-- Logs begin at Sat 2021-11-27 20:01:15 UTC, end at Sat 2021-11-27 22:28:26 UTC. -- Nov 27 20:29:54.358914 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Nov 27 20:29:54.367696 ncdv-master-1 devstack@keystone.service[90110]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 27 20:29:54.369702 ncdv-master-1 devstack@keystone.service[90110]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Nov 27 20:29:54 2021] *** Nov 27 20:29:54.369702 ncdv-master-1 devstack@keystone.service[90110]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 27 20:29:54.369702 ncdv-master-1 devstack@keystone.service[90110]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 27 20:29:54.369702 ncdv-master-1 devstack@keystone.service[90110]: nodename: ncdv-master-1 Nov 27 20:29:54.369702 ncdv-master-1 devstack@keystone.service[90110]: machine: x86_64 Nov 27 20:29:54.369702 ncdv-master-1 devstack@keystone.service[90110]: clock source: unix Nov 27 20:29:54.369702 ncdv-master-1 devstack@keystone.service[90110]: pcre jit disabled Nov 27 20:29:54.369702 ncdv-master-1 devstack@keystone.service[90110]: detected number of CPU cores: 4 Nov 27 20:29:54.369702 ncdv-master-1 devstack@keystone.service[90110]: current working directory: / Nov 27 20:29:54.369702 ncdv-master-1 devstack@keystone.service[90110]: detected binary path: /usr/bin/uwsgi-core Nov 27 20:29:54.369702 ncdv-master-1 devstack@keystone.service[90110]: your processes number limit is 47680 Nov 27 20:29:54.370355 ncdv-master-1 devstack@keystone.service[90110]: your memory page size is 4096 bytes Nov 27 20:29:54.370355 ncdv-master-1 devstack@keystone.service[90110]: detected max file descriptor number: 2048 Nov 27 20:29:54.370355 ncdv-master-1 devstack@keystone.service[90110]: lock engine: pthread robust mutexes Nov 27 20:29:54.370355 ncdv-master-1 devstack@keystone.service[90110]: thunder lock: enabled Nov 27 20:29:54.370355 ncdv-master-1 devstack@keystone.service[90110]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 27 20:29:54.370355 ncdv-master-1 devstack@keystone.service[90110]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 27 20:29:54.421320 ncdv-master-1 devstack@keystone.service[90110]: Python main interpreter initialized at 0x5647598749c0 Nov 27 20:29:54.421320 ncdv-master-1 devstack@keystone.service[90110]: python threads support enabled Nov 27 20:29:54.421320 ncdv-master-1 devstack@keystone.service[90110]: your server socket listen backlog is limited to 100 connections Nov 27 20:29:54.421320 ncdv-master-1 devstack@keystone.service[90110]: your mercy for graceful operations on workers is 90 seconds Nov 27 20:29:54.421701 ncdv-master-1 devstack@keystone.service[90110]: mapped 403077 bytes (393 KB) for 2 cores Nov 27 20:29:54.421789 ncdv-master-1 devstack@keystone.service[90110]: *** Operational MODE: preforking *** Nov 27 20:29:54.422023 ncdv-master-1 devstack@keystone.service[90110]: *** uWSGI is running in multiple interpreter mode *** Nov 27 20:29:54.422023 ncdv-master-1 devstack@keystone.service[90110]: spawned uWSGI master process (pid: 90110) Nov 27 20:29:54.422239 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Nov 27 20:29:54.425120 ncdv-master-1 devstack@keystone.service[90110]: spawned uWSGI worker 1 (pid: 90122, cores: 1) Nov 27 20:29:54.425120 ncdv-master-1 devstack@keystone.service[90110]: spawned uWSGI worker 2 (pid: 90123, cores: 1) Nov 27 20:29:54.425120 ncdv-master-1 devstack@keystone.service[90110]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 27 20:29:59.810510 ncdv-master-1 devstack@keystone.service[90123]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:29:59.810510 ncdv-master-1 devstack@keystone.service[90123]: from cryptography.utils import int_from_bytes Nov 27 20:29:59.811407 ncdv-master-1 devstack@keystone.service[90122]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:29:59.811407 ncdv-master-1 devstack@keystone.service[90122]: from cryptography.utils import int_from_bytes Nov 27 20:29:59.811860 ncdv-master-1 devstack@keystone.service[90123]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:29:59.811860 ncdv-master-1 devstack@keystone.service[90123]: from cryptography.utils import int_from_bytes Nov 27 20:29:59.811995 ncdv-master-1 devstack@keystone.service[90122]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 27 20:29:59.811995 ncdv-master-1 devstack@keystone.service[90122]: from cryptography.utils import int_from_bytes Nov 27 20:29:59.859572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 27 20:29:59.859762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 27 20:29:59.859885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 27 20:29:59.859982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] command line args: [] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 27 20:29:59.860064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 27 20:29:59.860210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 27 20:29:59.860302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] command line args: [] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 27 20:29:59.860383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ================================================================================ {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 27 20:29:59.860518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 27 20:29:59.860623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] admin_token = **** {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.860705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ================================================================================ {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 27 20:29:59.860847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] config_dir = [] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.860945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] admin_token = **** {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.861026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.861168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] config_dir = [] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.861254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] config_source = [] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.861357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] debug = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.861448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.861528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] config_source = [] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.861605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.861788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] debug = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.861918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.862032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.862164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.862269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.862269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.862473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.862571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.862678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.862784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] list_limit = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.862887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.862990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] log_config_append = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.863092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] list_limit = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.863201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.863349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] log_config_append = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.863451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] log_dir = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.863563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.863677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] log_file = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.863781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] log_dir = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.863890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.863978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] log_file = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.864089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.864170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.864252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.864332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.864406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.864536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.864622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.864697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.864823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.864909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.864991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.865066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.865190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.865274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.865349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.865471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.865561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.865643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.865761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.865848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.865992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.866078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.866237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.866318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.866479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.866602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.866724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.866814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.867000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.867217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.867418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] publish_errors = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.867514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.21/identity {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.867648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.867736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] publish_errors = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.867874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.867962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.868036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.868160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.868278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.868366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.868502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.868589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.868725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] standard_threads = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.868806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.868950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.869037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] standard_threads = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.869179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.869259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.869338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.869456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.869541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] use_journal = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.869620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.869702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] use_json = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.869777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] use_journal = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.869856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] use_stderr = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.869935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] use_json = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.870013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] use_syslog = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.870093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] use_stderr = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.870199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.870291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] use_syslog = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.870441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 27 20:29:59.870527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.870673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.870753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.870921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.871008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.871156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.871235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.871429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.871517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.871688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.871771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.871928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.872008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.872159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.872244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.872401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.872481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.872642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.872722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.872889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.872969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.873120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.873200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.873357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.873443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.873587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.873677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.873827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.873907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.874068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.874149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.874302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.874428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.874530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.874627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.874779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.874887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.875022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.875136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.875244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.875364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.875778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.875865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.876035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.876128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.876283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.876365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.876531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.876616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.876761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.876895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.876975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.877050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.877204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.877291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.877432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.877587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.877665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.877733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.877903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.877984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.878128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.878215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.878358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.878445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.878585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.878664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.878830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.878913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.879065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.879151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.879328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.879410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.879556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.879647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.879792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.879868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.880024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.880103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.880251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.880340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.880477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.880563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.880703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.880789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.880930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.881021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.881158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.881237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.881399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.881479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.881624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.881703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.881859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.881944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.882085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.882171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.882314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.882423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.882542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.882628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.882774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.882853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.883001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.883087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.883234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.883370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.883489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.883570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.883722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.883809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.883954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.884034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.884185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.884265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.884411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.884499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.884638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.884718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.884874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.884954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.885107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.885196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.885337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.885419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.885567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.885663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.885821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.885901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.886051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.886139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.886281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.886360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.886514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.886594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.886749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.886832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.886997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.887076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.887272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.887354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.887510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.887592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.887752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.887833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.887988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.888075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.888221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.888311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.888455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.888534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.888686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.888765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.888911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.888993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.889137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.889218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.889369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.889455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.889618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.889699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.889854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.889936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.890084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.890164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.890313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.890393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.890538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.890623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.890765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.890846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.890990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.891070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.891220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.891332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.891480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.891566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.891716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.891811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.891948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.892027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.892188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.892267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.892442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.892531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.892681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.892762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.892919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] auth.external = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.893022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.893136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.893234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] auth.external = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.893363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.893444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.893646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.893726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.893874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] auth.password = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.893964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.894102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] auth.password = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.894189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] auth.token = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.894333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] auth.token = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.894421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.894564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.894652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.894797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.894882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.895023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.895103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.895290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.895375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.895521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.895600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.895757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.895842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.895988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.896079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] credential.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.896225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] credential.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.896315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.896467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.896547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.896712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.896794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.896947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.897030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.897182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.897263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.897414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.897493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.897647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.897728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.897894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.897981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.898126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.898207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.898372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.898453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.898625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.898708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.898878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.898957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.899140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.899223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.899428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.899512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.899659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.899739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.899893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] federation.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.899965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.900133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.900215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] federation.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.900377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.900458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.900623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.900704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.900850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.900929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.901091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.901177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.901323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.901404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.901568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.901649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.901799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.901878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.902046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.902127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.902279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.902365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.902523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.902604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.903321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.903406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.903547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.903629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.903794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.903876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.904028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.904116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.904262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.904342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.904498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.904579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.904724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.904805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.904960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.905041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.905196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.905275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.905444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.905526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.905674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.905756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.905902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.905983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.906130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.906211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.906363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.906445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.906606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.906686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.906850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.906932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.907095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.907175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.907358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.907454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.907612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.907712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.907851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.907931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.908085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.908175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.908314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.908396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.908548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.908630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.908777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.908866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.909005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.909089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.909238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.909318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.909473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.909563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.909710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.909790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.909933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.910025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.910177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.910255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.910417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.910503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.910649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.910732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.910881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.910973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.911121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.911202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.911371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.911455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.911606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.911697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.911831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.911911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.912063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.912145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.912294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.912385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.912528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.912608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.912760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.912840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.912993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.913081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.913231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.913313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.913474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.913554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.913705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.913794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.913933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.914015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.914161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.914241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.914410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.914498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.914643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.914725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.914876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.914958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.915108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.915197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.915356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.915438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.915590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.915670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.915830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.915927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.916057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.916137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.916306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.916387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.916548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.916636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.916788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.916868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.917020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.917102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.917247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.917337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.917473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.917553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.917700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.917780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.917930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.918019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.918154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.918234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.918974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.919070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.919215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.919356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.919484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.919573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.919730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.919812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.919976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.920066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.920205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.920287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.920448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.920529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.920683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.920766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.920914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.920996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.921147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.921229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.921379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.921462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.921615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.921697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.921857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.921937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.922091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.922174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.922325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.922409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.922556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.922636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.922796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.922878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.923028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.923109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.923272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.923357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.923513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.923597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.923746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.923826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.923984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.924064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.924213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.924296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.924449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.924530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.924684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.924766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] resource.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.924926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] resource.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.925009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.925167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.925247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.925401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.925482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.925635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.925717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.925880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.925960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.926114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.926203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.926349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.926426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.926583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.926665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.926817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.926896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.927050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] role.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.927132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.927312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] role.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.927415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] role.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.927550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.927635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] role.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.927777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.927860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.928024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.928105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.928269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.928351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.928515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.928599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.928758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.928839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.928999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.929081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.929243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.929324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.929486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.929567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.929714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.929796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.929950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.930031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.930190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.930270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.930433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.930513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.930674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.930756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.930916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.931055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.931312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.931409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.931555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.931637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.931798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.931879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.932043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.932134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.932288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.932370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.932518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.932600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.932753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.932843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.933004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.933084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.933239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.933321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.933467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.933557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.933694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.933777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.933922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.934003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.934176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.934266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.934427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.934509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.934669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.934749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.934902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.934992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.935134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.935216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.935387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.935470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.935616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.935709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] token.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.935847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.935928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] token.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.936079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.936159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.936315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.936403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.936549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.936630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.936798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.936878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.937032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.937122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.937267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.937353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.937509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.937591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.937752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.937841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.937986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.938068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.938223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.938304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.938454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.938548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.938686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.938766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.938929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.939010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.939156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.939239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.939444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.939520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.939656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.939738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.939922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.940005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.connection = **** {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.940160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.940247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.connection = **** {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.940406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.940488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.940640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.940729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.940876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.940963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.941105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.941186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.941338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.941421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.941572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.941652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.941801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.941881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.942038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.942120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.942296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.942385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.942533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.942623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.942762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.942843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.942997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.943086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.943227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.943377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.943492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.943584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.943717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.943807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.943955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.944037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.944185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.944267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.944342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 27 20:29:59.944428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 27 20:29:59.944572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 27 20:29:59.975391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:29:59.975617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:29:59.975710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:29:59.975841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:29:59.976021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:29:59.976103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:29:59.984961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:29:59.985109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.013526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.013662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.013745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.013820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.067891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.068367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.117251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.117478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.118104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.118341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.185858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.186087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.186176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.186306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.186390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.186523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.186617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.186738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.186821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.186943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.187028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.187225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.211085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.211344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.211441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.211569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.211667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.211792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.211877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.212055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.212146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.212222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.212306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.212423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.212507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.212639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.223378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.223760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.236390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.236637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.236732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.236845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.236943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.237069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.237153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.237287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.237421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.237501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.237585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.237703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90122) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.237787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.237953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90123) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 27 20:30:00.254877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.254984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.255076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 27 20:30:00.255155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 27 20:30:00.255436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.255523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.255640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 27 20:30:00.255736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 27 20:30:00.255911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.255994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.256171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.256253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.256427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.256518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.256683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.256766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.267862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.268021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.268125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.268266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.268392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.268542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.268670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.268826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.276562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.276791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.279835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.280103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.280192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.280380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.280462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.280659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.280743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.280939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.281030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.281196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.281279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.281459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.281542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.281725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.281808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.281997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.282102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.282372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.282454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.282638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.282720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.282907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.308781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.309224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.310400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.310678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.310794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.311076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.315938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.316218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.316357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.316496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.316642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.316924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.323664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.323896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.324042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.324326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.328768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.329053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.329209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.329334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.329499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.329613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.329784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.329991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.330075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.330268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.330441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.330523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.330723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.330813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.331002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.331298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.348981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.349257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.349576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.349858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.353825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.354445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.357924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.358216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.358588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.358873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.363127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.363830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.366634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.367369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.370189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.370483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.370764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.370924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.371159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.371242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.371525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.371608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.371813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.371978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.372259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.372548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.391048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.391355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.391623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.391877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.391961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.392158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.392426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.392692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.399727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.400631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.401378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.401652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.402299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.402579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.404693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.404970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.405246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.405523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.405618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.405799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.405884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.406167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.406448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.406728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.420552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.420832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.421111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.421388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.421606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.421692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.421886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.421969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.422170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.422256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.422452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.422743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.423016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.423330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.440193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.443291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.443537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.444732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.446751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.448050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.448335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.449681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.449977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.450254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.450540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.451322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.451614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.451908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.457771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.459123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.459339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.460722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.462481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.462769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.463051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.463348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.463890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.464183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.464478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.464758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.472258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.472544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.472823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.473711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.473998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.474278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.480616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90122) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.481412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.481688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.481957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.482223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.482490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.482623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90123) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 27 20:30:00.482764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.482906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.483044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.483187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.483352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.483488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.483617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.483760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.483883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.484039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.484123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.484318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.484404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.484595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.484680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90122) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.484878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.485146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.485426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.485688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.485958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.486228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90123) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 27 20:30:00.522439 ncdv-master-1 devstack@keystone.service[90122]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647598749c0 pid: 90122 (default app) Nov 27 20:30:00.524382 ncdv-master-1 devstack@keystone.service[90123]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647598749c0 pid: 90123 (default app) Nov 27 20:30:00.525802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcf746-5e36-4c28-9635-537290a6a27b None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:00.526090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcf746-5e36-4c28-9635-537290a6a27b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:00.526364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcf746-5e36-4c28-9635-537290a6a27b None None] PATH_INFO: `/v3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:00.531182 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 791 bytes} [Sat Nov 27 20:30:00 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:08.481710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a77df-f963-4e6d-889f-053f7e11f7bb None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:08.482195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a77df-f963-4e6d-889f-053f7e11f7bb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:08.482279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a77df-f963-4e6d-889f-053f7e11f7bb None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:08.487453 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1/2] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:08 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:30:08.493106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed3cf4-4078-4200-abc2-1c1465ce1170 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:08.493496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed3cf4-4078-4200-abc2-1c1465ce1170 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:08.493654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed3cf4-4078-4200-abc2-1c1465ce1170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:08.524254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG oslo_db.sqlalchemy.engines [None req-98ed3cf4-4078-4200-abc2-1c1465ce1170 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:30:08.805037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG passlib.handlers.bcrypt [None req-98ed3cf4-4078-4200-abc2-1c1465ce1170 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=90122) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 27 20:30:08.805456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG passlib.handlers.bcrypt [None req-98ed3cf4-4078-4200-abc2-1c1465ce1170 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90122) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 27 20:30:08.860671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-98ed3cf4-4078-4200-abc2-1c1465ce1170 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:08.862297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-98ed3cf4-4078-4200-abc2-1c1465ce1170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:08.990115 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2/3] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:09.026599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a77df-f963-4e6d-889f-053f7e11f7bb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:09.060312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG oslo_db.sqlalchemy.engines [None req-392a77df-f963-4e6d-889f-053f7e11f7bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 27 20:30:09.283095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a77df-f963-4e6d-889f-053f7e11f7bb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:09.287375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344913d-0f3d-456c-a312-a8f7de9b20ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:09.288031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344913d-0f3d-456c-a312-a8f7de9b20ae admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:09.288317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344913d-0f3d-456c-a312-a8f7de9b20ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:09.288594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344913d-0f3d-456c-a312-a8f7de9b20ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:09.297618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344913d-0f3d-456c-a312-a8f7de9b20ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:09.347548 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f344913d-0f3d-456c-a312-a8f7de9b20ae admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 27 20:30:09.347832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344913d-0f3d-456c-a312-a8f7de9b20ae admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:09.357977 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2/4] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:09.364464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed3cf4-4078-4200-abc2-1c1465ce1170 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:09.379434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed3cf4-4078-4200-abc2-1c1465ce1170 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:09.383832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722cd46-7597-42c4-817b-720113d952b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:09.384912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722cd46-7597-42c4-817b-720113d952b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:09.385199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722cd46-7597-42c4-817b-720113d952b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:09.385483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722cd46-7597-42c4-817b-720113d952b8 admin admin] PATH_INFO: `/v3/projects/bb5d1bf085ae456f8f7285f5a202640b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:09.387005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722cd46-7597-42c4-817b-720113d952b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb5d1bf085ae456f8f7285f5a202640b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:09.439022 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3722cd46-7597-42c4-817b-720113d952b8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 27 20:30:09.439454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722cd46-7597-42c4-817b-720113d952b8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:09.444298 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3/5] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:09 2021] GET /identity/v3/projects/bb5d1bf085ae456f8f7285f5a202640b => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:11.830674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03097036-3342-405a-a623-1a33c3d11166 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:11.831182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03097036-3342-405a-a623-1a33c3d11166 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:11.831283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03097036-3342-405a-a623-1a33c3d11166 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:11.835774 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3/6] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:11 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:11.842429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240896-be70-475b-b2d0-c983c1c0b62c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:11.842864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240896-be70-475b-b2d0-c983c1c0b62c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:11.842983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240896-be70-475b-b2d0-c983c1c0b62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:11.862065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4b240896-be70-475b-b2d0-c983c1c0b62c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:11.863653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4b240896-be70-475b-b2d0-c983c1c0b62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:11.871659 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4/7] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:11.895455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03097036-3342-405a-a623-1a33c3d11166 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:11.909534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03097036-3342-405a-a623-1a33c3d11166 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:11.913773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4311d9-49b0-4739-891b-7d7734b9c415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:11.914409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4311d9-49b0-4739-891b-7d7734b9c415 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:11.914697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4311d9-49b0-4739-891b-7d7734b9c415 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:11.914976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4311d9-49b0-4739-891b-7d7734b9c415 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:11.923238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4311d9-49b0-4739-891b-7d7734b9c415 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:11.925043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4311d9-49b0-4739-891b-7d7734b9c415 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:11.934191 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4/8] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:30:11.945493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b240896-be70-475b-b2d0-c983c1c0b62c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:11.954515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b240896-be70-475b-b2d0-c983c1c0b62c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:11.958948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e55878-6aa9-40d3-8509-7f847e629908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:11.959849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55878-6aa9-40d3-8509-7f847e629908 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:11.960135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55878-6aa9-40d3-8509-7f847e629908 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:11.960412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55878-6aa9-40d3-8509-7f847e629908 admin admin] PATH_INFO: `/v3/users/3ad02887ca234176a8ab03d817e9a1ba` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:11.961819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e55878-6aa9-40d3-8509-7f847e629908 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad02887ca234176a8ab03d817e9a1ba)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:11.963688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e55878-6aa9-40d3-8509-7f847e629908 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:11.965729 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 5/9] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:11 2021] GET /identity/v3/users/3ad02887ca234176a8ab03d817e9a1ba => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:14.430498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01dd89-b00a-4ff9-ab5a-b91dc3b8955e None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:14.431019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01dd89-b00a-4ff9-ab5a-b91dc3b8955e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:14.431019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01dd89-b00a-4ff9-ab5a-b91dc3b8955e None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:14.432799 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 5/10] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:14.438657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c2edc-e2e3-4078-9541-c1e66f6af817 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:14.439057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c2edc-e2e3-4078-9541-c1e66f6af817 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:14.439234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c2edc-e2e3-4078-9541-c1e66f6af817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:14.458177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e94c2edc-e2e3-4078-9541-c1e66f6af817 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:14.459492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e94c2edc-e2e3-4078-9541-c1e66f6af817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:14.467521 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 6/11] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:14.476483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479d684-895b-4a03-9d1f-cbec1ee6ed88 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:14.476839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479d684-895b-4a03-9d1f-cbec1ee6ed88 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:14.477182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479d684-895b-4a03-9d1f-cbec1ee6ed88 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:14.478960 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 6/12] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:14.484454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44149-99aa-4dba-bc1e-15427b657d49 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:14.484742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44149-99aa-4dba-bc1e-15427b657d49 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:14.485020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44149-99aa-4dba-bc1e-15427b657d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:14.492169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479d684-895b-4a03-9d1f-cbec1ee6ed88 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:14.503600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1de44149-99aa-4dba-bc1e-15427b657d49 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:14.504794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1de44149-99aa-4dba-bc1e-15427b657d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:14.504917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479d684-895b-4a03-9d1f-cbec1ee6ed88 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:14.509094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230ee08-681f-4297-b6ab-a7bf17068789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:14.509861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230ee08-681f-4297-b6ab-a7bf17068789 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:14.510143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230ee08-681f-4297-b6ab-a7bf17068789 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:14.510418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230ee08-681f-4297-b6ab-a7bf17068789 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:14.513178 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 7/13] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:14.526566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230ee08-681f-4297-b6ab-a7bf17068789 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:14.533896 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-e230ee08-681f-4297-b6ab-a7bf17068789 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:30:14.535242 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 7/14] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:30:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:30:14.538082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de44149-99aa-4dba-bc1e-15427b657d49 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:14.541125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230ee08-681f-4297-b6ab-a7bf17068789 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:14.547095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de44149-99aa-4dba-bc1e-15427b657d49 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:14.551550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230ee08-681f-4297-b6ab-a7bf17068789 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:14.551815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505d57f-4c37-416f-805a-f5e34ce1e260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:14.552498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d57f-4c37-416f-805a-f5e34ce1e260 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:14.552728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d57f-4c37-416f-805a-f5e34ce1e260 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:14.553004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d57f-4c37-416f-805a-f5e34ce1e260 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:14.555872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae6edd-96c3-4413-b798-8b957b0fcdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:14.556512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae6edd-96c3-4413-b798-8b957b0fcdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:14.556794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae6edd-96c3-4413-b798-8b957b0fcdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:14.557071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae6edd-96c3-4413-b798-8b957b0fcdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:14.557823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae6edd-96c3-4413-b798-8b957b0fcdd9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:14.558124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae6edd-96c3-4413-b798-8b957b0fcdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:14.559869 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-b9ae6edd-96c3-4413-b798-8b957b0fcdd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:14.559869 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:30:14.559869 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:30:14.560771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae6edd-96c3-4413-b798-8b957b0fcdd9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:14.561192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505d57f-4c37-416f-805a-f5e34ce1e260 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:14.562969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505d57f-4c37-416f-805a-f5e34ce1e260 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:14.571896 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 8/15] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:14.575987 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 8/16] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:14.578823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505d57f-4c37-416f-805a-f5e34ce1e260 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:14.581804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae6edd-96c3-4413-b798-8b957b0fcdd9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:14.587284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505d57f-4c37-416f-805a-f5e34ce1e260 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:14.591721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae6edd-96c3-4413-b798-8b957b0fcdd9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:14.592143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e145db-7581-4c1d-8b6b-e9f4f3c38306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:14.592894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e145db-7581-4c1d-8b6b-e9f4f3c38306 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:14.593176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e145db-7581-4c1d-8b6b-e9f4f3c38306 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:14.593448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e145db-7581-4c1d-8b6b-e9f4f3c38306 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:14.594634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e145db-7581-4c1d-8b6b-e9f4f3c38306 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:14.596144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640216c-4a9c-4aa2-855c-00bf111c6baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:14.596363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e145db-7581-4c1d-8b6b-e9f4f3c38306 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:14.596966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640216c-4a9c-4aa2-855c-00bf111c6baa admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:14.597249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640216c-4a9c-4aa2-855c-00bf111c6baa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:14.597524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640216c-4a9c-4aa2-855c-00bf111c6baa admin admin] PATH_INFO: `/v3/users/3ad02887ca234176a8ab03d817e9a1ba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:14.598062 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 9/17] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:14.599214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640216c-4a9c-4aa2-855c-00bf111c6baa admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad02887ca234176a8ab03d817e9a1ba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:14.601062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640216c-4a9c-4aa2-855c-00bf111c6baa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:14.602862 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 9/18] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:14 2021] GET /identity/v3/users/3ad02887ca234176a8ab03d817e9a1ba => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:14.608750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e145db-7581-4c1d-8b6b-e9f4f3c38306 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:14.619172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e145db-7581-4c1d-8b6b-e9f4f3c38306 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:14.623893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46f54a-3d4d-4a54-b46e-50aa0702c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:14.624701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46f54a-3d4d-4a54-b46e-50aa0702c932 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:14.624987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46f54a-3d4d-4a54-b46e-50aa0702c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:14.625521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46f54a-3d4d-4a54-b46e-50aa0702c932 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:14.626769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46f54a-3d4d-4a54-b46e-50aa0702c932 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:14.628598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46f54a-3d4d-4a54-b46e-50aa0702c932 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:14.630274 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 10/19] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:14.637239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640216c-4a9c-4aa2-855c-00bf111c6baa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:14.647235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640216c-4a9c-4aa2-855c-00bf111c6baa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:14.651956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39d41c-af4d-435b-b706-308c1a0eff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:14.653249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39d41c-af4d-435b-b706-308c1a0eff3b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:14.653532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39d41c-af4d-435b-b706-308c1a0eff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:14.653804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39d41c-af4d-435b-b706-308c1a0eff3b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:14.654677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39d41c-af4d-435b-b706-308c1a0eff3b admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.domain.id=default, user.id=3ad02887ca234176a8ab03d817e9a1ba) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:14.654990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39d41c-af4d-435b-b706-308c1a0eff3b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:14.656056 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-ff39d41c-af4d-435b-b706-308c1a0eff3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:14.656056 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:30:14.656056 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:30:14.657259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39d41c-af4d-435b-b706-308c1a0eff3b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:14.669264 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 10/20] 10.222.0.21 () {56 vars in 1343 bytes} [Sat Nov 27 20:30:14 2021] GET /identity/v3/role_assignments?user.id=3ad02887ca234176a8ab03d817e9a1ba&scope.domain.id=default&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:17.822486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c41e51-4a98-4dbc-be39-4a5421942249 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:17.822486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c41e51-4a98-4dbc-be39-4a5421942249 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:17.822486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c41e51-4a98-4dbc-be39-4a5421942249 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:17.823909 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 11/21] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:17.834411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625be3-6aed-4369-9212-d9526226b2dc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:17.834411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625be3-6aed-4369-9212-d9526226b2dc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:17.834411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6625be3-6aed-4369-9212-d9526226b2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:17.874051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG passlib.handlers.bcrypt [None req-f6625be3-6aed-4369-9212-d9526226b2dc None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=90123) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 27 20:30:17.874485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG passlib.handlers.bcrypt [None req-f6625be3-6aed-4369-9212-d9526226b2dc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90123) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 27 20:30:17.924362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f6625be3-6aed-4369-9212-d9526226b2dc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:17.926018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f6625be3-6aed-4369-9212-d9526226b2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:17.961911 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 11/22] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:17.984862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a272d5-1494-426e-afba-406f3a6128ce None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:17.985464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a272d5-1494-426e-afba-406f3a6128ce None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:17.985942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a272d5-1494-426e-afba-406f3a6128ce None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:17.987917 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 12/23] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:17.994467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e61d0-2a49-478b-b56c-4cde2d502d7c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:17.994757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e61d0-2a49-478b-b56c-4cde2d502d7c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:17.995036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e61d0-2a49-478b-b56c-4cde2d502d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:17.998902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c55c8-e880-4a7f-873d-2e307fe50081 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:17.999479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c55c8-e880-4a7f-873d-2e307fe50081 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:17.999972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c55c8-e880-4a7f-873d-2e307fe50081 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.006081 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 13/24] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:18.007139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c55c8-e880-4a7f-873d-2e307fe50081 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:18.023365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e07e61d0-2a49-478b-b56c-4cde2d502d7c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:18.024792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e07e61d0-2a49-478b-b56c-4cde2d502d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:18.033316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c55c8-e880-4a7f-873d-2e307fe50081 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:18.038098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4a18-5c88-4da8-a416-c7197b551114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:18.039337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4a18-5c88-4da8-a416-c7197b551114 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.039814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4a18-5c88-4da8-a416-c7197b551114 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.040272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4a18-5c88-4da8-a416-c7197b551114 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.040931 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 12/25] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:18.042111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce465d-0a02-4cc3-b44f-310e27b0f0a5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.051275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce465d-0a02-4cc3-b44f-310e27b0f0a5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.051275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce465d-0a02-4cc3-b44f-310e27b0f0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.069893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca4a18-5c88-4da8-a416-c7197b551114 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:18.079102 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-2cca4a18-5c88-4da8-a416-c7197b551114 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:30:18.081038 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 14/26] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:30:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:18.082050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4a18-5c88-4da8-a416-c7197b551114 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:18.084751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3dce465d-0a02-4cc3-b44f-310e27b0f0a5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:18.091463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3dce465d-0a02-4cc3-b44f-310e27b0f0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:18.100446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4a18-5c88-4da8-a416-c7197b551114 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:18.107239 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 13/27] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:18.112401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce465d-0a02-4cc3-b44f-310e27b0f0a5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:18.122585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce465d-0a02-4cc3-b44f-310e27b0f0a5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:18.135445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4480d4-6feb-4372-b860-145a4707e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:18.136537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4480d4-6feb-4372-b860-145a4707e5be admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.136839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05087579-2f68-4e21-8a5b-0eb9cc0b3036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:18.137283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4480d4-6feb-4372-b860-145a4707e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.137501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087579-2f68-4e21-8a5b-0eb9cc0b3036 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.137780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087579-2f68-4e21-8a5b-0eb9cc0b3036 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.138052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087579-2f68-4e21-8a5b-0eb9cc0b3036 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.138391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4480d4-6feb-4372-b860-145a4707e5be admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.138810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05087579-2f68-4e21-8a5b-0eb9cc0b3036 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:18.143273 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-05087579-2f68-4e21-8a5b-0eb9cc0b3036 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:18.143273 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:30:18.143273 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:30:18.143273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05087579-2f68-4e21-8a5b-0eb9cc0b3036 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:18.144133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4480d4-6feb-4372-b860-145a4707e5be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:18.144653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4480d4-6feb-4372-b860-145a4707e5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:18.146505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4480d4-6feb-4372-b860-145a4707e5be admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:18.155919 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 14/28] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:18.162246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4480d4-6feb-4372-b860-145a4707e5be admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:18.180527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4480d4-6feb-4372-b860-145a4707e5be admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:18.195061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946a7c5-d7d3-4498-a1a4-c2a8b9268859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:18.196240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a7c5-d7d3-4498-a1a4-c2a8b9268859 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.196729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a7c5-d7d3-4498-a1a4-c2a8b9268859 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.197229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a7c5-d7d3-4498-a1a4-c2a8b9268859 admin admin] PATH_INFO: `/v3/users/3ad02887ca234176a8ab03d817e9a1ba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.208422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946a7c5-d7d3-4498-a1a4-c2a8b9268859 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad02887ca234176a8ab03d817e9a1ba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:18.210564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946a7c5-d7d3-4498-a1a4-c2a8b9268859 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:18.212537 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 15/29] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:18 2021] GET /identity/v3/users/3ad02887ca234176a8ab03d817e9a1ba => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:18.213492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946a7c5-d7d3-4498-a1a4-c2a8b9268859 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:18.236450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946a7c5-d7d3-4498-a1a4-c2a8b9268859 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:18.251881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e1b57-9767-4dc5-9ca1-06460d8b69d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:18.252683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e1b57-9767-4dc5-9ca1-06460d8b69d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.252966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e1b57-9767-4dc5-9ca1-06460d8b69d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.253242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e1b57-9767-4dc5-9ca1-06460d8b69d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.276603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e1b57-9767-4dc5-9ca1-06460d8b69d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:18.278557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e1b57-9767-4dc5-9ca1-06460d8b69d0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:18.300400 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 15/30] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:30:18 2021] POST /identity/v3/roles => generated 219 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:18.300569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05087579-2f68-4e21-8a5b-0eb9cc0b3036 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:18.301871 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-9c1e1b57-9767-4dc5-9ca1-06460d8b69d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:30:18.303243 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 16/31] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:18.304399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debf256-911f-481d-9ba1-3cde590b8b06 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.304722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debf256-911f-481d-9ba1-3cde590b8b06 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.305472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debf256-911f-481d-9ba1-3cde590b8b06 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.306964 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 17/32] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:18.314342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219903-bc76-440b-bbc3-128a69bf9f54 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.314342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219903-bc76-440b-bbc3-128a69bf9f54 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.314562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219903-bc76-440b-bbc3-128a69bf9f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.321645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05087579-2f68-4e21-8a5b-0eb9cc0b3036 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:18.341255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa906d2a-fc75-4485-9357-a738638df1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:18.341994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906d2a-fc75-4485-9357-a738638df1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.343221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906d2a-fc75-4485-9357-a738638df1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.343221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa906d2a-fc75-4485-9357-a738638df1b8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.345021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa906d2a-fc75-4485-9357-a738638df1b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:18.346921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa906d2a-fc75-4485-9357-a738638df1b8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:18.351449 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 16/33] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:18.352373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa906d2a-fc75-4485-9357-a738638df1b8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:18.360137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6c219903-bc76-440b-bbc3-128a69bf9f54 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:18.361357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6c219903-bc76-440b-bbc3-128a69bf9f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:18.375351 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 18/34] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:18.375351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219903-bc76-440b-bbc3-128a69bf9f54 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:18.377959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa906d2a-fc75-4485-9357-a738638df1b8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:18.391010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219903-bc76-440b-bbc3-128a69bf9f54 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:18.393244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1a007-3755-4030-a6e9-8034cf966b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:18.393923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1a007-3755-4030-a6e9-8034cf966b26 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.394210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1a007-3755-4030-a6e9-8034cf966b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.394483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1a007-3755-4030-a6e9-8034cf966b26 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.395237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1a007-3755-4030-a6e9-8034cf966b26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:18.395568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1a007-3755-4030-a6e9-8034cf966b26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:18.396995 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-52b1a007-3755-4030-a6e9-8034cf966b26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:18.396995 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:30:18.396995 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:30:18.397931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1a007-3755-4030-a6e9-8034cf966b26 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:18.422397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659d0ee-1c73-4559-a8ac-02581adbf15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:18.423309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d0ee-1c73-4559-a8ac-02581adbf15e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.423591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d0ee-1c73-4559-a8ac-02581adbf15e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.423870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d0ee-1c73-4559-a8ac-02581adbf15e admin admin] PATH_INFO: `/v3/domains/default/users/3ad02887ca234176a8ab03d817e9a1ba/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.426224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659d0ee-1c73-4559-a8ac-02581adbf15e admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3ad02887ca234176a8ab03d817e9a1ba, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:18.427285 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-8659d0ee-1c73-4559-a8ac-02581adbf15e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:18.427285 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:30:18.427285 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:30:18.429348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659d0ee-1c73-4559-a8ac-02581adbf15e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:18.446948 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 17/35] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:30:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:18.447827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1a007-3755-4030-a6e9-8034cf966b26 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:18.487137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1a007-3755-4030-a6e9-8034cf966b26 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:18.608466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e942f-c126-4e10-a5b5-c3e472a1d567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:18.609186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e942f-c126-4e10-a5b5-c3e472a1d567 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.609538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e942f-c126-4e10-a5b5-c3e472a1d567 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.609886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e942f-c126-4e10-a5b5-c3e472a1d567 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.610731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e942f-c126-4e10-a5b5-c3e472a1d567 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:18.612470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e942f-c126-4e10-a5b5-c3e472a1d567 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:18.625418 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 19/36] 10.222.0.21 () {58 vars in 1382 bytes} [Sat Nov 27 20:30:18 2021] PUT /identity/v3/domains/default/users/3ad02887ca234176a8ab03d817e9a1ba/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:30:18.626564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659d0ee-1c73-4559-a8ac-02581adbf15e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:18.637382 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 18/37] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:30:18 2021] POST /identity/v3/roles => generated 225 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:18.650706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659d0ee-1c73-4559-a8ac-02581adbf15e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:18.662285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676758c-3f84-4c99-b3e4-72f727ee8014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:18.662971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676758c-3f84-4c99-b3e4-72f727ee8014 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:18.663305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676758c-3f84-4c99-b3e4-72f727ee8014 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:18.663593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676758c-3f84-4c99-b3e4-72f727ee8014 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:18.664387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676758c-3f84-4c99-b3e4-72f727ee8014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:18.665791 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-5676758c-3f84-4c99-b3e4-72f727ee8014 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:18.665791 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:30:18.665791 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:30:18.667093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676758c-3f84-4c99-b3e4-72f727ee8014 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:18.720915 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 20/38] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:30:18 2021] POST /identity/v3/projects => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:19.026355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0c4a-4763-4b94-8a6b-d70996c62df3 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:19.026974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0c4a-4763-4b94-8a6b-d70996c62df3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:19.026974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0c4a-4763-4b94-8a6b-d70996c62df3 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:19.028802 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 19/39] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:19.035129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eb7ca-2b81-4d21-9400-16537a309524 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:19.035643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eb7ca-2b81-4d21-9400-16537a309524 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:19.035716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eb7ca-2b81-4d21-9400-16537a309524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:19.063959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3b8eb7ca-2b81-4d21-9400-16537a309524 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:19.065490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3b8eb7ca-2b81-4d21-9400-16537a309524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:19.145015 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 21/40] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:19.159951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c013-c753-4b73-8e17-82f9281d0407 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:19.160391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c013-c753-4b73-8e17-82f9281d0407 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:19.160757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c013-c753-4b73-8e17-82f9281d0407 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:19.162736 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 20/41] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:19.168884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469612-7fbd-4d9c-aada-ae186a8140d6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:19.169359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73c013-c753-4b73-8e17-82f9281d0407 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:19.169483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469612-7fbd-4d9c-aada-ae186a8140d6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:19.169735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469612-7fbd-4d9c-aada-ae186a8140d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:19.187584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b9469612-7fbd-4d9c-aada-ae186a8140d6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:19.187967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73c013-c753-4b73-8e17-82f9281d0407 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:19.188782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b9469612-7fbd-4d9c-aada-ae186a8140d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:19.194972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d32bd-1664-48f1-9151-f28351654f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:19.195676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d32bd-1664-48f1-9151-f28351654f06 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:19.195958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d32bd-1664-48f1-9151-f28351654f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:19.196230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d32bd-1664-48f1-9151-f28351654f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:19.196989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d32bd-1664-48f1-9151-f28351654f06 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:19.199151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d32bd-1664-48f1-9151-f28351654f06 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:19.200470 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 22/42] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:19.212574 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 21/43] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:30:19 2021] POST /identity/v3/roles => generated 223 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:19.226681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469612-7fbd-4d9c-aada-ae186a8140d6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:19.236849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469612-7fbd-4d9c-aada-ae186a8140d6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:19.241871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f106b3-da76-4bd2-b2f2-c25789a39cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:19.243041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f106b3-da76-4bd2-b2f2-c25789a39cbd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:19.243515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f106b3-da76-4bd2-b2f2-c25789a39cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:19.243942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f106b3-da76-4bd2-b2f2-c25789a39cbd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:19.245459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f106b3-da76-4bd2-b2f2-c25789a39cbd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:19.247472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f106b3-da76-4bd2-b2f2-c25789a39cbd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:19.249356 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 23/44] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:19.256105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d32bd-1664-48f1-9151-f28351654f06 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:19.267338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d32bd-1664-48f1-9151-f28351654f06 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:19.272362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbddc1-80b6-49d5-8382-ac4010987024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:19.273293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbddc1-80b6-49d5-8382-ac4010987024 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:19.273759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbddc1-80b6-49d5-8382-ac4010987024 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:19.274185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbddc1-80b6-49d5-8382-ac4010987024 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:19.275074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbddc1-80b6-49d5-8382-ac4010987024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:19.276320 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-a8cbddc1-80b6-49d5-8382-ac4010987024 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:19.276320 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:30:19.276320 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:30:19.278534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbddc1-80b6-49d5-8382-ac4010987024 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:19.312014 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 22/45] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:30:19 2021] POST /identity/v3/projects => generated 312 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:21.194800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f8a0-9488-41c2-9880-c40f825f5cc5 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:21.195375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f8a0-9488-41c2-9880-c40f825f5cc5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:21.195375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f8a0-9488-41c2-9880-c40f825f5cc5 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:21.197177 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 24/46] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:21.202905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a36f6f-0313-485f-82c2-d5c98a1b0f45 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:21.203337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a36f6f-0313-485f-82c2-d5c98a1b0f45 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:21.203613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a36f6f-0313-485f-82c2-d5c98a1b0f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:21.222353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e0a36f6f-0313-485f-82c2-d5c98a1b0f45 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:21.223994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e0a36f6f-0313-485f-82c2-d5c98a1b0f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:21.279410 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 23/47] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:21.304559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f8a0-9488-41c2-9880-c40f825f5cc5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:21.320295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f8a0-9488-41c2-9880-c40f825f5cc5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:21.324589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c71822-c388-4e8f-8220-a7e916e717e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:21.325375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71822-c388-4e8f-8220-a7e916e717e4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:21.325665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71822-c388-4e8f-8220-a7e916e717e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:21.325948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71822-c388-4e8f-8220-a7e916e717e4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:21.336233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c71822-c388-4e8f-8220-a7e916e717e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:21.343330 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-11c71822-c388-4e8f-8220-a7e916e717e4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:30:21.344616 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 25/48] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:30:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:21.351167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a36f6f-0313-485f-82c2-d5c98a1b0f45 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:21.361206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a36f6f-0313-485f-82c2-d5c98a1b0f45 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:21.365731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b7d94-cbea-4488-ba67-7b5a3ef80f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:21.366418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b7d94-cbea-4488-ba67-7b5a3ef80f72 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:21.366701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b7d94-cbea-4488-ba67-7b5a3ef80f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:21.366977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b7d94-cbea-4488-ba67-7b5a3ef80f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:21.367804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b7d94-cbea-4488-ba67-7b5a3ef80f72 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:21.368111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b7d94-cbea-4488-ba67-7b5a3ef80f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:21.369145 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-138b7d94-cbea-4488-ba67-7b5a3ef80f72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:21.369145 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:30:21.369145 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:30:21.370067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b7d94-cbea-4488-ba67-7b5a3ef80f72 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:21.384187 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 24/49] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:21.392061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c71822-c388-4e8f-8220-a7e916e717e4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:21.404100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c71822-c388-4e8f-8220-a7e916e717e4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:21.408598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca1641-4ed0-4443-a25e-88d9d45acfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:21.409451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca1641-4ed0-4443-a25e-88d9d45acfbb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:21.409741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca1641-4ed0-4443-a25e-88d9d45acfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:21.410024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca1641-4ed0-4443-a25e-88d9d45acfbb admin admin] PATH_INFO: `/v3/users/3ad02887ca234176a8ab03d817e9a1ba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:21.411246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca1641-4ed0-4443-a25e-88d9d45acfbb admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad02887ca234176a8ab03d817e9a1ba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:21.413100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca1641-4ed0-4443-a25e-88d9d45acfbb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:21.414788 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 26/50] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:21 2021] GET /identity/v3/users/3ad02887ca234176a8ab03d817e9a1ba => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:21.420749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b7d94-cbea-4488-ba67-7b5a3ef80f72 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:21.434685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b7d94-cbea-4488-ba67-7b5a3ef80f72 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:21.439098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2dc15-05a1-49e3-9989-b07f13b47a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:21.439923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2dc15-05a1-49e3-9989-b07f13b47a06 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:21.440210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2dc15-05a1-49e3-9989-b07f13b47a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:21.440487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2dc15-05a1-49e3-9989-b07f13b47a06 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:21.441683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2dc15-05a1-49e3-9989-b07f13b47a06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:21.443457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2dc15-05a1-49e3-9989-b07f13b47a06 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:21.445099 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 25/51] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:21.451662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca1641-4ed0-4443-a25e-88d9d45acfbb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:21.461468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca1641-4ed0-4443-a25e-88d9d45acfbb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:21.466748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc01b5e-1ff0-44a0-8c46-d2bcf9579d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:21.467426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc01b5e-1ff0-44a0-8c46-d2bcf9579d9b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:21.467719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc01b5e-1ff0-44a0-8c46-d2bcf9579d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:21.468002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc01b5e-1ff0-44a0-8c46-d2bcf9579d9b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:21.468871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc01b5e-1ff0-44a0-8c46-d2bcf9579d9b admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.domain.id=default, user.id=3ad02887ca234176a8ab03d817e9a1ba) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:21.469178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc01b5e-1ff0-44a0-8c46-d2bcf9579d9b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:21.471044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc01b5e-1ff0-44a0-8c46-d2bcf9579d9b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:21.476877 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 27/52] 10.222.0.21 () {56 vars in 1343 bytes} [Sat Nov 27 20:30:21 2021] GET /identity/v3/role_assignments?user.id=3ad02887ca234176a8ab03d817e9a1ba&scope.domain.id=default&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:21.759615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aa54c-87f8-4acb-a498-f0a27fd7dc5f None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:21.759906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aa54c-87f8-4acb-a498-f0a27fd7dc5f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:21.760186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1aa54c-87f8-4acb-a498-f0a27fd7dc5f None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:21.761980 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 26/53] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:21.767747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbef2ac-a587-4e56-9183-3cd954a401af None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:21.768045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbef2ac-a587-4e56-9183-3cd954a401af None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:21.768334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbef2ac-a587-4e56-9183-3cd954a401af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:21.786108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-dbbef2ac-a587-4e56-9183-3cd954a401af None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:21.787337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dbbef2ac-a587-4e56-9183-3cd954a401af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:21.795460 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 28/54] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:21.819926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1aa54c-87f8-4acb-a498-f0a27fd7dc5f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:21.831875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1aa54c-87f8-4acb-a498-f0a27fd7dc5f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:21.836176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a51f35-cbf0-4553-a436-f496326ed1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:21.836976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a51f35-cbf0-4553-a436-f496326ed1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:21.837265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a51f35-cbf0-4553-a436-f496326ed1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:21.837547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a51f35-cbf0-4553-a436-f496326ed1b3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:21.838718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a51f35-cbf0-4553-a436-f496326ed1b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:21.840960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a51f35-cbf0-4553-a436-f496326ed1b3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:21.842530 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 27/55] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:21.847995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbef2ac-a587-4e56-9183-3cd954a401af None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:21.857382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbef2ac-a587-4e56-9183-3cd954a401af None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:21.861848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037add0-c1f6-426e-9ed3-316b4f548ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:21.862491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037add0-c1f6-426e-9ed3-316b4f548ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:21.862777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037add0-c1f6-426e-9ed3-316b4f548ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:21.863056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037add0-c1f6-426e-9ed3-316b4f548ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:21.863835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037add0-c1f6-426e-9ed3-316b4f548ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:21.865744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037add0-c1f6-426e-9ed3-316b4f548ac5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:21.889642 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 29/56] 10.222.0.21 () {60 vars in 1161 bytes} [Sat Nov 27 20:30:21 2021] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:24.296023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec22e6-54f1-473b-8435-6051511a6ccf None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:24.296531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec22e6-54f1-473b-8435-6051511a6ccf None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:24.296642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec22e6-54f1-473b-8435-6051511a6ccf None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:24.298347 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 28/57] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:24.304259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917a54-1b84-4f21-ae4a-f03b417ab333 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:24.304621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917a54-1b84-4f21-ae4a-f03b417ab333 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:24.304862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917a54-1b84-4f21-ae4a-f03b417ab333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:24.322673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-82917a54-1b84-4f21-ae4a-f03b417ab333 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:24.323904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-82917a54-1b84-4f21-ae4a-f03b417ab333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:24.379988 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 30/58] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:24.406170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec22e6-54f1-473b-8435-6051511a6ccf None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:24.418683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec22e6-54f1-473b-8435-6051511a6ccf None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:24.422948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c98a81-8af7-4c8d-8896-5d51e84338e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:24.423764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98a81-8af7-4c8d-8896-5d51e84338e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:24.424061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98a81-8af7-4c8d-8896-5d51e84338e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:24.424346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c98a81-8af7-4c8d-8896-5d51e84338e8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:24.425546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c98a81-8af7-4c8d-8896-5d51e84338e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:24.427304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c98a81-8af7-4c8d-8896-5d51e84338e8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:24.428924 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 29/59] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:24.435090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917a54-1b84-4f21-ae4a-f03b417ab333 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:24.444009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917a54-1b84-4f21-ae4a-f03b417ab333 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:24.449297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d8023-753e-42fc-9ff3-acd567f19ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:24.450233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d8023-753e-42fc-9ff3-acd567f19ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:24.450524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d8023-753e-42fc-9ff3-acd567f19ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:24.450922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d8023-753e-42fc-9ff3-acd567f19ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:24.451932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d8023-753e-42fc-9ff3-acd567f19ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:24.453346 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-da2d8023-753e-42fc-9ff3-acd567f19ea2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:24.453346 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:30:24.453346 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:30:24.454763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d8023-753e-42fc-9ff3-acd567f19ea2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:24.480965 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 31/60] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:30:24 2021] POST /identity/v3/users => generated 275 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:30:28.277021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf737de-6dd6-4f15-9e0f-1cbe799a701d None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.277586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf737de-6dd6-4f15-9e0f-1cbe799a701d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.277586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf737de-6dd6-4f15-9e0f-1cbe799a701d None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.279635 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 30/61] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:28.289137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fce80-47d6-465a-ab5a-fad09a01d125 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.289137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fce80-47d6-465a-ab5a-fad09a01d125 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.289137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472fce80-47d6-465a-ab5a-fad09a01d125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.332457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-472fce80-47d6-465a-ab5a-fad09a01d125 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:28.334035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-472fce80-47d6-465a-ab5a-fad09a01d125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:28.347684 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 32/62] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:28.393355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf737de-6dd6-4f15-9e0f-1cbe799a701d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.409113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf737de-6dd6-4f15-9e0f-1cbe799a701d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.419779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bc0bd-a41b-49ce-b239-8ef159a5d154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.420986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bc0bd-a41b-49ce-b239-8ef159a5d154 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.421478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bc0bd-a41b-49ce-b239-8ef159a5d154 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.421957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bc0bd-a41b-49ce-b239-8ef159a5d154 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.459950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bc0bd-a41b-49ce-b239-8ef159a5d154 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:28.470303 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-608bc0bd-a41b-49ce-b239-8ef159a5d154 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:30:28.472130 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 31/63] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:28.478369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fce80-47d6-465a-ab5a-fad09a01d125 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.497952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472fce80-47d6-465a-ab5a-fad09a01d125 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.514116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f1693-a63c-4630-b676-4643cbba663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.515355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1693-a63c-4630-b676-4643cbba663c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.519756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1693-a63c-4630-b676-4643cbba663c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.520890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1693-a63c-4630-b676-4643cbba663c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.522140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f1693-a63c-4630-b676-4643cbba663c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:28.522743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f1693-a63c-4630-b676-4643cbba663c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:28.527373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f1693-a63c-4630-b676-4643cbba663c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:28.550453 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 33/64] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:28.558190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bc0bd-a41b-49ce-b239-8ef159a5d154 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.577670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bc0bd-a41b-49ce-b239-8ef159a5d154 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.586902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c563c-e3e4-48e4-a895-acdcfcb6c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.587822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c563c-e3e4-48e4-a895-acdcfcb6c74f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.588122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c563c-e3e4-48e4-a895-acdcfcb6c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.588363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c563c-e3e4-48e4-a895-acdcfcb6c74f admin admin] PATH_INFO: `/v3/users/57b13e39127444d9a3d4465c6b120b1c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.614101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256566d5-9000-4547-a58b-a7edecbc98c1 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.614728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256566d5-9000-4547-a58b-a7edecbc98c1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.615233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256566d5-9000-4547-a58b-a7edecbc98c1 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.617836 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 34/65] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:30:28.624547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b85df-a93b-4ee9-a1ff-fea7b03f5fe5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.625237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c563c-e3e4-48e4-a895-acdcfcb6c74f admin admin] RBAC: Authorizing `identity:get_user(user_id=57b13e39127444d9a3d4465c6b120b1c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:28.625605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b85df-a93b-4ee9-a1ff-fea7b03f5fe5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.626094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b85df-a93b-4ee9-a1ff-fea7b03f5fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.627468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c563c-e3e4-48e4-a895-acdcfcb6c74f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:28.631294 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 32/66] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/users/57b13e39127444d9a3d4465c6b120b1c => generated 275 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:28.637529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c563c-e3e4-48e4-a895-acdcfcb6c74f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.652365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c563c-e3e4-48e4-a895-acdcfcb6c74f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.659437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd501a5-8412-4465-b35e-ef778769d530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.660097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd501a5-8412-4465-b35e-ef778769d530 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.660391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd501a5-8412-4465-b35e-ef778769d530 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.661085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd501a5-8412-4465-b35e-ef778769d530 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.668522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9c8b85df-a93b-4ee9-a1ff-fea7b03f5fe5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:28.669588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9c8b85df-a93b-4ee9-a1ff-fea7b03f5fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:28.670574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd501a5-8412-4465-b35e-ef778769d530 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:28.672584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd501a5-8412-4465-b35e-ef778769d530 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:28.694352 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 33/68] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:28.696819 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 35/68] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:28.696931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117391c-8863-421b-bc3e-92ce68ae9b5c None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.696931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117391c-8863-421b-bc3e-92ce68ae9b5c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.696931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117391c-8863-421b-bc3e-92ce68ae9b5c None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.704244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b85df-a93b-4ee9-a1ff-fea7b03f5fe5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.704379 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 34/69] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:28 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:28.723278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e6489-700c-4811-9819-e22f0d6d6743 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.723278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e6489-700c-4811-9819-e22f0d6d6743 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.723278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e6489-700c-4811-9819-e22f0d6d6743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.727273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b85df-a93b-4ee9-a1ff-fea7b03f5fe5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.745469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac157b29-8611-4233-9d25-c958734b346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.751274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac157b29-8611-4233-9d25-c958734b346a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.751274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac157b29-8611-4233-9d25-c958734b346a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.751274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac157b29-8611-4233-9d25-c958734b346a admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.752853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac157b29-8611-4233-9d25-c958734b346a admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:28.757873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac157b29-8611-4233-9d25-c958734b346a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:28.758224 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 36/70] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:28.759294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac157b29-8611-4233-9d25-c958734b346a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.764972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cd4e6489-700c-4811-9819-e22f0d6d6743 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:28.766098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cd4e6489-700c-4811-9819-e22f0d6d6743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:28.777553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac157b29-8611-4233-9d25-c958734b346a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.784479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959a017-edde-4b32-ab21-b5cd6c4f6dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.785300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959a017-edde-4b32-ab21-b5cd6c4f6dfd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.785584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959a017-edde-4b32-ab21-b5cd6c4f6dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.785751 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 35/71] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 27 20:30:28.786611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e6489-700c-4811-9819-e22f0d6d6743 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.794793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959a017-edde-4b32-ab21-b5cd6c4f6dfd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.803416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e6489-700c-4811-9819-e22f0d6d6743 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.815279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a90a45-1189-4465-ae34-eb8ab4fb544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.815279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90a45-1189-4465-ae34-eb8ab4fb544d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.815279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90a45-1189-4465-ae34-eb8ab4fb544d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.815279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90a45-1189-4465-ae34-eb8ab4fb544d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.815997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a90a45-1189-4465-ae34-eb8ab4fb544d admin admin] RBAC: Adding query filter params (role.id=9a635e239d2c4df7972fb54b7ed42aa6, scope.project.id=838c496dfc884bc0b3b44afdd528b73e, user.id=57b13e39127444d9a3d4465c6b120b1c) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:28.815997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a90a45-1189-4465-ae34-eb8ab4fb544d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:28.819275 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-25a90a45-1189-4465-ae34-eb8ab4fb544d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:28.819275 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:30:28.819275 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:30:28.819275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a90a45-1189-4465-ae34-eb8ab4fb544d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:28.824664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959a017-edde-4b32-ab21-b5cd6c4f6dfd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:28.834865 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-b959a017-edde-4b32-ab21-b5cd6c4f6dfd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:28.834865 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 37/72] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:28.834865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959a017-edde-4b32-ab21-b5cd6c4f6dfd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.835332 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 36/73] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/role_assignments?user.id=57b13e39127444d9a3d4465c6b120b1c&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=9a635e239d2c4df7972fb54b7ed42aa6 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:28.836253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd238a38-ed0e-4372-a7eb-37fa5c4d2a54 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.836546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd238a38-ed0e-4372-a7eb-37fa5c4d2a54 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.836825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd238a38-ed0e-4372-a7eb-37fa5c4d2a54 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.840971 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 37/74] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:28 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:28.847181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd238a38-ed0e-4372-a7eb-37fa5c4d2a54 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.864982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959a017-edde-4b32-ab21-b5cd6c4f6dfd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.869933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd238a38-ed0e-4372-a7eb-37fa5c4d2a54 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.873826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf9f2b-82cc-4284-8c4d-f941678a3d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.873826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9f2b-82cc-4284-8c4d-f941678a3d7c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.873826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9f2b-82cc-4284-8c4d-f941678a3d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.873826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9f2b-82cc-4284-8c4d-f941678a3d7c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.882091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81eb5f-f9cf-4eef-b6e9-e9dc4b0ae054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.883521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81eb5f-f9cf-4eef-b6e9-e9dc4b0ae054 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.884047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81eb5f-f9cf-4eef-b6e9-e9dc4b0ae054 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.884543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81eb5f-f9cf-4eef-b6e9-e9dc4b0ae054 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.886361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81eb5f-f9cf-4eef-b6e9-e9dc4b0ae054 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:28.886903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81eb5f-f9cf-4eef-b6e9-e9dc4b0ae054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:28.889828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81eb5f-f9cf-4eef-b6e9-e9dc4b0ae054 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:28.894215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf9f2b-82cc-4284-8c4d-f941678a3d7c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:28.901908 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 38/75] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:28.903085 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-f9bf9f2b-82cc-4284-8c4d-f941678a3d7c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:30:28.903784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858245f2-4f04-4473-bce3-727ba700c9ae None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.904270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858245f2-4f04-4473-bce3-727ba700c9ae None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.904370 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 38/76] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:28.904867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858245f2-4f04-4473-bce3-727ba700c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.912587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf9f2b-82cc-4284-8c4d-f941678a3d7c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.928356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf9f2b-82cc-4284-8c4d-f941678a3d7c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.937568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f5299-a1c6-4324-929c-34288f056cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.939595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f5299-a1c6-4324-929c-34288f056cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.939991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f5299-a1c6-4324-929c-34288f056cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.940831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f5299-a1c6-4324-929c-34288f056cf2 admin admin] PATH_INFO: `/v3/users/57b13e39127444d9a3d4465c6b120b1c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.941706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f5299-a1c6-4324-929c-34288f056cf2 admin admin] RBAC: Authorizing `identity:get_user(user_id=57b13e39127444d9a3d4465c6b120b1c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:28.942367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-858245f2-4f04-4473-bce3-727ba700c9ae None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:28.943642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-858245f2-4f04-4473-bce3-727ba700c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:28.944897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f5299-a1c6-4324-929c-34288f056cf2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:28.946939 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 39/77] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/users/57b13e39127444d9a3d4465c6b120b1c => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:28.948479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f5299-a1c6-4324-929c-34288f056cf2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.954186 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 39/78] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:28.956609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f119de-5b35-4cb0-bbcb-39bebeb122eb None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.956609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f119de-5b35-4cb0-bbcb-39bebeb122eb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.956609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f119de-5b35-4cb0-bbcb-39bebeb122eb None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.961764 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 40/79] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:28.961764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f119de-5b35-4cb0-bbcb-39bebeb122eb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:28.967206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f5299-a1c6-4324-929c-34288f056cf2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.976006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfd5b9-f71d-4f10-a1e9-2c63d1b8e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.976692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd5b9-f71d-4f10-a1e9-2c63d1b8e4aa admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.976975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd5b9-f71d-4f10-a1e9-2c63d1b8e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.977254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd5b9-f71d-4f10-a1e9-2c63d1b8e4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:28.978037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfd5b9-f71d-4f10-a1e9-2c63d1b8e4aa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:28.978345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfd5b9-f71d-4f10-a1e9-2c63d1b8e4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:28.980599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f119de-5b35-4cb0-bbcb-39bebeb122eb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:28.982378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfd5b9-f71d-4f10-a1e9-2c63d1b8e4aa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:28.987230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dff5a1-70c6-47df-a299-a409eac8e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:28.989163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff5a1-70c6-47df-a299-a409eac8e758 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:28.989736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff5a1-70c6-47df-a299-a409eac8e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:28.990307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff5a1-70c6-47df-a299-a409eac8e758 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.001455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dff5a1-70c6-47df-a299-a409eac8e758 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.001857 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 40/80] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:29.003383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340cc4-8024-4264-a7f7-bcb8adddb8c2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.003676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340cc4-8024-4264-a7f7-bcb8adddb8c2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.003955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3340cc4-8024-4264-a7f7-bcb8adddb8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.004752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dff5a1-70c6-47df-a299-a409eac8e758 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.018595 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 41/81] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:29.020071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dff5a1-70c6-47df-a299-a409eac8e758 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.029610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c3340cc4-8024-4264-a7f7-bcb8adddb8c2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:29.031117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c3340cc4-8024-4264-a7f7-bcb8adddb8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:29.034337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dff5a1-70c6-47df-a299-a409eac8e758 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.039949 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 41/82] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:29.041287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3340cc4-8024-4264-a7f7-bcb8adddb8c2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.048044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3165b-23c9-4051-9194-6b9628ecc151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.051623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3165b-23c9-4051-9194-6b9628ecc151 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.052182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3165b-23c9-4051-9194-6b9628ecc151 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.052836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3165b-23c9-4051-9194-6b9628ecc151 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.055218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3340cc4-8024-4264-a7f7-bcb8adddb8c2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.061983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec8aa8-48dd-436d-8061-91ac194e16e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.063560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec8aa8-48dd-436d-8061-91ac194e16e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.064050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec8aa8-48dd-436d-8061-91ac194e16e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.064544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec8aa8-48dd-436d-8061-91ac194e16e7 admin admin] PATH_INFO: `/v3/users/3ad02887ca234176a8ab03d817e9a1ba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.066111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec8aa8-48dd-436d-8061-91ac194e16e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad02887ca234176a8ab03d817e9a1ba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.068519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec8aa8-48dd-436d-8061-91ac194e16e7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.070939 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 42/83] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/users/3ad02887ca234176a8ab03d817e9a1ba => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:29.072223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec8aa8-48dd-436d-8061-91ac194e16e7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.076824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3165b-23c9-4051-9194-6b9628ecc151 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:29.085115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec8aa8-48dd-436d-8061-91ac194e16e7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.085889 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d6e3165b-23c9-4051-9194-6b9628ecc151 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:29.087347 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 42/84] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:29.090995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3165b-23c9-4051-9194-6b9628ecc151 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.093248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af4a95-6b7f-4b3b-8041-63521be82b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.094117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af4a95-6b7f-4b3b-8041-63521be82b74 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.094541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af4a95-6b7f-4b3b-8041-63521be82b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.094683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af4a95-6b7f-4b3b-8041-63521be82b74 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.095944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af4a95-6b7f-4b3b-8041-63521be82b74 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.098022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af4a95-6b7f-4b3b-8041-63521be82b74 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.099916 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 43/85] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:29.100683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af4a95-6b7f-4b3b-8041-63521be82b74 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.105544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3165b-23c9-4051-9194-6b9628ecc151 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.114791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af4a95-6b7f-4b3b-8041-63521be82b74 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.117093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95d01-27b8-4f9b-b6b6-2adf4a0ef32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.117748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95d01-27b8-4f9b-b6b6-2adf4a0ef32e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.117975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95d01-27b8-4f9b-b6b6-2adf4a0ef32e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.118261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf95d01-27b8-4f9b-b6b6-2adf4a0ef32e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.121071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa9f5-f1c5-4db2-adeb-26f7c105f786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.122562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa9f5-f1c5-4db2-adeb-26f7c105f786 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.122850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa9f5-f1c5-4db2-adeb-26f7c105f786 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.123126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa9f5-f1c5-4db2-adeb-26f7c105f786 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.124518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caa9f5-f1c5-4db2-adeb-26f7c105f786 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.126486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caa9f5-f1c5-4db2-adeb-26f7c105f786 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.128081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf95d01-27b8-4f9b-b6b6-2adf4a0ef32e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.128337 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 44/86] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:29.129284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa9f5-f1c5-4db2-adeb-26f7c105f786 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.138803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf95d01-27b8-4f9b-b6b6-2adf4a0ef32e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.143598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa9f5-f1c5-4db2-adeb-26f7c105f786 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.149249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83490d6b-ac29-46ef-abda-a6bcf6321a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.150209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490d6b-ac29-46ef-abda-a6bcf6321a05 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.150315 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 43/87] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:29.150877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490d6b-ac29-46ef-abda-a6bcf6321a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.151479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83490d6b-ac29-46ef-abda-a6bcf6321a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.152458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83490d6b-ac29-46ef-abda-a6bcf6321a05 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:29.152971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83490d6b-ac29-46ef-abda-a6bcf6321a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.154828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83490d6b-ac29-46ef-abda-a6bcf6321a05 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.156304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95d01-27b8-4f9b-b6b6-2adf4a0ef32e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.166853 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 45/88] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:29.167341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf95d01-27b8-4f9b-b6b6-2adf4a0ef32e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.168664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83490d6b-ac29-46ef-abda-a6bcf6321a05 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.172133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a092e69-ae1e-4ab4-b072-1656926bc4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.172795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a092e69-ae1e-4ab4-b072-1656926bc4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.173082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a092e69-ae1e-4ab4-b072-1656926bc4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.173368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a092e69-ae1e-4ab4-b072-1656926bc4a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.174215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a092e69-ae1e-4ab4-b072-1656926bc4a0 admin admin] RBAC: Adding query filter params (role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=838c496dfc884bc0b3b44afdd528b73e, user.id=57b13e39127444d9a3d4465c6b120b1c) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:29.174529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a092e69-ae1e-4ab4-b072-1656926bc4a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.176791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a092e69-ae1e-4ab4-b072-1656926bc4a0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.181930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83490d6b-ac29-46ef-abda-a6bcf6321a05 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.187432 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 44/89] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/role_assignments?user.id=57b13e39127444d9a3d4465c6b120b1c&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:29.188636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a092e69-ae1e-4ab4-b072-1656926bc4a0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.204326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0f536-e85b-4ec9-9dfd-57acab9d13fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.205385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0f536-e85b-4ec9-9dfd-57acab9d13fa admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.205890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0f536-e85b-4ec9-9dfd-57acab9d13fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.206363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0f536-e85b-4ec9-9dfd-57acab9d13fa admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.207458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0f536-e85b-4ec9-9dfd-57acab9d13fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.209690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0f536-e85b-4ec9-9dfd-57acab9d13fa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.222122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a092e69-ae1e-4ab4-b072-1656926bc4a0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.230023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec217a2-c522-4961-9cea-612f903cf995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.231433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec217a2-c522-4961-9cea-612f903cf995 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.231923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec217a2-c522-4961-9cea-612f903cf995 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.233314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec217a2-c522-4961-9cea-612f903cf995 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.234950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec217a2-c522-4961-9cea-612f903cf995 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.237571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec217a2-c522-4961-9cea-612f903cf995 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.239717 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 45/90] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:29.240810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec217a2-c522-4961-9cea-612f903cf995 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.256566 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 46/91] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:30:29 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:29.257798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0f536-e85b-4ec9-9dfd-57acab9d13fa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.268257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec217a2-c522-4961-9cea-612f903cf995 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.282510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0f536-e85b-4ec9-9dfd-57acab9d13fa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.284175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ccd51-c8f7-4ab0-a177-ebe8e0342e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.286676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ccd51-c8f7-4ab0-a177-ebe8e0342e0a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.287712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ccd51-c8f7-4ab0-a177-ebe8e0342e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.288249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ccd51-c8f7-4ab0-a177-ebe8e0342e0a admin admin] PATH_INFO: `/v3/users/57b13e39127444d9a3d4465c6b120b1c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.290029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ccd51-c8f7-4ab0-a177-ebe8e0342e0a admin admin] RBAC: Authorizing `identity:get_user(user_id=57b13e39127444d9a3d4465c6b120b1c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.293980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ccd51-c8f7-4ab0-a177-ebe8e0342e0a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.298859 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 46/92] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/users/57b13e39127444d9a3d4465c6b120b1c => generated 275 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:29.306957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9767d9-5136-409c-9de8-519fe0f4a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.309091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9767d9-5136-409c-9de8-519fe0f4a9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.309592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9767d9-5136-409c-9de8-519fe0f4a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.310065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9767d9-5136-409c-9de8-519fe0f4a9e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.311158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9767d9-5136-409c-9de8-519fe0f4a9e2 admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=838c496dfc884bc0b3b44afdd528b73e, user.id=3ad02887ca234176a8ab03d817e9a1ba) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:29.311925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9767d9-5136-409c-9de8-519fe0f4a9e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.313284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ccd51-c8f7-4ab0-a177-ebe8e0342e0a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.315925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9767d9-5136-409c-9de8-519fe0f4a9e2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.330151 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 47/93] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/role_assignments?user.id=3ad02887ca234176a8ab03d817e9a1ba&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 259 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:29.333532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ccd51-c8f7-4ab0-a177-ebe8e0342e0a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.342631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b4f82-c91a-4151-946e-29cb9656190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.343734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b4f82-c91a-4151-946e-29cb9656190f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.344244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b4f82-c91a-4151-946e-29cb9656190f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.344719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b4f82-c91a-4151-946e-29cb9656190f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.363099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b4f82-c91a-4151-946e-29cb9656190f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.371287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b4f82-c91a-4151-946e-29cb9656190f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.388435 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 47/94] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:29.395295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9767d9-5136-409c-9de8-519fe0f4a9e2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.418230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9767d9-5136-409c-9de8-519fe0f4a9e2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.433475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2aaf1-0a75-41cd-8f21-af487739915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.434735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2aaf1-0a75-41cd-8f21-af487739915c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.435224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2aaf1-0a75-41cd-8f21-af487739915c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.435762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2aaf1-0a75-41cd-8f21-af487739915c admin admin] PATH_INFO: `/v3/projects/5a41da3c5d7f40a783965a725b9966ca` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.440245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2aaf1-0a75-41cd-8f21-af487739915c admin admin] RBAC: Authorizing `identity:get_project(project_id=5a41da3c5d7f40a783965a725b9966ca)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.443124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2aaf1-0a75-41cd-8f21-af487739915c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.445186 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 48/95] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/projects/5a41da3c5d7f40a783965a725b9966ca => generated 312 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:29.453801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b4f82-c91a-4151-946e-29cb9656190f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:29.470643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b4f82-c91a-4151-946e-29cb9656190f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:29.487297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a063c9-fc86-491b-aaea-b1ebaf050a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:29.487297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a063c9-fc86-491b-aaea-b1ebaf050a4d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:29.487297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a063c9-fc86-491b-aaea-b1ebaf050a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:29.487297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a063c9-fc86-491b-aaea-b1ebaf050a4d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:29.487813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a063c9-fc86-491b-aaea-b1ebaf050a4d admin admin] RBAC: Adding query filter params (role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=5a41da3c5d7f40a783965a725b9966ca, user.id=57b13e39127444d9a3d4465c6b120b1c) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:29.487813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a063c9-fc86-491b-aaea-b1ebaf050a4d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:29.487813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a063c9-fc86-491b-aaea-b1ebaf050a4d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:29.498691 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 48/96] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:29 2021] GET /identity/v3/role_assignments?user.id=57b13e39127444d9a3d4465c6b120b1c&scope.project.id=5a41da3c5d7f40a783965a725b9966ca&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:32.365428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e3478-3d3d-4e67-b41c-c42fcb1d5910 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:32.365973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e3478-3d3d-4e67-b41c-c42fcb1d5910 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:32.365973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e3478-3d3d-4e67-b41c-c42fcb1d5910 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:32.367782 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 49/97] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:32.374179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942cde-ccd5-456c-a634-a68f5e65657e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:32.375336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942cde-ccd5-456c-a634-a68f5e65657e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:32.375841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0942cde-ccd5-456c-a634-a68f5e65657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:32.416296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d0942cde-ccd5-456c-a634-a68f5e65657e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:32.418401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d0942cde-ccd5-456c-a634-a68f5e65657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:32.437755 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 49/98] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:32.483123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e3478-3d3d-4e67-b41c-c42fcb1d5910 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:32.512354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e3478-3d3d-4e67-b41c-c42fcb1d5910 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:32.520870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301f23a-169f-42eb-b263-0702537c5622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:32.522011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301f23a-169f-42eb-b263-0702537c5622 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:32.522516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301f23a-169f-42eb-b263-0702537c5622 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:32.522993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301f23a-169f-42eb-b263-0702537c5622 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:32.560380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301f23a-169f-42eb-b263-0702537c5622 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:32.568116 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-5301f23a-169f-42eb-b263-0702537c5622 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:30:32.569595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 50/99] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:30:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:32.580614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0942cde-ccd5-456c-a634-a68f5e65657e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:32.596528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0942cde-ccd5-456c-a634-a68f5e65657e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:32.614025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e23e24-26ce-4361-9ca7-8690a416521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:32.615128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e23e24-26ce-4361-9ca7-8690a416521a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:32.616026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e23e24-26ce-4361-9ca7-8690a416521a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:32.616026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e23e24-26ce-4361-9ca7-8690a416521a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:32.616749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e23e24-26ce-4361-9ca7-8690a416521a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:32.617064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e23e24-26ce-4361-9ca7-8690a416521a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:32.618705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e23e24-26ce-4361-9ca7-8690a416521a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:32.635003 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 50/100] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:30:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:32.641437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301f23a-169f-42eb-b263-0702537c5622 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:32.656396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301f23a-169f-42eb-b263-0702537c5622 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:32.663476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb500b69-13c7-4a25-8d4b-96c8c4b9afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:32.664352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb500b69-13c7-4a25-8d4b-96c8c4b9afbe admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:32.664640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb500b69-13c7-4a25-8d4b-96c8c4b9afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:32.664921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb500b69-13c7-4a25-8d4b-96c8c4b9afbe admin admin] PATH_INFO: `/v3/users/57b13e39127444d9a3d4465c6b120b1c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:32.672113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb500b69-13c7-4a25-8d4b-96c8c4b9afbe admin admin] RBAC: Authorizing `identity:get_user(user_id=57b13e39127444d9a3d4465c6b120b1c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:32.674307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb500b69-13c7-4a25-8d4b-96c8c4b9afbe admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:32.678320 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 51/101] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:32 2021] GET /identity/v3/users/57b13e39127444d9a3d4465c6b120b1c => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:32.685530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e23e24-26ce-4361-9ca7-8690a416521a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:32.705653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e23e24-26ce-4361-9ca7-8690a416521a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:32.721946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5972f53-9c0c-474d-9e45-5bc5f922fe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:32.726311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972f53-9c0c-474d-9e45-5bc5f922fe8f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:32.726311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972f53-9c0c-474d-9e45-5bc5f922fe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:32.726311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5972f53-9c0c-474d-9e45-5bc5f922fe8f admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:32.726762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5972f53-9c0c-474d-9e45-5bc5f922fe8f admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:32.731271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5972f53-9c0c-474d-9e45-5bc5f922fe8f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:32.735283 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 51/102] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:32 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:32.737363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb500b69-13c7-4a25-8d4b-96c8c4b9afbe admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:32.757743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb500b69-13c7-4a25-8d4b-96c8c4b9afbe admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:32.776838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a1c92-18e1-4ebe-937a-3b7432a37b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:32.777707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1c92-18e1-4ebe-937a-3b7432a37b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:32.777991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1c92-18e1-4ebe-937a-3b7432a37b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:32.778273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1c92-18e1-4ebe-937a-3b7432a37b4c admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e/users/57b13e39127444d9a3d4465c6b120b1c/roles/9a635e239d2c4df7972fb54b7ed42aa6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:32.785562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a1c92-18e1-4ebe-937a-3b7432a37b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=838c496dfc884bc0b3b44afdd528b73e, user_id=57b13e39127444d9a3d4465c6b120b1c, role_id=9a635e239d2c4df7972fb54b7ed42aa6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:32.788336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a1c92-18e1-4ebe-937a-3b7432a37b4c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:32.822641 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 52/103] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:30:32 2021] PUT /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e/users/57b13e39127444d9a3d4465c6b120b1c/roles/9a635e239d2c4df7972fb54b7ed42aa6 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:30:33.201085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0065b9e-5fc6-48f1-a5b8-b80bd5a85020 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.203305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0065b9e-5fc6-48f1-a5b8-b80bd5a85020 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.203305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0065b9e-5fc6-48f1-a5b8-b80bd5a85020 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.203755 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 52/104] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:33.218176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295888d-e410-447d-99cd-9d972b55314f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.218802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295888d-e410-447d-99cd-9d972b55314f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.219339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295888d-e410-447d-99cd-9d972b55314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.252307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0295888d-e410-447d-99cd-9d972b55314f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:33.253871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0295888d-e410-447d-99cd-9d972b55314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:33.301464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4f1ba-c288-4218-9791-65e3506f38d8 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.302935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4f1ba-c288-4218-9791-65e3506f38d8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.303471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4f1ba-c288-4218-9791-65e3506f38d8 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.305468 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 53/105] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:30:33.316868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a51257-89bb-4828-9974-d9243eef6103 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.317183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a51257-89bb-4828-9974-d9243eef6103 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.317429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a51257-89bb-4828-9974-d9243eef6103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.355419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-19a51257-89bb-4828-9974-d9243eef6103 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:33.356897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-19a51257-89bb-4828-9974-d9243eef6103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:33.370242 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 54/106] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:33.373214 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 53/107] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:33.403574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a51257-89bb-4828-9974-d9243eef6103 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.413759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295888d-e410-447d-99cd-9d972b55314f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.418229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a51257-89bb-4828-9974-d9243eef6103 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:33.425671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295888d-e410-447d-99cd-9d972b55314f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:33.429589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860dd8d-0df3-4bf9-8093-2c4eea8827fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:33.430402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dd8d-0df3-4bf9-8093-2c4eea8827fe admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.430680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dd8d-0df3-4bf9-8093-2c4eea8827fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.430950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dd8d-0df3-4bf9-8093-2c4eea8827fe admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.441883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d95c3-bb8a-465f-b909-e3032112edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:33.441883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d95c3-bb8a-465f-b909-e3032112edc7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.441883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d95c3-bb8a-465f-b909-e3032112edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.441883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d95c3-bb8a-465f-b909-e3032112edc7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.473045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860dd8d-0df3-4bf9-8093-2c4eea8827fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:33.481097 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-3860dd8d-0df3-4bf9-8093-2c4eea8827fe admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:33.482017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d95c3-bb8a-465f-b909-e3032112edc7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:33.489095 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-495d95c3-bb8a-465f-b909-e3032112edc7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:33.490638 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 55/108] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:33.496661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7843-6580-4999-906a-55901fb61bcc None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.498268 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 54/109] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:33.498742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7843-6580-4999-906a-55901fb61bcc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.501232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7843-6580-4999-906a-55901fb61bcc None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.504231 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 56/110] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:33 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:33.505525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d95c3-bb8a-465f-b909-e3032112edc7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.507397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f7843-6580-4999-906a-55901fb61bcc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.526382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d95c3-bb8a-465f-b909-e3032112edc7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:33.537076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f7843-6580-4999-906a-55901fb61bcc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:33.548159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaffc4-f769-4a48-8fab-a1f02ebbd08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:33.549109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaffc4-f769-4a48-8fab-a1f02ebbd08a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.549902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaffc4-f769-4a48-8fab-a1f02ebbd08a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.550355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaffc4-f769-4a48-8fab-a1f02ebbd08a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.551394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaffc4-f769-4a48-8fab-a1f02ebbd08a admin admin] RBAC: Adding query filter params (name=member) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:33.552645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dae3a-1ab3-464d-a8b5-85cb057929dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:33.553535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dae3a-1ab3-464d-a8b5-85cb057929dd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.554182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dae3a-1ab3-464d-a8b5-85cb057929dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.554543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaffc4-f769-4a48-8fab-a1f02ebbd08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:33.555218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dae3a-1ab3-464d-a8b5-85cb057929dd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.558002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199dae3a-1ab3-464d-a8b5-85cb057929dd admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:33.558916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199dae3a-1ab3-464d-a8b5-85cb057929dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:33.559148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaffc4-f769-4a48-8fab-a1f02ebbd08a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:33.563348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199dae3a-1ab3-464d-a8b5-85cb057929dd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:33.579287 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 55/111] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:33.580538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806507f8-cdde-42a3-9718-dcf315ea85a5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.580854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806507f8-cdde-42a3-9718-dcf315ea85a5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.581111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806507f8-cdde-42a3-9718-dcf315ea85a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.586338 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 57/112] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:33.591535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dae3a-1ab3-464d-a8b5-85cb057929dd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.621177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-806507f8-cdde-42a3-9718-dcf315ea85a5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:33.622467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-806507f8-cdde-42a3-9718-dcf315ea85a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:33.625133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dae3a-1ab3-464d-a8b5-85cb057929dd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:33.631811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309060c5-c796-4c4d-b579-1486b5fc50c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:33.636937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309060c5-c796-4c4d-b579-1486b5fc50c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.638383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309060c5-c796-4c4d-b579-1486b5fc50c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.639418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309060c5-c796-4c4d-b579-1486b5fc50c7 admin admin] PATH_INFO: `/v3/users/57b13e39127444d9a3d4465c6b120b1c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.642694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309060c5-c796-4c4d-b579-1486b5fc50c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=57b13e39127444d9a3d4465c6b120b1c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:33.643781 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 56/113] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:33.644928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806507f8-cdde-42a3-9718-dcf315ea85a5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.647184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309060c5-c796-4c4d-b579-1486b5fc50c7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:33.657358 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 58/114] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:33 2021] GET /identity/v3/users/57b13e39127444d9a3d4465c6b120b1c => generated 275 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:33.664229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309060c5-c796-4c4d-b579-1486b5fc50c7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.670092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806507f8-cdde-42a3-9718-dcf315ea85a5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:33.683744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe0eab-1553-4e68-83e1-e4a8fc849a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:33.686127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe0eab-1553-4e68-83e1-e4a8fc849a05 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.686612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe0eab-1553-4e68-83e1-e4a8fc849a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.687082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe0eab-1553-4e68-83e1-e4a8fc849a05 admin admin] PATH_INFO: `/v3/users/57b13e39127444d9a3d4465c6b120b1c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.689813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309060c5-c796-4c4d-b579-1486b5fc50c7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:33.695068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe0eab-1553-4e68-83e1-e4a8fc849a05 admin admin] RBAC: Authorizing `identity:get_user(user_id=57b13e39127444d9a3d4465c6b120b1c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:33.699301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8558258-ea6b-498e-8c98-812ed5765b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:33.700613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe0eab-1553-4e68-83e1-e4a8fc849a05 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:33.701020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558258-ea6b-498e-8c98-812ed5765b52 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.702079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558258-ea6b-498e-8c98-812ed5765b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.702552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558258-ea6b-498e-8c98-812ed5765b52 admin admin] PATH_INFO: `/v3/projects/5a41da3c5d7f40a783965a725b9966ca` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.705009 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 57/115] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:33 2021] GET /identity/v3/users/57b13e39127444d9a3d4465c6b120b1c => generated 275 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:33.705650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8558258-ea6b-498e-8c98-812ed5765b52 admin admin] RBAC: Authorizing `identity:get_project(project_id=5a41da3c5d7f40a783965a725b9966ca)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:33.708361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe0eab-1553-4e68-83e1-e4a8fc849a05 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.710340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8558258-ea6b-498e-8c98-812ed5765b52 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:33.717843 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 59/116] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:33 2021] GET /identity/v3/projects/5a41da3c5d7f40a783965a725b9966ca => generated 312 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:33.719310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8558258-ea6b-498e-8c98-812ed5765b52 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.732346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe0eab-1553-4e68-83e1-e4a8fc849a05 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:33.738453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9884-0be8-416a-ac4f-7f96f946f7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:33.739812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9884-0be8-416a-ac4f-7f96f946f7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.740297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9884-0be8-416a-ac4f-7f96f946f7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.740781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9884-0be8-416a-ac4f-7f96f946f7f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.746234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8558258-ea6b-498e-8c98-812ed5765b52 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:33.752875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182329af-6152-4a5a-8126-1b7e5bfa0256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:33.755283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182329af-6152-4a5a-8126-1b7e5bfa0256 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.757719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182329af-6152-4a5a-8126-1b7e5bfa0256 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.758250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182329af-6152-4a5a-8126-1b7e5bfa0256 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.760664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182329af-6152-4a5a-8126-1b7e5bfa0256 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:33.766367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182329af-6152-4a5a-8126-1b7e5bfa0256 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:33.769294 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 60/117] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:33 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:33.772234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182329af-6152-4a5a-8126-1b7e5bfa0256 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.774776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd9884-0be8-416a-ac4f-7f96f946f7f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:33.789613 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-79bd9884-0be8-416a-ac4f-7f96f946f7f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:30:33.791650 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 58/118] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:30:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:33.793863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9884-0be8-416a-ac4f-7f96f946f7f8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.801516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182329af-6152-4a5a-8126-1b7e5bfa0256 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:33.807996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251328d-78fb-47e2-8788-97fd05bfe130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:33.809156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251328d-78fb-47e2-8788-97fd05bfe130 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.809635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251328d-78fb-47e2-8788-97fd05bfe130 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.811177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251328d-78fb-47e2-8788-97fd05bfe130 admin admin] PATH_INFO: `/v3/projects/5a41da3c5d7f40a783965a725b9966ca/users/57b13e39127444d9a3d4465c6b120b1c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.816816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251328d-78fb-47e2-8788-97fd05bfe130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a41da3c5d7f40a783965a725b9966ca, user_id=57b13e39127444d9a3d4465c6b120b1c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:33.818134 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-7251328d-78fb-47e2-8788-97fd05bfe130 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:33.818134 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:30:33.818134 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:30:33.821734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9884-0be8-416a-ac4f-7f96f946f7f8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:33.823466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251328d-78fb-47e2-8788-97fd05bfe130 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:33.835273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa653e35-61e5-438c-8cc8-df005367a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:33.837256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa653e35-61e5-438c-8cc8-df005367a551 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:33.837800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa653e35-61e5-438c-8cc8-df005367a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:33.838852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa653e35-61e5-438c-8cc8-df005367a551 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e/users/57b13e39127444d9a3d4465c6b120b1c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:33.841329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa653e35-61e5-438c-8cc8-df005367a551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838c496dfc884bc0b3b44afdd528b73e, user_id=57b13e39127444d9a3d4465c6b120b1c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:33.844422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa653e35-61e5-438c-8cc8-df005367a551 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:33.856564 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 61/119] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:30:33 2021] PUT /identity/v3/projects/5a41da3c5d7f40a783965a725b9966ca/users/57b13e39127444d9a3d4465c6b120b1c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:30:33.858366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251328d-78fb-47e2-8788-97fd05bfe130 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:33.879282 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 59/120] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:30:33 2021] PUT /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e/users/57b13e39127444d9a3d4465c6b120b1c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:30:33.967189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251328d-78fb-47e2-8788-97fd05bfe130 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.033330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b556a-e8c4-4c3a-9a91-6caa8dace430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.034402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b556a-e8c4-4c3a-9a91-6caa8dace430 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.034891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b556a-e8c4-4c3a-9a91-6caa8dace430 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.035461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b556a-e8c4-4c3a-9a91-6caa8dace430 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.036456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b556a-e8c4-4c3a-9a91-6caa8dace430 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:34.037018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b556a-e8c4-4c3a-9a91-6caa8dace430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:34.038962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b556a-e8c4-4c3a-9a91-6caa8dace430 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:34.049327 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 62/121] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:34.064729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa653e35-61e5-438c-8cc8-df005367a551 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:34.077322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa653e35-61e5-438c-8cc8-df005367a551 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.083055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bf973-0f06-43df-afd9-76c1acb83c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.084292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf973-0f06-43df-afd9-76c1acb83c5e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.084779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf973-0f06-43df-afd9-76c1acb83c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.085315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bf973-0f06-43df-afd9-76c1acb83c5e admin admin] PATH_INFO: `/v3/users/3ad02887ca234176a8ab03d817e9a1ba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.086771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bf973-0f06-43df-afd9-76c1acb83c5e admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad02887ca234176a8ab03d817e9a1ba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:34.089123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bf973-0f06-43df-afd9-76c1acb83c5e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:34.091377 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 60/122] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:34 2021] GET /identity/v3/users/3ad02887ca234176a8ab03d817e9a1ba => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:34.097461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b556a-e8c4-4c3a-9a91-6caa8dace430 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:34.108965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b556a-e8c4-4c3a-9a91-6caa8dace430 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.118610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c41e1e-0215-413c-8906-89c7fe772314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.120031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41e1e-0215-413c-8906-89c7fe772314 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.120515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41e1e-0215-413c-8906-89c7fe772314 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.121001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c41e1e-0215-413c-8906-89c7fe772314 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.122520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c41e1e-0215-413c-8906-89c7fe772314 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:34.125238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c41e1e-0215-413c-8906-89c7fe772314 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:34.131763 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 63/123] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:34 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:34.138484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bf973-0f06-43df-afd9-76c1acb83c5e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:34.153797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bf973-0f06-43df-afd9-76c1acb83c5e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.159533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62323004-1481-421b-b321-b22c68daef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.160778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323004-1481-421b-b321-b22c68daef2c admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.161336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323004-1481-421b-b321-b22c68daef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.161838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62323004-1481-421b-b321-b22c68daef2c admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e/users/3ad02887ca234176a8ab03d817e9a1ba/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.164396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62323004-1481-421b-b321-b22c68daef2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=838c496dfc884bc0b3b44afdd528b73e, user_id=3ad02887ca234176a8ab03d817e9a1ba, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:34.172578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62323004-1481-421b-b321-b22c68daef2c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:34.201194 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 61/124] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:30:34 2021] PUT /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e/users/3ad02887ca234176a8ab03d817e9a1ba/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:30:34.267602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4a305-1e07-4ec6-8514-586339068084 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.268251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4a305-1e07-4ec6-8514-586339068084 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.268751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4a305-1e07-4ec6-8514-586339068084 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.271139 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 64/125] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:34.278014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a8f80-bb74-400e-852f-18fbcfa250b5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.278629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a8f80-bb74-400e-852f-18fbcfa250b5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.279102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a8f80-bb74-400e-852f-18fbcfa250b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.309897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9f9a8f80-bb74-400e-852f-18fbcfa250b5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:34.311800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9f9a8f80-bb74-400e-852f-18fbcfa250b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:34.381137 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 62/126] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:34.410666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4a305-1e07-4ec6-8514-586339068084 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:34.430988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4a305-1e07-4ec6-8514-586339068084 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.433866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a993e6-f209-4bb4-891a-5a1e166a446a None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.434155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a993e6-f209-4bb4-891a-5a1e166a446a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.434437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a993e6-f209-4bb4-891a-5a1e166a446a None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.436659 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 63/127] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:34.443729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620db9d0-a31a-46e7-890d-3de803218ddf None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.444013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620db9d0-a31a-46e7-890d-3de803218ddf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.444206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620db9d0-a31a-46e7-890d-3de803218ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.452878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a15a32-3a81-4125-a22d-bf4e41075e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.453822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15a32-3a81-4125-a22d-bf4e41075e18 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.454206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15a32-3a81-4125-a22d-bf4e41075e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.454580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15a32-3a81-4125-a22d-bf4e41075e18 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.483281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-620db9d0-a31a-46e7-890d-3de803218ddf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:34.483929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a15a32-3a81-4125-a22d-bf4e41075e18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:34.484499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-620db9d0-a31a-46e7-890d-3de803218ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:34.498412 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-e5a15a32-3a81-4125-a22d-bf4e41075e18 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 27 20:30:34.504859 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 65/128] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:34 2021] GET /identity/v3/roles/reader => generated 84 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:34.512881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a15a32-3a81-4125-a22d-bf4e41075e18 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:34.529273 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 64/129] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:34.535314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a15a32-3a81-4125-a22d-bf4e41075e18 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.560368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b45ea3-8a96-4886-9af1-c655fabecc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.561127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45ea3-8a96-4886-9af1-c655fabecc06 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.561512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45ea3-8a96-4886-9af1-c655fabecc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.561885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b45ea3-8a96-4886-9af1-c655fabecc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.562777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45ea3-8a96-4886-9af1-c655fabecc06 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:34.563184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45ea3-8a96-4886-9af1-c655fabecc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:34.565121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b45ea3-8a96-4886-9af1-c655fabecc06 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:34.583277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620db9d0-a31a-46e7-890d-3de803218ddf None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:34.583802 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 66/130] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:34 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:34.590729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b45ea3-8a96-4886-9af1-c655fabecc06 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:34.599001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620db9d0-a31a-46e7-890d-3de803218ddf None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.607656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b45ea3-8a96-4886-9af1-c655fabecc06 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.609304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f91ce8-d91b-4111-9526-25a362deafd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.610165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91ce8-d91b-4111-9526-25a362deafd1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.610503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91ce8-d91b-4111-9526-25a362deafd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.610791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f91ce8-d91b-4111-9526-25a362deafd1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.616335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f91ce8-d91b-4111-9526-25a362deafd1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:34.618057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f91ce8-d91b-4111-9526-25a362deafd1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:34.620676 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 65/131] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:34.622857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8d897-0105-4597-b32e-29b310110b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.625189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8d897-0105-4597-b32e-29b310110b4a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.625189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8d897-0105-4597-b32e-29b310110b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.625189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8d897-0105-4597-b32e-29b310110b4a admin admin] PATH_INFO: `/v3/users/46ae451713b14b30986ff54aa63ddba5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.627636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f91ce8-d91b-4111-9526-25a362deafd1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:34.645280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8d897-0105-4597-b32e-29b310110b4a admin admin] RBAC: Authorizing `identity:get_user(user_id=46ae451713b14b30986ff54aa63ddba5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:34.645823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f91ce8-d91b-4111-9526-25a362deafd1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.649793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8d897-0105-4597-b32e-29b310110b4a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:34.653104 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 67/132] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:34 2021] GET /identity/v3/users/46ae451713b14b30986ff54aa63ddba5 => generated 289 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:34.656008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e207f07-753e-4d4f-b793-8b8ebbb8bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.656008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e207f07-753e-4d4f-b793-8b8ebbb8bbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.656008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e207f07-753e-4d4f-b793-8b8ebbb8bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.656281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e207f07-753e-4d4f-b793-8b8ebbb8bbb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.659277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e207f07-753e-4d4f-b793-8b8ebbb8bbb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:34.659277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e207f07-753e-4d4f-b793-8b8ebbb8bbb0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:34.663322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8d897-0105-4597-b32e-29b310110b4a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:34.674633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8d897-0105-4597-b32e-29b310110b4a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.681072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250041c-b7c9-423c-b560-9dd899882b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.681731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250041c-b7c9-423c-b560-9dd899882b0a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.682046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250041c-b7c9-423c-b560-9dd899882b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.682363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250041c-b7c9-423c-b560-9dd899882b0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.695295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250041c-b7c9-423c-b560-9dd899882b0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:34.695295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250041c-b7c9-423c-b560-9dd899882b0a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:34.709027 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 68/133] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:30:34.718015 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 66/134] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:30:34 2021] POST /identity/v3/projects => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:34.719985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250041c-b7c9-423c-b560-9dd899882b0a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:34.738741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250041c-b7c9-423c-b560-9dd899882b0a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.843576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4e2e0-11b8-4519-941d-26606352c246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.844221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4e2e0-11b8-4519-941d-26606352c246 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.844508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4e2e0-11b8-4519-941d-26606352c246 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.844780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4e2e0-11b8-4519-941d-26606352c246 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.852319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4e2e0-11b8-4519-941d-26606352c246 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:34.854976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4e2e0-11b8-4519-941d-26606352c246 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:34.857073 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 69/135] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:34 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:34.863951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e207f07-753e-4d4f-b793-8b8ebbb8bbb0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:34.890223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e207f07-753e-4d4f-b793-8b8ebbb8bbb0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:34.923319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda88b7-5882-4c6d-b5c9-fcc914635575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:34.923319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda88b7-5882-4c6d-b5c9-fcc914635575 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:34.923319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda88b7-5882-4c6d-b5c9-fcc914635575 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:34.923319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda88b7-5882-4c6d-b5c9-fcc914635575 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:34.923715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda88b7-5882-4c6d-b5c9-fcc914635575 admin admin] RBAC: Adding query filter params (role.id=76969d6f17e84657bf8dea0d9c8879b1, scope.project.id=838c496dfc884bc0b3b44afdd528b73e, user.id=46ae451713b14b30986ff54aa63ddba5) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:34.923715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda88b7-5882-4c6d-b5c9-fcc914635575 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:34.924937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda88b7-5882-4c6d-b5c9-fcc914635575 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:34.939342 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 67/136] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:34 2021] GET /identity/v3/role_assignments?user.id=46ae451713b14b30986ff54aa63ddba5&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=76969d6f17e84657bf8dea0d9c8879b1 => generated 259 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:36.943753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c1ff7-18a8-4d48-87a3-7569b5bfedaa None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:36.944279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c1ff7-18a8-4d48-87a3-7569b5bfedaa None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:36.944279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c1ff7-18a8-4d48-87a3-7569b5bfedaa None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:36.946313 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 70/137] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:36.954618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c13cf-3599-4e76-a165-707a01fe9fb0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:36.954618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c13cf-3599-4e76-a165-707a01fe9fb0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:36.954618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c13cf-3599-4e76-a165-707a01fe9fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:36.988272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-693c13cf-3599-4e76-a165-707a01fe9fb0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:36.989775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-693c13cf-3599-4e76-a165-707a01fe9fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:37.003454 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 68/138] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:37.052197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c1ff7-18a8-4d48-87a3-7569b5bfedaa None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:37.069458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c1ff7-18a8-4d48-87a3-7569b5bfedaa None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:37.074296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592aa57e-97e6-4fcf-8115-84ca9b94e816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:37.075096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aa57e-97e6-4fcf-8115-84ca9b94e816 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:37.075404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aa57e-97e6-4fcf-8115-84ca9b94e816 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:37.075679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aa57e-97e6-4fcf-8115-84ca9b94e816 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:37.093949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592aa57e-97e6-4fcf-8115-84ca9b94e816 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:37.109580 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-592aa57e-97e6-4fcf-8115-84ca9b94e816 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:30:37.110815 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 71/139] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:30:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:37.127285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c13cf-3599-4e76-a165-707a01fe9fb0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:37.134953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c13cf-3599-4e76-a165-707a01fe9fb0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:37.156805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8af613-c3e0-4e5c-a6fa-6fec681f5faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:37.157837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8af613-c3e0-4e5c-a6fa-6fec681f5faf admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:37.158318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8af613-c3e0-4e5c-a6fa-6fec681f5faf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:37.158786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8af613-c3e0-4e5c-a6fa-6fec681f5faf admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:37.159802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8af613-c3e0-4e5c-a6fa-6fec681f5faf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:37.160310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8af613-c3e0-4e5c-a6fa-6fec681f5faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:37.162258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8af613-c3e0-4e5c-a6fa-6fec681f5faf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:37.181316 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 69/140] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:30:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:37.192376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592aa57e-97e6-4fcf-8115-84ca9b94e816 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:37.202897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592aa57e-97e6-4fcf-8115-84ca9b94e816 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:37.207205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356027ee-0105-41cb-84a5-1550b8864a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:37.215246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356027ee-0105-41cb-84a5-1550b8864a4b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:37.215589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356027ee-0105-41cb-84a5-1550b8864a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:37.215840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356027ee-0105-41cb-84a5-1550b8864a4b admin admin] PATH_INFO: `/v3/users/57b13e39127444d9a3d4465c6b120b1c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:37.217128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356027ee-0105-41cb-84a5-1550b8864a4b admin admin] RBAC: Authorizing `identity:get_user(user_id=57b13e39127444d9a3d4465c6b120b1c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:37.220540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356027ee-0105-41cb-84a5-1550b8864a4b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:37.221245 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 72/141] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:37 2021] GET /identity/v3/users/57b13e39127444d9a3d4465c6b120b1c => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:37.227147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8af613-c3e0-4e5c-a6fa-6fec681f5faf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:37.249609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8af613-c3e0-4e5c-a6fa-6fec681f5faf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:37.264834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49591479-d66b-4a52-9b20-156d6a1b3c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:37.265792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49591479-d66b-4a52-9b20-156d6a1b3c97 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:37.266295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49591479-d66b-4a52-9b20-156d6a1b3c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:37.266769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49591479-d66b-4a52-9b20-156d6a1b3c97 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:37.282956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49591479-d66b-4a52-9b20-156d6a1b3c97 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:37.286231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49591479-d66b-4a52-9b20-156d6a1b3c97 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:37.311075 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 70/142] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:37.318155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356027ee-0105-41cb-84a5-1550b8864a4b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:37.337562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356027ee-0105-41cb-84a5-1550b8864a4b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:37.342510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45fb59-5aa3-456a-b718-44b21ce91e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:37.347507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45fb59-5aa3-456a-b718-44b21ce91e0f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:37.347837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45fb59-5aa3-456a-b718-44b21ce91e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:37.348119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45fb59-5aa3-456a-b718-44b21ce91e0f admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:37.349457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45fb59-5aa3-456a-b718-44b21ce91e0f admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:37.351674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45fb59-5aa3-456a-b718-44b21ce91e0f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:37.353375 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 73/143] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:37 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:37.359698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49591479-d66b-4a52-9b20-156d6a1b3c97 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:37.377715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49591479-d66b-4a52-9b20-156d6a1b3c97 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:37.392933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bb167-d759-416d-a935-a248389e437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:37.393936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bb167-d759-416d-a935-a248389e437a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:37.394419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bb167-d759-416d-a935-a248389e437a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:37.394910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bb167-d759-416d-a935-a248389e437a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:37.395994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bb167-d759-416d-a935-a248389e437a admin admin] RBAC: Adding query filter params (role.id=9a635e239d2c4df7972fb54b7ed42aa6, scope.project.id=838c496dfc884bc0b3b44afdd528b73e, user.id=57b13e39127444d9a3d4465c6b120b1c) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:37.396505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bb167-d759-416d-a935-a248389e437a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:37.398561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bb167-d759-416d-a935-a248389e437a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:37.412440 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 71/144] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:37 2021] GET /identity/v3/role_assignments?user.id=57b13e39127444d9a3d4465c6b120b1c&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=9a635e239d2c4df7972fb54b7ed42aa6 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.187345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcfd99-777b-45bf-accb-0aa747c723ab None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.187345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcfd99-777b-45bf-accb-0aa747c723ab None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.187345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fcfd99-777b-45bf-accb-0aa747c723ab None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.188787 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 74/145] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:38.195835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf20948-ac82-4f00-88fb-a17289722822 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.196714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf20948-ac82-4f00-88fb-a17289722822 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.197187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf20948-ac82-4f00-88fb-a17289722822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.218185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-faf20948-ac82-4f00-88fb-a17289722822 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:38.219856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-faf20948-ac82-4f00-88fb-a17289722822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:38.235355 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 72/146] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:38.264861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcfd99-777b-45bf-accb-0aa747c723ab None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.280086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1fd9-94c6-4c1a-b524-493ed182b07a None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.281615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1fd9-94c6-4c1a-b524-493ed182b07a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.281896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fcfd99-777b-45bf-accb-0aa747c723ab None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.282320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d1fd9-94c6-4c1a-b524-493ed182b07a None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.284659 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 73/147] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:38 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:38.292164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25202e18-b237-466e-ae12-5c7649e19233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.292664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec40f8-591d-41f2-806d-b63bf26f9814 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.292965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202e18-b237-466e-ae12-5c7649e19233 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.293250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202e18-b237-466e-ae12-5c7649e19233 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.293525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25202e18-b237-466e-ae12-5c7649e19233 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.293784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec40f8-591d-41f2-806d-b63bf26f9814 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.294320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec40f8-591d-41f2-806d-b63bf26f9814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.315909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6cec40f8-591d-41f2-806d-b63bf26f9814 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:38.317417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6cec40f8-591d-41f2-806d-b63bf26f9814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:38.327437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25202e18-b237-466e-ae12-5c7649e19233 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:38.327987 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 74/148] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:38.335291 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-25202e18-b237-466e-ae12-5c7649e19233 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:38.344191 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 75/149] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:38.353284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec40f8-591d-41f2-806d-b63bf26f9814 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.365823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25202e18-b237-466e-ae12-5c7649e19233 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.367044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec40f8-591d-41f2-806d-b63bf26f9814 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.377850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25202e18-b237-466e-ae12-5c7649e19233 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.378265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5910fc-9e92-4623-9fea-2d9191f256ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.380728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5910fc-9e92-4623-9fea-2d9191f256ed admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.381024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5910fc-9e92-4623-9fea-2d9191f256ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.381303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5910fc-9e92-4623-9fea-2d9191f256ed admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.382194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5910fc-9e92-4623-9fea-2d9191f256ed admin admin] RBAC: Adding query filter params (name=member) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:38.382513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5910fc-9e92-4623-9fea-2d9191f256ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.387772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5910fc-9e92-4623-9fea-2d9191f256ed admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.399363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac178a58-6dc8-4729-abe9-56b6198ae53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.399363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac178a58-6dc8-4729-abe9-56b6198ae53c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.399363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac178a58-6dc8-4729-abe9-56b6198ae53c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.399363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac178a58-6dc8-4729-abe9-56b6198ae53c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.403486 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 75/150] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.410638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5910fc-9e92-4623-9fea-2d9191f256ed admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.422870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5910fc-9e92-4623-9fea-2d9191f256ed admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.434638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac178a58-6dc8-4729-abe9-56b6198ae53c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:38.440582 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-ac178a58-6dc8-4729-abe9-56b6198ae53c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:38.441967 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 76/151] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:38.443571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114a27-842e-404e-a20d-74422cc4a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.444770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114a27-842e-404e-a20d-74422cc4a35f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.444770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114a27-842e-404e-a20d-74422cc4a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.445202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114a27-842e-404e-a20d-74422cc4a35f admin admin] PATH_INFO: `/v3/users/57b13e39127444d9a3d4465c6b120b1c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.451542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d114a27-842e-404e-a20d-74422cc4a35f admin admin] RBAC: Authorizing `identity:get_user(user_id=57b13e39127444d9a3d4465c6b120b1c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.451542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d114a27-842e-404e-a20d-74422cc4a35f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.451542 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 76/152] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/users/57b13e39127444d9a3d4465c6b120b1c => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:38.456597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac178a58-6dc8-4729-abe9-56b6198ae53c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.461990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114a27-842e-404e-a20d-74422cc4a35f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.477460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac178a58-6dc8-4729-abe9-56b6198ae53c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.483098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114a27-842e-404e-a20d-74422cc4a35f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.486635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615fae5-d433-4568-bf29-5ac4a611c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.487470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615fae5-d433-4568-bf29-5ac4a611c32e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.487741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615fae5-d433-4568-bf29-5ac4a611c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.488702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615fae5-d433-4568-bf29-5ac4a611c32e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.490061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615fae5-d433-4568-bf29-5ac4a611c32e admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:38.490377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615fae5-d433-4568-bf29-5ac4a611c32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.492982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615fae5-d433-4568-bf29-5ac4a611c32e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.495041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a795b29-5fbe-4481-94a7-613ea1418763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.495780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795b29-5fbe-4481-94a7-613ea1418763 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.496060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795b29-5fbe-4481-94a7-613ea1418763 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.496333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795b29-5fbe-4481-94a7-613ea1418763 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.513429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a795b29-5fbe-4481-94a7-613ea1418763 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.513605 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 77/153] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.514607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7264-2a3d-43f3-8e0a-b074e65dc9f5 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.514862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7264-2a3d-43f3-8e0a-b074e65dc9f5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.515282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a795b29-5fbe-4481-94a7-613ea1418763 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.515384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e7264-2a3d-43f3-8e0a-b074e65dc9f5 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.517152 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 78/154] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:38.520623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e7264-2a3d-43f3-8e0a-b074e65dc9f5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.527952 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 77/155] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:38.534473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d86040-43cc-40b0-8a81-0f9194089858 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.534473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d86040-43cc-40b0-8a81-0f9194089858 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.534650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d86040-43cc-40b0-8a81-0f9194089858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.548989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e7264-2a3d-43f3-8e0a-b074e65dc9f5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.555432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-15d86040-43cc-40b0-8a81-0f9194089858 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:38.559280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b686d90-b93d-41ab-982c-28a6a234dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.559474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-15d86040-43cc-40b0-8a81-0f9194089858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:38.559552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686d90-b93d-41ab-982c-28a6a234dfdf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.559552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686d90-b93d-41ab-982c-28a6a234dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.559552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b686d90-b93d-41ab-982c-28a6a234dfdf admin admin] PATH_INFO: `/v3/users/57b13e39127444d9a3d4465c6b120b1c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.559758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b686d90-b93d-41ab-982c-28a6a234dfdf admin admin] RBAC: Authorizing `identity:get_user(user_id=57b13e39127444d9a3d4465c6b120b1c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.565956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b686d90-b93d-41ab-982c-28a6a234dfdf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.569448 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 79/157] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/users/57b13e39127444d9a3d4465c6b120b1c => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.573381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b686d90-b93d-41ab-982c-28a6a234dfdf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.573498 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 78/157] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:38.585081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d86040-43cc-40b0-8a81-0f9194089858 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.589526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b686d90-b93d-41ab-982c-28a6a234dfdf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.603277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d86040-43cc-40b0-8a81-0f9194089858 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.603485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f8184-620b-4005-bf8d-b047cf501516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.603485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f8184-620b-4005-bf8d-b047cf501516 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.603485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f8184-620b-4005-bf8d-b047cf501516 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.604225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f8184-620b-4005-bf8d-b047cf501516 admin admin] PATH_INFO: `/v3/projects/5a41da3c5d7f40a783965a725b9966ca` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.611275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f8184-620b-4005-bf8d-b047cf501516 admin admin] RBAC: Authorizing `identity:get_project(project_id=5a41da3c5d7f40a783965a725b9966ca)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.615272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fdc17-f06c-430a-b7ca-c10c5f74301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.615404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f8184-620b-4005-bf8d-b047cf501516 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.615481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fdc17-f06c-430a-b7ca-c10c5f74301f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.615481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fdc17-f06c-430a-b7ca-c10c5f74301f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.615481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fdc17-f06c-430a-b7ca-c10c5f74301f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.616008 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 80/158] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/projects/5a41da3c5d7f40a783965a725b9966ca => generated 312 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.621559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f8184-620b-4005-bf8d-b047cf501516 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.635395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fdc17-f06c-430a-b7ca-c10c5f74301f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.643277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fdc17-f06c-430a-b7ca-c10c5f74301f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.643401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f8184-620b-4005-bf8d-b047cf501516 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.648456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef19223-4a52-48cf-9fdc-cc324d40057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.649706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef19223-4a52-48cf-9fdc-cc324d40057d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.649988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef19223-4a52-48cf-9fdc-cc324d40057d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.652897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef19223-4a52-48cf-9fdc-cc324d40057d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.660293 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 79/159] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:38.661130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fdc17-f06c-430a-b7ca-c10c5f74301f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.679276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef19223-4a52-48cf-9fdc-cc324d40057d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:38.683279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fdc17-f06c-430a-b7ca-c10c5f74301f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.684872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52c30f-37ea-4c7a-afd8-47e0fc3f68e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.687336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52c30f-37ea-4c7a-afd8-47e0fc3f68e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.687336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52c30f-37ea-4c7a-afd8-47e0fc3f68e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.687336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52c30f-37ea-4c7a-afd8-47e0fc3f68e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.689040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52c30f-37ea-4c7a-afd8-47e0fc3f68e7 admin admin] RBAC: Adding query filter params (role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=5a41da3c5d7f40a783965a725b9966ca, user.id=57b13e39127444d9a3d4465c6b120b1c) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:38.689040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52c30f-37ea-4c7a-afd8-47e0fc3f68e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.689215 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-aef19223-4a52-48cf-9fdc-cc324d40057d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:30:38.691286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52c30f-37ea-4c7a-afd8-47e0fc3f68e7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.695651 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 81/160] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:38.698766 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 80/161] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/role_assignments?user.id=57b13e39127444d9a3d4465c6b120b1c&scope.project.id=5a41da3c5d7f40a783965a725b9966ca&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.699447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef19223-4a52-48cf-9fdc-cc324d40057d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.701378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52c30f-37ea-4c7a-afd8-47e0fc3f68e7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.715287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52c30f-37ea-4c7a-afd8-47e0fc3f68e7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.719276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd8e9d-c2c2-4ee3-8440-efdbbc990797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.721623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd8e9d-c2c2-4ee3-8440-efdbbc990797 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.727284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd8e9d-c2c2-4ee3-8440-efdbbc990797 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.727284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd8e9d-c2c2-4ee3-8440-efdbbc990797 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.727284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd8e9d-c2c2-4ee3-8440-efdbbc990797 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:38.727284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd8e9d-c2c2-4ee3-8440-efdbbc990797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.727284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd8e9d-c2c2-4ee3-8440-efdbbc990797 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.737768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef19223-4a52-48cf-9fdc-cc324d40057d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.743276 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 81/162] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.745790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07e3e8-78cd-4726-bd3c-0a70f2ec7d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.751549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd8e9d-c2c2-4ee3-8440-efdbbc990797 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.756004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07e3e8-78cd-4726-bd3c-0a70f2ec7d5c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.758764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07e3e8-78cd-4726-bd3c-0a70f2ec7d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.763279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07e3e8-78cd-4726-bd3c-0a70f2ec7d5c admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.763279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07e3e8-78cd-4726-bd3c-0a70f2ec7d5c admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.766197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07e3e8-78cd-4726-bd3c-0a70f2ec7d5c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.770323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd8e9d-c2c2-4ee3-8440-efdbbc990797 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.771874 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 82/163] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.778048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b941eb-edbc-4cd5-a52c-8b6a48a48676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.783280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07e3e8-78cd-4726-bd3c-0a70f2ec7d5c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.787277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b941eb-edbc-4cd5-a52c-8b6a48a48676 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.787277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b941eb-edbc-4cd5-a52c-8b6a48a48676 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.787277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b941eb-edbc-4cd5-a52c-8b6a48a48676 admin admin] PATH_INFO: `/v3/users/3ad02887ca234176a8ab03d817e9a1ba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.790895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b941eb-edbc-4cd5-a52c-8b6a48a48676 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ad02887ca234176a8ab03d817e9a1ba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.795295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b941eb-edbc-4cd5-a52c-8b6a48a48676 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.797054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07e3e8-78cd-4726-bd3c-0a70f2ec7d5c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.807278 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 82/164] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/users/3ad02887ca234176a8ab03d817e9a1ba => generated 247 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.811007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ac7ff-c6ea-40b7-8cdd-a11ea04c5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.811007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac7ff-c6ea-40b7-8cdd-a11ea04c5267 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.811007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac7ff-c6ea-40b7-8cdd-a11ea04c5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.811007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ac7ff-c6ea-40b7-8cdd-a11ea04c5267 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.811735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ac7ff-c6ea-40b7-8cdd-a11ea04c5267 admin admin] RBAC: Adding query filter params (role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=838c496dfc884bc0b3b44afdd528b73e, user.id=57b13e39127444d9a3d4465c6b120b1c) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:38.811735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ac7ff-c6ea-40b7-8cdd-a11ea04c5267 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.815285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ac7ff-c6ea-40b7-8cdd-a11ea04c5267 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.819281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b941eb-edbc-4cd5-a52c-8b6a48a48676 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.830104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b941eb-edbc-4cd5-a52c-8b6a48a48676 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.837765 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 83/165] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/role_assignments?user.id=57b13e39127444d9a3d4465c6b120b1c&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.839963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c1e80-eb9c-44af-b2a2-36065a52e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.840634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c1e80-eb9c-44af-b2a2-36065a52e2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.840911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c1e80-eb9c-44af-b2a2-36065a52e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.841287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c1e80-eb9c-44af-b2a2-36065a52e2b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.850900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c1e80-eb9c-44af-b2a2-36065a52e2b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.852783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c1e80-eb9c-44af-b2a2-36065a52e2b0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.863673 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 83/166] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:38.875294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ac7ff-c6ea-40b7-8cdd-a11ea04c5267 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.883278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ac7ff-c6ea-40b7-8cdd-a11ea04c5267 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.889719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5407c07-feb5-4586-b80e-a915deec2f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.889719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407c07-feb5-4586-b80e-a915deec2f54 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.889719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407c07-feb5-4586-b80e-a915deec2f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.889719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5407c07-feb5-4586-b80e-a915deec2f54 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.890694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5407c07-feb5-4586-b80e-a915deec2f54 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.893133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5407c07-feb5-4586-b80e-a915deec2f54 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.895562 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 84/167] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.911302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c1e80-eb9c-44af-b2a2-36065a52e2b0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:38.924955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c1e80-eb9c-44af-b2a2-36065a52e2b0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:38.929912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce1b1f-ad1f-465c-a9be-a89e165c6443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:38.930704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1b1f-ad1f-465c-a9be-a89e165c6443 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.935294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1b1f-ad1f-465c-a9be-a89e165c6443 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.935294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1b1f-ad1f-465c-a9be-a89e165c6443 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.935294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce1b1f-ad1f-465c-a9be-a89e165c6443 admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=838c496dfc884bc0b3b44afdd528b73e, user.id=3ad02887ca234176a8ab03d817e9a1ba) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:38.935294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce1b1f-ad1f-465c-a9be-a89e165c6443 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:38.941642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce1b1f-ad1f-465c-a9be-a89e165c6443 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:38.941831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350280f-152f-4d0c-b15e-f9f8e02aa898 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.941831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350280f-152f-4d0c-b15e-f9f8e02aa898 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.941981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350280f-152f-4d0c-b15e-f9f8e02aa898 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.948061 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 84/168] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:38 2021] GET /identity/v3/role_assignments?user.id=3ad02887ca234176a8ab03d817e9a1ba&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:38.948250 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 85/169] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:38 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:38.955378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef33db-2183-4b36-8247-0bc4aab36d37 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:38.955693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef33db-2183-4b36-8247-0bc4aab36d37 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:38.957746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef33db-2183-4b36-8247-0bc4aab36d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:38.995278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c2ef33db-2183-4b36-8247-0bc4aab36d37 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:38.999277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c2ef33db-2183-4b36-8247-0bc4aab36d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:39.006616 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 86/170] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:39.041910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce1b1f-ad1f-465c-a9be-a89e165c6443 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:39.053481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce1b1f-ad1f-465c-a9be-a89e165c6443 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:39.064058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826f6bc-b175-4a54-aeaa-078002426de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:39.065209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826f6bc-b175-4a54-aeaa-078002426de6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:39.065734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826f6bc-b175-4a54-aeaa-078002426de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:39.066233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826f6bc-b175-4a54-aeaa-078002426de6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:39.091088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826f6bc-b175-4a54-aeaa-078002426de6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:39.097246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a105fa-7f55-4719-9541-7cc9fa026cb7 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:39.097582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a105fa-7f55-4719-9541-7cc9fa026cb7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:39.097842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a105fa-7f55-4719-9541-7cc9fa026cb7 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:39.099821 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-4826f6bc-b175-4a54-aeaa-078002426de6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 27 20:30:39.099960 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 87/171] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:39.103609 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 85/172] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:39 2021] GET /identity/v3/roles/reader => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:39.110660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a105fa-7f55-4719-9541-7cc9fa026cb7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:39.113536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5699cd-48a5-4dc3-bf24-aef95aa0ec01 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:39.113833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5699cd-48a5-4dc3-bf24-aef95aa0ec01 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:39.114094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5699cd-48a5-4dc3-bf24-aef95aa0ec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:39.135979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a105fa-7f55-4719-9541-7cc9fa026cb7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:39.142255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ae5699cd-48a5-4dc3-bf24-aef95aa0ec01 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:39.143523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ae5699cd-48a5-4dc3-bf24-aef95aa0ec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:39.143943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64db25-6077-4d52-9d1d-5e679798c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:39.144973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64db25-6077-4d52-9d1d-5e679798c07c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:39.145614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64db25-6077-4d52-9d1d-5e679798c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:39.146129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64db25-6077-4d52-9d1d-5e679798c07c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:39.147557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64db25-6077-4d52-9d1d-5e679798c07c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:39.148411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64db25-6077-4d52-9d1d-5e679798c07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:39.151300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64db25-6077-4d52-9d1d-5e679798c07c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:39.161221 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 86/173] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:39.168615 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 88/174] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:39 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:39.175519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5699cd-48a5-4dc3-bf24-aef95aa0ec01 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:39.187116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5699cd-48a5-4dc3-bf24-aef95aa0ec01 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:39.192444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c08c72-b1eb-4f28-ac67-967657566a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:39.193610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08c72-b1eb-4f28-ac67-967657566a1a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:39.194028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08c72-b1eb-4f28-ac67-967657566a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:39.194639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c08c72-b1eb-4f28-ac67-967657566a1a admin admin] PATH_INFO: `/v3/users/46ae451713b14b30986ff54aa63ddba5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:39.196206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c08c72-b1eb-4f28-ac67-967657566a1a admin admin] RBAC: Authorizing `identity:get_user(user_id=46ae451713b14b30986ff54aa63ddba5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:39.200026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c08c72-b1eb-4f28-ac67-967657566a1a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:39.202056 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 87/175] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:39 2021] GET /identity/v3/users/46ae451713b14b30986ff54aa63ddba5 => generated 289 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:39.209466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64db25-6077-4d52-9d1d-5e679798c07c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:39.212298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c08c72-b1eb-4f28-ac67-967657566a1a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:39.222483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c08c72-b1eb-4f28-ac67-967657566a1a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:39.229696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64db25-6077-4d52-9d1d-5e679798c07c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:39.232572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c5d6-f451-4597-8888-73c6dea49683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:39.233395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c5d6-f451-4597-8888-73c6dea49683 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:39.233679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c5d6-f451-4597-8888-73c6dea49683 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:39.233946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c5d6-f451-4597-8888-73c6dea49683 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:39.235617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31c5d6-f451-4597-8888-73c6dea49683 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:39.237959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31c5d6-f451-4597-8888-73c6dea49683 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:39.239038 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 88/176] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:39.251044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c5d6-f451-4597-8888-73c6dea49683 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:39.251225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4d9d8-f967-4855-a20a-c29b2d0b1dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:39.251225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4d9d8-f967-4855-a20a-c29b2d0b1dcd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:39.251225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4d9d8-f967-4855-a20a-c29b2d0b1dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:39.251225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4d9d8-f967-4855-a20a-c29b2d0b1dcd admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:39.252373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4d9d8-f967-4855-a20a-c29b2d0b1dcd admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:39.257100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4d9d8-f967-4855-a20a-c29b2d0b1dcd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:39.258822 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 89/177] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:39 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:39.267334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4d9d8-f967-4855-a20a-c29b2d0b1dcd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:39.270370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c5d6-f451-4597-8888-73c6dea49683 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:39.277707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8aa6b-fe2e-4cdc-b11a-de4bd4c2bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:39.278385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8aa6b-fe2e-4cdc-b11a-de4bd4c2bb79 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:39.279132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8aa6b-fe2e-4cdc-b11a-de4bd4c2bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:39.279132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8aa6b-fe2e-4cdc-b11a-de4bd4c2bb79 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:39.280131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8aa6b-fe2e-4cdc-b11a-de4bd4c2bb79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:39.281637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8aa6b-fe2e-4cdc-b11a-de4bd4c2bb79 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:39.284840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4d9d8-f967-4855-a20a-c29b2d0b1dcd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:39.297128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd26669-70a9-47f0-a31d-383dbcd6710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:39.298282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd26669-70a9-47f0-a31d-383dbcd6710c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:39.298717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd26669-70a9-47f0-a31d-383dbcd6710c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:39.298717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd26669-70a9-47f0-a31d-383dbcd6710c admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e/users/46ae451713b14b30986ff54aa63ddba5/roles/76969d6f17e84657bf8dea0d9c8879b1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:39.301007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd26669-70a9-47f0-a31d-383dbcd6710c admin admin] RBAC: Authorizing `identity:create_grant(project_id=838c496dfc884bc0b3b44afdd528b73e, user_id=46ae451713b14b30986ff54aa63ddba5, role_id=76969d6f17e84657bf8dea0d9c8879b1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:39.304243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd26669-70a9-47f0-a31d-383dbcd6710c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:39.317337 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 89/178] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:30:39 2021] POST /identity/v3/users => generated 283 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:39.325624 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 90/179] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:30:39 2021] PUT /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e/users/46ae451713b14b30986ff54aa63ddba5/roles/76969d6f17e84657bf8dea0d9c8879b1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:30:42.446508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0022b1-8ba7-4b57-a676-1899edd6d750 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:42.446963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0022b1-8ba7-4b57-a676-1899edd6d750 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:42.447138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0022b1-8ba7-4b57-a676-1899edd6d750 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:42.449407 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 90/180] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:42.455411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182e02d-a8f6-49e2-90c1-5389809e104f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:42.455825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182e02d-a8f6-49e2-90c1-5389809e104f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:42.456015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182e02d-a8f6-49e2-90c1-5389809e104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:42.500519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6182e02d-a8f6-49e2-90c1-5389809e104f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:42.501707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6182e02d-a8f6-49e2-90c1-5389809e104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:42.669775 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 91/181] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:42.711878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0022b1-8ba7-4b57-a676-1899edd6d750 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:42.774681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0022b1-8ba7-4b57-a676-1899edd6d750 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:42.805081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be9303-bd80-4c8f-8b36-40896adec491 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:42.805370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be9303-bd80-4c8f-8b36-40896adec491 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:42.805633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be9303-bd80-4c8f-8b36-40896adec491 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:42.807985 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 92/182] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:30:42.814784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93aaad-5727-4fb0-9def-fdd8924d1b57 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:42.815240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93aaad-5727-4fb0-9def-fdd8924d1b57 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:42.815686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93aaad-5727-4fb0-9def-fdd8924d1b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:42.816532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe94a20-960c-4bed-bf6c-d604ed68a883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:42.817720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe94a20-960c-4bed-bf6c-d604ed68a883 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:42.818159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe94a20-960c-4bed-bf6c-d604ed68a883 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:42.818575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe94a20-960c-4bed-bf6c-d604ed68a883 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:42.844375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1b93aaad-5727-4fb0-9def-fdd8924d1b57 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:42.849327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1b93aaad-5727-4fb0-9def-fdd8924d1b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:42.852125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe94a20-960c-4bed-bf6c-d604ed68a883 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:42.861323 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-1fe94a20-960c-4bed-bf6c-d604ed68a883 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 27 20:30:42.864187 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 91/183] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:42 2021] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:42.873142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe94a20-960c-4bed-bf6c-d604ed68a883 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:42.876562 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 93/184] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:42.892376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe94a20-960c-4bed-bf6c-d604ed68a883 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:42.903843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a02a-9676-4fd7-bcc9-f85daa106bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:42.904689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a02a-9676-4fd7-bcc9-f85daa106bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:42.905115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a02a-9676-4fd7-bcc9-f85daa106bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:42.905530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a02a-9676-4fd7-bcc9-f85daa106bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:42.906442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a02a-9676-4fd7-bcc9-f85daa106bf2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:42.906906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a02a-9676-4fd7-bcc9-f85daa106bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:42.908711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a02a-9676-4fd7-bcc9-f85daa106bf2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:42.931246 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 92/185] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:42 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:42.939916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93aaad-5727-4fb0-9def-fdd8924d1b57 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:42.949277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a02a-9676-4fd7-bcc9-f85daa106bf2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:42.961653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93aaad-5727-4fb0-9def-fdd8924d1b57 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:42.976422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caf3ae-177b-44c9-8951-3337480e562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:42.977629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf3ae-177b-44c9-8951-3337480e562c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:42.978111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf3ae-177b-44c9-8951-3337480e562c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:42.979116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caf3ae-177b-44c9-8951-3337480e562c admin admin] PATH_INFO: `/v3/users/46ae451713b14b30986ff54aa63ddba5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:42.980276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a02a-9676-4fd7-bcc9-f85daa106bf2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:42.984421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caf3ae-177b-44c9-8951-3337480e562c admin admin] RBAC: Authorizing `identity:get_user(user_id=46ae451713b14b30986ff54aa63ddba5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:42.987339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caf3ae-177b-44c9-8951-3337480e562c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:42.989666 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 94/186] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:42 2021] GET /identity/v3/users/46ae451713b14b30986ff54aa63ddba5 => generated 289 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.001726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caf3ae-177b-44c9-8951-3337480e562c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.012940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dda94-739d-4105-9c7e-7a51948be18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.014098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dda94-739d-4105-9c7e-7a51948be18f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.014639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dda94-739d-4105-9c7e-7a51948be18f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.015165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dda94-739d-4105-9c7e-7a51948be18f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.026877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caf3ae-177b-44c9-8951-3337480e562c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.049027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313dda94-739d-4105-9c7e-7a51948be18f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:43.050561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0edcf-c3bf-4339-be62-874f5004650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.051503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0edcf-c3bf-4339-be62-874f5004650a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.052018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0edcf-c3bf-4339-be62-874f5004650a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.052508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0edcf-c3bf-4339-be62-874f5004650a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.061618 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-313dda94-739d-4105-9c7e-7a51948be18f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:30:43.063269 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 93/187] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:30:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:43.065834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f9771-a025-41ca-9017-d886a8c40da4 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.066322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f9771-a025-41ca-9017-d886a8c40da4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.066791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f9771-a025-41ca-9017-d886a8c40da4 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.071072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0edcf-c3bf-4339-be62-874f5004650a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.073012 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 94/188] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:43.073965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f9771-a025-41ca-9017-d886a8c40da4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.074679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0edcf-c3bf-4339-be62-874f5004650a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.088173 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 95/189] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:43.097609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011326a-9cd9-45a3-9f3b-9cc3f95f26fb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.098127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011326a-9cd9-45a3-9f3b-9cc3f95f26fb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.098621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011326a-9cd9-45a3-9f3b-9cc3f95f26fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.110412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f9771-a025-41ca-9017-d886a8c40da4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.118987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62b62-ba7d-403c-b57e-2fbdb0b418e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.120079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62b62-ba7d-403c-b57e-2fbdb0b418e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.120593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62b62-ba7d-403c-b57e-2fbdb0b418e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.121066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d62b62-ba7d-403c-b57e-2fbdb0b418e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.122130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d62b62-ba7d-403c-b57e-2fbdb0b418e0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:43.122660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d62b62-ba7d-403c-b57e-2fbdb0b418e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.124561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d62b62-ba7d-403c-b57e-2fbdb0b418e0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.141086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0011326a-9cd9-45a3-9f3b-9cc3f95f26fb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:43.142560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0011326a-9cd9-45a3-9f3b-9cc3f95f26fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:43.151129 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 95/190] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.152286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62b62-ba7d-403c-b57e-2fbdb0b418e0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.161434 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 96/191] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:43.163676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011326a-9cd9-45a3-9f3b-9cc3f95f26fb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.182242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d62b62-ba7d-403c-b57e-2fbdb0b418e0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.195947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011326a-9cd9-45a3-9f3b-9cc3f95f26fb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.205270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbff57-f9e3-45b0-a793-01f67201a0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.207358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a775d5-2765-41f0-b755-0cf657ce7e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.208447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a775d5-2765-41f0-b755-0cf657ce7e59 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.208958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbff57-f9e3-45b0-a793-01f67201a0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.209438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbff57-f9e3-45b0-a793-01f67201a0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.209933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbff57-f9e3-45b0-a793-01f67201a0c4 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.210403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a775d5-2765-41f0-b755-0cf657ce7e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.211480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a775d5-2765-41f0-b755-0cf657ce7e59 admin admin] PATH_INFO: `/v3/users/cc04b38ceb644158a222a9f03a0e3fa6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.212336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbff57-f9e3-45b0-a793-01f67201a0c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.215514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbff57-f9e3-45b0-a793-01f67201a0c4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.218733 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 96/192] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.220621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbff57-f9e3-45b0-a793-01f67201a0c4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.238117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbff57-f9e3-45b0-a793-01f67201a0c4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.246367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179a5fc-c778-4913-94d7-e0e01fd14adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.247437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179a5fc-c778-4913-94d7-e0e01fd14adc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.248692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179a5fc-c778-4913-94d7-e0e01fd14adc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.249187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179a5fc-c778-4913-94d7-e0e01fd14adc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.258207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a775d5-2765-41f0-b755-0cf657ce7e59 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc04b38ceb644158a222a9f03a0e3fa6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.261217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a775d5-2765-41f0-b755-0cf657ce7e59 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.263127 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 97/193] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/users/cc04b38ceb644158a222a9f03a0e3fa6 => generated 283 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.264204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a775d5-2765-41f0-b755-0cf657ce7e59 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.278197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179a5fc-c778-4913-94d7-e0e01fd14adc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:43.285486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a775d5-2765-41f0-b755-0cf657ce7e59 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.290358 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-d179a5fc-c778-4913-94d7-e0e01fd14adc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:43.292959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f81f5-d522-4753-92fd-6190b0bdbfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.293879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f81f5-d522-4753-92fd-6190b0bdbfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.294363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f81f5-d522-4753-92fd-6190b0bdbfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.294837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f81f5-d522-4753-92fd-6190b0bdbfd7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.295931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f81f5-d522-4753-92fd-6190b0bdbfd7 admin admin] RBAC: Adding query filter params (role.id=76969d6f17e84657bf8dea0d9c8879b1, scope.project.id=838c496dfc884bc0b3b44afdd528b73e, user.id=46ae451713b14b30986ff54aa63ddba5) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:43.296442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f81f5-d522-4753-92fd-6190b0bdbfd7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.298504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f81f5-d522-4753-92fd-6190b0bdbfd7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.299974 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 97/194] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:43.304165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179a5fc-c778-4913-94d7-e0e01fd14adc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.320771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179a5fc-c778-4913-94d7-e0e01fd14adc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.334049 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 98/195] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/role_assignments?user.id=46ae451713b14b30986ff54aa63ddba5&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=76969d6f17e84657bf8dea0d9c8879b1 => generated 608 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.340609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f81f5-d522-4753-92fd-6190b0bdbfd7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.350777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c3849-aa69-442c-ae1b-de5b8e7dfc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.351627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3849-aa69-442c-ae1b-de5b8e7dfc05 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.351918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3849-aa69-442c-ae1b-de5b8e7dfc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.352194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3849-aa69-442c-ae1b-de5b8e7dfc05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.368903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f81f5-d522-4753-92fd-6190b0bdbfd7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.374519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c3849-aa69-442c-ae1b-de5b8e7dfc05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.376883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c3849-aa69-442c-ae1b-de5b8e7dfc05 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.387606 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 98/196] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:43.394256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa003b9-9609-41d5-b1b1-16c0d1055cfe None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.394548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa003b9-9609-41d5-b1b1-16c0d1055cfe None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.394825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa003b9-9609-41d5-b1b1-16c0d1055cfe None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.401114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ab224-ba07-4dfc-bb0a-2b002d7f018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.401786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ab224-ba07-4dfc-bb0a-2b002d7f018a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.402174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ab224-ba07-4dfc-bb0a-2b002d7f018a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.402290 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 99/197] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:43 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:43.402452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ab224-ba07-4dfc-bb0a-2b002d7f018a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.403154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa003b9-9609-41d5-b1b1-16c0d1055cfe None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.403268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ab224-ba07-4dfc-bb0a-2b002d7f018a admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:43.403503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ab224-ba07-4dfc-bb0a-2b002d7f018a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.409182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ab224-ba07-4dfc-bb0a-2b002d7f018a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.437367 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 99/198] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.444579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa003b9-9609-41d5-b1b1-16c0d1055cfe None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.444853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c279e-3a21-493e-95f1-ad62e39c8cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.447376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d511-87ca-4bb5-a437-f52e6a95dead None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.447977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d511-87ca-4bb5-a437-f52e6a95dead None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.448564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d511-87ca-4bb5-a437-f52e6a95dead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.452305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c279e-3a21-493e-95f1-ad62e39c8cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.452305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c279e-3a21-493e-95f1-ad62e39c8cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.452305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c279e-3a21-493e-95f1-ad62e39c8cc4 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.456426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c279e-3a21-493e-95f1-ad62e39c8cc4 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.458632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c279e-3a21-493e-95f1-ad62e39c8cc4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.461881 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 100/199] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.469738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c279e-3a21-493e-95f1-ad62e39c8cc4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.482158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c279e-3a21-493e-95f1-ad62e39c8cc4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.483959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7169d511-87ca-4bb5-a437-f52e6a95dead None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:43.485206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7169d511-87ca-4bb5-a437-f52e6a95dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:43.495768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5059f5-254c-48fe-93f0-ea4d281480b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.500191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5059f5-254c-48fe-93f0-ea4d281480b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.500751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5059f5-254c-48fe-93f0-ea4d281480b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.501184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5059f5-254c-48fe-93f0-ea4d281480b6 admin admin] PATH_INFO: `/v3/users/cc04b38ceb644158a222a9f03a0e3fa6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.503172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5059f5-254c-48fe-93f0-ea4d281480b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc04b38ceb644158a222a9f03a0e3fa6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.505155 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 100/200] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:43.506030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5059f5-254c-48fe-93f0-ea4d281480b6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.506853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916047ca-7fb4-4b35-b7bb-62d3e83877d8 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.507313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916047ca-7fb4-4b35-b7bb-62d3e83877d8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.507720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916047ca-7fb4-4b35-b7bb-62d3e83877d8 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.512890 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 101/201] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/users/cc04b38ceb644158a222a9f03a0e3fa6 => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.512890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5059f5-254c-48fe-93f0-ea4d281480b6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.513465 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 101/202] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:43 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:43.517074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916047ca-7fb4-4b35-b7bb-62d3e83877d8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.537242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5059f5-254c-48fe-93f0-ea4d281480b6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.546328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d65c8-0767-45f2-a106-40438dd7c424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.548395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916047ca-7fb4-4b35-b7bb-62d3e83877d8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.548551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d65c8-0767-45f2-a106-40438dd7c424 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.548747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d65c8-0767-45f2-a106-40438dd7c424 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.549438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d65c8-0767-45f2-a106-40438dd7c424 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.552864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d65c8-0767-45f2-a106-40438dd7c424 admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45, user.id=cc04b38ceb644158a222a9f03a0e3fa6) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:43.553143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8d2b0-7434-4cb5-8b09-07cb598078d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.553276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d65c8-0767-45f2-a106-40438dd7c424 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.553853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8d2b0-7434-4cb5-8b09-07cb598078d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.554234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8d2b0-7434-4cb5-8b09-07cb598078d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.554511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8d2b0-7434-4cb5-8b09-07cb598078d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.560335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d65c8-0767-45f2-a106-40438dd7c424 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.563955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8d2b0-7434-4cb5-8b09-07cb598078d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.565742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8d2b0-7434-4cb5-8b09-07cb598078d9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.583289 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 102/203] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/role_assignments?user.id=cc04b38ceb644158a222a9f03a0e3fa6&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 259 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.583289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca573cc-6d94-42f1-9e61-972d5cdd535c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.583289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca573cc-6d94-42f1-9e61-972d5cdd535c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.583639 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 102/204] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:30:43.583713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca573cc-6d94-42f1-9e61-972d5cdd535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.583780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8d2b0-7434-4cb5-8b09-07cb598078d9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.598252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8d2b0-7434-4cb5-8b09-07cb598078d9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.605522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c23a7-4e8c-453a-981e-b0ce2af4be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.606682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c23a7-4e8c-453a-981e-b0ce2af4be76 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.607157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c23a7-4e8c-453a-981e-b0ce2af4be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.607689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c23a7-4e8c-453a-981e-b0ce2af4be76 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.608561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7ca573cc-6d94-42f1-9e61-972d5cdd535c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:43.609809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7ca573cc-6d94-42f1-9e61-972d5cdd535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:43.629081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c23a7-4e8c-453a-981e-b0ce2af4be76 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:43.635324 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 103/205] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:43.635324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca573cc-6d94-42f1-9e61-972d5cdd535c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.636646 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-611c23a7-4e8c-453a-981e-b0ce2af4be76 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:30:43.638126 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 103/206] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:43.650039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c23a7-4e8c-453a-981e-b0ce2af4be76 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.657132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca573cc-6d94-42f1-9e61-972d5cdd535c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.670238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4e40b-5a87-4acb-a362-2419f91d89ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.671230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e40b-5a87-4acb-a362-2419f91d89ad admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.671535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e40b-5a87-4acb-a362-2419f91d89ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.671797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e40b-5a87-4acb-a362-2419f91d89ad admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.673123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4e40b-5a87-4acb-a362-2419f91d89ad admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.676552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4e40b-5a87-4acb-a362-2419f91d89ad admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.677120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c23a7-4e8c-453a-981e-b0ce2af4be76 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.678573 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 104/207] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.679167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4e40b-5a87-4acb-a362-2419f91d89ad admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.690070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9969781-025b-44e1-bdd0-72976ee50a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.690760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9969781-025b-44e1-bdd0-72976ee50a2f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.691042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9969781-025b-44e1-bdd0-72976ee50a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.691353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9969781-025b-44e1-bdd0-72976ee50a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.692136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9969781-025b-44e1-bdd0-72976ee50a2f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:43.692441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9969781-025b-44e1-bdd0-72976ee50a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.694087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9969781-025b-44e1-bdd0-72976ee50a2f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.707614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4e40b-5a87-4acb-a362-2419f91d89ad admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.710248 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 104/208] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.710442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9969781-025b-44e1-bdd0-72976ee50a2f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.716757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd51b5-767e-4d04-a08b-409aa37e368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.717824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd51b5-767e-4d04-a08b-409aa37e368c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.717959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd51b5-767e-4d04-a08b-409aa37e368c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.718230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd51b5-767e-4d04-a08b-409aa37e368c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.720167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd51b5-767e-4d04-a08b-409aa37e368c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.722108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd51b5-767e-4d04-a08b-409aa37e368c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.723889 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 105/209] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.724707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd51b5-767e-4d04-a08b-409aa37e368c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.730600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9969781-025b-44e1-bdd0-72976ee50a2f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.741039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd51b5-767e-4d04-a08b-409aa37e368c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.742281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5e287-bc5a-44ed-a18c-6dc3d3d5b11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.743152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e287-bc5a-44ed-a18c-6dc3d3d5b11f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.743611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e287-bc5a-44ed-a18c-6dc3d3d5b11f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.743889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e287-bc5a-44ed-a18c-6dc3d3d5b11f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.744842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5e287-bc5a-44ed-a18c-6dc3d3d5b11f admin admin] RBAC: Adding query filter params (role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45, user.id=cc04b38ceb644158a222a9f03a0e3fa6) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:43.745154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5e287-bc5a-44ed-a18c-6dc3d3d5b11f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.747092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5e287-bc5a-44ed-a18c-6dc3d3d5b11f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.752307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a99b0-4413-467e-a469-59461e61a22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.753192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a99b0-4413-467e-a469-59461e61a22c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.753457 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 105/210] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/role_assignments?user.id=cc04b38ceb644158a222a9f03a0e3fa6&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.753555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a99b0-4413-467e-a469-59461e61a22c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.753741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a99b0-4413-467e-a469-59461e61a22c admin admin] PATH_INFO: `/v3/users/cc04b38ceb644158a222a9f03a0e3fa6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.754339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5e287-bc5a-44ed-a18c-6dc3d3d5b11f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.760148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a99b0-4413-467e-a469-59461e61a22c admin admin] RBAC: Authorizing `identity:get_user(user_id=cc04b38ceb644158a222a9f03a0e3fa6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.760148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a99b0-4413-467e-a469-59461e61a22c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.760404 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 106/211] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/users/cc04b38ceb644158a222a9f03a0e3fa6 => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:43.766625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a99b0-4413-467e-a469-59461e61a22c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.769072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5e287-bc5a-44ed-a18c-6dc3d3d5b11f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.774127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dd0e0-4a17-4039-8346-43df7ea40637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.774819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dd0e0-4a17-4039-8346-43df7ea40637 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.775140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dd0e0-4a17-4039-8346-43df7ea40637 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.775580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dd0e0-4a17-4039-8346-43df7ea40637 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.776404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dd0e0-4a17-4039-8346-43df7ea40637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.777569 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-197dd0e0-4a17-4039-8346-43df7ea40637 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:43.777569 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:30:43.777569 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:30:43.778925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197dd0e0-4a17-4039-8346-43df7ea40637 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.780036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a99b0-4413-467e-a469-59461e61a22c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.787591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389ac46-91a2-4bc4-bdc7-09ee34917e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.788643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389ac46-91a2-4bc4-bdc7-09ee34917e9a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.789050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389ac46-91a2-4bc4-bdc7-09ee34917e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.789447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389ac46-91a2-4bc4-bdc7-09ee34917e9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.800899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389ac46-91a2-4bc4-bdc7-09ee34917e9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.802811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389ac46-91a2-4bc4-bdc7-09ee34917e9a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.813477 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 107/213] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:43.813774 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 106/212] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:30:43 2021] POST /identity/v3/users => generated 297 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:43.819879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389ac46-91a2-4bc4-bdc7-09ee34917e9a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.837411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389ac46-91a2-4bc4-bdc7-09ee34917e9a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.849065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62217607-72e8-4442-82fe-c4c5494e39dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.849848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217607-72e8-4442-82fe-c4c5494e39dc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.850434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217607-72e8-4442-82fe-c4c5494e39dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.850434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62217607-72e8-4442-82fe-c4c5494e39dc admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.858141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62217607-72e8-4442-82fe-c4c5494e39dc admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.865500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62217607-72e8-4442-82fe-c4c5494e39dc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.869009 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 108/214] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:43.876484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dd0e0-4a17-4039-8346-43df7ea40637 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:43.889118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197dd0e0-4a17-4039-8346-43df7ea40637 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:43.893813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11405338-0442-41c0-b248-7f77b1a234a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:43.894484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11405338-0442-41c0-b248-7f77b1a234a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:43.894765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11405338-0442-41c0-b248-7f77b1a234a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:43.895033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11405338-0442-41c0-b248-7f77b1a234a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:43.896008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11405338-0442-41c0-b248-7f77b1a234a4 admin admin] RBAC: Adding query filter params (role.id=9a635e239d2c4df7972fb54b7ed42aa6, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45, user.id=cc04b38ceb644158a222a9f03a0e3fa6) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:43.896317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11405338-0442-41c0-b248-7f77b1a234a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:43.898234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11405338-0442-41c0-b248-7f77b1a234a4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:43.906292 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 107/215] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:43 2021] GET /identity/v3/role_assignments?user.id=cc04b38ceb644158a222a9f03a0e3fa6&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=9a635e239d2c4df7972fb54b7ed42aa6 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:46.546610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953903dd-8807-47fc-a8c4-2582cce0456d None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:46.547139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953903dd-8807-47fc-a8c4-2582cce0456d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:46.547139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953903dd-8807-47fc-a8c4-2582cce0456d None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:46.549363 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 109/216] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:46.555797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545bf84-8678-4b26-ae87-aab43ef68611 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:46.556287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545bf84-8678-4b26-ae87-aab43ef68611 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:46.557010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545bf84-8678-4b26-ae87-aab43ef68611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:46.580885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3545bf84-8678-4b26-ae87-aab43ef68611 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:46.582081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3545bf84-8678-4b26-ae87-aab43ef68611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:46.597438 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 108/217] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:46.641387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953903dd-8807-47fc-a8c4-2582cce0456d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:46.653820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953903dd-8807-47fc-a8c4-2582cce0456d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:46.662232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e4b4c-64fc-470b-8159-6ec2ac69d9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:46.663021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e4b4c-64fc-470b-8159-6ec2ac69d9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:46.663335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e4b4c-64fc-470b-8159-6ec2ac69d9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:46.663611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e4b4c-64fc-470b-8159-6ec2ac69d9d3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:46.675335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e4b4c-64fc-470b-8159-6ec2ac69d9d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:46.682682 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-154e4b4c-64fc-470b-8159-6ec2ac69d9d3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:30:46.683107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef3bfe-ce04-4752-905f-d8f082b4cc1a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:46.683430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef3bfe-ce04-4752-905f-d8f082b4cc1a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:46.683705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef3bfe-ce04-4752-905f-d8f082b4cc1a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:46.684190 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 110/218] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:30:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:46.685684 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 109/219] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:30:46.691616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e4b4c-64fc-470b-8159-6ec2ac69d9d3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:46.696270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dfbd2-445a-4c9a-840e-e95d93c1dbfe None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:46.696491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dfbd2-445a-4c9a-840e-e95d93c1dbfe None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:46.696769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dfbd2-445a-4c9a-840e-e95d93c1dbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:46.703121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e4b4c-64fc-470b-8159-6ec2ac69d9d3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:46.707765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aea1f2-34d8-414e-a540-7e62a4fb3696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:46.708415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aea1f2-34d8-414e-a540-7e62a4fb3696 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:46.708696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aea1f2-34d8-414e-a540-7e62a4fb3696 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:46.708971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aea1f2-34d8-414e-a540-7e62a4fb3696 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:46.709728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aea1f2-34d8-414e-a540-7e62a4fb3696 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:46.710035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aea1f2-34d8-414e-a540-7e62a4fb3696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:46.711682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aea1f2-34d8-414e-a540-7e62a4fb3696 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:46.721728 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 111/220] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:46.733141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aea1f2-34d8-414e-a540-7e62a4fb3696 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:46.736062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-814dfbd2-445a-4c9a-840e-e95d93c1dbfe None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:46.737263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-814dfbd2-445a-4c9a-840e-e95d93c1dbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:46.743720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aea1f2-34d8-414e-a540-7e62a4fb3696 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:46.748737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620f9d-8afd-4644-a3e9-bd0e89bc72b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:46.749895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f9d-8afd-4644-a3e9-bd0e89bc72b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:46.750174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f9d-8afd-4644-a3e9-bd0e89bc72b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:46.750442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f9d-8afd-4644-a3e9-bd0e89bc72b5 admin admin] PATH_INFO: `/v3/users/cc04b38ceb644158a222a9f03a0e3fa6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:46.751788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28620f9d-8afd-4644-a3e9-bd0e89bc72b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc04b38ceb644158a222a9f03a0e3fa6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:46.754259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28620f9d-8afd-4644-a3e9-bd0e89bc72b5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:46.756330 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 112/221] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:46 2021] GET /identity/v3/users/cc04b38ceb644158a222a9f03a0e3fa6 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:46.759080 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 110/222] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:46.763487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620f9d-8afd-4644-a3e9-bd0e89bc72b5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:46.773874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620f9d-8afd-4644-a3e9-bd0e89bc72b5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:46.782798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f34ddb-f8ea-4bb4-9548-2c13340b7dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:46.783700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f34ddb-f8ea-4bb4-9548-2c13340b7dec admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:46.783979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f34ddb-f8ea-4bb4-9548-2c13340b7dec admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:46.784248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f34ddb-f8ea-4bb4-9548-2c13340b7dec admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:46.785440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f34ddb-f8ea-4bb4-9548-2c13340b7dec admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:46.787507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f34ddb-f8ea-4bb4-9548-2c13340b7dec admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:46.789177 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 113/223] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:46 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:46.795821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dfbd2-445a-4c9a-840e-e95d93c1dbfe None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:46.805557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dfbd2-445a-4c9a-840e-e95d93c1dbfe None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:46.810092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2f367-33be-434a-b574-02acdefcfd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:46.810975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2f367-33be-434a-b574-02acdefcfd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:46.811273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2f367-33be-434a-b574-02acdefcfd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:46.811545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2f367-33be-434a-b574-02acdefcfd3d admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/users/cc04b38ceb644158a222a9f03a0e3fa6/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:46.813411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f34ddb-f8ea-4bb4-9548-2c13340b7dec admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:46.814581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2f367-33be-434a-b574-02acdefcfd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d57f777fe5147a9a30ce29df70e5d45, user_id=cc04b38ceb644158a222a9f03a0e3fa6, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:46.817326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2f367-33be-434a-b574-02acdefcfd3d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:46.824838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f34ddb-f8ea-4bb4-9548-2c13340b7dec admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:46.829355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c9fdc-0feb-43fc-942c-ab4fd293beaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:46.830222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c9fdc-0feb-43fc-942c-ab4fd293beaa admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:46.830507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c9fdc-0feb-43fc-942c-ab4fd293beaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:46.830778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c9fdc-0feb-43fc-942c-ab4fd293beaa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:46.841845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c9fdc-0feb-43fc-942c-ab4fd293beaa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:46.848817 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-060c9fdc-0feb-43fc-942c-ab4fd293beaa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:46.849443 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 111/224] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:30:46 2021] PUT /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/users/cc04b38ceb644158a222a9f03a0e3fa6/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:30:46.850413 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 114/225] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:30:46.865671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2f367-33be-434a-b574-02acdefcfd3d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:46.967655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2f367-33be-434a-b574-02acdefcfd3d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:46.972472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641ec28-ed45-490e-a160-4d4b746a79dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:46.973134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641ec28-ed45-490e-a160-4d4b746a79dd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:46.973424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641ec28-ed45-490e-a160-4d4b746a79dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:46.973687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641ec28-ed45-490e-a160-4d4b746a79dd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:46.974450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641ec28-ed45-490e-a160-4d4b746a79dd admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:46.974756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641ec28-ed45-490e-a160-4d4b746a79dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:46.976457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641ec28-ed45-490e-a160-4d4b746a79dd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:46.991066 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 112/226] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:46.997374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c9fdc-0feb-43fc-942c-ab4fd293beaa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.017540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c9fdc-0feb-43fc-942c-ab4fd293beaa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.023117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c9678-bbd3-4515-9abf-fddcdf03c0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.024030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c9678-bbd3-4515-9abf-fddcdf03c0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.024387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c9678-bbd3-4515-9abf-fddcdf03c0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.024668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c9678-bbd3-4515-9abf-fddcdf03c0a8 admin admin] PATH_INFO: `/v3/users/cc04b38ceb644158a222a9f03a0e3fa6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.026037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c9678-bbd3-4515-9abf-fddcdf03c0a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc04b38ceb644158a222a9f03a0e3fa6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.036684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c9678-bbd3-4515-9abf-fddcdf03c0a8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.038892 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 115/227] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:46 2021] GET /identity/v3/users/cc04b38ceb644158a222a9f03a0e3fa6 => generated 283 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:47.044910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641ec28-ed45-490e-a160-4d4b746a79dd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.047873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6066-d7cf-431a-aab3-0e26f434551d None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.048163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6066-d7cf-431a-aab3-0e26f434551d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.048439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef6066-d7cf-431a-aab3-0e26f434551d None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.050440 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 116/228] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:47.064697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641ec28-ed45-490e-a160-4d4b746a79dd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.067101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f53e-83cf-4161-bbe1-e11e3bcbab7d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.067436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f53e-83cf-4161-bbe1-e11e3bcbab7d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.067712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f53e-83cf-4161-bbe1-e11e3bcbab7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.086188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf354d-2974-41c9-9a56-c25184060937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.087077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf354d-2974-41c9-9a56-c25184060937 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.087385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf354d-2974-41c9-9a56-c25184060937 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.087706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf354d-2974-41c9-9a56-c25184060937 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.089278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf354d-2974-41c9-9a56-c25184060937 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.094898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf354d-2974-41c9-9a56-c25184060937 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.096884 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 113/229] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:47.098016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6dd5f53e-83cf-4161-bbe1-e11e3bcbab7d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:47.099353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6dd5f53e-83cf-4161-bbe1-e11e3bcbab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:47.103411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf354d-2974-41c9-9a56-c25184060937 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.117743 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 117/230] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:47.119918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf354d-2974-41c9-9a56-c25184060937 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.125023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fc85e-6856-4d4d-af10-2b61936d634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.125995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fc85e-6856-4d4d-af10-2b61936d634c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.126277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fc85e-6856-4d4d-af10-2b61936d634c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.126598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fc85e-6856-4d4d-af10-2b61936d634c admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/users/cc04b38ceb644158a222a9f03a0e3fa6/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.128896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fc85e-6856-4d4d-af10-2b61936d634c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d57f777fe5147a9a30ce29df70e5d45, user_id=cc04b38ceb644158a222a9f03a0e3fa6, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.131875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fc85e-6856-4d4d-af10-2b61936d634c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.158237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5f53e-83cf-4161-bbe1-e11e3bcbab7d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.165856 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 114/231] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:30:47 2021] PUT /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/users/cc04b38ceb644158a222a9f03a0e3fa6/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:30:47.169467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5f53e-83cf-4161-bbe1-e11e3bcbab7d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.234090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6392a-4a69-4b3c-853f-80eafc9c5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.234834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6392a-4a69-4b3c-853f-80eafc9c5541 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.235117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6392a-4a69-4b3c-853f-80eafc9c5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.235427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6392a-4a69-4b3c-853f-80eafc9c5541 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.249406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6392a-4a69-4b3c-853f-80eafc9c5541 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:47.257519 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-3cf6392a-4a69-4b3c-853f-80eafc9c5541 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:30:47.258785 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 118/232] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:30:47.262397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befd9ee-b37e-45fc-8951-af1d5ad22984 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.262689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befd9ee-b37e-45fc-8951-af1d5ad22984 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.262967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befd9ee-b37e-45fc-8951-af1d5ad22984 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.265229 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 115/233] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:47.269113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6392a-4a69-4b3c-853f-80eafc9c5541 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.275556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7df9b-b799-4537-80b4-182a9648d008 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.275556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7df9b-b799-4537-80b4-182a9648d008 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.276082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7df9b-b799-4537-80b4-182a9648d008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.280326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6392a-4a69-4b3c-853f-80eafc9c5541 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.291318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43d642-18f1-4be1-9bb3-40d471cb22aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.292009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43d642-18f1-4be1-9bb3-40d471cb22aa admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.292293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43d642-18f1-4be1-9bb3-40d471cb22aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.292571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43d642-18f1-4be1-9bb3-40d471cb22aa admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.293359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43d642-18f1-4be1-9bb3-40d471cb22aa admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:47.293669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43d642-18f1-4be1-9bb3-40d471cb22aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.295300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43d642-18f1-4be1-9bb3-40d471cb22aa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.302889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-26d7df9b-b799-4537-80b4-182a9648d008 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:47.304349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-26d7df9b-b799-4537-80b4-182a9648d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:47.307347 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 119/234] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:47.313975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43d642-18f1-4be1-9bb3-40d471cb22aa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.315084 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 116/235] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:47.325164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43d642-18f1-4be1-9bb3-40d471cb22aa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.330568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cd04d-ea2d-4f4e-b440-a084cbbf5270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.331896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cd04d-ea2d-4f4e-b440-a084cbbf5270 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.332375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cd04d-ea2d-4f4e-b440-a084cbbf5270 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.332859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cd04d-ea2d-4f4e-b440-a084cbbf5270 admin admin] PATH_INFO: `/v3/users/cc04b38ceb644158a222a9f03a0e3fa6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.334415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cd04d-ea2d-4f4e-b440-a084cbbf5270 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc04b38ceb644158a222a9f03a0e3fa6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.337123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cd04d-ea2d-4f4e-b440-a084cbbf5270 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.340068 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 120/236] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/users/cc04b38ceb644158a222a9f03a0e3fa6 => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:47.343502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7df9b-b799-4537-80b4-182a9648d008 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.346604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cd04d-ea2d-4f4e-b440-a084cbbf5270 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.353481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7df9b-b799-4537-80b4-182a9648d008 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.358670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24f6ba-2223-419c-8f9e-ad07aa8dd34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.359721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24f6ba-2223-419c-8f9e-ad07aa8dd34c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.360116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24f6ba-2223-419c-8f9e-ad07aa8dd34c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.360498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24f6ba-2223-419c-8f9e-ad07aa8dd34c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.360967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cd04d-ea2d-4f4e-b440-a084cbbf5270 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.366655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0f926-1b43-4dc9-abe7-c8d8efdebce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.368099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0f926-1b43-4dc9-abe7-c8d8efdebce0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.368565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0f926-1b43-4dc9-abe7-c8d8efdebce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.369559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0f926-1b43-4dc9-abe7-c8d8efdebce0 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.371392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0f926-1b43-4dc9-abe7-c8d8efdebce0 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.373585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24f6ba-2223-419c-8f9e-ad07aa8dd34c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:47.374180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0f926-1b43-4dc9-abe7-c8d8efdebce0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.376330 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 121/237] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:47.381600 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-8d24f6ba-2223-419c-8f9e-ad07aa8dd34c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:47.382753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0f926-1b43-4dc9-abe7-c8d8efdebce0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.387455 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 117/238] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:47.389955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24f6ba-2223-419c-8f9e-ad07aa8dd34c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.393910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0f926-1b43-4dc9-abe7-c8d8efdebce0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.400117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1834016-b1c2-44a9-a0b6-7908fc4af923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.401115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24f6ba-2223-419c-8f9e-ad07aa8dd34c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.401612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1834016-b1c2-44a9-a0b6-7908fc4af923 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.402136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1834016-b1c2-44a9-a0b6-7908fc4af923 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.402595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1834016-b1c2-44a9-a0b6-7908fc4af923 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/users/cc04b38ceb644158a222a9f03a0e3fa6/roles/9a635e239d2c4df7972fb54b7ed42aa6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.405714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1834016-b1c2-44a9-a0b6-7908fc4af923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d57f777fe5147a9a30ce29df70e5d45, user_id=cc04b38ceb644158a222a9f03a0e3fa6, role_id=9a635e239d2c4df7972fb54b7ed42aa6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.405958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459a3d3-7e31-4598-a261-46af1aaf3495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.406717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459a3d3-7e31-4598-a261-46af1aaf3495 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.407098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459a3d3-7e31-4598-a261-46af1aaf3495 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.407510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459a3d3-7e31-4598-a261-46af1aaf3495 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.408386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459a3d3-7e31-4598-a261-46af1aaf3495 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:47.408792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459a3d3-7e31-4598-a261-46af1aaf3495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.409757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1834016-b1c2-44a9-a0b6-7908fc4af923 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.410587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459a3d3-7e31-4598-a261-46af1aaf3495 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.429723 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 118/239] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:47.437252 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 122/240] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:30:47 2021] PUT /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/users/cc04b38ceb644158a222a9f03a0e3fa6/roles/9a635e239d2c4df7972fb54b7ed42aa6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:30:47.438644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459a3d3-7e31-4598-a261-46af1aaf3495 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.457272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459a3d3-7e31-4598-a261-46af1aaf3495 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.525729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd649b-6af4-4579-b2bb-3aed9e2e4416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.526616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd649b-6af4-4579-b2bb-3aed9e2e4416 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.526899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd649b-6af4-4579-b2bb-3aed9e2e4416 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.527228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd649b-6af4-4579-b2bb-3aed9e2e4416 admin admin] PATH_INFO: `/v3/users/0d2626f9e4ee4867b6a7edb351809e53` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.543702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd649b-6af4-4579-b2bb-3aed9e2e4416 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d2626f9e4ee4867b6a7edb351809e53)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.546217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd649b-6af4-4579-b2bb-3aed9e2e4416 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.548475 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 119/241] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/users/0d2626f9e4ee4867b6a7edb351809e53 => generated 297 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:47.554392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1834016-b1c2-44a9-a0b6-7908fc4af923 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.566765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1834016-b1c2-44a9-a0b6-7908fc4af923 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.571552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e4594-0a87-4e6e-9625-e92b5b3c47a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.572787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e4594-0a87-4e6e-9625-e92b5b3c47a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.573070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e4594-0a87-4e6e-9625-e92b5b3c47a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.573350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e4594-0a87-4e6e-9625-e92b5b3c47a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.582930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e4594-0a87-4e6e-9625-e92b5b3c47a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.584869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e4594-0a87-4e6e-9625-e92b5b3c47a5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.596034 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 123/242] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:47.602510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd649b-6af4-4579-b2bb-3aed9e2e4416 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.614088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd649b-6af4-4579-b2bb-3aed9e2e4416 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.618944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785af07a-9f7a-42b6-a7ed-fdc2aa2cc1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.619849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af07a-9f7a-42b6-a7ed-fdc2aa2cc1dd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.620136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af07a-9f7a-42b6-a7ed-fdc2aa2cc1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.620412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af07a-9f7a-42b6-a7ed-fdc2aa2cc1dd admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.621958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785af07a-9f7a-42b6-a7ed-fdc2aa2cc1dd admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.623495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b4242-a9f6-41f8-87db-e5acd9e01db1 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.623779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b4242-a9f6-41f8-87db-e5acd9e01db1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.624052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b4242-a9f6-41f8-87db-e5acd9e01db1 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.625683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785af07a-9f7a-42b6-a7ed-fdc2aa2cc1dd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.626455 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 124/243] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:30:47.627678 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 120/244] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:47.634938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b4242-a9f6-41f8-87db-e5acd9e01db1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.643127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99ea9a-248c-4d87-97cb-e3b4030bb438 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.643607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99ea9a-248c-4d87-97cb-e3b4030bb438 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.643983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99ea9a-248c-4d87-97cb-e3b4030bb438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.652771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b4242-a9f6-41f8-87db-e5acd9e01db1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.657747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540032e-a74b-4ab5-8f2b-5cc53783a031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.658660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540032e-a74b-4ab5-8f2b-5cc53783a031 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.659002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540032e-a74b-4ab5-8f2b-5cc53783a031 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.659359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540032e-a74b-4ab5-8f2b-5cc53783a031 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.660324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540032e-a74b-4ab5-8f2b-5cc53783a031 admin admin] RBAC: Adding query filter params (role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45, user.id=0d2626f9e4ee4867b6a7edb351809e53) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:47.660679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540032e-a74b-4ab5-8f2b-5cc53783a031 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.662750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540032e-a74b-4ab5-8f2b-5cc53783a031 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.675452 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 125/245] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/role_assignments?user.id=0d2626f9e4ee4867b6a7edb351809e53&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:47.676951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ee99ea9a-248c-4d87-97cb-e3b4030bb438 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:47.678335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ee99ea9a-248c-4d87-97cb-e3b4030bb438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:47.693335 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 121/246] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 27 20:30:47.721525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540032e-a74b-4ab5-8f2b-5cc53783a031 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.732632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540032e-a74b-4ab5-8f2b-5cc53783a031 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.738039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55c76c-842e-4de4-bcec-b7846c494a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.738848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c76c-842e-4de4-bcec-b7846c494a3b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.739126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c76c-842e-4de4-bcec-b7846c494a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.740216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55c76c-842e-4de4-bcec-b7846c494a3b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.741458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55c76c-842e-4de4-bcec-b7846c494a3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.743179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55c76c-842e-4de4-bcec-b7846c494a3b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.745137 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 126/247] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:47.751546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99ea9a-248c-4d87-97cb-e3b4030bb438 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:47.761918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99ea9a-248c-4d87-97cb-e3b4030bb438 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:47.766718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c861fd-0b49-4370-960c-bb242543d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:47.767448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c861fd-0b49-4370-960c-bb242543d8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:47.767736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c861fd-0b49-4370-960c-bb242543d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:47.768007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c861fd-0b49-4370-960c-bb242543d8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:47.768750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c861fd-0b49-4370-960c-bb242543d8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:47.770794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c861fd-0b49-4370-960c-bb242543d8c4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:47.803588 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 122/248] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:30:47 2021] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:50.175153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd2bfd-254a-4bfc-ab8e-c78d77379f72 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.175904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd2bfd-254a-4bfc-ab8e-c78d77379f72 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.175904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd2bfd-254a-4bfc-ab8e-c78d77379f72 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.177791 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 127/249] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:50.183924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821dc7d-2088-44e2-9be5-602adccc63c7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.184417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821dc7d-2088-44e2-9be5-602adccc63c7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.184586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821dc7d-2088-44e2-9be5-602adccc63c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.208899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f821dc7d-2088-44e2-9be5-602adccc63c7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:50.210084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f821dc7d-2088-44e2-9be5-602adccc63c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:50.225224 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 123/250] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:50.260514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36db3ba-7051-401a-a602-f9f18ba39d10 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.261159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36db3ba-7051-401a-a602-f9f18ba39d10 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.261675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36db3ba-7051-401a-a602-f9f18ba39d10 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.263907 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 128/251] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:50.270083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76935eb-d3d3-4f62-a500-bbed6c09cbd6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.270379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76935eb-d3d3-4f62-a500-bbed6c09cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.270661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76935eb-d3d3-4f62-a500-bbed6c09cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.272583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36db3ba-7051-401a-a602-f9f18ba39d10 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.291913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36db3ba-7051-401a-a602-f9f18ba39d10 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.294769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a76935eb-d3d3-4f62-a500-bbed6c09cbd6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:50.299950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe75561-06db-4242-80cf-1643fd8b0080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.300119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a76935eb-d3d3-4f62-a500-bbed6c09cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:50.300738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe75561-06db-4242-80cf-1643fd8b0080 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.301016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe75561-06db-4242-80cf-1643fd8b0080 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.301288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe75561-06db-4242-80cf-1643fd8b0080 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.312716 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 124/252] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:50.326164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe75561-06db-4242-80cf-1643fd8b0080 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:50.332988 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-afe75561-06db-4242-80cf-1643fd8b0080 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:30:50.334204 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 129/253] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:30:50.341478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76935eb-d3d3-4f62-a500-bbed6c09cbd6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.351914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76935eb-d3d3-4f62-a500-bbed6c09cbd6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.361766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95332-a13c-4203-a0b0-fba8cf9cc2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.362446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95332-a13c-4203-a0b0-fba8cf9cc2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.362555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe75561-06db-4242-80cf-1643fd8b0080 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.362718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95332-a13c-4203-a0b0-fba8cf9cc2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.362997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95332-a13c-4203-a0b0-fba8cf9cc2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.364091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95332-a13c-4203-a0b0-fba8cf9cc2d2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:50.364403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95332-a13c-4203-a0b0-fba8cf9cc2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.366020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95332-a13c-4203-a0b0-fba8cf9cc2d2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.381279 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 125/254] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:50.381441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe75561-06db-4242-80cf-1643fd8b0080 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.387066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0fb73-7716-4936-b007-d571e66ca006 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.387389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0fb73-7716-4936-b007-d571e66ca006 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.387670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0fb73-7716-4936-b007-d571e66ca006 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.388725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6126d7-bb33-4572-9340-429627adcca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.389459 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 126/255] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:30:50.389576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6126d7-bb33-4572-9340-429627adcca2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.389766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6126d7-bb33-4572-9340-429627adcca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.390034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6126d7-bb33-4572-9340-429627adcca2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.390213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0fb73-7716-4936-b007-d571e66ca006 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.403939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0fb73-7716-4936-b007-d571e66ca006 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.408654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cfba3-639f-4c76-b389-028eff4116d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.409492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cfba3-639f-4c76-b389-028eff4116d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.409772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cfba3-639f-4c76-b389-028eff4116d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.410044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cfba3-639f-4c76-b389-028eff4116d9 admin admin] PATH_INFO: `/v3/users/cc04b38ceb644158a222a9f03a0e3fa6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.411244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cfba3-639f-4c76-b389-028eff4116d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc04b38ceb644158a222a9f03a0e3fa6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.413732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cfba3-639f-4c76-b389-028eff4116d9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.416439 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 127/256] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/users/cc04b38ceb644158a222a9f03a0e3fa6 => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:50.417639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab90f8f-3494-4424-9754-5c76fe5c2dc7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.417923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab90f8f-3494-4424-9754-5c76fe5c2dc7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.418197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab90f8f-3494-4424-9754-5c76fe5c2dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.420179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6126d7-bb33-4572-9340-429627adcca2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:50.429917 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-9b6126d7-bb33-4572-9340-429627adcca2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:50.429917 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 130/257] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:30:50.429917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6126d7-bb33-4572-9340-429627adcca2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.436474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-aab90f8f-3494-4424-9754-5c76fe5c2dc7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:50.437749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aab90f8f-3494-4424-9754-5c76fe5c2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:50.452211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6126d7-bb33-4572-9340-429627adcca2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.454294 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 128/258] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:50.454959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab90f8f-3494-4424-9754-5c76fe5c2dc7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.467926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02692c-3a9c-48cb-894a-9d55c8266117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.468576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02692c-3a9c-48cb-894a-9d55c8266117 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.468854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02692c-3a9c-48cb-894a-9d55c8266117 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.469125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02692c-3a9c-48cb-894a-9d55c8266117 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.485529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab90f8f-3494-4424-9754-5c76fe5c2dc7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.487448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02692c-3a9c-48cb-894a-9d55c8266117 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.489229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02692c-3a9c-48cb-894a-9d55c8266117 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.496986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0066892-ba85-41ce-9d0a-4954749f24f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.497654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0066892-ba85-41ce-9d0a-4954749f24f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.497933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0066892-ba85-41ce-9d0a-4954749f24f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.498213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0066892-ba85-41ce-9d0a-4954749f24f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.498976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0066892-ba85-41ce-9d0a-4954749f24f6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:50.507308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0066892-ba85-41ce-9d0a-4954749f24f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.508966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0066892-ba85-41ce-9d0a-4954749f24f6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.519493 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 131/259] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:50.522621 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 129/260] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:50.527145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02692c-3a9c-48cb-894a-9d55c8266117 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.532293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0066892-ba85-41ce-9d0a-4954749f24f6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.542807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02692c-3a9c-48cb-894a-9d55c8266117 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.547723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0066892-ba85-41ce-9d0a-4954749f24f6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.552599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf44ce8-6bac-46bb-b34b-ad7cf6942bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.553447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf44ce8-6bac-46bb-b34b-ad7cf6942bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.553729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf44ce8-6bac-46bb-b34b-ad7cf6942bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.553999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf44ce8-6bac-46bb-b34b-ad7cf6942bd4 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.555551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf44ce8-6bac-46bb-b34b-ad7cf6942bd4 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.557646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf44ce8-6bac-46bb-b34b-ad7cf6942bd4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.559712 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 132/261] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:50.560949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf44ce8-6bac-46bb-b34b-ad7cf6942bd4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.561767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5181d8-b5c4-45a9-b453-c96a306c6012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.562623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5181d8-b5c4-45a9-b453-c96a306c6012 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.562897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5181d8-b5c4-45a9-b453-c96a306c6012 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.563166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5181d8-b5c4-45a9-b453-c96a306c6012 admin admin] PATH_INFO: `/v3/users/cc04b38ceb644158a222a9f03a0e3fa6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.564671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5181d8-b5c4-45a9-b453-c96a306c6012 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc04b38ceb644158a222a9f03a0e3fa6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.566796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5181d8-b5c4-45a9-b453-c96a306c6012 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.568536 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 130/262] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/users/cc04b38ceb644158a222a9f03a0e3fa6 => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:50.569160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5181d8-b5c4-45a9-b453-c96a306c6012 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.583601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf44ce8-6bac-46bb-b34b-ad7cf6942bd4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.588124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5181d8-b5c4-45a9-b453-c96a306c6012 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.593714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429516cf-fa6f-41b4-a7c1-d327230d4f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.594506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429516cf-fa6f-41b4-a7c1-d327230d4f57 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.594783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429516cf-fa6f-41b4-a7c1-d327230d4f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.595155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429516cf-fa6f-41b4-a7c1-d327230d4f57 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.598274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801dc77-f05d-44b6-97d0-bc2ae2996847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.598915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801dc77-f05d-44b6-97d0-bc2ae2996847 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.599192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801dc77-f05d-44b6-97d0-bc2ae2996847 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.599487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801dc77-f05d-44b6-97d0-bc2ae2996847 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.600341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801dc77-f05d-44b6-97d0-bc2ae2996847 admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45, user.id=cc04b38ceb644158a222a9f03a0e3fa6) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:50.600649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801dc77-f05d-44b6-97d0-bc2ae2996847 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.602499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801dc77-f05d-44b6-97d0-bc2ae2996847 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.617131 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 131/263] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/role_assignments?user.id=cc04b38ceb644158a222a9f03a0e3fa6&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:50.617779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801dc77-f05d-44b6-97d0-bc2ae2996847 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.618930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429516cf-fa6f-41b4-a7c1-d327230d4f57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:50.626642 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-429516cf-fa6f-41b4-a7c1-d327230d4f57 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:30:50.635543 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 133/264] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:50.636528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429516cf-fa6f-41b4-a7c1-d327230d4f57 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.640915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801dc77-f05d-44b6-97d0-bc2ae2996847 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.648409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd04fb-f085-4e4f-bab1-03fb124ce882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.649433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd04fb-f085-4e4f-bab1-03fb124ce882 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.649994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd04fb-f085-4e4f-bab1-03fb124ce882 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.650472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd04fb-f085-4e4f-bab1-03fb124ce882 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.658991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429516cf-fa6f-41b4-a7c1-d327230d4f57 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.659872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd04fb-f085-4e4f-bab1-03fb124ce882 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.661889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd04fb-f085-4e4f-bab1-03fb124ce882 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.671389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0793197-b877-4431-84cb-4c704eadff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.672079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0793197-b877-4431-84cb-4c704eadff16 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.672359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0793197-b877-4431-84cb-4c704eadff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.672630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0793197-b877-4431-84cb-4c704eadff16 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.673410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0793197-b877-4431-84cb-4c704eadff16 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:50.673716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0793197-b877-4431-84cb-4c704eadff16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.675108 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 132/265] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:50.679506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0793197-b877-4431-84cb-4c704eadff16 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.686167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd04fb-f085-4e4f-bab1-03fb124ce882 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.695415 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 134/266] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:50.703980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd04fb-f085-4e4f-bab1-03fb124ce882 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.708302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0793197-b877-4431-84cb-4c704eadff16 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.720711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9456a7-96d0-4cfc-b76f-dd3bd9b94e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.723233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9456a7-96d0-4cfc-b76f-dd3bd9b94e91 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.723945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9456a7-96d0-4cfc-b76f-dd3bd9b94e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.724407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0793197-b877-4431-84cb-4c704eadff16 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.725076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9456a7-96d0-4cfc-b76f-dd3bd9b94e91 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.727716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9456a7-96d0-4cfc-b76f-dd3bd9b94e91 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.733358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9456a7-96d0-4cfc-b76f-dd3bd9b94e91 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.736553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ed67e-0b3f-42cc-9b94-6c2d6d80e6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.737839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ed67e-0b3f-42cc-9b94-6c2d6d80e6ba admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.738292 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 133/267] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:50.738856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ed67e-0b3f-42cc-9b94-6c2d6d80e6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.743620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ed67e-0b3f-42cc-9b94-6c2d6d80e6ba admin admin] PATH_INFO: `/v3/users/cc04b38ceb644158a222a9f03a0e3fa6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.745581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ed67e-0b3f-42cc-9b94-6c2d6d80e6ba admin admin] RBAC: Authorizing `identity:get_user(user_id=cc04b38ceb644158a222a9f03a0e3fa6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.748240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ed67e-0b3f-42cc-9b94-6c2d6d80e6ba admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.750832 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 135/268] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/users/cc04b38ceb644158a222a9f03a0e3fa6 => generated 283 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:50.757817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9456a7-96d0-4cfc-b76f-dd3bd9b94e91 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.767802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ed67e-0b3f-42cc-9b94-6c2d6d80e6ba admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.774079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9456a7-96d0-4cfc-b76f-dd3bd9b94e91 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.784255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad57e6-b1b6-4dbc-97ee-24e41c06ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.785451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad57e6-b1b6-4dbc-97ee-24e41c06ba73 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.787632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad57e6-b1b6-4dbc-97ee-24e41c06ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.788684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad57e6-b1b6-4dbc-97ee-24e41c06ba73 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.789711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ed67e-0b3f-42cc-9b94-6c2d6d80e6ba admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.801582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad57e6-b1b6-4dbc-97ee-24e41c06ba73 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.804050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57897341-7026-4752-8c36-706738949622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.805988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57897341-7026-4752-8c36-706738949622 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.807452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57897341-7026-4752-8c36-706738949622 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.807979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad57e6-b1b6-4dbc-97ee-24e41c06ba73 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.808496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57897341-7026-4752-8c36-706738949622 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.809777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57897341-7026-4752-8c36-706738949622 admin admin] RBAC: Adding query filter params (role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45, user.id=cc04b38ceb644158a222a9f03a0e3fa6) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:50.812165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57897341-7026-4752-8c36-706738949622 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.816988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57897341-7026-4752-8c36-706738949622 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.826241 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 136/269] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/role_assignments?user.id=cc04b38ceb644158a222a9f03a0e3fa6&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:50.829908 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 134/270] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:50.835797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57897341-7026-4752-8c36-706738949622 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.849503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57897341-7026-4752-8c36-706738949622 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.858529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268b29b-03b8-4bd8-80de-7e1f35b23ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.859907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268b29b-03b8-4bd8-80de-7e1f35b23ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.860441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268b29b-03b8-4bd8-80de-7e1f35b23ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.860974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268b29b-03b8-4bd8-80de-7e1f35b23ad8 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.863926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268b29b-03b8-4bd8-80de-7e1f35b23ad8 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.866473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268b29b-03b8-4bd8-80de-7e1f35b23ad8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.868922 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 137/271] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:50.875691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad57e6-b1b6-4dbc-97ee-24e41c06ba73 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:50.887901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad57e6-b1b6-4dbc-97ee-24e41c06ba73 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:50.894218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6070b-a830-4115-8d59-f6ca250c600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:50.895245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6070b-a830-4115-8d59-f6ca250c600d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:50.895817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6070b-a830-4115-8d59-f6ca250c600d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:50.896315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6070b-a830-4115-8d59-f6ca250c600d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:50.897507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6070b-a830-4115-8d59-f6ca250c600d admin admin] RBAC: Adding query filter params (role.id=9a635e239d2c4df7972fb54b7ed42aa6, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45, user.id=cc04b38ceb644158a222a9f03a0e3fa6) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:50.898096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6070b-a830-4115-8d59-f6ca250c600d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:50.900855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6070b-a830-4115-8d59-f6ca250c600d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:50.908670 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 135/272] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:50 2021] GET /identity/v3/role_assignments?user.id=cc04b38ceb644158a222a9f03a0e3fa6&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=9a635e239d2c4df7972fb54b7ed42aa6 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:51.309367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c5623-cf3c-4ea0-b0ed-ae8be81bd441 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:51.309903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c5623-cf3c-4ea0-b0ed-ae8be81bd441 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:51.309903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c5623-cf3c-4ea0-b0ed-ae8be81bd441 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:51.312162 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 138/273] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:51.319101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d303f-7d0d-4e57-91a2-2046e9654463 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:51.319652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d303f-7d0d-4e57-91a2-2046e9654463 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:51.319727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d303f-7d0d-4e57-91a2-2046e9654463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:51.339559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9c8d303f-7d0d-4e57-91a2-2046e9654463 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:51.340772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9c8d303f-7d0d-4e57-91a2-2046e9654463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:51.350099 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 136/274] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:51.377404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c5623-cf3c-4ea0-b0ed-ae8be81bd441 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:51.394217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c5623-cf3c-4ea0-b0ed-ae8be81bd441 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:51.398710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d945f4-c0f8-4ff5-84fd-666b9017c922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:51.399573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d945f4-c0f8-4ff5-84fd-666b9017c922 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:51.400519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d945f4-c0f8-4ff5-84fd-666b9017c922 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:51.400805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d945f4-c0f8-4ff5-84fd-666b9017c922 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:51.414860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d945f4-c0f8-4ff5-84fd-666b9017c922 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:51.422093 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-40d945f4-c0f8-4ff5-84fd-666b9017c922 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:51.423557 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 139/275] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:51.429906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d303f-7d0d-4e57-91a2-2046e9654463 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:51.439419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d303f-7d0d-4e57-91a2-2046e9654463 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:51.444499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e267fb-a51a-4a35-b3a3-783b1ee4ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:51.445174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e267fb-a51a-4a35-b3a3-783b1ee4ecdd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:51.445458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e267fb-a51a-4a35-b3a3-783b1ee4ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:51.445734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e267fb-a51a-4a35-b3a3-783b1ee4ecdd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:51.447366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e267fb-a51a-4a35-b3a3-783b1ee4ecdd admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:51.447528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e267fb-a51a-4a35-b3a3-783b1ee4ecdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:51.451660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e267fb-a51a-4a35-b3a3-783b1ee4ecdd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:51.459406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 137/276] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:51.466157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d945f4-c0f8-4ff5-84fd-666b9017c922 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:51.476478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d945f4-c0f8-4ff5-84fd-666b9017c922 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:51.483850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f85538-cfb9-48fc-a90c-cf4be513ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:51.484775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f85538-cfb9-48fc-a90c-cf4be513ecc6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:51.485063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f85538-cfb9-48fc-a90c-cf4be513ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:51.485399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f85538-cfb9-48fc-a90c-cf4be513ecc6 admin admin] PATH_INFO: `/v3/users/0d2626f9e4ee4867b6a7edb351809e53` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:51.486673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f85538-cfb9-48fc-a90c-cf4be513ecc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d2626f9e4ee4867b6a7edb351809e53)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:51.489256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f85538-cfb9-48fc-a90c-cf4be513ecc6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:51.491275 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 140/277] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:51 2021] GET /identity/v3/users/0d2626f9e4ee4867b6a7edb351809e53 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:51.496952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e267fb-a51a-4a35-b3a3-783b1ee4ecdd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:51.510234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e267fb-a51a-4a35-b3a3-783b1ee4ecdd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:51.517808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f6c28-ef61-4034-94cc-b6dfef2a5751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:51.518691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f6c28-ef61-4034-94cc-b6dfef2a5751 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:51.518980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f6c28-ef61-4034-94cc-b6dfef2a5751 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:51.519423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f6c28-ef61-4034-94cc-b6dfef2a5751 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:51.520913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f6c28-ef61-4034-94cc-b6dfef2a5751 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:51.523706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f6c28-ef61-4034-94cc-b6dfef2a5751 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:51.525473 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 138/278] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:51 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:51.531085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f85538-cfb9-48fc-a90c-cf4be513ecc6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:51.541045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f85538-cfb9-48fc-a90c-cf4be513ecc6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:51.545294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c90fd6-05d2-4c15-8e64-854b75bf5dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:51.546190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c90fd6-05d2-4c15-8e64-854b75bf5dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:51.546473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c90fd6-05d2-4c15-8e64-854b75bf5dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:51.546746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c90fd6-05d2-4c15-8e64-854b75bf5dcc admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/users/0d2626f9e4ee4867b6a7edb351809e53/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:51.548758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c90fd6-05d2-4c15-8e64-854b75bf5dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d57f777fe5147a9a30ce29df70e5d45, user_id=0d2626f9e4ee4867b6a7edb351809e53, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:51.551410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c90fd6-05d2-4c15-8e64-854b75bf5dcc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:51.564710 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 141/279] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:30:51 2021] PUT /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/users/0d2626f9e4ee4867b6a7edb351809e53/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:30:51.750128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3d97e-b529-46b0-951d-167e3c8633f3 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:51.750538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3d97e-b529-46b0-951d-167e3c8633f3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:51.750708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3d97e-b529-46b0-951d-167e3c8633f3 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:51.752612 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 139/280] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:51.760115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25372ee9-ef49-4eed-806a-60b2851c44ef None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:51.760438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25372ee9-ef49-4eed-806a-60b2851c44ef None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:51.760683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25372ee9-ef49-4eed-806a-60b2851c44ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:51.779604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-25372ee9-ef49-4eed-806a-60b2851c44ef None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:51.780815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-25372ee9-ef49-4eed-806a-60b2851c44ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:51.838703 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 142/281] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:51.864573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3d97e-b529-46b0-951d-167e3c8633f3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:51.877786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3d97e-b529-46b0-951d-167e3c8633f3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:51.882160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bc19a-90e5-446e-9fe8-fbc7daa27623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:51.883095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bc19a-90e5-446e-9fe8-fbc7daa27623 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:51.883564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bc19a-90e5-446e-9fe8-fbc7daa27623 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:51.883986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bc19a-90e5-446e-9fe8-fbc7daa27623 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:51.885916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bc19a-90e5-446e-9fe8-fbc7daa27623 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:51.887795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bc19a-90e5-446e-9fe8-fbc7daa27623 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:51.889619 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 140/282] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:51.895647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25372ee9-ef49-4eed-806a-60b2851c44ef None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:51.904625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25372ee9-ef49-4eed-806a-60b2851c44ef None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:51.908931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeaf097-5a98-427d-9447-6c7890ea9f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:51.909591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaf097-5a98-427d-9447-6c7890ea9f35 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:51.909873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaf097-5a98-427d-9447-6c7890ea9f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:51.910147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaf097-5a98-427d-9447-6c7890ea9f35 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:51.910879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaf097-5a98-427d-9447-6c7890ea9f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:51.912805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeaf097-5a98-427d-9447-6c7890ea9f35 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:51.934710 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 143/283] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:30:51 2021] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:52.147380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b124a4-ad45-4130-83d3-e96e50701a45 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:52.147889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b124a4-ad45-4130-83d3-e96e50701a45 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:52.148178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b124a4-ad45-4130-83d3-e96e50701a45 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:52.150099 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 141/284] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:52.155891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a190b-6542-4cb2-a916-6eb49b3e710f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:52.156175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a190b-6542-4cb2-a916-6eb49b3e710f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:52.156446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a190b-6542-4cb2-a916-6eb49b3e710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:52.174732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-698a190b-6542-4cb2-a916-6eb49b3e710f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:52.176180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-698a190b-6542-4cb2-a916-6eb49b3e710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:52.184359 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 144/285] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:52.209222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b124a4-ad45-4130-83d3-e96e50701a45 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:52.221595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b124a4-ad45-4130-83d3-e96e50701a45 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:52.225868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e122a7a-2491-44d7-8500-953777ab695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:52.226651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122a7a-2491-44d7-8500-953777ab695d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:52.226930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122a7a-2491-44d7-8500-953777ab695d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:52.227203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122a7a-2491-44d7-8500-953777ab695d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:52.239676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e122a7a-2491-44d7-8500-953777ab695d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:52.247150 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-9e122a7a-2491-44d7-8500-953777ab695d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 27 20:30:52.248970 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 142/286] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:52 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:52.255395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a190b-6542-4cb2-a916-6eb49b3e710f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:52.265493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a190b-6542-4cb2-a916-6eb49b3e710f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:52.270296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87721d60-aea3-45ca-aff0-5a505acaefe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:52.270956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87721d60-aea3-45ca-aff0-5a505acaefe9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:52.271236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87721d60-aea3-45ca-aff0-5a505acaefe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:52.271538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87721d60-aea3-45ca-aff0-5a505acaefe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:52.272307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87721d60-aea3-45ca-aff0-5a505acaefe9 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:52.272594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87721d60-aea3-45ca-aff0-5a505acaefe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:52.274168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87721d60-aea3-45ca-aff0-5a505acaefe9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:52.283843 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 145/287] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:52 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:52.289908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e122a7a-2491-44d7-8500-953777ab695d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:52.301086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e122a7a-2491-44d7-8500-953777ab695d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:52.307444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fd972-0e11-4ec2-bc21-c4f0f803fc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:52.308296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fd972-0e11-4ec2-bc21-c4f0f803fc11 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:52.308576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fd972-0e11-4ec2-bc21-c4f0f803fc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:52.308841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fd972-0e11-4ec2-bc21-c4f0f803fc11 admin admin] PATH_INFO: `/v3/users/80811d7f2ff84ca1af635648dcfe6004` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:52.322986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fd972-0e11-4ec2-bc21-c4f0f803fc11 admin admin] RBAC: Authorizing `identity:get_user(user_id=80811d7f2ff84ca1af635648dcfe6004)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:52.325177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fd972-0e11-4ec2-bc21-c4f0f803fc11 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:52.327069 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 143/288] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:52 2021] GET /identity/v3/users/80811d7f2ff84ca1af635648dcfe6004 => generated 297 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:52.333888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87721d60-aea3-45ca-aff0-5a505acaefe9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:52.343909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87721d60-aea3-45ca-aff0-5a505acaefe9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:52.348534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee1639-59c8-4033-8cf0-764c4cfdf89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:52.349268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee1639-59c8-4033-8cf0-764c4cfdf89f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:52.349622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee1639-59c8-4033-8cf0-764c4cfdf89f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:52.349999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee1639-59c8-4033-8cf0-764c4cfdf89f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:52.358424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee1639-59c8-4033-8cf0-764c4cfdf89f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:52.360346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee1639-59c8-4033-8cf0-764c4cfdf89f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:52.370427 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 146/289] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:52.376486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fd972-0e11-4ec2-bc21-c4f0f803fc11 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:52.388782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fd972-0e11-4ec2-bc21-c4f0f803fc11 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:52.393520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f4d32-1cfc-45ed-9b2c-b1577c9f5f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:52.394584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f4d32-1cfc-45ed-9b2c-b1577c9f5f22 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:52.395060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f4d32-1cfc-45ed-9b2c-b1577c9f5f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:52.395528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f4d32-1cfc-45ed-9b2c-b1577c9f5f22 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:52.396917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f4d32-1cfc-45ed-9b2c-b1577c9f5f22 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:52.399352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f4d32-1cfc-45ed-9b2c-b1577c9f5f22 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:52.402111 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 144/290] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:52 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:52.408523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee1639-59c8-4033-8cf0-764c4cfdf89f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:52.418459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee1639-59c8-4033-8cf0-764c4cfdf89f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:52.423218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca3fe0-b7a8-49a0-b737-430b229c56e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:52.424112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca3fe0-b7a8-49a0-b737-430b229c56e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:52.424563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca3fe0-b7a8-49a0-b737-430b229c56e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:52.424997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca3fe0-b7a8-49a0-b737-430b229c56e1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:52.426031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca3fe0-b7a8-49a0-b737-430b229c56e1 admin admin] RBAC: Adding query filter params (role.id=76969d6f17e84657bf8dea0d9c8879b1, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45, user.id=80811d7f2ff84ca1af635648dcfe6004) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:52.426581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca3fe0-b7a8-49a0-b737-430b229c56e1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:52.428728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca3fe0-b7a8-49a0-b737-430b229c56e1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:52.435170 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 147/291] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:52 2021] GET /identity/v3/role_assignments?user.id=80811d7f2ff84ca1af635648dcfe6004&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=76969d6f17e84657bf8dea0d9c8879b1 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:54.066575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e4cc1-3c96-4ade-b0f7-d3235b38f87a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.067103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e4cc1-3c96-4ade-b0f7-d3235b38f87a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.067103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e4cc1-3c96-4ade-b0f7-d3235b38f87a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.069155 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 145/292] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:54.075158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d789d-1016-43cb-a9eb-9903c1368ec9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.075595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d789d-1016-43cb-a9eb-9903c1368ec9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.075760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d789d-1016-43cb-a9eb-9903c1368ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.094095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8f5d789d-1016-43cb-a9eb-9903c1368ec9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:54.095302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8f5d789d-1016-43cb-a9eb-9903c1368ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:54.103485 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 148/293] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:54.131284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e4cc1-3c96-4ade-b0f7-d3235b38f87a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.144216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e4cc1-3c96-4ade-b0f7-d3235b38f87a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.148809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e07366-cb3d-4391-b602-8757f8b02881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.149658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e07366-cb3d-4391-b602-8757f8b02881 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.149962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e07366-cb3d-4391-b602-8757f8b02881 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.150239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e07366-cb3d-4391-b602-8757f8b02881 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.162235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e07366-cb3d-4391-b602-8757f8b02881 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:54.169902 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-e3e07366-cb3d-4391-b602-8757f8b02881 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:54.171523 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 146/294] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:54.177919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d789d-1016-43cb-a9eb-9903c1368ec9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.187225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d789d-1016-43cb-a9eb-9903c1368ec9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.191810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88a3ad-a1ca-43bf-b7df-48983ceba722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.192474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88a3ad-a1ca-43bf-b7df-48983ceba722 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.192755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88a3ad-a1ca-43bf-b7df-48983ceba722 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.193029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88a3ad-a1ca-43bf-b7df-48983ceba722 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.193798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88a3ad-a1ca-43bf-b7df-48983ceba722 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:54.194105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88a3ad-a1ca-43bf-b7df-48983ceba722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:54.195710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88a3ad-a1ca-43bf-b7df-48983ceba722 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:54.205007 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 149/295] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:54.210903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e07366-cb3d-4391-b602-8757f8b02881 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.221457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e07366-cb3d-4391-b602-8757f8b02881 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.226311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a39b5-d4c7-4f6e-85a6-42b93950040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.227358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a39b5-d4c7-4f6e-85a6-42b93950040c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.227711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a39b5-d4c7-4f6e-85a6-42b93950040c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.228519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a39b5-d4c7-4f6e-85a6-42b93950040c admin admin] PATH_INFO: `/v3/users/0d2626f9e4ee4867b6a7edb351809e53` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.229748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a39b5-d4c7-4f6e-85a6-42b93950040c admin admin] RBAC: Authorizing `identity:get_user(user_id=0d2626f9e4ee4867b6a7edb351809e53)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:54.231934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a39b5-d4c7-4f6e-85a6-42b93950040c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:54.233824 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 147/296] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:54 2021] GET /identity/v3/users/0d2626f9e4ee4867b6a7edb351809e53 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:54.239785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88a3ad-a1ca-43bf-b7df-48983ceba722 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.249857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88a3ad-a1ca-43bf-b7df-48983ceba722 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.254467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a73daf-2c61-4fe4-924f-f8a76fd7bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.255108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73daf-2c61-4fe4-924f-f8a76fd7bac6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.255423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73daf-2c61-4fe4-924f-f8a76fd7bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.255703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a73daf-2c61-4fe4-924f-f8a76fd7bac6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.264364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a73daf-2c61-4fe4-924f-f8a76fd7bac6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:54.266126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a73daf-2c61-4fe4-924f-f8a76fd7bac6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:54.275810 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 150/297] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:54.282070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a39b5-d4c7-4f6e-85a6-42b93950040c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.292517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a39b5-d4c7-4f6e-85a6-42b93950040c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.297120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91262170-3bcc-432a-83d5-6d0c582246f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.297971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91262170-3bcc-432a-83d5-6d0c582246f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.298258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91262170-3bcc-432a-83d5-6d0c582246f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.298531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91262170-3bcc-432a-83d5-6d0c582246f7 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.299784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91262170-3bcc-432a-83d5-6d0c582246f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:54.301873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91262170-3bcc-432a-83d5-6d0c582246f7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:54.304232 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 148/298] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:54 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:54.310532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a73daf-2c61-4fe4-924f-f8a76fd7bac6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.319773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a73daf-2c61-4fe4-924f-f8a76fd7bac6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.324827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f10ecf-83af-47eb-a915-e1ff9448612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.325471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f10ecf-83af-47eb-a915-e1ff9448612f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.325753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f10ecf-83af-47eb-a915-e1ff9448612f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.326030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f10ecf-83af-47eb-a915-e1ff9448612f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.326872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f10ecf-83af-47eb-a915-e1ff9448612f admin admin] RBAC: Adding query filter params (role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45, user.id=0d2626f9e4ee4867b6a7edb351809e53) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:54.327234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f10ecf-83af-47eb-a915-e1ff9448612f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:54.329089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f10ecf-83af-47eb-a915-e1ff9448612f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:54.335504 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 151/299] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:54 2021] GET /identity/v3/role_assignments?user.id=0d2626f9e4ee4867b6a7edb351809e53&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:54.552185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42b912-8e3e-446e-96c9-90b9fac91c6c None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.552516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42b912-8e3e-446e-96c9-90b9fac91c6c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.552722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42b912-8e3e-446e-96c9-90b9fac91c6c None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.554695 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 149/300] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:54.562292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08036b-9c45-4547-a12c-9d01f4f356c0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.562579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08036b-9c45-4547-a12c-9d01f4f356c0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.562857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08036b-9c45-4547-a12c-9d01f4f356c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.584696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5d08036b-9c45-4547-a12c-9d01f4f356c0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:54.585832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5d08036b-9c45-4547-a12c-9d01f4f356c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:54.594024 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 152/301] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:54.602988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedc368-ca5e-4c80-87b0-eb2308209032 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.603304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedc368-ca5e-4c80-87b0-eb2308209032 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.603587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedc368-ca5e-4c80-87b0-eb2308209032 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.605641 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 150/302] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:54.611364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72154cb9-d4d8-48c5-88c2-decb39713f61 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.611656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72154cb9-d4d8-48c5-88c2-decb39713f61 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.611937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72154cb9-d4d8-48c5-88c2-decb39713f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.620017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedc368-ca5e-4c80-87b0-eb2308209032 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.634116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-72154cb9-d4d8-48c5-88c2-decb39713f61 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:54.635348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-72154cb9-d4d8-48c5-88c2-decb39713f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:54.635619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedc368-ca5e-4c80-87b0-eb2308209032 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.640374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5dd40-d0fc-4abc-b8b3-2cce91a415b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.641161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dd40-d0fc-4abc-b8b3-2cce91a415b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.641440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dd40-d0fc-4abc-b8b3-2cce91a415b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.641708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dd40-d0fc-4abc-b8b3-2cce91a415b7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.647338 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 153/303] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:54.656371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5dd40-d0fc-4abc-b8b3-2cce91a415b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:54.663462 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-2bc5dd40-d0fc-4abc-b8b3-2cce91a415b7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:54.664957 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 151/304] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:30:54.671765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72154cb9-d4d8-48c5-88c2-decb39713f61 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.675452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5dd40-d0fc-4abc-b8b3-2cce91a415b7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.682991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72154cb9-d4d8-48c5-88c2-decb39713f61 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.687843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5dd40-d0fc-4abc-b8b3-2cce91a415b7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.688227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbb696-74ee-4467-8cfa-47064b55e807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.689252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbb696-74ee-4467-8cfa-47064b55e807 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.689741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbb696-74ee-4467-8cfa-47064b55e807 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.690216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbb696-74ee-4467-8cfa-47064b55e807 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.691368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbb696-74ee-4467-8cfa-47064b55e807 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:54.691881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbb696-74ee-4467-8cfa-47064b55e807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:54.692368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e421c76-d2da-44a6-b7fa-8d6aafc938cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.693140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e421c76-d2da-44a6-b7fa-8d6aafc938cb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.693419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e421c76-d2da-44a6-b7fa-8d6aafc938cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.693690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e421c76-d2da-44a6-b7fa-8d6aafc938cb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.694595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbb696-74ee-4467-8cfa-47064b55e807 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:54.694861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e421c76-d2da-44a6-b7fa-8d6aafc938cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:54.697019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e421c76-d2da-44a6-b7fa-8d6aafc938cb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:54.699201 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 152/305] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:54.705023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e421c76-d2da-44a6-b7fa-8d6aafc938cb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.709567 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 154/306] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:54.716373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e421c76-d2da-44a6-b7fa-8d6aafc938cb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.717837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbb696-74ee-4467-8cfa-47064b55e807 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.720783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a104f42-1d21-48c4-80ac-e2c71daaf380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.721431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a104f42-1d21-48c4-80ac-e2c71daaf380 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.721747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a104f42-1d21-48c4-80ac-e2c71daaf380 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.721977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a104f42-1d21-48c4-80ac-e2c71daaf380 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.722692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a104f42-1d21-48c4-80ac-e2c71daaf380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:54.724633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a104f42-1d21-48c4-80ac-e2c71daaf380 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:54.727823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbb696-74ee-4467-8cfa-47064b55e807 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.732655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd5841-b2dd-421a-95bf-08327563a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.733509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5841-b2dd-421a-95bf-08327563a80b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.733796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5841-b2dd-421a-95bf-08327563a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.734075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd5841-b2dd-421a-95bf-08327563a80b admin admin] PATH_INFO: `/v3/users/8343c24821f54f7c96f0e4da5429761c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.746044 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 153/307] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:30:54 2021] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:30:54.753944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd5841-b2dd-421a-95bf-08327563a80b admin admin] RBAC: Authorizing `identity:get_user(user_id=8343c24821f54f7c96f0e4da5429761c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:54.756305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd5841-b2dd-421a-95bf-08327563a80b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:54.758468 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 155/308] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:54 2021] GET /identity/v3/users/8343c24821f54f7c96f0e4da5429761c => generated 293 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:54.764938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a104f42-1d21-48c4-80ac-e2c71daaf380 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:54.776086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a104f42-1d21-48c4-80ac-e2c71daaf380 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:54.780763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8932c-5aee-4dcc-bc08-d01e4fcfe678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:54.781553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8932c-5aee-4dcc-bc08-d01e4fcfe678 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.781908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8932c-5aee-4dcc-bc08-d01e4fcfe678 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.782255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8932c-5aee-4dcc-bc08-d01e4fcfe678 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.783396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8932c-5aee-4dcc-bc08-d01e4fcfe678 admin admin] RBAC: Adding query filter params (role.id=e3eef42cb87d4017b957fccc4eb21e62, user.id=8343c24821f54f7c96f0e4da5429761c, scope.system=all) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:54.783883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8932c-5aee-4dcc-bc08-d01e4fcfe678 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:54.785779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8932c-5aee-4dcc-bc08-d01e4fcfe678 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:54.795310 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 154/309] 10.222.0.21 () {56 vars in 1329 bytes} [Sat Nov 27 20:30:54 2021] GET /identity/v3/role_assignments?user.id=8343c24821f54f7c96f0e4da5429761c&scope.system=all&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:54.955348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf5c13-9be5-4f3f-b154-40c72e098f64 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.955552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf5c13-9be5-4f3f-b154-40c72e098f64 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.955809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf5c13-9be5-4f3f-b154-40c72e098f64 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.957874 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 156/310] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:54.964847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bd4ff-091f-4c04-bec0-282e5518848c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:54.965272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bd4ff-091f-4c04-bec0-282e5518848c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:54.965399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bd4ff-091f-4c04-bec0-282e5518848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:54.984376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d90bd4ff-091f-4c04-bec0-282e5518848c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:54.985598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d90bd4ff-091f-4c04-bec0-282e5518848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:54.993697 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 155/311] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:55.023163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf5c13-9be5-4f3f-b154-40c72e098f64 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:55.037920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf5c13-9be5-4f3f-b154-40c72e098f64 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:55.042527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a71dad-26b0-471a-9dcd-b45ebeb7dc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:55.043622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a71dad-26b0-471a-9dcd-b45ebeb7dc41 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:55.044049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a71dad-26b0-471a-9dcd-b45ebeb7dc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:55.044470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a71dad-26b0-471a-9dcd-b45ebeb7dc41 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:55.055681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a71dad-26b0-471a-9dcd-b45ebeb7dc41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:55.063113 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-53a71dad-26b0-471a-9dcd-b45ebeb7dc41 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 27 20:30:55.064700 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 157/312] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:55 2021] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:55.070640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bd4ff-091f-4c04-bec0-282e5518848c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:55.081232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bd4ff-091f-4c04-bec0-282e5518848c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:55.086580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cfa94-efd7-484f-bdbb-ec40503fb203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:55.088081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cfa94-efd7-484f-bdbb-ec40503fb203 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:55.088387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cfa94-efd7-484f-bdbb-ec40503fb203 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:55.088659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cfa94-efd7-484f-bdbb-ec40503fb203 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:55.089427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7cfa94-efd7-484f-bdbb-ec40503fb203 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:55.089786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7cfa94-efd7-484f-bdbb-ec40503fb203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:55.091391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7cfa94-efd7-484f-bdbb-ec40503fb203 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:55.102266 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 156/313] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:55 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:55.109099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a71dad-26b0-471a-9dcd-b45ebeb7dc41 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:55.119896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a71dad-26b0-471a-9dcd-b45ebeb7dc41 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:55.126226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0db7dc-8b27-4bdd-b147-c873257e82cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:55.127177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0db7dc-8b27-4bdd-b147-c873257e82cf admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:55.127553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0db7dc-8b27-4bdd-b147-c873257e82cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:55.127823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0db7dc-8b27-4bdd-b147-c873257e82cf admin admin] PATH_INFO: `/v3/users/80811d7f2ff84ca1af635648dcfe6004` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:55.129034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0db7dc-8b27-4bdd-b147-c873257e82cf admin admin] RBAC: Authorizing `identity:get_user(user_id=80811d7f2ff84ca1af635648dcfe6004)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:55.131150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0db7dc-8b27-4bdd-b147-c873257e82cf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:55.132959 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 158/314] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:55 2021] GET /identity/v3/users/80811d7f2ff84ca1af635648dcfe6004 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:55.140016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cfa94-efd7-484f-bdbb-ec40503fb203 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:55.151244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cfa94-efd7-484f-bdbb-ec40503fb203 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:55.157210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8a0eb-3bf7-4742-a6db-750878583f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:55.158066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8a0eb-3bf7-4742-a6db-750878583f87 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:55.158346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8a0eb-3bf7-4742-a6db-750878583f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:55.158703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8a0eb-3bf7-4742-a6db-750878583f87 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:55.160079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8a0eb-3bf7-4742-a6db-750878583f87 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:55.162431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8a0eb-3bf7-4742-a6db-750878583f87 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:55.169395 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 157/315] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:55 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:55.170738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0db7dc-8b27-4bdd-b147-c873257e82cf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:55.182688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0db7dc-8b27-4bdd-b147-c873257e82cf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:55.187492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93255-56c2-496f-980c-b8420a431aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:55.188534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93255-56c2-496f-980c-b8420a431aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:55.188946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93255-56c2-496f-980c-b8420a431aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:55.189283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93255-56c2-496f-980c-b8420a431aa6 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/users/80811d7f2ff84ca1af635648dcfe6004/roles/76969d6f17e84657bf8dea0d9c8879b1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:55.191485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f93255-56c2-496f-980c-b8420a431aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d57f777fe5147a9a30ce29df70e5d45, user_id=80811d7f2ff84ca1af635648dcfe6004, role_id=76969d6f17e84657bf8dea0d9c8879b1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:55.194301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f93255-56c2-496f-980c-b8420a431aa6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:55.212774 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 159/316] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:30:55 2021] PUT /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/users/80811d7f2ff84ca1af635648dcfe6004/roles/76969d6f17e84657bf8dea0d9c8879b1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:30:57.282522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c8ab9-46d8-4074-b867-3d5731c2d36c None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.283162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c8ab9-46d8-4074-b867-3d5731c2d36c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.283162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c8ab9-46d8-4074-b867-3d5731c2d36c None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.285466 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 158/317] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:57.292404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31385e2-fbaf-422d-bcaf-857134dd7ba0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.292936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31385e2-fbaf-422d-bcaf-857134dd7ba0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.293186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31385e2-fbaf-422d-bcaf-857134dd7ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.310834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e31385e2-fbaf-422d-bcaf-857134dd7ba0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:57.312100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e31385e2-fbaf-422d-bcaf-857134dd7ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:57.369362 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 160/318] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:57.394199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c8ab9-46d8-4074-b867-3d5731c2d36c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.396610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40938a-0662-4a6f-81f5-f689ac9a286d None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.397066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40938a-0662-4a6f-81f5-f689ac9a286d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.397351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40938a-0662-4a6f-81f5-f689ac9a286d None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.399392 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 161/319] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:30:57.405062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c6df4-4c73-40fb-a3ca-188a274d6742 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.405346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c6df4-4c73-40fb-a3ca-188a274d6742 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.405622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c6df4-4c73-40fb-a3ca-188a274d6742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.407857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c8ab9-46d8-4074-b867-3d5731c2d36c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.412254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6b539-7e8b-4fef-afcb-f055a775e2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.413034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b539-7e8b-4fef-afcb-f055a775e2dd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.413310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b539-7e8b-4fef-afcb-f055a775e2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.413580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b539-7e8b-4fef-afcb-f055a775e2dd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.430658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-866c6df4-4c73-40fb-a3ca-188a274d6742 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:57.430915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6b539-7e8b-4fef-afcb-f055a775e2dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:57.432211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-866c6df4-4c73-40fb-a3ca-188a274d6742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:57.437782 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-e0b6b539-7e8b-4fef-afcb-f055a775e2dd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:30:57.439291 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 159/320] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:57.440456 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 162/321] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:57.448687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6b539-7e8b-4fef-afcb-f055a775e2dd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.459634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6b539-7e8b-4fef-afcb-f055a775e2dd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.463553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb405ed1-502f-48a1-b368-9ae830bfdfe8 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.463908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb405ed1-502f-48a1-b368-9ae830bfdfe8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.464255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb405ed1-502f-48a1-b368-9ae830bfdfe8 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.464982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97041b78-cda1-4844-b9aa-a226ad09ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.465701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97041b78-cda1-4844-b9aa-a226ad09ad37 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.466046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97041b78-cda1-4844-b9aa-a226ad09ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.466387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97041b78-cda1-4844-b9aa-a226ad09ad37 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.466592 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 163/322] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:30:57.467210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97041b78-cda1-4844-b9aa-a226ad09ad37 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:57.467556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97041b78-cda1-4844-b9aa-a226ad09ad37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.469163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97041b78-cda1-4844-b9aa-a226ad09ad37 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.471668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f124d82-f796-49bb-b429-d79be9e18389 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.472133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f124d82-f796-49bb-b429-d79be9e18389 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.472416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f124d82-f796-49bb-b429-d79be9e18389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.479341 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 160/323] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:57.480372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97041b78-cda1-4844-b9aa-a226ad09ad37 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.490693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9f124d82-f796-49bb-b429-d79be9e18389 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:57.491885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9f124d82-f796-49bb-b429-d79be9e18389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:57.492445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97041b78-cda1-4844-b9aa-a226ad09ad37 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.497178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abd0ae-d977-4aaf-99d1-13a89edd600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.497946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abd0ae-d977-4aaf-99d1-13a89edd600b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.498310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abd0ae-d977-4aaf-99d1-13a89edd600b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.498587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abd0ae-d977-4aaf-99d1-13a89edd600b admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.499846 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 164/324] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:30:57.503456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f124d82-f796-49bb-b429-d79be9e18389 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.509805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f124d82-f796-49bb-b429-d79be9e18389 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.513493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abd0ae-d977-4aaf-99d1-13a89edd600b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:57.514208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552a4f-0878-402a-bdcd-227b2db858b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.515049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552a4f-0878-402a-bdcd-227b2db858b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.515359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552a4f-0878-402a-bdcd-227b2db858b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.515634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552a4f-0878-402a-bdcd-227b2db858b4 admin admin] PATH_INFO: `/v3/users/8343c24821f54f7c96f0e4da5429761c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.516822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00552a4f-0878-402a-bdcd-227b2db858b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=8343c24821f54f7c96f0e4da5429761c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.519107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00552a4f-0878-402a-bdcd-227b2db858b4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.520696 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 165/325] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/users/8343c24821f54f7c96f0e4da5429761c => generated 293 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:57.521846 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d7abd0ae-d977-4aaf-99d1-13a89edd600b admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 27 20:30:57.523167 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 161/326] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:57.527096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552a4f-0878-402a-bdcd-227b2db858b4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.529985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abd0ae-d977-4aaf-99d1-13a89edd600b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.536740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552a4f-0878-402a-bdcd-227b2db858b4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.540750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abd0ae-d977-4aaf-99d1-13a89edd600b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.541119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e76139-0aae-49b9-836f-bf01f933a1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.542014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e76139-0aae-49b9-836f-bf01f933a1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.542244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e76139-0aae-49b9-836f-bf01f933a1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.542515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e76139-0aae-49b9-836f-bf01f933a1ef admin admin] PATH_INFO: `/v3/system/users/8343c24821f54f7c96f0e4da5429761c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.543978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e76139-0aae-49b9-836f-bf01f933a1ef admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8343c24821f54f7c96f0e4da5429761c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.544987 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-95e76139-0aae-49b9-836f-bf01f933a1ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:57.544987 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:30:57.544987 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:30:57.545519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86b378-9e2b-4866-9d36-b17a9521bd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.545853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e76139-0aae-49b9-836f-bf01f933a1ef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.546166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86b378-9e2b-4866-9d36-b17a9521bd62 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.546450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86b378-9e2b-4866-9d36-b17a9521bd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.546726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86b378-9e2b-4866-9d36-b17a9521bd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.547533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86b378-9e2b-4866-9d36-b17a9521bd62 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:57.547840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86b378-9e2b-4866-9d36-b17a9521bd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.549438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86b378-9e2b-4866-9d36-b17a9521bd62 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.560837 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 162/328] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:57.566592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86b378-9e2b-4866-9d36-b17a9521bd62 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.567479 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 166/328] 10.222.0.21 () {58 vars in 1355 bytes} [Sat Nov 27 20:30:57 2021] PUT /identity/v3/system/users/8343c24821f54f7c96f0e4da5429761c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:30:57.568773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e76139-0aae-49b9-836f-bf01f933a1ef admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.576999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86b378-9e2b-4866-9d36-b17a9521bd62 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.582212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e76139-0aae-49b9-836f-bf01f933a1ef admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.582539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533445e0-2166-43e8-be35-f6481f2ae95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.583504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533445e0-2166-43e8-be35-f6481f2ae95a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.583805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533445e0-2166-43e8-be35-f6481f2ae95a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.584176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533445e0-2166-43e8-be35-f6481f2ae95a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.585583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533445e0-2166-43e8-be35-f6481f2ae95a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.587994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533445e0-2166-43e8-be35-f6481f2ae95a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.589484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde0713-a72f-4127-81f4-36739bad9952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.589975 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 163/329] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:57.591225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde0713-a72f-4127-81f4-36739bad9952 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.591761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde0713-a72f-4127-81f4-36739bad9952 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.592236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde0713-a72f-4127-81f4-36739bad9952 admin admin] PATH_INFO: `/v3/users/844ad57aa115462eb7ae14e0edccf18a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.596639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533445e0-2166-43e8-be35-f6481f2ae95a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.607654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533445e0-2166-43e8-be35-f6481f2ae95a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.611834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde0713-a72f-4127-81f4-36739bad9952 admin admin] RBAC: Authorizing `identity:get_user(user_id=844ad57aa115462eb7ae14e0edccf18a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.612853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921f686-7411-4151-ae23-ac49f79661ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.613686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f686-7411-4151-ae23-ac49f79661ec admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.614190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f686-7411-4151-ae23-ac49f79661ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.614569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921f686-7411-4151-ae23-ac49f79661ec admin admin] PATH_INFO: `/v3/groups` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.615025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde0713-a72f-4127-81f4-36739bad9952 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.615562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921f686-7411-4151-ae23-ac49f79661ec admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.616793 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-8921f686-7411-4151-ae23-ac49f79661ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:30:57.616793 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:30:57.616793 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:30:57.617928 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 167/330] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/users/844ad57aa115462eb7ae14e0edccf18a => generated 293 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:57.620135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921f686-7411-4151-ae23-ac49f79661ec admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.624078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde0713-a72f-4127-81f4-36739bad9952 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.636644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde0713-a72f-4127-81f4-36739bad9952 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.641400 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 164/331] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 20:30:57 2021] POST /identity/v3/groups => generated 229 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:30:57.645196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ba8eb-e7ab-4d60-af83-7f0e672720c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.646166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ba8eb-e7ab-4d60-af83-7f0e672720c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.646588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ba8eb-e7ab-4d60-af83-7f0e672720c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.647039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ba8eb-e7ab-4d60-af83-7f0e672720c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.648295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ba8eb-e7ab-4d60-af83-7f0e672720c3 admin admin] RBAC: Adding query filter params (role.id=76969d6f17e84657bf8dea0d9c8879b1, user.id=844ad57aa115462eb7ae14e0edccf18a, scope.system=all) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:57.648916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ba8eb-e7ab-4d60-af83-7f0e672720c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.652405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ba8eb-e7ab-4d60-af83-7f0e672720c3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.661972 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 168/332] 10.222.0.21 () {56 vars in 1329 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/role_assignments?user.id=844ad57aa115462eb7ae14e0edccf18a&scope.system=all&role.id=76969d6f17e84657bf8dea0d9c8879b1 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:30:57.732182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4dc5-74ed-4395-9250-c9e7b8e59e9c None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.732834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4dc5-74ed-4395-9250-c9e7b8e59e9c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.733273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4dc5-74ed-4395-9250-c9e7b8e59e9c None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.735867 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 165/333] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:30:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:30:57.742619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01576a68-2334-426e-ab6b-e5c02f956b20 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.742938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01576a68-2334-426e-ab6b-e5c02f956b20 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.743208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01576a68-2334-426e-ab6b-e5c02f956b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.763650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-01576a68-2334-426e-ab6b-e5c02f956b20 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:30:57.764925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-01576a68-2334-426e-ab6b-e5c02f956b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:30:57.779429 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 169/334] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:30:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:30:57.801305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c4dc5-74ed-4395-9250-c9e7b8e59e9c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.814596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c4dc5-74ed-4395-9250-c9e7b8e59e9c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.819133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f3f5c-6d6f-4b0c-b3f8-18ee98ac53d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.819962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3f5c-6d6f-4b0c-b3f8-18ee98ac53d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.820238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3f5c-6d6f-4b0c-b3f8-18ee98ac53d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.820506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3f5c-6d6f-4b0c-b3f8-18ee98ac53d4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.832856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f3f5c-6d6f-4b0c-b3f8-18ee98ac53d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:30:57.840624 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-1b1f3f5c-6d6f-4b0c-b3f8-18ee98ac53d4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 27 20:30:57.847440 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 166/335] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:30:57.849231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01576a68-2334-426e-ab6b-e5c02f956b20 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.859232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01576a68-2334-426e-ab6b-e5c02f956b20 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.864067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93165b6-2609-480b-b9a2-0ba7d605c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.864763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93165b6-2609-480b-b9a2-0ba7d605c7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.865047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93165b6-2609-480b-b9a2-0ba7d605c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.865308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93165b6-2609-480b-b9a2-0ba7d605c7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.866101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93165b6-2609-480b-b9a2-0ba7d605c7b3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:57.866403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93165b6-2609-480b-b9a2-0ba7d605c7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.868110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93165b6-2609-480b-b9a2-0ba7d605c7b3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.883558 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 170/336] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:57.885563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f3f5c-6d6f-4b0c-b3f8-18ee98ac53d4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.897379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f3f5c-6d6f-4b0c-b3f8-18ee98ac53d4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.902751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2a62-af3e-49fd-9244-36182c8d0864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.903646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2a62-af3e-49fd-9244-36182c8d0864 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.903924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2a62-af3e-49fd-9244-36182c8d0864 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.904192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2a62-af3e-49fd-9244-36182c8d0864 admin admin] PATH_INFO: `/v3/users/80811d7f2ff84ca1af635648dcfe6004` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.905421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf2a62-af3e-49fd-9244-36182c8d0864 admin admin] RBAC: Authorizing `identity:get_user(user_id=80811d7f2ff84ca1af635648dcfe6004)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.907614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf2a62-af3e-49fd-9244-36182c8d0864 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.912281 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 167/337] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/users/80811d7f2ff84ca1af635648dcfe6004 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:57.916198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93165b6-2609-480b-b9a2-0ba7d605c7b3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.925877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93165b6-2609-480b-b9a2-0ba7d605c7b3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.932210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd2fc9-9a02-42e3-9618-6e93a8bb6ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.932855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd2fc9-9a02-42e3-9618-6e93a8bb6ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.933130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd2fc9-9a02-42e3-9618-6e93a8bb6ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.933402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd2fc9-9a02-42e3-9618-6e93a8bb6ee0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.941791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd2fc9-9a02-42e3-9618-6e93a8bb6ee0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.944739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd2fc9-9a02-42e3-9618-6e93a8bb6ee0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.953687 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 171/338] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:30:57.960090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2a62-af3e-49fd-9244-36182c8d0864 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:57.972549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2a62-af3e-49fd-9244-36182c8d0864 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:57.977186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4c7cf-991a-420c-953f-74b6c50a5395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:57.978665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4c7cf-991a-420c-953f-74b6c50a5395 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:57.978949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4c7cf-991a-420c-953f-74b6c50a5395 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:57.979286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4c7cf-991a-420c-953f-74b6c50a5395 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:57.980553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4c7cf-991a-420c-953f-74b6c50a5395 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:57.982787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4c7cf-991a-420c-953f-74b6c50a5395 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:57.984999 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 168/339] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:30:57.991414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd2fc9-9a02-42e3-9618-6e93a8bb6ee0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:30:58.001507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd2fc9-9a02-42e3-9618-6e93a8bb6ee0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:30:58.006290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87238f80-1b6e-4cd4-8f07-6e946b5434e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:30:58.007036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87238f80-1b6e-4cd4-8f07-6e946b5434e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:30:58.007436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87238f80-1b6e-4cd4-8f07-6e946b5434e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:30:58.007692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87238f80-1b6e-4cd4-8f07-6e946b5434e1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:30:58.008599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87238f80-1b6e-4cd4-8f07-6e946b5434e1 admin admin] RBAC: Adding query filter params (role.id=76969d6f17e84657bf8dea0d9c8879b1, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45, user.id=80811d7f2ff84ca1af635648dcfe6004) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:30:58.009030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87238f80-1b6e-4cd4-8f07-6e946b5434e1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:30:58.011335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87238f80-1b6e-4cd4-8f07-6e946b5434e1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:30:58.018961 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 172/340] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:30:57 2021] GET /identity/v3/role_assignments?user.id=80811d7f2ff84ca1af635648dcfe6004&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=76969d6f17e84657bf8dea0d9c8879b1 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:00.055416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d155394-5a14-4736-98bd-2cc7454dda1b None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.055948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d155394-5a14-4736-98bd-2cc7454dda1b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.056026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d155394-5a14-4736-98bd-2cc7454dda1b None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.057947 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 169/341] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:00.063522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3640a-70d1-48c6-aafa-050a2513c500 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.063968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3640a-70d1-48c6-aafa-050a2513c500 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.064112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3640a-70d1-48c6-aafa-050a2513c500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.081698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5cc3640a-70d1-48c6-aafa-050a2513c500 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:00.082877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5cc3640a-70d1-48c6-aafa-050a2513c500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:00.091164 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 173/342] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:00.099625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71ea40-01e1-481e-943f-3ea83778ff35 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.099910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71ea40-01e1-481e-943f-3ea83778ff35 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.100261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71ea40-01e1-481e-943f-3ea83778ff35 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.102119 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 170/343] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:31:00.108304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d6af-ce71-439e-a0a2-8c2c04dabc7c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.108592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d6af-ce71-439e-a0a2-8c2c04dabc7c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.108865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d6af-ce71-439e-a0a2-8c2c04dabc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.118936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71ea40-01e1-481e-943f-3ea83778ff35 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:00.127500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4ee5d6af-ce71-439e-a0a2-8c2c04dabc7c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:00.128902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4ee5d6af-ce71-439e-a0a2-8c2c04dabc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:00.136005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71ea40-01e1-481e-943f-3ea83778ff35 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:00.139087 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 174/344] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:00.144685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ef3c2-6ce7-494d-b4e5-509e42d991b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:00.145462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ef3c2-6ce7-494d-b4e5-509e42d991b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.145737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ef3c2-6ce7-494d-b4e5-509e42d991b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.146004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ef3c2-6ce7-494d-b4e5-509e42d991b3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.157035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ef3c2-6ce7-494d-b4e5-509e42d991b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:00.163794 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-927ef3c2-6ce7-494d-b4e5-509e42d991b3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:31:00.165138 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 171/345] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:00.169645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d6af-ce71-439e-a0a2-8c2c04dabc7c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:00.170928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ef3c2-6ce7-494d-b4e5-509e42d991b3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:00.179072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d6af-ce71-439e-a0a2-8c2c04dabc7c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:00.180252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ef3c2-6ce7-494d-b4e5-509e42d991b3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:00.183457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ccf9d-a2da-4150-b231-5307d1aaa913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:00.184235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ccf9d-a2da-4150-b231-5307d1aaa913 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.184482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93933ce2-2c63-4c7e-ae44-abe74d0bc89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:00.184600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ccf9d-a2da-4150-b231-5307d1aaa913 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.184768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ccf9d-a2da-4150-b231-5307d1aaa913 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.185105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93933ce2-2c63-4c7e-ae44-abe74d0bc89d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.185384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93933ce2-2c63-4c7e-ae44-abe74d0bc89d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.185657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93933ce2-2c63-4c7e-ae44-abe74d0bc89d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.186415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93933ce2-2c63-4c7e-ae44-abe74d0bc89d admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:00.186717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93933ce2-2c63-4c7e-ae44-abe74d0bc89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:00.188337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93933ce2-2c63-4c7e-ae44-abe74d0bc89d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:00.194689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ccf9d-a2da-4150-b231-5307d1aaa913 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:00.197522 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 172/346] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:31:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:00.198520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdae53a-e8b4-4575-aac7-4cf89dbe8578 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.198806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdae53a-e8b4-4575-aac7-4cf89dbe8578 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.199079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdae53a-e8b4-4575-aac7-4cf89dbe8578 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.200816 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 173/347] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:00.202767 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-987ccf9d-a2da-4150-b231-5307d1aaa913 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 27 20:31:00.203041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdae53a-e8b4-4575-aac7-4cf89dbe8578 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:00.204070 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 175/348] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:00 2021] GET /identity/v3/roles/reader => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:00.207936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a53f97-7b4d-4535-943e-626d0a6979eb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.208222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a53f97-7b4d-4535-943e-626d0a6979eb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.208500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a53f97-7b4d-4535-943e-626d0a6979eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.219645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdae53a-e8b4-4575-aac7-4cf89dbe8578 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:00.223926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3b408-9056-43b0-8625-594957fbc0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:00.224745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3b408-9056-43b0-8625-594957fbc0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.225027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3b408-9056-43b0-8625-594957fbc0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.225302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3b408-9056-43b0-8625-594957fbc0a0 admin admin] PATH_INFO: `/v3/users/8343c24821f54f7c96f0e4da5429761c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.226105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e2a53f97-7b4d-4535-943e-626d0a6979eb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:00.226482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3b408-9056-43b0-8625-594957fbc0a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=8343c24821f54f7c96f0e4da5429761c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:00.227302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e2a53f97-7b4d-4535-943e-626d0a6979eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:00.228666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3b408-9056-43b0-8625-594957fbc0a0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:00.230223 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 174/349] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:31:00 2021] GET /identity/v3/users/8343c24821f54f7c96f0e4da5429761c => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:00.232072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3b408-9056-43b0-8625-594957fbc0a0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:00.235543 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 176/350] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:00.236375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a53f97-7b4d-4535-943e-626d0a6979eb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:00.244271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3b408-9056-43b0-8625-594957fbc0a0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:00.245597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a53f97-7b4d-4535-943e-626d0a6979eb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:00.248486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136da9c-f4ec-4ce1-bcdf-c3a2a82f615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:00.249098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136da9c-f4ec-4ce1-bcdf-c3a2a82f615a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.249639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136da9c-f4ec-4ce1-bcdf-c3a2a82f615a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.249914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136da9c-f4ec-4ce1-bcdf-c3a2a82f615a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.250369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83027ecc-5484-451c-8a2a-1cb76b225509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:00.250653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136da9c-f4ec-4ce1-bcdf-c3a2a82f615a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:00.250956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136da9c-f4ec-4ce1-bcdf-c3a2a82f615a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:00.251047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83027ecc-5484-451c-8a2a-1cb76b225509 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.251244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83027ecc-5484-451c-8a2a-1cb76b225509 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.251546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83027ecc-5484-451c-8a2a-1cb76b225509 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.252543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136da9c-f4ec-4ce1-bcdf-c3a2a82f615a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:00.252709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83027ecc-5484-451c-8a2a-1cb76b225509 admin admin] RBAC: Adding query filter params (role.id=e3eef42cb87d4017b957fccc4eb21e62, user.id=8343c24821f54f7c96f0e4da5429761c, scope.system=all) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:00.252996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83027ecc-5484-451c-8a2a-1cb76b225509 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:00.254809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83027ecc-5484-451c-8a2a-1cb76b225509 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:00.261296 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 175/351] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:31:00 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:00.262064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136da9c-f4ec-4ce1-bcdf-c3a2a82f615a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:00.270854 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 177/352] 10.222.0.21 () {56 vars in 1329 bytes} [Sat Nov 27 20:31:00 2021] GET /identity/v3/role_assignments?user.id=8343c24821f54f7c96f0e4da5429761c&scope.system=all&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 510 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:00.271065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136da9c-f4ec-4ce1-bcdf-c3a2a82f615a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:00.271703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83027ecc-5484-451c-8a2a-1cb76b225509 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:00.275947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45d45-2225-4441-95e3-58edd9d597cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:00.276739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45d45-2225-4441-95e3-58edd9d597cc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.277030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45d45-2225-4441-95e3-58edd9d597cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.277307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45d45-2225-4441-95e3-58edd9d597cc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.278532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb45d45-2225-4441-95e3-58edd9d597cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:00.280305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb45d45-2225-4441-95e3-58edd9d597cc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:00.281995 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 176/353] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:00.282789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83027ecc-5484-451c-8a2a-1cb76b225509 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:00.287650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671d721-6c7b-43b6-b42f-a6c4c777a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:00.288290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45d45-2225-4441-95e3-58edd9d597cc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:00.289158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671d721-6c7b-43b6-b42f-a6c4c777a5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.289622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671d721-6c7b-43b6-b42f-a6c4c777a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.290120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671d721-6c7b-43b6-b42f-a6c4c777a5f5 admin admin] PATH_INFO: `/v3/users/844ad57aa115462eb7ae14e0edccf18a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.291668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671d721-6c7b-43b6-b42f-a6c4c777a5f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=844ad57aa115462eb7ae14e0edccf18a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:00.294072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671d721-6c7b-43b6-b42f-a6c4c777a5f5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:00.296045 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 178/354] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:31:00 2021] GET /identity/v3/users/844ad57aa115462eb7ae14e0edccf18a => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:00.298691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45d45-2225-4441-95e3-58edd9d597cc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:00.302269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671d721-6c7b-43b6-b42f-a6c4c777a5f5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:00.303203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a229c-f2b0-40f5-93c2-e032afefcb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:00.303915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a229c-f2b0-40f5-93c2-e032afefcb3b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.304200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a229c-f2b0-40f5-93c2-e032afefcb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.304476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a229c-f2b0-40f5-93c2-e032afefcb3b admin admin] PATH_INFO: `/v3/groups` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.305254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a229c-f2b0-40f5-93c2-e032afefcb3b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:00.307533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a229c-f2b0-40f5-93c2-e032afefcb3b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:00.312407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671d721-6c7b-43b6-b42f-a6c4c777a5f5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:00.317937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a5f30-ac63-46ff-9f21-737dcd76b392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:00.318801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a5f30-ac63-46ff-9f21-737dcd76b392 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:00.319084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a5f30-ac63-46ff-9f21-737dcd76b392 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:00.319461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a5f30-ac63-46ff-9f21-737dcd76b392 admin admin] PATH_INFO: `/v3/system/users/844ad57aa115462eb7ae14e0edccf18a/roles/76969d6f17e84657bf8dea0d9c8879b1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:00.320984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a5f30-ac63-46ff-9f21-737dcd76b392 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=844ad57aa115462eb7ae14e0edccf18a, role_id=76969d6f17e84657bf8dea0d9c8879b1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:00.323121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a5f30-ac63-46ff-9f21-737dcd76b392 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:00.327545 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 177/355] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 20:31:00 2021] POST /identity/v3/groups => generated 226 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:31:00.335396 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 179/356] 10.222.0.21 () {58 vars in 1355 bytes} [Sat Nov 27 20:31:00 2021] PUT /identity/v3/system/users/844ad57aa115462eb7ae14e0edccf18a/roles/76969d6f17e84657bf8dea0d9c8879b1 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:31:03.050051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16068f-1b6b-4da4-87b2-a691b0fdc53d None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.050603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16068f-1b6b-4da4-87b2-a691b0fdc53d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.050603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16068f-1b6b-4da4-87b2-a691b0fdc53d None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.052686 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 178/357] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:03.059227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6b220-f435-4efe-87ab-6867192e3fc4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.059725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6b220-f435-4efe-87ab-6867192e3fc4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.059802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6b220-f435-4efe-87ab-6867192e3fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.078291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-68d6b220-f435-4efe-87ab-6867192e3fc4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:03.080304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-68d6b220-f435-4efe-87ab-6867192e3fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:03.088722 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 180/358] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:03.130422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16068f-1b6b-4da4-87b2-a691b0fdc53d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.145104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16068f-1b6b-4da4-87b2-a691b0fdc53d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.149485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f268-36d8-4694-94c9-b6c9b11e5dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.150263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f268-36d8-4694-94c9-b6c9b11e5dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.150542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f268-36d8-4694-94c9-b6c9b11e5dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.150812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f268-36d8-4694-94c9-b6c9b11e5dd2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.168129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180f268-36d8-4694-94c9-b6c9b11e5dd2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:03.175005 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-a180f268-36d8-4694-94c9-b6c9b11e5dd2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:31:03.176389 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 179/359] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:03.182911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6b220-f435-4efe-87ab-6867192e3fc4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.192168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6b220-f435-4efe-87ab-6867192e3fc4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.200751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e61d8a-cc75-466a-baec-a4ad3452249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.201419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e61d8a-cc75-466a-baec-a4ad3452249a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.201701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e61d8a-cc75-466a-baec-a4ad3452249a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.201973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e61d8a-cc75-466a-baec-a4ad3452249a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.202737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e61d8a-cc75-466a-baec-a4ad3452249a admin admin] RBAC: Adding query filter params (name=member) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:03.203041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e61d8a-cc75-466a-baec-a4ad3452249a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.204659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e61d8a-cc75-466a-baec-a4ad3452249a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.218639 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 181/360] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:03.219856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f268-36d8-4694-94c9-b6c9b11e5dd2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.232557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f268-36d8-4694-94c9-b6c9b11e5dd2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.237610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe98de-0d7b-4d96-a737-6625f9d53070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.238317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe98de-0d7b-4d96-a737-6625f9d53070 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.238601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe98de-0d7b-4d96-a737-6625f9d53070 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.238888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe98de-0d7b-4d96-a737-6625f9d53070 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.241078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b14c3-5248-4edd-b759-348b89319990 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.241416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b14c3-5248-4edd-b759-348b89319990 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.241691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b14c3-5248-4edd-b759-348b89319990 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.247348 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 182/361] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:03.254942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1eff0-94fa-4061-b1da-dd5656791e28 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.255231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1eff0-94fa-4061-b1da-dd5656791e28 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.255534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe98de-0d7b-4d96-a737-6625f9d53070 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.255709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1eff0-94fa-4061-b1da-dd5656791e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.257294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe98de-0d7b-4d96-a737-6625f9d53070 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.271353 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 180/362] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:03.277719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe98de-0d7b-4d96-a737-6625f9d53070 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.283632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-12d1eff0-94fa-4061-b1da-dd5656791e28 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:03.284820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-12d1eff0-94fa-4061-b1da-dd5656791e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:03.296498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe98de-0d7b-4d96-a737-6625f9d53070 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.296758 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 183/363] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 27 20:31:03.309930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbd71d-7a9e-4a2e-9eaa-87024b5861ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.310721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbd71d-7a9e-4a2e-9eaa-87024b5861ba admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.310998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbd71d-7a9e-4a2e-9eaa-87024b5861ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.311283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbd71d-7a9e-4a2e-9eaa-87024b5861ba admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.316020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbd71d-7a9e-4a2e-9eaa-87024b5861ba admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.318075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbd71d-7a9e-4a2e-9eaa-87024b5861ba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.320083 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 181/364] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:03.326441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1eff0-94fa-4061-b1da-dd5656791e28 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.333433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbd71d-7a9e-4a2e-9eaa-87024b5861ba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.337980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1eff0-94fa-4061-b1da-dd5656791e28 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.342407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f430e-711b-4342-aa31-99b4a299519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.343286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f430e-711b-4342-aa31-99b4a299519d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.343565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f430e-711b-4342-aa31-99b4a299519d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.343838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f430e-711b-4342-aa31-99b4a299519d admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.349645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbd71d-7a9e-4a2e-9eaa-87024b5861ba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.352452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f430e-711b-4342-aa31-99b4a299519d admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.353524 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-0e3f430e-711b-4342-aa31-99b4a299519d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:03.353524 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:31:03.353524 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:31:03.354726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f430e-711b-4342-aa31-99b4a299519d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.357139 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 184/365] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:03.362499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a827e-8eef-45d1-bf22-53636b80fb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.363301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a827e-8eef-45d1-bf22-53636b80fb70 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.363586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a827e-8eef-45d1-bf22-53636b80fb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.363889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a827e-8eef-45d1-bf22-53636b80fb70 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.365292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f430e-711b-4342-aa31-99b4a299519d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.375442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f430e-711b-4342-aa31-99b4a299519d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.380139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb53a9-85cc-431f-997f-d3a47aa5a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.380788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb53a9-85cc-431f-997f-d3a47aa5a8bb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.381067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb53a9-85cc-431f-997f-d3a47aa5a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.381346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb53a9-85cc-431f-997f-d3a47aa5a8bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.382187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb53a9-85cc-431f-997f-d3a47aa5a8bb admin admin] RBAC: Adding query filter params (group.id=44beaa9009304c22bfb50f12df57b694, role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=838c496dfc884bc0b3b44afdd528b73e) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:03.382494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb53a9-85cc-431f-997f-d3a47aa5a8bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.385204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb53a9-85cc-431f-997f-d3a47aa5a8bb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.388206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a827e-8eef-45d1-bf22-53636b80fb70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:03.391588 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 185/366] 10.222.0.21 () {56 vars in 1397 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/role_assignments?group.id=44beaa9009304c22bfb50f12df57b694&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:03.395305 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-bb1a827e-8eef-45d1-bf22-53636b80fb70 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 27 20:31:03.396805 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 182/367] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/roles/reader => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:03.403909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb53a9-85cc-431f-997f-d3a47aa5a8bb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.414566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb53a9-85cc-431f-997f-d3a47aa5a8bb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.428441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585b77d-f3d5-46ef-b38e-23f31e3bb58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.428441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b77d-f3d5-46ef-b38e-23f31e3bb58c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.428441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b77d-f3d5-46ef-b38e-23f31e3bb58c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.428441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585b77d-f3d5-46ef-b38e-23f31e3bb58c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.429155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585b77d-f3d5-46ef-b38e-23f31e3bb58c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:03.429155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585b77d-f3d5-46ef-b38e-23f31e3bb58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.429155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585b77d-f3d5-46ef-b38e-23f31e3bb58c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.444587 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 186/368] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:03.452146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a827e-8eef-45d1-bf22-53636b80fb70 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.461721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dbe60-0049-474e-8a32-e2ef6ab8040e None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.462031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dbe60-0049-474e-8a32-e2ef6ab8040e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.462262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dbe60-0049-474e-8a32-e2ef6ab8040e None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.465172 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 187/369] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:03.466843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a827e-8eef-45d1-bf22-53636b80fb70 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.470615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc2a64-0a35-4f90-a387-578c9661db8e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.470907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc2a64-0a35-4f90-a387-578c9661db8e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.471189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc2a64-0a35-4f90-a387-578c9661db8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.495854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f5bc2a64-0a35-4f90-a387-578c9661db8e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:03.496174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6fe02-fca7-4986-9310-57d2e8df58b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.496887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6fe02-fca7-4986-9310-57d2e8df58b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.497048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f5bc2a64-0a35-4f90-a387-578c9661db8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:03.497193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6fe02-fca7-4986-9310-57d2e8df58b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.497426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6fe02-fca7-4986-9310-57d2e8df58b3 admin admin] PATH_INFO: `/v3/users/844ad57aa115462eb7ae14e0edccf18a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.498722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6fe02-fca7-4986-9310-57d2e8df58b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=844ad57aa115462eb7ae14e0edccf18a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.501149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6fe02-fca7-4986-9310-57d2e8df58b3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.503114 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 183/370] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/users/844ad57aa115462eb7ae14e0edccf18a => generated 293 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:03.509733 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 188/371] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:03.510112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6fe02-fca7-4986-9310-57d2e8df58b3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.525900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6fe02-fca7-4986-9310-57d2e8df58b3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.535986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c81c15-d3e2-4341-ae2e-801a25d106e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.536662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c81c15-d3e2-4341-ae2e-801a25d106e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.536943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c81c15-d3e2-4341-ae2e-801a25d106e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.537216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c81c15-d3e2-4341-ae2e-801a25d106e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.538236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c81c15-d3e2-4341-ae2e-801a25d106e3 admin admin] RBAC: Adding query filter params (role.id=76969d6f17e84657bf8dea0d9c8879b1, user.id=844ad57aa115462eb7ae14e0edccf18a, scope.system=all) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:03.538551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c81c15-d3e2-4341-ae2e-801a25d106e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.540557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c81c15-d3e2-4341-ae2e-801a25d106e3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.556393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc2a64-0a35-4f90-a387-578c9661db8e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.561482 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 184/372] 10.222.0.21 () {56 vars in 1329 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/role_assignments?user.id=844ad57aa115462eb7ae14e0edccf18a&scope.system=all&role.id=76969d6f17e84657bf8dea0d9c8879b1 => generated 510 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:03.567761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc2a64-0a35-4f90-a387-578c9661db8e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.580947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f939-8ec4-4fca-b126-ba102117e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.581877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f939-8ec4-4fca-b126-ba102117e07b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.582164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f939-8ec4-4fca-b126-ba102117e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.582440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0f939-8ec4-4fca-b126-ba102117e07b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.604574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0f939-8ec4-4fca-b126-ba102117e07b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:03.612514 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-6cf0f939-8ec4-4fca-b126-ba102117e07b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:31:03.614215 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 189/373] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:03.621086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c81c15-d3e2-4341-ae2e-801a25d106e3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.641124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c81c15-d3e2-4341-ae2e-801a25d106e3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.657149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad43d4-6f0b-430e-8d65-f7c557a80e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.657847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad43d4-6f0b-430e-8d65-f7c557a80e71 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.658128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad43d4-6f0b-430e-8d65-f7c557a80e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.658405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad43d4-6f0b-430e-8d65-f7c557a80e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.659376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad43d4-6f0b-430e-8d65-f7c557a80e71 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:03.659681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad43d4-6f0b-430e-8d65-f7c557a80e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.661323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad43d4-6f0b-430e-8d65-f7c557a80e71 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.676649 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 185/374] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:03.683431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f939-8ec4-4fca-b126-ba102117e07b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.694170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0f939-8ec4-4fca-b126-ba102117e07b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.703937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc6986-2e58-4574-8c8f-dc340aae5dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.704603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc6986-2e58-4574-8c8f-dc340aae5dba admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.704883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc6986-2e58-4574-8c8f-dc340aae5dba admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.705155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc6986-2e58-4574-8c8f-dc340aae5dba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.721856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc6986-2e58-4574-8c8f-dc340aae5dba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.723813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc6986-2e58-4574-8c8f-dc340aae5dba admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.739399 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 190/375] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:03.742329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad43d4-6f0b-430e-8d65-f7c557a80e71 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.763571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad43d4-6f0b-430e-8d65-f7c557a80e71 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.773562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ad6fb-387a-4750-8fd6-50be24fa6013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.774981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ad6fb-387a-4750-8fd6-50be24fa6013 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.775277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ad6fb-387a-4750-8fd6-50be24fa6013 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.775556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ad6fb-387a-4750-8fd6-50be24fa6013 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.779998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ad6fb-387a-4750-8fd6-50be24fa6013 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.782254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ad6fb-387a-4750-8fd6-50be24fa6013 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.784355 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 186/376] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:03.790409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc6986-2e58-4574-8c8f-dc340aae5dba admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.804750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc6986-2e58-4574-8c8f-dc340aae5dba admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.810149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c4711-d466-42ac-9839-7f347809b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.811013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c4711-d466-42ac-9839-7f347809b678 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.811372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c4711-d466-42ac-9839-7f347809b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.811778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c4711-d466-42ac-9839-7f347809b678 admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.813158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c4711-d466-42ac-9839-7f347809b678 admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.815135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c4711-d466-42ac-9839-7f347809b678 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.816910 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 191/377] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:03.823450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ad6fb-387a-4750-8fd6-50be24fa6013 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:03.841107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ad6fb-387a-4750-8fd6-50be24fa6013 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:03.851684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e0b80-f577-43ed-bb50-d7bedb3d2da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:03.852911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e0b80-f577-43ed-bb50-d7bedb3d2da7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:03.853192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e0b80-f577-43ed-bb50-d7bedb3d2da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:03.853499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e0b80-f577-43ed-bb50-d7bedb3d2da7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:03.854314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e0b80-f577-43ed-bb50-d7bedb3d2da7 admin admin] RBAC: Adding query filter params (group.id=44beaa9009304c22bfb50f12df57b694, role.id=9a635e239d2c4df7972fb54b7ed42aa6, scope.project.id=838c496dfc884bc0b3b44afdd528b73e) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:03.854618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e0b80-f577-43ed-bb50-d7bedb3d2da7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:03.856521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e0b80-f577-43ed-bb50-d7bedb3d2da7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:03.868275 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 187/378] 10.222.0.21 () {56 vars in 1397 bytes} [Sat Nov 27 20:31:03 2021] GET /identity/v3/role_assignments?group.id=44beaa9009304c22bfb50f12df57b694&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=9a635e239d2c4df7972fb54b7ed42aa6 => generated 260 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:04.057267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdfcc6-b270-408f-af72-152cd7bca4b7 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:04.057655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdfcc6-b270-408f-af72-152cd7bca4b7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:04.057827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdfcc6-b270-408f-af72-152cd7bca4b7 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:04.060378 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 192/379] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:04.066385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe18b0-4919-4a49-99c6-47e8daaa3787 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:04.067154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe18b0-4919-4a49-99c6-47e8daaa3787 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:04.067591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe18b0-4919-4a49-99c6-47e8daaa3787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:04.093389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cfbe18b0-4919-4a49-99c6-47e8daaa3787 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:04.094807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cfbe18b0-4919-4a49-99c6-47e8daaa3787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:04.107275 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 188/380] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:04.156324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdfcc6-b270-408f-af72-152cd7bca4b7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:04.176339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdfcc6-b270-408f-af72-152cd7bca4b7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:04.181037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c089-db1d-4eef-b7a2-aa217663104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:04.181837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c089-db1d-4eef-b7a2-aa217663104f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:04.182118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c089-db1d-4eef-b7a2-aa217663104f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:04.182391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c089-db1d-4eef-b7a2-aa217663104f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:04.204358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875c089-db1d-4eef-b7a2-aa217663104f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:04.211606 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-6875c089-db1d-4eef-b7a2-aa217663104f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:31:04.213297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 193/381] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:04.220764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe18b0-4919-4a49-99c6-47e8daaa3787 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:04.232482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe18b0-4919-4a49-99c6-47e8daaa3787 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:04.242441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5d2d1-5128-4993-9ecd-bf9c50bc5292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:04.243485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d2d1-5128-4993-9ecd-bf9c50bc5292 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:04.243982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d2d1-5128-4993-9ecd-bf9c50bc5292 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:04.244464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d2d1-5128-4993-9ecd-bf9c50bc5292 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:04.245420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5d2d1-5128-4993-9ecd-bf9c50bc5292 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:04.245916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5d2d1-5128-4993-9ecd-bf9c50bc5292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:04.247782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5d2d1-5128-4993-9ecd-bf9c50bc5292 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:04.264282 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 189/382] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:31:04 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:04.271229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c089-db1d-4eef-b7a2-aa217663104f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:04.283635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c089-db1d-4eef-b7a2-aa217663104f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:04.290409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ca548-408a-4be8-a1b2-2aa1a7d52b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:04.291049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ca548-408a-4be8-a1b2-2aa1a7d52b52 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:04.291356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ca548-408a-4be8-a1b2-2aa1a7d52b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:04.291636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ca548-408a-4be8-a1b2-2aa1a7d52b52 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:04.304099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ca548-408a-4be8-a1b2-2aa1a7d52b52 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:04.306418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ca548-408a-4be8-a1b2-2aa1a7d52b52 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:04.317880 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 194/383] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:04.323718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5d2d1-5128-4993-9ecd-bf9c50bc5292 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:04.340796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5d2d1-5128-4993-9ecd-bf9c50bc5292 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:04.355964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa988e-0b69-432f-99e8-f0e2aed2d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:04.357122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa988e-0b69-432f-99e8-f0e2aed2d461 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:04.357616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa988e-0b69-432f-99e8-f0e2aed2d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:04.358093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa988e-0b69-432f-99e8-f0e2aed2d461 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:04.359605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa988e-0b69-432f-99e8-f0e2aed2d461 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:04.361995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa988e-0b69-432f-99e8-f0e2aed2d461 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:04.364213 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 190/384] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:04 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:04.370547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ca548-408a-4be8-a1b2-2aa1a7d52b52 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:04.382575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ca548-408a-4be8-a1b2-2aa1a7d52b52 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:04.391242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0623d-39ee-47de-a3ee-3e9a4d5e8459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:04.392109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0623d-39ee-47de-a3ee-3e9a4d5e8459 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:04.392389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0623d-39ee-47de-a3ee-3e9a4d5e8459 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:04.392662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0623d-39ee-47de-a3ee-3e9a4d5e8459 admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:04.400274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0623d-39ee-47de-a3ee-3e9a4d5e8459 admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:04.402168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0623d-39ee-47de-a3ee-3e9a4d5e8459 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:04.404110 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 195/385] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:04 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:04.409958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa988e-0b69-432f-99e8-f0e2aed2d461 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:04.424259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa988e-0b69-432f-99e8-f0e2aed2d461 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:04.434910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1badd7e-e892-4d3b-9b9b-9f04f4f90701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:04.435860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1badd7e-e892-4d3b-9b9b-9f04f4f90701 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:04.436352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1badd7e-e892-4d3b-9b9b-9f04f4f90701 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:04.436836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1badd7e-e892-4d3b-9b9b-9f04f4f90701 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:04.437876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1badd7e-e892-4d3b-9b9b-9f04f4f90701 admin admin] RBAC: Adding query filter params (group.id=44beaa9009304c22bfb50f12df57b694, role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:04.438397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1badd7e-e892-4d3b-9b9b-9f04f4f90701 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:04.440452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1badd7e-e892-4d3b-9b9b-9f04f4f90701 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:04.451985 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 191/386] 10.222.0.21 () {56 vars in 1397 bytes} [Sat Nov 27 20:31:04 2021] GET /identity/v3/role_assignments?group.id=44beaa9009304c22bfb50f12df57b694&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:05.695095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e78bf6-296e-42c9-bb5f-6aada7a222ab None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:05.695671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e78bf6-296e-42c9-bb5f-6aada7a222ab None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:05.695671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e78bf6-296e-42c9-bb5f-6aada7a222ab None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:05.698408 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 196/387] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:05.713370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed67c2-3a29-4d68-96b3-f28e8083e6ed None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:05.714276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed67c2-3a29-4d68-96b3-f28e8083e6ed None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:05.714758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed67c2-3a29-4d68-96b3-f28e8083e6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:05.737309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ffed67c2-3a29-4d68-96b3-f28e8083e6ed None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:05.738814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ffed67c2-3a29-4d68-96b3-f28e8083e6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:05.747542 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 192/388] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:05.785364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e78bf6-296e-42c9-bb5f-6aada7a222ab None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:05.800752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e78bf6-296e-42c9-bb5f-6aada7a222ab None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:05.807664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9fb5b-9c14-45e2-854d-fbb1e68dd220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:05.808748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9fb5b-9c14-45e2-854d-fbb1e68dd220 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:05.809227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9fb5b-9c14-45e2-854d-fbb1e68dd220 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:05.809705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9fb5b-9c14-45e2-854d-fbb1e68dd220 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:05.825953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9fb5b-9c14-45e2-854d-fbb1e68dd220 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:05.833548 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-50d9fb5b-9c14-45e2-854d-fbb1e68dd220 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:31:05.835285 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 197/389] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:05 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:05.841625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed67c2-3a29-4d68-96b3-f28e8083e6ed None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:05.851014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed67c2-3a29-4d68-96b3-f28e8083e6ed None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:05.858245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb89eb-ffa0-4f07-b89d-c6859baa20a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:05.859205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb89eb-ffa0-4f07-b89d-c6859baa20a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:05.859712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb89eb-ffa0-4f07-b89d-c6859baa20a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:05.860180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb89eb-ffa0-4f07-b89d-c6859baa20a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:05.861149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb89eb-ffa0-4f07-b89d-c6859baa20a5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:05.861652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb89eb-ffa0-4f07-b89d-c6859baa20a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:05.863471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb89eb-ffa0-4f07-b89d-c6859baa20a5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:05.873136 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 193/390] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:05 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:05.880645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9fb5b-9c14-45e2-854d-fbb1e68dd220 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:05.890810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9fb5b-9c14-45e2-854d-fbb1e68dd220 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:05.900088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c1c4-0053-43e3-abf8-af556d8241e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:05.900987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c1c4-0053-43e3-abf8-af556d8241e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:05.901463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c1c4-0053-43e3-abf8-af556d8241e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:05.901936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537c1c4-0053-43e3-abf8-af556d8241e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:05.915538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537c1c4-0053-43e3-abf8-af556d8241e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:05.917580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537c1c4-0053-43e3-abf8-af556d8241e2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:05.933190 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 198/391] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:05.939246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb89eb-ffa0-4f07-b89d-c6859baa20a5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:05.949406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb89eb-ffa0-4f07-b89d-c6859baa20a5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:05.958884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a8ec4-c7c1-4dc0-a1c6-de4e06009f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:05.960011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a8ec4-c7c1-4dc0-a1c6-de4e06009f15 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:05.960492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a8ec4-c7c1-4dc0-a1c6-de4e06009f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:05.960960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a8ec4-c7c1-4dc0-a1c6-de4e06009f15 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:05.963441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a8ec4-c7c1-4dc0-a1c6-de4e06009f15 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:05.965732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a8ec4-c7c1-4dc0-a1c6-de4e06009f15 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:05.967901 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 194/392] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:05 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:05.973465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c1c4-0053-43e3-abf8-af556d8241e2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:05.982671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537c1c4-0053-43e3-abf8-af556d8241e2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:05.990807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6eb22-4791-4a09-a9ab-ff1f81124418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:05.992026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6eb22-4791-4a09-a9ab-ff1f81124418 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:05.992508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6eb22-4791-4a09-a9ab-ff1f81124418 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:05.993482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6eb22-4791-4a09-a9ab-ff1f81124418 admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:05.994880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6eb22-4791-4a09-a9ab-ff1f81124418 admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:05.996999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6eb22-4791-4a09-a9ab-ff1f81124418 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:05.999443 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 199/393] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:05 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:06.005464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a8ec4-c7c1-4dc0-a1c6-de4e06009f15 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:06.015814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a8ec4-c7c1-4dc0-a1c6-de4e06009f15 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:06.023310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc262494-2cc9-46ce-a221-74363003c4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:06.024728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc262494-2cc9-46ce-a221-74363003c4db admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.025226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc262494-2cc9-46ce-a221-74363003c4db admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.025694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc262494-2cc9-46ce-a221-74363003c4db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.026722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc262494-2cc9-46ce-a221-74363003c4db admin admin] RBAC: Adding query filter params (group.id=44beaa9009304c22bfb50f12df57b694, role.id=9a635e239d2c4df7972fb54b7ed42aa6, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:06.027244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc262494-2cc9-46ce-a221-74363003c4db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:06.029347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc262494-2cc9-46ce-a221-74363003c4db admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:06.035476 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 195/394] 10.222.0.21 () {56 vars in 1397 bytes} [Sat Nov 27 20:31:06 2021] GET /identity/v3/role_assignments?group.id=44beaa9009304c22bfb50f12df57b694&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=9a635e239d2c4df7972fb54b7ed42aa6 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:06.072138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6625b-fd47-45d5-adfc-3be3eec7631f None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.072763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6625b-fd47-45d5-adfc-3be3eec7631f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.073233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6625b-fd47-45d5-adfc-3be3eec7631f None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.075218 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 200/395] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:06.081735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc385294-929b-4579-9f45-a00cd3f1318e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.082338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc385294-929b-4579-9f45-a00cd3f1318e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.082803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc385294-929b-4579-9f45-a00cd3f1318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.108511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fc385294-929b-4579-9f45-a00cd3f1318e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:06.110096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fc385294-929b-4579-9f45-a00cd3f1318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:06.123634 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 196/396] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:06.152550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6625b-fd47-45d5-adfc-3be3eec7631f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:06.170335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6625b-fd47-45d5-adfc-3be3eec7631f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:06.181397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99855679-53f4-4d66-94f4-8594aab74ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:06.182577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99855679-53f4-4d66-94f4-8594aab74ecb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.183087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99855679-53f4-4d66-94f4-8594aab74ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.183596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99855679-53f4-4d66-94f4-8594aab74ecb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.203391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99855679-53f4-4d66-94f4-8594aab74ecb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:06.210876 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-99855679-53f4-4d66-94f4-8594aab74ecb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:31:06.212645 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 201/397] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:06.219422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc385294-929b-4579-9f45-a00cd3f1318e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:06.229860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc385294-929b-4579-9f45-a00cd3f1318e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:06.238491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686eb6f2-7e3a-4539-9322-6df32ecdaad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:06.239570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686eb6f2-7e3a-4539-9322-6df32ecdaad2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.240072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686eb6f2-7e3a-4539-9322-6df32ecdaad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.240557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686eb6f2-7e3a-4539-9322-6df32ecdaad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.241577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686eb6f2-7e3a-4539-9322-6df32ecdaad2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:06.242102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686eb6f2-7e3a-4539-9322-6df32ecdaad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:06.244146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686eb6f2-7e3a-4539-9322-6df32ecdaad2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:06.254344 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 197/398] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:06.261537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99855679-53f4-4d66-94f4-8594aab74ecb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:06.272051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99855679-53f4-4d66-94f4-8594aab74ecb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:06.277664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ff763-5e16-4f9f-9c63-48de34550f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:06.278675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ff763-5e16-4f9f-9c63-48de34550f2c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.279273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ff763-5e16-4f9f-9c63-48de34550f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.279832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ff763-5e16-4f9f-9c63-48de34550f2c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.290167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ff763-5e16-4f9f-9c63-48de34550f2c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:06.292363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ff763-5e16-4f9f-9c63-48de34550f2c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:06.302704 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 202/399] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:06 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:06.309247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686eb6f2-7e3a-4539-9322-6df32ecdaad2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:06.319776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686eb6f2-7e3a-4539-9322-6df32ecdaad2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:06.325289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b1eba-0369-4aa9-b4d0-84814b5505ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:06.326442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b1eba-0369-4aa9-b4d0-84814b5505ba admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.326969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b1eba-0369-4aa9-b4d0-84814b5505ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.327482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b1eba-0369-4aa9-b4d0-84814b5505ba admin admin] PATH_INFO: `/v3/projects/bb5d1bf085ae456f8f7285f5a202640b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.328946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b1eba-0369-4aa9-b4d0-84814b5505ba admin admin] RBAC: Authorizing `identity:get_project(project_id=bb5d1bf085ae456f8f7285f5a202640b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:06.330997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b1eba-0369-4aa9-b4d0-84814b5505ba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:06.333301 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 198/400] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:06 2021] GET /identity/v3/projects/bb5d1bf085ae456f8f7285f5a202640b => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:06.339541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ff763-5e16-4f9f-9c63-48de34550f2c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:06.349112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ff763-5e16-4f9f-9c63-48de34550f2c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:06.354519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266d04c-2a7f-4d34-8331-c8946e2d2fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:06.355728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266d04c-2a7f-4d34-8331-c8946e2d2fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.356208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266d04c-2a7f-4d34-8331-c8946e2d2fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.356716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266d04c-2a7f-4d34-8331-c8946e2d2fa6 admin admin] PATH_INFO: `/v3/groups/02439c93963d47448b5dcb1073f5142e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.363573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266d04c-2a7f-4d34-8331-c8946e2d2fa6 admin admin] RBAC: Authorizing `identity:get_group(group_id=02439c93963d47448b5dcb1073f5142e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:06.365744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266d04c-2a7f-4d34-8331-c8946e2d2fa6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:06.368111 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 203/401] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:06 2021] GET /identity/v3/groups/02439c93963d47448b5dcb1073f5142e => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:06.374832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b1eba-0369-4aa9-b4d0-84814b5505ba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:06.386082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b1eba-0369-4aa9-b4d0-84814b5505ba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:06.391010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a8d76-3429-4824-b754-4c39e04a1dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:06.391988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8d76-3429-4824-b754-4c39e04a1dce admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.392469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8d76-3429-4824-b754-4c39e04a1dce admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.392937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8d76-3429-4824-b754-4c39e04a1dce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.394030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8d76-3429-4824-b754-4c39e04a1dce admin admin] RBAC: Adding query filter params (group.id=02439c93963d47448b5dcb1073f5142e, role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=bb5d1bf085ae456f8f7285f5a202640b) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:06.394553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8d76-3429-4824-b754-4c39e04a1dce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:06.396740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8d76-3429-4824-b754-4c39e04a1dce admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:06.403745 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 199/402] 10.222.0.21 () {56 vars in 1397 bytes} [Sat Nov 27 20:31:06 2021] GET /identity/v3/role_assignments?group.id=02439c93963d47448b5dcb1073f5142e&scope.project.id=bb5d1bf085ae456f8f7285f5a202640b&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:06.785273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8da5c-1ec9-4cb2-b9d7-45b345ddd298 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.786329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8da5c-1ec9-4cb2-b9d7-45b345ddd298 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.786823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8da5c-1ec9-4cb2-b9d7-45b345ddd298 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.788823 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 204/403] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:06.798439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f6c05-5cad-4ea4-8e7a-30b9f6a3139e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.799335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f6c05-5cad-4ea4-8e7a-30b9f6a3139e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.799829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f6c05-5cad-4ea4-8e7a-30b9f6a3139e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.825704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4e0f6c05-5cad-4ea4-8e7a-30b9f6a3139e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:06.827212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4e0f6c05-5cad-4ea4-8e7a-30b9f6a3139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:06.835352 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 200/404] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:06.885225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8da5c-1ec9-4cb2-b9d7-45b345ddd298 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:06.901205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8da5c-1ec9-4cb2-b9d7-45b345ddd298 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:06.905907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c6699-63de-40b2-a518-4edbd35e782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:06.906907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c6699-63de-40b2-a518-4edbd35e782b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.907407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c6699-63de-40b2-a518-4edbd35e782b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.907872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c6699-63de-40b2-a518-4edbd35e782b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.921950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c6699-63de-40b2-a518-4edbd35e782b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:06.929271 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-473c6699-63de-40b2-a518-4edbd35e782b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:31:06.930776 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 205/405] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:06.937271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f6c05-5cad-4ea4-8e7a-30b9f6a3139e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:06.947427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f6c05-5cad-4ea4-8e7a-30b9f6a3139e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:06.955269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aeaf37-0b8a-413a-88ff-865964c45ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:06.956161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeaf37-0b8a-413a-88ff-865964c45ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.956641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeaf37-0b8a-413a-88ff-865964c45ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.957110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeaf37-0b8a-413a-88ff-865964c45ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.958118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aeaf37-0b8a-413a-88ff-865964c45ac3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:06.958633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aeaf37-0b8a-413a-88ff-865964c45ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:06.960505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aeaf37-0b8a-413a-88ff-865964c45ac3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:06.970233 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 201/406] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:31:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:06.976520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c6699-63de-40b2-a518-4edbd35e782b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:06.987200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c6699-63de-40b2-a518-4edbd35e782b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:06.994590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce7bcb-89dd-4ff8-8953-1e82a6c3f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:06.995735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7bcb-89dd-4ff8-8953-1e82a6c3f192 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:06.996249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7bcb-89dd-4ff8-8953-1e82a6c3f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:06.996716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce7bcb-89dd-4ff8-8953-1e82a6c3f192 admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:06.998212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce7bcb-89dd-4ff8-8953-1e82a6c3f192 admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:07.000622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce7bcb-89dd-4ff8-8953-1e82a6c3f192 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:07.002813 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 206/407] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:06 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:07.009204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aeaf37-0b8a-413a-88ff-865964c45ac3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:07.019893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aeaf37-0b8a-413a-88ff-865964c45ac3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:07.028320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110ca39-f7f3-410f-9d87-1a69abe89b8e None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:07.028607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110ca39-f7f3-410f-9d87-1a69abe89b8e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:07.028882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110ca39-f7f3-410f-9d87-1a69abe89b8e None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:07.029182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b34e57-d308-43e0-b910-e05690f847f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:07.030290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b34e57-d308-43e0-b910-e05690f847f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:07.030780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b34e57-d308-43e0-b910-e05690f847f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:07.030908 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 207/408] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:31:07.031408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b34e57-d308-43e0-b910-e05690f847f3 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:07.032870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b34e57-d308-43e0-b910-e05690f847f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:07.035346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b34e57-d308-43e0-b910-e05690f847f3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:07.036349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9120a8-84fa-4634-a763-45f579ba4e89 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:07.036629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9120a8-84fa-4634-a763-45f579ba4e89 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:07.036897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9120a8-84fa-4634-a763-45f579ba4e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:07.038160 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 202/409] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:07 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:07.044369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b34e57-d308-43e0-b910-e05690f847f3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:07.054578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b34e57-d308-43e0-b910-e05690f847f3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:07.060601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3b5e6-58be-4d33-95a4-4e13bcd441b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:07.061756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3b5e6-58be-4d33-95a4-4e13bcd441b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:07.062327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3b5e6-58be-4d33-95a4-4e13bcd441b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:07.062797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3b5e6-58be-4d33-95a4-4e13bcd441b6 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e/groups/44beaa9009304c22bfb50f12df57b694/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:07.065231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3b5e6-58be-4d33-95a4-4e13bcd441b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838c496dfc884bc0b3b44afdd528b73e, group_id=44beaa9009304c22bfb50f12df57b694, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:07.068314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9e9120a8-84fa-4634-a763-45f579ba4e89 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:07.068621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3b5e6-58be-4d33-95a4-4e13bcd441b6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:07.069510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e9120a8-84fa-4634-a763-45f579ba4e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:07.085926 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 203/410] 10.222.0.21 () {58 vars in 1463 bytes} [Sat Nov 27 20:31:07 2021] PUT /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e/groups/44beaa9009304c22bfb50f12df57b694/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:07.094076 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 208/411] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:07.130724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3b5e6-58be-4d33-95a4-4e13bcd441b6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:07.208964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3b5e6-58be-4d33-95a4-4e13bcd441b6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:07.213984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d99b06-b030-49d3-a4b9-4785cf3eada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:07.215042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d99b06-b030-49d3-a4b9-4785cf3eada3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:07.215617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d99b06-b030-49d3-a4b9-4785cf3eada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:07.216199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d99b06-b030-49d3-a4b9-4785cf3eada3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:07.228818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d99b06-b030-49d3-a4b9-4785cf3eada3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:07.236512 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-67d99b06-b030-49d3-a4b9-4785cf3eada3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:31:07.238306 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 204/412] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:07.244524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9120a8-84fa-4634-a763-45f579ba4e89 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:07.259626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9120a8-84fa-4634-a763-45f579ba4e89 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:07.274216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95096de-8412-46c8-baa3-b09b87fec462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:07.274908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95096de-8412-46c8-baa3-b09b87fec462 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:07.275185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95096de-8412-46c8-baa3-b09b87fec462 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:07.275484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95096de-8412-46c8-baa3-b09b87fec462 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:07.276263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95096de-8412-46c8-baa3-b09b87fec462 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:07.276565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95096de-8412-46c8-baa3-b09b87fec462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:07.278187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95096de-8412-46c8-baa3-b09b87fec462 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:07.295075 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 209/413] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:07.301180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d99b06-b030-49d3-a4b9-4785cf3eada3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:07.313354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d99b06-b030-49d3-a4b9-4785cf3eada3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:07.323055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccde4f3-ecca-4318-be49-e27ba496cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:07.324337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccde4f3-ecca-4318-be49-e27ba496cee4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:07.324885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccde4f3-ecca-4318-be49-e27ba496cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:07.325374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccde4f3-ecca-4318-be49-e27ba496cee4 admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:07.326896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccde4f3-ecca-4318-be49-e27ba496cee4 admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:07.328338 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-cccde4f3-ecca-4318-be49-e27ba496cee4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:07.328338 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:31:07.328338 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:31:07.329956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccde4f3-ecca-4318-be49-e27ba496cee4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:07.332421 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 205/414] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:07 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:07.338810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95096de-8412-46c8-baa3-b09b87fec462 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:07.352778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95096de-8412-46c8-baa3-b09b87fec462 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:07.361566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69ce8a-a039-47ee-b075-e589352df282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:07.362440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ce8a-a039-47ee-b075-e589352df282 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:07.362714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ce8a-a039-47ee-b075-e589352df282 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:07.362981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69ce8a-a039-47ee-b075-e589352df282 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:07.364307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69ce8a-a039-47ee-b075-e589352df282 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:07.366389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69ce8a-a039-47ee-b075-e589352df282 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:07.368533 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 210/415] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:07 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:07.375076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccde4f3-ecca-4318-be49-e27ba496cee4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:07.385368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccde4f3-ecca-4318-be49-e27ba496cee4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:07.395239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292da7a-9f00-4c83-9dae-adfdbb8322bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:07.396158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292da7a-9f00-4c83-9dae-adfdbb8322bc admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:07.396441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292da7a-9f00-4c83-9dae-adfdbb8322bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:07.396708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292da7a-9f00-4c83-9dae-adfdbb8322bc admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e/groups/44beaa9009304c22bfb50f12df57b694/roles/9a635e239d2c4df7972fb54b7ed42aa6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:07.405465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292da7a-9f00-4c83-9dae-adfdbb8322bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=838c496dfc884bc0b3b44afdd528b73e, group_id=44beaa9009304c22bfb50f12df57b694, role_id=9a635e239d2c4df7972fb54b7ed42aa6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:07.408201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292da7a-9f00-4c83-9dae-adfdbb8322bc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:07.430066 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 206/416] 10.222.0.21 () {58 vars in 1463 bytes} [Sat Nov 27 20:31:07 2021] PUT /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e/groups/44beaa9009304c22bfb50f12df57b694/roles/9a635e239d2c4df7972fb54b7ed42aa6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:07.849157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967a07-3fad-4087-96c4-74c8b608fd1e None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:07.849683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967a07-3fad-4087-96c4-74c8b608fd1e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:07.849683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967a07-3fad-4087-96c4-74c8b608fd1e None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:07.851724 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 211/417] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:07.859346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d7f0-dea0-429e-a40e-6ba03a9366fe None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:07.859897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d7f0-dea0-429e-a40e-6ba03a9366fe None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:07.859897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d7f0-dea0-429e-a40e-6ba03a9366fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:07.888431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-64f7d7f0-dea0-429e-a40e-6ba03a9366fe None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:07.890455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-64f7d7f0-dea0-429e-a40e-6ba03a9366fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:07.969870 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 207/418] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:08.004891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967a07-3fad-4087-96c4-74c8b608fd1e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:08.021042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967a07-3fad-4087-96c4-74c8b608fd1e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:08.025611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2a28-068b-45d6-9e70-03f36ba11d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:08.026390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2a28-068b-45d6-9e70-03f36ba11d37 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:08.026674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2a28-068b-45d6-9e70-03f36ba11d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:08.026941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2a28-068b-45d6-9e70-03f36ba11d37 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:08.044140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2a28-068b-45d6-9e70-03f36ba11d37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:08.051121 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-f27e2a28-068b-45d6-9e70-03f36ba11d37 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:31:08.052365 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 212/419] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:08.059171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7d7f0-dea0-429e-a40e-6ba03a9366fe None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:08.068362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7d7f0-dea0-429e-a40e-6ba03a9366fe None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:08.075397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2447e-296d-4dc0-947a-a226a056f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:08.076070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2447e-296d-4dc0-947a-a226a056f604 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:08.076349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2447e-296d-4dc0-947a-a226a056f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:08.076622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2447e-296d-4dc0-947a-a226a056f604 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:08.077393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2447e-296d-4dc0-947a-a226a056f604 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:08.077696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2447e-296d-4dc0-947a-a226a056f604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:08.079324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2447e-296d-4dc0-947a-a226a056f604 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:08.091479 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 208/420] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:31:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:08.097507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2a28-068b-45d6-9e70-03f36ba11d37 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:08.108721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2a28-068b-45d6-9e70-03f36ba11d37 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:08.115335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dbc10-7343-4d95-a744-06be121df2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:08.116182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbc10-7343-4d95-a744-06be121df2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:08.116464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbc10-7343-4d95-a744-06be121df2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:08.116735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbc10-7343-4d95-a744-06be121df2a7 admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:08.118485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dbc10-7343-4d95-a744-06be121df2a7 admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:08.120408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dbc10-7343-4d95-a744-06be121df2a7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:08.122013 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 213/421] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:08 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:08.128189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2447e-296d-4dc0-947a-a226a056f604 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:08.145798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2447e-296d-4dc0-947a-a226a056f604 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:08.156977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ed569-516c-43ed-bf33-16a6f7a606e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:08.157874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed569-516c-43ed-bf33-16a6f7a606e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:08.158138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed569-516c-43ed-bf33-16a6f7a606e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:08.158411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed569-516c-43ed-bf33-16a6f7a606e3 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:08.159658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ed569-516c-43ed-bf33-16a6f7a606e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:08.161709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ed569-516c-43ed-bf33-16a6f7a606e3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:08.163377 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 209/422] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:08 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:08.169550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dbc10-7343-4d95-a744-06be121df2a7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:08.184679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dbc10-7343-4d95-a744-06be121df2a7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:08.192720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d6ab2-ea94-4e51-a76b-9c0d5707227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:08.193590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d6ab2-ea94-4e51-a76b-9c0d5707227f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:08.193869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d6ab2-ea94-4e51-a76b-9c0d5707227f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:08.194134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d6ab2-ea94-4e51-a76b-9c0d5707227f admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/groups/44beaa9009304c22bfb50f12df57b694/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:08.196214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d6ab2-ea94-4e51-a76b-9c0d5707227f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d57f777fe5147a9a30ce29df70e5d45, group_id=44beaa9009304c22bfb50f12df57b694, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:08.198822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d6ab2-ea94-4e51-a76b-9c0d5707227f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:08.224533 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 214/423] 10.222.0.21 () {58 vars in 1463 bytes} [Sat Nov 27 20:31:08 2021] PUT /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/groups/44beaa9009304c22bfb50f12df57b694/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:09.496077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04652a-c277-4b04-bcc7-db942e56a783 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.496612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04652a-c277-4b04-bcc7-db942e56a783 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.496612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04652a-c277-4b04-bcc7-db942e56a783 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.498655 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 210/424] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:09.504525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b28dd9-58cb-4b5b-9c93-2ecc3194e236 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.504920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b28dd9-58cb-4b5b-9c93-2ecc3194e236 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.505114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b28dd9-58cb-4b5b-9c93-2ecc3194e236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.530872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-37b28dd9-58cb-4b5b-9c93-2ecc3194e236 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:09.532104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-37b28dd9-58cb-4b5b-9c93-2ecc3194e236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:09.607719 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 215/425] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:09.653119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04652a-c277-4b04-bcc7-db942e56a783 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:09.670174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d786f59-4d6c-470d-af44-51456afb7d84 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.670466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d786f59-4d6c-470d-af44-51456afb7d84 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.670726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d786f59-4d6c-470d-af44-51456afb7d84 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.672536 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 216/426] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:31:09.672646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04652a-c277-4b04-bcc7-db942e56a783 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:09.678233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bbcb9-6a44-4222-b4ff-5f099f9a4867 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.678518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bbcb9-6a44-4222-b4ff-5f099f9a4867 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.678799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bbcb9-6a44-4222-b4ff-5f099f9a4867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.680750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3773e1e-cee8-4ff9-afbe-4559cff86f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:09.681554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3773e1e-cee8-4ff9-afbe-4559cff86f54 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.681838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3773e1e-cee8-4ff9-afbe-4559cff86f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.682113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3773e1e-cee8-4ff9-afbe-4559cff86f54 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.698203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cb8bbcb9-6a44-4222-b4ff-5f099f9a4867 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:09.699679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cb8bbcb9-6a44-4222-b4ff-5f099f9a4867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:09.704177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3773e1e-cee8-4ff9-afbe-4559cff86f54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:09.708360 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 217/427] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:09.714167 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-b3773e1e-cee8-4ff9-afbe-4559cff86f54 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:31:09.715656 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 211/428] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:09.721685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bbcb9-6a44-4222-b4ff-5f099f9a4867 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:09.736480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bbcb9-6a44-4222-b4ff-5f099f9a4867 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:09.745791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e8fba-7ab7-4804-bbb2-24da1339705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:09.746474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e8fba-7ab7-4804-bbb2-24da1339705f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.746751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e8fba-7ab7-4804-bbb2-24da1339705f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.747021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e8fba-7ab7-4804-bbb2-24da1339705f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.747128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3773e1e-cee8-4ff9-afbe-4559cff86f54 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:09.747815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e8fba-7ab7-4804-bbb2-24da1339705f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:09.748114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e8fba-7ab7-4804-bbb2-24da1339705f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:09.749959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e8fba-7ab7-4804-bbb2-24da1339705f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:09.759378 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 218/429] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:09.762651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3773e1e-cee8-4ff9-afbe-4559cff86f54 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:09.769297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e8fba-7ab7-4804-bbb2-24da1339705f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:09.777211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce382b-3cf9-40ac-a974-0f26932594f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:09.778013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce382b-3cf9-40ac-a974-0f26932594f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.778290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce382b-3cf9-40ac-a974-0f26932594f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.778560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce382b-3cf9-40ac-a974-0f26932594f6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.783693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e8fba-7ab7-4804-bbb2-24da1339705f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:09.792083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222c5c0-17ce-4628-9a64-5f8c07a641a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:09.792946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222c5c0-17ce-4628-9a64-5f8c07a641a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.793230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222c5c0-17ce-4628-9a64-5f8c07a641a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.793505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222c5c0-17ce-4628-9a64-5f8c07a641a1 admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.795849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222c5c0-17ce-4628-9a64-5f8c07a641a1 admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:09.797741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222c5c0-17ce-4628-9a64-5f8c07a641a1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:09.807821 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 219/430] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:09 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:09.809253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222c5c0-17ce-4628-9a64-5f8c07a641a1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:09.810209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce382b-3cf9-40ac-a974-0f26932594f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:09.817146 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-03ce382b-3cf9-40ac-a974-0f26932594f6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:31:09.818933 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 212/431] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:09.826577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce382b-3cf9-40ac-a974-0f26932594f6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:09.830674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222c5c0-17ce-4628-9a64-5f8c07a641a1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:09.838408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d953-e4b7-4ce0-afd5-56e3bc4e661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:09.839301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d953-e4b7-4ce0-afd5-56e3bc4e661d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.840635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d953-e4b7-4ce0-afd5-56e3bc4e661d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.840910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d953-e4b7-4ce0-afd5-56e3bc4e661d admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.842297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35d953-e4b7-4ce0-afd5-56e3bc4e661d admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:09.845111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce382b-3cf9-40ac-a974-0f26932594f6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:09.847650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35d953-e4b7-4ce0-afd5-56e3bc4e661d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:09.849392 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 220/432] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:09 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:09.855914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d953-e4b7-4ce0-afd5-56e3bc4e661d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:09.863573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4527d-b107-4bbf-b30f-b41b142d7877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:09.863950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4527d-b107-4bbf-b30f-b41b142d7877 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.864229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4527d-b107-4bbf-b30f-b41b142d7877 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.864496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4527d-b107-4bbf-b30f-b41b142d7877 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.865431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4527d-b107-4bbf-b30f-b41b142d7877 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:09.865774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4527d-b107-4bbf-b30f-b41b142d7877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:09.868086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4527d-b107-4bbf-b30f-b41b142d7877 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:09.878160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35d953-e4b7-4ce0-afd5-56e3bc4e661d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:09.886490 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 213/433] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:09.890174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53711f-8b36-413e-8796-845eba59634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:09.890174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53711f-8b36-413e-8796-845eba59634b admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.890174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53711f-8b36-413e-8796-845eba59634b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.890174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53711f-8b36-413e-8796-845eba59634b admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/groups/44beaa9009304c22bfb50f12df57b694/roles/9a635e239d2c4df7972fb54b7ed42aa6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.892525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4527d-b107-4bbf-b30f-b41b142d7877 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:09.896109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53711f-8b36-413e-8796-845eba59634b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d57f777fe5147a9a30ce29df70e5d45, group_id=44beaa9009304c22bfb50f12df57b694, role_id=9a635e239d2c4df7972fb54b7ed42aa6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:09.903295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53711f-8b36-413e-8796-845eba59634b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:09.908585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4527d-b107-4bbf-b30f-b41b142d7877 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:09.921156 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 221/434] 10.222.0.21 () {58 vars in 1463 bytes} [Sat Nov 27 20:31:09 2021] PUT /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45/groups/44beaa9009304c22bfb50f12df57b694/roles/9a635e239d2c4df7972fb54b7ed42aa6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:09.928247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faf4bc-de00-4e5d-8642-e0c807d4d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:09.929196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faf4bc-de00-4e5d-8642-e0c807d4d555 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:09.929532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faf4bc-de00-4e5d-8642-e0c807d4d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:09.929810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faf4bc-de00-4e5d-8642-e0c807d4d555 admin admin] PATH_INFO: `/v3/groups/02439c93963d47448b5dcb1073f5142e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:09.931976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faf4bc-de00-4e5d-8642-e0c807d4d555 admin admin] RBAC: Authorizing `identity:get_group(group_id=02439c93963d47448b5dcb1073f5142e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:09.934317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faf4bc-de00-4e5d-8642-e0c807d4d555 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:09.936203 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 214/435] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:09 2021] GET /identity/v3/groups/02439c93963d47448b5dcb1073f5142e => generated 229 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:09.942695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53711f-8b36-413e-8796-845eba59634b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.020728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53711f-8b36-413e-8796-845eba59634b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.025730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe343277-31e1-4699-a60c-93d9bda17e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.026598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343277-31e1-4699-a60c-93d9bda17e48 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.026877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343277-31e1-4699-a60c-93d9bda17e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.027150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343277-31e1-4699-a60c-93d9bda17e48 admin admin] PATH_INFO: `/v3/projects/bb5d1bf085ae456f8f7285f5a202640b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.029975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe343277-31e1-4699-a60c-93d9bda17e48 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb5d1bf085ae456f8f7285f5a202640b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:10.031917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe343277-31e1-4699-a60c-93d9bda17e48 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:10.033882 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 222/436] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:09 2021] GET /identity/v3/projects/bb5d1bf085ae456f8f7285f5a202640b => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:10.040852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faf4bc-de00-4e5d-8642-e0c807d4d555 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.051167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faf4bc-de00-4e5d-8642-e0c807d4d555 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.059766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33672070-4be0-41a3-af5b-786f55eed06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.060658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33672070-4be0-41a3-af5b-786f55eed06e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.060932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33672070-4be0-41a3-af5b-786f55eed06e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.061197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33672070-4be0-41a3-af5b-786f55eed06e admin admin] PATH_INFO: `/v3/projects/bb5d1bf085ae456f8f7285f5a202640b/groups/02439c93963d47448b5dcb1073f5142e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.063233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33672070-4be0-41a3-af5b-786f55eed06e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5d1bf085ae456f8f7285f5a202640b, group_id=02439c93963d47448b5dcb1073f5142e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:10.065973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33672070-4be0-41a3-af5b-786f55eed06e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:10.084795 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 215/437] 10.222.0.21 () {58 vars in 1463 bytes} [Sat Nov 27 20:31:10 2021] PUT /identity/v3/projects/bb5d1bf085ae456f8f7285f5a202640b/groups/02439c93963d47448b5dcb1073f5142e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:10.420800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e17b68-1202-4b87-9d53-61f7cf4536b4 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.421135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e17b68-1202-4b87-9d53-61f7cf4536b4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.421253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e17b68-1202-4b87-9d53-61f7cf4536b4 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.423298 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 223/438] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:10.431647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fbf25-994a-4f7d-a110-4fcac4c06a42 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.431920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fbf25-994a-4f7d-a110-4fcac4c06a42 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.432188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fbf25-994a-4f7d-a110-4fcac4c06a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.453039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-962fbf25-994a-4f7d-a110-4fcac4c06a42 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:10.454235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-962fbf25-994a-4f7d-a110-4fcac4c06a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:10.515454 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 216/439] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:10.541998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e17b68-1202-4b87-9d53-61f7cf4536b4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.554721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e17b68-1202-4b87-9d53-61f7cf4536b4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.559642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2b7f9-5d0d-4da3-ba86-c7ed54a085fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.560422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b7f9-5d0d-4da3-ba86-c7ed54a085fb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.560700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b7f9-5d0d-4da3-ba86-c7ed54a085fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.560971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b7f9-5d0d-4da3-ba86-c7ed54a085fb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.575895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2b7f9-5d0d-4da3-ba86-c7ed54a085fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:10.582737 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-c2d2b7f9-5d0d-4da3-ba86-c7ed54a085fb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:31:10.584271 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 224/440] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:10.591015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fbf25-994a-4f7d-a110-4fcac4c06a42 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.600184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fbf25-994a-4f7d-a110-4fcac4c06a42 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.607343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab2768-188d-42ea-9f26-7a78dfb9fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.608012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab2768-188d-42ea-9f26-7a78dfb9fce5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.608291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab2768-188d-42ea-9f26-7a78dfb9fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.608560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab2768-188d-42ea-9f26-7a78dfb9fce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.609315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab2768-188d-42ea-9f26-7a78dfb9fce5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:10.609604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab2768-188d-42ea-9f26-7a78dfb9fce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:10.611229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab2768-188d-42ea-9f26-7a78dfb9fce5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:10.620962 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 217/441] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:31:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:10.624590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf338dda-35f0-4455-bec8-a7a310a40d47 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.624871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf338dda-35f0-4455-bec8-a7a310a40d47 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.625143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf338dda-35f0-4455-bec8-a7a310a40d47 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.627107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab2768-188d-42ea-9f26-7a78dfb9fce5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.627223 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 225/442] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:10.632783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ab01-8a13-46c8-ba48-c6ceab1ffad1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.633161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ab01-8a13-46c8-ba48-c6ceab1ffad1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.633402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ab01-8a13-46c8-ba48-c6ceab1ffad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.640574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab2768-188d-42ea-9f26-7a78dfb9fce5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.645021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b0fa-6fab-435a-a5c7-d765632c382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.645659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b0fa-6fab-435a-a5c7-d765632c382d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.645940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b0fa-6fab-435a-a5c7-d765632c382d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.646211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b0fa-6fab-435a-a5c7-d765632c382d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.654443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99b0fa-6fab-435a-a5c7-d765632c382d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:10.656241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99b0fa-6fab-435a-a5c7-d765632c382d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:10.668267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1311ab01-8a13-46c8-ba48-c6ceab1ffad1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:10.668530 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 218/443] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:31:10.669513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1311ab01-8a13-46c8-ba48-c6ceab1ffad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:10.674457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b0fa-6fab-435a-a5c7-d765632c382d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.683070 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 226/444] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:10.683335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b0fa-6fab-435a-a5c7-d765632c382d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.689055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6623f3e-82d5-4cc1-9a67-2f5df275a3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.689922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6623f3e-82d5-4cc1-9a67-2f5df275a3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.690171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6623f3e-82d5-4cc1-9a67-2f5df275a3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.690440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6623f3e-82d5-4cc1-9a67-2f5df275a3c9 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.691679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6623f3e-82d5-4cc1-9a67-2f5df275a3c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:10.693712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6623f3e-82d5-4cc1-9a67-2f5df275a3c9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:10.696139 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 219/445] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:10 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:10.701875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311ab01-8a13-46c8-ba48-c6ceab1ffad1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.711419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311ab01-8a13-46c8-ba48-c6ceab1ffad1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.715902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d9eba-c376-4d70-bb75-67e7e59b842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.716734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d9eba-c376-4d70-bb75-67e7e59b842f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.717005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d9eba-c376-4d70-bb75-67e7e59b842f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.717276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d9eba-c376-4d70-bb75-67e7e59b842f admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.718444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d9eba-c376-4d70-bb75-67e7e59b842f admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:10.720366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d9eba-c376-4d70-bb75-67e7e59b842f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:10.722217 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 227/446] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:10 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:10.727484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6623f3e-82d5-4cc1-9a67-2f5df275a3c9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.737313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6623f3e-82d5-4cc1-9a67-2f5df275a3c9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.740704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d9eba-c376-4d70-bb75-67e7e59b842f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.751405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609bf2e-d822-42dc-911d-8cdb8a96b6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.752210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609bf2e-d822-42dc-911d-8cdb8a96b6bc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.752489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609bf2e-d822-42dc-911d-8cdb8a96b6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.752760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609bf2e-d822-42dc-911d-8cdb8a96b6bc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.755199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d9eba-c376-4d70-bb75-67e7e59b842f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.769812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbba50-b6bf-4ce8-a9e7-3bcb8b829921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.770454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbba50-b6bf-4ce8-a9e7-3bcb8b829921 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.770727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbba50-b6bf-4ce8-a9e7-3bcb8b829921 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.770995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbba50-b6bf-4ce8-a9e7-3bcb8b829921 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.771865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbba50-b6bf-4ce8-a9e7-3bcb8b829921 admin admin] RBAC: Adding query filter params (group.id=44beaa9009304c22bfb50f12df57b694, role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=838c496dfc884bc0b3b44afdd528b73e) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:10.772170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbba50-b6bf-4ce8-a9e7-3bcb8b829921 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:10.774057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbba50-b6bf-4ce8-a9e7-3bcb8b829921 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:10.776370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609bf2e-d822-42dc-911d-8cdb8a96b6bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:10.783514 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-0609bf2e-d822-42dc-911d-8cdb8a96b6bc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:31:10.784703 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 228/447] 10.222.0.21 () {56 vars in 1397 bytes} [Sat Nov 27 20:31:10 2021] GET /identity/v3/role_assignments?group.id=44beaa9009304c22bfb50f12df57b694&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 611 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:10.790533 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 220/448] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:10.791964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbba50-b6bf-4ce8-a9e7-3bcb8b829921 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.803127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbba50-b6bf-4ce8-a9e7-3bcb8b829921 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.815946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ab08b-cc93-40d1-839a-1fa9091f127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.817063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ab08b-cc93-40d1-839a-1fa9091f127b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.817551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ab08b-cc93-40d1-839a-1fa9091f127b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.818078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ab08b-cc93-40d1-839a-1fa9091f127b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.819122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ab08b-cc93-40d1-839a-1fa9091f127b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:10.819706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ab08b-cc93-40d1-839a-1fa9091f127b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:10.822243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ab08b-cc93-40d1-839a-1fa9091f127b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:10.838953 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 229/449] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:10.845271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609bf2e-d822-42dc-911d-8cdb8a96b6bc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.863755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609bf2e-d822-42dc-911d-8cdb8a96b6bc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.876701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f041a-2a60-4af0-948f-ad8400cf9188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.877358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f041a-2a60-4af0-948f-ad8400cf9188 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.877636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f041a-2a60-4af0-948f-ad8400cf9188 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.877904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f041a-2a60-4af0-948f-ad8400cf9188 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.892337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f041a-2a60-4af0-948f-ad8400cf9188 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:10.894101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f041a-2a60-4af0-948f-ad8400cf9188 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:10.907925 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 221/450] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:10.914026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ab08b-cc93-40d1-839a-1fa9091f127b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.939109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ab08b-cc93-40d1-839a-1fa9091f127b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.946997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4893fad-b55a-4085-93b0-c3efbfd36ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.948286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4893fad-b55a-4085-93b0-c3efbfd36ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.948773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4893fad-b55a-4085-93b0-c3efbfd36ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.949245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4893fad-b55a-4085-93b0-c3efbfd36ae9 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.952890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4893fad-b55a-4085-93b0-c3efbfd36ae9 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:10.955520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4893fad-b55a-4085-93b0-c3efbfd36ae9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:10.957818 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 230/451] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:10 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:10.964299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f041a-2a60-4af0-948f-ad8400cf9188 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:10.973655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f041a-2a60-4af0-948f-ad8400cf9188 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:10.990749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ac031-2d8e-4300-a39d-c4a7a2ee73ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:10.991633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ac031-2d8e-4300-a39d-c4a7a2ee73ce admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:10.991915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ac031-2d8e-4300-a39d-c4a7a2ee73ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:10.992200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ac031-2d8e-4300-a39d-c4a7a2ee73ce admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:10.996013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ac031-2d8e-4300-a39d-c4a7a2ee73ce admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:10.998048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ac031-2d8e-4300-a39d-c4a7a2ee73ce admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:11.000326 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 222/452] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:10 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:11.006388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4893fad-b55a-4085-93b0-c3efbfd36ae9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:11.023095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4893fad-b55a-4085-93b0-c3efbfd36ae9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:11.034757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336d251-37aa-44ff-8320-aabd7d2b4dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:11.035900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336d251-37aa-44ff-8320-aabd7d2b4dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:11.036422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336d251-37aa-44ff-8320-aabd7d2b4dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:11.036918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336d251-37aa-44ff-8320-aabd7d2b4dd3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:11.038136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336d251-37aa-44ff-8320-aabd7d2b4dd3 admin admin] RBAC: Adding query filter params (group.id=44beaa9009304c22bfb50f12df57b694, role.id=9a635e239d2c4df7972fb54b7ed42aa6, scope.project.id=838c496dfc884bc0b3b44afdd528b73e) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:11.038689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336d251-37aa-44ff-8320-aabd7d2b4dd3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:11.041015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336d251-37aa-44ff-8320-aabd7d2b4dd3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:11.048389 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 231/453] 10.222.0.21 () {56 vars in 1397 bytes} [Sat Nov 27 20:31:11 2021] GET /identity/v3/role_assignments?group.id=44beaa9009304c22bfb50f12df57b694&scope.project.id=838c496dfc884bc0b3b44afdd528b73e&role.id=9a635e239d2c4df7972fb54b7ed42aa6 => generated 611 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:11.767638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bba8f-5d5d-4a71-bbdd-02d3c35f00fc None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:11.768485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bba8f-5d5d-4a71-bbdd-02d3c35f00fc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:11.768760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bba8f-5d5d-4a71-bbdd-02d3c35f00fc None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:11.770654 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 223/454] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:11.776732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b946a-a5c4-4aef-a0b0-53adfb69d7ab None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:11.777600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b946a-a5c4-4aef-a0b0-53adfb69d7ab None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:11.778080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b946a-a5c4-4aef-a0b0-53adfb69d7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:11.797805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9c9b946a-a5c4-4aef-a0b0-53adfb69d7ab None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:11.799427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9c9b946a-a5c4-4aef-a0b0-53adfb69d7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:11.808323 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 232/455] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:11.834135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bba8f-5d5d-4a71-bbdd-02d3c35f00fc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:11.847318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bba8f-5d5d-4a71-bbdd-02d3c35f00fc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:11.852050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa17fde-ecc4-41e7-8693-87de228eeaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:11.853101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa17fde-ecc4-41e7-8693-87de228eeaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:11.853713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa17fde-ecc4-41e7-8693-87de228eeaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:11.854288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa17fde-ecc4-41e7-8693-87de228eeaa7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:11.868824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa17fde-ecc4-41e7-8693-87de228eeaa7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:11.876387 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-aaa17fde-ecc4-41e7-8693-87de228eeaa7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 27 20:31:11.878176 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 224/456] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:11.884584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b946a-a5c4-4aef-a0b0-53adfb69d7ab None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:11.894088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b946a-a5c4-4aef-a0b0-53adfb69d7ab None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:11.900116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1239c-bb61-4f38-ae2c-57bfa1b7d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:11.901113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1239c-bb61-4f38-ae2c-57bfa1b7d3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:11.901596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1239c-bb61-4f38-ae2c-57bfa1b7d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:11.902071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1239c-bb61-4f38-ae2c-57bfa1b7d3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:11.903032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1239c-bb61-4f38-ae2c-57bfa1b7d3a0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:11.903584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1239c-bb61-4f38-ae2c-57bfa1b7d3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:11.905463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1239c-bb61-4f38-ae2c-57bfa1b7d3a0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:11.915219 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 233/457] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:31:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:11.923179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa17fde-ecc4-41e7-8693-87de228eeaa7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:11.940666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa17fde-ecc4-41e7-8693-87de228eeaa7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:11.945537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905cbed-cff1-487c-9187-dc5b19cbfda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:11.946489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905cbed-cff1-487c-9187-dc5b19cbfda3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:11.946974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905cbed-cff1-487c-9187-dc5b19cbfda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:11.947495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905cbed-cff1-487c-9187-dc5b19cbfda3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:11.956676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905cbed-cff1-487c-9187-dc5b19cbfda3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:11.958674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905cbed-cff1-487c-9187-dc5b19cbfda3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:11.968716 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 225/458] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:31:11.974579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1239c-bb61-4f38-ae2c-57bfa1b7d3a0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:11.985066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1239c-bb61-4f38-ae2c-57bfa1b7d3a0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:11.989753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e06ed-9ada-4d67-8696-7b1f78c5f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:11.990839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e06ed-9ada-4d67-8696-7b1f78c5f966 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:11.991384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e06ed-9ada-4d67-8696-7b1f78c5f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:11.991857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e06ed-9ada-4d67-8696-7b1f78c5f966 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:11.993280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e06ed-9ada-4d67-8696-7b1f78c5f966 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:11.995552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e06ed-9ada-4d67-8696-7b1f78c5f966 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:11.997660 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 234/459] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:11 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:12.003809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905cbed-cff1-487c-9187-dc5b19cbfda3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:12.014442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905cbed-cff1-487c-9187-dc5b19cbfda3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:12.021747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41322ba-365b-4ee0-a662-327a467f3932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:12.021747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41322ba-365b-4ee0-a662-327a467f3932 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:12.021943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41322ba-365b-4ee0-a662-327a467f3932 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:12.022139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41322ba-365b-4ee0-a662-327a467f3932 admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:12.023528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41322ba-365b-4ee0-a662-327a467f3932 admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:12.026119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41322ba-365b-4ee0-a662-327a467f3932 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:12.028490 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 226/460] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:12 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:12.034322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e06ed-9ada-4d67-8696-7b1f78c5f966 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:12.044772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e06ed-9ada-4d67-8696-7b1f78c5f966 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:12.049206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bd0e7-3d56-43f9-9490-5c005a0d8b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:12.049846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bd0e7-3d56-43f9-9490-5c005a0d8b0a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:12.050129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bd0e7-3d56-43f9-9490-5c005a0d8b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:12.050407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bd0e7-3d56-43f9-9490-5c005a0d8b0a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:12.051240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bd0e7-3d56-43f9-9490-5c005a0d8b0a admin admin] RBAC: Adding query filter params (group.id=44beaa9009304c22bfb50f12df57b694, role.id=e3eef42cb87d4017b957fccc4eb21e62, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:12.051576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bd0e7-3d56-43f9-9490-5c005a0d8b0a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:12.053396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bd0e7-3d56-43f9-9490-5c005a0d8b0a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:12.059941 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 235/461] 10.222.0.21 () {56 vars in 1397 bytes} [Sat Nov 27 20:31:12 2021] GET /identity/v3/role_assignments?group.id=44beaa9009304c22bfb50f12df57b694&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=e3eef42cb87d4017b957fccc4eb21e62 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:12.885354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586694aa-ec39-4458-90f6-6bfa33d32a15 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:12.885960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586694aa-ec39-4458-90f6-6bfa33d32a15 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:12.885960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586694aa-ec39-4458-90f6-6bfa33d32a15 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:12.887759 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 227/462] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:12.887858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04e7f-4601-4625-b29e-d59560263c1a None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:12.888326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04e7f-4601-4625-b29e-d59560263c1a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:12.888326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec04e7f-4601-4625-b29e-d59560263c1a None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:12.890029 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 236/463] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:12.893183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd595a2-b8c2-4a56-90d8-e4ea679ed29f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:12.893467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd595a2-b8c2-4a56-90d8-e4ea679ed29f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:12.893741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd595a2-b8c2-4a56-90d8-e4ea679ed29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:12.895236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7592a3-5e8c-4d1c-a564-70aa471e4fd4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:12.895544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7592a3-5e8c-4d1c-a564-70aa471e4fd4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:12.895815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7592a3-5e8c-4d1c-a564-70aa471e4fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:12.912475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cdd595a2-b8c2-4a56-90d8-e4ea679ed29f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:12.913674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cdd595a2-b8c2-4a56-90d8-e4ea679ed29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:12.913861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-dc7592a3-5e8c-4d1c-a564-70aa471e4fd4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:12.915037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dc7592a3-5e8c-4d1c-a564-70aa471e4fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:12.921023 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 228/464] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:12.922268 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 237/465] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:12.946511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd595a2-b8c2-4a56-90d8-e4ea679ed29f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:12.947996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7592a3-5e8c-4d1c-a564-70aa471e4fd4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:12.955366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd595a2-b8c2-4a56-90d8-e4ea679ed29f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:12.956660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7592a3-5e8c-4d1c-a564-70aa471e4fd4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:12.959754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48600a-17e6-4494-8d6f-4c2e3faeb6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:12.960515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48600a-17e6-4494-8d6f-4c2e3faeb6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:12.960793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48600a-17e6-4494-8d6f-4c2e3faeb6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:12.961084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48600a-17e6-4494-8d6f-4c2e3faeb6a9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:12.961784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10586a-d57b-4d65-ad27-12c73122381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:12.962461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10586a-d57b-4d65-ad27-12c73122381b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:12.962743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10586a-d57b-4d65-ad27-12c73122381b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:12.963017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10586a-d57b-4d65-ad27-12c73122381b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:12.971545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48600a-17e6-4494-8d6f-4c2e3faeb6a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:12.973174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10586a-d57b-4d65-ad27-12c73122381b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:12.978248 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-9b48600a-17e6-4494-8d6f-4c2e3faeb6a9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:31:12.979392 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 229/466] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:12.980549 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-1f10586a-d57b-4d65-ad27-12c73122381b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:31:12.981800 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 238/467] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:12.985276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48600a-17e6-4494-8d6f-4c2e3faeb6a9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:12.987403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10586a-d57b-4d65-ad27-12c73122381b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:12.994382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48600a-17e6-4494-8d6f-4c2e3faeb6a9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:12.996456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10586a-d57b-4d65-ad27-12c73122381b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:12.998561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef011ee2-5873-4cb2-8b60-a767fffb873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:12.999454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011ee2-5873-4cb2-8b60-a767fffb873f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:12.999739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011ee2-5873-4cb2-8b60-a767fffb873f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:13.000006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011ee2-5873-4cb2-8b60-a767fffb873f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:13.000742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef011ee2-5873-4cb2-8b60-a767fffb873f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:13.001038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed727597-34e1-40d4-be55-aa6e6e0975d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:13.001145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef011ee2-5873-4cb2-8b60-a767fffb873f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:13.001643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727597-34e1-40d4-be55-aa6e6e0975d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:13.001926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727597-34e1-40d4-be55-aa6e6e0975d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:13.002204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727597-34e1-40d4-be55-aa6e6e0975d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:13.002599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef011ee2-5873-4cb2-8b60-a767fffb873f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:13.002944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed727597-34e1-40d4-be55-aa6e6e0975d6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:13.003277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed727597-34e1-40d4-be55-aa6e6e0975d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:13.004841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed727597-34e1-40d4-be55-aa6e6e0975d6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:13.011934 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 230/468] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:13.015287 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 239/469] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:13.017732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef011ee2-5873-4cb2-8b60-a767fffb873f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:13.019891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed727597-34e1-40d4-be55-aa6e6e0975d6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:13.027747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef011ee2-5873-4cb2-8b60-a767fffb873f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:13.029611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed727597-34e1-40d4-be55-aa6e6e0975d6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:13.032036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356513b8-2dde-4d9f-a886-462d3f9cc8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:13.032657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356513b8-2dde-4d9f-a886-462d3f9cc8ed admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:13.032943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356513b8-2dde-4d9f-a886-462d3f9cc8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:13.033220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356513b8-2dde-4d9f-a886-462d3f9cc8ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:13.033935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0307c7-07e8-4a2d-9d21-9ad9cf83423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:13.034548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0307c7-07e8-4a2d-9d21-9ad9cf83423d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:13.034839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0307c7-07e8-4a2d-9d21-9ad9cf83423d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:13.035114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0307c7-07e8-4a2d-9d21-9ad9cf83423d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:13.040875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356513b8-2dde-4d9f-a886-462d3f9cc8ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:13.042606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356513b8-2dde-4d9f-a886-462d3f9cc8ed admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:13.042710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0307c7-07e8-4a2d-9d21-9ad9cf83423d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:13.044354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0307c7-07e8-4a2d-9d21-9ad9cf83423d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:13.051161 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 231/470] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:13.052951 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 240/471] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:31:13.057082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356513b8-2dde-4d9f-a886-462d3f9cc8ed admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:13.058298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0307c7-07e8-4a2d-9d21-9ad9cf83423d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:13.065392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356513b8-2dde-4d9f-a886-462d3f9cc8ed admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:13.066626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0307c7-07e8-4a2d-9d21-9ad9cf83423d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:13.069788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d579e-4f23-4da2-a5e1-212765796368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:13.071120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d579e-4f23-4da2-a5e1-212765796368 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:13.071354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b79182-12d7-4130-80f5-ec82ab58eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:13.071462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d579e-4f23-4da2-a5e1-212765796368 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:13.071696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d579e-4f23-4da2-a5e1-212765796368 admin admin] PATH_INFO: `/v3/projects/bb5d1bf085ae456f8f7285f5a202640b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:13.072147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b79182-12d7-4130-80f5-ec82ab58eed0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:13.072424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b79182-12d7-4130-80f5-ec82ab58eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:13.072694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b79182-12d7-4130-80f5-ec82ab58eed0 admin admin] PATH_INFO: `/v3/projects/8d57f777fe5147a9a30ce29df70e5d45` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:13.072894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d579e-4f23-4da2-a5e1-212765796368 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb5d1bf085ae456f8f7285f5a202640b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:13.073834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b79182-12d7-4130-80f5-ec82ab58eed0 admin admin] RBAC: Authorizing `identity:get_project(project_id=8d57f777fe5147a9a30ce29df70e5d45)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:13.074626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d579e-4f23-4da2-a5e1-212765796368 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:13.075923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b79182-12d7-4130-80f5-ec82ab58eed0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:13.076247 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 232/472] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:13 2021] GET /identity/v3/projects/bb5d1bf085ae456f8f7285f5a202640b => generated 344 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:13.077595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 241/473] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:31:13 2021] GET /identity/v3/projects/8d57f777fe5147a9a30ce29df70e5d45 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:13.081887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d579e-4f23-4da2-a5e1-212765796368 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:13.082726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b79182-12d7-4130-80f5-ec82ab58eed0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:13.091631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d579e-4f23-4da2-a5e1-212765796368 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:13.092920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b79182-12d7-4130-80f5-ec82ab58eed0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:13.095902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0d7c6-4e3a-43a4-85b6-1984fb26814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:13.096683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0d7c6-4e3a-43a4-85b6-1984fb26814b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:13.096965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0d7c6-4e3a-43a4-85b6-1984fb26814b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:13.097232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0d7c6-4e3a-43a4-85b6-1984fb26814b admin admin] PATH_INFO: `/v3/groups/02439c93963d47448b5dcb1073f5142e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:13.097474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4377-df6b-4ad2-83cd-3737a91c7edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:13.098255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4377-df6b-4ad2-83cd-3737a91c7edb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:13.098367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0d7c6-4e3a-43a4-85b6-1984fb26814b admin admin] RBAC: Authorizing `identity:get_group(group_id=02439c93963d47448b5dcb1073f5142e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:13.098533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4377-df6b-4ad2-83cd-3737a91c7edb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:13.098801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de4377-df6b-4ad2-83cd-3737a91c7edb admin admin] PATH_INFO: `/v3/groups/44beaa9009304c22bfb50f12df57b694` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:13.099954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de4377-df6b-4ad2-83cd-3737a91c7edb admin admin] RBAC: Authorizing `identity:get_group(group_id=44beaa9009304c22bfb50f12df57b694)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:13.100231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0d7c6-4e3a-43a4-85b6-1984fb26814b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:13.101932 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 233/474] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:13 2021] GET /identity/v3/groups/02439c93963d47448b5dcb1073f5142e => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:13.102048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de4377-df6b-4ad2-83cd-3737a91c7edb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:13.103529 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 242/475] 10.222.0.21 () {56 vars in 1201 bytes} [Sat Nov 27 20:31:13 2021] GET /identity/v3/groups/44beaa9009304c22bfb50f12df57b694 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:13.107588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0d7c6-4e3a-43a4-85b6-1984fb26814b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:13.109218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4377-df6b-4ad2-83cd-3737a91c7edb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:13.116650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0d7c6-4e3a-43a4-85b6-1984fb26814b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:13.118294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de4377-df6b-4ad2-83cd-3737a91c7edb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:13.120887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864a0d4-5aab-47ef-96e7-ef0440a45684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:13.121480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864a0d4-5aab-47ef-96e7-ef0440a45684 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:13.121758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864a0d4-5aab-47ef-96e7-ef0440a45684 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:13.122032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864a0d4-5aab-47ef-96e7-ef0440a45684 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:13.122540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302696ae-bdf3-407c-b433-020ff3c2d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:13.122842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864a0d4-5aab-47ef-96e7-ef0440a45684 admin admin] RBAC: Adding query filter params (group.id=02439c93963d47448b5dcb1073f5142e, role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=bb5d1bf085ae456f8f7285f5a202640b) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:13.123129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302696ae-bdf3-407c-b433-020ff3c2d4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:13.123238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864a0d4-5aab-47ef-96e7-ef0440a45684 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:13.123446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302696ae-bdf3-407c-b433-020ff3c2d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:13.123720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302696ae-bdf3-407c-b433-020ff3c2d4d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:13.124807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302696ae-bdf3-407c-b433-020ff3c2d4d2 admin admin] RBAC: Adding query filter params (group.id=44beaa9009304c22bfb50f12df57b694, role.id=9a635e239d2c4df7972fb54b7ed42aa6, scope.project.id=8d57f777fe5147a9a30ce29df70e5d45) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:13.125117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302696ae-bdf3-407c-b433-020ff3c2d4d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:13.125219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864a0d4-5aab-47ef-96e7-ef0440a45684 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:13.126883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302696ae-bdf3-407c-b433-020ff3c2d4d2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:13.130752 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 234/476] 10.222.0.21 () {56 vars in 1397 bytes} [Sat Nov 27 20:31:13 2021] GET /identity/v3/role_assignments?group.id=02439c93963d47448b5dcb1073f5142e&scope.project.id=bb5d1bf085ae456f8f7285f5a202640b&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:13.132881 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 243/477] 10.222.0.21 () {56 vars in 1397 bytes} [Sat Nov 27 20:31:13 2021] GET /identity/v3/role_assignments?group.id=44beaa9009304c22bfb50f12df57b694&scope.project.id=8d57f777fe5147a9a30ce29df70e5d45&role.id=9a635e239d2c4df7972fb54b7ed42aa6 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:16.134244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1632c6-59b1-473f-9393-5c0ed7c09332 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.134804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1632c6-59b1-473f-9393-5c0ed7c09332 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.134804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1632c6-59b1-473f-9393-5c0ed7c09332 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.136593 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 235/478] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:16.142417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc474d5-50bd-428e-a5f0-9d98ff7b971b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.142808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc474d5-50bd-428e-a5f0-9d98ff7b971b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.142988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc474d5-50bd-428e-a5f0-9d98ff7b971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.165449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2bc474d5-50bd-428e-a5f0-9d98ff7b971b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:16.166620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2bc474d5-50bd-428e-a5f0-9d98ff7b971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:16.178254 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 244/479] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:16.221748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1632c6-59b1-473f-9393-5c0ed7c09332 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:16.236863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1632c6-59b1-473f-9393-5c0ed7c09332 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:16.241501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c67e50-f938-401c-8bda-7cbe541d0a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:16.242347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c67e50-f938-401c-8bda-7cbe541d0a62 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.242624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c67e50-f938-401c-8bda-7cbe541d0a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.242898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c67e50-f938-401c-8bda-7cbe541d0a62 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.258814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c67e50-f938-401c-8bda-7cbe541d0a62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:16.260677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c67e50-f938-401c-8bda-7cbe541d0a62 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:16.281168 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-a1c67e50-f938-401c-8bda-7cbe541d0a62 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:16.282331 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 236/480] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:16.288679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc474d5-50bd-428e-a5f0-9d98ff7b971b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:16.297671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc474d5-50bd-428e-a5f0-9d98ff7b971b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:16.307841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874431c-c614-4e30-b001-abf56bcebe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:16.308491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874431c-c614-4e30-b001-abf56bcebe8e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.308769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874431c-c614-4e30-b001-abf56bcebe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.309036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874431c-c614-4e30-b001-abf56bcebe8e admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.309774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874431c-c614-4e30-b001-abf56bcebe8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:16.310074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874431c-c614-4e30-b001-abf56bcebe8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:16.311073 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-4874431c-c614-4e30-b001-abf56bcebe8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:16.311073 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:31:16.311073 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:31:16.311999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874431c-c614-4e30-b001-abf56bcebe8e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:16.334033 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 245/481] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:16.340568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c67e50-f938-401c-8bda-7cbe541d0a62 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:16.356288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c67e50-f938-401c-8bda-7cbe541d0a62 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:16.361919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eadc29-0f93-4d97-a394-36470312a9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:16.362585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eadc29-0f93-4d97-a394-36470312a9fa admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.362862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eadc29-0f93-4d97-a394-36470312a9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.363180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eadc29-0f93-4d97-a394-36470312a9fa admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.363935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eadc29-0f93-4d97-a394-36470312a9fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:16.366008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eadc29-0f93-4d97-a394-36470312a9fa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:16.387180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2a294-860c-41cb-a71d-498ef4c784c7 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.387494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2a294-860c-41cb-a71d-498ef4c784c7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.387766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2a294-860c-41cb-a71d-498ef4c784c7 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.389902 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 246/482] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:16.394626 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 237/483] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:31:16 2021] POST /identity/v3/users => generated 246 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:31:16.396484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dedc92-78e1-4bd9-a138-42d22cea686b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.396769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dedc92-78e1-4bd9-a138-42d22cea686b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.397038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dedc92-78e1-4bd9-a138-42d22cea686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.418012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-21dedc92-78e1-4bd9-a138-42d22cea686b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:16.419285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-21dedc92-78e1-4bd9-a138-42d22cea686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:16.427566 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 247/484] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:16.455209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eadc29-0f93-4d97-a394-36470312a9fa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:16.468169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d73b9d-73cb-49be-89ca-2f5bfb070165 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.468824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d73b9d-73cb-49be-89ca-2f5bfb070165 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.469048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eadc29-0f93-4d97-a394-36470312a9fa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:16.469508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d73b9d-73cb-49be-89ca-2f5bfb070165 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.472002 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 248/485] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:16.479843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092542-8ddb-47c4-ae9d-c9a607a47dfe None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.480521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092542-8ddb-47c4-ae9d-c9a607a47dfe None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.480990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092542-8ddb-47c4-ae9d-c9a607a47dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.484096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20428ac-a15a-431a-8520-598377a5c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:16.484924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20428ac-a15a-431a-8520-598377a5c6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.485200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20428ac-a15a-431a-8520-598377a5c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.485466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20428ac-a15a-431a-8520-598377a5c6f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.501741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-88092542-8ddb-47c4-ae9d-c9a607a47dfe None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:16.503391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-88092542-8ddb-47c4-ae9d-c9a607a47dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:16.504380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20428ac-a15a-431a-8520-598377a5c6f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:16.506319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20428ac-a15a-431a-8520-598377a5c6f2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:16.512816 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 249/486] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:16.535701 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d20428ac-a15a-431a-8520-598377a5c6f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:16.537282 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 238/487] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:16.548928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88092542-8ddb-47c4-ae9d-c9a607a47dfe None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:16.568165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20428ac-a15a-431a-8520-598377a5c6f2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:16.569067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88092542-8ddb-47c4-ae9d-c9a607a47dfe None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:16.574150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d2c31-6b35-4e33-80a8-48a6fc5ac8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:16.575150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d2c31-6b35-4e33-80a8-48a6fc5ac8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.575693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d2c31-6b35-4e33-80a8-48a6fc5ac8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.576163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d2c31-6b35-4e33-80a8-48a6fc5ac8c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.577139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d2c31-6b35-4e33-80a8-48a6fc5ac8c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:16.577648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d2c31-6b35-4e33-80a8-48a6fc5ac8c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:16.579479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d2c31-6b35-4e33-80a8-48a6fc5ac8c5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:16.584530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20428ac-a15a-431a-8520-598377a5c6f2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:16.593386 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 250/488] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:16.600225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d2c31-6b35-4e33-80a8-48a6fc5ac8c5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:16.604078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94793d3d-ac61-4e5c-bc16-1dbaffcefa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:16.604904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94793d3d-ac61-4e5c-bc16-1dbaffcefa6e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.605176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94793d3d-ac61-4e5c-bc16-1dbaffcefa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.605449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94793d3d-ac61-4e5c-bc16-1dbaffcefa6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.612738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d2c31-6b35-4e33-80a8-48a6fc5ac8c5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:16.618915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c1198-b26e-40f6-b4fb-4c704edb6c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:16.619942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c1198-b26e-40f6-b4fb-4c704edb6c0a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.620468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c1198-b26e-40f6-b4fb-4c704edb6c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.621622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c1198-b26e-40f6-b4fb-4c704edb6c0a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.623009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c1198-b26e-40f6-b4fb-4c704edb6c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:16.625564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c1198-b26e-40f6-b4fb-4c704edb6c0a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:16.628576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94793d3d-ac61-4e5c-bc16-1dbaffcefa6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:16.630469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94793d3d-ac61-4e5c-bc16-1dbaffcefa6e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:16.654208 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-94793d3d-ac61-4e5c-bc16-1dbaffcefa6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:16.655075 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 251/489] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:31:16 2021] POST /identity/v3/users => generated 248 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:31:16.655720 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 239/490] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:16.662678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94793d3d-ac61-4e5c-bc16-1dbaffcefa6e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:16.674661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94793d3d-ac61-4e5c-bc16-1dbaffcefa6e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:16.686132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f984b-1feb-44fe-82c8-248f8de18564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:16.687087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f984b-1feb-44fe-82c8-248f8de18564 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.687547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f984b-1feb-44fe-82c8-248f8de18564 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.687958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f984b-1feb-44fe-82c8-248f8de18564 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.688868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f984b-1feb-44fe-82c8-248f8de18564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:16.689318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f984b-1feb-44fe-82c8-248f8de18564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:16.691223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f984b-1feb-44fe-82c8-248f8de18564 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:16.707008 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 240/491] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:16.712885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c1198-b26e-40f6-b4fb-4c704edb6c0a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:16.724378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c1198-b26e-40f6-b4fb-4c704edb6c0a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:16.730213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51156f00-1f4b-49aa-8f94-ce3f6bf53e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:16.731285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156f00-1f4b-49aa-8f94-ce3f6bf53e1f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:16.731755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156f00-1f4b-49aa-8f94-ce3f6bf53e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:16.732169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156f00-1f4b-49aa-8f94-ce3f6bf53e1f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:16.733120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51156f00-1f4b-49aa-8f94-ce3f6bf53e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:16.735355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51156f00-1f4b-49aa-8f94-ce3f6bf53e1f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:16.761913 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 252/492] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:31:16 2021] POST /identity/v3/users => generated 248 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:31:17.364356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f96d6d-6238-4f6d-989f-a55c156cbabd None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:17.364885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f96d6d-6238-4f6d-989f-a55c156cbabd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:17.364885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f96d6d-6238-4f6d-989f-a55c156cbabd None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:17.366998 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 241/493] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:17.373759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ef94e-ac66-4000-8927-db024932fcd1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:17.374539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ef94e-ac66-4000-8927-db024932fcd1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:17.374630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ef94e-ac66-4000-8927-db024932fcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:17.400333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-690ef94e-ac66-4000-8927-db024932fcd1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:17.401574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-690ef94e-ac66-4000-8927-db024932fcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:17.409717 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 253/494] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:17.443096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f96d6d-6238-4f6d-989f-a55c156cbabd None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:17.461184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f96d6d-6238-4f6d-989f-a55c156cbabd None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:17.470814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88cc07-b20a-4657-aa3b-1d39a6852800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:17.471621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88cc07-b20a-4657-aa3b-1d39a6852800 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:17.471904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88cc07-b20a-4657-aa3b-1d39a6852800 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:17.472181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88cc07-b20a-4657-aa3b-1d39a6852800 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:17.488093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88cc07-b20a-4657-aa3b-1d39a6852800 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:17.489938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88cc07-b20a-4657-aa3b-1d39a6852800 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:17.511375 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-8a88cc07-b20a-4657-aa3b-1d39a6852800 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:17.512774 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 242/495] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:17.518813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ef94e-ac66-4000-8927-db024932fcd1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:17.533586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ef94e-ac66-4000-8927-db024932fcd1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:17.543857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358f0bd-467c-4608-83b9-9af1a6190b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:17.544510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358f0bd-467c-4608-83b9-9af1a6190b3d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:17.544789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358f0bd-467c-4608-83b9-9af1a6190b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:17.545063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358f0bd-467c-4608-83b9-9af1a6190b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:17.545799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358f0bd-467c-4608-83b9-9af1a6190b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:17.546101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358f0bd-467c-4608-83b9-9af1a6190b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:17.547706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358f0bd-467c-4608-83b9-9af1a6190b3d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:17.559687 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 254/496] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:17.565410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88cc07-b20a-4657-aa3b-1d39a6852800 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:17.580410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88cc07-b20a-4657-aa3b-1d39a6852800 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:17.591201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cff2d-c341-490b-903e-f1e3ee588385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:17.591897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cff2d-c341-490b-903e-f1e3ee588385 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:17.592180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cff2d-c341-490b-903e-f1e3ee588385 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:17.592455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cff2d-c341-490b-903e-f1e3ee588385 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:17.593185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cff2d-c341-490b-903e-f1e3ee588385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:17.595112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cff2d-c341-490b-903e-f1e3ee588385 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:17.630545 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 243/497] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:31:17 2021] POST /identity/v3/users => generated 249 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:31:17.855281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d103a0c-4bec-4649-96a2-7873e4037b62 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:17.855679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d103a0c-4bec-4649-96a2-7873e4037b62 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:17.855849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d103a0c-4bec-4649-96a2-7873e4037b62 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:17.857910 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 255/498] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:17.864530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb572a-f04c-4ec8-aeb4-85cd5ac8fae0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:17.864827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb572a-f04c-4ec8-aeb4-85cd5ac8fae0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:17.865075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb572a-f04c-4ec8-aeb4-85cd5ac8fae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:17.888257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-72cb572a-f04c-4ec8-aeb4-85cd5ac8fae0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:17.889390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-72cb572a-f04c-4ec8-aeb4-85cd5ac8fae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:17.902545 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 244/499] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:17.933142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d103a0c-4bec-4649-96a2-7873e4037b62 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:17.949410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d103a0c-4bec-4649-96a2-7873e4037b62 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:17.953733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4330fd-99c8-476a-8dc8-bc34b249a58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:17.954386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4330fd-99c8-476a-8dc8-bc34b249a58f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:17.954672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4330fd-99c8-476a-8dc8-bc34b249a58f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:17.954945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4330fd-99c8-476a-8dc8-bc34b249a58f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:17.955745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4330fd-99c8-476a-8dc8-bc34b249a58f admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:17.956753 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-0c4330fd-99c8-476a-8dc8-bc34b249a58f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:17.956753 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:31:17.956753 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:31:17.957627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4330fd-99c8-476a-8dc8-bc34b249a58f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:17.967173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.sql.core [None req-0c4330fd-99c8-476a-8dc8-bc34b249a58f admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 27 20:31:17.967173 ncdv-master-1 devstack@keystone.service[90123]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 27 20:31:17.967173 ncdv-master-1 devstack@keystone.service[90123]: [parameters: {'id': '6eb94fbbb6f44a1898a658705288ec8a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 27 20:31:17.967173 ncdv-master-1 devstack@keystone.service[90123]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90123) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 27 20:31:17.982898 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-0c4330fd-99c8-476a-8dc8-bc34b249a58f admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 27 20:31:17.984720 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 256/500] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:31:17 2021] POST /identity/v3/roles => generated 144 bytes in 52 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:17.995289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb572a-f04c-4ec8-aeb4-85cd5ac8fae0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:18.009759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb572a-f04c-4ec8-aeb4-85cd5ac8fae0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:18.023483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4e900-6f10-4d0a-9974-8f28f31bb8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:18.024534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e900-6f10-4d0a-9974-8f28f31bb8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:18.024993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e900-6f10-4d0a-9974-8f28f31bb8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:18.025413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4e900-6f10-4d0a-9974-8f28f31bb8a0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:18.037383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4e900-6f10-4d0a-9974-8f28f31bb8a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:18.045045 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-7ee4e900-6f10-4d0a-9974-8f28f31bb8a0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 27 20:31:18.051404 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 245/501] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:18.053149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4330fd-99c8-476a-8dc8-bc34b249a58f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:18.064002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4330fd-99c8-476a-8dc8-bc34b249a58f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:18.068768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76005486-9395-4f18-85bb-f5a38ec9b8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:18.069610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76005486-9395-4f18-85bb-f5a38ec9b8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:18.070040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76005486-9395-4f18-85bb-f5a38ec9b8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:18.071059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76005486-9395-4f18-85bb-f5a38ec9b8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:18.071998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76005486-9395-4f18-85bb-f5a38ec9b8d7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:18.072451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76005486-9395-4f18-85bb-f5a38ec9b8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:18.074200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76005486-9395-4f18-85bb-f5a38ec9b8d7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:18.087386 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 257/502] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:19.617548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778b817-00b1-46a7-ae3a-108f5d1edd1f None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.618509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778b817-00b1-46a7-ae3a-108f5d1edd1f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.619036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778b817-00b1-46a7-ae3a-108f5d1edd1f None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.621621 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 246/503] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:19.630013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856975c-6624-466a-ae4a-263c17182f56 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.630993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856975c-6624-466a-ae4a-263c17182f56 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.631513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856975c-6624-466a-ae4a-263c17182f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.660426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2856975c-6624-466a-ae4a-263c17182f56 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:19.661987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2856975c-6624-466a-ae4a-263c17182f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:19.670846 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 258/504] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:19.671416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed951e9-1e0e-4595-a714-8bcbf631f2d7 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.671945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed951e9-1e0e-4595-a714-8bcbf631f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.672417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed951e9-1e0e-4595-a714-8bcbf631f2d7 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.674621 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 247/505] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:31:19.680409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ec7e-5baf-4108-89dd-930024a5774b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.680701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ec7e-5baf-4108-89dd-930024a5774b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.680981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ec7e-5baf-4108-89dd-930024a5774b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.699129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-10c6ec7e-5baf-4108-89dd-930024a5774b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:19.700265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-10c6ec7e-5baf-4108-89dd-930024a5774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:19.708217 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 259/506] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:19.713234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed951e9-1e0e-4595-a714-8bcbf631f2d7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:19.735554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed951e9-1e0e-4595-a714-8bcbf631f2d7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:19.742748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfee2d-26de-4e2f-8e19-959892daa0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:19.743816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfee2d-26de-4e2f-8e19-959892daa0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.744330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfee2d-26de-4e2f-8e19-959892daa0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.744810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfee2d-26de-4e2f-8e19-959892daa0b5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.756325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfee2d-26de-4e2f-8e19-959892daa0b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:19.760130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6ec7e-5baf-4108-89dd-930024a5774b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:19.764337 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d0dfee2d-26de-4e2f-8e19-959892daa0b5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:19.765787 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 248/507] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:19.771896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfee2d-26de-4e2f-8e19-959892daa0b5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:19.774352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6ec7e-5baf-4108-89dd-930024a5774b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:19.782958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfee2d-26de-4e2f-8e19-959892daa0b5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:19.787588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f822-2360-4ed9-b5ba-dfb207d90b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:19.788450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba60e9f-0fb9-4a96-af15-ed0cddaf6571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:19.788766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f822-2360-4ed9-b5ba-dfb207d90b49 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.789252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f822-2360-4ed9-b5ba-dfb207d90b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.789412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba60e9f-0fb9-4a96-af15-ed0cddaf6571 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.789829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f822-2360-4ed9-b5ba-dfb207d90b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.789935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba60e9f-0fb9-4a96-af15-ed0cddaf6571 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.790118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba60e9f-0fb9-4a96-af15-ed0cddaf6571 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.791145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022f822-2360-4ed9-b5ba-dfb207d90b49 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:19.791681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022f822-2360-4ed9-b5ba-dfb207d90b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:19.793465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022f822-2360-4ed9-b5ba-dfb207d90b49 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:19.803045 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 249/508] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:19.808481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f822-2360-4ed9-b5ba-dfb207d90b49 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:19.817274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba60e9f-0fb9-4a96-af15-ed0cddaf6571 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:19.829531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f822-2360-4ed9-b5ba-dfb207d90b49 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:19.830912 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-cba60e9f-0fb9-4a96-af15-ed0cddaf6571 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:19.835192 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 260/509] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:19.837141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df5c3d-361a-4954-9d89-c9d95e3297cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:19.838159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df5c3d-361a-4954-9d89-c9d95e3297cb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.838654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df5c3d-361a-4954-9d89-c9d95e3297cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.839202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df5c3d-361a-4954-9d89-c9d95e3297cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.840205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba60e9f-0fb9-4a96-af15-ed0cddaf6571 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:19.851863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df5c3d-361a-4954-9d89-c9d95e3297cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:19.854126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df5c3d-361a-4954-9d89-c9d95e3297cb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:19.857640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba60e9f-0fb9-4a96-af15-ed0cddaf6571 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:19.872204 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-c1df5c3d-361a-4954-9d89-c9d95e3297cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:19.872866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f4b2e-4f68-4e7a-8327-aae12fda4427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:19.873533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4b2e-4f68-4e7a-8327-aae12fda4427 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.873816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4b2e-4f68-4e7a-8327-aae12fda4427 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.874351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f4b2e-4f68-4e7a-8327-aae12fda4427 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.875121 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 250/510] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:19.875225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f4b2e-4f68-4e7a-8327-aae12fda4427 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:19.875510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f4b2e-4f68-4e7a-8327-aae12fda4427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:19.877179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f4b2e-4f68-4e7a-8327-aae12fda4427 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:19.881300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df5c3d-361a-4954-9d89-c9d95e3297cb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:19.888708 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 261/511] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:19.899913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f4b2e-4f68-4e7a-8327-aae12fda4427 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:19.902129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df5c3d-361a-4954-9d89-c9d95e3297cb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:19.911493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f4b2e-4f68-4e7a-8327-aae12fda4427 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:19.913348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aea57d-4485-4494-848c-72b8b829a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:19.915612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aea57d-4485-4494-848c-72b8b829a2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.916691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aea57d-4485-4494-848c-72b8b829a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.917172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aea57d-4485-4494-848c-72b8b829a2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.918626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aea57d-4485-4494-848c-72b8b829a2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:19.920017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aea57d-4485-4494-848c-72b8b829a2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:19.922979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac8f86-a282-4dd0-a40e-2c8496c9c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:19.924017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8f86-a282-4dd0-a40e-2c8496c9c0fe admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.924330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aea57d-4485-4494-848c-72b8b829a2f2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:19.925808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8f86-a282-4dd0-a40e-2c8496c9c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.926364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac8f86-a282-4dd0-a40e-2c8496c9c0fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.947396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac8f86-a282-4dd0-a40e-2c8496c9c0fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:19.949535 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 251/512] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:19.953245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac8f86-a282-4dd0-a40e-2c8496c9c0fe admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:19.960282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aea57d-4485-4494-848c-72b8b829a2f2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:19.972905 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-57ac8f86-a282-4dd0-a40e-2c8496c9c0fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:19.974461 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 262/513] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:19.975974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aea57d-4485-4494-848c-72b8b829a2f2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:19.981222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac8f86-a282-4dd0-a40e-2c8496c9c0fe admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:19.985994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e6e6-b62b-49b4-8d3b-857db5424b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:19.987112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e6e6-b62b-49b4-8d3b-857db5424b13 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:19.987656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e6e6-b62b-49b4-8d3b-857db5424b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:19.988129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e6e6-b62b-49b4-8d3b-857db5424b13 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:19.995279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac8f86-a282-4dd0-a40e-2c8496c9c0fe admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.002555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009e6e6-b62b-49b4-8d3b-857db5424b13 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.004829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009e6e6-b62b-49b4-8d3b-857db5424b13 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.005426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff176e-29c1-4f1a-84c7-230060e7903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.006199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff176e-29c1-4f1a-84c7-230060e7903d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.006562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff176e-29c1-4f1a-84c7-230060e7903d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.006928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff176e-29c1-4f1a-84c7-230060e7903d admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.008344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff176e-29c1-4f1a-84c7-230060e7903d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.008977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff176e-29c1-4f1a-84c7-230060e7903d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.011923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff176e-29c1-4f1a-84c7-230060e7903d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.021368 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-f009e6e6-b62b-49b4-8d3b-857db5424b13 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 27 20:31:20.023688 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 252/514] 10.222.0.21 () {56 vars in 1114 bytes} [Sat Nov 27 20:31:19 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:20.024926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f43c19-57b5-4838-8bd8-1978fb2191fa None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.025211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f43c19-57b5-4838-8bd8-1978fb2191fa None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.025636 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 263/515] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:20.027475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f43c19-57b5-4838-8bd8-1978fb2191fa None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.029417 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 253/516] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:20.034875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff176e-29c1-4f1a-84c7-230060e7903d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.036050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f43c19-57b5-4838-8bd8-1978fb2191fa None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.047605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff176e-29c1-4f1a-84c7-230060e7903d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.052086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a841b6b-ff4f-455f-bf4c-9da41b813954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.052744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a841b6b-ff4f-455f-bf4c-9da41b813954 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.053032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a841b6b-ff4f-455f-bf4c-9da41b813954 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.053311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a841b6b-ff4f-455f-bf4c-9da41b813954 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.055058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a841b6b-ff4f-455f-bf4c-9da41b813954 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.055058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a841b6b-ff4f-455f-bf4c-9da41b813954 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.056027 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-2a841b6b-ff4f-455f-bf4c-9da41b813954 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:20.056027 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:31:20.056027 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:31:20.057171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a841b6b-ff4f-455f-bf4c-9da41b813954 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.060448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f43c19-57b5-4838-8bd8-1978fb2191fa None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.065340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525388eb-d0b2-40ac-a8d8-33bf1ba8bd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.066380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525388eb-d0b2-40ac-a8d8-33bf1ba8bd9a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.066939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525388eb-d0b2-40ac-a8d8-33bf1ba8bd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.067445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525388eb-d0b2-40ac-a8d8-33bf1ba8bd9a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.076921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525388eb-d0b2-40ac-a8d8-33bf1ba8bd9a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.079221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525388eb-d0b2-40ac-a8d8-33bf1ba8bd9a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.094890 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-525388eb-d0b2-40ac-a8d8-33bf1ba8bd9a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 27 20:31:20.101337 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 254/517] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/users/cinder => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:20.101337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdf874-f1e8-4bd6-a3cb-18f5505648bd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.101337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdf874-f1e8-4bd6-a3cb-18f5505648bd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.101337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdf874-f1e8-4bd6-a3cb-18f5505648bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.103758 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 264/518] 10.222.0.21 () {56 vars in 1154 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.104825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a841b6b-ff4f-455f-bf4c-9da41b813954 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.119102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a841b6b-ff4f-455f-bf4c-9da41b813954 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.122871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6afdf874-f1e8-4bd6-a3cb-18f5505648bd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:20.124343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c0a41-a200-419a-b59d-d3e64ee28dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.124575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6afdf874-f1e8-4bd6-a3cb-18f5505648bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:20.125346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c0a41-a200-419a-b59d-d3e64ee28dea admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.125888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c0a41-a200-419a-b59d-d3e64ee28dea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.126311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c0a41-a200-419a-b59d-d3e64ee28dea admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.127571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c0a41-a200-419a-b59d-d3e64ee28dea admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.128122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c0a41-a200-419a-b59d-d3e64ee28dea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.130564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c0a41-a200-419a-b59d-d3e64ee28dea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.133636 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 255/519] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:20.134690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdf874-f1e8-4bd6-a3cb-18f5505648bd None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.144387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdf874-f1e8-4bd6-a3cb-18f5505648bd None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.150108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964980df-a485-47a1-a95b-d1c0bbc620be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.150916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964980df-a485-47a1-a95b-d1c0bbc620be admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.151334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964980df-a485-47a1-a95b-d1c0bbc620be admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.151753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964980df-a485-47a1-a95b-d1c0bbc620be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.153150 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 265/520] 10.222.0.21 () {56 vars in 1158 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.159836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c0a41-a200-419a-b59d-d3e64ee28dea admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.171338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964980df-a485-47a1-a95b-d1c0bbc620be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.173366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964980df-a485-47a1-a95b-d1c0bbc620be admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.180987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c0a41-a200-419a-b59d-d3e64ee28dea admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.184061 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 256/521] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:20.187440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964980df-a485-47a1-a95b-d1c0bbc620be admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.192507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8457b7-5d32-4b54-9291-d88bf503033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.193228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8457b7-5d32-4b54-9291-d88bf503033e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.193516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8457b7-5d32-4b54-9291-d88bf503033e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.193854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8457b7-5d32-4b54-9291-d88bf503033e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.202921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8457b7-5d32-4b54-9291-d88bf503033e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.203612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964980df-a485-47a1-a95b-d1c0bbc620be admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.205328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8457b7-5d32-4b54-9291-d88bf503033e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.208507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0d485-ca1c-443f-bbee-95402e97224a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.209335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0d485-ca1c-443f-bbee-95402e97224a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.209621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0d485-ca1c-443f-bbee-95402e97224a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.209897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0d485-ca1c-443f-bbee-95402e97224a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.216091 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 266/522] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:31:20.217117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8457b7-5d32-4b54-9291-d88bf503033e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.226309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0d485-ca1c-443f-bbee-95402e97224a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:20.227008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8457b7-5d32-4b54-9291-d88bf503033e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.231845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe028d7-0966-44ba-986b-cec5e51297b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.232844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe028d7-0966-44ba-986b-cec5e51297b2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.233328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe028d7-0966-44ba-986b-cec5e51297b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.233817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe028d7-0966-44ba-986b-cec5e51297b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.234615 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-cdd0d485-ca1c-443f-bbee-95402e97224a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:20.241162 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 257/523] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:20.241162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0d485-ca1c-443f-bbee-95402e97224a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.247065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0d485-ca1c-443f-bbee-95402e97224a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.251930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db676f-285e-4abb-aadc-f187a2ba0cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.252673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe028d7-0966-44ba-986b-cec5e51297b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.252786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db676f-285e-4abb-aadc-f187a2ba0cff admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.252963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db676f-285e-4abb-aadc-f187a2ba0cff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.253227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db676f-285e-4abb-aadc-f187a2ba0cff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.255412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe028d7-0966-44ba-986b-cec5e51297b2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.264888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db676f-285e-4abb-aadc-f187a2ba0cff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.266761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db676f-285e-4abb-aadc-f187a2ba0cff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.276843 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-5fe028d7-0966-44ba-986b-cec5e51297b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:20.278612 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 267/524] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:20.279608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe028d7-0966-44ba-986b-cec5e51297b2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.291628 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-f0db676f-285e-4abb-aadc-f187a2ba0cff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:20.292887 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 258/525] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:20.293664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db676f-285e-4abb-aadc-f187a2ba0cff admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.294086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe028d7-0966-44ba-986b-cec5e51297b2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.302877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb5ea5-531d-43c4-a870-4a44098872a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.303872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb5ea5-531d-43c4-a870-4a44098872a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.304977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb5ea5-531d-43c4-a870-4a44098872a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.305456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb5ea5-531d-43c4-a870-4a44098872a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.306478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb5ea5-531d-43c4-a870-4a44098872a9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.307036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb5ea5-531d-43c4-a870-4a44098872a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.308970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb5ea5-531d-43c4-a870-4a44098872a9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.309625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db676f-285e-4abb-aadc-f187a2ba0cff admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.314186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacafc5-63e4-4f3f-8d2c-350b9f2bf6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.314837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacafc5-63e4-4f3f-8d2c-350b9f2bf6ee admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.315123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacafc5-63e4-4f3f-8d2c-350b9f2bf6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.315441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacafc5-63e4-4f3f-8d2c-350b9f2bf6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.316567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacafc5-63e4-4f3f-8d2c-350b9f2bf6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.316567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacafc5-63e4-4f3f-8d2c-350b9f2bf6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.318053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacafc5-63e4-4f3f-8d2c-350b9f2bf6ee admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.325771 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 268/526] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.326961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb5ea5-531d-43c4-a870-4a44098872a9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.331668 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 259/527] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.332486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacafc5-63e4-4f3f-8d2c-350b9f2bf6ee admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.338668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb5ea5-531d-43c4-a870-4a44098872a9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.343723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afdec8-6400-4bff-b202-2d6e88d87d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.344987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afdec8-6400-4bff-b202-2d6e88d87d28 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.345507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afdec8-6400-4bff-b202-2d6e88d87d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.346086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afdec8-6400-4bff-b202-2d6e88d87d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.347018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afdec8-6400-4bff-b202-2d6e88d87d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.347607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afdec8-6400-4bff-b202-2d6e88d87d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.347894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacafc5-63e4-4f3f-8d2c-350b9f2bf6ee admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.349807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afdec8-6400-4bff-b202-2d6e88d87d28 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.352454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117e3d-3e96-4dd1-8f9c-a87ec7fba6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.353206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117e3d-3e96-4dd1-8f9c-a87ec7fba6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.353491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117e3d-3e96-4dd1-8f9c-a87ec7fba6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.353762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117e3d-3e96-4dd1-8f9c-a87ec7fba6c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.364493 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 269/528] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.365901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afdec8-6400-4bff-b202-2d6e88d87d28 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.375534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d117e3d-3e96-4dd1-8f9c-a87ec7fba6c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.377532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d117e3d-3e96-4dd1-8f9c-a87ec7fba6c2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.383874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afdec8-6400-4bff-b202-2d6e88d87d28 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.390887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130b54f-06ef-4588-9034-983a7ad20b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.392220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130b54f-06ef-4588-9034-983a7ad20b4b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.392712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130b54f-06ef-4588-9034-983a7ad20b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.393241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130b54f-06ef-4588-9034-983a7ad20b4b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.399438 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-8d117e3d-3e96-4dd1-8f9c-a87ec7fba6c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:20.406512 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 260/529] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:20.406512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117e3d-3e96-4dd1-8f9c-a87ec7fba6c2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.410864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130b54f-06ef-4588-9034-983a7ad20b4b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.411369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117e3d-3e96-4dd1-8f9c-a87ec7fba6c2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.413534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130b54f-06ef-4588-9034-983a7ad20b4b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.416893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14270fcf-fa35-4d35-8f53-d051715284b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.417897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14270fcf-fa35-4d35-8f53-d051715284b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.418009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14270fcf-fa35-4d35-8f53-d051715284b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.418207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14270fcf-fa35-4d35-8f53-d051715284b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.426966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14270fcf-fa35-4d35-8f53-d051715284b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.427418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14270fcf-fa35-4d35-8f53-d051715284b1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.436246 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-5130b54f-06ef-4588-9034-983a7ad20b4b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:20.438056 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 270/530] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:20.439085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130b54f-06ef-4588-9034-983a7ad20b4b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.446617 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-14270fcf-fa35-4d35-8f53-d051715284b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:20.448006 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 261/531] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:20.448629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14270fcf-fa35-4d35-8f53-d051715284b1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.457957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130b54f-06ef-4588-9034-983a7ad20b4b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.464689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d478d9-4e4e-48b3-96c2-ba2b15e5578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.465635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d478d9-4e4e-48b3-96c2-ba2b15e5578e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.466099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14270fcf-fa35-4d35-8f53-d051715284b1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.466385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d478d9-4e4e-48b3-96c2-ba2b15e5578e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.466862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d478d9-4e4e-48b3-96c2-ba2b15e5578e admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.467907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d478d9-4e4e-48b3-96c2-ba2b15e5578e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.468415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d478d9-4e4e-48b3-96c2-ba2b15e5578e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.470367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d478d9-4e4e-48b3-96c2-ba2b15e5578e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.470578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff89c4-24b6-4fb3-a169-0e1d6a81881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.471213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff89c4-24b6-4fb3-a169-0e1d6a81881d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.471535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff89c4-24b6-4fb3-a169-0e1d6a81881d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.471810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff89c4-24b6-4fb3-a169-0e1d6a81881d admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.472596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff89c4-24b6-4fb3-a169-0e1d6a81881d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.472929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff89c4-24b6-4fb3-a169-0e1d6a81881d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.473916 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-70ff89c4-24b6-4fb3-a169-0e1d6a81881d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:20.473916 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:31:20.473916 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:31:20.475277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff89c4-24b6-4fb3-a169-0e1d6a81881d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.485598 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 271/532] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.486777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d478d9-4e4e-48b3-96c2-ba2b15e5578e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.501136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d478d9-4e4e-48b3-96c2-ba2b15e5578e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.503402 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 262/533] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.505015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff89c4-24b6-4fb3-a169-0e1d6a81881d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.511078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad4871-0a25-4fa5-946f-d9498ac99d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.512623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad4871-0a25-4fa5-946f-d9498ac99d6b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.513156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad4871-0a25-4fa5-946f-d9498ac99d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.513913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad4871-0a25-4fa5-946f-d9498ac99d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.515167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad4871-0a25-4fa5-946f-d9498ac99d6b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.515635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff89c4-24b6-4fb3-a169-0e1d6a81881d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.515969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad4871-0a25-4fa5-946f-d9498ac99d6b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.517611 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-acad4871-0a25-4fa5-946f-d9498ac99d6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:20.517611 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:31:20.517611 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:31:20.519599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad4871-0a25-4fa5-946f-d9498ac99d6b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.520443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792cdee-a983-465f-835a-9de435c1aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.521285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792cdee-a983-465f-835a-9de435c1aa61 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.521659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792cdee-a983-465f-835a-9de435c1aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.522075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792cdee-a983-465f-835a-9de435c1aa61 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.530466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792cdee-a983-465f-835a-9de435c1aa61 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.532606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792cdee-a983-465f-835a-9de435c1aa61 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.547554 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 272/534] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.553075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad4871-0a25-4fa5-946f-d9498ac99d6b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.553221 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-2792cdee-a983-465f-835a-9de435c1aa61 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 27 20:31:20.553221 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 263/535] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:20.554525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792cdee-a983-465f-835a-9de435c1aa61 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.569286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad4871-0a25-4fa5-946f-d9498ac99d6b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.572824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792cdee-a983-465f-835a-9de435c1aa61 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.577487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b30ba-a1dd-4f5b-9704-fb788304c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.578137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b30ba-a1dd-4f5b-9704-fb788304c69d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.578421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b30ba-a1dd-4f5b-9704-fb788304c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.578699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b30ba-a1dd-4f5b-9704-fb788304c69d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.579600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b30ba-a1dd-4f5b-9704-fb788304c69d admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=aa3373ab52dc4fe680372579cfcde718) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.579888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b30ba-a1dd-4f5b-9704-fb788304c69d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.580631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dea06d-4d1e-4754-bf32-2ea4bd5ad507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.581604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea06d-4d1e-4754-bf32-2ea4bd5ad507 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.581718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b30ba-a1dd-4f5b-9704-fb788304c69d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.582204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea06d-4d1e-4754-bf32-2ea4bd5ad507 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.582730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dea06d-4d1e-4754-bf32-2ea4bd5ad507 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.584082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dea06d-4d1e-4754-bf32-2ea4bd5ad507 admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=198c9372013440ec942a0192a73a231d) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.585130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dea06d-4d1e-4754-bf32-2ea4bd5ad507 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.593564 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 273/536] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/role_assignments?user.id=aa3373ab52dc4fe680372579cfcde718&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.593564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b30ba-a1dd-4f5b-9704-fb788304c69d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.593829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dea06d-4d1e-4754-bf32-2ea4bd5ad507 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.605535 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 264/537] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/role_assignments?user.id=198c9372013440ec942a0192a73a231d&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:20.607835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b30ba-a1dd-4f5b-9704-fb788304c69d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.612727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e093d12-9a6f-4baa-96fc-49f52459145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.613484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e093d12-9a6f-4baa-96fc-49f52459145f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.613803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e093d12-9a6f-4baa-96fc-49f52459145f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.614082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e093d12-9a6f-4baa-96fc-49f52459145f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.615009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e093d12-9a6f-4baa-96fc-49f52459145f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.615367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e093d12-9a6f-4baa-96fc-49f52459145f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.617516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e093d12-9a6f-4baa-96fc-49f52459145f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.639144 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 274/538] 10.222.0.21 () {56 vars in 1158 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.645725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dea06d-4d1e-4754-bf32-2ea4bd5ad507 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.657200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dea06d-4d1e-4754-bf32-2ea4bd5ad507 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.662186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c60f8-c9e1-4f24-bf4e-593ece6b3cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.662899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c60f8-c9e1-4f24-bf4e-593ece6b3cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.663185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c60f8-c9e1-4f24-bf4e-593ece6b3cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.663497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c60f8-c9e1-4f24-bf4e-593ece6b3cb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.673445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c60f8-c9e1-4f24-bf4e-593ece6b3cb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.675382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c60f8-c9e1-4f24-bf4e-593ece6b3cb7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.690888 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 265/539] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:20.692336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e093d12-9a6f-4baa-96fc-49f52459145f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.705399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e093d12-9a6f-4baa-96fc-49f52459145f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.710172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2434e-a15a-4162-8108-87725aa59049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.711027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2434e-a15a-4162-8108-87725aa59049 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.711406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2434e-a15a-4162-8108-87725aa59049 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.711685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2434e-a15a-4162-8108-87725aa59049 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.728442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2434e-a15a-4162-8108-87725aa59049 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.730466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2434e-a15a-4162-8108-87725aa59049 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.756693 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-8fd2434e-a15a-4162-8108-87725aa59049 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:20.758692 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 275/540] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:20.764900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c60f8-c9e1-4f24-bf4e-593ece6b3cb7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.779479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c60f8-c9e1-4f24-bf4e-593ece6b3cb7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.787642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea9f00-b7a2-42bf-8845-6b8104496e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.788366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea9f00-b7a2-42bf-8845-6b8104496e9e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.788647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea9f00-b7a2-42bf-8845-6b8104496e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.789021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea9f00-b7a2-42bf-8845-6b8104496e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.789765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea9f00-b7a2-42bf-8845-6b8104496e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.790071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea9f00-b7a2-42bf-8845-6b8104496e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.791776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea9f00-b7a2-42bf-8845-6b8104496e9e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.797503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668b473-357e-4d3c-9cc8-a6e6621d20d6 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.797794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668b473-357e-4d3c-9cc8-a6e6621d20d6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.798045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668b473-357e-4d3c-9cc8-a6e6621d20d6 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.799875 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 276/541] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:20.806598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d5133-6ac3-4aa7-9de7-fc08ba9103f8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.806886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d5133-6ac3-4aa7-9de7-fc08ba9103f8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.807164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d5133-6ac3-4aa7-9de7-fc08ba9103f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.809848 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 266/542] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.816166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea9f00-b7a2-42bf-8845-6b8104496e9e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.827130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fb2d5133-6ac3-4aa7-9de7-fc08ba9103f8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:20.828452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fb2d5133-6ac3-4aa7-9de7-fc08ba9103f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:20.833102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea9f00-b7a2-42bf-8845-6b8104496e9e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.836907 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 277/543] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:20.848344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4475-bd98-45c5-bbf9-dd07ddba5562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.849281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4475-bd98-45c5-bbf9-dd07ddba5562 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.849565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4475-bd98-45c5-bbf9-dd07ddba5562 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.849840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4475-bd98-45c5-bbf9-dd07ddba5562 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.863799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d4475-bd98-45c5-bbf9-dd07ddba5562 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.863994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d5133-6ac3-4aa7-9de7-fc08ba9103f8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.866362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d4475-bd98-45c5-bbf9-dd07ddba5562 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.884998 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-0e9d4475-bd98-45c5-bbf9-dd07ddba5562 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:20.889341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d5133-6ac3-4aa7-9de7-fc08ba9103f8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.895781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1f88d-9875-4f93-aaee-9456747247c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.896971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1f88d-9875-4f93-aaee-9456747247c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.897471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1f88d-9875-4f93-aaee-9456747247c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.897936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1f88d-9875-4f93-aaee-9456747247c3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.901743 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 267/544] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:20.904284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4475-bd98-45c5-bbf9-dd07ddba5562 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.921886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4475-bd98-45c5-bbf9-dd07ddba5562 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.927978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1f88d-9875-4f93-aaee-9456747247c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:20.930956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20718102-11d5-4fd5-9392-83f0ea563e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.931708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20718102-11d5-4fd5-9392-83f0ea563e29 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.931993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20718102-11d5-4fd5-9392-83f0ea563e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.932317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20718102-11d5-4fd5-9392-83f0ea563e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.933236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20718102-11d5-4fd5-9392-83f0ea563e29 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.933591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20718102-11d5-4fd5-9392-83f0ea563e29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.935620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20718102-11d5-4fd5-9392-83f0ea563e29 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.937931 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-37e1f88d-9875-4f93-aaee-9456747247c3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:20.940376 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 278/545] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:20.949686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1f88d-9875-4f93-aaee-9456747247c3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.952887 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 268/546] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:20.959767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20718102-11d5-4fd5-9392-83f0ea563e29 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.963319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1f88d-9875-4f93-aaee-9456747247c3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.968445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ee7fe-14c2-4061-8630-ffa4c770ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.968917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ee7fe-14c2-4061-8630-ffa4c770ff45 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.969302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ee7fe-14c2-4061-8630-ffa4c770ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.969677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ee7fe-14c2-4061-8630-ffa4c770ff45 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.970601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ee7fe-14c2-4061-8630-ffa4c770ff45 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.970953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ee7fe-14c2-4061-8630-ffa4c770ff45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.972723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ee7fe-14c2-4061-8630-ffa4c770ff45 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.973501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20718102-11d5-4fd5-9392-83f0ea563e29 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:20.983513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93b3f-5070-47f5-89c1-6baa10b2ab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:20.984280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93b3f-5070-47f5-89c1-6baa10b2ab95 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:20.984765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93b3f-5070-47f5-89c1-6baa10b2ab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:20.985434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93b3f-5070-47f5-89c1-6baa10b2ab95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:20.986278 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 279/547] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:20.991328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93b3f-5070-47f5-89c1-6baa10b2ab95 admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=7e4c41e7988043c0b3b8e338ccd31d37) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:20.991328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93b3f-5070-47f5-89c1-6baa10b2ab95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:20.991328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93b3f-5070-47f5-89c1-6baa10b2ab95 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:20.999384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ee7fe-14c2-4061-8630-ffa4c770ff45 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:20.999564 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 269/548] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/role_assignments?user.id=7e4c41e7988043c0b3b8e338ccd31d37&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:21.009034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ee7fe-14c2-4061-8630-ffa4c770ff45 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.022152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e69b7b-b0da-46ea-bbeb-8787e74f2e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.022958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e69b7b-b0da-46ea-bbeb-8787e74f2e50 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.023867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e69b7b-b0da-46ea-bbeb-8787e74f2e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.024105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e69b7b-b0da-46ea-bbeb-8787e74f2e50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.038856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e69b7b-b0da-46ea-bbeb-8787e74f2e50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.040754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e69b7b-b0da-46ea-bbeb-8787e74f2e50 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.060022 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-d6e69b7b-b0da-46ea-bbeb-8787e74f2e50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:21.061593 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 280/549] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:21.067742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93b3f-5070-47f5-89c1-6baa10b2ab95 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.078908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93b3f-5070-47f5-89c1-6baa10b2ab95 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.083620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5705a4-31b6-4639-acf4-85c2bafaf30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.084290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5705a4-31b6-4639-acf4-85c2bafaf30a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.084570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5705a4-31b6-4639-acf4-85c2bafaf30a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.084841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5705a4-31b6-4639-acf4-85c2bafaf30a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.086112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5705a4-31b6-4639-acf4-85c2bafaf30a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:21.086416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5705a4-31b6-4639-acf4-85c2bafaf30a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.088115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5705a4-31b6-4639-acf4-85c2bafaf30a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.100882 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 270/550] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:21.106885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e69b7b-b0da-46ea-bbeb-8787e74f2e50 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.117650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e69b7b-b0da-46ea-bbeb-8787e74f2e50 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.122291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47a0dd-ead9-4c93-b7e0-7b09e7c49ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.123077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a0dd-ead9-4c93-b7e0-7b09e7c49ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.123395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a0dd-ead9-4c93-b7e0-7b09e7c49ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.123666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a0dd-ead9-4c93-b7e0-7b09e7c49ba7 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.132030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47a0dd-ead9-4c93-b7e0-7b09e7c49ba7 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.134239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47a0dd-ead9-4c93-b7e0-7b09e7c49ba7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.149139 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-be47a0dd-ead9-4c93-b7e0-7b09e7c49ba7 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 27 20:31:21.150685 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 281/551] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:21 2021] GET /identity/v3/users/neutron => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:21.156986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5705a4-31b6-4639-acf4-85c2bafaf30a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.167962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5705a4-31b6-4639-acf4-85c2bafaf30a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.172564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f88c17-2661-448e-92b7-6b913491775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.173277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f88c17-2661-448e-92b7-6b913491775a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.173555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f88c17-2661-448e-92b7-6b913491775a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.173826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f88c17-2661-448e-92b7-6b913491775a admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.174726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f88c17-2661-448e-92b7-6b913491775a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:21.175129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f88c17-2661-448e-92b7-6b913491775a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.176177 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-60f88c17-2661-448e-92b7-6b913491775a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:21.176177 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:31:21.176177 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:31:21.177362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f88c17-2661-448e-92b7-6b913491775a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.217471 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 271/552] 10.222.0.21 () {56 vars in 1160 bytes} [Sat Nov 27 20:31:21 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:21.223534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47a0dd-ead9-4c93-b7e0-7b09e7c49ba7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.234290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47a0dd-ead9-4c93-b7e0-7b09e7c49ba7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.238935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931fe05-f76b-4100-bdb1-3399e32241a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.239634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931fe05-f76b-4100-bdb1-3399e32241a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.239966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931fe05-f76b-4100-bdb1-3399e32241a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.240237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931fe05-f76b-4100-bdb1-3399e32241a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.249615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931fe05-f76b-4100-bdb1-3399e32241a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.251533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931fe05-f76b-4100-bdb1-3399e32241a1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.262503 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 282/553] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:21.268436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f88c17-2661-448e-92b7-6b913491775a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.278716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f88c17-2661-448e-92b7-6b913491775a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.283078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761404-b86a-4342-9428-ae2c04994761 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.283395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761404-b86a-4342-9428-ae2c04994761 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.283669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761404-b86a-4342-9428-ae2c04994761 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.285447 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 283/554] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:21.287619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125bfff-222a-48fa-bb1a-6a48b074d409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.288420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125bfff-222a-48fa-bb1a-6a48b074d409 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.289218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125bfff-222a-48fa-bb1a-6a48b074d409 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.289493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125bfff-222a-48fa-bb1a-6a48b074d409 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.293103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b159a97-4ad5-4336-a3f0-935dcf4d10fb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.293383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b159a97-4ad5-4336-a3f0-935dcf4d10fb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.293652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b159a97-4ad5-4336-a3f0-935dcf4d10fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.307685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125bfff-222a-48fa-bb1a-6a48b074d409 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.309825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125bfff-222a-48fa-bb1a-6a48b074d409 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.315380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1b159a97-4ad5-4336-a3f0-935dcf4d10fb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:21.316603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1b159a97-4ad5-4336-a3f0-935dcf4d10fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:21.337499 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-c125bfff-222a-48fa-bb1a-6a48b074d409 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:21.338747 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 272/555] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:21.348486 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 284/556] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:21.349493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125bfff-222a-48fa-bb1a-6a48b074d409 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.360039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125bfff-222a-48fa-bb1a-6a48b074d409 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.364513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95856746-7d2e-4bc5-af75-67bcaac8bf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.365159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95856746-7d2e-4bc5-af75-67bcaac8bf3b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.365437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95856746-7d2e-4bc5-af75-67bcaac8bf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.365708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95856746-7d2e-4bc5-af75-67bcaac8bf3b admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.366447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95856746-7d2e-4bc5-af75-67bcaac8bf3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:21.366748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95856746-7d2e-4bc5-af75-67bcaac8bf3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.368497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95856746-7d2e-4bc5-af75-67bcaac8bf3b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.381397 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 273/557] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:21.386626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b159a97-4ad5-4336-a3f0-935dcf4d10fb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.391401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95856746-7d2e-4bc5-af75-67bcaac8bf3b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.396011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b159a97-4ad5-4336-a3f0-935dcf4d10fb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.402470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95856746-7d2e-4bc5-af75-67bcaac8bf3b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.407126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cea4e-5769-4ab9-b7b5-6a5507cdd755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.407939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cea4e-5769-4ab9-b7b5-6a5507cdd755 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.408221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cea4e-5769-4ab9-b7b5-6a5507cdd755 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.408484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cea4e-5769-4ab9-b7b5-6a5507cdd755 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.416499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6d8a-a1fb-4095-b427-fcfa5ce84379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.418068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6d8a-a1fb-4095-b427-fcfa5ce84379 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.418558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6d8a-a1fb-4095-b427-fcfa5ce84379 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.419058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6d8a-a1fb-4095-b427-fcfa5ce84379 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.430553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cea4e-5769-4ab9-b7b5-6a5507cdd755 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.435576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cea4e-5769-4ab9-b7b5-6a5507cdd755 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.439832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d6d8a-a1fb-4095-b427-fcfa5ce84379 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.446021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d6d8a-a1fb-4095-b427-fcfa5ce84379 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.472879 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-723d6d8a-a1fb-4095-b427-fcfa5ce84379 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:21.474525 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-679cea4e-5769-4ab9-b7b5-6a5507cdd755 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:21.477774 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 285/558] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:21.478212 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 274/559] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:21.483582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cea4e-5769-4ab9-b7b5-6a5507cdd755 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.493928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6d8a-a1fb-4095-b427-fcfa5ce84379 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.505900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cea4e-5769-4ab9-b7b5-6a5507cdd755 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.508971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6d8a-a1fb-4095-b427-fcfa5ce84379 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.516097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad5a32-5b3b-4801-ab23-3fafcca10101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.516761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad5a32-5b3b-4801-ab23-3fafcca10101 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.517029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad5a32-5b3b-4801-ab23-3fafcca10101 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.517305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad5a32-5b3b-4801-ab23-3fafcca10101 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.518101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad5a32-5b3b-4801-ab23-3fafcca10101 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:21.518405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad5a32-5b3b-4801-ab23-3fafcca10101 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.520280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad5a32-5b3b-4801-ab23-3fafcca10101 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.520911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e780a-e734-4f22-9053-fb5ed96190d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.521560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e780a-e734-4f22-9053-fb5ed96190d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.521840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e780a-e734-4f22-9053-fb5ed96190d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.522115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e780a-e734-4f22-9053-fb5ed96190d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.522857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e780a-e734-4f22-9053-fb5ed96190d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:21.523239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e780a-e734-4f22-9053-fb5ed96190d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.524854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e780a-e734-4f22-9053-fb5ed96190d8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.547443 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 275/560] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:21.549274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e780a-e734-4f22-9053-fb5ed96190d8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.550278 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 286/561] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:21.563616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad5a32-5b3b-4801-ab23-3fafcca10101 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:21.564810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e780a-e734-4f22-9053-fb5ed96190d8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.569835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66857990-db09-4191-927f-f3f9c9698802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.570644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857990-db09-4191-927f-f3f9c9698802 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.571327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857990-db09-4191-927f-f3f9c9698802 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.571620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66857990-db09-4191-927f-f3f9c9698802 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.572388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66857990-db09-4191-927f-f3f9c9698802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.574436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66857990-db09-4191-927f-f3f9c9698802 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.590534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad5a32-5b3b-4801-ab23-3fafcca10101 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:21.599957 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 276/562] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:31:21 2021] POST /identity/v3/users => generated 247 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:31:21.612796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a91b5-a51a-4ec6-8f27-dabbc21a4631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:21.613478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a91b5-a51a-4ec6-8f27-dabbc21a4631 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:21.613763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a91b5-a51a-4ec6-8f27-dabbc21a4631 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:21.614043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a91b5-a51a-4ec6-8f27-dabbc21a4631 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:21.614906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a91b5-a51a-4ec6-8f27-dabbc21a4631 admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=10914bd6817341eeafda6c3ded4ecfc3) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:21.615222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a91b5-a51a-4ec6-8f27-dabbc21a4631 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:21.617832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a91b5-a51a-4ec6-8f27-dabbc21a4631 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:21.633654 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 287/563] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:21 2021] GET /identity/v3/role_assignments?user.id=10914bd6817341eeafda6c3ded4ecfc3&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 259 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:23.610919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6538f54-9fd6-40f7-a188-25bf1c49d78f None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.612000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6538f54-9fd6-40f7-a188-25bf1c49d78f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.612485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6538f54-9fd6-40f7-a188-25bf1c49d78f None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.614712 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 277/564] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:23.636952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345542a-2c47-4bcd-8356-5c56a6e1ad86 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.637886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345542a-2c47-4bcd-8356-5c56a6e1ad86 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.638388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345542a-2c47-4bcd-8356-5c56a6e1ad86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.658198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c345542a-2c47-4bcd-8356-5c56a6e1ad86 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:23.659779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c345542a-2c47-4bcd-8356-5c56a6e1ad86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:23.668033 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 288/565] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:23.708853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6538f54-9fd6-40f7-a188-25bf1c49d78f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:23.725125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6538f54-9fd6-40f7-a188-25bf1c49d78f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:23.728381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770de46-6158-47d5-8719-c945cfff6f0a None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.728885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770de46-6158-47d5-8719-c945cfff6f0a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.729359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770de46-6158-47d5-8719-c945cfff6f0a None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.731641 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 289/566] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:23.736903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98502391-04ac-43ef-98d7-270dbe63c5dd None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.737217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98502391-04ac-43ef-98d7-270dbe63c5dd None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.737464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98502391-04ac-43ef-98d7-270dbe63c5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.739078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5142523-2aa7-4de5-8f46-1c264bd9f89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:23.739889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5142523-2aa7-4de5-8f46-1c264bd9f89f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.740169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5142523-2aa7-4de5-8f46-1c264bd9f89f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.740437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5142523-2aa7-4de5-8f46-1c264bd9f89f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.760157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5142523-2aa7-4de5-8f46-1c264bd9f89f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:23.762179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-98502391-04ac-43ef-98d7-270dbe63c5dd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:23.763615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-98502391-04ac-43ef-98d7-270dbe63c5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:23.767048 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-e5142523-2aa7-4de5-8f46-1c264bd9f89f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:23.768267 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 278/567] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:23.779284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5142523-2aa7-4de5-8f46-1c264bd9f89f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:23.779666 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 290/568] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:23.792265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5142523-2aa7-4de5-8f46-1c264bd9f89f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:23.800535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98502391-04ac-43ef-98d7-270dbe63c5dd None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:23.800668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7aa22-88fa-4fc7-acd5-eb1647a5ea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:23.801275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7aa22-88fa-4fc7-acd5-eb1647a5ea21 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.801557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7aa22-88fa-4fc7-acd5-eb1647a5ea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.801831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7aa22-88fa-4fc7-acd5-eb1647a5ea21 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.802592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7aa22-88fa-4fc7-acd5-eb1647a5ea21 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:23.802896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7aa22-88fa-4fc7-acd5-eb1647a5ea21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:23.805082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7aa22-88fa-4fc7-acd5-eb1647a5ea21 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:23.812605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98502391-04ac-43ef-98d7-270dbe63c5dd None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:23.817872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aab02-1fae-4567-a2b0-9aa52dd9aca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:23.818935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aab02-1fae-4567-a2b0-9aa52dd9aca5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.819465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aab02-1fae-4567-a2b0-9aa52dd9aca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.820027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aab02-1fae-4567-a2b0-9aa52dd9aca5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.822453 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 279/569] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:23.829011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7aa22-88fa-4fc7-acd5-eb1647a5ea21 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:23.832052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aab02-1fae-4567-a2b0-9aa52dd9aca5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:23.840036 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-771aab02-1fae-4567-a2b0-9aa52dd9aca5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:23.847344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7aa22-88fa-4fc7-acd5-eb1647a5ea21 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:23.847820 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 291/570] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:23.849922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aab02-1fae-4567-a2b0-9aa52dd9aca5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:23.860672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aab02-1fae-4567-a2b0-9aa52dd9aca5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:23.860980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa971bf-df27-4083-be9d-e4c77f475ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:23.861695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa971bf-df27-4083-be9d-e4c77f475ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.861976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa971bf-df27-4083-be9d-e4c77f475ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.862257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa971bf-df27-4083-be9d-e4c77f475ff8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.866539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42802b-bdde-4808-8c28-1949476f485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:23.868150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42802b-bdde-4808-8c28-1949476f485b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.868638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42802b-bdde-4808-8c28-1949476f485b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.869332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42802b-bdde-4808-8c28-1949476f485b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.870344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42802b-bdde-4808-8c28-1949476f485b admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:23.870854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42802b-bdde-4808-8c28-1949476f485b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:23.873265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42802b-bdde-4808-8c28-1949476f485b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:23.887781 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 292/571] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:23.890448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42802b-bdde-4808-8c28-1949476f485b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:23.891996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa971bf-df27-4083-be9d-e4c77f475ff8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:23.893847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa971bf-df27-4083-be9d-e4c77f475ff8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:23.902123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42802b-bdde-4808-8c28-1949476f485b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:23.907176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503d014-31b4-4931-ba2e-8bfa54789a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:23.908690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503d014-31b4-4931-ba2e-8bfa54789a4c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.909210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503d014-31b4-4931-ba2e-8bfa54789a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.909689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503d014-31b4-4931-ba2e-8bfa54789a4c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.920932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503d014-31b4-4931-ba2e-8bfa54789a4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:23.923016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503d014-31b4-4931-ba2e-8bfa54789a4c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:23.923663 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-bfa971bf-df27-4083-be9d-e4c77f475ff8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:23.932471 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 280/572] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:23.938668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa971bf-df27-4083-be9d-e4c77f475ff8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:23.941614 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-9503d014-31b4-4931-ba2e-8bfa54789a4c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:23.947366 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 293/573] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:23.950468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503d014-31b4-4931-ba2e-8bfa54789a4c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:23.954519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa971bf-df27-4083-be9d-e4c77f475ff8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:23.961884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503d014-31b4-4931-ba2e-8bfa54789a4c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:23.966970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84255e5c-985b-49f4-afec-5f752452eb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:23.967878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255e5c-985b-49f4-afec-5f752452eb70 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.968367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255e5c-985b-49f4-afec-5f752452eb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.968853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84255e5c-985b-49f4-afec-5f752452eb70 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.969810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84255e5c-985b-49f4-afec-5f752452eb70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:23.970315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84255e5c-985b-49f4-afec-5f752452eb70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:23.972248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84255e5c-985b-49f4-afec-5f752452eb70 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:23.972489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f703b80-975f-4855-93f7-d02093f8c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:23.973158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f703b80-975f-4855-93f7-d02093f8c1eb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.973470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f703b80-975f-4855-93f7-d02093f8c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.973969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f703b80-975f-4855-93f7-d02093f8c1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.974719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f703b80-975f-4855-93f7-d02093f8c1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:23.975028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f703b80-975f-4855-93f7-d02093f8c1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:23.976771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f703b80-975f-4855-93f7-d02093f8c1eb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:23.988529 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 294/574] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:23.989665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba148-519a-4e2f-9071-05bcce74daae None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:23.989951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba148-519a-4e2f-9071-05bcce74daae None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:23.992400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba148-519a-4e2f-9071-05bcce74daae None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:23.992400 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 295/575] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:23.993066 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 281/576] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:23.998665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ba148-519a-4e2f-9071-05bcce74daae None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.000691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6eea-f49a-4e37-af56-eaafb750a063 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.000981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6eea-f49a-4e37-af56-eaafb750a063 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.001259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab6eea-f49a-4e37-af56-eaafb750a063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.015638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ba148-519a-4e2f-9071-05bcce74daae None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.021170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc17e8-40bb-4ab5-bc4d-a7c6024020bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.022023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc17e8-40bb-4ab5-bc4d-a7c6024020bc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.022304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc17e8-40bb-4ab5-bc4d-a7c6024020bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.022578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc17e8-40bb-4ab5-bc4d-a7c6024020bc admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.028663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2cab6eea-f49a-4e37-af56-eaafb750a063 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:24.030317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2cab6eea-f49a-4e37-af56-eaafb750a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:24.032335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc17e8-40bb-4ab5-bc4d-a7c6024020bc admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.034490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc17e8-40bb-4ab5-bc4d-a7c6024020bc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.042313 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 282/577] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:24.043636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab6eea-f49a-4e37-af56-eaafb750a063 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.049950 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-7cdc17e8-40bb-4ab5-bc4d-a7c6024020bc admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 27 20:31:24.052478 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 296/578] 10.222.0.21 () {56 vars in 1114 bytes} [Sat Nov 27 20:31:23 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:24.055232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab6eea-f49a-4e37-af56-eaafb750a063 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.059899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb30814-7571-455e-b945-8b6f4de46045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.060703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb30814-7571-455e-b945-8b6f4de46045 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.060984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb30814-7571-455e-b945-8b6f4de46045 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.061253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb30814-7571-455e-b945-8b6f4de46045 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.061704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc17e8-40bb-4ab5-bc4d-a7c6024020bc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.070045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb30814-7571-455e-b945-8b6f4de46045 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.073339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb30814-7571-455e-b945-8b6f4de46045 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.075557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc17e8-40bb-4ab5-bc4d-a7c6024020bc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.081335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd6c52-6c28-4619-aec4-576a8a1e3b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.082290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd6c52-6c28-4619-aec4-576a8a1e3b38 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.082775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd6c52-6c28-4619-aec4-576a8a1e3b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.083228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd6c52-6c28-4619-aec4-576a8a1e3b38 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.084275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd6c52-6c28-4619-aec4-576a8a1e3b38 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.084759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd6c52-6c28-4619-aec4-576a8a1e3b38 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.087420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd6c52-6c28-4619-aec4-576a8a1e3b38 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.091469 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-cbb30814-7571-455e-b945-8b6f4de46045 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 27 20:31:24.092770 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 283/579] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:24.093608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb30814-7571-455e-b945-8b6f4de46045 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.108474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb30814-7571-455e-b945-8b6f4de46045 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.110481 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 297/580] 10.222.0.21 () {56 vars in 1154 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:24.111225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd6c52-6c28-4619-aec4-576a8a1e3b38 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.114088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f28c67-0828-4408-8207-18c1fc9d6efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.115074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f28c67-0828-4408-8207-18c1fc9d6efd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.115558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f28c67-0828-4408-8207-18c1fc9d6efd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.116008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f28c67-0828-4408-8207-18c1fc9d6efd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.121586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd6c52-6c28-4619-aec4-576a8a1e3b38 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.126594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ed18b-e734-46d5-a390-c11876bfdea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.127348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ed18b-e734-46d5-a390-c11876bfdea8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.127696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ed18b-e734-46d5-a390-c11876bfdea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.128058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ed18b-e734-46d5-a390-c11876bfdea8 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.128964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ed18b-e734-46d5-a390-c11876bfdea8 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.129385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ed18b-e734-46d5-a390-c11876bfdea8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.130047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f28c67-0828-4408-8207-18c1fc9d6efd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:24.131305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ed18b-e734-46d5-a390-c11876bfdea8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.137643 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-57f28c67-0828-4408-8207-18c1fc9d6efd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:24.139395 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 284/581] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:24.140438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f28c67-0828-4408-8207-18c1fc9d6efd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.149676 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 298/582] 10.222.0.21 () {56 vars in 1158 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:24.150568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ed18b-e734-46d5-a390-c11876bfdea8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.150961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f28c67-0828-4408-8207-18c1fc9d6efd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.155840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ce571-e8fc-4902-b311-6e0c50425b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.156934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ce571-e8fc-4902-b311-6e0c50425b69 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.157439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ce571-e8fc-4902-b311-6e0c50425b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.157891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ce571-e8fc-4902-b311-6e0c50425b69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.167548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ed18b-e734-46d5-a390-c11876bfdea8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.171152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ce571-e8fc-4902-b311-6e0c50425b69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.173650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ce571-e8fc-4902-b311-6e0c50425b69 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.173769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbccfa-f332-4f6b-b155-b06a2d33b403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.174542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbccfa-f332-4f6b-b155-b06a2d33b403 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.174940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbccfa-f332-4f6b-b155-b06a2d33b403 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.175350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbccfa-f332-4f6b-b155-b06a2d33b403 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.176282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbccfa-f332-4f6b-b155-b06a2d33b403 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.176575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbccfa-f332-4f6b-b155-b06a2d33b403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.178349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbccfa-f332-4f6b-b155-b06a2d33b403 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.187844 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 299/583] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:24.188735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbccfa-f332-4f6b-b155-b06a2d33b403 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.192735 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-eb6ce571-e8fc-4902-b311-6e0c50425b69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:24.194108 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 285/584] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:24.195723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ce571-e8fc-4902-b311-6e0c50425b69 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.199377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbccfa-f332-4f6b-b155-b06a2d33b403 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.204732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f3f6-c7f7-4f4e-9e3b-2aac8c812b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.205553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f3f6-c7f7-4f4e-9e3b-2aac8c812b42 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.205832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f3f6-c7f7-4f4e-9e3b-2aac8c812b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.206162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f3f6-c7f7-4f4e-9e3b-2aac8c812b42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.207530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ce571-e8fc-4902-b311-6e0c50425b69 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.212267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c79fa-1bed-4d0f-a2f1-23ad93a21ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.213235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c79fa-1bed-4d0f-a2f1-23ad93a21ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.213731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c79fa-1bed-4d0f-a2f1-23ad93a21ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.214212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c79fa-1bed-4d0f-a2f1-23ad93a21ea0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.217205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195f3f6-c7f7-4f4e-9e3b-2aac8c812b42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.219169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195f3f6-c7f7-4f4e-9e3b-2aac8c812b42 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.226701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c79fa-1bed-4d0f-a2f1-23ad93a21ea0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.228790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c79fa-1bed-4d0f-a2f1-23ad93a21ea0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.236779 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-3195f3f6-c7f7-4f4e-9e3b-2aac8c812b42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:24.238265 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 300/585] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:24.243610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f3f6-c7f7-4f4e-9e3b-2aac8c812b42 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.246724 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-926c79fa-1bed-4d0f-a2f1-23ad93a21ea0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:24.248398 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 286/586] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:24.249680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c79fa-1bed-4d0f-a2f1-23ad93a21ea0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.254362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f3f6-c7f7-4f4e-9e3b-2aac8c812b42 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.261021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c79fa-1bed-4d0f-a2f1-23ad93a21ea0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.261161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ea600-cac9-4031-b67d-58215d545362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.261800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea600-cac9-4031-b67d-58215d545362 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.262134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea600-cac9-4031-b67d-58215d545362 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.262456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea600-cac9-4031-b67d-58215d545362 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.263232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ea600-cac9-4031-b67d-58215d545362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.263564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ea600-cac9-4031-b67d-58215d545362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.265289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ea600-cac9-4031-b67d-58215d545362 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.267096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2c92d-079b-47af-93fa-7acd91889a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.267979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2c92d-079b-47af-93fa-7acd91889a51 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.268476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2c92d-079b-47af-93fa-7acd91889a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.268956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2c92d-079b-47af-93fa-7acd91889a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.269873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2c92d-079b-47af-93fa-7acd91889a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.270372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2c92d-079b-47af-93fa-7acd91889a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.272178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2c92d-079b-47af-93fa-7acd91889a51 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.278086 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 301/587] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:24.279030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ea600-cac9-4031-b67d-58215d545362 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.285214 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 287/588] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:24.286232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2c92d-079b-47af-93fa-7acd91889a51 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.295578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ea600-cac9-4031-b67d-58215d545362 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.296551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2c92d-079b-47af-93fa-7acd91889a51 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.300193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1f356-b011-4953-8be2-00773cbaae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.300994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f356-b011-4953-8be2-00773cbaae80 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.301418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f356-b011-4953-8be2-00773cbaae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.301847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f356-b011-4953-8be2-00773cbaae80 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.302072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011fa1-2c87-4512-966d-992c195d6f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.302885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1f356-b011-4953-8be2-00773cbaae80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.302998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011fa1-2c87-4512-966d-992c195d6f3a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.303406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011fa1-2c87-4512-966d-992c195d6f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.303582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1f356-b011-4953-8be2-00773cbaae80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.303862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011fa1-2c87-4512-966d-992c195d6f3a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.305556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1f356-b011-4953-8be2-00773cbaae80 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.311064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65011fa1-2c87-4512-966d-992c195d6f3a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.313131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65011fa1-2c87-4512-966d-992c195d6f3a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.318050 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 302/589] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:24.319319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1f356-b011-4953-8be2-00773cbaae80 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.327314 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-65011fa1-2c87-4512-966d-992c195d6f3a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:24.328604 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 288/590] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:24.329450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011fa1-2c87-4512-966d-992c195d6f3a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.329648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1f356-b011-4953-8be2-00773cbaae80 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.334686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838957f-846e-4af3-a4ff-92ccd489a5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.335795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838957f-846e-4af3-a4ff-92ccd489a5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.336394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838957f-846e-4af3-a4ff-92ccd489a5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.336843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838957f-846e-4af3-a4ff-92ccd489a5a6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.341276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011fa1-2c87-4512-966d-992c195d6f3a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.345395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838957f-846e-4af3-a4ff-92ccd489a5a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.345909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40028811-ac38-494b-b778-51951439b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.346801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40028811-ac38-494b-b778-51951439b6aa admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.347167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40028811-ac38-494b-b778-51951439b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.347565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40028811-ac38-494b-b778-51951439b6aa admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.348408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838957f-846e-4af3-a4ff-92ccd489a5a6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.355852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40028811-ac38-494b-b778-51951439b6aa admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.357955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40028811-ac38-494b-b778-51951439b6aa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.364937 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-7838957f-846e-4af3-a4ff-92ccd489a5a6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:24.366592 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 303/591] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:24.371895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838957f-846e-4af3-a4ff-92ccd489a5a6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.373453 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-40028811-ac38-494b-b778-51951439b6aa admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 27 20:31:24.375167 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 289/592] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/users/glance => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:24.376151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40028811-ac38-494b-b778-51951439b6aa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.386311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838957f-846e-4af3-a4ff-92ccd489a5a6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.386548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40028811-ac38-494b-b778-51951439b6aa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.391408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c73947-24ba-4ac7-8fb8-75371662c4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.391773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e561ad-cf15-457c-9871-e3fb5933000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.392459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73947-24ba-4ac7-8fb8-75371662c4df admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.392646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e561ad-cf15-457c-9871-e3fb5933000b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.393027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e561ad-cf15-457c-9871-e3fb5933000b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.393163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73947-24ba-4ac7-8fb8-75371662c4df admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.393476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e561ad-cf15-457c-9871-e3fb5933000b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.393738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73947-24ba-4ac7-8fb8-75371662c4df admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.394449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e561ad-cf15-457c-9871-e3fb5933000b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.394854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e561ad-cf15-457c-9871-e3fb5933000b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.394978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c73947-24ba-4ac7-8fb8-75371662c4df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.395524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c73947-24ba-4ac7-8fb8-75371662c4df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.396987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e561ad-cf15-457c-9871-e3fb5933000b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.397748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c73947-24ba-4ac7-8fb8-75371662c4df admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.415355 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 290/593] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:24.415355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e561ad-cf15-457c-9871-e3fb5933000b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.418168 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 304/594] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:24.419806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c73947-24ba-4ac7-8fb8-75371662c4df admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.421609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e561ad-cf15-457c-9871-e3fb5933000b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.426447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7916ebb-71ae-4ee4-8dde-b17972ce5d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.427236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7916ebb-71ae-4ee4-8dde-b17972ce5d2c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.427669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7916ebb-71ae-4ee4-8dde-b17972ce5d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.428041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7916ebb-71ae-4ee4-8dde-b17972ce5d2c admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.429040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7916ebb-71ae-4ee4-8dde-b17972ce5d2c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.429508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7916ebb-71ae-4ee4-8dde-b17972ce5d2c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.431677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7916ebb-71ae-4ee4-8dde-b17972ce5d2c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.435947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c73947-24ba-4ac7-8fb8-75371662c4df admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.441089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4e477-e12b-4089-aef3-8573143a265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.442781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e477-e12b-4089-aef3-8573143a265a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.443060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e477-e12b-4089-aef3-8573143a265a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.443374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4e477-e12b-4089-aef3-8573143a265a admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/198c9372013440ec942a0192a73a231d/roles/9442d70924794d1d9b528d5b470a7366` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.453007 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 291/595] 10.222.0.21 () {56 vars in 1158 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:24.454079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7916ebb-71ae-4ee4-8dde-b17972ce5d2c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.465532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7916ebb-71ae-4ee4-8dde-b17972ce5d2c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.468402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4e477-e12b-4089-aef3-8573143a265a admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=198c9372013440ec942a0192a73a231d, role_id=9442d70924794d1d9b528d5b470a7366)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.470297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7be1d-f262-4ebd-b4d0-8afe99d6474a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.471231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4e477-e12b-4089-aef3-8573143a265a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.471382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7be1d-f262-4ebd-b4d0-8afe99d6474a admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.471745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7be1d-f262-4ebd-b4d0-8afe99d6474a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.472116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7be1d-f262-4ebd-b4d0-8afe99d6474a admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/aa3373ab52dc4fe680372579cfcde718/roles/9442d70924794d1d9b528d5b470a7366` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.489951 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 305/596] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:31:24 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/198c9372013440ec942a0192a73a231d/roles/9442d70924794d1d9b528d5b470a7366 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:31:24.490912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4e477-e12b-4089-aef3-8573143a265a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.496928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7be1d-f262-4ebd-b4d0-8afe99d6474a admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=aa3373ab52dc4fe680372579cfcde718, role_id=9442d70924794d1d9b528d5b470a7366)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.500303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7be1d-f262-4ebd-b4d0-8afe99d6474a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.523562 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 292/597] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:31:24 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/aa3373ab52dc4fe680372579cfcde718/roles/9442d70924794d1d9b528d5b470a7366 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:24.527739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fec14-500a-4242-9c58-7e26b4b4b2e8 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.528141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fec14-500a-4242-9c58-7e26b4b4b2e8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.528708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fec14-500a-4242-9c58-7e26b4b4b2e8 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.532070 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 293/598] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:24 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:24.546048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a25f0-e3a0-493d-ab56-449ff81f3914 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.546649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a25f0-e3a0-493d-ab56-449ff81f3914 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.547110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a25f0-e3a0-493d-ab56-449ff81f3914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.596831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-981a25f0-e3a0-493d-ab56-449ff81f3914 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:24.599535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-981a25f0-e3a0-493d-ab56-449ff81f3914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:24.621882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4e477-e12b-4089-aef3-8573143a265a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.680703 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 294/599] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:24.706399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a25f0-e3a0-493d-ab56-449ff81f3914 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.719834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a25f0-e3a0-493d-ab56-449ff81f3914 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.726555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae21d4-f181-4aec-b570-09a18ed98275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.727658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae21d4-f181-4aec-b570-09a18ed98275 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.728137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae21d4-f181-4aec-b570-09a18ed98275 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.728560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae21d4-f181-4aec-b570-09a18ed98275 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.745384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae21d4-f181-4aec-b570-09a18ed98275 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:24.754778 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d5ae21d4-f181-4aec-b570-09a18ed98275 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:24.758762 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 295/600] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:24.759678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fde9e-b1eb-4055-97d7-58088f12c83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.761114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fde9e-b1eb-4055-97d7-58088f12c83e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.761606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fde9e-b1eb-4055-97d7-58088f12c83e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.761881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fde9e-b1eb-4055-97d7-58088f12c83e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.764341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae21d4-f181-4aec-b570-09a18ed98275 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.776440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fde9e-b1eb-4055-97d7-58088f12c83e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.776974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae21d4-f181-4aec-b570-09a18ed98275 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.778302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fde9e-b1eb-4055-97d7-58088f12c83e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.785910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a55a9-6c89-46f2-9961-ceb467fe90d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.786582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a55a9-6c89-46f2-9961-ceb467fe90d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.786862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a55a9-6c89-46f2-9961-ceb467fe90d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.787138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a55a9-6c89-46f2-9961-ceb467fe90d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.788448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a55a9-6c89-46f2-9961-ceb467fe90d0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.788846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a55a9-6c89-46f2-9961-ceb467fe90d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.790475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a55a9-6c89-46f2-9961-ceb467fe90d0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.801479 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 296/601] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:24.802102 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-400fde9e-b1eb-4055-97d7-58088f12c83e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:24.803344 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 306/602] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:24.808342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a55a9-6c89-46f2-9961-ceb467fe90d0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.812240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fde9e-b1eb-4055-97d7-58088f12c83e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.821446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a55a9-6c89-46f2-9961-ceb467fe90d0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.821949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fde9e-b1eb-4055-97d7-58088f12c83e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.826686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07fbf4-fc72-4168-bbe6-63ef1b54f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.827500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07fbf4-fc72-4168-bbe6-63ef1b54f039 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.827786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07fbf4-fc72-4168-bbe6-63ef1b54f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.827890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1d6d4-131a-4625-8726-6086de2865e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.828079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07fbf4-fc72-4168-bbe6-63ef1b54f039 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.828516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1d6d4-131a-4625-8726-6086de2865e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.829010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1d6d4-131a-4625-8726-6086de2865e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.829285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1d6d4-131a-4625-8726-6086de2865e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.830024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1d6d4-131a-4625-8726-6086de2865e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.830375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1d6d4-131a-4625-8726-6086de2865e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.832341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1d6d4-131a-4625-8726-6086de2865e7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.842081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07fbf4-fc72-4168-bbe6-63ef1b54f039 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.844262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07fbf4-fc72-4168-bbe6-63ef1b54f039 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.845162 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 307/603] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:24.851202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1d6d4-131a-4625-8726-6086de2865e7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.861033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1d6d4-131a-4625-8726-6086de2865e7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.863951 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-fb07fbf4-fc72-4168-bbe6-63ef1b54f039 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:24.865144 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 297/604] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:24.865902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122344e3-f898-4a30-8b20-68443b037ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.867299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122344e3-f898-4a30-8b20-68443b037ced admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.867612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122344e3-f898-4a30-8b20-68443b037ced admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.867938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122344e3-f898-4a30-8b20-68443b037ced admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.872259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07fbf4-fc72-4168-bbe6-63ef1b54f039 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.876028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122344e3-f898-4a30-8b20-68443b037ced admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.878045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122344e3-f898-4a30-8b20-68443b037ced admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.884685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07fbf4-fc72-4168-bbe6-63ef1b54f039 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.893723 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-122344e3-f898-4a30-8b20-68443b037ced admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:24.895128 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 308/605] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:24.900743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fab59-e33e-4730-a270-c75d6b06ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.901427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fab59-e33e-4730-a270-c75d6b06ab14 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.901534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122344e3-f898-4a30-8b20-68443b037ced admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.901693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fab59-e33e-4730-a270-c75d6b06ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.901970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fab59-e33e-4730-a270-c75d6b06ab14 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.902714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fab59-e33e-4730-a270-c75d6b06ab14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.903019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fab59-e33e-4730-a270-c75d6b06ab14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.904662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fab59-e33e-4730-a270-c75d6b06ab14 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.919408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122344e3-f898-4a30-8b20-68443b037ced admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.928849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51167d8-3234-4c17-939d-9c17bc53894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.931384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51167d8-3234-4c17-939d-9c17bc53894e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.931736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51167d8-3234-4c17-939d-9c17bc53894e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.932644 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 298/606] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:24.932760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51167d8-3234-4c17-939d-9c17bc53894e admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.933603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51167d8-3234-4c17-939d-9c17bc53894e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:24.933914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51167d8-3234-4c17-939d-9c17bc53894e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.935890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51167d8-3234-4c17-939d-9c17bc53894e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.938575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fab59-e33e-4730-a270-c75d6b06ab14 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.954438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fab59-e33e-4730-a270-c75d6b06ab14 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:24.964018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb0dcc-4bae-439f-847a-138ad226cf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:24.964951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0dcc-4bae-439f-847a-138ad226cf6a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:24.965231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0dcc-4bae-439f-847a-138ad226cf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:24.965500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb0dcc-4bae-439f-847a-138ad226cf6a admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:24.969644 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 309/607] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:24.976945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51167d8-3234-4c17-939d-9c17bc53894e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:24.987458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb0dcc-4bae-439f-847a-138ad226cf6a admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:24.990665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb0dcc-4bae-439f-847a-138ad226cf6a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:24.994903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51167d8-3234-4c17-939d-9c17bc53894e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.004860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3ea80-f78c-4465-bd64-4a81d81186bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.006998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3ea80-f78c-4465-bd64-4a81d81186bb admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.009454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3ea80-f78c-4465-bd64-4a81d81186bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.009791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3ea80-f78c-4465-bd64-4a81d81186bb admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/7e4c41e7988043c0b3b8e338ccd31d37/roles/9442d70924794d1d9b528d5b470a7366` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.015108 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-5deb0dcc-4bae-439f-847a-138ad226cf6a admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 27 20:31:25.016362 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 299/608] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:24 2021] GET /identity/v3/users/neutron => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:25.022661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb0dcc-4bae-439f-847a-138ad226cf6a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.034293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb0dcc-4bae-439f-847a-138ad226cf6a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.040657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be3e07-8ebc-45fc-b6a4-0f8fbac2c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.041322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be3e07-8ebc-45fc-b6a4-0f8fbac2c2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.041612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be3e07-8ebc-45fc-b6a4-0f8fbac2c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.041931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be3e07-8ebc-45fc-b6a4-0f8fbac2c2b4 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.042775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be3e07-8ebc-45fc-b6a4-0f8fbac2c2b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:25.043183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be3e07-8ebc-45fc-b6a4-0f8fbac2c2b4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.044633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3ea80-f78c-4465-bd64-4a81d81186bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=7e4c41e7988043c0b3b8e338ccd31d37, role_id=9442d70924794d1d9b528d5b470a7366)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.045286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be3e07-8ebc-45fc-b6a4-0f8fbac2c2b4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.047246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3ea80-f78c-4465-bd64-4a81d81186bb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.071023 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 300/609] 10.222.0.21 () {56 vars in 1160 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:25.072440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be3e07-8ebc-45fc-b6a4-0f8fbac2c2b4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.082431 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 310/610] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:31:24 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/7e4c41e7988043c0b3b8e338ccd31d37/roles/9442d70924794d1d9b528d5b470a7366 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:25.083699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be3e07-8ebc-45fc-b6a4-0f8fbac2c2b4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.147453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c38445-ef69-4d0c-b093-36b9425f0b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.148325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c38445-ef69-4d0c-b093-36b9425f0b3c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.148654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c38445-ef69-4d0c-b093-36b9425f0b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.148983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c38445-ef69-4d0c-b093-36b9425f0b3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.160738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c38445-ef69-4d0c-b093-36b9425f0b3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.162670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c38445-ef69-4d0c-b093-36b9425f0b3c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.181629 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-32c38445-ef69-4d0c-b093-36b9425f0b3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:25.187407 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 301/611] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:25.189516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3ea80-f78c-4465-bd64-4a81d81186bb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.200467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3ea80-f78c-4465-bd64-4a81d81186bb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.205283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f0d4c-61cd-44c7-baab-e4a3e83633e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.206037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f0d4c-61cd-44c7-baab-e4a3e83633e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.206331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f0d4c-61cd-44c7-baab-e4a3e83633e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.206609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f0d4c-61cd-44c7-baab-e4a3e83633e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.207443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f0d4c-61cd-44c7-baab-e4a3e83633e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:25.207753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f0d4c-61cd-44c7-baab-e4a3e83633e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.209538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f0d4c-61cd-44c7-baab-e4a3e83633e5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.228442 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 311/612] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:25.234723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c38445-ef69-4d0c-b093-36b9425f0b3c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.245699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c38445-ef69-4d0c-b093-36b9425f0b3c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.255586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03c79e-4253-492d-b50b-b826ae05ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.256457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03c79e-4253-492d-b50b-b826ae05ab96 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.256740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03c79e-4253-492d-b50b-b826ae05ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.257063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03c79e-4253-492d-b50b-b826ae05ab96 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.271304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03c79e-4253-492d-b50b-b826ae05ab96 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.273458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03c79e-4253-492d-b50b-b826ae05ab96 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.294115 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-ed03c79e-4253-492d-b50b-b826ae05ab96 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:25.299165 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 302/613] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:25.306169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f0d4c-61cd-44c7-baab-e4a3e83633e5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.316674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f0d4c-61cd-44c7-baab-e4a3e83633e5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.321596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf917d-175e-4a0e-8407-d71b1c390ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.322327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf917d-175e-4a0e-8407-d71b1c390ede admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.322619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf917d-175e-4a0e-8407-d71b1c390ede admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.322897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf917d-175e-4a0e-8407-d71b1c390ede admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.323809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf917d-175e-4a0e-8407-d71b1c390ede admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:25.324121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf917d-175e-4a0e-8407-d71b1c390ede admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.326128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf917d-175e-4a0e-8407-d71b1c390ede admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.330834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de206dc-1d01-48e1-9761-cb07e32a8815 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.331204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de206dc-1d01-48e1-9761-cb07e32a8815 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.331519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de206dc-1d01-48e1-9761-cb07e32a8815 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.333670 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 303/614] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:31:25.345703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7250c6-7be2-4edb-baa5-48e6bb66ac3b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.346030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7250c6-7be2-4edb-baa5-48e6bb66ac3b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.346248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7250c6-7be2-4edb-baa5-48e6bb66ac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.361279 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 312/615] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:25.364273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf917d-175e-4a0e-8407-d71b1c390ede admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.372217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0b7250c6-7be2-4edb-baa5-48e6bb66ac3b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:25.373463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0b7250c6-7be2-4edb-baa5-48e6bb66ac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:25.374836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf917d-175e-4a0e-8407-d71b1c390ede admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.379742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0b9b5-0f62-4c47-9c8c-42520ef91205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.380621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b9b5-0f62-4c47-9c8c-42520ef91205 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.380896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b9b5-0f62-4c47-9c8c-42520ef91205 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.381169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0b9b5-0f62-4c47-9c8c-42520ef91205 admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/10914bd6817341eeafda6c3ded4ecfc3/roles/9442d70924794d1d9b528d5b470a7366` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.383877 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 304/616] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:25.397418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0b9b5-0f62-4c47-9c8c-42520ef91205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=10914bd6817341eeafda6c3ded4ecfc3, role_id=9442d70924794d1d9b528d5b470a7366)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.401218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0b9b5-0f62-4c47-9c8c-42520ef91205 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.410856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7250c6-7be2-4edb-baa5-48e6bb66ac3b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.416480 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 313/617] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:31:25 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/10914bd6817341eeafda6c3ded4ecfc3/roles/9442d70924794d1d9b528d5b470a7366 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:25.424712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7250c6-7be2-4edb-baa5-48e6bb66ac3b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.496019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69c29-ea9b-4b5a-a9b3-e9344e9b69bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.496750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69c29-ea9b-4b5a-a9b3-e9344e9b69bd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.497088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69c29-ea9b-4b5a-a9b3-e9344e9b69bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.497370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff69c29-ea9b-4b5a-a9b3-e9344e9b69bd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.515015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff69c29-ea9b-4b5a-a9b3-e9344e9b69bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:25.522385 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-5ff69c29-ea9b-4b5a-a9b3-e9344e9b69bd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:25.524205 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 305/618] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:25.530953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0b9b5-0f62-4c47-9c8c-42520ef91205 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.549892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0b9b5-0f62-4c47-9c8c-42520ef91205 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.558155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7dad1-18f0-4cc2-9de3-a20e541e06c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.558996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7dad1-18f0-4cc2-9de3-a20e541e06c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.559294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7dad1-18f0-4cc2-9de3-a20e541e06c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.559570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7dad1-18f0-4cc2-9de3-a20e541e06c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.560337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7dad1-18f0-4cc2-9de3-a20e541e06c4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:25.560637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7dad1-18f0-4cc2-9de3-a20e541e06c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.562214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7dad1-18f0-4cc2-9de3-a20e541e06c4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.571586 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 314/619] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:25.581064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69c29-ea9b-4b5a-a9b3-e9344e9b69bd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.593199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff69c29-ea9b-4b5a-a9b3-e9344e9b69bd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.598478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363605c6-54f5-4e52-bb48-3f8c8d10ddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.599374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363605c6-54f5-4e52-bb48-3f8c8d10ddc2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.599657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363605c6-54f5-4e52-bb48-3f8c8d10ddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.599928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363605c6-54f5-4e52-bb48-3f8c8d10ddc2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.619878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363605c6-54f5-4e52-bb48-3f8c8d10ddc2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.621968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363605c6-54f5-4e52-bb48-3f8c8d10ddc2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.644396 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-363605c6-54f5-4e52-bb48-3f8c8d10ddc2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:25.645641 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 306/620] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:25.652168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7dad1-18f0-4cc2-9de3-a20e541e06c4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.665506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7dad1-18f0-4cc2-9de3-a20e541e06c4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.677892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2411672-48ff-4a78-b698-1b474788034d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.678561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2411672-48ff-4a78-b698-1b474788034d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.678839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2411672-48ff-4a78-b698-1b474788034d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.679173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2411672-48ff-4a78-b698-1b474788034d admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.680802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2411672-48ff-4a78-b698-1b474788034d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:25.680802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2411672-48ff-4a78-b698-1b474788034d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.681876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2411672-48ff-4a78-b698-1b474788034d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.694672 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 315/621] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:25.700951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363605c6-54f5-4e52-bb48-3f8c8d10ddc2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.711932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363605c6-54f5-4e52-bb48-3f8c8d10ddc2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.717313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507d76-ad72-4b35-8b1d-8718698f1e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.718095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507d76-ad72-4b35-8b1d-8718698f1e6f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.718425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507d76-ad72-4b35-8b1d-8718698f1e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.718701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96507d76-ad72-4b35-8b1d-8718698f1e6f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.728019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96507d76-ad72-4b35-8b1d-8718698f1e6f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.730050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96507d76-ad72-4b35-8b1d-8718698f1e6f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.744808 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-96507d76-ad72-4b35-8b1d-8718698f1e6f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 27 20:31:25.746577 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 307/622] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:25.753145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2411672-48ff-4a78-b698-1b474788034d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.766604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2411672-48ff-4a78-b698-1b474788034d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.771439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c6db1-3617-45d2-96a3-31798d9ef8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.772163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c6db1-3617-45d2-96a3-31798d9ef8fb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.772447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c6db1-3617-45d2-96a3-31798d9ef8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.772776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c6db1-3617-45d2-96a3-31798d9ef8fb admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.774307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c6db1-3617-45d2-96a3-31798d9ef8fb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:25.774624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c6db1-3617-45d2-96a3-31798d9ef8fb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.776525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c6db1-3617-45d2-96a3-31798d9ef8fb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.796253 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 316/623] 10.222.0.21 () {56 vars in 1156 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:25.802375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507d76-ad72-4b35-8b1d-8718698f1e6f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.813428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96507d76-ad72-4b35-8b1d-8718698f1e6f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.820640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0e503-797a-4d9d-84d1-a63ce9516ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.821288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0e503-797a-4d9d-84d1-a63ce9516ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.821625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0e503-797a-4d9d-84d1-a63ce9516ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.821901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0e503-797a-4d9d-84d1-a63ce9516ae3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.830646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0e503-797a-4d9d-84d1-a63ce9516ae3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.832493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0e503-797a-4d9d-84d1-a63ce9516ae3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.842155 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 308/624] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:25.848367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c6db1-3617-45d2-96a3-31798d9ef8fb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.858838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c6db1-3617-45d2-96a3-31798d9ef8fb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.863533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d691c2-509b-478d-a470-0b800b1f7396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.864373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d691c2-509b-478d-a470-0b800b1f7396 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.864658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d691c2-509b-478d-a470-0b800b1f7396 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.865060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d691c2-509b-478d-a470-0b800b1f7396 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.876614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d691c2-509b-478d-a470-0b800b1f7396 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.878461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d691c2-509b-478d-a470-0b800b1f7396 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.896458 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-28d691c2-509b-478d-a470-0b800b1f7396 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:25.898039 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 317/625] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:25.904075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0e503-797a-4d9d-84d1-a63ce9516ae3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.913281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0e503-797a-4d9d-84d1-a63ce9516ae3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.921426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcc28e-1508-4b3b-96ba-4f840a0cfffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.922079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcc28e-1508-4b3b-96ba-4f840a0cfffe admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.922363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcc28e-1508-4b3b-96ba-4f840a0cfffe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.922639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcc28e-1508-4b3b-96ba-4f840a0cfffe admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.923479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcc28e-1508-4b3b-96ba-4f840a0cfffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:25.923785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcc28e-1508-4b3b-96ba-4f840a0cfffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.925451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdcc28e-1508-4b3b-96ba-4f840a0cfffe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.942163 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 309/626] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:25.948837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d691c2-509b-478d-a470-0b800b1f7396 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:25.959546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d691c2-509b-478d-a470-0b800b1f7396 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:25.964709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bb335-4d13-4ed8-ba51-99c86e700cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:25.965571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb335-4d13-4ed8-ba51-99c86e700cae admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:25.965839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb335-4d13-4ed8-ba51-99c86e700cae admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:25.966115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb335-4d13-4ed8-ba51-99c86e700cae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:25.974314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bb335-4d13-4ed8-ba51-99c86e700cae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:25.976971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bb335-4d13-4ed8-ba51-99c86e700cae admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:25.991126 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-687bb335-4d13-4ed8-ba51-99c86e700cae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:25.992857 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 318/627] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:25.999467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcc28e-1508-4b3b-96ba-4f840a0cfffe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:26.013811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcc28e-1508-4b3b-96ba-4f840a0cfffe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:26.018614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a07d9-a51e-4f00-a206-4b3a60ff1c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:26.019295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a07d9-a51e-4f00-a206-4b3a60ff1c9e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:26.019641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a07d9-a51e-4f00-a206-4b3a60ff1c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:26.019921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a07d9-a51e-4f00-a206-4b3a60ff1c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:26.020779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a07d9-a51e-4f00-a206-4b3a60ff1c9e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:26.021092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a07d9-a51e-4f00-a206-4b3a60ff1c9e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:26.023081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a07d9-a51e-4f00-a206-4b3a60ff1c9e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:26.040435 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 310/628] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:26.047026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bb335-4d13-4ed8-ba51-99c86e700cae admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:26.059655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bb335-4d13-4ed8-ba51-99c86e700cae admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:26.065535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cdad59-bc14-46b3-8640-1ebb0bf72b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:26.066293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdad59-bc14-46b3-8640-1ebb0bf72b48 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:26.066580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdad59-bc14-46b3-8640-1ebb0bf72b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:26.066905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cdad59-bc14-46b3-8640-1ebb0bf72b48 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:26.067776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdad59-bc14-46b3-8640-1ebb0bf72b48 admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=f39a303b702041259ebb6a66c5967528) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:26.068140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdad59-bc14-46b3-8640-1ebb0bf72b48 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:26.070117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cdad59-bc14-46b3-8640-1ebb0bf72b48 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:26.079355 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 319/629] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:26 2021] GET /identity/v3/role_assignments?user.id=f39a303b702041259ebb6a66c5967528&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:27.510143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba0f81-eda8-464a-ac82-2e7226ef5be7 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.510661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba0f81-eda8-464a-ac82-2e7226ef5be7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.510661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba0f81-eda8-464a-ac82-2e7226ef5be7 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.512448 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 311/630] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:27.520506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990577-5b5a-4c25-adc4-556d8791cb34 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.520506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990577-5b5a-4c25-adc4-556d8791cb34 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.520506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6990577-5b5a-4c25-adc4-556d8791cb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.544236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e6990577-5b5a-4c25-adc4-556d8791cb34 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:27.545754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e6990577-5b5a-4c25-adc4-556d8791cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:27.554696 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 320/631] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:27.604754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba0f81-eda8-464a-ac82-2e7226ef5be7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:27.624204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba0f81-eda8-464a-ac82-2e7226ef5be7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:27.628879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a990f1-f8a8-416e-afbe-5446a494f0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:27.629669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a990f1-f8a8-416e-afbe-5446a494f0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.629949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a990f1-f8a8-416e-afbe-5446a494f0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.630222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a990f1-f8a8-416e-afbe-5446a494f0e9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.644364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a990f1-f8a8-416e-afbe-5446a494f0e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:27.651332 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-26a990f1-f8a8-416e-afbe-5446a494f0e9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:27.652830 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 312/632] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:27.658886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6990577-5b5a-4c25-adc4-556d8791cb34 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:27.672244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6990577-5b5a-4c25-adc4-556d8791cb34 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:27.684010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1155f-d908-4096-8c04-4ff16d22e364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:27.684908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1155f-d908-4096-8c04-4ff16d22e364 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.685351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1155f-d908-4096-8c04-4ff16d22e364 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.685770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1155f-d908-4096-8c04-4ff16d22e364 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.686679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1155f-d908-4096-8c04-4ff16d22e364 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:27.687129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1155f-d908-4096-8c04-4ff16d22e364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:27.688886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1155f-d908-4096-8c04-4ff16d22e364 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:27.703072 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 321/633] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:27.708676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a990f1-f8a8-416e-afbe-5446a494f0e9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:27.724536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a990f1-f8a8-416e-afbe-5446a494f0e9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:27.734327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b0a83-b712-413c-8e4b-504037185d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:27.735072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0a83-b712-413c-8e4b-504037185d4d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.735420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0a83-b712-413c-8e4b-504037185d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.735693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0a83-b712-413c-8e4b-504037185d4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.751021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b0a83-b712-413c-8e4b-504037185d4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:27.751211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29becb46-dab6-47c5-a9ff-a2d1651513c2 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.751655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29becb46-dab6-47c5-a9ff-a2d1651513c2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.752026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29becb46-dab6-47c5-a9ff-a2d1651513c2 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.752976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b0a83-b712-413c-8e4b-504037185d4d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:27.754421 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 322/634] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:27.761158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d33a-4a03-443a-8529-efd4498df0ac None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.761435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d33a-4a03-443a-8529-efd4498df0ac None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.761705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d33a-4a03-443a-8529-efd4498df0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.771443 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-3e2b0a83-b712-413c-8e4b-504037185d4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:27.772970 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 313/635] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:27.779068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b0a83-b712-413c-8e4b-504037185d4d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:27.789040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b0a83-b712-413c-8e4b-504037185d4d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:27.794367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af8d06-514d-44f5-a4fa-254b382c0e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:27.795020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af8d06-514d-44f5-a4fa-254b382c0e30 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.795327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af8d06-514d-44f5-a4fa-254b382c0e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.795599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af8d06-514d-44f5-a4fa-254b382c0e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.796332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af8d06-514d-44f5-a4fa-254b382c0e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:27.796654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af8d06-514d-44f5-a4fa-254b382c0e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:27.798418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af8d06-514d-44f5-a4fa-254b382c0e30 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:27.804862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a386d33a-4a03-443a-8529-efd4498df0ac None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:27.806968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a386d33a-4a03-443a-8529-efd4498df0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:27.816044 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 314/636] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:27.822127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af8d06-514d-44f5-a4fa-254b382c0e30 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:27.832197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af8d06-514d-44f5-a4fa-254b382c0e30 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:27.836996 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 323/637] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:27.837594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad554259-8c09-458e-b0bf-ad520ecc998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:27.838499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad554259-8c09-458e-b0bf-ad520ecc998f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.838827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad554259-8c09-458e-b0bf-ad520ecc998f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.839103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad554259-8c09-458e-b0bf-ad520ecc998f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.848496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad554259-8c09-458e-b0bf-ad520ecc998f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:27.850606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad554259-8c09-458e-b0bf-ad520ecc998f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:27.864414 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-ad554259-8c09-458e-b0bf-ad520ecc998f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 27 20:31:27.865861 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 315/638] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:27 2021] GET /identity/v3/users/cinder => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:27.877433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386d33a-4a03-443a-8529-efd4498df0ac None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:27.885580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad554259-8c09-458e-b0bf-ad520ecc998f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:27.887558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386d33a-4a03-443a-8529-efd4498df0ac None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:27.899921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76bdf0-6704-445b-8297-f9fe74e5fe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:27.900913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad554259-8c09-458e-b0bf-ad520ecc998f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:27.901382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76bdf0-6704-445b-8297-f9fe74e5fe73 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.901861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76bdf0-6704-445b-8297-f9fe74e5fe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.902334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76bdf0-6704-445b-8297-f9fe74e5fe73 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.910402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc431fd5-ec26-4428-87f7-e5257ebe2b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:27.911770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431fd5-ec26-4428-87f7-e5257ebe2b84 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.912661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431fd5-ec26-4428-87f7-e5257ebe2b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.914081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431fd5-ec26-4428-87f7-e5257ebe2b84 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.916062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc431fd5-ec26-4428-87f7-e5257ebe2b84 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:27.917580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc431fd5-ec26-4428-87f7-e5257ebe2b84 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:27.920539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc431fd5-ec26-4428-87f7-e5257ebe2b84 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:27.925869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76bdf0-6704-445b-8297-f9fe74e5fe73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:27.937707 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-9b76bdf0-6704-445b-8297-f9fe74e5fe73 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:27.941765 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 324/639] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:27.955354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76bdf0-6704-445b-8297-f9fe74e5fe73 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:27.960112 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 316/640] 10.222.0.21 () {56 vars in 1158 bytes} [Sat Nov 27 20:31:27 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:27.969726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc431fd5-ec26-4428-87f7-e5257ebe2b84 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:27.970427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76bdf0-6704-445b-8297-f9fe74e5fe73 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:27.982343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ecbaf-2079-4804-a695-c24b17c751f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:27.984119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ecbaf-2079-4804-a695-c24b17c751f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:27.984399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ecbaf-2079-4804-a695-c24b17c751f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:27.984671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ecbaf-2079-4804-a695-c24b17c751f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:27.985674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ecbaf-2079-4804-a695-c24b17c751f6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:27.985979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ecbaf-2079-4804-a695-c24b17c751f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:27.989136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc431fd5-ec26-4428-87f7-e5257ebe2b84 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:27.991164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ecbaf-2079-4804-a695-c24b17c751f6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:27.999034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c04a8e-661b-47e6-9fe8-4102b3147492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.002271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c04a8e-661b-47e6-9fe8-4102b3147492 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.002561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c04a8e-661b-47e6-9fe8-4102b3147492 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.002835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c04a8e-661b-47e6-9fe8-4102b3147492 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.013223 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 325/641] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:28.020218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ecbaf-2079-4804-a695-c24b17c751f6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.026375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c04a8e-661b-47e6-9fe8-4102b3147492 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.028242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c04a8e-661b-47e6-9fe8-4102b3147492 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.040545 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 317/642] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:31:28.042098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ecbaf-2079-4804-a695-c24b17c751f6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.047045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c04a8e-661b-47e6-9fe8-4102b3147492 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.057857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c04a8e-661b-47e6-9fe8-4102b3147492 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.060445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294335f-43a0-445f-ac1e-c0707a9efd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.061256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294335f-43a0-445f-ac1e-c0707a9efd42 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.061643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294335f-43a0-445f-ac1e-c0707a9efd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.062030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294335f-43a0-445f-ac1e-c0707a9efd42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.062863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca963555-bc7e-4a0f-8ddc-41bc43c97746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.063725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca963555-bc7e-4a0f-8ddc-41bc43c97746 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.064282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca963555-bc7e-4a0f-8ddc-41bc43c97746 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.064561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca963555-bc7e-4a0f-8ddc-41bc43c97746 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.076013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca963555-bc7e-4a0f-8ddc-41bc43c97746 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.078295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca963555-bc7e-4a0f-8ddc-41bc43c97746 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.092349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294335f-43a0-445f-ac1e-c0707a9efd42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.094205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294335f-43a0-445f-ac1e-c0707a9efd42 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.097006 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-ca963555-bc7e-4a0f-8ddc-41bc43c97746 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:28.098503 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 318/643] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:28.105482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca963555-bc7e-4a0f-8ddc-41bc43c97746 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.116281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca963555-bc7e-4a0f-8ddc-41bc43c97746 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.121762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e1950-001b-48c6-bbc8-31636983355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.122463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1950-001b-48c6-bbc8-31636983355f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.122748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1950-001b-48c6-bbc8-31636983355f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.123022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1950-001b-48c6-bbc8-31636983355f admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.124072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e1950-001b-48c6-bbc8-31636983355f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.124375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e1950-001b-48c6-bbc8-31636983355f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.126023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e1950-001b-48c6-bbc8-31636983355f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.136064 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-d294335f-43a0-445f-ac1e-c0707a9efd42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:28.137656 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 326/644] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:28.143737 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 319/645] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:28.145392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294335f-43a0-445f-ac1e-c0707a9efd42 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.150407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e1950-001b-48c6-bbc8-31636983355f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.162981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294335f-43a0-445f-ac1e-c0707a9efd42 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.168242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e1950-001b-48c6-bbc8-31636983355f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.168765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1651-e7d1-4eae-964d-46f61771750d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.169681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1651-e7d1-4eae-964d-46f61771750d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.170298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1651-e7d1-4eae-964d-46f61771750d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.170744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1651-e7d1-4eae-964d-46f61771750d admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.171741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa1651-e7d1-4eae-964d-46f61771750d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.172216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa1651-e7d1-4eae-964d-46f61771750d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.174149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa1651-e7d1-4eae-964d-46f61771750d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.184518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baf5e7-a428-4cfb-bf15-67c688d06d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.184783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baf5e7-a428-4cfb-bf15-67c688d06d2e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.185277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baf5e7-a428-4cfb-bf15-67c688d06d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.185799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baf5e7-a428-4cfb-bf15-67c688d06d2e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.190862 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 327/646] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:28.198415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1651-e7d1-4eae-964d-46f61771750d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.208469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baf5e7-a428-4cfb-bf15-67c688d06d2e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.210453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baf5e7-a428-4cfb-bf15-67c688d06d2e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.211439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1651-e7d1-4eae-964d-46f61771750d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.216898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19edf6-7ebd-4eb3-8810-0c2258e0d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.217953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19edf6-7ebd-4eb3-8810-0c2258e0d3ed admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.218416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19edf6-7ebd-4eb3-8810-0c2258e0d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.218912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19edf6-7ebd-4eb3-8810-0c2258e0d3ed admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.228317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19edf6-7ebd-4eb3-8810-0c2258e0d3ed admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.230633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19edf6-7ebd-4eb3-8810-0c2258e0d3ed admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.235369 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-f4baf5e7-a428-4cfb-bf15-67c688d06d2e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:28.236562 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 320/647] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:28.243165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baf5e7-a428-4cfb-bf15-67c688d06d2e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.252762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baf5e7-a428-4cfb-bf15-67c688d06d2e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.257643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e42ab-4364-4354-9a4a-7de73800d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.258431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e42ab-4364-4354-9a4a-7de73800d4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.258956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e42ab-4364-4354-9a4a-7de73800d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.259488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e42ab-4364-4354-9a4a-7de73800d4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.260421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e42ab-4364-4354-9a4a-7de73800d4a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.260931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e42ab-4364-4354-9a4a-7de73800d4a7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.262820 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-3f19edf6-7ebd-4eb3-8810-0c2258e0d3ed admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 27 20:31:28.263184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e42ab-4364-4354-9a4a-7de73800d4a7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.268563 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 328/648] 10.222.0.21 () {56 vars in 1114 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:28.274634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19edf6-7ebd-4eb3-8810-0c2258e0d3ed admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.276846 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 321/649] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:28.282933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e42ab-4364-4354-9a4a-7de73800d4a7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.291232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19edf6-7ebd-4eb3-8810-0c2258e0d3ed admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.293245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e42ab-4364-4354-9a4a-7de73800d4a7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.298389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ab4d0-d982-4f8d-9f9e-6828677a2b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.299229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ab4d0-d982-4f8d-9f9e-6828677a2b6e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.299688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ab4d0-d982-4f8d-9f9e-6828677a2b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.300215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ab4d0-d982-4f8d-9f9e-6828677a2b6e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.301283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ab4d0-d982-4f8d-9f9e-6828677a2b6e admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=198c9372013440ec942a0192a73a231d) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.301761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ab4d0-d982-4f8d-9f9e-6828677a2b6e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.303860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ab4d0-d982-4f8d-9f9e-6828677a2b6e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.307903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574dbad-20f3-4c8b-938b-a31b27e64e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.308579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574dbad-20f3-4c8b-938b-a31b27e64e34 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.308865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574dbad-20f3-4c8b-938b-a31b27e64e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.309142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574dbad-20f3-4c8b-938b-a31b27e64e34 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.309985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574dbad-20f3-4c8b-938b-a31b27e64e34 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.310298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574dbad-20f3-4c8b-938b-a31b27e64e34 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.311964 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 322/650] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/role_assignments?user.id=198c9372013440ec942a0192a73a231d&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:28.315333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574dbad-20f3-4c8b-938b-a31b27e64e34 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.351451 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 329/651] 10.222.0.21 () {56 vars in 1154 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:28.357264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ab4d0-d982-4f8d-9f9e-6828677a2b6e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.372916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ab4d0-d982-4f8d-9f9e-6828677a2b6e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.381327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c4db9-4d49-4349-ae43-60264a3bfe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.382331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c4db9-4d49-4349-ae43-60264a3bfe8c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.382829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c4db9-4d49-4349-ae43-60264a3bfe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.383400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c4db9-4d49-4349-ae43-60264a3bfe8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.392702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c4db9-4d49-4349-ae43-60264a3bfe8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.394955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c4db9-4d49-4349-ae43-60264a3bfe8c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.405590 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 323/652] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:28.411786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574dbad-20f3-4c8b-938b-a31b27e64e34 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.434552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574dbad-20f3-4c8b-938b-a31b27e64e34 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.445545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4426106-fb1b-4bc2-8dfa-f342c6b9f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.446375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4426106-fb1b-4bc2-8dfa-f342c6b9f1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.446624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4426106-fb1b-4bc2-8dfa-f342c6b9f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.446897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4426106-fb1b-4bc2-8dfa-f342c6b9f1a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.469815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4426106-fb1b-4bc2-8dfa-f342c6b9f1a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.471623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4426106-fb1b-4bc2-8dfa-f342c6b9f1a8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.474701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4bf1-38b3-4517-ba58-b1f4720c018b None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.475268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4bf1-38b3-4517-ba58-b1f4720c018b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.475738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e4bf1-38b3-4517-ba58-b1f4720c018b None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.478032 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 324/653] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:28.495881 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-b4426106-fb1b-4bc2-8dfa-f342c6b9f1a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:28.497922 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 330/654] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:28.499902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6878a76-058d-4083-981d-63b330050f71 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.500017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99e499-7126-4b3f-9db6-da17ea221229 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.500283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99e499-7126-4b3f-9db6-da17ea221229 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.500448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6878a76-058d-4083-981d-63b330050f71 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.500605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99e499-7126-4b3f-9db6-da17ea221229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.500718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6878a76-058d-4083-981d-63b330050f71 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.502589 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 331/655] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:28.503481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6878a76-058d-4083-981d-63b330050f71 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.523744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6878a76-058d-4083-981d-63b330050f71 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.524967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cd99e499-7126-4b3f-9db6-da17ea221229 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:28.526276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cd99e499-7126-4b3f-9db6-da17ea221229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:28.528583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087314b-15fd-4140-a7ea-c8370f671a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.529367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087314b-15fd-4140-a7ea-c8370f671a28 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.529653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087314b-15fd-4140-a7ea-c8370f671a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.529930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087314b-15fd-4140-a7ea-c8370f671a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.530733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087314b-15fd-4140-a7ea-c8370f671a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.531044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087314b-15fd-4140-a7ea-c8370f671a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.532822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087314b-15fd-4140-a7ea-c8370f671a28 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.534792 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 325/656] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:28.536131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425488-56e4-4bfc-9a37-1b5f59b03f34 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.536423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425488-56e4-4bfc-9a37-1b5f59b03f34 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.536700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425488-56e4-4bfc-9a37-1b5f59b03f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.557499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c7425488-56e4-4bfc-9a37-1b5f59b03f34 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:28.558669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c7425488-56e4-4bfc-9a37-1b5f59b03f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:28.562019 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 332/657] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:28.567023 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 326/658] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:28.567646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087314b-15fd-4140-a7ea-c8370f671a28 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.579701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7425488-56e4-4bfc-9a37-1b5f59b03f34 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.586926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087314b-15fd-4140-a7ea-c8370f671a28 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.589683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7425488-56e4-4bfc-9a37-1b5f59b03f34 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.594254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601bc8-2d60-428a-8f37-7baa06b4629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.595147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601bc8-2d60-428a-8f37-7baa06b4629e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.595457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601bc8-2d60-428a-8f37-7baa06b4629e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.595824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7601bc8-2d60-428a-8f37-7baa06b4629e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.597250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f64a1-2e6c-465b-9675-f5c3c87ca120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.598319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f64a1-2e6c-465b-9675-f5c3c87ca120 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.598890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f64a1-2e6c-465b-9675-f5c3c87ca120 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.599413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f64a1-2e6c-465b-9675-f5c3c87ca120 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.607646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7601bc8-2d60-428a-8f37-7baa06b4629e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:28.610265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f64a1-2e6c-465b-9675-f5c3c87ca120 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.612401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f64a1-2e6c-465b-9675-f5c3c87ca120 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.614507 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-f7601bc8-2d60-428a-8f37-7baa06b4629e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:28.615936 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 327/659] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:28.617065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601bc8-2d60-428a-8f37-7baa06b4629e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.629807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7601bc8-2d60-428a-8f37-7baa06b4629e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.630610 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-d81f64a1-2e6c-465b-9675-f5c3c87ca120 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:28.631947 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 333/660] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:28.632872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f64a1-2e6c-465b-9675-f5c3c87ca120 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.637325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9c44a-386a-4ea7-a671-ddc7c2b13d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.638587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9c44a-386a-4ea7-a671-ddc7c2b13d04 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.639464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9c44a-386a-4ea7-a671-ddc7c2b13d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.640291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9c44a-386a-4ea7-a671-ddc7c2b13d04 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.643013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f64a1-2e6c-465b-9675-f5c3c87ca120 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.649086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb1c1c-de10-445b-a142-996e16f7dddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.649744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1c1c-de10-445b-a142-996e16f7dddf admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.650028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1c1c-de10-445b-a142-996e16f7dddf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.650304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1c1c-de10-445b-a142-996e16f7dddf admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.651068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb1c1c-de10-445b-a142-996e16f7dddf admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.651394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb1c1c-de10-445b-a142-996e16f7dddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.652969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb1c1c-de10-445b-a142-996e16f7dddf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.653284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9c44a-386a-4ea7-a671-ddc7c2b13d04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:28.660303 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d1d9c44a-386a-4ea7-a671-ddc7c2b13d04 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:28.661536 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 328/661] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:28.662956 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 334/662] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:28.667494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9c44a-386a-4ea7-a671-ddc7c2b13d04 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.669290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb1c1c-de10-445b-a142-996e16f7dddf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.678745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9c44a-386a-4ea7-a671-ddc7c2b13d04 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.681289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb1c1c-de10-445b-a142-996e16f7dddf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.683466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f15e9-a7ad-4b07-ba55-2da071bf9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.684113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f15e9-a7ad-4b07-ba55-2da071bf9c2f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.684399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f15e9-a7ad-4b07-ba55-2da071bf9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.684676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f15e9-a7ad-4b07-ba55-2da071bf9c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.685477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f15e9-a7ad-4b07-ba55-2da071bf9c2f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.685788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f15e9-a7ad-4b07-ba55-2da071bf9c2f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.687599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70328d15-9b61-4933-b686-b49610ba99b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.687725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f15e9-a7ad-4b07-ba55-2da071bf9c2f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.688650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70328d15-9b61-4933-b686-b49610ba99b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.689067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70328d15-9b61-4933-b686-b49610ba99b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.689512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70328d15-9b61-4933-b686-b49610ba99b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.701870 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 329/663] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:28.702696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f15e9-a7ad-4b07-ba55-2da071bf9c2f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.704821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70328d15-9b61-4933-b686-b49610ba99b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.706913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70328d15-9b61-4933-b686-b49610ba99b4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.712784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f15e9-a7ad-4b07-ba55-2da071bf9c2f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.717598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668949e-47a0-481a-aae2-2e5a3df5dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.718304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668949e-47a0-481a-aae2-2e5a3df5dd3a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.718589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668949e-47a0-481a-aae2-2e5a3df5dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.718862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668949e-47a0-481a-aae2-2e5a3df5dd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.719715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668949e-47a0-481a-aae2-2e5a3df5dd3a admin admin] RBAC: Adding query filter params (name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.720074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668949e-47a0-481a-aae2-2e5a3df5dd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.721739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668949e-47a0-481a-aae2-2e5a3df5dd3a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.730032 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-70328d15-9b61-4933-b686-b49610ba99b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:28.730887 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 330/664] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:28.731705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668949e-47a0-481a-aae2-2e5a3df5dd3a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.732425 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 335/665] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:28.737370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70328d15-9b61-4933-b686-b49610ba99b4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.747293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668949e-47a0-481a-aae2-2e5a3df5dd3a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.749515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70328d15-9b61-4933-b686-b49610ba99b4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.752202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09a013-b314-4130-8278-6ccc0a9d5755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.752946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09a013-b314-4130-8278-6ccc0a9d5755 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.753233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09a013-b314-4130-8278-6ccc0a9d5755 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.753516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09a013-b314-4130-8278-6ccc0a9d5755 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.754434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09a013-b314-4130-8278-6ccc0a9d5755 admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=aa3373ab52dc4fe680372579cfcde718) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.754762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09a013-b314-4130-8278-6ccc0a9d5755 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.756165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd32360-e9ad-4cae-af9b-1839d2338f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.756735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09a013-b314-4130-8278-6ccc0a9d5755 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.758083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd32360-e9ad-4cae-af9b-1839d2338f63 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.758578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd32360-e9ad-4cae-af9b-1839d2338f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.759109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd32360-e9ad-4cae-af9b-1839d2338f63 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.764212 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 331/666] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/role_assignments?user.id=aa3373ab52dc4fe680372579cfcde718&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:28.765089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09a013-b314-4130-8278-6ccc0a9d5755 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.772042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd32360-e9ad-4cae-af9b-1839d2338f63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.774508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd32360-e9ad-4cae-af9b-1839d2338f63 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.776684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09a013-b314-4130-8278-6ccc0a9d5755 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.781818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9282c-6b71-4807-acb4-bd2589311b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.782468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9282c-6b71-4807-acb4-bd2589311b5a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.782753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9282c-6b71-4807-acb4-bd2589311b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.783026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9282c-6b71-4807-acb4-bd2589311b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.784268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9282c-6b71-4807-acb4-bd2589311b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.784759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9282c-6b71-4807-acb4-bd2589311b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.786976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9282c-6b71-4807-acb4-bd2589311b5a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.796069 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-dbd32360-e9ad-4cae-af9b-1839d2338f63 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:28.797730 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 336/667] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:28.803356 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 332/668] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:28.807324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd32360-e9ad-4cae-af9b-1839d2338f63 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.807706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9282c-6b71-4807-acb4-bd2589311b5a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.818394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9282c-6b71-4807-acb4-bd2589311b5a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.824896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fada50-cbc2-496e-b58a-385509581ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.825718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fada50-cbc2-496e-b58a-385509581ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.825986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fada50-cbc2-496e-b58a-385509581ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.826259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fada50-cbc2-496e-b58a-385509581ad2 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.826613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd32360-e9ad-4cae-af9b-1839d2338f63 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.837076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fada50-cbc2-496e-b58a-385509581ad2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.839327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fada50-cbc2-496e-b58a-385509581ad2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.839615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f882c-88fc-4507-9851-abdf414e060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.840654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f882c-88fc-4507-9851-abdf414e060f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.841142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f882c-88fc-4507-9851-abdf414e060f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.841643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f882c-88fc-4507-9851-abdf414e060f admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.842606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f882c-88fc-4507-9851-abdf414e060f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.843140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f882c-88fc-4507-9851-abdf414e060f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.845007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f882c-88fc-4507-9851-abdf414e060f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.856821 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-36fada50-cbc2-496e-b58a-385509581ad2 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 27 20:31:28.863438 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 333/669] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/users/glance => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:28.866318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fada50-cbc2-496e-b58a-385509581ad2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.878185 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 337/670] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:28.878901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fada50-cbc2-496e-b58a-385509581ad2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.884379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f882c-88fc-4507-9851-abdf414e060f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.884679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dea1a-ba07-4cd0-bc17-8be9cd3bd715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.885367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dea1a-ba07-4cd0-bc17-8be9cd3bd715 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.885650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dea1a-ba07-4cd0-bc17-8be9cd3bd715 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.885930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dea1a-ba07-4cd0-bc17-8be9cd3bd715 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.886848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dea1a-ba07-4cd0-bc17-8be9cd3bd715 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:28.887163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dea1a-ba07-4cd0-bc17-8be9cd3bd715 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.889256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dea1a-ba07-4cd0-bc17-8be9cd3bd715 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.901876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f882c-88fc-4507-9851-abdf414e060f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.910978 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 334/671] 10.222.0.21 () {56 vars in 1158 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:28.918009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dea1a-ba07-4cd0-bc17-8be9cd3bd715 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.930641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dea1a-ba07-4cd0-bc17-8be9cd3bd715 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.931814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b35b9-397d-4adf-88e5-6b695fc11205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.933063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b35b9-397d-4adf-88e5-6b695fc11205 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.933641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b35b9-397d-4adf-88e5-6b695fc11205 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.934117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b35b9-397d-4adf-88e5-6b695fc11205 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.938107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19735d-5796-40d3-996b-d60e7cc27c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.938107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19735d-5796-40d3-996b-d60e7cc27c41 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.938107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19735d-5796-40d3-996b-d60e7cc27c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.938107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19735d-5796-40d3-996b-d60e7cc27c41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.948424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19735d-5796-40d3-996b-d60e7cc27c41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.950635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19735d-5796-40d3-996b-d60e7cc27c41 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.960834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b35b9-397d-4adf-88e5-6b695fc11205 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:28.963151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b35b9-397d-4adf-88e5-6b695fc11205 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:28.967282 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 335/672] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:31:28.969315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19735d-5796-40d3-996b-d60e7cc27c41 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:28.980172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19735d-5796-40d3-996b-d60e7cc27c41 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:28.985490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399bba4-1310-442c-8ff3-b2c0d43d79db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:28.986413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bba4-1310-442c-8ff3-b2c0d43d79db admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:28.986862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bba4-1310-442c-8ff3-b2c0d43d79db admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:28.987300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399bba4-1310-442c-8ff3-b2c0d43d79db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:28.999531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399bba4-1310-442c-8ff3-b2c0d43d79db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.001697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399bba4-1310-442c-8ff3-b2c0d43d79db admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.002646 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-8e3b35b9-397d-4adf-88e5-6b695fc11205 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 27 20:31:29.004394 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 338/673] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/users/neutron => generated 85 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:29.010714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b35b9-397d-4adf-88e5-6b695fc11205 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.023588 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-0399bba4-1310-442c-8ff3-b2c0d43d79db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:29.025807 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 336/674] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:29.029823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b35b9-397d-4adf-88e5-6b695fc11205 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.033861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399bba4-1310-442c-8ff3-b2c0d43d79db admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.043631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399bba4-1310-442c-8ff3-b2c0d43d79db admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.044639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17e70a-f718-4ccc-b787-ff7b2f11c616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.045325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17e70a-f718-4ccc-b787-ff7b2f11c616 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.045654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17e70a-f718-4ccc-b787-ff7b2f11c616 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.045884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17e70a-f718-4ccc-b787-ff7b2f11c616 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.046848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17e70a-f718-4ccc-b787-ff7b2f11c616 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.047162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17e70a-f718-4ccc-b787-ff7b2f11c616 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.048909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133b417-c562-4c4d-bcbe-c1b0bf81eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.049040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17e70a-f718-4ccc-b787-ff7b2f11c616 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.049559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133b417-c562-4c4d-bcbe-c1b0bf81eeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.049840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133b417-c562-4c4d-bcbe-c1b0bf81eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.050119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133b417-c562-4c4d-bcbe-c1b0bf81eeb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.050855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133b417-c562-4c4d-bcbe-c1b0bf81eeb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.051166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133b417-c562-4c4d-bcbe-c1b0bf81eeb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.053281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133b417-c562-4c4d-bcbe-c1b0bf81eeb8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.071380 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 337/675] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:29.073983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133b417-c562-4c4d-bcbe-c1b0bf81eeb8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.081678 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 339/676] 10.222.0.21 () {56 vars in 1160 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:29.086801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133b417-c562-4c4d-bcbe-c1b0bf81eeb8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.087772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17e70a-f718-4ccc-b787-ff7b2f11c616 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.092027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fa082-e494-4be2-a732-9de0c3fe1801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.093216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fa082-e494-4be2-a732-9de0c3fe1801 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.093660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fa082-e494-4be2-a732-9de0c3fe1801 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.094635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fa082-e494-4be2-a732-9de0c3fe1801 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.098544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17e70a-f718-4ccc-b787-ff7b2f11c616 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.103361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fa082-e494-4be2-a732-9de0c3fe1801 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.104688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa69cb-b473-4e4d-9404-f63f5b8d824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.105424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa69cb-b473-4e4d-9404-f63f5b8d824b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.105861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa69cb-b473-4e4d-9404-f63f5b8d824b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.106214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fa082-e494-4be2-a732-9de0c3fe1801 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.106328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa69cb-b473-4e4d-9404-f63f5b8d824b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.117629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa69cb-b473-4e4d-9404-f63f5b8d824b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.119626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa69cb-b473-4e4d-9404-f63f5b8d824b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.124210 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-df7fa082-e494-4be2-a732-9de0c3fe1801 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:29.127158 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 338/677] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:29.133553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fa082-e494-4be2-a732-9de0c3fe1801 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.136482 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 340/678] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:31:29.141810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa69cb-b473-4e4d-9404-f63f5b8d824b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.145395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fa082-e494-4be2-a732-9de0c3fe1801 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.151906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b32d7-f98f-4f79-8d06-e65fb05b8a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.152191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa69cb-b473-4e4d-9404-f63f5b8d824b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.153055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b32d7-f98f-4f79-8d06-e65fb05b8a42 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.153521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b32d7-f98f-4f79-8d06-e65fb05b8a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.154068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b32d7-f98f-4f79-8d06-e65fb05b8a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.155276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b32d7-f98f-4f79-8d06-e65fb05b8a42 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.155824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b32d7-f98f-4f79-8d06-e65fb05b8a42 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.157516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2c30b-fcae-4c26-89ea-868e0702d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.158391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2c30b-fcae-4c26-89ea-868e0702d0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.158743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b32d7-f98f-4f79-8d06-e65fb05b8a42 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.158943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2c30b-fcae-4c26-89ea-868e0702d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.159359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2c30b-fcae-4c26-89ea-868e0702d0b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.171777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2c30b-fcae-4c26-89ea-868e0702d0b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.173730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2c30b-fcae-4c26-89ea-868e0702d0b4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.173921 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 339/679] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:29.180879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b32d7-f98f-4f79-8d06-e65fb05b8a42 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.190464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b32d7-f98f-4f79-8d06-e65fb05b8a42 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.195170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36791117-c481-4181-8b47-1a2f2db39066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.195938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36791117-c481-4181-8b47-1a2f2db39066 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.196322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36791117-c481-4181-8b47-1a2f2db39066 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.196726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36791117-c481-4181-8b47-1a2f2db39066 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.197026 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-d0a2c30b-fcae-4c26-89ea-868e0702d0b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:29.197763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36791117-c481-4181-8b47-1a2f2db39066 admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=7e4c41e7988043c0b3b8e338ccd31d37) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.198178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36791117-c481-4181-8b47-1a2f2db39066 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.198751 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 341/680] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:29.200855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36791117-c481-4181-8b47-1a2f2db39066 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.208201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2c30b-fcae-4c26-89ea-868e0702d0b4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.211928 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 340/681] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/role_assignments?user.id=7e4c41e7988043c0b3b8e338ccd31d37&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:29.218493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2c30b-fcae-4c26-89ea-868e0702d0b4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.224542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4a8e7-7bc6-4fb1-a0b3-01d8e739f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.225217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4a8e7-7bc6-4fb1-a0b3-01d8e739f921 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.225490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4a8e7-7bc6-4fb1-a0b3-01d8e739f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.225829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4a8e7-7bc6-4fb1-a0b3-01d8e739f921 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.226582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4a8e7-7bc6-4fb1-a0b3-01d8e739f921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.226883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4a8e7-7bc6-4fb1-a0b3-01d8e739f921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.228569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4a8e7-7bc6-4fb1-a0b3-01d8e739f921 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.243077 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 342/682] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:29.249543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36791117-c481-4181-8b47-1a2f2db39066 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.271519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36791117-c481-4181-8b47-1a2f2db39066 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.279701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0d13-80d4-4ed5-a676-1c2cb7cd6a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.280806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0d13-80d4-4ed5-a676-1c2cb7cd6a24 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.281314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0d13-80d4-4ed5-a676-1c2cb7cd6a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.281733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0d13-80d4-4ed5-a676-1c2cb7cd6a24 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.292517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0d13-80d4-4ed5-a676-1c2cb7cd6a24 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.294717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0d13-80d4-4ed5-a676-1c2cb7cd6a24 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.314323 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-a07b0d13-80d4-4ed5-a676-1c2cb7cd6a24 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:29.315925 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 341/683] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:29.322604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4a8e7-7bc6-4fb1-a0b3-01d8e739f921 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.341108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4a8e7-7bc6-4fb1-a0b3-01d8e739f921 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.357062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea9db8-f651-4fdf-ad51-07ae7f5933b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.357748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9db8-f651-4fdf-ad51-07ae7f5933b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.358030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9db8-f651-4fdf-ad51-07ae7f5933b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.358302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea9db8-f651-4fdf-ad51-07ae7f5933b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.362534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea9db8-f651-4fdf-ad51-07ae7f5933b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.362891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea9db8-f651-4fdf-ad51-07ae7f5933b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.364820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea9db8-f651-4fdf-ad51-07ae7f5933b1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.385726 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 343/684] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:29.391855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0d13-80d4-4ed5-a676-1c2cb7cd6a24 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.405628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0d13-80d4-4ed5-a676-1c2cb7cd6a24 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.415764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291204fe-6cab-4eac-8e8e-4f6922d009cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.416515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291204fe-6cab-4eac-8e8e-4f6922d009cd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.416866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291204fe-6cab-4eac-8e8e-4f6922d009cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.417206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291204fe-6cab-4eac-8e8e-4f6922d009cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.418131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291204fe-6cab-4eac-8e8e-4f6922d009cd admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=10914bd6817341eeafda6c3ded4ecfc3) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.418515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291204fe-6cab-4eac-8e8e-4f6922d009cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.419624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149226a-6d13-4b18-b67a-93e9b1df6a9d None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.419907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149226a-6d13-4b18-b67a-93e9b1df6a9d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.420177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149226a-6d13-4b18-b67a-93e9b1df6a9d None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.420668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291204fe-6cab-4eac-8e8e-4f6922d009cd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.422119 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 344/685] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:31:29.427815 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 342/686] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/role_assignments?user.id=10914bd6817341eeafda6c3ded4ecfc3&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:29.434112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1c0d2-173e-4f62-83ad-5928cb9fd445 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.434494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1c0d2-173e-4f62-83ad-5928cb9fd445 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.434834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1c0d2-173e-4f62-83ad-5928cb9fd445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.461077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-77d1c0d2-173e-4f62-83ad-5928cb9fd445 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:29.462173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-77d1c0d2-173e-4f62-83ad-5928cb9fd445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:29.471154 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 345/687] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:29.497425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291204fe-6cab-4eac-8e8e-4f6922d009cd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.516401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291204fe-6cab-4eac-8e8e-4f6922d009cd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.521573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c5052-753e-401d-8690-b941b7c250ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.522496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c5052-753e-401d-8690-b941b7c250ae admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.522985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c5052-753e-401d-8690-b941b7c250ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.523370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c5052-753e-401d-8690-b941b7c250ae admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.540525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c5052-753e-401d-8690-b941b7c250ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:29.547968 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-b83c5052-753e-401d-8690-b941b7c250ae admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:29.549624 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 343/688] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:29.556287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1c0d2-173e-4f62-83ad-5928cb9fd445 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.566136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1c0d2-173e-4f62-83ad-5928cb9fd445 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.571736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64c50c-3b3e-4ee6-b126-8b68cc384546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.572578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64c50c-3b3e-4ee6-b126-8b68cc384546 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.572932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64c50c-3b3e-4ee6-b126-8b68cc384546 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.573279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64c50c-3b3e-4ee6-b126-8b68cc384546 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.574169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64c50c-3b3e-4ee6-b126-8b68cc384546 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.574555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64c50c-3b3e-4ee6-b126-8b68cc384546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.576384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64c50c-3b3e-4ee6-b126-8b68cc384546 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.586557 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 346/689] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:29.592840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c5052-753e-401d-8690-b941b7c250ae admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.603705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c5052-753e-401d-8690-b941b7c250ae admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.609538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226b43-6dee-4d6b-bf24-0d74cb07f936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.610352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226b43-6dee-4d6b-bf24-0d74cb07f936 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.610634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226b43-6dee-4d6b-bf24-0d74cb07f936 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.610904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226b43-6dee-4d6b-bf24-0d74cb07f936 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.623401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd226b43-6dee-4d6b-bf24-0d74cb07f936 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.625541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd226b43-6dee-4d6b-bf24-0d74cb07f936 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.643708 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-cd226b43-6dee-4d6b-bf24-0d74cb07f936 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:29.645282 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 344/690] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:29.651547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64c50c-3b3e-4ee6-b126-8b68cc384546 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.661642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64c50c-3b3e-4ee6-b126-8b68cc384546 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.666773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a532d59-69ab-4dd1-9d0c-1c924a22aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.667506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a532d59-69ab-4dd1-9d0c-1c924a22aee9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.667791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a532d59-69ab-4dd1-9d0c-1c924a22aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.668064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a532d59-69ab-4dd1-9d0c-1c924a22aee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.668802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a532d59-69ab-4dd1-9d0c-1c924a22aee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.669106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a532d59-69ab-4dd1-9d0c-1c924a22aee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.670687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a532d59-69ab-4dd1-9d0c-1c924a22aee9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.682799 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 347/691] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:29.688782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226b43-6dee-4d6b-bf24-0d74cb07f936 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.699315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226b43-6dee-4d6b-bf24-0d74cb07f936 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.704029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1e9c9-86cd-48d9-b84b-3ff831c9289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.704865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1e9c9-86cd-48d9-b84b-3ff831c9289d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.705150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1e9c9-86cd-48d9-b84b-3ff831c9289d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.705423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1e9c9-86cd-48d9-b84b-3ff831c9289d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.713850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1e9c9-86cd-48d9-b84b-3ff831c9289d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.715915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1e9c9-86cd-48d9-b84b-3ff831c9289d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.730136 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-98f1e9c9-86cd-48d9-b84b-3ff831c9289d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 27 20:31:29.731365 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 345/692] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:29.737587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a532d59-69ab-4dd1-9d0c-1c924a22aee9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.747855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a532d59-69ab-4dd1-9d0c-1c924a22aee9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.753730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc4e8b-d2e1-4508-87b3-df90eb98d6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.754499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc4e8b-d2e1-4508-87b3-df90eb98d6fb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.754854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc4e8b-d2e1-4508-87b3-df90eb98d6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.755201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc4e8b-d2e1-4508-87b3-df90eb98d6fb admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.756148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc4e8b-d2e1-4508-87b3-df90eb98d6fb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.756531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc4e8b-d2e1-4508-87b3-df90eb98d6fb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.758975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc4e8b-d2e1-4508-87b3-df90eb98d6fb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.777890 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 348/693] 10.222.0.21 () {56 vars in 1156 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:29.783616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1e9c9-86cd-48d9-b84b-3ff831c9289d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.793580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1e9c9-86cd-48d9-b84b-3ff831c9289d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.798326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155c9b4-c01c-4efe-81b1-d9823142fc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.799180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155c9b4-c01c-4efe-81b1-d9823142fc84 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.799497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155c9b4-c01c-4efe-81b1-d9823142fc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.799769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155c9b4-c01c-4efe-81b1-d9823142fc84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.813447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155c9b4-c01c-4efe-81b1-d9823142fc84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.815430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155c9b4-c01c-4efe-81b1-d9823142fc84 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.833304 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-7155c9b4-c01c-4efe-81b1-d9823142fc84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:29.834809 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 346/694] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:29.842259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc4e8b-d2e1-4508-87b3-df90eb98d6fb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.850659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc4e8b-d2e1-4508-87b3-df90eb98d6fb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.855276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5adfd7-2589-4a12-a980-1e08e26def6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.855938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5adfd7-2589-4a12-a980-1e08e26def6c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.856218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5adfd7-2589-4a12-a980-1e08e26def6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.856491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5adfd7-2589-4a12-a980-1e08e26def6c admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.857221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5adfd7-2589-4a12-a980-1e08e26def6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.857527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5adfd7-2589-4a12-a980-1e08e26def6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.859121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5adfd7-2589-4a12-a980-1e08e26def6c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.871810 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 349/695] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:29.878065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155c9b4-c01c-4efe-81b1-d9823142fc84 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.888452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155c9b4-c01c-4efe-81b1-d9823142fc84 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.893128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a4f02-c700-4573-adbb-20add50afdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.893947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a4f02-c700-4573-adbb-20add50afdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.894244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a4f02-c700-4573-adbb-20add50afdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.894551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a4f02-c700-4573-adbb-20add50afdf5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.902490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a4f02-c700-4573-adbb-20add50afdf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.904562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a4f02-c700-4573-adbb-20add50afdf5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.918634 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-161a4f02-c700-4573-adbb-20add50afdf5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:29.919903 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 347/696] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:29.926202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5adfd7-2589-4a12-a980-1e08e26def6c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.936839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5adfd7-2589-4a12-a980-1e08e26def6c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.941477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513d3cf-b2c4-46b7-aa6a-8c3854d938e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.942183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d3cf-b2c4-46b7-aa6a-8c3854d938e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.942464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d3cf-b2c4-46b7-aa6a-8c3854d938e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.942788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d3cf-b2c4-46b7-aa6a-8c3854d938e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:29.943691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513d3cf-b2c4-46b7-aa6a-8c3854d938e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:29.944053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513d3cf-b2c4-46b7-aa6a-8c3854d938e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:29.946100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513d3cf-b2c4-46b7-aa6a-8c3854d938e0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:29.959434 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 350/697] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:29.966300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a4f02-c700-4573-adbb-20add50afdf5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:29.976825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a4f02-c700-4573-adbb-20add50afdf5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:29.981620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872b567-c863-4b69-b154-7d8eb71def34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:29.982543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872b567-c863-4b69-b154-7d8eb71def34 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:29.982828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872b567-c863-4b69-b154-7d8eb71def34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:29.983100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872b567-c863-4b69-b154-7d8eb71def34 admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/f39a303b702041259ebb6a66c5967528/roles/9442d70924794d1d9b528d5b470a7366` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:30.000566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872b567-c863-4b69-b154-7d8eb71def34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=f39a303b702041259ebb6a66c5967528, role_id=9442d70924794d1d9b528d5b470a7366)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:30.003141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872b567-c863-4b69-b154-7d8eb71def34 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:30.024189 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 348/698] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:31:29 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/f39a303b702041259ebb6a66c5967528/roles/9442d70924794d1d9b528d5b470a7366 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:31.215289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035425b-2ced-4c02-812a-4fc90aa2193f None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:31.215289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035425b-2ced-4c02-812a-4fc90aa2193f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:31.215289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035425b-2ced-4c02-812a-4fc90aa2193f None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:31.217810 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 351/699] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:31.225035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646e69-6aa4-4735-a77c-6d6f93203210 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:31.226137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646e69-6aa4-4735-a77c-6d6f93203210 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:31.226137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4646e69-6aa4-4735-a77c-6d6f93203210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:31.251581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c4646e69-6aa4-4735-a77c-6d6f93203210 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:31.252753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c4646e69-6aa4-4735-a77c-6d6f93203210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:31.330952 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 349/700] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 27 20:31:31.371434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035425b-2ced-4c02-812a-4fc90aa2193f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:31.401696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035425b-2ced-4c02-812a-4fc90aa2193f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:31.413355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a2599-b67a-4515-a273-e8c2ad1fc3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:31.414530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a2599-b67a-4515-a273-e8c2ad1fc3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:31.415022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a2599-b67a-4515-a273-e8c2ad1fc3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:31.415528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a2599-b67a-4515-a273-e8c2ad1fc3f9 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:31.416499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a2599-b67a-4515-a273-e8c2ad1fc3f9 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:31.417977 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-1d2a2599-b67a-4515-a273-e8c2ad1fc3f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:31.417977 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:31:31.417977 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:31:31.419222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a2599-b67a-4515-a273-e8c2ad1fc3f9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:31.463276 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-1d2a2599-b67a-4515-a273-e8c2ad1fc3f9 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 27 20:31:31.465846 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 352/701] 10.222.0.21 () {56 vars in 1150 bytes} [Sat Nov 27 20:31:31 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:31.472527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4646e69-6aa4-4735-a77c-6d6f93203210 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:31.488760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4646e69-6aa4-4735-a77c-6d6f93203210 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:31.497126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fffc51-88b7-4b95-8574-8493a32b5799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:31.497789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fffc51-88b7-4b95-8574-8493a32b5799 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:31.498067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fffc51-88b7-4b95-8574-8493a32b5799 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:31.498337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fffc51-88b7-4b95-8574-8493a32b5799 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:31.499332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fffc51-88b7-4b95-8574-8493a32b5799 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:31.499637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fffc51-88b7-4b95-8574-8493a32b5799 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:31.500649 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-b3fffc51-88b7-4b95-8574-8493a32b5799 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:31.500649 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:31:31.500649 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:31:31.501530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fffc51-88b7-4b95-8574-8493a32b5799 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:31.510463 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 350/702] 10.222.0.21 () {56 vars in 1145 bytes} [Sat Nov 27 20:31:31 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:31.516724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a2599-b67a-4515-a273-e8c2ad1fc3f9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:31.536516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a2599-b67a-4515-a273-e8c2ad1fc3f9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:31.552913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92076050-ecf1-4424-9496-d708c5ece9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:31.553576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076050-ecf1-4424-9496-d708c5ece9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:31.558454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076050-ecf1-4424-9496-d708c5ece9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:31.558454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92076050-ecf1-4424-9496-d708c5ece9f4 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:31.558454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92076050-ecf1-4424-9496-d708c5ece9f4 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:31.558454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92076050-ecf1-4424-9496-d708c5ece9f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:31.558454 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-92076050-ecf1-4424-9496-d708c5ece9f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:31.558454 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:31:31.558454 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:31:31.558921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92076050-ecf1-4424-9496-d708c5ece9f4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:31.572627 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 353/703] 10.222.0.21 () {56 vars in 1145 bytes} [Sat Nov 27 20:31:31 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:32.327796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f0e32-bf24-4836-8607-66bdcc47e8bc None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.327796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f0e32-bf24-4836-8607-66bdcc47e8bc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.327796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f0e32-bf24-4836-8607-66bdcc47e8bc None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.328960 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 351/704] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:32.333724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c552dec-d3fb-4e1e-8bfa-79aef9ccf254 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.334521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c552dec-d3fb-4e1e-8bfa-79aef9ccf254 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.335076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c552dec-d3fb-4e1e-8bfa-79aef9ccf254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.356885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9c552dec-d3fb-4e1e-8bfa-79aef9ccf254 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:32.358402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9c552dec-d3fb-4e1e-8bfa-79aef9ccf254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:32.370958 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 354/705] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:32.420816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f0e32-bf24-4836-8607-66bdcc47e8bc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.452504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f0e32-bf24-4836-8607-66bdcc47e8bc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.457277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e2b66-a20e-4922-bc5a-65f4497688d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.458296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e2b66-a20e-4922-bc5a-65f4497688d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.458919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e2b66-a20e-4922-bc5a-65f4497688d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.459444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e2b66-a20e-4922-bc5a-65f4497688d3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.474017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e2b66-a20e-4922-bc5a-65f4497688d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:32.485744 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-8c4e2b66-a20e-4922-bc5a-65f4497688d3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:31:32.487282 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 352/706] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:32.493674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c552dec-d3fb-4e1e-8bfa-79aef9ccf254 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.503463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c552dec-d3fb-4e1e-8bfa-79aef9ccf254 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.514288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e08b2-e03e-421a-ad9e-37422ec4685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.515215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e08b2-e03e-421a-ad9e-37422ec4685f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.515863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e08b2-e03e-421a-ad9e-37422ec4685f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.516345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e08b2-e03e-421a-ad9e-37422ec4685f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.517327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e08b2-e03e-421a-ad9e-37422ec4685f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:32.517848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e08b2-e03e-421a-ad9e-37422ec4685f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:32.519678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e08b2-e03e-421a-ad9e-37422ec4685f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:32.528513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a22c7-f42a-48ff-80cf-bc81d9bbea1a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.528800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a22c7-f42a-48ff-80cf-bc81d9bbea1a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.529188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a22c7-f42a-48ff-80cf-bc81d9bbea1a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.530762 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 355/707] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:32.531155 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 353/708] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:31:32.536895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e08b2-e03e-421a-ad9e-37422ec4685f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.542544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ec1d2-aa37-40d2-b345-2beb7bc4d626 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.542940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ec1d2-aa37-40d2-b345-2beb7bc4d626 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.543077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ec1d2-aa37-40d2-b345-2beb7bc4d626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.548569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e08b2-e03e-421a-ad9e-37422ec4685f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.561630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78eda5-70ce-42fe-a807-00e4bcfb5880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.561953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4b4ec1d2-aa37-40d2-b345-2beb7bc4d626 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:32.562969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78eda5-70ce-42fe-a807-00e4bcfb5880 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.563078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4b4ec1d2-aa37-40d2-b345-2beb7bc4d626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:32.563573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78eda5-70ce-42fe-a807-00e4bcfb5880 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.564151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78eda5-70ce-42fe-a807-00e4bcfb5880 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.579464 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 354/709] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:32.581072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78eda5-70ce-42fe-a807-00e4bcfb5880 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:32.583123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78eda5-70ce-42fe-a807-00e4bcfb5880 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:32.597190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ec1d2-aa37-40d2-b345-2beb7bc4d626 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.607462 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-5d78eda5-70ce-42fe-a807-00e4bcfb5880 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:32.614610 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 356/710] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:32.617929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ec1d2-aa37-40d2-b345-2beb7bc4d626 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.619024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78eda5-70ce-42fe-a807-00e4bcfb5880 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.630518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71fd26-1fbf-4657-af75-1fb41e045ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.631333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71fd26-1fbf-4657-af75-1fb41e045ebf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.631670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71fd26-1fbf-4657-af75-1fb41e045ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.631977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71fd26-1fbf-4657-af75-1fb41e045ebf admin admin] PATH_INFO: `/v3/services/network` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.632649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71fd26-1fbf-4657-af75-1fb41e045ebf admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:32.634741 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-bb71fd26-1fbf-4657-af75-1fb41e045ebf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:32.634741 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:31:32.634741 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:31:32.635662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71fd26-1fbf-4657-af75-1fb41e045ebf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:32.638106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78eda5-70ce-42fe-a807-00e4bcfb5880 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.646605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baccd3-e422-403b-baac-5e162c7dacea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.647551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baccd3-e422-403b-baac-5e162c7dacea admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.647852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baccd3-e422-403b-baac-5e162c7dacea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.648110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47baccd3-e422-403b-baac-5e162c7dacea admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.649151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baccd3-e422-403b-baac-5e162c7dacea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:32.649452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baccd3-e422-403b-baac-5e162c7dacea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:32.656725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47baccd3-e422-403b-baac-5e162c7dacea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:32.658009 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-bb71fd26-1fbf-4657-af75-1fb41e045ebf admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 27 20:31:32.663639 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 355/711] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/services/network => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:32.666831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71fd26-1fbf-4657-af75-1fb41e045ebf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.676740 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 357/712] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:32.684977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71fd26-1fbf-4657-af75-1fb41e045ebf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.688421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baccd3-e422-403b-baac-5e162c7dacea admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.700434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47baccd3-e422-403b-baac-5e162c7dacea admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.702455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0a06d-e9ed-4994-bea8-68a269e98e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.703120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0a06d-e9ed-4994-bea8-68a269e98e53 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.703847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0a06d-e9ed-4994-bea8-68a269e98e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.704129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0a06d-e9ed-4994-bea8-68a269e98e53 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.705230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0a06d-e9ed-4994-bea8-68a269e98e53 admin admin] RBAC: Adding query filter params (name=network) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:32.705537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0a06d-e9ed-4994-bea8-68a269e98e53 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:32.708775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0a06d-e9ed-4994-bea8-68a269e98e53 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:32.711746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5e957-554b-4646-b668-feee9ca8d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.712610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e957-554b-4646-b668-feee9ca8d6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.712988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e957-554b-4646-b668-feee9ca8d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.713267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5e957-554b-4646-b668-feee9ca8d6c9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.719953 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 356/713] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/services?name=network => generated 124 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:32.730697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0a06d-e9ed-4994-bea8-68a269e98e53 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.736901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5e957-554b-4646-b668-feee9ca8d6c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:32.740676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5e957-554b-4646-b668-feee9ca8d6c9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:32.745458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0a06d-e9ed-4994-bea8-68a269e98e53 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.756099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c72624-8466-426a-ba79-702471761688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.757568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c72624-8466-426a-ba79-702471761688 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.759281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c72624-8466-426a-ba79-702471761688 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.759561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c72624-8466-426a-ba79-702471761688 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.760289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c72624-8466-426a-ba79-702471761688 admin admin] RBAC: Adding query filter params (type=network) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:32.760596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c72624-8466-426a-ba79-702471761688 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:32.765165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c72624-8466-426a-ba79-702471761688 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:32.771732 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-8cd5e957-554b-4646-b668-feee9ca8d6c9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 27 20:31:32.774521 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 357/715] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/services?type=network => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:32.776126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a5312-d89e-473b-ba3c-4ac05aa04b5b None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.776643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a5312-d89e-473b-ba3c-4ac05aa04b5b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.777121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a5312-d89e-473b-ba3c-4ac05aa04b5b None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.778186 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 358/715] 10.222.0.21 () {56 vars in 1114 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/users/nova => generated 82 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:32.779480 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 358/716] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:32.780143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5e957-554b-4646-b668-feee9ca8d6c9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.788257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b8c62-4a4f-4be1-8514-c52fa71e418a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.788573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b8c62-4a4f-4be1-8514-c52fa71e418a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.788849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b8c62-4a4f-4be1-8514-c52fa71e418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.794051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5e957-554b-4646-b668-feee9ca8d6c9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.799503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55784ab3-9cf6-467b-afa5-4ef256217f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.800582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55784ab3-9cf6-467b-afa5-4ef256217f83 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.801192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55784ab3-9cf6-467b-afa5-4ef256217f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.801683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55784ab3-9cf6-467b-afa5-4ef256217f83 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.802836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55784ab3-9cf6-467b-afa5-4ef256217f83 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:32.803392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55784ab3-9cf6-467b-afa5-4ef256217f83 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:32.806111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55784ab3-9cf6-467b-afa5-4ef256217f83 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:32.831575 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 359/717] 10.222.0.21 () {56 vars in 1154 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:32.832456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0a6b8c62-4a4f-4be1-8514-c52fa71e418a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:32.833689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0a6b8c62-4a4f-4be1-8514-c52fa71e418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:32.835871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55784ab3-9cf6-467b-afa5-4ef256217f83 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.846440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55784ab3-9cf6-467b-afa5-4ef256217f83 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.851890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785dad9-6e90-48ef-8465-23f3e8ddfa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.853117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785dad9-6e90-48ef-8465-23f3e8ddfa72 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.853665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785dad9-6e90-48ef-8465-23f3e8ddfa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.854216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785dad9-6e90-48ef-8465-23f3e8ddfa72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.859534 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 359/718] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:32.864260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785dad9-6e90-48ef-8465-23f3e8ddfa72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:32.866890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785dad9-6e90-48ef-8465-23f3e8ddfa72 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:32.883399 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 360/719] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:31:32.885715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b8c62-4a4f-4be1-8514-c52fa71e418a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.895971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b8c62-4a4f-4be1-8514-c52fa71e418a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.901875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c757c8-f7fd-413d-b036-5296fcaff54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.903130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c757c8-f7fd-413d-b036-5296fcaff54a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.903608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c757c8-f7fd-413d-b036-5296fcaff54a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.904083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c757c8-f7fd-413d-b036-5296fcaff54a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.914420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785dad9-6e90-48ef-8465-23f3e8ddfa72 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:32.926766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785dad9-6e90-48ef-8465-23f3e8ddfa72 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:32.929903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c757c8-f7fd-413d-b036-5296fcaff54a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:32.935419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c757c8-f7fd-413d-b036-5296fcaff54a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:32.936364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a97a0-b1bd-412b-8841-8b087afa3319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:32.937547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a97a0-b1bd-412b-8841-8b087afa3319 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:32.940155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a97a0-b1bd-412b-8841-8b087afa3319 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:32.940633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a97a0-b1bd-412b-8841-8b087afa3319 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:32.968749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a97a0-b1bd-412b-8841-8b087afa3319 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:32.970972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a97a0-b1bd-412b-8841-8b087afa3319 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:32.974367 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-90c757c8-f7fd-413d-b036-5296fcaff54a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:32.976778 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 360/720] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:32.988183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c757c8-f7fd-413d-b036-5296fcaff54a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.009328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c757c8-f7fd-413d-b036-5296fcaff54a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.012106 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-884a97a0-b1bd-412b-8841-8b087afa3319 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:33.014148 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 361/721] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:33.018242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354717e9-3ee7-4349-aaa1-342d5c02b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.019186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354717e9-3ee7-4349-aaa1-342d5c02b1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.019719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354717e9-3ee7-4349-aaa1-342d5c02b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.021212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a97a0-b1bd-412b-8841-8b087afa3319 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.021967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354717e9-3ee7-4349-aaa1-342d5c02b1a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.023335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354717e9-3ee7-4349-aaa1-342d5c02b1a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:33.023647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354717e9-3ee7-4349-aaa1-342d5c02b1a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.025297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354717e9-3ee7-4349-aaa1-342d5c02b1a9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.041466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a97a0-b1bd-412b-8841-8b087afa3319 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.042641 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 361/722] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:33.051414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d70844-1dfe-4356-bb6e-add6716e69c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.052235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d70844-1dfe-4356-bb6e-add6716e69c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.052578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d70844-1dfe-4356-bb6e-add6716e69c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.052915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d70844-1dfe-4356-bb6e-add6716e69c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.054367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d70844-1dfe-4356-bb6e-add6716e69c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:33.054768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d70844-1dfe-4356-bb6e-add6716e69c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.057276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354717e9-3ee7-4349-aaa1-342d5c02b1a9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.065938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d70844-1dfe-4356-bb6e-add6716e69c7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.067657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354717e9-3ee7-4349-aaa1-342d5c02b1a9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.072523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7940ec0-d0f8-471b-a2d4-295cb79f1184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.073350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7940ec0-d0f8-471b-a2d4-295cb79f1184 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.073629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7940ec0-d0f8-471b-a2d4-295cb79f1184 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.073898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7940ec0-d0f8-471b-a2d4-295cb79f1184 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.079522 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 362/723] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:33.081544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7940ec0-d0f8-471b-a2d4-295cb79f1184 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.083736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7940ec0-d0f8-471b-a2d4-295cb79f1184 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.086626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d70844-1dfe-4356-bb6e-add6716e69c7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.097176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d70844-1dfe-4356-bb6e-add6716e69c7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.100094 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-b7940ec0-d0f8-471b-a2d4-295cb79f1184 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:33.101578 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 362/724] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:33.107350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7940ec0-d0f8-471b-a2d4-295cb79f1184 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.110000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df44101-f1b4-485e-ae0a-ee64969582b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.110950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df44101-f1b4-485e-ae0a-ee64969582b8 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.111531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df44101-f1b4-485e-ae0a-ee64969582b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.112038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df44101-f1b4-485e-ae0a-ee64969582b8 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.112955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df44101-f1b4-485e-ae0a-ee64969582b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.115206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df44101-f1b4-485e-ae0a-ee64969582b8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.117893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7940ec0-d0f8-471b-a2d4-295cb79f1184 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.122276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b37b-8b36-40d6-9599-8f1168d6debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.122923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b37b-8b36-40d6-9599-8f1168d6debc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.123202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b37b-8b36-40d6-9599-8f1168d6debc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.123537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b37b-8b36-40d6-9599-8f1168d6debc admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.124570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2b37b-8b36-40d6-9599-8f1168d6debc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:33.124874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2b37b-8b36-40d6-9599-8f1168d6debc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.126694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2b37b-8b36-40d6-9599-8f1168d6debc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.141707 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 363/726] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:33.142203 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 363/726] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:31:33 2021] POST /identity/v3/users => generated 254 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:31:33.148538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b37b-8b36-40d6-9599-8f1168d6debc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.160435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b37b-8b36-40d6-9599-8f1168d6debc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.166322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade383a-030e-477d-a27e-32eabe806cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.167339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade383a-030e-477d-a27e-32eabe806cda admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.167823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade383a-030e-477d-a27e-32eabe806cda admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.168368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade383a-030e-477d-a27e-32eabe806cda admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.169407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade383a-030e-477d-a27e-32eabe806cda admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=aa3373ab52dc4fe680372579cfcde718) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:33.170031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade383a-030e-477d-a27e-32eabe806cda admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.172254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade383a-030e-477d-a27e-32eabe806cda admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.176315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31727e6b-9ef4-4367-8965-a7d6c49cab60 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.176600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31727e6b-9ef4-4367-8965-a7d6c49cab60 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.176869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31727e6b-9ef4-4367-8965-a7d6c49cab60 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.178932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 364/727] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:33.183307 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 364/728] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/role_assignments?user.id=aa3373ab52dc4fe680372579cfcde718&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:33.185763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3f17e-bf68-4f80-b105-2615de6658c0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.186253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3f17e-bf68-4f80-b105-2615de6658c0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.186701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3f17e-bf68-4f80-b105-2615de6658c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.208355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2ce3f17e-bf68-4f80-b105-2615de6658c0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:33.209941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2ce3f17e-bf68-4f80-b105-2615de6658c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:33.218852 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 365/729] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:33.244984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade383a-030e-477d-a27e-32eabe806cda admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.256176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade383a-030e-477d-a27e-32eabe806cda admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.261950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774ed8a-b59c-4817-ae9f-5c2641e75a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.262885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774ed8a-b59c-4817-ae9f-5c2641e75a1d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.263176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774ed8a-b59c-4817-ae9f-5c2641e75a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.263502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774ed8a-b59c-4817-ae9f-5c2641e75a1d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.276758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774ed8a-b59c-4817-ae9f-5c2641e75a1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:33.284012 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-9774ed8a-b59c-4817-ae9f-5c2641e75a1d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:33.285729 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 365/730] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:33.292514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3f17e-bf68-4f80-b105-2615de6658c0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.308996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3f17e-bf68-4f80-b105-2615de6658c0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.320322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b2428-1d53-495b-bc2e-0bef03d7cf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.321420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b2428-1d53-495b-bc2e-0bef03d7cf4e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.321911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b2428-1d53-495b-bc2e-0bef03d7cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.322405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b2428-1d53-495b-bc2e-0bef03d7cf4e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.323459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b2428-1d53-495b-bc2e-0bef03d7cf4e admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:33.323989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b2428-1d53-495b-bc2e-0bef03d7cf4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.325838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b2428-1d53-495b-bc2e-0bef03d7cf4e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.342937 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 366/731] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:33.350074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774ed8a-b59c-4817-ae9f-5c2641e75a1d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.366214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774ed8a-b59c-4817-ae9f-5c2641e75a1d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.372992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e706d5-b54c-4aed-a3d9-011a2e636197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.374112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e706d5-b54c-4aed-a3d9-011a2e636197 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.374393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e706d5-b54c-4aed-a3d9-011a2e636197 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.374666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e706d5-b54c-4aed-a3d9-011a2e636197 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.394961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e706d5-b54c-4aed-a3d9-011a2e636197 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.397037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e706d5-b54c-4aed-a3d9-011a2e636197 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.418602 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-e0e706d5-b54c-4aed-a3d9-011a2e636197 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:33.420293 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 366/732] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:33.426777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b2428-1d53-495b-bc2e-0bef03d7cf4e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.450685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b2428-1d53-495b-bc2e-0bef03d7cf4e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.459208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5747c5-50fc-46cc-a417-5f2f2ad95894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.460419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5747c5-50fc-46cc-a417-5f2f2ad95894 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.460919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5747c5-50fc-46cc-a417-5f2f2ad95894 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.461400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5747c5-50fc-46cc-a417-5f2f2ad95894 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.462359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5747c5-50fc-46cc-a417-5f2f2ad95894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:33.462876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5747c5-50fc-46cc-a417-5f2f2ad95894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.464767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5747c5-50fc-46cc-a417-5f2f2ad95894 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.489703 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 367/733] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:33.496108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e706d5-b54c-4aed-a3d9-011a2e636197 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.510622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e706d5-b54c-4aed-a3d9-011a2e636197 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.516706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f150b7f-5796-47e8-8e1b-fc598ccbc70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.517601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f150b7f-5796-47e8-8e1b-fc598ccbc70f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.517882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f150b7f-5796-47e8-8e1b-fc598ccbc70f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.518156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f150b7f-5796-47e8-8e1b-fc598ccbc70f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.527106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f150b7f-5796-47e8-8e1b-fc598ccbc70f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.529271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f150b7f-5796-47e8-8e1b-fc598ccbc70f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.544251 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-3f150b7f-5796-47e8-8e1b-fc598ccbc70f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 27 20:31:33.545750 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 367/734] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:33.551747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5747c5-50fc-46cc-a417-5f2f2ad95894 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.567446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5747c5-50fc-46cc-a417-5f2f2ad95894 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.575897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f390d-0f43-44a7-b54d-2b91e4b2b1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.576662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f390d-0f43-44a7-b54d-2b91e4b2b1ba admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.576944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f390d-0f43-44a7-b54d-2b91e4b2b1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.577216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f390d-0f43-44a7-b54d-2b91e4b2b1ba admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.578127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f390d-0f43-44a7-b54d-2b91e4b2b1ba admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:33.578433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f390d-0f43-44a7-b54d-2b91e4b2b1ba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.580505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f390d-0f43-44a7-b54d-2b91e4b2b1ba admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.601093 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 368/735] 10.222.0.21 () {56 vars in 1156 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:33.607231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f150b7f-5796-47e8-8e1b-fc598ccbc70f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.618657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f150b7f-5796-47e8-8e1b-fc598ccbc70f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.623497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20753364-8445-49f2-a6a7-13e122714795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.624452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20753364-8445-49f2-a6a7-13e122714795 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.624735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20753364-8445-49f2-a6a7-13e122714795 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.625009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20753364-8445-49f2-a6a7-13e122714795 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.634263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20753364-8445-49f2-a6a7-13e122714795 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.636246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20753364-8445-49f2-a6a7-13e122714795 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.645529 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 368/736] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:31:33.652445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f390d-0f43-44a7-b54d-2b91e4b2b1ba admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.662539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f390d-0f43-44a7-b54d-2b91e4b2b1ba admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.670173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5cba7-3a0b-4fad-8596-8170d7f3c9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.671003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5cba7-3a0b-4fad-8596-8170d7f3c9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.671331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5cba7-3a0b-4fad-8596-8170d7f3c9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.671604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5cba7-3a0b-4fad-8596-8170d7f3c9a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.682454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5cba7-3a0b-4fad-8596-8170d7f3c9a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.684325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5cba7-3a0b-4fad-8596-8170d7f3c9a7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.701433 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-39f5cba7-3a0b-4fad-8596-8170d7f3c9a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:33.702623 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 369/737] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:33.708862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20753364-8445-49f2-a6a7-13e122714795 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.718350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20753364-8445-49f2-a6a7-13e122714795 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.722972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d070452-15a1-4b9e-8925-3faeb2183727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.723646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d070452-15a1-4b9e-8925-3faeb2183727 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.723928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d070452-15a1-4b9e-8925-3faeb2183727 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.724201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d070452-15a1-4b9e-8925-3faeb2183727 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.724927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d070452-15a1-4b9e-8925-3faeb2183727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:33.725230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d070452-15a1-4b9e-8925-3faeb2183727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.727491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d070452-15a1-4b9e-8925-3faeb2183727 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.739171 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 369/738] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:33.745309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5cba7-3a0b-4fad-8596-8170d7f3c9a7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.755846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5cba7-3a0b-4fad-8596-8170d7f3c9a7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.761524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b70f-0552-4eda-a242-048dea27199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.762364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b70f-0552-4eda-a242-048dea27199e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.762645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b70f-0552-4eda-a242-048dea27199e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.762972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b70f-0552-4eda-a242-048dea27199e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.770540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b70f-0552-4eda-a242-048dea27199e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.773310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5b70f-0552-4eda-a242-048dea27199e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.786605 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-46c5b70f-0552-4eda-a242-048dea27199e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:33.791381 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 370/739] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:33.794532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d070452-15a1-4b9e-8925-3faeb2183727 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.805140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d070452-15a1-4b9e-8925-3faeb2183727 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.809898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481baa2-7658-4a48-9e5e-59e6fa8eb981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.810543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481baa2-7658-4a48-9e5e-59e6fa8eb981 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.810869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481baa2-7658-4a48-9e5e-59e6fa8eb981 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.811147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481baa2-7658-4a48-9e5e-59e6fa8eb981 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.812027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481baa2-7658-4a48-9e5e-59e6fa8eb981 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:33.812335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481baa2-7658-4a48-9e5e-59e6fa8eb981 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.814229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481baa2-7658-4a48-9e5e-59e6fa8eb981 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.831396 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 370/740] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:33.834003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b70f-0552-4eda-a242-048dea27199e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:33.845517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5b70f-0552-4eda-a242-048dea27199e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:33.855629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe144f0-6bfc-40e8-b468-e2ff8ce2fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:33.856277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe144f0-6bfc-40e8-b468-e2ff8ce2fef5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:33.856558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe144f0-6bfc-40e8-b468-e2ff8ce2fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:33.856829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe144f0-6bfc-40e8-b468-e2ff8ce2fef5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:33.857730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe144f0-6bfc-40e8-b468-e2ff8ce2fef5 admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=f39a303b702041259ebb6a66c5967528) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:33.858040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe144f0-6bfc-40e8-b468-e2ff8ce2fef5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:33.860137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe144f0-6bfc-40e8-b468-e2ff8ce2fef5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:33.867395 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 371/741] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:33 2021] GET /identity/v3/role_assignments?user.id=f39a303b702041259ebb6a66c5967528&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:34.810701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f59c-fd2d-45e7-807f-730d4652186a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:34.811446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f59c-fd2d-45e7-807f-730d4652186a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:34.811446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f59c-fd2d-45e7-807f-730d4652186a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:34.813307 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 371/742] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:34.818952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a907b1-8aa0-4b28-a977-9f9e30e4c7fb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:34.820014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a907b1-8aa0-4b28-a977-9f9e30e4c7fb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:34.820014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a907b1-8aa0-4b28-a977-9f9e30e4c7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:34.844273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e8a907b1-8aa0-4b28-a977-9f9e30e4c7fb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:34.845461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e8a907b1-8aa0-4b28-a977-9f9e30e4c7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:34.853986 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 372/743] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 27 20:31:34.891119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f59c-fd2d-45e7-807f-730d4652186a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:34.909046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f59c-fd2d-45e7-807f-730d4652186a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:34.915819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc7c41-74a0-4dc8-b11b-f55e3c96340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:34.916509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc7c41-74a0-4dc8-b11b-f55e3c96340e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:34.916799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc7c41-74a0-4dc8-b11b-f55e3c96340e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:34.917074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc7c41-74a0-4dc8-b11b-f55e3c96340e admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:34.917817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc7c41-74a0-4dc8-b11b-f55e3c96340e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:34.918828 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-8abc7c41-74a0-4dc8-b11b-f55e3c96340e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:34.918828 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:31:34.918828 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:31:34.919729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc7c41-74a0-4dc8-b11b-f55e3c96340e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:34.955448 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 372/744] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:31:34 2021] POST /identity/v3/services => generated 251 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:31:35.567312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2991d-fd56-4878-b43e-a67d9bdb2c36 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:35.567696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2991d-fd56-4878-b43e-a67d9bdb2c36 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:35.567862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2991d-fd56-4878-b43e-a67d9bdb2c36 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:35.570140 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 373/745] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:35.576096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445e84-41a5-47c1-ad6c-59a612a8218a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:35.576398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445e84-41a5-47c1-ad6c-59a612a8218a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:35.576674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43445e84-41a5-47c1-ad6c-59a612a8218a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:35.597236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-43445e84-41a5-47c1-ad6c-59a612a8218a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:35.598594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-43445e84-41a5-47c1-ad6c-59a612a8218a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:35.624279 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 373/746] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:35 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:31:35.648744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2991d-fd56-4878-b43e-a67d9bdb2c36 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:35.661744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2991d-fd56-4878-b43e-a67d9bdb2c36 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:35.666674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7dc70-ef5d-43f8-93cb-451379f528fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:35.667388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7dc70-ef5d-43f8-93cb-451379f528fc admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:35.667721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7dc70-ef5d-43f8-93cb-451379f528fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:35.667980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7dc70-ef5d-43f8-93cb-451379f528fc admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:35.668773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7dc70-ef5d-43f8-93cb-451379f528fc admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:35.669816 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-2be7dc70-ef5d-43f8-93cb-451379f528fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:35.669816 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:31:35.669816 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:31:35.670686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7dc70-ef5d-43f8-93cb-451379f528fc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:35.686541 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 374/747] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:31:35 2021] POST /identity/v3/services => generated 240 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:31:35.911550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301ff07-7739-4d2b-8da4-55ddb45dae3d None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:35.912219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301ff07-7739-4d2b-8da4-55ddb45dae3d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:35.912219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301ff07-7739-4d2b-8da4-55ddb45dae3d None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:35.914372 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 374/748] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:35.920741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0af15-f606-43e6-af60-f84b95767ae5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:35.921266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0af15-f606-43e6-af60-f84b95767ae5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:35.921353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0af15-f606-43e6-af60-f84b95767ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:35.942709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d6c0af15-f606-43e6-af60-f84b95767ae5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:35.944397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d6c0af15-f606-43e6-af60-f84b95767ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:35.979456 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 375/749] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:35 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:36.004032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301ff07-7739-4d2b-8da4-55ddb45dae3d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.020453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301ff07-7739-4d2b-8da4-55ddb45dae3d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.026598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fa074-6a5e-4837-919a-e12c3a911069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.027745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa074-6a5e-4837-919a-e12c3a911069 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.028293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa074-6a5e-4837-919a-e12c3a911069 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.028819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fa074-6a5e-4837-919a-e12c3a911069 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.040752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fa074-6a5e-4837-919a-e12c3a911069 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:36.048038 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-137fa074-6a5e-4837-919a-e12c3a911069 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:31:36.054756 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 375/750] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:36.056372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0af15-f606-43e6-af60-f84b95767ae5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.066143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0af15-f606-43e6-af60-f84b95767ae5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.071300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786d4bd-a907-4edf-8ed0-4bf43009a840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.072235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786d4bd-a907-4edf-8ed0-4bf43009a840 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.072778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786d4bd-a907-4edf-8ed0-4bf43009a840 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.073252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786d4bd-a907-4edf-8ed0-4bf43009a840 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.074212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786d4bd-a907-4edf-8ed0-4bf43009a840 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:36.074719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786d4bd-a907-4edf-8ed0-4bf43009a840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:36.076599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786d4bd-a907-4edf-8ed0-4bf43009a840 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:36.093489 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 376/751] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:36.095143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fa074-6a5e-4837-919a-e12c3a911069 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.106109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fa074-6a5e-4837-919a-e12c3a911069 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.111002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdc2ce-e038-455b-b9bf-0cc0757491c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.112163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc2ce-e038-455b-b9bf-0cc0757491c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.112652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc2ce-e038-455b-b9bf-0cc0757491c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.113168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc2ce-e038-455b-b9bf-0cc0757491c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.125789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdc2ce-e038-455b-b9bf-0cc0757491c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:36.128021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdc2ce-e038-455b-b9bf-0cc0757491c4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:36.146494 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-77fdc2ce-e038-455b-b9bf-0cc0757491c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:36.152252 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 376/752] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:36.154938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786d4bd-a907-4edf-8ed0-4bf43009a840 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.166007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786d4bd-a907-4edf-8ed0-4bf43009a840 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.171773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968e784-3ac9-4dba-a569-67c97610366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.172762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968e784-3ac9-4dba-a569-67c97610366e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.173248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968e784-3ac9-4dba-a569-67c97610366e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.173773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968e784-3ac9-4dba-a569-67c97610366e admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.174706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968e784-3ac9-4dba-a569-67c97610366e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:36.175276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968e784-3ac9-4dba-a569-67c97610366e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:36.177152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968e784-3ac9-4dba-a569-67c97610366e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:36.195380 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 377/753] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:36.198807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdc2ce-e038-455b-b9bf-0cc0757491c4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.210176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdc2ce-e038-455b-b9bf-0cc0757491c4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.216631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7468d-000c-402f-8205-658ecf9de9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.217856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7468d-000c-402f-8205-658ecf9de9ed admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.218381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7468d-000c-402f-8205-658ecf9de9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.218854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7468d-000c-402f-8205-658ecf9de9ed admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.229063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7468d-000c-402f-8205-658ecf9de9ed admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:36.231559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7468d-000c-402f-8205-658ecf9de9ed admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:36.247688 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-91f7468d-000c-402f-8205-658ecf9de9ed admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 27 20:31:36.249437 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 377/754] 10.222.0.21 () {56 vars in 1114 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:36.255881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968e784-3ac9-4dba-a569-67c97610366e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.267365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968e784-3ac9-4dba-a569-67c97610366e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.275145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fd084-2e30-4c27-90c7-e9627f7be2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.276094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fd084-2e30-4c27-90c7-e9627f7be2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.276525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fd084-2e30-4c27-90c7-e9627f7be2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.276943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fd084-2e30-4c27-90c7-e9627f7be2b4 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.278023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fd084-2e30-4c27-90c7-e9627f7be2b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:36.278520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fd084-2e30-4c27-90c7-e9627f7be2b4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:36.280586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fd084-2e30-4c27-90c7-e9627f7be2b4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:36.303061 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 378/755] 10.222.0.21 () {56 vars in 1154 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:36.305714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7468d-000c-402f-8205-658ecf9de9ed admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.316176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7468d-000c-402f-8205-658ecf9de9ed admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.321581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03e157-b4c6-4976-8dd4-b6ae5ae7ef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.322645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03e157-b4c6-4976-8dd4-b6ae5ae7ef7d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.323105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03e157-b4c6-4976-8dd4-b6ae5ae7ef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.323547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03e157-b4c6-4976-8dd4-b6ae5ae7ef7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.335906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03e157-b4c6-4976-8dd4-b6ae5ae7ef7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:36.338037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03e157-b4c6-4976-8dd4-b6ae5ae7ef7d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:36.355529 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-bd03e157-b4c6-4976-8dd4-b6ae5ae7ef7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:36.362080 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 378/756] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:36.363619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fd084-2e30-4c27-90c7-e9627f7be2b4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.374582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fd084-2e30-4c27-90c7-e9627f7be2b4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.379557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a168f99-b1aa-43c9-90b0-d88997a5449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.380518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a168f99-b1aa-43c9-90b0-d88997a5449f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.381014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a168f99-b1aa-43c9-90b0-d88997a5449f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.381566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a168f99-b1aa-43c9-90b0-d88997a5449f admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.382552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a168f99-b1aa-43c9-90b0-d88997a5449f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:36.383062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a168f99-b1aa-43c9-90b0-d88997a5449f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:36.384934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a168f99-b1aa-43c9-90b0-d88997a5449f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:36.400854 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 379/757] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:36.404139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03e157-b4c6-4976-8dd4-b6ae5ae7ef7d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.414973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03e157-b4c6-4976-8dd4-b6ae5ae7ef7d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.420042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c76a-29f9-434f-950d-f9fc67d63c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.421116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c76a-29f9-434f-950d-f9fc67d63c95 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.421612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c76a-29f9-434f-950d-f9fc67d63c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.422080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7c76a-29f9-434f-950d-f9fc67d63c95 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.435483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7c76a-29f9-434f-950d-f9fc67d63c95 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:36.437728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7c76a-29f9-434f-950d-f9fc67d63c95 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:36.457484 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-78a7c76a-29f9-434f-950d-f9fc67d63c95 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:36.462717 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 379/758] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:36.465926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a168f99-b1aa-43c9-90b0-d88997a5449f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.479117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a168f99-b1aa-43c9-90b0-d88997a5449f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.485706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bb06b-7b1c-4d8e-87e8-1d32a4e8ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.486634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bb06b-7b1c-4d8e-87e8-1d32a4e8ea44 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.487147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bb06b-7b1c-4d8e-87e8-1d32a4e8ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.487665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bb06b-7b1c-4d8e-87e8-1d32a4e8ea44 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.488716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bb06b-7b1c-4d8e-87e8-1d32a4e8ea44 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:36.489314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bb06b-7b1c-4d8e-87e8-1d32a4e8ea44 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:36.491622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bb06b-7b1c-4d8e-87e8-1d32a4e8ea44 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:36.514538 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 380/759] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:36.523285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c76a-29f9-434f-950d-f9fc67d63c95 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.551278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7c76a-29f9-434f-950d-f9fc67d63c95 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.571283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba560caa-8b6c-4c6a-ad96-2404ec308cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.575278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba560caa-8b6c-4c6a-ad96-2404ec308cca admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.575278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba560caa-8b6c-4c6a-ad96-2404ec308cca admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.575278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba560caa-8b6c-4c6a-ad96-2404ec308cca admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/aa3373ab52dc4fe680372579cfcde718/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.575278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba560caa-8b6c-4c6a-ad96-2404ec308cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=aa3373ab52dc4fe680372579cfcde718, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:36.583271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba560caa-8b6c-4c6a-ad96-2404ec308cca admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:36.619712 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 380/760] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:31:36 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/aa3373ab52dc4fe680372579cfcde718/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:36.783992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ea48-bb0c-4d97-a322-75d4f0d33a1a None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.784296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ea48-bb0c-4d97-a322-75d4f0d33a1a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.784489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ea48-bb0c-4d97-a322-75d4f0d33a1a None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.786697 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 381/761] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:36.793213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3965e5-7fad-4985-a63b-908111dac89b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.793509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3965e5-7fad-4985-a63b-908111dac89b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.793788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3965e5-7fad-4985-a63b-908111dac89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.819211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5f3965e5-7fad-4985-a63b-908111dac89b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:36.820455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5f3965e5-7fad-4985-a63b-908111dac89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:36.910229 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 381/762] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:36 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:36.943846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013ea48-bb0c-4d97-a322-75d4f0d33a1a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:36.957550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013ea48-bb0c-4d97-a322-75d4f0d33a1a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:36.962145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe614eb-938d-4496-a1df-9df0d9382c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:36.963029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe614eb-938d-4496-a1df-9df0d9382c54 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:36.963402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe614eb-938d-4496-a1df-9df0d9382c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:36.963750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe614eb-938d-4496-a1df-9df0d9382c54 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:36.976479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe614eb-938d-4496-a1df-9df0d9382c54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:36.983461 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-dfe614eb-938d-4496-a1df-9df0d9382c54 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:36.985063 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 382/763] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:36.991537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3965e5-7fad-4985-a63b-908111dac89b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.000979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3965e5-7fad-4985-a63b-908111dac89b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.005531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ad1ad-ee2a-456c-b3a0-f436bf69235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.006247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad1ad-ee2a-456c-b3a0-f436bf69235f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.007066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad1ad-ee2a-456c-b3a0-f436bf69235f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.007418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad1ad-ee2a-456c-b3a0-f436bf69235f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.008178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ad1ad-ee2a-456c-b3a0-f436bf69235f admin admin] RBAC: Adding query filter params (name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:37.008479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ad1ad-ee2a-456c-b3a0-f436bf69235f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.010150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ad1ad-ee2a-456c-b3a0-f436bf69235f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.020186 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 382/764] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:36 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:37.026333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe614eb-938d-4496-a1df-9df0d9382c54 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.036898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe614eb-938d-4496-a1df-9df0d9382c54 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.042082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388556e7-1c59-4c11-83b3-bede36822285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.042902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388556e7-1c59-4c11-83b3-bede36822285 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.043190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388556e7-1c59-4c11-83b3-bede36822285 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.043499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388556e7-1c59-4c11-83b3-bede36822285 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.055081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388556e7-1c59-4c11-83b3-bede36822285 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.057026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388556e7-1c59-4c11-83b3-bede36822285 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.074145 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-388556e7-1c59-4c11-83b3-bede36822285 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:37.075679 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 383/765] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:37.081663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ad1ad-ee2a-456c-b3a0-f436bf69235f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.091901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ad1ad-ee2a-456c-b3a0-f436bf69235f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.096529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be48a6-ff2d-48d0-9b10-299de11785a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.097235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be48a6-ff2d-48d0-9b10-299de11785a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.097517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be48a6-ff2d-48d0-9b10-299de11785a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.097794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be48a6-ff2d-48d0-9b10-299de11785a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.098572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be48a6-ff2d-48d0-9b10-299de11785a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:37.098876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be48a6-ff2d-48d0-9b10-299de11785a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.101168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be48a6-ff2d-48d0-9b10-299de11785a8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.114458 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 383/766] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:37.120453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388556e7-1c59-4c11-83b3-bede36822285 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.130703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388556e7-1c59-4c11-83b3-bede36822285 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.135951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6359e5-b651-4fec-a9fa-fe3ed1ad838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.136856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6359e5-b651-4fec-a9fa-fe3ed1ad838d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.137134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6359e5-b651-4fec-a9fa-fe3ed1ad838d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.137402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6359e5-b651-4fec-a9fa-fe3ed1ad838d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.145979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6359e5-b651-4fec-a9fa-fe3ed1ad838d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.150086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6359e5-b651-4fec-a9fa-fe3ed1ad838d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.166318 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-0f6359e5-b651-4fec-a9fa-fe3ed1ad838d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 27 20:31:37.167848 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 384/767] 10.222.0.21 () {56 vars in 1138 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:37.173926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be48a6-ff2d-48d0-9b10-299de11785a8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.183974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be48a6-ff2d-48d0-9b10-299de11785a8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.188587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f271804-03d0-4b8b-b11f-140ee442c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.189300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f271804-03d0-4b8b-b11f-140ee442c755 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.189636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f271804-03d0-4b8b-b11f-140ee442c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.189908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f271804-03d0-4b8b-b11f-140ee442c755 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.190797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f271804-03d0-4b8b-b11f-140ee442c755 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:37.191139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f271804-03d0-4b8b-b11f-140ee442c755 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.193020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f271804-03d0-4b8b-b11f-140ee442c755 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.216890 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 384/768] 10.222.0.21 () {56 vars in 1170 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:37.222878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6359e5-b651-4fec-a9fa-fe3ed1ad838d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.237551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6359e5-b651-4fec-a9fa-fe3ed1ad838d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.247542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa07bc5-eb2e-423f-8f97-fff4060638c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.248193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07bc5-eb2e-423f-8f97-fff4060638c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.248469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07bc5-eb2e-423f-8f97-fff4060638c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.248993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07bc5-eb2e-423f-8f97-fff4060638c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.266812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa07bc5-eb2e-423f-8f97-fff4060638c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.268566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa07bc5-eb2e-423f-8f97-fff4060638c9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.280480 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 385/769] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:31:37.286513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f271804-03d0-4b8b-b11f-140ee442c755 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.298654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f271804-03d0-4b8b-b11f-140ee442c755 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.307312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e64693-44dc-498a-b9a1-0c2deff0e257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.308147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e64693-44dc-498a-b9a1-0c2deff0e257 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.308425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e64693-44dc-498a-b9a1-0c2deff0e257 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.308693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e64693-44dc-498a-b9a1-0c2deff0e257 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.320883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e64693-44dc-498a-b9a1-0c2deff0e257 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.322828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e64693-44dc-498a-b9a1-0c2deff0e257 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.340343 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-85e64693-44dc-498a-b9a1-0c2deff0e257 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:37.341870 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 385/770] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:37.347684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa07bc5-eb2e-423f-8f97-fff4060638c9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.360155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa07bc5-eb2e-423f-8f97-fff4060638c9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.367844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4c348-8292-43c0-8129-0df450d8f846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.368499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c348-8292-43c0-8129-0df450d8f846 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.368776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c348-8292-43c0-8129-0df450d8f846 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.369047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4c348-8292-43c0-8129-0df450d8f846 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.369777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4c348-8292-43c0-8129-0df450d8f846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:37.370077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4c348-8292-43c0-8129-0df450d8f846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.371673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4c348-8292-43c0-8129-0df450d8f846 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.389360 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 386/771] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:37.395159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e64693-44dc-498a-b9a1-0c2deff0e257 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.405865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e64693-44dc-498a-b9a1-0c2deff0e257 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.406311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662ccd-b054-4757-82f7-efeba76ccb8c None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.406600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662ccd-b054-4757-82f7-efeba76ccb8c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.406877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26662ccd-b054-4757-82f7-efeba76ccb8c None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.408645 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 387/772] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:31:37.414416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce5e3e-de39-41d8-a65e-c3d7d8eed37a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.414798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce5e3e-de39-41d8-a65e-c3d7d8eed37a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.415083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce5e3e-de39-41d8-a65e-c3d7d8eed37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.417240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb20bc-64f6-490c-ba9a-a5098f110bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.418171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb20bc-64f6-490c-ba9a-a5098f110bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.418543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb20bc-64f6-490c-ba9a-a5098f110bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.418870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb20bc-64f6-490c-ba9a-a5098f110bf7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.449301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb20bc-64f6-490c-ba9a-a5098f110bf7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.452990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb20bc-64f6-490c-ba9a-a5098f110bf7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.463324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-23ce5e3e-de39-41d8-a65e-c3d7d8eed37a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:37.464553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-23ce5e3e-de39-41d8-a65e-c3d7d8eed37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:37.477872 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-6ffb20bc-64f6-490c-ba9a-a5098f110bf7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:37.481957 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 388/773] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:37 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:31:37.487477 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 386/774] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:37.487722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce5e3e-de39-41d8-a65e-c3d7d8eed37a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.499160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce5e3e-de39-41d8-a65e-c3d7d8eed37a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.504470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70a60d-c7d5-4127-bac5-56fbc48e57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.505183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70a60d-c7d5-4127-bac5-56fbc48e57a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.505464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70a60d-c7d5-4127-bac5-56fbc48e57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.505796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70a60d-c7d5-4127-bac5-56fbc48e57a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.507194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70a60d-c7d5-4127-bac5-56fbc48e57a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:37.507560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70a60d-c7d5-4127-bac5-56fbc48e57a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.509441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70a60d-c7d5-4127-bac5-56fbc48e57a5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.526882 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 389/775] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:37.536319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb20bc-64f6-490c-ba9a-a5098f110bf7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.547966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb20bc-64f6-490c-ba9a-a5098f110bf7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.554403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791b1bb-4010-42fc-b940-4b8b8133e03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.554985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791b1bb-4010-42fc-b940-4b8b8133e03b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.555343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791b1bb-4010-42fc-b940-4b8b8133e03b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.555621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791b1bb-4010-42fc-b940-4b8b8133e03b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.556518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791b1bb-4010-42fc-b940-4b8b8133e03b admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=93ed192079af4cad8a303e6c1b4da343) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:37.556831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791b1bb-4010-42fc-b940-4b8b8133e03b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.558947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791b1bb-4010-42fc-b940-4b8b8133e03b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.563059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70a60d-c7d5-4127-bac5-56fbc48e57a5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.574348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70a60d-c7d5-4127-bac5-56fbc48e57a5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.579320 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 387/776] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/role_assignments?user.id=93ed192079af4cad8a303e6c1b4da343&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:37.581356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40413282-3ac6-4c65-8561-8b4afd0595f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.582211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413282-3ac6-4c65-8561-8b4afd0595f0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.582491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413282-3ac6-4c65-8561-8b4afd0595f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.582812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413282-3ac6-4c65-8561-8b4afd0595f0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.607382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40413282-3ac6-4c65-8561-8b4afd0595f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:37.614962 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-40413282-3ac6-4c65-8561-8b4afd0595f0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:31:37.616861 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 390/777] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:37.624016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791b1bb-4010-42fc-b940-4b8b8133e03b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.637465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791b1bb-4010-42fc-b940-4b8b8133e03b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.655300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dba532-548d-4188-b7cf-960951018fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.655300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba532-548d-4188-b7cf-960951018fab admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.655300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba532-548d-4188-b7cf-960951018fab admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.655300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba532-548d-4188-b7cf-960951018fab admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.655755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dba532-548d-4188-b7cf-960951018fab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:37.655755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dba532-548d-4188-b7cf-960951018fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.657466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dba532-548d-4188-b7cf-960951018fab admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.671414 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 388/778] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:37.677940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40413282-3ac6-4c65-8561-8b4afd0595f0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.694497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40413282-3ac6-4c65-8561-8b4afd0595f0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.700102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5a1f0-4f07-491b-b733-69f702c1607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.701085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5a1f0-4f07-491b-b733-69f702c1607f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.701560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5a1f0-4f07-491b-b733-69f702c1607f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.701973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5a1f0-4f07-491b-b733-69f702c1607f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.723303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5a1f0-4f07-491b-b733-69f702c1607f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.726177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5a1f0-4f07-491b-b733-69f702c1607f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.747661 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-50e5a1f0-4f07-491b-b733-69f702c1607f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:37.754612 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 391/779] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:37.756204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dba532-548d-4188-b7cf-960951018fab admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.778033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dba532-548d-4188-b7cf-960951018fab admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.788712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e6404-f7c8-432d-875a-b0ed0bb5e512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.789717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6404-f7c8-432d-875a-b0ed0bb5e512 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.790210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6404-f7c8-432d-875a-b0ed0bb5e512 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.790639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6404-f7c8-432d-875a-b0ed0bb5e512 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.791679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e6404-f7c8-432d-875a-b0ed0bb5e512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:37.792131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e6404-f7c8-432d-875a-b0ed0bb5e512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.793982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e6404-f7c8-432d-875a-b0ed0bb5e512 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.812813 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 389/780] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:37.819859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5a1f0-4f07-491b-b733-69f702c1607f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.833443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5a1f0-4f07-491b-b733-69f702c1607f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.838661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617a2f7-71f5-40b5-bd9e-0d5af9b08e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.839837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a2f7-71f5-40b5-bd9e-0d5af9b08e4c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.840321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a2f7-71f5-40b5-bd9e-0d5af9b08e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.840746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a2f7-71f5-40b5-bd9e-0d5af9b08e4c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.854962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617a2f7-71f5-40b5-bd9e-0d5af9b08e4c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.857404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617a2f7-71f5-40b5-bd9e-0d5af9b08e4c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.877006 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-5617a2f7-71f5-40b5-bd9e-0d5af9b08e4c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 27 20:31:37.883372 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 392/781] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/users/swift => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:37.885910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e6404-f7c8-432d-875a-b0ed0bb5e512 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.896571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e6404-f7c8-432d-875a-b0ed0bb5e512 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.901699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc94404-5e42-4cb5-816d-a9c934f26482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.902583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc94404-5e42-4cb5-816d-a9c934f26482 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.903069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc94404-5e42-4cb5-816d-a9c934f26482 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.903530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc94404-5e42-4cb5-816d-a9c934f26482 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.904571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc94404-5e42-4cb5-816d-a9c934f26482 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:37.905022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc94404-5e42-4cb5-816d-a9c934f26482 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.911479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc94404-5e42-4cb5-816d-a9c934f26482 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.933502 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 390/782] 10.222.0.21 () {56 vars in 1156 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:37.939855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617a2f7-71f5-40b5-bd9e-0d5af9b08e4c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:37.952588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617a2f7-71f5-40b5-bd9e-0d5af9b08e4c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:37.960939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc9b1e-5330-4da3-ac6f-469ada3a63a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:37.961874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc9b1e-5330-4da3-ac6f-469ada3a63a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:37.962315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc9b1e-5330-4da3-ac6f-469ada3a63a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:37.962761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc9b1e-5330-4da3-ac6f-469ada3a63a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:37.974412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc9b1e-5330-4da3-ac6f-469ada3a63a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:37.977008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc9b1e-5330-4da3-ac6f-469ada3a63a4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:37.988876 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 393/783] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:31:37.995302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc94404-5e42-4cb5-816d-a9c934f26482 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:38.008889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc94404-5e42-4cb5-816d-a9c934f26482 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:38.017977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abd23f-38de-48b5-9cd0-37d01725da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:38.018829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abd23f-38de-48b5-9cd0-37d01725da47 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.019112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abd23f-38de-48b5-9cd0-37d01725da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.019452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abd23f-38de-48b5-9cd0-37d01725da47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.030550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abd23f-38de-48b5-9cd0-37d01725da47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:38.032473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abd23f-38de-48b5-9cd0-37d01725da47 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:38.052721 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-86abd23f-38de-48b5-9cd0-37d01725da47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:38.054863 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 391/784] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:38.060822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc9b1e-5330-4da3-ac6f-469ada3a63a4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:38.074173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc9b1e-5330-4da3-ac6f-469ada3a63a4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:38.082935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942869db-5c40-4c47-9ae0-606245a87c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:38.083783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942869db-5c40-4c47-9ae0-606245a87c5e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.084232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942869db-5c40-4c47-9ae0-606245a87c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.085179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942869db-5c40-4c47-9ae0-606245a87c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.086052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942869db-5c40-4c47-9ae0-606245a87c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:38.086498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942869db-5c40-4c47-9ae0-606245a87c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:38.088252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942869db-5c40-4c47-9ae0-606245a87c5e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:38.109401 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 394/785] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:38.115552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abd23f-38de-48b5-9cd0-37d01725da47 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:38.133067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abd23f-38de-48b5-9cd0-37d01725da47 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:38.139507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836464a-2c3c-4ff1-8eb8-7920c3ec9371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:38.140413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836464a-2c3c-4ff1-8eb8-7920c3ec9371 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.140760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836464a-2c3c-4ff1-8eb8-7920c3ec9371 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.141099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836464a-2c3c-4ff1-8eb8-7920c3ec9371 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.150731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836464a-2c3c-4ff1-8eb8-7920c3ec9371 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:38.152891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836464a-2c3c-4ff1-8eb8-7920c3ec9371 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:38.168283 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d836464a-2c3c-4ff1-8eb8-7920c3ec9371 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:38.169833 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 392/786] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:38.175847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942869db-5c40-4c47-9ae0-606245a87c5e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:38.187610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942869db-5c40-4c47-9ae0-606245a87c5e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:38.198952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bded8e-e751-46e9-a066-a0d296528154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:38.199821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bded8e-e751-46e9-a066-a0d296528154 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.200263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bded8e-e751-46e9-a066-a0d296528154 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.200676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bded8e-e751-46e9-a066-a0d296528154 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.201613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bded8e-e751-46e9-a066-a0d296528154 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:38.202056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bded8e-e751-46e9-a066-a0d296528154 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:38.204037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bded8e-e751-46e9-a066-a0d296528154 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:38.222424 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 395/787] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:38.228642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836464a-2c3c-4ff1-8eb8-7920c3ec9371 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:38.243363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836464a-2c3c-4ff1-8eb8-7920c3ec9371 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:38.252250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd97d0-a2b9-419f-b769-fc70934653a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:38.252951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd97d0-a2b9-419f-b769-fc70934653a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.253232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd97d0-a2b9-419f-b769-fc70934653a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.253506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd97d0-a2b9-419f-b769-fc70934653a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.254387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd97d0-a2b9-419f-b769-fc70934653a1 admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=f39a303b702041259ebb6a66c5967528) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:38.254694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd97d0-a2b9-419f-b769-fc70934653a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:38.256756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd97d0-a2b9-419f-b769-fc70934653a1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:38.267545 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 393/788] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:38 2021] GET /identity/v3/role_assignments?user.id=f39a303b702041259ebb6a66c5967528&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:38.324437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad03643-62a3-4c13-880e-045113dc706a None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.324997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad03643-62a3-4c13-880e-045113dc706a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.325445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad03643-62a3-4c13-880e-045113dc706a None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.327478 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 396/789] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:38.333982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f74561-3aec-49fc-a9d1-5bf8f9de4fa4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.334270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f74561-3aec-49fc-a9d1-5bf8f9de4fa4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.335068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f74561-3aec-49fc-a9d1-5bf8f9de4fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.364654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-75f74561-3aec-49fc-a9d1-5bf8f9de4fa4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:38.365918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-75f74561-3aec-49fc-a9d1-5bf8f9de4fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:38.374975 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 394/790] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:38 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:38.429852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad03643-62a3-4c13-880e-045113dc706a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:38.449060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad03643-62a3-4c13-880e-045113dc706a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:38.453742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8f51c-18c7-41fd-8c5c-45428d3e6835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:38.454829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f51c-18c7-41fd-8c5c-45428d3e6835 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.455309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f51c-18c7-41fd-8c5c-45428d3e6835 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.455755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f51c-18c7-41fd-8c5c-45428d3e6835 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.456602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8f51c-18c7-41fd-8c5c-45428d3e6835 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:38.458375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8f51c-18c7-41fd-8c5c-45428d3e6835 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:38.475858 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-60b8f51c-18c7-41fd-8c5c-45428d3e6835 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 27 20:31:38.477427 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 397/791] 10.222.0.21 () {56 vars in 1150 bytes} [Sat Nov 27 20:31:38 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:38.484116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f74561-3aec-49fc-a9d1-5bf8f9de4fa4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:38.496993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f74561-3aec-49fc-a9d1-5bf8f9de4fa4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:38.506564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3feef7-6473-44cd-8fcb-c39329707d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:38.507330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3feef7-6473-44cd-8fcb-c39329707d8d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.507614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3feef7-6473-44cd-8fcb-c39329707d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.507884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3feef7-6473-44cd-8fcb-c39329707d8d admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.508622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3feef7-6473-44cd-8fcb-c39329707d8d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:38.508924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3feef7-6473-44cd-8fcb-c39329707d8d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:38.510620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3feef7-6473-44cd-8fcb-c39329707d8d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:38.519562 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 395/792] 10.222.0.21 () {56 vars in 1145 bytes} [Sat Nov 27 20:31:38 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:38.525969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8f51c-18c7-41fd-8c5c-45428d3e6835 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:38.541436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8f51c-18c7-41fd-8c5c-45428d3e6835 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:38.546889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aac2db-a353-4fb9-99a4-5959c1c56c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:38.547810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac2db-a353-4fb9-99a4-5959c1c56c6a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.548287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac2db-a353-4fb9-99a4-5959c1c56c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.548764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac2db-a353-4fb9-99a4-5959c1c56c6a admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.549671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aac2db-a353-4fb9-99a4-5959c1c56c6a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:38.550170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aac2db-a353-4fb9-99a4-5959c1c56c6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:38.551979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aac2db-a353-4fb9-99a4-5959c1c56c6a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:38.558144 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 398/793] 10.222.0.21 () {56 vars in 1145 bytes} [Sat Nov 27 20:31:38 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:38.567285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3feef7-6473-44cd-8fcb-c39329707d8d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:38.575266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3feef7-6473-44cd-8fcb-c39329707d8d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:38.580648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb8a28-b173-43a9-8be3-e033f8e19abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:38.581384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb8a28-b173-43a9-8be3-e033f8e19abb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.581663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb8a28-b173-43a9-8be3-e033f8e19abb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.581933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb8a28-b173-43a9-8be3-e033f8e19abb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.582784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb8a28-b173-43a9-8be3-e033f8e19abb admin admin] RBAC: Adding query filter params (interface=public, service_id=1e7185bf589e4aad8ef113bf24b43fc8, region_id=RegionOne) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:38.583094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb8a28-b173-43a9-8be3-e033f8e19abb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:38.584196 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-7beb8a28-b173-43a9-8be3-e033f8e19abb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:38.584196 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:31:38.584196 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:31:38.585237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb8a28-b173-43a9-8be3-e033f8e19abb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:38.594239 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 396/794] 10.222.0.21 () {56 vars in 1272 bytes} [Sat Nov 27 20:31:38 2021] GET /identity/v3/endpoints?service_id=1e7185bf589e4aad8ef113bf24b43fc8&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:38.600062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aac2db-a353-4fb9-99a4-5959c1c56c6a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:38.611534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aac2db-a353-4fb9-99a4-5959c1c56c6a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:38.616522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1772b13-89a7-42c7-b2f4-90946a62d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:38.617224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772b13-89a7-42c7-b2f4-90946a62d930 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:38.617504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772b13-89a7-42c7-b2f4-90946a62d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:38.617830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772b13-89a7-42c7-b2f4-90946a62d930 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:38.618520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1772b13-89a7-42c7-b2f4-90946a62d930 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:38.620282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1772b13-89a7-42c7-b2f4-90946a62d930 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:38.627346 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 399/795] 10.222.0.21 () {56 vars in 1108 bytes} [Sat Nov 27 20:31:38 2021] GET /identity/v3/services => generated 772 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:39.146823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4832e3-1704-4527-bd17-df86a041640e None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.147925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4832e3-1704-4527-bd17-df86a041640e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.148406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4832e3-1704-4527-bd17-df86a041640e None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.150620 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 397/796] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:39.156534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1454b-1b57-4a95-aeda-d7e8271d8e38 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.157394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1454b-1b57-4a95-aeda-d7e8271d8e38 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.157873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1454b-1b57-4a95-aeda-d7e8271d8e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.187203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3cf1454b-1b57-4a95-aeda-d7e8271d8e38 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:39.188733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3cf1454b-1b57-4a95-aeda-d7e8271d8e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:39.197448 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 400/797] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:39 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:39.242500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4832e3-1704-4527-bd17-df86a041640e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:39.257586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4832e3-1704-4527-bd17-df86a041640e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:39.265279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ff66-06a1-4d97-91b7-aab4eb2d4967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:39.266287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ff66-06a1-4d97-91b7-aab4eb2d4967 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.266781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ff66-06a1-4d97-91b7-aab4eb2d4967 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.267270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2ff66-06a1-4d97-91b7-aab4eb2d4967 admin admin] PATH_INFO: `/v3/services/network` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.268144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2ff66-06a1-4d97-91b7-aab4eb2d4967 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:39.269928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2ff66-06a1-4d97-91b7-aab4eb2d4967 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:39.285697 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-3ed2ff66-06a1-4d97-91b7-aab4eb2d4967 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 27 20:31:39.287326 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 398/798] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:39 2021] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:39.294679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1454b-1b57-4a95-aeda-d7e8271d8e38 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:39.304823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1454b-1b57-4a95-aeda-d7e8271d8e38 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:39.314508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b18b1-5d26-4740-955e-9444e20505d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:39.315594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b18b1-5d26-4740-955e-9444e20505d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.316076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b18b1-5d26-4740-955e-9444e20505d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.316546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b18b1-5d26-4740-955e-9444e20505d7 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.317515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b18b1-5d26-4740-955e-9444e20505d7 admin admin] RBAC: Adding query filter params (name=network) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:39.318014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b18b1-5d26-4740-955e-9444e20505d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:39.320358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b18b1-5d26-4740-955e-9444e20505d7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:39.326037 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 401/799] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:31:39 2021] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:39.331796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ff66-06a1-4d97-91b7-aab4eb2d4967 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:39.342431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2ff66-06a1-4d97-91b7-aab4eb2d4967 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:39.351913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16344f-9b10-4d55-bb51-854a14c185fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:39.352830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16344f-9b10-4d55-bb51-854a14c185fc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.353309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16344f-9b10-4d55-bb51-854a14c185fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.353792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16344f-9b10-4d55-bb51-854a14c185fc admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.354706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16344f-9b10-4d55-bb51-854a14c185fc admin admin] RBAC: Adding query filter params (type=network) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:39.355203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16344f-9b10-4d55-bb51-854a14c185fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:39.357000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16344f-9b10-4d55-bb51-854a14c185fc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:39.362926 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 399/800] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:31:39 2021] GET /identity/v3/services?type=network => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:39.368764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b18b1-5d26-4740-955e-9444e20505d7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:39.378941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b18b1-5d26-4740-955e-9444e20505d7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:39.386848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488e798-b6ed-40a6-b99a-e05b03cc356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:39.387783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488e798-b6ed-40a6-b99a-e05b03cc356a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.388281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488e798-b6ed-40a6-b99a-e05b03cc356a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.388753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488e798-b6ed-40a6-b99a-e05b03cc356a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.389767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488e798-b6ed-40a6-b99a-e05b03cc356a admin admin] RBAC: Adding query filter params (interface=public, service_id=d5d7417b47904db5b808b9180fa65ae2, region_id=RegionOne) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:39.390272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488e798-b6ed-40a6-b99a-e05b03cc356a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:39.391476 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-6488e798-b6ed-40a6-b99a-e05b03cc356a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:39.391476 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:31:39.391476 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:31:39.392697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488e798-b6ed-40a6-b99a-e05b03cc356a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:39.401212 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 402/801] 10.222.0.21 () {56 vars in 1272 bytes} [Sat Nov 27 20:31:39 2021] GET /identity/v3/endpoints?service_id=d5d7417b47904db5b808b9180fa65ae2&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:39.406781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16344f-9b10-4d55-bb51-854a14c185fc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:39.417460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16344f-9b10-4d55-bb51-854a14c185fc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:39.429907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee303356-cbad-4980-91aa-946ee1fdb6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:39.430849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee303356-cbad-4980-91aa-946ee1fdb6ff admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.431383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee303356-cbad-4980-91aa-946ee1fdb6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.431855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee303356-cbad-4980-91aa-946ee1fdb6ff admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.432783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee303356-cbad-4980-91aa-946ee1fdb6ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:39.434579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee303356-cbad-4980-91aa-946ee1fdb6ff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:39.445318 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 400/802] 10.222.0.21 () {56 vars in 1108 bytes} [Sat Nov 27 20:31:39 2021] GET /identity/v3/services => generated 772 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:39.715992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9f5f-4ba8-430f-a6bc-2f3fc0965e21 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.716169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9f5f-4ba8-430f-a6bc-2f3fc0965e21 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.716455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9f5f-4ba8-430f-a6bc-2f3fc0965e21 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.718420 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 403/803] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:39.724461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a56c2e-a86b-4d59-a86e-2e07c2c4d521 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.724777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a56c2e-a86b-4d59-a86e-2e07c2c4d521 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.725016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a56c2e-a86b-4d59-a86e-2e07c2c4d521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.749170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d7a56c2e-a86b-4d59-a86e-2e07c2c4d521 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:39.750370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d7a56c2e-a86b-4d59-a86e-2e07c2c4d521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:39.761769 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 401/804] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:39 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:39.793692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9f5f-4ba8-430f-a6bc-2f3fc0965e21 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:39.807237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9f5f-4ba8-430f-a6bc-2f3fc0965e21 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:39.814978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd855e9-d4e5-443c-aa64-1cd205174f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:39.815794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd855e9-d4e5-443c-aa64-1cd205174f3f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.816079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd855e9-d4e5-443c-aa64-1cd205174f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.816354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd855e9-d4e5-443c-aa64-1cd205174f3f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.832514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd855e9-d4e5-443c-aa64-1cd205174f3f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:39.840081 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-fcd855e9-d4e5-443c-aa64-1cd205174f3f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:31:39.841631 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 404/805] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:39.848082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a56c2e-a86b-4d59-a86e-2e07c2c4d521 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:39.861458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a56c2e-a86b-4d59-a86e-2e07c2c4d521 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:39.871304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9c2e5-b33b-4a6e-92f7-b6cc8ac769f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:39.872279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9c2e5-b33b-4a6e-92f7-b6cc8ac769f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.872765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9c2e5-b33b-4a6e-92f7-b6cc8ac769f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.873260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9c2e5-b33b-4a6e-92f7-b6cc8ac769f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.874542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9c2e5-b33b-4a6e-92f7-b6cc8ac769f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:39.875053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9c2e5-b33b-4a6e-92f7-b6cc8ac769f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:39.876922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9c2e5-b33b-4a6e-92f7-b6cc8ac769f7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:39.886699 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 402/806] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:39.895399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd855e9-d4e5-443c-aa64-1cd205174f3f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:39.908319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd855e9-d4e5-443c-aa64-1cd205174f3f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:39.920149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e2a75-af7f-4ada-962e-7af680dcfa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:39.920942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e2a75-af7f-4ada-962e-7af680dcfa0a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:39.921226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e2a75-af7f-4ada-962e-7af680dcfa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:39.921500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e2a75-af7f-4ada-962e-7af680dcfa0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:39.943112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e2a75-af7f-4ada-962e-7af680dcfa0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:39.945513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e2a75-af7f-4ada-962e-7af680dcfa0a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:39.971311 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-8f8e2a75-af7f-4ada-962e-7af680dcfa0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:39.972783 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 405/807] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:39.979413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9c2e5-b33b-4a6e-92f7-b6cc8ac769f7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:39.995525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9c2e5-b33b-4a6e-92f7-b6cc8ac769f7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.003126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed64af-52d7-47b4-b667-256d68d1145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.004125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed64af-52d7-47b4-b667-256d68d1145f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.004610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed64af-52d7-47b4-b667-256d68d1145f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.005137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed64af-52d7-47b4-b667-256d68d1145f admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.006100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed64af-52d7-47b4-b667-256d68d1145f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:40.007175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed64af-52d7-47b4-b667-256d68d1145f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:40.009062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed64af-52d7-47b4-b667-256d68d1145f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:40.030842 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 403/808] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:40.036488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e2a75-af7f-4ada-962e-7af680dcfa0a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:40.054020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e2a75-af7f-4ada-962e-7af680dcfa0a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.063489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06297662-6eac-4d80-887b-8fb5e5b2e295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.064284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06297662-6eac-4d80-887b-8fb5e5b2e295 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.064571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06297662-6eac-4d80-887b-8fb5e5b2e295 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.064847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06297662-6eac-4d80-887b-8fb5e5b2e295 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.084134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06297662-6eac-4d80-887b-8fb5e5b2e295 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:40.086246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06297662-6eac-4d80-887b-8fb5e5b2e295 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:40.101910 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-06297662-6eac-4d80-887b-8fb5e5b2e295 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 27 20:31:40.103467 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 406/809] 10.222.0.21 () {56 vars in 1114 bytes} [Sat Nov 27 20:31:40 2021] GET /identity/v3/users/nova => generated 82 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:40.109605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed64af-52d7-47b4-b667-256d68d1145f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:40.125451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed64af-52d7-47b4-b667-256d68d1145f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.134004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc110fc-e1cf-434c-8686-30f0959fba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.134994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc110fc-e1cf-434c-8686-30f0959fba2e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.135589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc110fc-e1cf-434c-8686-30f0959fba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.136127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc110fc-e1cf-434c-8686-30f0959fba2e admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.137173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc110fc-e1cf-434c-8686-30f0959fba2e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:40.137712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc110fc-e1cf-434c-8686-30f0959fba2e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:40.139869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc110fc-e1cf-434c-8686-30f0959fba2e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:40.171152 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 404/810] 10.222.0.21 () {56 vars in 1154 bytes} [Sat Nov 27 20:31:40 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:40.177525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06297662-6eac-4d80-887b-8fb5e5b2e295 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:40.192224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06297662-6eac-4d80-887b-8fb5e5b2e295 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.205507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25879523-4ace-4479-b339-4052cd612043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.206166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25879523-4ace-4479-b339-4052cd612043 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.206447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25879523-4ace-4479-b339-4052cd612043 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.206725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25879523-4ace-4479-b339-4052cd612043 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.227492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25879523-4ace-4479-b339-4052cd612043 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:40.229169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25879523-4ace-4479-b339-4052cd612043 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:40.240411 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 407/811] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:40 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:31:40.246555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc110fc-e1cf-434c-8686-30f0959fba2e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:40.260929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc110fc-e1cf-434c-8686-30f0959fba2e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.270326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb2632-654e-4e27-b01a-a04672a808df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.271440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb2632-654e-4e27-b01a-a04672a808df admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.272076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb2632-654e-4e27-b01a-a04672a808df admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.272548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb2632-654e-4e27-b01a-a04672a808df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.287579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb2632-654e-4e27-b01a-a04672a808df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:40.289807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb2632-654e-4e27-b01a-a04672a808df admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:40.312828 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-75cb2632-654e-4e27-b01a-a04672a808df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:40.314456 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 405/812] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:40.320617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25879523-4ace-4479-b339-4052cd612043 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:40.337938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25879523-4ace-4479-b339-4052cd612043 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.352768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ea16-83c6-4fee-bf70-f60456261ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.353448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ea16-83c6-4fee-bf70-f60456261ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.353729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ea16-83c6-4fee-bf70-f60456261ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.353998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ea16-83c6-4fee-bf70-f60456261ce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.354816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1ea16-83c6-4fee-bf70-f60456261ce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:40.355123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1ea16-83c6-4fee-bf70-f60456261ce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:40.356744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1ea16-83c6-4fee-bf70-f60456261ce9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:40.376957 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 408/813] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:40.382972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb2632-654e-4e27-b01a-a04672a808df admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:40.396318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb2632-654e-4e27-b01a-a04672a808df admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.405018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcba152-a50d-403c-960c-93a3382d89bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.406198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcba152-a50d-403c-960c-93a3382d89bb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.406681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcba152-a50d-403c-960c-93a3382d89bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.407197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcba152-a50d-403c-960c-93a3382d89bb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.420928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcba152-a50d-403c-960c-93a3382d89bb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:40.423229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcba152-a50d-403c-960c-93a3382d89bb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:40.456189 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-cbcba152-a50d-403c-960c-93a3382d89bb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:40.457838 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 406/814] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:40.464564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ea16-83c6-4fee-bf70-f60456261ce9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:40.489636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ea16-83c6-4fee-bf70-f60456261ce9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.503843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135b82e-2953-4631-af2d-71980a85295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.504496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b82e-2953-4631-af2d-71980a85295a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.504771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b82e-2953-4631-af2d-71980a85295a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.505043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b82e-2953-4631-af2d-71980a85295a admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.505844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135b82e-2953-4631-af2d-71980a85295a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:40.506148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135b82e-2953-4631-af2d-71980a85295a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:40.508084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135b82e-2953-4631-af2d-71980a85295a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:40.534243 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 409/815] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:40.540847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcba152-a50d-403c-960c-93a3382d89bb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:40.556702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcba152-a50d-403c-960c-93a3382d89bb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.566258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334e994-79f7-4eec-8f8f-95832421a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.567181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e994-79f7-4eec-8f8f-95832421a8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.567780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e994-79f7-4eec-8f8f-95832421a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.568292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334e994-79f7-4eec-8f8f-95832421a8a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.569430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334e994-79f7-4eec-8f8f-95832421a8a5 admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=aa3373ab52dc4fe680372579cfcde718) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:40.570307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334e994-79f7-4eec-8f8f-95832421a8a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:40.572435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334e994-79f7-4eec-8f8f-95832421a8a5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:40.583579 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 407/816] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:40 2021] GET /identity/v3/role_assignments?user.id=aa3373ab52dc4fe680372579cfcde718&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:40.771809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e84aa-912b-4287-a3c7-d1e607e1e0be None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.772208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e84aa-912b-4287-a3c7-d1e607e1e0be None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.772507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e84aa-912b-4287-a3c7-d1e607e1e0be None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.774296 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 410/817] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:40.780720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d451163-41f6-4ecf-a709-b6b1cabe079e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.781373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d451163-41f6-4ecf-a709-b6b1cabe079e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.781878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d451163-41f6-4ecf-a709-b6b1cabe079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.805474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0d451163-41f6-4ecf-a709-b6b1cabe079e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:40.806715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0d451163-41f6-4ecf-a709-b6b1cabe079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:40.819647 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 408/818] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:40 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:40.865137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e84aa-912b-4287-a3c7-d1e607e1e0be None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:40.880392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e84aa-912b-4287-a3c7-d1e607e1e0be None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.885865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a27aa0-fa72-49ee-b8c3-135af75595bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.886754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a27aa0-fa72-49ee-b8c3-135af75595bd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.887038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a27aa0-fa72-49ee-b8c3-135af75595bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.887334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a27aa0-fa72-49ee-b8c3-135af75595bd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.900214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a27aa0-fa72-49ee-b8c3-135af75595bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:40.907337 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-f5a27aa0-fa72-49ee-b8c3-135af75595bd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:40.908558 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 411/819] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:40.915382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d451163-41f6-4ecf-a709-b6b1cabe079e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:40.924708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d451163-41f6-4ecf-a709-b6b1cabe079e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.933659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a5194-f3a3-4a40-ae5b-a086dcb44ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.934333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a5194-f3a3-4a40-ae5b-a086dcb44ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.934610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a5194-f3a3-4a40-ae5b-a086dcb44ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.934879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a5194-f3a3-4a40-ae5b-a086dcb44ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.935772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a5194-f3a3-4a40-ae5b-a086dcb44ba1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:40.936073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a5194-f3a3-4a40-ae5b-a086dcb44ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:40.937746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a5194-f3a3-4a40-ae5b-a086dcb44ba1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:40.947899 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 409/820] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:40.953663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a27aa0-fa72-49ee-b8c3-135af75595bd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:40.964437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a27aa0-fa72-49ee-b8c3-135af75595bd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:40.969167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6a44b-f182-47e5-aa94-0bf0cd973b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:40.970038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6a44b-f182-47e5-aa94-0bf0cd973b4a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:40.970322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6a44b-f182-47e5-aa94-0bf0cd973b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:40.970644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6a44b-f182-47e5-aa94-0bf0cd973b4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:40.985176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6a44b-f182-47e5-aa94-0bf0cd973b4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:40.987145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6a44b-f182-47e5-aa94-0bf0cd973b4a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.004228 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-98a6a44b-f182-47e5-aa94-0bf0cd973b4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:41.005777 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 412/821] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:41.012070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a5194-f3a3-4a40-ae5b-a086dcb44ba1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.022639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a5194-f3a3-4a40-ae5b-a086dcb44ba1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.027321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef7b6c-5883-49de-88e1-7e5b9f80046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.028027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef7b6c-5883-49de-88e1-7e5b9f80046e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.028303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef7b6c-5883-49de-88e1-7e5b9f80046e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.028628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef7b6c-5883-49de-88e1-7e5b9f80046e admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.029360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef7b6c-5883-49de-88e1-7e5b9f80046e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:41.029736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef7b6c-5883-49de-88e1-7e5b9f80046e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.031452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef7b6c-5883-49de-88e1-7e5b9f80046e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.044320 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 410/822] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:41.050852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6a44b-f182-47e5-aa94-0bf0cd973b4a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.062531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6a44b-f182-47e5-aa94-0bf0cd973b4a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.067171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437e2d5-5945-4fac-a761-5b70a1a1f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.068089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437e2d5-5945-4fac-a761-5b70a1a1f0eb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.068365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437e2d5-5945-4fac-a761-5b70a1a1f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.068637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437e2d5-5945-4fac-a761-5b70a1a1f0eb admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.077510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437e2d5-5945-4fac-a761-5b70a1a1f0eb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.079741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437e2d5-5945-4fac-a761-5b70a1a1f0eb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.095016 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-b437e2d5-5945-4fac-a761-5b70a1a1f0eb admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 27 20:31:41.096616 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 413/823] 10.222.0.21 () {56 vars in 1138 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:41.103767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef7b6c-5883-49de-88e1-7e5b9f80046e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.114616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef7b6c-5883-49de-88e1-7e5b9f80046e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.119852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422d27b-d1d7-4d19-b89f-d151e21c04dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.120548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422d27b-d1d7-4d19-b89f-d151e21c04dc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.120882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422d27b-d1d7-4d19-b89f-d151e21c04dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.121155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422d27b-d1d7-4d19-b89f-d151e21c04dc admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.122099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422d27b-d1d7-4d19-b89f-d151e21c04dc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:41.122411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422d27b-d1d7-4d19-b89f-d151e21c04dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.124830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422d27b-d1d7-4d19-b89f-d151e21c04dc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.145173 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 411/824] 10.222.0.21 () {56 vars in 1170 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:41.151651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437e2d5-5945-4fac-a761-5b70a1a1f0eb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.161871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437e2d5-5945-4fac-a761-5b70a1a1f0eb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.168136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0a1f-d2d0-4319-875e-e300bf3e4ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.168980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0a1f-d2d0-4319-875e-e300bf3e4ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.169260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0a1f-d2d0-4319-875e-e300bf3e4ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.169533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b0a1f-d2d0-4319-875e-e300bf3e4ff8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.184280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b0a1f-d2d0-4319-875e-e300bf3e4ff8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.186196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b0a1f-d2d0-4319-875e-e300bf3e4ff8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.203589 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-a57b0a1f-d2d0-4319-875e-e300bf3e4ff8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:41.205192 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 414/825] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:41.213933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422d27b-d1d7-4d19-b89f-d151e21c04dc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.228903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422d27b-d1d7-4d19-b89f-d151e21c04dc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.234309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4a94f-9079-4a9d-a4f4-d1fbb49783e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.235073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4a94f-9079-4a9d-a4f4-d1fbb49783e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.235445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4a94f-9079-4a9d-a4f4-d1fbb49783e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.235716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4a94f-9079-4a9d-a4f4-d1fbb49783e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.236515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4a94f-9079-4a9d-a4f4-d1fbb49783e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:41.236876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4a94f-9079-4a9d-a4f4-d1fbb49783e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.238578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4a94f-9079-4a9d-a4f4-d1fbb49783e2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.252440 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 412/826] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:41.258895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0a1f-d2d0-4319-875e-e300bf3e4ff8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.270153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b0a1f-d2d0-4319-875e-e300bf3e4ff8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.277709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66523ca8-35bf-4f9a-ad6d-f892f9cbfd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.278480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66523ca8-35bf-4f9a-ad6d-f892f9cbfd2c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.278761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66523ca8-35bf-4f9a-ad6d-f892f9cbfd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.279032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66523ca8-35bf-4f9a-ad6d-f892f9cbfd2c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.286313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66523ca8-35bf-4f9a-ad6d-f892f9cbfd2c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.288514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66523ca8-35bf-4f9a-ad6d-f892f9cbfd2c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.303904 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-66523ca8-35bf-4f9a-ad6d-f892f9cbfd2c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:41.305434 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 415/827] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:41.311601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4a94f-9079-4a9d-a4f4-d1fbb49783e2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.322272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4a94f-9079-4a9d-a4f4-d1fbb49783e2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.326959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dce618-6088-4f30-aef5-f78723b7b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.327691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dce618-6088-4f30-aef5-f78723b7b9df admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.327968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dce618-6088-4f30-aef5-f78723b7b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.328294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dce618-6088-4f30-aef5-f78723b7b9df admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.329085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dce618-6088-4f30-aef5-f78723b7b9df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:41.329444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dce618-6088-4f30-aef5-f78723b7b9df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.331368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dce618-6088-4f30-aef5-f78723b7b9df admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.344603 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 413/828] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:41.350999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66523ca8-35bf-4f9a-ad6d-f892f9cbfd2c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.360958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66523ca8-35bf-4f9a-ad6d-f892f9cbfd2c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.366182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef133e-dd22-48d6-88b4-3a36914c9ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.367186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef133e-dd22-48d6-88b4-3a36914c9ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.367496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef133e-dd22-48d6-88b4-3a36914c9ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.367751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef133e-dd22-48d6-88b4-3a36914c9ca2 admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/93ed192079af4cad8a303e6c1b4da343/roles/9442d70924794d1d9b528d5b470a7366` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.387531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef133e-dd22-48d6-88b4-3a36914c9ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=93ed192079af4cad8a303e6c1b4da343, role_id=9442d70924794d1d9b528d5b470a7366)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.390270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef133e-dd22-48d6-88b4-3a36914c9ca2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.411423 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 416/829] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:31:41 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/93ed192079af4cad8a303e6c1b4da343/roles/9442d70924794d1d9b528d5b470a7366 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:41.618336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ffe35-8f4a-4cb9-8a7a-c05ba25e2aa2 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.618680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ffe35-8f4a-4cb9-8a7a-c05ba25e2aa2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.618846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ffe35-8f4a-4cb9-8a7a-c05ba25e2aa2 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.621003 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 414/830] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:41.627904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22689e3-3bbf-4595-a1cc-a7a267f25308 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.628199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9890-11ed-418b-9392-cd5acc6551ac None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.628358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22689e3-3bbf-4595-a1cc-a7a267f25308 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.628501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9890-11ed-418b-9392-cd5acc6551ac None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.628642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22689e3-3bbf-4595-a1cc-a7a267f25308 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.628781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af9890-11ed-418b-9392-cd5acc6551ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.630438 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 415/831] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:41.638743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9593af-3eab-4507-a9bf-35d49a8c9b08 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.639004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9593af-3eab-4507-a9bf-35d49a8c9b08 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.639345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9593af-3eab-4507-a9bf-35d49a8c9b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.653822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-20af9890-11ed-418b-9392-cd5acc6551ac None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:41.655070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-20af9890-11ed-418b-9392-cd5acc6551ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:41.661034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7c9593af-3eab-4507-a9bf-35d49a8c9b08 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:41.662199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7c9593af-3eab-4507-a9bf-35d49a8c9b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:41.723015 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 416/832] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:41 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:31:41.724687 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 417/833] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:41 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:41.750376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9593af-3eab-4507-a9bf-35d49a8c9b08 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.750698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af9890-11ed-418b-9392-cd5acc6551ac None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.760431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9593af-3eab-4507-a9bf-35d49a8c9b08 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.760715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af9890-11ed-418b-9392-cd5acc6551ac None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.765236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde89855-3ee8-4937-8734-eba81e4ebd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.766124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde89855-3ee8-4937-8734-eba81e4ebd63 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.766298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde89855-3ee8-4937-8734-eba81e4ebd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.766558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde89855-3ee8-4937-8734-eba81e4ebd63 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.767224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde89855-3ee8-4937-8734-eba81e4ebd63 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.768844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde89855-3ee8-4937-8734-eba81e4ebd63 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.772886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760185c-cb89-4386-8882-3a07da78b4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.773679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760185c-cb89-4386-8882-3a07da78b4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.773953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760185c-cb89-4386-8882-3a07da78b4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.774219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760185c-cb89-4386-8882-3a07da78b4b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.780574 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-cde89855-3ee8-4937-8734-eba81e4ebd63 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 27 20:31:41.782037 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 418/834] 10.222.0.21 () {56 vars in 1150 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:41.788323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde89855-3ee8-4937-8734-eba81e4ebd63 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.797882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde89855-3ee8-4937-8734-eba81e4ebd63 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.800733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760185c-cb89-4386-8882-3a07da78b4b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:41.809672 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-b760185c-cb89-4386-8882-3a07da78b4b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:31:41.809820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dd9d9-58d1-409c-a06b-f0d305826a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.809820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dd9d9-58d1-409c-a06b-f0d305826a0d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.810002 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 417/835] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:41.810158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dd9d9-58d1-409c-a06b-f0d305826a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.810446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dd9d9-58d1-409c-a06b-f0d305826a0d admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.811164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7dd9d9-58d1-409c-a06b-f0d305826a0d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:41.811510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7dd9d9-58d1-409c-a06b-f0d305826a0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.813081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7dd9d9-58d1-409c-a06b-f0d305826a0d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.821129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760185c-cb89-4386-8882-3a07da78b4b0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.828556 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 419/836] 10.222.0.21 () {56 vars in 1145 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:41.835126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dd9d9-58d1-409c-a06b-f0d305826a0d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.842729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760185c-cb89-4386-8882-3a07da78b4b0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.848505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dd9d9-58d1-409c-a06b-f0d305826a0d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.852816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000214b1-e70b-4b9c-9404-9c1c994c73bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.853479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000214b1-e70b-4b9c-9404-9c1c994c73bd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.853763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000214b1-e70b-4b9c-9404-9c1c994c73bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.854033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000214b1-e70b-4b9c-9404-9c1c994c73bd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.854792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000214b1-e70b-4b9c-9404-9c1c994c73bd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:41.855095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000214b1-e70b-4b9c-9404-9c1c994c73bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.856725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000214b1-e70b-4b9c-9404-9c1c994c73bd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.861258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8240211-694e-47cd-974e-9e2abdf5f918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.861906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240211-694e-47cd-974e-9e2abdf5f918 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.862181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240211-694e-47cd-974e-9e2abdf5f918 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.862458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240211-694e-47cd-974e-9e2abdf5f918 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.863208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8240211-694e-47cd-974e-9e2abdf5f918 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:41.863546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8240211-694e-47cd-974e-9e2abdf5f918 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.865084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8240211-694e-47cd-974e-9e2abdf5f918 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.875869 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 420/837] 10.222.0.21 () {56 vars in 1145 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:41.881224 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 418/838] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:41.882270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8240211-694e-47cd-974e-9e2abdf5f918 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.889603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000214b1-e70b-4b9c-9404-9c1c994c73bd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:41.900559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8240211-694e-47cd-974e-9e2abdf5f918 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.903235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000214b1-e70b-4b9c-9404-9c1c994c73bd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:41.911670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798a323-db99-4073-8247-fc4e26de5235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.912325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a323-db99-4073-8247-fc4e26de5235 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.912791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f9252-cdd0-4d1b-8bd8-1f916199eb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:41.913570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f9252-cdd0-4d1b-8bd8-1f916199eb4b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:41.913850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f9252-cdd0-4d1b-8bd8-1f916199eb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.913953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a323-db99-4073-8247-fc4e26de5235 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:41.914210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a323-db99-4073-8247-fc4e26de5235 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.914967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798a323-db99-4073-8247-fc4e26de5235 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.915534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f9252-cdd0-4d1b-8bd8-1f916199eb4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:41.917144 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-7798a323-db99-4073-8247-fc4e26de5235 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:41.917144 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:31:41.917144 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:31:41.918022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798a323-db99-4073-8247-fc4e26de5235 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.936547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f9252-cdd0-4d1b-8bd8-1f916199eb4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:41.938440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f9252-cdd0-4d1b-8bd8-1f916199eb4b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:41.957978 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 421/839] 10.222.0.21 () {60 vars in 1165 bytes} [Sat Nov 27 20:31:41 2021] POST /identity/v3/endpoints => generated 346 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:31:41.967525 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-611f9252-cdd0-4d1b-8bd8-1f916199eb4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:41.968787 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 419/840] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:41.975137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798a323-db99-4073-8247-fc4e26de5235 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:42.001484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798a323-db99-4073-8247-fc4e26de5235 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:42.007278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be901970-3991-4171-abaa-e2431dae806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:42.007949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be901970-3991-4171-abaa-e2431dae806c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:42.008281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be901970-3991-4171-abaa-e2431dae806c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:42.008556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be901970-3991-4171-abaa-e2431dae806c admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:42.009349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be901970-3991-4171-abaa-e2431dae806c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:42.009656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be901970-3991-4171-abaa-e2431dae806c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:42.011279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be901970-3991-4171-abaa-e2431dae806c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:42.036421 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 422/841] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:42.042463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f9252-cdd0-4d1b-8bd8-1f916199eb4b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:42.057320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f9252-cdd0-4d1b-8bd8-1f916199eb4b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:42.067933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d53ab-6fa4-4086-8d03-6c1548257aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:42.068872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d53ab-6fa4-4086-8d03-6c1548257aaf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:42.069253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d53ab-6fa4-4086-8d03-6c1548257aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:42.069533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d53ab-6fa4-4086-8d03-6c1548257aaf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:42.083581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d53ab-6fa4-4086-8d03-6c1548257aaf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:42.086397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d53ab-6fa4-4086-8d03-6c1548257aaf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:42.103847 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-5e2d53ab-6fa4-4086-8d03-6c1548257aaf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 27 20:31:42.105542 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 420/842] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:42 2021] GET /identity/v3/users/swift => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:42.117199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be901970-3991-4171-abaa-e2431dae806c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:42.133660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be901970-3991-4171-abaa-e2431dae806c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:42.149146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcbcb2-d756-4589-b596-9aa13a90e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:42.149833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcbcb2-d756-4589-b596-9aa13a90e357 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:42.150110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcbcb2-d756-4589-b596-9aa13a90e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:42.150381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcbcb2-d756-4589-b596-9aa13a90e357 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:42.151240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcbcb2-d756-4589-b596-9aa13a90e357 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:42.151574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcbcb2-d756-4589-b596-9aa13a90e357 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:42.153433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddcbcb2-d756-4589-b596-9aa13a90e357 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:42.180390 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 423/843] 10.222.0.21 () {56 vars in 1156 bytes} [Sat Nov 27 20:31:42 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:42.186536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d53ab-6fa4-4086-8d03-6c1548257aaf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:42.201801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d53ab-6fa4-4086-8d03-6c1548257aaf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:42.211047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97ea9b-2b6f-4057-9b0f-c9f0e6873f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:42.211931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97ea9b-2b6f-4057-9b0f-c9f0e6873f0e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:42.212213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97ea9b-2b6f-4057-9b0f-c9f0e6873f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:42.212484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97ea9b-2b6f-4057-9b0f-c9f0e6873f0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:42.232195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97ea9b-2b6f-4057-9b0f-c9f0e6873f0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:42.235040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa97ea9b-2b6f-4057-9b0f-c9f0e6873f0e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:42.259642 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-aa97ea9b-2b6f-4057-9b0f-c9f0e6873f0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:42.261601 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 421/844] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:42.268594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcbcb2-d756-4589-b596-9aa13a90e357 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:42.281468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcbcb2-d756-4589-b596-9aa13a90e357 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:42.296562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977cfb8-7c74-48c2-99a4-05aa25a9da1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:42.297237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977cfb8-7c74-48c2-99a4-05aa25a9da1a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:42.297518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977cfb8-7c74-48c2-99a4-05aa25a9da1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:42.297845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977cfb8-7c74-48c2-99a4-05aa25a9da1a admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:42.298589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977cfb8-7c74-48c2-99a4-05aa25a9da1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:42.298944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977cfb8-7c74-48c2-99a4-05aa25a9da1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:42.300624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977cfb8-7c74-48c2-99a4-05aa25a9da1a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:42.313932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 424/845] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:42.320027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97ea9b-2b6f-4057-9b0f-c9f0e6873f0e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:42.330056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97ea9b-2b6f-4057-9b0f-c9f0e6873f0e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:42.336611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80773fc6-92bf-4cce-8c3a-7287d5a69e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:42.337443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80773fc6-92bf-4cce-8c3a-7287d5a69e03 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:42.337724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80773fc6-92bf-4cce-8c3a-7287d5a69e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:42.337998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80773fc6-92bf-4cce-8c3a-7287d5a69e03 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:42.345451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80773fc6-92bf-4cce-8c3a-7287d5a69e03 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:42.347500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80773fc6-92bf-4cce-8c3a-7287d5a69e03 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:42.361022 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-80773fc6-92bf-4cce-8c3a-7287d5a69e03 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:42.362782 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 422/846] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:42.368655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977cfb8-7c74-48c2-99a4-05aa25a9da1a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:42.386621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977cfb8-7c74-48c2-99a4-05aa25a9da1a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:42.391626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64970b78-e64d-47ed-878e-eda37ecaa17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:42.392487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970b78-e64d-47ed-878e-eda37ecaa17c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:42.393041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970b78-e64d-47ed-878e-eda37ecaa17c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:42.393541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64970b78-e64d-47ed-878e-eda37ecaa17c admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:42.394513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64970b78-e64d-47ed-878e-eda37ecaa17c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:42.395002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64970b78-e64d-47ed-878e-eda37ecaa17c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:42.397202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64970b78-e64d-47ed-878e-eda37ecaa17c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:42.416745 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 425/847] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:42.422613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80773fc6-92bf-4cce-8c3a-7287d5a69e03 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:42.437179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80773fc6-92bf-4cce-8c3a-7287d5a69e03 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:42.450757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9710c-ca6b-452c-8288-31f8ae91ac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:42.451927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9710c-ca6b-452c-8288-31f8ae91ac01 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:42.452388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9710c-ca6b-452c-8288-31f8ae91ac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:42.452835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9710c-ca6b-452c-8288-31f8ae91ac01 admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/f39a303b702041259ebb6a66c5967528/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:42.455004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9710c-ca6b-452c-8288-31f8ae91ac01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=f39a303b702041259ebb6a66c5967528, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:42.457866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9710c-ca6b-452c-8288-31f8ae91ac01 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:42.481147 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 423/848] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:31:42 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/f39a303b702041259ebb6a66c5967528/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:42.838428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c81b-759d-447b-a5e0-43a78093fec3 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:42.838706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c81b-759d-447b-a5e0-43a78093fec3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:42.838985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9c81b-759d-447b-a5e0-43a78093fec3 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:42.841042 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 426/849] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:42.847462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239fc30-9020-47c2-bc14-2bff5fc9ad54 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:42.847750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239fc30-9020-47c2-bc14-2bff5fc9ad54 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:42.848022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239fc30-9020-47c2-bc14-2bff5fc9ad54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:42.872339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5239fc30-9020-47c2-bc14-2bff5fc9ad54 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:42.873820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5239fc30-9020-47c2-bc14-2bff5fc9ad54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:42.940550 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 424/850] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:42 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:42.966593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c81b-759d-447b-a5e0-43a78093fec3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:42.987074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9c81b-759d-447b-a5e0-43a78093fec3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:42.995002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef923b-a217-4a66-b63e-5b161fef5b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:42.995882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef923b-a217-4a66-b63e-5b161fef5b1e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:42.996233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef923b-a217-4a66-b63e-5b161fef5b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:42.996576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef923b-a217-4a66-b63e-5b161fef5b1e admin admin] PATH_INFO: `/v3/services/network` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:42.997330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef923b-a217-4a66-b63e-5b161fef5b1e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:42.999351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef923b-a217-4a66-b63e-5b161fef5b1e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:43.022955 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-ecef923b-a217-4a66-b63e-5b161fef5b1e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 27 20:31:43.024532 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 427/851] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:42 2021] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:43.032675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239fc30-9020-47c2-bc14-2bff5fc9ad54 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:43.042370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239fc30-9020-47c2-bc14-2bff5fc9ad54 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:43.047145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e76e-ba52-4936-a98d-c1a47bcb5cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:43.048082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e76e-ba52-4936-a98d-c1a47bcb5cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:43.048573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e76e-ba52-4936-a98d-c1a47bcb5cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:43.049076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e76e-ba52-4936-a98d-c1a47bcb5cb6 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:43.049978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025e76e-ba52-4936-a98d-c1a47bcb5cb6 admin admin] RBAC: Adding query filter params (name=network) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:43.050459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025e76e-ba52-4936-a98d-c1a47bcb5cb6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:43.052302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025e76e-ba52-4936-a98d-c1a47bcb5cb6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:43.057960 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 425/852] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:31:43 2021] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:43.063563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef923b-a217-4a66-b63e-5b161fef5b1e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:43.076181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef923b-a217-4a66-b63e-5b161fef5b1e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:43.083345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0558e9-b7e4-41ba-af9d-11a4143bad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:43.083996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0558e9-b7e4-41ba-af9d-11a4143bad45 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:43.084307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0558e9-b7e4-41ba-af9d-11a4143bad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:43.085114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0558e9-b7e4-41ba-af9d-11a4143bad45 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:43.086007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0558e9-b7e4-41ba-af9d-11a4143bad45 admin admin] RBAC: Adding query filter params (type=network) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:43.086311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0558e9-b7e4-41ba-af9d-11a4143bad45 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:43.087914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0558e9-b7e4-41ba-af9d-11a4143bad45 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:43.099453 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 428/853] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:31:43 2021] GET /identity/v3/services?type=network => generated 350 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:43.105455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e76e-ba52-4936-a98d-c1a47bcb5cb6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:43.119850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e76e-ba52-4936-a98d-c1a47bcb5cb6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:43.124960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dd8d8-43fe-4ee0-b0a8-4cd0f35e89ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:43.125887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dd8d8-43fe-4ee0-b0a8-4cd0f35e89ff admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:43.126347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dd8d8-43fe-4ee0-b0a8-4cd0f35e89ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:43.126831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dd8d8-43fe-4ee0-b0a8-4cd0f35e89ff admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:43.127870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173dd8d8-43fe-4ee0-b0a8-4cd0f35e89ff admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:43.129102 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-173dd8d8-43fe-4ee0-b0a8-4cd0f35e89ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:31:43.129102 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:31:43.129102 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:31:43.130300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173dd8d8-43fe-4ee0-b0a8-4cd0f35e89ff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:43.165722 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 426/854] 10.222.0.21 () {60 vars in 1165 bytes} [Sat Nov 27 20:31:43 2021] POST /identity/v3/endpoints => generated 327 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:31:43.854148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa856c-a8f4-4da1-8213-657263a8cfc5 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:43.854691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa856c-a8f4-4da1-8213-657263a8cfc5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:43.854691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa856c-a8f4-4da1-8213-657263a8cfc5 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:43.857076 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 429/855] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:43.863836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd047-75df-4c6c-b72f-634326176daf None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:43.864349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd047-75df-4c6c-b72f-634326176daf None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:43.864447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbd047-75df-4c6c-b72f-634326176daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:43.887382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-dcfbd047-75df-4c6c-b72f-634326176daf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:43.888940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dcfbd047-75df-4c6c-b72f-634326176daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:43.909001 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 427/856] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:43 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:43.936295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa856c-a8f4-4da1-8213-657263a8cfc5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:43.955994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa856c-a8f4-4da1-8213-657263a8cfc5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:43.962265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bde464-56a3-490f-8204-c9f7e72b93a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:43.963062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde464-56a3-490f-8204-c9f7e72b93a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:43.963386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde464-56a3-490f-8204-c9f7e72b93a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:43.963662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde464-56a3-490f-8204-c9f7e72b93a6 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:43.964336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bde464-56a3-490f-8204-c9f7e72b93a6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:43.965926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bde464-56a3-490f-8204-c9f7e72b93a6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:43.977894 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-c1bde464-56a3-490f-8204-c9f7e72b93a6 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 27 20:31:43.979364 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 430/857] 10.222.0.21 () {56 vars in 1153 bytes} [Sat Nov 27 20:31:43 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:43.985689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbd047-75df-4c6c-b72f-634326176daf None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:43.995692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbd047-75df-4c6c-b72f-634326176daf None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.000516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94966533-f45a-4c17-a637-627e70346f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.001158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94966533-f45a-4c17-a637-627e70346f68 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.001438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94966533-f45a-4c17-a637-627e70346f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.001709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94966533-f45a-4c17-a637-627e70346f68 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.002428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94966533-f45a-4c17-a637-627e70346f68 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:44.002728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94966533-f45a-4c17-a637-627e70346f68 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.004721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94966533-f45a-4c17-a637-627e70346f68 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.010558 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 428/858] 10.222.0.21 () {56 vars in 1147 bytes} [Sat Nov 27 20:31:43 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:44.018481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bde464-56a3-490f-8204-c9f7e72b93a6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.030238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bde464-56a3-490f-8204-c9f7e72b93a6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.035089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12d260-a81a-4988-b885-3cb979f937c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.036005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12d260-a81a-4988-b885-3cb979f937c0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.036489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12d260-a81a-4988-b885-3cb979f937c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.036963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12d260-a81a-4988-b885-3cb979f937c0 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.037910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12d260-a81a-4988-b885-3cb979f937c0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:44.038448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12d260-a81a-4988-b885-3cb979f937c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.040266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12d260-a81a-4988-b885-3cb979f937c0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.046105 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 431/859] 10.222.0.21 () {56 vars in 1147 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:44.274666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba941da0-b12e-4155-b772-7db5f0226af0 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.275041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba941da0-b12e-4155-b772-7db5f0226af0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.275241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba941da0-b12e-4155-b772-7db5f0226af0 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.277006 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 429/860] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:44.283163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ef63-dc80-4b17-b392-e3eacc16923a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.283471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ef63-dc80-4b17-b392-e3eacc16923a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.283743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ef63-dc80-4b17-b392-e3eacc16923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.301943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-dac9ef63-dc80-4b17-b392-e3eacc16923a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:44.303652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dac9ef63-dc80-4b17-b392-e3eacc16923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:44.311573 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 432/861] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:44 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:44.337025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba941da0-b12e-4155-b772-7db5f0226af0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.349281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba941da0-b12e-4155-b772-7db5f0226af0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.353739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6098244-fb3a-4dd4-beae-d722ca29f70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.354514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6098244-fb3a-4dd4-beae-d722ca29f70d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.354787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6098244-fb3a-4dd4-beae-d722ca29f70d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.355053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6098244-fb3a-4dd4-beae-d722ca29f70d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.367264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6098244-fb3a-4dd4-beae-d722ca29f70d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:44.374289 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d6098244-fb3a-4dd4-beae-d722ca29f70d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:31:44.375709 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 430/862] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:44.381995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9ef63-dc80-4b17-b392-e3eacc16923a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.390966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9ef63-dc80-4b17-b392-e3eacc16923a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.395542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d967af-0dbb-4be7-b5d1-e3b4a829af2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.396195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d967af-0dbb-4be7-b5d1-e3b4a829af2b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.396470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d967af-0dbb-4be7-b5d1-e3b4a829af2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.396778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d967af-0dbb-4be7-b5d1-e3b4a829af2b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.397533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d967af-0dbb-4be7-b5d1-e3b4a829af2b admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:44.397831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d967af-0dbb-4be7-b5d1-e3b4a829af2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.399423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d967af-0dbb-4be7-b5d1-e3b4a829af2b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.408113 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 433/863] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:44.414586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6098244-fb3a-4dd4-beae-d722ca29f70d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.426365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6098244-fb3a-4dd4-beae-d722ca29f70d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.435292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1bdd4-1c2f-40ab-a3f7-07bccc15d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.435292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1bdd4-1c2f-40ab-a3f7-07bccc15d5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.435292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1bdd4-1c2f-40ab-a3f7-07bccc15d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.435292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1bdd4-1c2f-40ab-a3f7-07bccc15d5f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.443810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1bdd4-1c2f-40ab-a3f7-07bccc15d5f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.443967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1bdd4-1c2f-40ab-a3f7-07bccc15d5f2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.461337 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-4be1bdd4-1c2f-40ab-a3f7-07bccc15d5f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:44.462837 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 431/864] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:44.469266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d967af-0dbb-4be7-b5d1-e3b4a829af2b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.480361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d967af-0dbb-4be7-b5d1-e3b4a829af2b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.485310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b788-89e8-444e-a1fe-2fe1bd031e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.486045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b788-89e8-444e-a1fe-2fe1bd031e61 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.486326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b788-89e8-444e-a1fe-2fe1bd031e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.486597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b788-89e8-444e-a1fe-2fe1bd031e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.487442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b788-89e8-444e-a1fe-2fe1bd031e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:44.487802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b788-89e8-444e-a1fe-2fe1bd031e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.489439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b788-89e8-444e-a1fe-2fe1bd031e61 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.503479 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 434/865] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:44.509957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1bdd4-1c2f-40ab-a3f7-07bccc15d5f2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.520138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1bdd4-1c2f-40ab-a3f7-07bccc15d5f2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.525077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59081a2-ba5d-4751-b370-768f6e102ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.525862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59081a2-ba5d-4751-b370-768f6e102ddc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.526139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59081a2-ba5d-4751-b370-768f6e102ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.526409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59081a2-ba5d-4751-b370-768f6e102ddc admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.533983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59081a2-ba5d-4751-b370-768f6e102ddc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.536097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59081a2-ba5d-4751-b370-768f6e102ddc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.554147 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-e59081a2-ba5d-4751-b370-768f6e102ddc admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 27 20:31:44.555646 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 432/866] 10.222.0.21 () {56 vars in 1138 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:44.564599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b788-89e8-444e-a1fe-2fe1bd031e61 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.575172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b788-89e8-444e-a1fe-2fe1bd031e61 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.579810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8787-e7f2-493d-9e01-813550456f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.580562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8787-e7f2-493d-9e01-813550456f0a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.580844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8787-e7f2-493d-9e01-813550456f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.581164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf8787-e7f2-493d-9e01-813550456f0a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.582002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf8787-e7f2-493d-9e01-813550456f0a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:44.582356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf8787-e7f2-493d-9e01-813550456f0a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.584355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf8787-e7f2-493d-9e01-813550456f0a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.602887 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 435/867] 10.222.0.21 () {56 vars in 1170 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:44.608621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59081a2-ba5d-4751-b370-768f6e102ddc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.618435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59081a2-ba5d-4751-b370-768f6e102ddc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.622873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ed552-1363-40dd-8e25-a6d39f733e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.623785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ed552-1363-40dd-8e25-a6d39f733e03 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.624064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ed552-1363-40dd-8e25-a6d39f733e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.624345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ed552-1363-40dd-8e25-a6d39f733e03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.632537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ed552-1363-40dd-8e25-a6d39f733e03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.634284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ed552-1363-40dd-8e25-a6d39f733e03 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.643241 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 433/868] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:31:44.648905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8787-e7f2-493d-9e01-813550456f0a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.658513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf8787-e7f2-493d-9e01-813550456f0a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.663687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6579fa-6454-40b3-97b4-2c99ebc3e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.664514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6579fa-6454-40b3-97b4-2c99ebc3e83e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.664801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6579fa-6454-40b3-97b4-2c99ebc3e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.665072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6579fa-6454-40b3-97b4-2c99ebc3e83e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.675577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6579fa-6454-40b3-97b4-2c99ebc3e83e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.677397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6579fa-6454-40b3-97b4-2c99ebc3e83e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.694662 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-de6579fa-6454-40b3-97b4-2c99ebc3e83e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:44.696128 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 436/869] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:44.701995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ed552-1363-40dd-8e25-a6d39f733e03 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.711138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ed552-1363-40dd-8e25-a6d39f733e03 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.715812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e7ac8-608b-41bf-bd2c-d928e52cbb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.716687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7ac8-608b-41bf-bd2c-d928e52cbb83 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.717165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7ac8-608b-41bf-bd2c-d928e52cbb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.717635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e7ac8-608b-41bf-bd2c-d928e52cbb83 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.718561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e7ac8-608b-41bf-bd2c-d928e52cbb83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:44.719072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e7ac8-608b-41bf-bd2c-d928e52cbb83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.720853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e7ac8-608b-41bf-bd2c-d928e52cbb83 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.732817 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 434/870] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:44.738730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6579fa-6454-40b3-97b4-2c99ebc3e83e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.748728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6579fa-6454-40b3-97b4-2c99ebc3e83e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.753320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd5fd3-0c1c-443e-a174-b52d221cd90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.754333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5fd3-0c1c-443e-a174-b52d221cd90f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.754827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5fd3-0c1c-443e-a174-b52d221cd90f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.755315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd5fd3-0c1c-443e-a174-b52d221cd90f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.762847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5fd3-0c1c-443e-a174-b52d221cd90f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.765079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd5fd3-0c1c-443e-a174-b52d221cd90f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.779244 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-86fd5fd3-0c1c-443e-a174-b52d221cd90f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:44.785577 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 437/871] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:44.786873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e7ac8-608b-41bf-bd2c-d928e52cbb83 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.801262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e7ac8-608b-41bf-bd2c-d928e52cbb83 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.806572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a4a03-a405-4d91-a911-5980d5997213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.807491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4a03-a405-4d91-a911-5980d5997213 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.807972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4a03-a405-4d91-a911-5980d5997213 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.808440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4a03-a405-4d91-a911-5980d5997213 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.809418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a4a03-a405-4d91-a911-5980d5997213 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:44.809977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a4a03-a405-4d91-a911-5980d5997213 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.812030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a4a03-a405-4d91-a911-5980d5997213 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.824497 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 435/872] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:44.830993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd5fd3-0c1c-443e-a174-b52d221cd90f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.842879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd5fd3-0c1c-443e-a174-b52d221cd90f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.847762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b24af-832c-446d-b89a-73716ff07a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.848693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b24af-832c-446d-b89a-73716ff07a11 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.849169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b24af-832c-446d-b89a-73716ff07a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.849668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b24af-832c-446d-b89a-73716ff07a11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.850816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b24af-832c-446d-b89a-73716ff07a11 admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=93ed192079af4cad8a303e6c1b4da343) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:44.851362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b24af-832c-446d-b89a-73716ff07a11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.853495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b24af-832c-446d-b89a-73716ff07a11 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:44.860435 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 438/873] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/role_assignments?user.id=93ed192079af4cad8a303e6c1b4da343&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:44.911099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfde481-4697-4d9d-b102-5d56535f2bf8 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.911630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfde481-4697-4d9d-b102-5d56535f2bf8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.911736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfde481-4697-4d9d-b102-5d56535f2bf8 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.913781 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 436/874] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:44.919950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1180-11fb-49f3-930c-724549606c50 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.920227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1180-11fb-49f3-930c-724549606c50 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.920498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b1180-11fb-49f3-930c-724549606c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.939960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-377b1180-11fb-49f3-930c-724549606c50 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:44.941155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-377b1180-11fb-49f3-930c-724549606c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:44.949352 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 439/875] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:44 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:44.973881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfde481-4697-4d9d-b102-5d56535f2bf8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:44.986750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfde481-4697-4d9d-b102-5d56535f2bf8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:44.991771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168222e-7ce6-42e0-b7eb-c71cff97202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:44.992559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168222e-7ce6-42e0-b7eb-c71cff97202a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:44.992838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168222e-7ce6-42e0-b7eb-c71cff97202a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:44.993107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168222e-7ce6-42e0-b7eb-c71cff97202a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:44.993774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168222e-7ce6-42e0-b7eb-c71cff97202a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:44.995434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168222e-7ce6-42e0-b7eb-c71cff97202a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:45.008125 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-5168222e-7ce6-42e0-b7eb-c71cff97202a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 27 20:31:45.009708 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 437/876] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:44 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:45.016778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1180-11fb-49f3-930c-724549606c50 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:45.026489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b1180-11fb-49f3-930c-724549606c50 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:45.031403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4eb874-b9fc-4a21-9478-ae03036a6af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:45.032013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb874-b9fc-4a21-9478-ae03036a6af3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.032289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb874-b9fc-4a21-9478-ae03036a6af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.032558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4eb874-b9fc-4a21-9478-ae03036a6af3 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.033289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eb874-b9fc-4a21-9478-ae03036a6af3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:45.033591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eb874-b9fc-4a21-9478-ae03036a6af3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:45.035191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4eb874-b9fc-4a21-9478-ae03036a6af3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:45.040922 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 440/877] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:45.048294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168222e-7ce6-42e0-b7eb-c71cff97202a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:45.061493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168222e-7ce6-42e0-b7eb-c71cff97202a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:45.066324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be3968-aaf9-4248-94f9-fd8d5de83989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:45.066987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be3968-aaf9-4248-94f9-fd8d5de83989 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.067283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be3968-aaf9-4248-94f9-fd8d5de83989 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.067574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be3968-aaf9-4248-94f9-fd8d5de83989 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.068296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be3968-aaf9-4248-94f9-fd8d5de83989 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:45.068671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be3968-aaf9-4248-94f9-fd8d5de83989 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:45.070776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be3968-aaf9-4248-94f9-fd8d5de83989 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:45.076428 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 438/878] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:45.528409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec2d2-2938-4578-b23a-15e326000164 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.528766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec2d2-2938-4578-b23a-15e326000164 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.528950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec2d2-2938-4578-b23a-15e326000164 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.531006 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 441/879] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:45.536878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e8c3e-5ded-4916-9415-adf2dc6f6396 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.537170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e8c3e-5ded-4916-9415-adf2dc6f6396 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.537481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e8c3e-5ded-4916-9415-adf2dc6f6396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.555885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-409e8c3e-5ded-4916-9415-adf2dc6f6396 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:45.557065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-409e8c3e-5ded-4916-9415-adf2dc6f6396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:45.571362 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 439/880] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:45 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:45.591408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dec2d2-2938-4578-b23a-15e326000164 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:45.603679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dec2d2-2938-4578-b23a-15e326000164 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:45.608250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd479b7-3e78-4c7c-a4f2-078ce7a0977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:45.609015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd479b7-3e78-4c7c-a4f2-078ce7a0977c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.609347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd479b7-3e78-4c7c-a4f2-078ce7a0977c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.609623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd479b7-3e78-4c7c-a4f2-078ce7a0977c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.620642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd479b7-3e78-4c7c-a4f2-078ce7a0977c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:45.627920 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-2bd479b7-3e78-4c7c-a4f2-078ce7a0977c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:31:45.634404 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 442/881] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:45.635739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e8c3e-5ded-4916-9415-adf2dc6f6396 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:45.644744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e8c3e-5ded-4916-9415-adf2dc6f6396 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:45.649921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb6bf8-ca76-459f-bee8-ba849f9e2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:45.650571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb6bf8-ca76-459f-bee8-ba849f9e2d01 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.650854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb6bf8-ca76-459f-bee8-ba849f9e2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.651178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb6bf8-ca76-459f-bee8-ba849f9e2d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.651966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb6bf8-ca76-459f-bee8-ba849f9e2d01 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:45.652271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb6bf8-ca76-459f-bee8-ba849f9e2d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:45.653914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb6bf8-ca76-459f-bee8-ba849f9e2d01 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:45.667076 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 440/882] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:45.668352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd479b7-3e78-4c7c-a4f2-078ce7a0977c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:45.678667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd479b7-3e78-4c7c-a4f2-078ce7a0977c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:45.683374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da423aa-fcab-44f9-8332-7c07e256a2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:45.684198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da423aa-fcab-44f9-8332-7c07e256a2db admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.684480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da423aa-fcab-44f9-8332-7c07e256a2db admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.684810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da423aa-fcab-44f9-8332-7c07e256a2db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.695737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da423aa-fcab-44f9-8332-7c07e256a2db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:45.697550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da423aa-fcab-44f9-8332-7c07e256a2db admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:45.714194 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-1da423aa-fcab-44f9-8332-7c07e256a2db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:45.719415 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 443/883] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:45.721742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb6bf8-ca76-459f-bee8-ba849f9e2d01 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:45.731702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb6bf8-ca76-459f-bee8-ba849f9e2d01 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:45.736323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0601b-9a4d-4185-8b14-d47c8b2f27ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:45.737026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0601b-9a4d-4185-8b14-d47c8b2f27ba admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.737309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0601b-9a4d-4185-8b14-d47c8b2f27ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.737582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0601b-9a4d-4185-8b14-d47c8b2f27ba admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.738370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0601b-9a4d-4185-8b14-d47c8b2f27ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:45.738675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0601b-9a4d-4185-8b14-d47c8b2f27ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:45.740337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0601b-9a4d-4185-8b14-d47c8b2f27ba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:45.755342 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 441/884] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:45.759413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da423aa-fcab-44f9-8332-7c07e256a2db admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:45.769378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da423aa-fcab-44f9-8332-7c07e256a2db admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:45.774903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180887d0-43b7-4761-8b8c-b3538ece1dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:45.775773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180887d0-43b7-4761-8b8c-b3538ece1dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.776055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180887d0-43b7-4761-8b8c-b3538ece1dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.776329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180887d0-43b7-4761-8b8c-b3538ece1dc9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.784935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180887d0-43b7-4761-8b8c-b3538ece1dc9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:45.786992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180887d0-43b7-4761-8b8c-b3538ece1dc9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:45.801723 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-180887d0-43b7-4761-8b8c-b3538ece1dc9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 27 20:31:45.803863 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 444/885] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:45.809862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0601b-9a4d-4185-8b14-d47c8b2f27ba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:45.820329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0601b-9a4d-4185-8b14-d47c8b2f27ba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:45.824851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbda7b-875a-403d-8901-b170104502f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:45.825507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbda7b-875a-403d-8901-b170104502f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.825790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbda7b-875a-403d-8901-b170104502f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.826066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbda7b-875a-403d-8901-b170104502f2 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.826970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbda7b-875a-403d-8901-b170104502f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:45.827309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbda7b-875a-403d-8901-b170104502f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:45.829177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbda7b-875a-403d-8901-b170104502f2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:45.851389 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 442/886] 10.222.0.21 () {56 vars in 1156 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:45.853091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180887d0-43b7-4761-8b8c-b3538ece1dc9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:45.864541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180887d0-43b7-4761-8b8c-b3538ece1dc9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:45.869887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c21e9-5b5b-4a4d-af35-eb0814887814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:45.870433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c21e9-5b5b-4a4d-af35-eb0814887814 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.870769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c21e9-5b5b-4a4d-af35-eb0814887814 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.871054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c21e9-5b5b-4a4d-af35-eb0814887814 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.879904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c21e9-5b5b-4a4d-af35-eb0814887814 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:45.882355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c21e9-5b5b-4a4d-af35-eb0814887814 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:45.895347 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 445/887] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:31:45.897915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbda7b-875a-403d-8901-b170104502f2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:45.907921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbda7b-875a-403d-8901-b170104502f2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:45.913216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d577d6-a87b-4b26-8fba-d7dd128c2738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:45.914057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d577d6-a87b-4b26-8fba-d7dd128c2738 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.914340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d577d6-a87b-4b26-8fba-d7dd128c2738 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.914615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d577d6-a87b-4b26-8fba-d7dd128c2738 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.926468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d577d6-a87b-4b26-8fba-d7dd128c2738 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:45.928988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d577d6-a87b-4b26-8fba-d7dd128c2738 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:45.946675 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d9d577d6-a87b-4b26-8fba-d7dd128c2738 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:45.948110 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 443/888] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:45.954021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c21e9-5b5b-4a4d-af35-eb0814887814 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:45.963069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c21e9-5b5b-4a4d-af35-eb0814887814 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:45.967738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2a66-03cc-4e29-9f0c-4c103c922c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:45.968385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2a66-03cc-4e29-9f0c-4c103c922c32 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:45.968669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2a66-03cc-4e29-9f0c-4c103c922c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:45.968936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2a66-03cc-4e29-9f0c-4c103c922c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:45.969670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d2a66-03cc-4e29-9f0c-4c103c922c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:45.970166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d2a66-03cc-4e29-9f0c-4c103c922c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:45.971689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d2a66-03cc-4e29-9f0c-4c103c922c32 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:45.989624 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 446/889] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:45.991570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d577d6-a87b-4b26-8fba-d7dd128c2738 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:46.001655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d577d6-a87b-4b26-8fba-d7dd128c2738 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:46.006401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88547239-c478-4e32-bcde-4409056d6df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:46.007227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88547239-c478-4e32-bcde-4409056d6df0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:46.007700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88547239-c478-4e32-bcde-4409056d6df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:46.007982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88547239-c478-4e32-bcde-4409056d6df0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:46.015564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88547239-c478-4e32-bcde-4409056d6df0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:46.017596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88547239-c478-4e32-bcde-4409056d6df0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:46.031193 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-88547239-c478-4e32-bcde-4409056d6df0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:46.038287 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 444/890] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:46.039640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2a66-03cc-4e29-9f0c-4c103c922c32 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:46.049610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2a66-03cc-4e29-9f0c-4c103c922c32 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:46.054363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab052ff-8795-4fde-b15e-843f5e0789e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:46.055008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab052ff-8795-4fde-b15e-843f5e0789e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:46.055367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab052ff-8795-4fde-b15e-843f5e0789e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:46.055643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab052ff-8795-4fde-b15e-843f5e0789e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:46.056490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab052ff-8795-4fde-b15e-843f5e0789e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:46.056794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab052ff-8795-4fde-b15e-843f5e0789e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:46.058798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab052ff-8795-4fde-b15e-843f5e0789e0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:46.075427 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 447/891] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:46.078604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88547239-c478-4e32-bcde-4409056d6df0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:46.090918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88547239-c478-4e32-bcde-4409056d6df0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:46.095636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58103ae9-cc12-469d-a507-e0bd9d85b191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:46.096336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58103ae9-cc12-469d-a507-e0bd9d85b191 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:46.096616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58103ae9-cc12-469d-a507-e0bd9d85b191 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:46.096939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58103ae9-cc12-469d-a507-e0bd9d85b191 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:46.097776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58103ae9-cc12-469d-a507-e0bd9d85b191 admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=f39a303b702041259ebb6a66c5967528) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:46.098128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58103ae9-cc12-469d-a507-e0bd9d85b191 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:46.100262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58103ae9-cc12-469d-a507-e0bd9d85b191 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:46.111394 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 445/892] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:46 2021] GET /identity/v3/role_assignments?user.id=f39a303b702041259ebb6a66c5967528&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:46.600743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd0fc-39d2-46c9-a0c9-a7822f9d20d3 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:46.601088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd0fc-39d2-46c9-a0c9-a7822f9d20d3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:46.601298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dd0fc-39d2-46c9-a0c9-a7822f9d20d3 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:46.603348 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 448/893] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:46.609021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65374c-c086-4a2a-b0bc-3f62b2b92612 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:46.609311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65374c-c086-4a2a-b0bc-3f62b2b92612 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:46.609585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65374c-c086-4a2a-b0bc-3f62b2b92612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:46.628022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cd65374c-c086-4a2a-b0bc-3f62b2b92612 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:46.629223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cd65374c-c086-4a2a-b0bc-3f62b2b92612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:46.638285 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 446/894] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:46 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:46.662922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dd0fc-39d2-46c9-a0c9-a7822f9d20d3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:46.675518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dd0fc-39d2-46c9-a0c9-a7822f9d20d3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:46.680120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31953177-140e-40bf-9f66-e023bd0a1205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:46.680995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31953177-140e-40bf-9f66-e023bd0a1205 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:46.681480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31953177-140e-40bf-9f66-e023bd0a1205 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:46.681958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31953177-140e-40bf-9f66-e023bd0a1205 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:46.682910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31953177-140e-40bf-9f66-e023bd0a1205 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:46.684728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31953177-140e-40bf-9f66-e023bd0a1205 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:46.700277 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 449/895] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:31:46 2021] POST /identity/v3/services => generated 269 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:31:47.469652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeed0ac-5d3c-4bf6-bfb9-7ebb20e85b90 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.470153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeed0ac-5d3c-4bf6-bfb9-7ebb20e85b90 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.470256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeed0ac-5d3c-4bf6-bfb9-7ebb20e85b90 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.472312 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 447/896] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:47.478095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef5c5-5dd1-4394-bdf0-a28fff944254 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.478497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef5c5-5dd1-4394-bdf0-a28fff944254 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.478665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef5c5-5dd1-4394-bdf0-a28fff944254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.497088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-163ef5c5-5dd1-4394-bdf0-a28fff944254 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:47.498263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-163ef5c5-5dd1-4394-bdf0-a28fff944254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:47.515226 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 450/897] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:47 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:47.541220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeed0ac-5d3c-4bf6-bfb9-7ebb20e85b90 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:47.553783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeed0ac-5d3c-4bf6-bfb9-7ebb20e85b90 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:47.558154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e7191-3a33-4e5b-abda-d1eb89f5dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:47.558943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7191-3a33-4e5b-abda-d1eb89f5dc93 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.559219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7191-3a33-4e5b-abda-d1eb89f5dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.559604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e7191-3a33-4e5b-abda-d1eb89f5dc93 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.570901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e7191-3a33-4e5b-abda-d1eb89f5dc93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:47.578050 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-777e7191-3a33-4e5b-abda-d1eb89f5dc93 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 27 20:31:47.579533 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 448/898] 10.222.0.21 () {56 vars in 1141 bytes} [Sat Nov 27 20:31:47 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:47.585957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ef5c5-5dd1-4394-bdf0-a28fff944254 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:47.594937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ef5c5-5dd1-4394-bdf0-a28fff944254 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:47.599569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2cc85-c31b-47eb-944a-460f6ed2f722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:47.600765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2cc85-c31b-47eb-944a-460f6ed2f722 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.601045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2cc85-c31b-47eb-944a-460f6ed2f722 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.601316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2cc85-c31b-47eb-944a-460f6ed2f722 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.602070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2cc85-c31b-47eb-944a-460f6ed2f722 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:47.602371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2cc85-c31b-47eb-944a-460f6ed2f722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:47.603966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2cc85-c31b-47eb-944a-460f6ed2f722 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:47.612644 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 451/899] 10.222.0.21 () {56 vars in 1136 bytes} [Sat Nov 27 20:31:47 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:47.617361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddff96-3dbb-4564-b6e9-5e46e762e424 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.618120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddff96-3dbb-4564-b6e9-5e46e762e424 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.618493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2cc85-c31b-47eb-944a-460f6ed2f722 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:47.618875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddff96-3dbb-4564-b6e9-5e46e762e424 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.621007 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 449/900] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:47 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:47.628152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe92fc-d527-43b5-a252-e6ceb9d2e311 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.628436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe92fc-d527-43b5-a252-e6ceb9d2e311 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.628714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe92fc-d527-43b5-a252-e6ceb9d2e311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.629539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2cc85-c31b-47eb-944a-460f6ed2f722 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:47.634792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4ba99-2025-4b52-963a-fea4874a1c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:47.636064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ba99-2025-4b52-963a-fea4874a1c53 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.636546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ba99-2025-4b52-963a-fea4874a1c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.637012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4ba99-2025-4b52-963a-fea4874a1c53 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.648224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4ba99-2025-4b52-963a-fea4874a1c53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:47.649320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0fbe92fc-d527-43b5-a252-e6ceb9d2e311 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:47.650512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0fbe92fc-d527-43b5-a252-e6ceb9d2e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:47.650804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4ba99-2025-4b52-963a-fea4874a1c53 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:47.663328 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 450/901] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:47 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:47.674671 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-3ce4ba99-2025-4b52-963a-fea4874a1c53 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:47.676410 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 452/902] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:47.682679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe92fc-d527-43b5-a252-e6ceb9d2e311 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:47.685805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4ba99-2025-4b52-963a-fea4874a1c53 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:47.693146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe92fc-d527-43b5-a252-e6ceb9d2e311 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:47.695986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4ba99-2025-4b52-963a-fea4874a1c53 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:47.698885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37384e56-aee0-48ca-ad6d-6f5fc2e906a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:47.699798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384e56-aee0-48ca-ad6d-6f5fc2e906a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.700277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384e56-aee0-48ca-ad6d-6f5fc2e906a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.700447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdadae-5863-4a7d-86cb-4ecf898d5a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:47.700933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37384e56-aee0-48ca-ad6d-6f5fc2e906a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.701055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdadae-5863-4a7d-86cb-4ecf898d5a7b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.701320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdadae-5863-4a7d-86cb-4ecf898d5a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.701595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdadae-5863-4a7d-86cb-4ecf898d5a7b admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.702324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdadae-5863-4a7d-86cb-4ecf898d5a7b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:47.702695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37384e56-aee0-48ca-ad6d-6f5fc2e906a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:47.703233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37384e56-aee0-48ca-ad6d-6f5fc2e906a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:47.704181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbdadae-5863-4a7d-86cb-4ecf898d5a7b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:47.705257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37384e56-aee0-48ca-ad6d-6f5fc2e906a9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:47.718356 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 451/903] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:47.720125 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 453/904] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:31:47 2021] POST /identity/v3/services => generated 251 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:31:47.725512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37384e56-aee0-48ca-ad6d-6f5fc2e906a9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:47.736521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37384e56-aee0-48ca-ad6d-6f5fc2e906a9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:47.753344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948c014-6b10-4fb7-9be2-9c97a1b08ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:47.754576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c014-6b10-4fb7-9be2-9c97a1b08ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.755179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c014-6b10-4fb7-9be2-9c97a1b08ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.755682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c014-6b10-4fb7-9be2-9c97a1b08ea7 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.765876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948c014-6b10-4fb7-9be2-9c97a1b08ea7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:47.768485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948c014-6b10-4fb7-9be2-9c97a1b08ea7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:47.784764 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-3948c014-6b10-4fb7-9be2-9c97a1b08ea7 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 27 20:31:47.786814 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 452/905] 10.222.0.21 () {56 vars in 1138 bytes} [Sat Nov 27 20:31:47 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:47.793226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdadae-5863-4a7d-86cb-4ecf898d5a7b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:47.804529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdadae-5863-4a7d-86cb-4ecf898d5a7b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:47.809408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475c100-2f6d-428b-9177-8b48779760ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:47.810092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475c100-2f6d-428b-9177-8b48779760ac admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.810372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475c100-2f6d-428b-9177-8b48779760ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.810641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475c100-2f6d-428b-9177-8b48779760ac admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.811778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475c100-2f6d-428b-9177-8b48779760ac admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:47.812154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475c100-2f6d-428b-9177-8b48779760ac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:47.814314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475c100-2f6d-428b-9177-8b48779760ac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:47.836873 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 454/906] 10.222.0.21 () {56 vars in 1170 bytes} [Sat Nov 27 20:31:47 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:47.843276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948c014-6b10-4fb7-9be2-9c97a1b08ea7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:47.853917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948c014-6b10-4fb7-9be2-9c97a1b08ea7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:47.858878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24854502-fa56-4832-b01e-3bd05fd2938d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:47.859617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854502-fa56-4832-b01e-3bd05fd2938d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.859902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854502-fa56-4832-b01e-3bd05fd2938d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.860177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854502-fa56-4832-b01e-3bd05fd2938d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.870024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24854502-fa56-4832-b01e-3bd05fd2938d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:47.871910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24854502-fa56-4832-b01e-3bd05fd2938d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:47.882827 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 453/907] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:47 2021] GET /identity/v3/auth/tokens => generated 1663 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:31:47.889293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475c100-2f6d-428b-9177-8b48779760ac admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:47.900736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475c100-2f6d-428b-9177-8b48779760ac admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:47.905706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19b23b-3319-40f4-9b6b-a97f35c1846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:47.906558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b23b-3319-40f4-9b6b-a97f35c1846c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.906840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b23b-3319-40f4-9b6b-a97f35c1846c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.907109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19b23b-3319-40f4-9b6b-a97f35c1846c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.919191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19b23b-3319-40f4-9b6b-a97f35c1846c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:47.921087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19b23b-3319-40f4-9b6b-a97f35c1846c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:47.940548 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-bb19b23b-3319-40f4-9b6b-a97f35c1846c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:47.942225 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 455/908] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:47.949386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24854502-fa56-4832-b01e-3bd05fd2938d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:47.958229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24854502-fa56-4832-b01e-3bd05fd2938d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:47.965715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace92c22-573d-4c05-b6ef-bd1eeb5f4d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:47.966369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace92c22-573d-4c05-b6ef-bd1eeb5f4d16 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:47.966650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace92c22-573d-4c05-b6ef-bd1eeb5f4d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:47.966924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace92c22-573d-4c05-b6ef-bd1eeb5f4d16 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:47.967727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace92c22-573d-4c05-b6ef-bd1eeb5f4d16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:47.968032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace92c22-573d-4c05-b6ef-bd1eeb5f4d16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:47.969698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace92c22-573d-4c05-b6ef-bd1eeb5f4d16 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:47.983961 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 454/909] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:47.989592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19b23b-3319-40f4-9b6b-a97f35c1846c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:48.000852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19b23b-3319-40f4-9b6b-a97f35c1846c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:48.005497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517fc86-1b9f-4c3f-8a48-20e86683ada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:48.006892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517fc86-1b9f-4c3f-8a48-20e86683ada9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:48.007170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517fc86-1b9f-4c3f-8a48-20e86683ada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:48.007482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517fc86-1b9f-4c3f-8a48-20e86683ada9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:48.015582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517fc86-1b9f-4c3f-8a48-20e86683ada9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:48.017580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517fc86-1b9f-4c3f-8a48-20e86683ada9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:48.031669 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-7517fc86-1b9f-4c3f-8a48-20e86683ada9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:48.033215 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 456/910] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:48.039564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace92c22-573d-4c05-b6ef-bd1eeb5f4d16 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:48.049664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace92c22-573d-4c05-b6ef-bd1eeb5f4d16 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:48.055066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57106d62-5fd2-4130-875a-b78f8de160d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:48.055751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57106d62-5fd2-4130-875a-b78f8de160d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:48.056080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57106d62-5fd2-4130-875a-b78f8de160d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:48.056352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57106d62-5fd2-4130-875a-b78f8de160d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:48.057199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57106d62-5fd2-4130-875a-b78f8de160d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:48.057506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57106d62-5fd2-4130-875a-b78f8de160d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:48.059533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57106d62-5fd2-4130-875a-b78f8de160d7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:48.075554 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 455/911] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:48.082469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517fc86-1b9f-4c3f-8a48-20e86683ada9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:48.093585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517fc86-1b9f-4c3f-8a48-20e86683ada9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:48.098359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1ea8c-733d-4a61-9c02-59e084a4da50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:48.099062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ea8c-733d-4a61-9c02-59e084a4da50 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:48.099379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ea8c-733d-4a61-9c02-59e084a4da50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:48.099741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ea8c-733d-4a61-9c02-59e084a4da50 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:48.100581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1ea8c-733d-4a61-9c02-59e084a4da50 admin admin] RBAC: Adding query filter params (role.id=00be6a1aa54446848af1e63781d879e5, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=93ed192079af4cad8a303e6c1b4da343) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:48.100948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1ea8c-733d-4a61-9c02-59e084a4da50 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:48.103076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1ea8c-733d-4a61-9c02-59e084a4da50 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:48.109545 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 457/912] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:48 2021] GET /identity/v3/role_assignments?user.id=93ed192079af4cad8a303e6c1b4da343&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=00be6a1aa54446848af1e63781d879e5 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:48.685879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b88fdc-e03c-499e-8067-836e2f8ace79 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:48.686571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b88fdc-e03c-499e-8067-836e2f8ace79 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:48.686571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b88fdc-e03c-499e-8067-836e2f8ace79 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:48.688497 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 456/913] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:48.695475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9761-e982-4085-81e3-482a6be84d94 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:48.695993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9761-e982-4085-81e3-482a6be84d94 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:48.695993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9761-e982-4085-81e3-482a6be84d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:48.713672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4cdb9761-e982-4085-81e3-482a6be84d94 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:48.714853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4cdb9761-e982-4085-81e3-482a6be84d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:48.724615 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 458/914] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:48 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:31:48.749607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b88fdc-e03c-499e-8067-836e2f8ace79 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:48.762234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b88fdc-e03c-499e-8067-836e2f8ace79 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:48.766828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654fc81-9e2d-4f60-9c33-503a4f1d269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:48.767665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654fc81-9e2d-4f60-9c33-503a4f1d269f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:48.767944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654fc81-9e2d-4f60-9c33-503a4f1d269f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:48.768221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654fc81-9e2d-4f60-9c33-503a4f1d269f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:48.768887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654fc81-9e2d-4f60-9c33-503a4f1d269f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:48.770482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654fc81-9e2d-4f60-9c33-503a4f1d269f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:48.782399 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-b654fc81-9e2d-4f60-9c33-503a4f1d269f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 27 20:31:48.787378 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 457/915] 10.222.0.21 () {56 vars in 1147 bytes} [Sat Nov 27 20:31:48 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:48.790633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9761-e982-4085-81e3-482a6be84d94 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:48.799795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9761-e982-4085-81e3-482a6be84d94 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:48.804981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4dc85-ca43-497b-8018-0c3173289f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:48.805635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4dc85-ca43-497b-8018-0c3173289f18 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:48.805917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4dc85-ca43-497b-8018-0c3173289f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:48.806191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4dc85-ca43-497b-8018-0c3173289f18 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:48.806914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4dc85-ca43-497b-8018-0c3173289f18 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:48.807219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4dc85-ca43-497b-8018-0c3173289f18 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:48.809002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4dc85-ca43-497b-8018-0c3173289f18 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:48.819413 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 459/916] 10.222.0.21 () {56 vars in 1143 bytes} [Sat Nov 27 20:31:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:48.821132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654fc81-9e2d-4f60-9c33-503a4f1d269f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:48.833302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654fc81-9e2d-4f60-9c33-503a4f1d269f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:48.839018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee931a-4f5d-4225-8bbb-a52bf7f1452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:48.839793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee931a-4f5d-4225-8bbb-a52bf7f1452b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:48.840079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee931a-4f5d-4225-8bbb-a52bf7f1452b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:48.840409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee931a-4f5d-4225-8bbb-a52bf7f1452b admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:48.841200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee931a-4f5d-4225-8bbb-a52bf7f1452b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:48.841513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee931a-4f5d-4225-8bbb-a52bf7f1452b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:48.843217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee931a-4f5d-4225-8bbb-a52bf7f1452b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:48.855460 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 458/917] 10.222.0.21 () {56 vars in 1143 bytes} [Sat Nov 27 20:31:48 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:49.251525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f951252-1a00-4395-9e48-b762a3e8f211 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:49.251525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f951252-1a00-4395-9e48-b762a3e8f211 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:49.251525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f951252-1a00-4395-9e48-b762a3e8f211 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:49.251525 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 460/918] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:49.260015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb966e-cc99-4fbc-9674-008ee9017909 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:49.260015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb966e-cc99-4fbc-9674-008ee9017909 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:49.260015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb966e-cc99-4fbc-9674-008ee9017909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:49.278224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7bdb966e-cc99-4fbc-9674-008ee9017909 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:49.279767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7bdb966e-cc99-4fbc-9674-008ee9017909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:49.288014 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 459/919] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:49 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:49.312785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f951252-1a00-4395-9e48-b762a3e8f211 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:49.325344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f951252-1a00-4395-9e48-b762a3e8f211 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:49.329903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c7f31-dadf-4644-9987-3d7fa5d74cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:49.330936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c7f31-dadf-4644-9987-3d7fa5d74cfb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:49.331448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c7f31-dadf-4644-9987-3d7fa5d74cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:49.331918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c7f31-dadf-4644-9987-3d7fa5d74cfb admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:49.332773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c7f31-dadf-4644-9987-3d7fa5d74cfb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:49.335092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c7f31-dadf-4644-9987-3d7fa5d74cfb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:49.347084 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-186c7f31-dadf-4644-9987-3d7fa5d74cfb admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 27 20:31:49.349049 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 461/920] 10.222.0.21 () {56 vars in 1153 bytes} [Sat Nov 27 20:31:49 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:49.355918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb966e-cc99-4fbc-9674-008ee9017909 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:49.366157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb966e-cc99-4fbc-9674-008ee9017909 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:49.370910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9b7ac-54f2-4bf6-bd29-ea0186e0b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:49.371954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9b7ac-54f2-4bf6-bd29-ea0186e0b3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:49.372432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9b7ac-54f2-4bf6-bd29-ea0186e0b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:49.372897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9b7ac-54f2-4bf6-bd29-ea0186e0b3a6 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:49.374068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9b7ac-54f2-4bf6-bd29-ea0186e0b3a6 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:49.374564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9b7ac-54f2-4bf6-bd29-ea0186e0b3a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:49.376398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9b7ac-54f2-4bf6-bd29-ea0186e0b3a6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:49.381711 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 460/921] 10.222.0.21 () {56 vars in 1147 bytes} [Sat Nov 27 20:31:49 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:49.387843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c7f31-dadf-4644-9987-3d7fa5d74cfb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:49.398146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c7f31-dadf-4644-9987-3d7fa5d74cfb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:49.402820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fb6a3-37ea-40fd-a0bb-ed88f463197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:49.403734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb6a3-37ea-40fd-a0bb-ed88f463197a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:49.404235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb6a3-37ea-40fd-a0bb-ed88f463197a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:49.404701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb6a3-37ea-40fd-a0bb-ed88f463197a admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:49.405596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fb6a3-37ea-40fd-a0bb-ed88f463197a admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:49.406103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fb6a3-37ea-40fd-a0bb-ed88f463197a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:49.407910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fb6a3-37ea-40fd-a0bb-ed88f463197a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:49.413246 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 462/922] 10.222.0.21 () {56 vars in 1147 bytes} [Sat Nov 27 20:31:49 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:49.419300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9b7ac-54f2-4bf6-bd29-ea0186e0b3a6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:49.430111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9b7ac-54f2-4bf6-bd29-ea0186e0b3a6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:49.435091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8201922-faed-422e-9d88-624e871fd6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:49.436096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8201922-faed-422e-9d88-624e871fd6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:49.436589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8201922-faed-422e-9d88-624e871fd6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:49.437091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8201922-faed-422e-9d88-624e871fd6e2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:49.438079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8201922-faed-422e-9d88-624e871fd6e2 admin admin] RBAC: Adding query filter params (interface=public, service_id=abe4f856d10e46a89422bbb2615fac33, region_id=RegionOne) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:49.438619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8201922-faed-422e-9d88-624e871fd6e2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:49.440529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8201922-faed-422e-9d88-624e871fd6e2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:49.447746 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 461/923] 10.222.0.21 () {56 vars in 1272 bytes} [Sat Nov 27 20:31:49 2021] GET /identity/v3/endpoints?service_id=abe4f856d10e46a89422bbb2615fac33&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:49.452785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fb6a3-37ea-40fd-a0bb-ed88f463197a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:49.463383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fb6a3-37ea-40fd-a0bb-ed88f463197a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:49.468139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a38a42-dd76-4c49-bf5b-353bbc159fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:49.468786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a38a42-dd76-4c49-bf5b-353bbc159fee admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:49.469112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a38a42-dd76-4c49-bf5b-353bbc159fee admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:49.469382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a38a42-dd76-4c49-bf5b-353bbc159fee admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:49.470119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a38a42-dd76-4c49-bf5b-353bbc159fee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:49.471782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a38a42-dd76-4c49-bf5b-353bbc159fee admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:49.477835 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 463/924] 10.222.0.21 () {56 vars in 1108 bytes} [Sat Nov 27 20:31:49 2021] GET /identity/v3/services => generated 1268 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:31:50.261687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af8f8-7139-4c79-9454-2373dd63b332 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.262210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af8f8-7139-4c79-9454-2373dd63b332 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.262210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37af8f8-7139-4c79-9454-2373dd63b332 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.264292 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 462/925] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:50.270092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f27a-85ec-4493-927f-7329cf41bf84 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.270519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f27a-85ec-4493-927f-7329cf41bf84 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.270612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220f27a-85ec-4493-927f-7329cf41bf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.289140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8220f27a-85ec-4493-927f-7329cf41bf84 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:50.290325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8220f27a-85ec-4493-927f-7329cf41bf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:50.298263 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 464/926] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:50 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:50.323224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37af8f8-7139-4c79-9454-2373dd63b332 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:50.336281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37af8f8-7139-4c79-9454-2373dd63b332 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:50.340850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4549-c28e-471e-8e96-2efc47e579ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:50.341631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4549-c28e-471e-8e96-2efc47e579ea admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.341907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4549-c28e-471e-8e96-2efc47e579ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.342182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c4549-c28e-471e-8e96-2efc47e579ea admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.342840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c4549-c28e-471e-8e96-2efc47e579ea admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:50.344575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c4549-c28e-471e-8e96-2efc47e579ea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:50.356196 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-e10c4549-c28e-471e-8e96-2efc47e579ea admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 27 20:31:50.357798 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 463/927] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:50.364594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220f27a-85ec-4493-927f-7329cf41bf84 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:50.374504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220f27a-85ec-4493-927f-7329cf41bf84 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:50.379023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c5e6d-6e25-4da7-bc52-57d0ac695630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:50.379712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c5e6d-6e25-4da7-bc52-57d0ac695630 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.379991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c5e6d-6e25-4da7-bc52-57d0ac695630 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.380425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c5e6d-6e25-4da7-bc52-57d0ac695630 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.381255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c5e6d-6e25-4da7-bc52-57d0ac695630 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:50.381554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c5e6d-6e25-4da7-bc52-57d0ac695630 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:50.383149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c5e6d-6e25-4da7-bc52-57d0ac695630 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:50.390166 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 465/928] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:50.396147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4549-c28e-471e-8e96-2efc47e579ea admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:50.406048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c4549-c28e-471e-8e96-2efc47e579ea admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:50.410546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedac69-5624-4410-96cb-985dcbbf59ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:50.411191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedac69-5624-4410-96cb-985dcbbf59ae admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.411504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedac69-5624-4410-96cb-985dcbbf59ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.411777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedac69-5624-4410-96cb-985dcbbf59ae admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.413027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedac69-5624-4410-96cb-985dcbbf59ae admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:50.413326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedac69-5624-4410-96cb-985dcbbf59ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:50.414916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedac69-5624-4410-96cb-985dcbbf59ae admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:50.420145 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 464/929] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:50.426239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c5e6d-6e25-4da7-bc52-57d0ac695630 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:50.436057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c5e6d-6e25-4da7-bc52-57d0ac695630 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:50.440542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb7dfb-d75d-4c37-b6f6-aa9701f6fab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:50.441189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb7dfb-d75d-4c37-b6f6-aa9701f6fab0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.441473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb7dfb-d75d-4c37-b6f6-aa9701f6fab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.441747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb7dfb-d75d-4c37-b6f6-aa9701f6fab0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.442555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb7dfb-d75d-4c37-b6f6-aa9701f6fab0 admin admin] RBAC: Adding query filter params (interface=public, service_id=4210b662da0349db9f6641a548ce9503, region_id=RegionOne) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:50.442864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb7dfb-d75d-4c37-b6f6-aa9701f6fab0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:50.445062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb7dfb-d75d-4c37-b6f6-aa9701f6fab0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:50.450804 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 466/930] 10.222.0.21 () {56 vars in 1272 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/endpoints?service_id=4210b662da0349db9f6641a548ce9503&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:50.456678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedac69-5624-4410-96cb-985dcbbf59ae admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:50.466755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedac69-5624-4410-96cb-985dcbbf59ae admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:50.471528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229c3dd-1835-4ee7-b4d8-5b2dd073efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:50.472180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229c3dd-1835-4ee7-b4d8-5b2dd073efda admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.472458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229c3dd-1835-4ee7-b4d8-5b2dd073efda admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.472730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229c3dd-1835-4ee7-b4d8-5b2dd073efda admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.473466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229c3dd-1835-4ee7-b4d8-5b2dd073efda admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:50.475674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229c3dd-1835-4ee7-b4d8-5b2dd073efda admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:50.481960 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 465/931] 10.222.0.21 () {56 vars in 1108 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/services => generated 1268 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:31:50.616538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a38942-db1a-4d36-b0b4-996c8489ae38 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.616856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a38942-db1a-4d36-b0b4-996c8489ae38 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.617014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a38942-db1a-4d36-b0b4-996c8489ae38 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.619137 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 467/932] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:50.625197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142b242-3c08-42d4-90fd-2d1d0b92a0dc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.625492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142b242-3c08-42d4-90fd-2d1d0b92a0dc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.625775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142b242-3c08-42d4-90fd-2d1d0b92a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.651233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a142b242-3c08-42d4-90fd-2d1d0b92a0dc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:50.652488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a142b242-3c08-42d4-90fd-2d1d0b92a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:50.660819 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 466/933] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:50 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:50.686060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a38942-db1a-4d36-b0b4-996c8489ae38 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:50.699601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a38942-db1a-4d36-b0b4-996c8489ae38 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:50.704209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e01e9-efc2-47d4-a54d-22e3270ab5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:50.705115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e01e9-efc2-47d4-a54d-22e3270ab5ae admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.705396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e01e9-efc2-47d4-a54d-22e3270ab5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.705666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e01e9-efc2-47d4-a54d-22e3270ab5ae admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.718071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e01e9-efc2-47d4-a54d-22e3270ab5ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:50.726326 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-b75e01e9-efc2-47d4-a54d-22e3270ab5ae admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 27 20:31:50.728054 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 468/934] 10.222.0.21 () {56 vars in 1141 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:50.734499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142b242-3c08-42d4-90fd-2d1d0b92a0dc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:50.743925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142b242-3c08-42d4-90fd-2d1d0b92a0dc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:50.748742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd154e7-6f9a-4241-9005-6662b6230983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:50.749399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd154e7-6f9a-4241-9005-6662b6230983 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.749732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd154e7-6f9a-4241-9005-6662b6230983 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.750005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd154e7-6f9a-4241-9005-6662b6230983 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.750820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd154e7-6f9a-4241-9005-6662b6230983 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:50.751119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd154e7-6f9a-4241-9005-6662b6230983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:50.752946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd154e7-6f9a-4241-9005-6662b6230983 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:50.762786 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 467/935] 10.222.0.21 () {56 vars in 1136 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:50.769009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e01e9-efc2-47d4-a54d-22e3270ab5ae admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:50.780152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e01e9-efc2-47d4-a54d-22e3270ab5ae admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:50.785086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aac509-ec77-4959-95dd-71ebec1bfab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:50.785999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aac509-ec77-4959-95dd-71ebec1bfab9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.786351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aac509-ec77-4959-95dd-71ebec1bfab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.786697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aac509-ec77-4959-95dd-71ebec1bfab9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.797178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aac509-ec77-4959-95dd-71ebec1bfab9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:50.799193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aac509-ec77-4959-95dd-71ebec1bfab9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:50.816916 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-95aac509-ec77-4959-95dd-71ebec1bfab9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:50.818585 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 469/936] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:50.824480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd154e7-6f9a-4241-9005-6662b6230983 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:50.835102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd154e7-6f9a-4241-9005-6662b6230983 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:50.840536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17f20-81a2-4def-8a76-d588b3cf9c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:50.841444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17f20-81a2-4def-8a76-d588b3cf9c11 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.841939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17f20-81a2-4def-8a76-d588b3cf9c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.842415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17f20-81a2-4def-8a76-d588b3cf9c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.843447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc17f20-81a2-4def-8a76-d588b3cf9c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:50.843949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc17f20-81a2-4def-8a76-d588b3cf9c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:50.845806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc17f20-81a2-4def-8a76-d588b3cf9c11 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:50.863754 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 468/937] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:50.870859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aac509-ec77-4959-95dd-71ebec1bfab9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:50.881759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aac509-ec77-4959-95dd-71ebec1bfab9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:50.886668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a6156-54d9-4323-b635-9ddf0c527b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:50.887768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a6156-54d9-4323-b635-9ddf0c527b34 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.888275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a6156-54d9-4323-b635-9ddf0c527b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.888750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a6156-54d9-4323-b635-9ddf0c527b34 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.897684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a6156-54d9-4323-b635-9ddf0c527b34 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:50.900039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a6156-54d9-4323-b635-9ddf0c527b34 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:50.916583 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-c39a6156-54d9-4323-b635-9ddf0c527b34 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 27 20:31:50.918508 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 470/938] 10.222.0.21 () {56 vars in 1138 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:50.925226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17f20-81a2-4def-8a76-d588b3cf9c11 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:50.936100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17f20-81a2-4def-8a76-d588b3cf9c11 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:50.941004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04705-58a3-4d15-95ce-68362abdd1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:50.942003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04705-58a3-4d15-95ce-68362abdd1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:50.942483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04705-58a3-4d15-95ce-68362abdd1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:50.942946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04705-58a3-4d15-95ce-68362abdd1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:50.944099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd04705-58a3-4d15-95ce-68362abdd1b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:50.944629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd04705-58a3-4d15-95ce-68362abdd1b9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:50.946680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd04705-58a3-4d15-95ce-68362abdd1b9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:50.966436 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 469/939] 10.222.0.21 () {56 vars in 1170 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:50.987119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a6156-54d9-4323-b635-9ddf0c527b34 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:51.005774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a6156-54d9-4323-b635-9ddf0c527b34 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:51.014400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3592f3d-f519-4347-8292-f2a8d9449205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:51.015625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3592f3d-f519-4347-8292-f2a8d9449205 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:51.017732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3592f3d-f519-4347-8292-f2a8d9449205 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:51.018224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3592f3d-f519-4347-8292-f2a8d9449205 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:51.044065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3592f3d-f519-4347-8292-f2a8d9449205 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:51.046295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3592f3d-f519-4347-8292-f2a8d9449205 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:51.090357 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-a3592f3d-f519-4347-8292-f2a8d9449205 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:51.092442 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 471/940] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:51.099200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04705-58a3-4d15-95ce-68362abdd1b9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:51.109750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04705-58a3-4d15-95ce-68362abdd1b9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:51.114583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30690f7a-58f8-481f-9598-a5f76c082c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:51.116063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30690f7a-58f8-481f-9598-a5f76c082c1a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:51.116595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30690f7a-58f8-481f-9598-a5f76c082c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:51.117063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30690f7a-58f8-481f-9598-a5f76c082c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:51.117980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30690f7a-58f8-481f-9598-a5f76c082c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:51.118479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30690f7a-58f8-481f-9598-a5f76c082c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:51.120328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30690f7a-58f8-481f-9598-a5f76c082c1a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:51.132723 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 470/941] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:51.138837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3592f3d-f519-4347-8292-f2a8d9449205 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:51.148916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3592f3d-f519-4347-8292-f2a8d9449205 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:51.153749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c97923-b692-466a-92f0-ab0bf831fc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:51.154805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c97923-b692-466a-92f0-ab0bf831fc45 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:51.155357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c97923-b692-466a-92f0-ab0bf831fc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:51.155840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c97923-b692-466a-92f0-ab0bf831fc45 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:51.163781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c97923-b692-466a-92f0-ab0bf831fc45 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:51.166100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c97923-b692-466a-92f0-ab0bf831fc45 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:51.180130 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-28c97923-b692-466a-92f0-ab0bf831fc45 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:51.181780 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 472/942] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:51.187776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30690f7a-58f8-481f-9598-a5f76c082c1a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:51.197419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30690f7a-58f8-481f-9598-a5f76c082c1a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:51.202117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fccf45-82ba-462f-bfe9-9d8db2ab65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:51.202808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fccf45-82ba-462f-bfe9-9d8db2ab65f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:51.203092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fccf45-82ba-462f-bfe9-9d8db2ab65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:51.203392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fccf45-82ba-462f-bfe9-9d8db2ab65f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:51.204274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fccf45-82ba-462f-bfe9-9d8db2ab65f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:51.204584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fccf45-82ba-462f-bfe9-9d8db2ab65f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:51.206584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fccf45-82ba-462f-bfe9-9d8db2ab65f7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:51.218976 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 471/943] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:51.225679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c97923-b692-466a-92f0-ab0bf831fc45 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:51.236102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c97923-b692-466a-92f0-ab0bf831fc45 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:51.241456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aab2e2-cc40-44fb-a53b-5da2a9de86ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:51.242404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aab2e2-cc40-44fb-a53b-5da2a9de86ea admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:51.242684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aab2e2-cc40-44fb-a53b-5da2a9de86ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:51.242957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aab2e2-cc40-44fb-a53b-5da2a9de86ea admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/93ed192079af4cad8a303e6c1b4da343/roles/00be6a1aa54446848af1e63781d879e5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:51.245403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aab2e2-cc40-44fb-a53b-5da2a9de86ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=93ed192079af4cad8a303e6c1b4da343, role_id=00be6a1aa54446848af1e63781d879e5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:51.248470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aab2e2-cc40-44fb-a53b-5da2a9de86ea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:51.265134 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 473/944] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:31:51 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/93ed192079af4cad8a303e6c1b4da343/roles/00be6a1aa54446848af1e63781d879e5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:31:51.400900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197ed5b-a7fb-4621-902d-b94595f91c7e None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:51.401400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197ed5b-a7fb-4621-902d-b94595f91c7e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:51.401400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197ed5b-a7fb-4621-902d-b94595f91c7e None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:51.403586 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 472/945] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:51.410157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78e448-6b85-46c4-a3d7-001430ff6c29 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:51.410669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78e448-6b85-46c4-a3d7-001430ff6c29 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:51.410768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78e448-6b85-46c4-a3d7-001430ff6c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:51.435755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fe78e448-6b85-46c4-a3d7-001430ff6c29 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:51.436980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fe78e448-6b85-46c4-a3d7-001430ff6c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:51.511350 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 474/946] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:51 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:51.539448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197ed5b-a7fb-4621-902d-b94595f91c7e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:51.552084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197ed5b-a7fb-4621-902d-b94595f91c7e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:51.557113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc37a6a-6981-48e3-a046-9509e2031c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:51.557764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc37a6a-6981-48e3-a046-9509e2031c8c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:51.558046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc37a6a-6981-48e3-a046-9509e2031c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:51.558320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc37a6a-6981-48e3-a046-9509e2031c8c admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:51.559085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc37a6a-6981-48e3-a046-9509e2031c8c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:51.560726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc37a6a-6981-48e3-a046-9509e2031c8c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:51.577749 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 473/947] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:31:51 2021] POST /identity/v3/services => generated 241 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:31:52.021704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438413e-adb4-41de-88eb-593e2411900e None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:52.022296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438413e-adb4-41de-88eb-593e2411900e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:52.022783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438413e-adb4-41de-88eb-593e2411900e None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:52.025098 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 475/948] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:52.031187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad148486-10e9-4f62-9abb-987adcda5150 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:52.031761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad148486-10e9-4f62-9abb-987adcda5150 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:52.032236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad148486-10e9-4f62-9abb-987adcda5150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:52.050418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ad148486-10e9-4f62-9abb-987adcda5150 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:52.051882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ad148486-10e9-4f62-9abb-987adcda5150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:52.068636 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 474/949] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:52 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:52.093967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438413e-adb4-41de-88eb-593e2411900e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:52.106954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438413e-adb4-41de-88eb-593e2411900e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:52.111637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63be48-1520-4221-b947-e42b5cdd476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:52.112644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63be48-1520-4221-b947-e42b5cdd476d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:52.113143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63be48-1520-4221-b947-e42b5cdd476d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:52.113621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63be48-1520-4221-b947-e42b5cdd476d admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:52.114471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63be48-1520-4221-b947-e42b5cdd476d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:52.116318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63be48-1520-4221-b947-e42b5cdd476d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:52.127966 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-ec63be48-1520-4221-b947-e42b5cdd476d admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 27 20:31:52.129651 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 476/950] 10.222.0.21 () {56 vars in 1153 bytes} [Sat Nov 27 20:31:52 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:52.136784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad148486-10e9-4f62-9abb-987adcda5150 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:52.145952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad148486-10e9-4f62-9abb-987adcda5150 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:52.150748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127572-1485-4fbb-aecb-359ba4174cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:52.151648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127572-1485-4fbb-aecb-359ba4174cef admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:52.152147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127572-1485-4fbb-aecb-359ba4174cef admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:52.152633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01127572-1485-4fbb-aecb-359ba4174cef admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:52.153556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01127572-1485-4fbb-aecb-359ba4174cef admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:52.154053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01127572-1485-4fbb-aecb-359ba4174cef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:52.155862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01127572-1485-4fbb-aecb-359ba4174cef admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:52.161122 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 475/951] 10.222.0.21 () {56 vars in 1147 bytes} [Sat Nov 27 20:31:52 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:52.167732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63be48-1520-4221-b947-e42b5cdd476d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:52.177411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63be48-1520-4221-b947-e42b5cdd476d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:52.182187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfed6-5613-4243-b876-5d7400ebd700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:52.183042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfed6-5613-4243-b876-5d7400ebd700 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:52.183571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfed6-5613-4243-b876-5d7400ebd700 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:52.184060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfed6-5613-4243-b876-5d7400ebd700 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:52.184968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bfed6-5613-4243-b876-5d7400ebd700 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:52.185463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bfed6-5613-4243-b876-5d7400ebd700 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:52.187301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bfed6-5613-4243-b876-5d7400ebd700 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:52.192617 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 477/952] 10.222.0.21 () {56 vars in 1147 bytes} [Sat Nov 27 20:31:52 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:52.199073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127572-1485-4fbb-aecb-359ba4174cef admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:52.208915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01127572-1485-4fbb-aecb-359ba4174cef admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:52.213582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b7eaa-bbad-41f0-9166-729ecd7ebc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:52.214453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b7eaa-bbad-41f0-9166-729ecd7ebc77 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:52.214950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b7eaa-bbad-41f0-9166-729ecd7ebc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:52.215445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b7eaa-bbad-41f0-9166-729ecd7ebc77 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:52.216390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b7eaa-bbad-41f0-9166-729ecd7ebc77 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:52.218227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b7eaa-bbad-41f0-9166-729ecd7ebc77 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:52.239911 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 476/953] 10.222.0.21 () {60 vars in 1165 bytes} [Sat Nov 27 20:31:52 2021] POST /identity/v3/endpoints => generated 347 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:31:53.050765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b11e7-1345-410e-8e36-6cc785428675 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:53.051586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b11e7-1345-410e-8e36-6cc785428675 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:53.051719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b11e7-1345-410e-8e36-6cc785428675 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:53.056009 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 478/954] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:53 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:53.065512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f6a2f-7ae7-49b0-bcc1-61f3720b3a0c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:53.066225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f6a2f-7ae7-49b0-bcc1-61f3720b3a0c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:53.066489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f6a2f-7ae7-49b0-bcc1-61f3720b3a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:53.095760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b19f6a2f-7ae7-49b0-bcc1-61f3720b3a0c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:53.098070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b19f6a2f-7ae7-49b0-bcc1-61f3720b3a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:53.127787 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 477/955] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:53 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:53.152518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b11e7-1345-410e-8e36-6cc785428675 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:53.165121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b11e7-1345-410e-8e36-6cc785428675 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:53.169547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336db925-7047-4b98-b664-aefbb66cd945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:53.170322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336db925-7047-4b98-b664-aefbb66cd945 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:53.170598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336db925-7047-4b98-b664-aefbb66cd945 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:53.170863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336db925-7047-4b98-b664-aefbb66cd945 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:53.171546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336db925-7047-4b98-b664-aefbb66cd945 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:53.173101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336db925-7047-4b98-b664-aefbb66cd945 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:53.184230 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-336db925-7047-4b98-b664-aefbb66cd945 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 27 20:31:53.185671 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 479/956] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:53 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:53.192040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f6a2f-7ae7-49b0-bcc1-61f3720b3a0c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:53.201129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f6a2f-7ae7-49b0-bcc1-61f3720b3a0c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:53.205687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c986390-951d-405a-8bcf-1e3ed3fafe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:53.206335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986390-951d-405a-8bcf-1e3ed3fafe67 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:53.206612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986390-951d-405a-8bcf-1e3ed3fafe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:53.206882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c986390-951d-405a-8bcf-1e3ed3fafe67 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:53.207636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c986390-951d-405a-8bcf-1e3ed3fafe67 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:53.207938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c986390-951d-405a-8bcf-1e3ed3fafe67 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:53.210071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c986390-951d-405a-8bcf-1e3ed3fafe67 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:53.215123 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 478/957] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:53 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:53.221151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336db925-7047-4b98-b664-aefbb66cd945 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:53.232773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336db925-7047-4b98-b664-aefbb66cd945 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:53.237410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57095a-79c6-4fd6-8767-910a12c5de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:53.238252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57095a-79c6-4fd6-8767-910a12c5de65 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:53.238533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57095a-79c6-4fd6-8767-910a12c5de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:53.238804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57095a-79c6-4fd6-8767-910a12c5de65 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:53.239538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57095a-79c6-4fd6-8767-910a12c5de65 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:53.239889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57095a-79c6-4fd6-8767-910a12c5de65 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:53.241975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57095a-79c6-4fd6-8767-910a12c5de65 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:53.247337 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 480/958] 10.222.0.21 () {56 vars in 1135 bytes} [Sat Nov 27 20:31:53 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:53.253607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c986390-951d-405a-8bcf-1e3ed3fafe67 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:53.263583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c986390-951d-405a-8bcf-1e3ed3fafe67 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:53.268312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72824d75-d25f-4021-b300-372ce79bcdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:53.268939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824d75-d25f-4021-b300-372ce79bcdb4 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:53.269269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824d75-d25f-4021-b300-372ce79bcdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:53.269539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824d75-d25f-4021-b300-372ce79bcdb4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:53.270336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72824d75-d25f-4021-b300-372ce79bcdb4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:53.272499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72824d75-d25f-4021-b300-372ce79bcdb4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:53.292789 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 479/959] 10.222.0.21 () {60 vars in 1165 bytes} [Sat Nov 27 20:31:53 2021] POST /identity/v3/endpoints => generated 346 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:31:53.835087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c8de2-bf25-4ec4-bc91-66cf0b884e11 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:53.835505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c8de2-bf25-4ec4-bc91-66cf0b884e11 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:53.835673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c8de2-bf25-4ec4-bc91-66cf0b884e11 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:53.837690 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 481/960] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:53.843438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3527740-5506-47b6-b74e-78a411333c51 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:53.843730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3527740-5506-47b6-b74e-78a411333c51 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:53.844005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3527740-5506-47b6-b74e-78a411333c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:53.862027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b3527740-5506-47b6-b74e-78a411333c51 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:53.863207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b3527740-5506-47b6-b74e-78a411333c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:53.883352 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 480/961] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:53 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:53.905553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c8de2-bf25-4ec4-bc91-66cf0b884e11 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:53.918275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c8de2-bf25-4ec4-bc91-66cf0b884e11 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:53.922719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9e02f-a540-470d-9ac8-16816ff90317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:53.923535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e02f-a540-470d-9ac8-16816ff90317 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:53.923822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e02f-a540-470d-9ac8-16816ff90317 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:53.924096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e02f-a540-470d-9ac8-16816ff90317 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:53.934359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9e02f-a540-470d-9ac8-16816ff90317 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:31:53.941572 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-dcd9e02f-a540-470d-9ac8-16816ff90317 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 27 20:31:53.947510 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 482/962] 10.222.0.21 () {56 vars in 1141 bytes} [Sat Nov 27 20:31:53 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:53.949686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3527740-5506-47b6-b74e-78a411333c51 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:53.959556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3527740-5506-47b6-b74e-78a411333c51 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:53.964679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed896f-1f6e-4ddd-8c06-06cc1f03b2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:53.965525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed896f-1f6e-4ddd-8c06-06cc1f03b2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:53.965810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed896f-1f6e-4ddd-8c06-06cc1f03b2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:53.966084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed896f-1f6e-4ddd-8c06-06cc1f03b2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:53.966937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed896f-1f6e-4ddd-8c06-06cc1f03b2b6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:53.967242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed896f-1f6e-4ddd-8c06-06cc1f03b2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:53.969055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed896f-1f6e-4ddd-8c06-06cc1f03b2b6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:53.983490 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 481/963] 10.222.0.21 () {56 vars in 1136 bytes} [Sat Nov 27 20:31:53 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:53.985377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9e02f-a540-470d-9ac8-16816ff90317 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:53.999732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9e02f-a540-470d-9ac8-16816ff90317 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.004796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553f8fa-380b-40f0-abfe-e22d61588433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.005749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553f8fa-380b-40f0-abfe-e22d61588433 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.006030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553f8fa-380b-40f0-abfe-e22d61588433 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.006301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553f8fa-380b-40f0-abfe-e22d61588433 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.017311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553f8fa-380b-40f0-abfe-e22d61588433 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.019208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553f8fa-380b-40f0-abfe-e22d61588433 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.036593 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-3553f8fa-380b-40f0-abfe-e22d61588433 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:54.042661 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 483/964] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:54.044964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed896f-1f6e-4ddd-8c06-06cc1f03b2b6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.055012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed896f-1f6e-4ddd-8c06-06cc1f03b2b6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.059719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc3c24-5f9e-4444-ad9b-13f2413a579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.060416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc3c24-5f9e-4444-ad9b-13f2413a579c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.060698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc3c24-5f9e-4444-ad9b-13f2413a579c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.060973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc3c24-5f9e-4444-ad9b-13f2413a579c admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.061758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc3c24-5f9e-4444-ad9b-13f2413a579c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:54.062063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc3c24-5f9e-4444-ad9b-13f2413a579c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.063748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc3c24-5f9e-4444-ad9b-13f2413a579c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.075146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477c23-2927-4fe4-b46e-8ed101b94236 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.075736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477c23-2927-4fe4-b46e-8ed101b94236 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.075736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477c23-2927-4fe4-b46e-8ed101b94236 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.077103 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 482/965] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:54.080368 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 484/966] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:54 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:31:54.083108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc3c24-5f9e-4444-ad9b-13f2413a579c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.086993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aca133-8f41-4d50-9c72-7aef10fcfaa1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.087206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aca133-8f41-4d50-9c72-7aef10fcfaa1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.087507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aca133-8f41-4d50-9c72-7aef10fcfaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.093660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc3c24-5f9e-4444-ad9b-13f2413a579c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.098881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b9e1-7395-4f35-a9bd-05fdbae6339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.100328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b9e1-7395-4f35-a9bd-05fdbae6339e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.100605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b9e1-7395-4f35-a9bd-05fdbae6339e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.100924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3b9e1-7395-4f35-a9bd-05fdbae6339e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.108237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-38aca133-8f41-4d50-9c72-7aef10fcfaa1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:54.109538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-38aca133-8f41-4d50-9c72-7aef10fcfaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:54.112403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3b9e1-7395-4f35-a9bd-05fdbae6339e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.115410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3b9e1-7395-4f35-a9bd-05fdbae6339e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.124332 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 485/967] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:54 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:31:54.139561 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-89e3b9e1-7395-4f35-a9bd-05fdbae6339e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 27 20:31:54.146017 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 483/968] 10.222.0.21 () {56 vars in 1138 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:54.148079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aca133-8f41-4d50-9c72-7aef10fcfaa1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.152096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b9e1-7395-4f35-a9bd-05fdbae6339e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.157874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aca133-8f41-4d50-9c72-7aef10fcfaa1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.162988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4925b96-1801-4e8f-bc98-234364c90f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.163806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4925b96-1801-4e8f-bc98-234364c90f18 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.164023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4925b96-1801-4e8f-bc98-234364c90f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.164299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4925b96-1801-4e8f-bc98-234364c90f18 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.165205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4925b96-1801-4e8f-bc98-234364c90f18 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:54.165513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4925b96-1801-4e8f-bc98-234364c90f18 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.167068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3b9e1-7395-4f35-a9bd-05fdbae6339e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.167422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4925b96-1801-4e8f-bc98-234364c90f18 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.173016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8297d-04b2-43b0-8146-e87b076d3094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.174042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8297d-04b2-43b0-8146-e87b076d3094 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.174746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8297d-04b2-43b0-8146-e87b076d3094 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.175192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8297d-04b2-43b0-8146-e87b076d3094 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.176221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8297d-04b2-43b0-8146-e87b076d3094 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.178794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8297d-04b2-43b0-8146-e87b076d3094 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.190898 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-fef8297d-04b2-43b0-8146-e87b076d3094 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 27 20:31:54.191036 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 486/969] 10.222.0.21 () {56 vars in 1170 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:54.192342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4925b96-1801-4e8f-bc98-234364c90f18 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.192928 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 484/970] 10.222.0.21 () {56 vars in 1147 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:54.200512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8297d-04b2-43b0-8146-e87b076d3094 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.204930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4925b96-1801-4e8f-bc98-234364c90f18 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.210811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee52792-f62b-407e-b3f0-7ff51da1c87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.211682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52792-f62b-407e-b3f0-7ff51da1c87e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.212097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52792-f62b-407e-b3f0-7ff51da1c87e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.212471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52792-f62b-407e-b3f0-7ff51da1c87e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.213630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8297d-04b2-43b0-8146-e87b076d3094 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.218440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca58a6-cc28-46f0-8084-5f37e874e293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.219827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca58a6-cc28-46f0-8084-5f37e874e293 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.220259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca58a6-cc28-46f0-8084-5f37e874e293 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.220869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca58a6-cc28-46f0-8084-5f37e874e293 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.221845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee52792-f62b-407e-b3f0-7ff51da1c87e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.221964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca58a6-cc28-46f0-8084-5f37e874e293 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:54.222411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca58a6-cc28-46f0-8084-5f37e874e293 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.223949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee52792-f62b-407e-b3f0-7ff51da1c87e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.224345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca58a6-cc28-46f0-8084-5f37e874e293 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.235469 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 485/971] 10.222.0.21 () {56 vars in 1143 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:54.236504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca58a6-cc28-46f0-8084-5f37e874e293 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.247298 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 487/972] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/auth/tokens => generated 2138 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:31:54.249147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee52792-f62b-407e-b3f0-7ff51da1c87e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.258449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca58a6-cc28-46f0-8084-5f37e874e293 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.263878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f26c8-5c87-425f-b5ec-98709288b780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.264629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f26c8-5c87-425f-b5ec-98709288b780 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.264924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f26c8-5c87-425f-b5ec-98709288b780 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.265407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f26c8-5c87-425f-b5ec-98709288b780 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.266088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee52792-f62b-407e-b3f0-7ff51da1c87e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.266313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f26c8-5c87-425f-b5ec-98709288b780 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:54.266622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f26c8-5c87-425f-b5ec-98709288b780 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.268248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f26c8-5c87-425f-b5ec-98709288b780 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.274171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da753e0d-d2fa-4fad-bd6d-c3097023b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.274681 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 486/973] 10.222.0.21 () {56 vars in 1143 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:54.276118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da753e0d-d2fa-4fad-bd6d-c3097023b70b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.276407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da753e0d-d2fa-4fad-bd6d-c3097023b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.276676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da753e0d-d2fa-4fad-bd6d-c3097023b70b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.281360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f26c8-5c87-425f-b5ec-98709288b780 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.290394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da753e0d-d2fa-4fad-bd6d-c3097023b70b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.292329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da753e0d-d2fa-4fad-bd6d-c3097023b70b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.292831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f26c8-5c87-425f-b5ec-98709288b780 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.297861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72b7a8-5047-492b-af36-0f90977c9991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.298511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72b7a8-5047-492b-af36-0f90977c9991 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.298795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72b7a8-5047-492b-af36-0f90977c9991 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.299075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72b7a8-5047-492b-af36-0f90977c9991 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.300366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72b7a8-5047-492b-af36-0f90977c9991 admin admin] RBAC: Adding query filter params (interface=public, service_id=5757ab6085fe4f158a7170d1364d27d6, region_id=RegionOne) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:54.300678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72b7a8-5047-492b-af36-0f90977c9991 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.302966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72b7a8-5047-492b-af36-0f90977c9991 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.309861 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-da753e0d-d2fa-4fad-bd6d-c3097023b70b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:31:54.311381 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 488/974] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:54.315629 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 487/975] 10.222.0.21 () {56 vars in 1272 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/endpoints?service_id=5757ab6085fe4f158a7170d1364d27d6&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:54.316928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da753e0d-d2fa-4fad-bd6d-c3097023b70b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.319584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72b7a8-5047-492b-af36-0f90977c9991 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.328563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da753e0d-d2fa-4fad-bd6d-c3097023b70b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.328982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72b7a8-5047-492b-af36-0f90977c9991 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.333655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339de3c9-fdb3-4817-99d0-d8e692e3de4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.333845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377664e-9019-488d-80be-92ac5e1ed420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.334934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377664e-9019-488d-80be-92ac5e1ed420 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.335091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339de3c9-fdb3-4817-99d0-d8e692e3de4b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.335232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377664e-9019-488d-80be-92ac5e1ed420 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.335507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339de3c9-fdb3-4817-99d0-d8e692e3de4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.335656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377664e-9019-488d-80be-92ac5e1ed420 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.336693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339de3c9-fdb3-4817-99d0-d8e692e3de4b admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.336865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377664e-9019-488d-80be-92ac5e1ed420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:54.337058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339de3c9-fdb3-4817-99d0-d8e692e3de4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.337215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377664e-9019-488d-80be-92ac5e1ed420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.338202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377664e-9019-488d-80be-92ac5e1ed420 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.338471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339de3c9-fdb3-4817-99d0-d8e692e3de4b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.344994 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 488/976] 10.222.0.21 () {56 vars in 1108 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:31:54.364217 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 489/977] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:54.370132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339de3c9-fdb3-4817-99d0-d8e692e3de4b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.381493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339de3c9-fdb3-4817-99d0-d8e692e3de4b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.386681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827741a-2dab-4767-8dbc-427afd274477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.388212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827741a-2dab-4767-8dbc-427afd274477 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.388716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827741a-2dab-4767-8dbc-427afd274477 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.389115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827741a-2dab-4767-8dbc-427afd274477 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.398353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827741a-2dab-4767-8dbc-427afd274477 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.400606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827741a-2dab-4767-8dbc-427afd274477 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.415774 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d827741a-2dab-4767-8dbc-427afd274477 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:54.417609 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 489/978] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:54.428585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377664e-9019-488d-80be-92ac5e1ed420 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.439533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377664e-9019-488d-80be-92ac5e1ed420 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.452090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c07256-7d82-43cc-9d1b-bcdd91dbca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.452812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c07256-7d82-43cc-9d1b-bcdd91dbca44 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.453112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c07256-7d82-43cc-9d1b-bcdd91dbca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.453443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c07256-7d82-43cc-9d1b-bcdd91dbca44 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.454406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c07256-7d82-43cc-9d1b-bcdd91dbca44 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:54.454722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c07256-7d82-43cc-9d1b-bcdd91dbca44 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.456726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c07256-7d82-43cc-9d1b-bcdd91dbca44 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.473745 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 490/979] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:54.480618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827741a-2dab-4767-8dbc-427afd274477 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.492923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827741a-2dab-4767-8dbc-427afd274477 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.499500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f8ae3-a69c-4a2e-9582-8d919717b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.500177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8ae3-a69c-4a2e-9582-8d919717b945 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.500514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8ae3-a69c-4a2e-9582-8d919717b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.500797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8ae3-a69c-4a2e-9582-8d919717b945 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.501707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f8ae3-a69c-4a2e-9582-8d919717b945 admin admin] RBAC: Adding query filter params (role.id=00be6a1aa54446848af1e63781d879e5, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=93ed192079af4cad8a303e6c1b4da343) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:54.502025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f8ae3-a69c-4a2e-9582-8d919717b945 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.504410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f8ae3-a69c-4a2e-9582-8d919717b945 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.512149 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 490/980] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/role_assignments?user.id=93ed192079af4cad8a303e6c1b4da343&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=00be6a1aa54446848af1e63781d879e5 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:54.858643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cc83-5e55-4fd2-85c4-bed6f54e4b90 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.859030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cc83-5e55-4fd2-85c4-bed6f54e4b90 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.859198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cc83-5e55-4fd2-85c4-bed6f54e4b90 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.861238 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 491/981] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:54.867815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fae8f4-c533-42d8-b464-db2aa0a78951 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.868105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fae8f4-c533-42d8-b464-db2aa0a78951 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.868384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fae8f4-c533-42d8-b464-db2aa0a78951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.887960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-98fae8f4-c533-42d8-b464-db2aa0a78951 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:54.889144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-98fae8f4-c533-42d8-b464-db2aa0a78951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:54.897779 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 491/982] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:54 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:54.923753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338cc83-5e55-4fd2-85c4-bed6f54e4b90 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.936230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338cc83-5e55-4fd2-85c4-bed6f54e4b90 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.940820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa6d2-eb21-414c-8d70-225120624c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.941683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa6d2-eb21-414c-8d70-225120624c73 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.941957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa6d2-eb21-414c-8d70-225120624c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.942298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fa6d2-eb21-414c-8d70-225120624c73 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.944038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fa6d2-eb21-414c-8d70-225120624c73 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.945801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308fa6d2-eb21-414c-8d70-225120624c73 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.957072 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-308fa6d2-eb21-414c-8d70-225120624c73 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 27 20:31:54.958536 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 492/983] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:54.965226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fae8f4-c533-42d8-b464-db2aa0a78951 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:54.975663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fae8f4-c533-42d8-b464-db2aa0a78951 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:54.980290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaf627-d8db-4452-93c7-08aeec0abd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:54.980941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf627-d8db-4452-93c7-08aeec0abd11 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:54.981219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf627-d8db-4452-93c7-08aeec0abd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:54.981488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf627-d8db-4452-93c7-08aeec0abd11 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:54.982212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaf627-d8db-4452-93c7-08aeec0abd11 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:54.982517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaf627-d8db-4452-93c7-08aeec0abd11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:54.984146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaf627-d8db-4452-93c7-08aeec0abd11 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:54.989397 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 492/984] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:54.996153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa6d2-eb21-414c-8d70-225120624c73 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:55.006811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fa6d2-eb21-414c-8d70-225120624c73 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:55.011819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaecfb7-e4c7-497f-8e0c-8e70ac5638b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:55.012503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaecfb7-e4c7-497f-8e0c-8e70ac5638b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:55.013058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaecfb7-e4c7-497f-8e0c-8e70ac5638b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:55.013544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaecfb7-e4c7-497f-8e0c-8e70ac5638b4 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:55.014653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaecfb7-e4c7-497f-8e0c-8e70ac5638b4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:55.015132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaecfb7-e4c7-497f-8e0c-8e70ac5638b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:55.016944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaecfb7-e4c7-497f-8e0c-8e70ac5638b4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:55.022677 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 493/985] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:31:54 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:55.904975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573710b3-9c7a-4343-b650-c74d93fc6d56 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:55.904975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573710b3-9c7a-4343-b650-c74d93fc6d56 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:55.904975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573710b3-9c7a-4343-b650-c74d93fc6d56 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:55.904975 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 493/986] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:55.914445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a89b5-ad7a-4fd7-825b-1c1def0d102a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:55.914445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a89b5-ad7a-4fd7-825b-1c1def0d102a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:55.914445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a89b5-ad7a-4fd7-825b-1c1def0d102a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:55.931971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3f6a89b5-ad7a-4fd7-825b-1c1def0d102a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:55.933496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3f6a89b5-ad7a-4fd7-825b-1c1def0d102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:55.941723 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 494/987] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:55 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:55.967332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573710b3-9c7a-4343-b650-c74d93fc6d56 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:55.980498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573710b3-9c7a-4343-b650-c74d93fc6d56 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:55.985095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d6fe1-33d6-42ad-bc84-84c689e27fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:55.986056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d6fe1-33d6-42ad-bc84-84c689e27fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:55.986548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d6fe1-33d6-42ad-bc84-84c689e27fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:55.987026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d6fe1-33d6-42ad-bc84-84c689e27fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:55.987967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d6fe1-33d6-42ad-bc84-84c689e27fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:55.990048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d6fe1-33d6-42ad-bc84-84c689e27fc4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:55.991641 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.common [None req-3a8d6fe1-33d6-42ad-bc84-84c689e27fc4 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 27 20:31:56.010751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.sql.core [None req-3a8d6fe1-33d6-42ad-bc84-84c689e27fc4 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 27 20:31:56.010751 ncdv-master-1 devstack@keystone.service[90122]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 27 20:31:56.010751 ncdv-master-1 devstack@keystone.service[90122]: [parameters: {'id': '4fef7386b08943899f1b0f9db004de70', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 27 20:31:56.010751 ncdv-master-1 devstack@keystone.service[90122]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90122) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 27 20:31:56.028567 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-3a8d6fe1-33d6-42ad-bc84-84c689e27fc4 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4fef7386b08943899f1b0f9db004de70.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4fef7386b08943899f1b0f9db004de70. Nov 27 20:31:56.030672 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 494/988] 10.222.0.21 () {60 vars in 1161 bytes} [Sat Nov 27 20:31:55 2021] POST /identity/v3/projects => generated 262 bytes in 64 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:56.037405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a89b5-ad7a-4fd7-825b-1c1def0d102a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:56.046937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a89b5-ad7a-4fd7-825b-1c1def0d102a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:56.051623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3565fab-331d-446d-b2ff-6a19cba557c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:56.052921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3565fab-331d-446d-b2ff-6a19cba557c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:56.053207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3565fab-331d-446d-b2ff-6a19cba557c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:56.053481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3565fab-331d-446d-b2ff-6a19cba557c3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:56.060671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3565fab-331d-446d-b2ff-6a19cba557c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:56.062616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3565fab-331d-446d-b2ff-6a19cba557c3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:56.076140 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-e3565fab-331d-446d-b2ff-6a19cba557c3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:31:56.077639 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 495/989] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:31:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:56.083824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d6fe1-33d6-42ad-bc84-84c689e27fc4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:56.097142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d6fe1-33d6-42ad-bc84-84c689e27fc4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:56.102247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669e79d-1c89-4aaf-9ade-6028e4c55572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:56.103245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669e79d-1c89-4aaf-9ade-6028e4c55572 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:56.103752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669e79d-1c89-4aaf-9ade-6028e4c55572 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:56.104222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669e79d-1c89-4aaf-9ade-6028e4c55572 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:56.105220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669e79d-1c89-4aaf-9ade-6028e4c55572 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:56.105719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669e79d-1c89-4aaf-9ade-6028e4c55572 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:56.108393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669e79d-1c89-4aaf-9ade-6028e4c55572 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:56.130868 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 495/990] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:31:56 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:56.967662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaa629-44f6-406c-ad6a-864b7a9887b8 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:56.968185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaa629-44f6-406c-ad6a-864b7a9887b8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:56.968262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaa629-44f6-406c-ad6a-864b7a9887b8 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:56.970267 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 496/991] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:56.976542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d85b7-5146-48da-8a8d-dc732a7f3c6b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:56.976955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d85b7-5146-48da-8a8d-dc732a7f3c6b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:56.977127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d85b7-5146-48da-8a8d-dc732a7f3c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:56.995884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-713d85b7-5146-48da-8a8d-dc732a7f3c6b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:56.997402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-713d85b7-5146-48da-8a8d-dc732a7f3c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:57.010865 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 496/992] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:56 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:57.032606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaa629-44f6-406c-ad6a-864b7a9887b8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:57.045879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaa629-44f6-406c-ad6a-864b7a9887b8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:57.050575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4521d42-c3b0-4598-a925-68c53c6f94a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:57.051394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4521d42-c3b0-4598-a925-68c53c6f94a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.051679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4521d42-c3b0-4598-a925-68c53c6f94a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.051952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4521d42-c3b0-4598-a925-68c53c6f94a1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.053165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4521d42-c3b0-4598-a925-68c53c6f94a1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:57.055178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4521d42-c3b0-4598-a925-68c53c6f94a1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:57.056844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d596757-61f5-4c53-a225-a3e776fe006a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.057340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d596757-61f5-4c53-a225-a3e776fe006a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.057826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d596757-61f5-4c53-a225-a3e776fe006a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.060372 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 497/993] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:31:57.066348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83238eb4-cf4a-44b2-bf8c-3e7967137a06 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.066882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83238eb4-cf4a-44b2-bf8c-3e7967137a06 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.067403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83238eb4-cf4a-44b2-bf8c-3e7967137a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.068527 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-c4521d42-c3b0-4598-a925-68c53c6f94a1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 27 20:31:57.074777 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 497/994] 10.222.0.21 () {56 vars in 1147 bytes} [Sat Nov 27 20:31:57 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:57.077164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4521d42-c3b0-4598-a925-68c53c6f94a1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:57.087972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4521d42-c3b0-4598-a925-68c53c6f94a1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:57.089126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-83238eb4-cf4a-44b2-bf8c-3e7967137a06 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:57.090821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-83238eb4-cf4a-44b2-bf8c-3e7967137a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:57.092868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ebd5d-9c05-4f86-a766-a7cfe50a34e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:57.093568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ebd5d-9c05-4f86-a766-a7cfe50a34e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.093927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ebd5d-9c05-4f86-a766-a7cfe50a34e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.094209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ebd5d-9c05-4f86-a766-a7cfe50a34e1 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.094945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ebd5d-9c05-4f86-a766-a7cfe50a34e1 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:57.095283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ebd5d-9c05-4f86-a766-a7cfe50a34e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:57.096987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ebd5d-9c05-4f86-a766-a7cfe50a34e1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:57.101995 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 498/995] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:57 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:31:57.107465 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 498/996] 10.222.0.21 () {56 vars in 1143 bytes} [Sat Nov 27 20:31:57 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:57.111450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83238eb4-cf4a-44b2-bf8c-3e7967137a06 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:57.121442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83238eb4-cf4a-44b2-bf8c-3e7967137a06 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:57.126526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c981f30-cae5-4f8f-bf9d-272fe0307fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:57.127538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c981f30-cae5-4f8f-bf9d-272fe0307fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.128020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c981f30-cae5-4f8f-bf9d-272fe0307fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.128490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c981f30-cae5-4f8f-bf9d-272fe0307fa2 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.128679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ebd5d-9c05-4f86-a766-a7cfe50a34e1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:57.130170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c981f30-cae5-4f8f-bf9d-272fe0307fa2 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:57.131496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c981f30-cae5-4f8f-bf9d-272fe0307fa2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:57.133300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c981f30-cae5-4f8f-bf9d-272fe0307fa2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:57.139007 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 499/997] 10.222.0.21 () {56 vars in 1143 bytes} [Sat Nov 27 20:31:57 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:57.143945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ebd5d-9c05-4f86-a766-a7cfe50a34e1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:57.145353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c981f30-cae5-4f8f-bf9d-272fe0307fa2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:57.154614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd7ddf-4f4d-4e0d-9560-e507c5a37c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:57.155518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c981f30-cae5-4f8f-bf9d-272fe0307fa2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:57.156944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd7ddf-4f4d-4e0d-9560-e507c5a37c5e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.157236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd7ddf-4f4d-4e0d-9560-e507c5a37c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.157511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd7ddf-4f4d-4e0d-9560-e507c5a37c5e admin admin] PATH_INFO: `/v3/services/image` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.158185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd7ddf-4f4d-4e0d-9560-e507c5a37c5e admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:57.160356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd7ddf-4f4d-4e0d-9560-e507c5a37c5e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:57.161805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148f457-50fc-4f7d-a8c0-c711141b1787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:57.162675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148f457-50fc-4f7d-a8c0-c711141b1787 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.162962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148f457-50fc-4f7d-a8c0-c711141b1787 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.163240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148f457-50fc-4f7d-a8c0-c711141b1787 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.164032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148f457-50fc-4f7d-a8c0-c711141b1787 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:57.165617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148f457-50fc-4f7d-a8c0-c711141b1787 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:57.173133 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-bbcd7ddf-4f4d-4e0d-9560-e507c5a37c5e admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 27 20:31:57.175267 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 499/998] 10.222.0.21 () {56 vars in 1126 bytes} [Sat Nov 27 20:31:57 2021] GET /identity/v3/services/image => generated 86 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:57.182435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd7ddf-4f4d-4e0d-9560-e507c5a37c5e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:57.194717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd7ddf-4f4d-4e0d-9560-e507c5a37c5e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:57.195402 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 500/999] 10.222.0.21 () {60 vars in 1165 bytes} [Sat Nov 27 20:31:57 2021] POST /identity/v3/endpoints => generated 349 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:31:57.211698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d7df0-cb75-4574-8852-49bd5a9abe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:57.212430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7df0-cb75-4574-8852-49bd5a9abe31 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.212714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7df0-cb75-4574-8852-49bd5a9abe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.212988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d7df0-cb75-4574-8852-49bd5a9abe31 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.213779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d7df0-cb75-4574-8852-49bd5a9abe31 admin admin] RBAC: Adding query filter params (name=image) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:57.214086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d7df0-cb75-4574-8852-49bd5a9abe31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:57.215842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d7df0-cb75-4574-8852-49bd5a9abe31 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:57.222195 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 500/1000] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:57 2021] GET /identity/v3/services?name=image => generated 122 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:57.228805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148f457-50fc-4f7d-a8c0-c711141b1787 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:57.239529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148f457-50fc-4f7d-a8c0-c711141b1787 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:57.244268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9898c2-ea43-4bf1-a664-60df4e3ded61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:57.244943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9898c2-ea43-4bf1-a664-60df4e3ded61 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.245226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9898c2-ea43-4bf1-a664-60df4e3ded61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.245502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9898c2-ea43-4bf1-a664-60df4e3ded61 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.246285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9898c2-ea43-4bf1-a664-60df4e3ded61 admin admin] RBAC: Adding query filter params (type=image) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:57.246598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9898c2-ea43-4bf1-a664-60df4e3ded61 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:57.248529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9898c2-ea43-4bf1-a664-60df4e3ded61 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:57.258686 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 501/1001] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:31:57 2021] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:57.502438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692b86e-4a23-4ff0-8199-50adeb33e625 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.502734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692b86e-4a23-4ff0-8199-50adeb33e625 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.502957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692b86e-4a23-4ff0-8199-50adeb33e625 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.504764 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 501/1002] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:57.510851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c9db-7568-4a09-958f-3c4ae1185b73 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.511142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c9db-7568-4a09-958f-3c4ae1185b73 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.511526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c9db-7568-4a09-958f-3c4ae1185b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.530368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e893c9db-7568-4a09-958f-3c4ae1185b73 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:57.531585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e893c9db-7568-4a09-958f-3c4ae1185b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:57.540264 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 502/1003] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:57 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:57.565461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692b86e-4a23-4ff0-8199-50adeb33e625 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:57.579283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692b86e-4a23-4ff0-8199-50adeb33e625 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:57.582959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48e5d5-5195-4d64-b30c-c2877c5dec2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:57.584227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48e5d5-5195-4d64-b30c-c2877c5dec2f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:57.584505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48e5d5-5195-4d64-b30c-c2877c5dec2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:57.584776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48e5d5-5195-4d64-b30c-c2877c5dec2f admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:57.585581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48e5d5-5195-4d64-b30c-c2877c5dec2f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:57.587222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48e5d5-5195-4d64-b30c-c2877c5dec2f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:57.602778 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 502/1004] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:31:57 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:31:58.723012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2de2e-b08b-4589-a4ee-2d12fefb72ad None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:58.723012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2de2e-b08b-4589-a4ee-2d12fefb72ad None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:58.723012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2de2e-b08b-4589-a4ee-2d12fefb72ad None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:58.724962 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 503/1005] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:58.731051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4dff6-5360-48a6-bb2e-48153ca845cf None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:58.731981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4dff6-5360-48a6-bb2e-48153ca845cf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:58.732465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4dff6-5360-48a6-bb2e-48153ca845cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:58.750468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-01d4dff6-5360-48a6-bb2e-48153ca845cf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:58.752125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-01d4dff6-5360-48a6-bb2e-48153ca845cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:58.769171 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 503/1006] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:58 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:58.796438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2de2e-b08b-4589-a4ee-2d12fefb72ad None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:58.809185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2de2e-b08b-4589-a4ee-2d12fefb72ad None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:58.813969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de938c99-621b-4ea7-a319-82f5c0e25abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:58.814862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938c99-621b-4ea7-a319-82f5c0e25abf admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:58.815394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938c99-621b-4ea7-a319-82f5c0e25abf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:58.815876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de938c99-621b-4ea7-a319-82f5c0e25abf admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:58.816794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de938c99-621b-4ea7-a319-82f5c0e25abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:58.819399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de938c99-621b-4ea7-a319-82f5c0e25abf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:58.834381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.sql.core [None req-de938c99-621b-4ea7-a319-82f5c0e25abf admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 27 20:31:58.834381 ncdv-master-1 devstack@keystone.service[90122]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 27 20:31:58.834381 ncdv-master-1 devstack@keystone.service[90122]: [parameters: {'user_id': '80143a92769c4d21a1f3bb0a5de3b583', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 27 20:31:58.834381 ncdv-master-1 devstack@keystone.service[90122]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90122) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 27 20:31:58.840999 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-de938c99-621b-4ea7-a319-82f5c0e25abf admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 27 20:31:58.842966 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 504/1007] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:31:58 2021] POST /identity/v3/users => generated 160 bytes in 47 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:58.849851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4dff6-5360-48a6-bb2e-48153ca845cf None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:58.860316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4dff6-5360-48a6-bb2e-48153ca845cf None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:58.865658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a41b-1a04-4623-a690-24d0a72e3bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:58.866807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a41b-1a04-4623-a690-24d0a72e3bba admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:58.867357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a41b-1a04-4623-a690-24d0a72e3bba admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:58.867843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a41b-1a04-4623-a690-24d0a72e3bba admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:58.876540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424a41b-1a04-4623-a690-24d0a72e3bba admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:58.878777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424a41b-1a04-4623-a690-24d0a72e3bba admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:58.894294 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-5424a41b-1a04-4623-a690-24d0a72e3bba admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 27 20:31:58.896915 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 504/1008] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:31:58 2021] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:31:58.903693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de938c99-621b-4ea7-a319-82f5c0e25abf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:58.914475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de938c99-621b-4ea7-a319-82f5c0e25abf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:58.919362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1cb1f-9708-4639-b292-9764f6d1bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:58.920245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1cb1f-9708-4639-b292-9764f6d1bcaf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:58.920786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1cb1f-9708-4639-b292-9764f6d1bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:58.921289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1cb1f-9708-4639-b292-9764f6d1bcaf admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:58.922290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1cb1f-9708-4639-b292-9764f6d1bcaf admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:58.922824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1cb1f-9708-4639-b292-9764f6d1bcaf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:58.925222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1cb1f-9708-4639-b292-9764f6d1bcaf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:58.967596 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 505/1009] 10.222.0.21 () {56 vars in 1122 bytes} [Sat Nov 27 20:31:58 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:59.750511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222547a1-b730-4056-8e1a-1c178669ad05 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:59.751017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222547a1-b730-4056-8e1a-1c178669ad05 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:59.751116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222547a1-b730-4056-8e1a-1c178669ad05 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:59.752878 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 505/1010] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:59.753393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b0b1-733b-45f8-a260-a01cc07e3f11 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:59.753820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b0b1-733b-45f8-a260-a01cc07e3f11 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:59.754005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b0b1-733b-45f8-a260-a01cc07e3f11 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:59.756263 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 506/1011] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:31:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:31:59.759171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c44cb-6ff0-4b28-a566-dc9be6da8440 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:59.759488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c44cb-6ff0-4b28-a566-dc9be6da8440 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:59.759766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c44cb-6ff0-4b28-a566-dc9be6da8440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:59.761718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9a72-7b71-4eef-ab76-69d9e1cb15a9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:59.762104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9a72-7b71-4eef-ab76-69d9e1cb15a9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:59.762380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa9a72-7b71-4eef-ab76-69d9e1cb15a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:59.778205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-032c44cb-6ff0-4b28-a566-dc9be6da8440 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:59.779326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-032c44cb-6ff0-4b28-a566-dc9be6da8440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:59.782437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-53fa9a72-7b71-4eef-ab76-69d9e1cb15a9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:31:59.783940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-53fa9a72-7b71-4eef-ab76-69d9e1cb15a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:31:59.787169 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 506/1012] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:59 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:31:59.791782 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 507/1013] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:31:59 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:31:59.812817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c44cb-6ff0-4b28-a566-dc9be6da8440 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:59.817248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa9a72-7b71-4eef-ab76-69d9e1cb15a9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:59.822505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c44cb-6ff0-4b28-a566-dc9be6da8440 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:59.826583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa9a72-7b71-4eef-ab76-69d9e1cb15a9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:59.827028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1c7c4-f8c6-4df6-a4dc-107aee3c8bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:59.827848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c7c4-f8c6-4df6-a4dc-107aee3c8bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:59.828130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c7c4-f8c6-4df6-a4dc-107aee3c8bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:59.828410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c7c4-f8c6-4df6-a4dc-107aee3c8bf9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:59.829057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1c7c4-f8c6-4df6-a4dc-107aee3c8bf9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:59.830624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1c7c4-f8c6-4df6-a4dc-107aee3c8bf9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:59.831162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb1b78-cd5e-403f-a9d1-6a944e6bb614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:59.831810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1b78-cd5e-403f-a9d1-6a944e6bb614 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:59.832152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1b78-cd5e-403f-a9d1-6a944e6bb614 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:59.832427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb1b78-cd5e-403f-a9d1-6a944e6bb614 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:59.833165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb1b78-cd5e-403f-a9d1-6a944e6bb614 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:59.834716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb1b78-cd5e-403f-a9d1-6a944e6bb614 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:59.842425 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-43e1c7c4-f8c6-4df6-a4dc-107aee3c8bf9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 27 20:31:59.849124 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 507/1014] 10.222.0.21 () {56 vars in 1147 bytes} [Sat Nov 27 20:31:59 2021] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:31:59.849273 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 508/1015] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:31:59 2021] POST /identity/v3/services => generated 242 bytes in 31 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:31:59.850746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1c7c4-f8c6-4df6-a4dc-107aee3c8bf9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:59.861174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1c7c4-f8c6-4df6-a4dc-107aee3c8bf9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:59.877574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36fe5b-7a9f-48e3-9eda-658ce90caedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:59.878270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36fe5b-7a9f-48e3-9eda-658ce90caedc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:59.878525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36fe5b-7a9f-48e3-9eda-658ce90caedc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:59.878821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36fe5b-7a9f-48e3-9eda-658ce90caedc admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:59.879855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36fe5b-7a9f-48e3-9eda-658ce90caedc admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:59.880192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36fe5b-7a9f-48e3-9eda-658ce90caedc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:59.881866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36fe5b-7a9f-48e3-9eda-658ce90caedc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:59.887709 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 508/1016] 10.222.0.21 () {56 vars in 1143 bytes} [Sat Nov 27 20:31:59 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:59.894185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb1b78-cd5e-403f-a9d1-6a944e6bb614 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:59.905206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb1b78-cd5e-403f-a9d1-6a944e6bb614 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:59.909917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6c232-776f-4c7e-a1ad-c69b1b3e8b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:59.910608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6c232-776f-4c7e-a1ad-c69b1b3e8b77 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:59.910890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6c232-776f-4c7e-a1ad-c69b1b3e8b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:59.911163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6c232-776f-4c7e-a1ad-c69b1b3e8b77 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:59.912591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6c232-776f-4c7e-a1ad-c69b1b3e8b77 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:59.912899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6c232-776f-4c7e-a1ad-c69b1b3e8b77 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:59.914544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6c232-776f-4c7e-a1ad-c69b1b3e8b77 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:59.920424 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 509/1017] 10.222.0.21 () {56 vars in 1143 bytes} [Sat Nov 27 20:31:59 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:31:59.927102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36fe5b-7a9f-48e3-9eda-658ce90caedc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:59.938089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36fe5b-7a9f-48e3-9eda-658ce90caedc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:59.943080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475757e-b540-4c03-be2b-28d00f9d4f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:59.944029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475757e-b540-4c03-be2b-28d00f9d4f17 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:59.944470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475757e-b540-4c03-be2b-28d00f9d4f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:59.944902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475757e-b540-4c03-be2b-28d00f9d4f17 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:59.945861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475757e-b540-4c03-be2b-28d00f9d4f17 admin admin] RBAC: Adding query filter params (interface=admin, service_id=5757ab6085fe4f158a7170d1364d27d6, region_id=RegionOne) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:31:59.946321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475757e-b540-4c03-be2b-28d00f9d4f17 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:59.948126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475757e-b540-4c03-be2b-28d00f9d4f17 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:59.954032 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 509/1018] 10.222.0.21 () {56 vars in 1270 bytes} [Sat Nov 27 20:31:59 2021] GET /identity/v3/endpoints?service_id=5757ab6085fe4f158a7170d1364d27d6&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:31:59.961243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6c232-776f-4c7e-a1ad-c69b1b3e8b77 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:31:59.971473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6c232-776f-4c7e-a1ad-c69b1b3e8b77 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:31:59.976905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207170f-a384-40eb-945d-01d713844dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:31:59.977662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207170f-a384-40eb-945d-01d713844dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:31:59.978018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207170f-a384-40eb-945d-01d713844dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:31:59.978365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207170f-a384-40eb-945d-01d713844dd8 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:31:59.979150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207170f-a384-40eb-945d-01d713844dd8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:31:59.980920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207170f-a384-40eb-945d-01d713844dd8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:31:59.988467 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 510/1019] 10.222.0.21 () {56 vars in 1108 bytes} [Sat Nov 27 20:31:59 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:32:00.119422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d820c-2645-4bc9-ba96-800ae017afca None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:00.119790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d820c-2645-4bc9-ba96-800ae017afca None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:00.119985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d820c-2645-4bc9-ba96-800ae017afca None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:00.122142 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 510/1020] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:00.128781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70795a-e590-413c-b296-3a63d0648614 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:00.129111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70795a-e590-413c-b296-3a63d0648614 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:00.129345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70795a-e590-413c-b296-3a63d0648614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:00.148420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4b70795a-e590-413c-b296-3a63d0648614 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:00.149634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4b70795a-e590-413c-b296-3a63d0648614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:00.157709 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 511/1021] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:00 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:00.183351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d820c-2645-4bc9-ba96-800ae017afca None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:00.195756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d820c-2645-4bc9-ba96-800ae017afca None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:00.200291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf62a61-d801-4c48-8166-0fe7e2ca7567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:00.201069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62a61-d801-4c48-8166-0fe7e2ca7567 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:00.201354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62a61-d801-4c48-8166-0fe7e2ca7567 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:00.201618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62a61-d801-4c48-8166-0fe7e2ca7567 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:00.202275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf62a61-d801-4c48-8166-0fe7e2ca7567 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:00.203913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf62a61-d801-4c48-8166-0fe7e2ca7567 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:00.215458 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-ebf62a61-d801-4c48-8166-0fe7e2ca7567 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 27 20:32:00.216654 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 511/1022] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:32:00 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:32:00.223164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70795a-e590-413c-b296-3a63d0648614 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:00.232992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70795a-e590-413c-b296-3a63d0648614 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:00.237955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa6143-123f-42d0-8b9c-29fb6d3d306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:00.238613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa6143-123f-42d0-8b9c-29fb6d3d306d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:00.238891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa6143-123f-42d0-8b9c-29fb6d3d306d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:00.239158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa6143-123f-42d0-8b9c-29fb6d3d306d admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:00.240526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa6143-123f-42d0-8b9c-29fb6d3d306d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:00.240829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa6143-123f-42d0-8b9c-29fb6d3d306d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:00.243585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa6143-123f-42d0-8b9c-29fb6d3d306d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:00.249265 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 512/1023] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:32:00 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:00.255597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf62a61-d801-4c48-8166-0fe7e2ca7567 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:00.265632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf62a61-d801-4c48-8166-0fe7e2ca7567 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:00.270451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fde75a-2eb7-4384-b89f-1044d7595ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:00.271353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fde75a-2eb7-4384-b89f-1044d7595ffb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:00.271826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fde75a-2eb7-4384-b89f-1044d7595ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:00.272274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fde75a-2eb7-4384-b89f-1044d7595ffb admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:00.273170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fde75a-2eb7-4384-b89f-1044d7595ffb admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:00.273648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fde75a-2eb7-4384-b89f-1044d7595ffb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:00.275403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fde75a-2eb7-4384-b89f-1044d7595ffb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:00.280804 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 512/1024] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:32:00 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:00.287524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa6143-123f-42d0-8b9c-29fb6d3d306d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:00.297004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa6143-123f-42d0-8b9c-29fb6d3d306d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:00.301398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1667f2-22d9-42c6-8282-737a3e4111fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:00.302039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1667f2-22d9-42c6-8282-737a3e4111fd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:00.302921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1667f2-22d9-42c6-8282-737a3e4111fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:00.303192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1667f2-22d9-42c6-8282-737a3e4111fd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:00.304009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1667f2-22d9-42c6-8282-737a3e4111fd admin admin] RBAC: Adding query filter params (interface=public, service_id=ad61b98bf3974303a33c1765529b37c0, region_id=RegionOne) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:00.304321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1667f2-22d9-42c6-8282-737a3e4111fd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:00.306013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1667f2-22d9-42c6-8282-737a3e4111fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:00.311590 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 513/1025] 10.222.0.21 () {56 vars in 1272 bytes} [Sat Nov 27 20:32:00 2021] GET /identity/v3/endpoints?service_id=ad61b98bf3974303a33c1765529b37c0&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:00.317910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fde75a-2eb7-4384-b89f-1044d7595ffb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:00.327604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fde75a-2eb7-4384-b89f-1044d7595ffb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:00.332058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa2695-f8f4-4fbe-adf5-92a977399e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:00.332732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2695-f8f4-4fbe-adf5-92a977399e68 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:00.333017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2695-f8f4-4fbe-adf5-92a977399e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:00.333323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2695-f8f4-4fbe-adf5-92a977399e68 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:00.334013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa2695-f8f4-4fbe-adf5-92a977399e68 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:00.335632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa2695-f8f4-4fbe-adf5-92a977399e68 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:00.342222 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 513/1026] 10.222.0.21 () {56 vars in 1108 bytes} [Sat Nov 27 20:32:00 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:32:02.422391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab773d2b-b1c6-45cc-99f1-306ea76b20cd None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.422924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab773d2b-b1c6-45cc-99f1-306ea76b20cd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.422924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab773d2b-b1c6-45cc-99f1-306ea76b20cd None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.426606 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 514/1027] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:02.432233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66a62c-ec98-4f79-9ba1-d9fdb48d8947 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.432742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66a62c-ec98-4f79-9ba1-d9fdb48d8947 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.433188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66a62c-ec98-4f79-9ba1-d9fdb48d8947 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.434614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ba082-a9bd-44b5-a6cb-b3c2d6524286 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.434906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ba082-a9bd-44b5-a6cb-b3c2d6524286 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.435175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ba082-a9bd-44b5-a6cb-b3c2d6524286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.435840 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 514/1028] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:02.444259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e76dc-6bb3-4e05-a6c2-8f3fb9a8bd5e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.444259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e76dc-6bb3-4e05-a6c2-8f3fb9a8bd5e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.444259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e76dc-6bb3-4e05-a6c2-8f3fb9a8bd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.457384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-983ba082-a9bd-44b5-a6cb-b3c2d6524286 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:02.459216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-983ba082-a9bd-44b5-a6cb-b3c2d6524286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:02.460986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6d0e76dc-6bb3-4e05-a6c2-8f3fb9a8bd5e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:02.462179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6d0e76dc-6bb3-4e05-a6c2-8f3fb9a8bd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:02.467021 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 515/1029] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:02 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:32:02.469730 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 515/1030] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:02 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:32:02.491711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ba082-a9bd-44b5-a6cb-b3c2d6524286 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.494087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e76dc-6bb3-4e05-a6c2-8f3fb9a8bd5e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.501065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ba082-a9bd-44b5-a6cb-b3c2d6524286 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.503201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e76dc-6bb3-4e05-a6c2-8f3fb9a8bd5e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.506016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35114eb-e951-4bc6-bc28-7d9ab062416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.506782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35114eb-e951-4bc6-bc28-7d9ab062416a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.507062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35114eb-e951-4bc6-bc28-7d9ab062416a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.507383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35114eb-e951-4bc6-bc28-7d9ab062416a admin admin] PATH_INFO: `/v3/services/image` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.508048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35114eb-e951-4bc6-bc28-7d9ab062416a admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.508447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e7080-54d3-419b-89b4-3df62f7173be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.509232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7080-54d3-419b-89b4-3df62f7173be admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.509511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7080-54d3-419b-89b4-3df62f7173be admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.509666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35114eb-e951-4bc6-bc28-7d9ab062416a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.509814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e7080-54d3-419b-89b4-3df62f7173be admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.510425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e7080-54d3-419b-89b4-3df62f7173be admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.512264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e7080-54d3-419b-89b4-3df62f7173be admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.520366 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d35114eb-e951-4bc6-bc28-7d9ab062416a admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 27 20:32:02.522294 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 516/1031] 10.222.0.21 () {56 vars in 1126 bytes} [Sat Nov 27 20:32:02 2021] GET /identity/v3/services/image => generated 86 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:02.523598 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-036e7080-54d3-419b-89b4-3df62f7173be admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 27 20:32:02.524856 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 516/1032] 10.222.0.21 () {56 vars in 1147 bytes} [Sat Nov 27 20:32:02 2021] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:32:02.528579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35114eb-e951-4bc6-bc28-7d9ab062416a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.531036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e7080-54d3-419b-89b4-3df62f7173be admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.538097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35114eb-e951-4bc6-bc28-7d9ab062416a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.540457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e7080-54d3-419b-89b4-3df62f7173be admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.542668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44386abe-e2e0-4dce-a3e9-29da0d6079a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.543354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44386abe-e2e0-4dce-a3e9-29da0d6079a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.543643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44386abe-e2e0-4dce-a3e9-29da0d6079a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.543913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44386abe-e2e0-4dce-a3e9-29da0d6079a2 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.544627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44386abe-e2e0-4dce-a3e9-29da0d6079a2 admin admin] RBAC: Adding query filter params (name=image) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:02.544928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44386abe-e2e0-4dce-a3e9-29da0d6079a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.545371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb13d5-2554-469d-a731-7cf8486923ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.546000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb13d5-2554-469d-a731-7cf8486923ea admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.546277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb13d5-2554-469d-a731-7cf8486923ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.546512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44386abe-e2e0-4dce-a3e9-29da0d6079a2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.546622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb13d5-2554-469d-a731-7cf8486923ea admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.547238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb13d5-2554-469d-a731-7cf8486923ea admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:02.547583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb13d5-2554-469d-a731-7cf8486923ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.549097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb13d5-2554-469d-a731-7cf8486923ea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.559120 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 517/1033] 10.222.0.21 () {56 vars in 1143 bytes} [Sat Nov 27 20:32:02 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:02.559417 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 517/1034] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:02 2021] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:02.559518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb13d5-2554-469d-a731-7cf8486923ea admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.559910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44386abe-e2e0-4dce-a3e9-29da0d6079a2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.569139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb13d5-2554-469d-a731-7cf8486923ea admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.569588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44386abe-e2e0-4dce-a3e9-29da0d6079a2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.573986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cb604-5b29-4baf-b745-fcdbd7b63f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.574109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9a8a-9ca7-4e41-8e7f-79d23e2edca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.574615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cb604-5b29-4baf-b745-fcdbd7b63f93 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.574729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9a8a-9ca7-4e41-8e7f-79d23e2edca2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.574902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cb604-5b29-4baf-b745-fcdbd7b63f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.575015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9a8a-9ca7-4e41-8e7f-79d23e2edca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.575181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cb604-5b29-4baf-b745-fcdbd7b63f93 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.575389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f9a8a-9ca7-4e41-8e7f-79d23e2edca2 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.575902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cb604-5b29-4baf-b745-fcdbd7b63f93 admin admin] RBAC: Adding query filter params (type=image) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:02.576007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f9a8a-9ca7-4e41-8e7f-79d23e2edca2 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:02.576203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cb604-5b29-4baf-b745-fcdbd7b63f93 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.576310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f9a8a-9ca7-4e41-8e7f-79d23e2edca2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.577753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cb604-5b29-4baf-b745-fcdbd7b63f93 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.577850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f9a8a-9ca7-4e41-8e7f-79d23e2edca2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.588362 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 518/1035] 10.222.0.21 () {56 vars in 1143 bytes} [Sat Nov 27 20:32:02 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:02.588524 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 518/1036] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:02 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:02.589198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9a8a-9ca7-4e41-8e7f-79d23e2edca2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.589990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cb604-5b29-4baf-b745-fcdbd7b63f93 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.598469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f9a8a-9ca7-4e41-8e7f-79d23e2edca2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.598938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cb604-5b29-4baf-b745-fcdbd7b63f93 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.603073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ba5eb-8bee-4d4d-9b22-e817b711dca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.603638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f23895-b12a-4d5e-ab89-403a708d7257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.603826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ba5eb-8bee-4d4d-9b22-e817b711dca1 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.604019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ba5eb-8bee-4d4d-9b22-e817b711dca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.604231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f23895-b12a-4d5e-ab89-403a708d7257 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.604408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ba5eb-8bee-4d4d-9b22-e817b711dca1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.604553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f23895-b12a-4d5e-ab89-403a708d7257 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.604776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f23895-b12a-4d5e-ab89-403a708d7257 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.605007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ba5eb-8bee-4d4d-9b22-e817b711dca1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.605557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f23895-b12a-4d5e-ab89-403a708d7257 admin admin] RBAC: Adding query filter params (interface=public, service_id=1c70e8f25a13464ea328896edbc83d27, region_id=RegionOne) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:02.605870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f23895-b12a-4d5e-ab89-403a708d7257 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.606576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ba5eb-8bee-4d4d-9b22-e817b711dca1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.607486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f23895-b12a-4d5e-ab89-403a708d7257 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.613320 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 519/1037] 10.222.0.21 () {56 vars in 1272 bytes} [Sat Nov 27 20:32:02 2021] GET /identity/v3/endpoints?service_id=1c70e8f25a13464ea328896edbc83d27&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:02.619544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f23895-b12a-4d5e-ab89-403a708d7257 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.631496 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 519/1038] 10.222.0.21 () {60 vars in 1165 bytes} [Sat Nov 27 20:32:02 2021] POST /identity/v3/endpoints => generated 325 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:32:02.631786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f23895-b12a-4d5e-ab89-403a708d7257 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.646296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cf300-93c2-49b2-a3cc-d52d39a2707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.646970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cf300-93c2-49b2-a3cc-d52d39a2707d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.647284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cf300-93c2-49b2-a3cc-d52d39a2707d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.647557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cf300-93c2-49b2-a3cc-d52d39a2707d admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.648271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cf300-93c2-49b2-a3cc-d52d39a2707d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.649913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cf300-93c2-49b2-a3cc-d52d39a2707d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.657296 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 520/1039] 10.222.0.21 () {56 vars in 1108 bytes} [Sat Nov 27 20:32:02 2021] GET /identity/v3/services => generated 1957 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:32:02.805734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca699b5f-98f3-41fa-94e3-1f8780fb4a5f None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.806112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca699b5f-98f3-41fa-94e3-1f8780fb4a5f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.806341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca699b5f-98f3-41fa-94e3-1f8780fb4a5f None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.808518 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 520/1040] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:02.815127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc77e2c-857f-42a2-9b4e-e0e6f849060c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.815489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc77e2c-857f-42a2-9b4e-e0e6f849060c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.815832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc77e2c-857f-42a2-9b4e-e0e6f849060c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.835838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fcc77e2c-857f-42a2-9b4e-e0e6f849060c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:02.837084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fcc77e2c-857f-42a2-9b4e-e0e6f849060c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:02.845282 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 521/1041] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:02 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:02.871138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca699b5f-98f3-41fa-94e3-1f8780fb4a5f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.884411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca699b5f-98f3-41fa-94e3-1f8780fb4a5f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.889030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffcc7a-7250-41c4-ac3a-7eb8a3ae4308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.889891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffcc7a-7250-41c4-ac3a-7eb8a3ae4308 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.890246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffcc7a-7250-41c4-ac3a-7eb8a3ae4308 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.890592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffcc7a-7250-41c4-ac3a-7eb8a3ae4308 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.891376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffcc7a-7250-41c4-ac3a-7eb8a3ae4308 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.893176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffcc7a-7250-41c4-ac3a-7eb8a3ae4308 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.905230 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-39ffcc7a-7250-41c4-ac3a-7eb8a3ae4308 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 27 20:32:02.906728 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 521/1042] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:32:02 2021] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:02.913981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc77e2c-857f-42a2-9b4e-e0e6f849060c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.923420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc77e2c-857f-42a2-9b4e-e0e6f849060c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.928122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ecc5b-e042-4617-8527-32dffec18fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.928778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ecc5b-e042-4617-8527-32dffec18fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.929060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ecc5b-e042-4617-8527-32dffec18fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.929334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ecc5b-e042-4617-8527-32dffec18fe5 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.930053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ecc5b-e042-4617-8527-32dffec18fe5 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:02.930358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ecc5b-e042-4617-8527-32dffec18fe5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.931974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ecc5b-e042-4617-8527-32dffec18fe5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.937239 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 522/1043] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:32:02 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:02.943358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffcc7a-7250-41c4-ac3a-7eb8a3ae4308 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.953441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffcc7a-7250-41c4-ac3a-7eb8a3ae4308 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.957818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5ae8d-0f4a-4307-a828-e62155a3d46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.959063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5ae8d-0f4a-4307-a828-e62155a3d46f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.959385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5ae8d-0f4a-4307-a828-e62155a3d46f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.959659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5ae8d-0f4a-4307-a828-e62155a3d46f admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.960410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5ae8d-0f4a-4307-a828-e62155a3d46f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:02.960688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5ae8d-0f4a-4307-a828-e62155a3d46f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.962261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5ae8d-0f4a-4307-a828-e62155a3d46f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:02.967053 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 522/1044] 10.222.0.21 () {56 vars in 1133 bytes} [Sat Nov 27 20:32:02 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:02.972993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ecc5b-e042-4617-8527-32dffec18fe5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:02.983179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ecc5b-e042-4617-8527-32dffec18fe5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:02.988124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d892ca2-04ed-4e27-9606-f3b215240c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:02.988932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d892ca2-04ed-4e27-9606-f3b215240c67 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:02.989909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d892ca2-04ed-4e27-9606-f3b215240c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:02.990333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d892ca2-04ed-4e27-9606-f3b215240c67 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:02.991359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d892ca2-04ed-4e27-9606-f3b215240c67 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:02.993127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d892ca2-04ed-4e27-9606-f3b215240c67 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:03.013355 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 523/1045] 10.222.0.21 () {60 vars in 1165 bytes} [Sat Nov 27 20:32:02 2021] POST /identity/v3/endpoints => generated 334 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:32:05.122031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492666c-51b2-46ca-aeaf-214ffdea451b None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.122574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492666c-51b2-46ca-aeaf-214ffdea451b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.122574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492666c-51b2-46ca-aeaf-214ffdea451b None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.124913 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 523/1046] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:05.131377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b5cc-9c80-4c8b-ad00-8ceb492ddd3c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.131934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b5cc-9c80-4c8b-ad00-8ceb492ddd3c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.131934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b5cc-9c80-4c8b-ad00-8ceb492ddd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.132172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34b373-d53e-4590-8ff3-64c95a67cd4f None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.132427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34b373-d53e-4590-8ff3-64c95a67cd4f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.132708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34b373-d53e-4590-8ff3-64c95a67cd4f None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.134773 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 524/1047] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:32:05.140378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7c576-8686-470e-b69c-0174c3051c25 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.140664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7c576-8686-470e-b69c-0174c3051c25 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.140942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7c576-8686-470e-b69c-0174c3051c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.151355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-70c2b5cc-9c80-4c8b-ad00-8ceb492ddd3c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:05.152542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-70c2b5cc-9c80-4c8b-ad00-8ceb492ddd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:05.158446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-aab7c576-8686-470e-b69c-0174c3051c25 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:05.159637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aab7c576-8686-470e-b69c-0174c3051c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:05.171297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 524/1048] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:05 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:05.177604 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 525/1049] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:05 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:32:05.198445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2b5cc-9c80-4c8b-ad00-8ceb492ddd3c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.203028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7c576-8686-470e-b69c-0174c3051c25 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.207805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2b5cc-9c80-4c8b-ad00-8ceb492ddd3c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.212674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7c576-8686-470e-b69c-0174c3051c25 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.213013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e5b7-aa6b-40ad-85b3-4bf95a7fd8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.213772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e5b7-aa6b-40ad-85b3-4bf95a7fd8de admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.214054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e5b7-aa6b-40ad-85b3-4bf95a7fd8de admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.214381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e5b7-aa6b-40ad-85b3-4bf95a7fd8de admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.215562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e5b7-aa6b-40ad-85b3-4bf95a7fd8de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.217247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e5b7-aa6b-40ad-85b3-4bf95a7fd8de admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.217410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb291ab-da71-4bf2-8a97-c3d491887d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.218148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb291ab-da71-4bf2-8a97-c3d491887d52 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.218437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb291ab-da71-4bf2-8a97-c3d491887d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.218711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb291ab-da71-4bf2-8a97-c3d491887d52 admin admin] PATH_INFO: `/v3/services/image` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.219404 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 525/1050] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:05.219520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb291ab-da71-4bf2-8a97-c3d491887d52 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.220985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb291ab-da71-4bf2-8a97-c3d491887d52 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.225586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e5b7-aa6b-40ad-85b3-4bf95a7fd8de admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.233217 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-0cb291ab-da71-4bf2-8a97-c3d491887d52 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 27 20:32:05.234495 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 526/1051] 10.222.0.21 () {56 vars in 1126 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:32:05.236149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e5b7-aa6b-40ad-85b3-4bf95a7fd8de admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.240735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb291ab-da71-4bf2-8a97-c3d491887d52 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.240921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2389cde-4cc5-4b65-a886-a669e8c69e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.241559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2389cde-4cc5-4b65-a886-a669e8c69e19 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.241845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2389cde-4cc5-4b65-a886-a669e8c69e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.242124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2389cde-4cc5-4b65-a886-a669e8c69e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.242856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2389cde-4cc5-4b65-a886-a669e8c69e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.244774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2389cde-4cc5-4b65-a886-a669e8c69e19 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.252504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb291ab-da71-4bf2-8a97-c3d491887d52 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.258727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34525e-a683-4a38-b905-3302a4d31ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.260041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34525e-a683-4a38-b905-3302a4d31ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.260844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34525e-a683-4a38-b905-3302a4d31ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.261176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34525e-a683-4a38-b905-3302a4d31ad9 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.261988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34525e-a683-4a38-b905-3302a4d31ad9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:05.262359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34525e-a683-4a38-b905-3302a4d31ad9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.264242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34525e-a683-4a38-b905-3302a4d31ad9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.269940 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 527/1052] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/services?name=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:05.276608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34525e-a683-4a38-b905-3302a4d31ad9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.287405 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 526/1053] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:32:05 2021] POST /identity/v3/projects => generated 311 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:32:05.297508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34525e-a683-4a38-b905-3302a4d31ad9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.356709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960d2a1-0de1-48d8-a5e8-c2eac02494a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.357383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960d2a1-0de1-48d8-a5e8-c2eac02494a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.357664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960d2a1-0de1-48d8-a5e8-c2eac02494a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.357941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960d2a1-0de1-48d8-a5e8-c2eac02494a7 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.358730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960d2a1-0de1-48d8-a5e8-c2eac02494a7 admin admin] RBAC: Adding query filter params (type=image) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:05.359039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960d2a1-0de1-48d8-a5e8-c2eac02494a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.361045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960d2a1-0de1-48d8-a5e8-c2eac02494a7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.366490 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 528/1054] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/services?type=image => generated 350 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:05.373252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2389cde-4cc5-4b65-a886-a669e8c69e19 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.384025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2389cde-4cc5-4b65-a886-a669e8c69e19 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.388609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e41f3-ccb6-4b76-b073-0f7e78c04dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.389276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e41f3-ccb6-4b76-b073-0f7e78c04dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.389558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e41f3-ccb6-4b76-b073-0f7e78c04dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.389831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e41f3-ccb6-4b76-b073-0f7e78c04dc8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.390609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e41f3-ccb6-4b76-b073-0f7e78c04dc8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.392239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e41f3-ccb6-4b76-b073-0f7e78c04dc8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.412700 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 527/1055] 10.222.0.21 () {60 vars in 1165 bytes} [Sat Nov 27 20:32:05 2021] POST /identity/v3/endpoints => generated 327 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:32:05.527210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aa4e9-9170-4320-9a37-6d1efd8bed83 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.527510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aa4e9-9170-4320-9a37-6d1efd8bed83 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.527792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5aa4e9-9170-4320-9a37-6d1efd8bed83 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.529686 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 529/1056] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:05.536599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd70c1-fb78-4c2d-8a3d-f62784ab52a9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.536888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd70c1-fb78-4c2d-8a3d-f62784ab52a9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.537334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd70c1-fb78-4c2d-8a3d-f62784ab52a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.557424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-94bd70c1-fb78-4c2d-8a3d-f62784ab52a9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:05.558676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-94bd70c1-fb78-4c2d-8a3d-f62784ab52a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:05.580572 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 528/1057] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:05.607640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5aa4e9-9170-4320-9a37-6d1efd8bed83 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.620451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5aa4e9-9170-4320-9a37-6d1efd8bed83 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.625178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b1e14-fe39-43ef-8e70-0f9e35794071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.625921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b1e14-fe39-43ef-8e70-0f9e35794071 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.626194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b1e14-fe39-43ef-8e70-0f9e35794071 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.626462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b1e14-fe39-43ef-8e70-0f9e35794071 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.639588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b1e14-fe39-43ef-8e70-0f9e35794071 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:05.647580 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-374b1e14-fe39-43ef-8e70-0f9e35794071 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 27 20:32:05.648937 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 530/1058] 10.222.0.21 () {56 vars in 1141 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:05.655448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd70c1-fb78-4c2d-8a3d-f62784ab52a9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.665065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd70c1-fb78-4c2d-8a3d-f62784ab52a9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.670621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aa586-798c-4732-8deb-268bdd096be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.671633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aa586-798c-4732-8deb-268bdd096be1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.672143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aa586-798c-4732-8deb-268bdd096be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.672414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077aa586-798c-4732-8deb-268bdd096be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.673172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077aa586-798c-4732-8deb-268bdd096be1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:05.673473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077aa586-798c-4732-8deb-268bdd096be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.675044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077aa586-798c-4732-8deb-268bdd096be1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.683905 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 529/1059] 10.222.0.21 () {56 vars in 1136 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:05.690032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b1e14-fe39-43ef-8e70-0f9e35794071 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.701362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b1e14-fe39-43ef-8e70-0f9e35794071 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.706164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc844473-833e-49e8-baae-bf827f8d1cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.706932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844473-833e-49e8-baae-bf827f8d1cfa admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.707232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844473-833e-49e8-baae-bf827f8d1cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.707610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844473-833e-49e8-baae-bf827f8d1cfa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.718534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc844473-833e-49e8-baae-bf827f8d1cfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.720408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc844473-833e-49e8-baae-bf827f8d1cfa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.736777 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-bc844473-833e-49e8-baae-bf827f8d1cfa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:32:05.738148 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 531/1060] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:05.744574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aa586-798c-4732-8deb-268bdd096be1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.755916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077aa586-798c-4732-8deb-268bdd096be1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.760716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702232d-b15e-4da2-b3b3-f6328028d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.761462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702232d-b15e-4da2-b3b3-f6328028d29e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.761815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702232d-b15e-4da2-b3b3-f6328028d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.762162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702232d-b15e-4da2-b3b3-f6328028d29e admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.762971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702232d-b15e-4da2-b3b3-f6328028d29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:05.763384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702232d-b15e-4da2-b3b3-f6328028d29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.765156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702232d-b15e-4da2-b3b3-f6328028d29e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.777859 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 530/1061] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:05.784199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc844473-833e-49e8-baae-bf827f8d1cfa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.794239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc844473-833e-49e8-baae-bf827f8d1cfa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.798686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb89efd-1b44-4de6-b9aa-496703ce44d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.799560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb89efd-1b44-4de6-b9aa-496703ce44d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.799877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb89efd-1b44-4de6-b9aa-496703ce44d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.800173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb89efd-1b44-4de6-b9aa-496703ce44d5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.808204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb89efd-1b44-4de6-b9aa-496703ce44d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.810347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb89efd-1b44-4de6-b9aa-496703ce44d5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.824876 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-ceb89efd-1b44-4de6-b9aa-496703ce44d5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 27 20:32:05.826202 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 532/1062] 10.222.0.21 () {56 vars in 1114 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:05.832623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702232d-b15e-4da2-b3b3-f6328028d29e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.842681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702232d-b15e-4da2-b3b3-f6328028d29e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.847074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0d77f-8f46-4ee3-8cf3-d49133b7c0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.847745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0d77f-8f46-4ee3-8cf3-d49133b7c0fb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.848024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0d77f-8f46-4ee3-8cf3-d49133b7c0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.848292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0d77f-8f46-4ee3-8cf3-d49133b7c0fb admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.849220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0d77f-8f46-4ee3-8cf3-d49133b7c0fb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:05.849548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0d77f-8f46-4ee3-8cf3-d49133b7c0fb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.851513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0d77f-8f46-4ee3-8cf3-d49133b7c0fb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.870044 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 531/1063] 10.222.0.21 () {56 vars in 1154 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:05.876369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb89efd-1b44-4de6-b9aa-496703ce44d5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.886659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb89efd-1b44-4de6-b9aa-496703ce44d5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.891141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ad425-9652-43b4-96af-d1a0f721d954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.891865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ad425-9652-43b4-96af-d1a0f721d954 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.892167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ad425-9652-43b4-96af-d1a0f721d954 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.892440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ad425-9652-43b4-96af-d1a0f721d954 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.900372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ad425-9652-43b4-96af-d1a0f721d954 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.902143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ad425-9652-43b4-96af-d1a0f721d954 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.911499 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 533/1064] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:32:05.917499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0d77f-8f46-4ee3-8cf3-d49133b7c0fb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.927855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0d77f-8f46-4ee3-8cf3-d49133b7c0fb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.932483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c7eb4-7ba4-4cec-92fc-72d3647f659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.933325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c7eb4-7ba4-4cec-92fc-72d3647f659b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.933677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c7eb4-7ba4-4cec-92fc-72d3647f659b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.934016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c7eb4-7ba4-4cec-92fc-72d3647f659b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.944728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c7eb4-7ba4-4cec-92fc-72d3647f659b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.946574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c7eb4-7ba4-4cec-92fc-72d3647f659b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:05.962818 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-013c7eb4-7ba4-4cec-92fc-72d3647f659b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:32:05.963970 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 532/1065] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:05.970132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ad425-9652-43b4-96af-d1a0f721d954 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:05.979184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ad425-9652-43b4-96af-d1a0f721d954 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:05.983879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab30f-04dc-4fd3-9f0b-379a08c23b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:05.984647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab30f-04dc-4fd3-9f0b-379a08c23b41 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:05.985013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab30f-04dc-4fd3-9f0b-379a08c23b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:05.985391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab30f-04dc-4fd3-9f0b-379a08c23b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:05.986230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab30f-04dc-4fd3-9f0b-379a08c23b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:05.986612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab30f-04dc-4fd3-9f0b-379a08c23b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:05.988275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab30f-04dc-4fd3-9f0b-379a08c23b41 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:06.001454 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 534/1066] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:32:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:06.006647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c7eb4-7ba4-4cec-92fc-72d3647f659b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:06.017414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c7eb4-7ba4-4cec-92fc-72d3647f659b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:06.023158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1a35c-c93e-44c3-92bb-a152af2b5f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:06.023991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1a35c-c93e-44c3-92bb-a152af2b5f04 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:06.024275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1a35c-c93e-44c3-92bb-a152af2b5f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:06.024556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1a35c-c93e-44c3-92bb-a152af2b5f04 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:06.031770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1a35c-c93e-44c3-92bb-a152af2b5f04 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:06.033803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1a35c-c93e-44c3-92bb-a152af2b5f04 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:06.047020 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-e6b1a35c-c93e-44c3-92bb-a152af2b5f04 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:32:06.053377 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 533/1067] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:32:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:32:06.054795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab30f-04dc-4fd3-9f0b-379a08c23b41 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:06.064797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab30f-04dc-4fd3-9f0b-379a08c23b41 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:06.069340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c1fe8-1b7f-456e-a4f1-0407d0567e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:06.070027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c1fe8-1b7f-456e-a4f1-0407d0567e11 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:06.070336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c1fe8-1b7f-456e-a4f1-0407d0567e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:06.070641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c1fe8-1b7f-456e-a4f1-0407d0567e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:06.071462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c1fe8-1b7f-456e-a4f1-0407d0567e11 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:06.071767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c1fe8-1b7f-456e-a4f1-0407d0567e11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:06.073662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c1fe8-1b7f-456e-a4f1-0407d0567e11 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:06.087513 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 535/1068] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:32:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:06.093014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1a35c-c93e-44c3-92bb-a152af2b5f04 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:06.103143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1a35c-c93e-44c3-92bb-a152af2b5f04 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:06.107631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef93e57-bfc0-4883-91b1-273bde2ee660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:06.108281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef93e57-bfc0-4883-91b1-273bde2ee660 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:06.108572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef93e57-bfc0-4883-91b1-273bde2ee660 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:06.108907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef93e57-bfc0-4883-91b1-273bde2ee660 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:06.109768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef93e57-bfc0-4883-91b1-273bde2ee660 admin admin] RBAC: Adding query filter params (role.id=00be6a1aa54446848af1e63781d879e5, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=aa3373ab52dc4fe680372579cfcde718) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:06.110082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef93e57-bfc0-4883-91b1-273bde2ee660 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:06.111941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef93e57-bfc0-4883-91b1-273bde2ee660 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:06.118043 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 534/1069] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:32:06 2021] GET /identity/v3/role_assignments?user.id=aa3373ab52dc4fe680372579cfcde718&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=00be6a1aa54446848af1e63781d879e5 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:07.803095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01ff50-f304-48ae-be7c-27ad2fbca118 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:07.803653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01ff50-f304-48ae-be7c-27ad2fbca118 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:07.803769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01ff50-f304-48ae-be7c-27ad2fbca118 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:07.805537 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 536/1070] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:07.811372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfccf9-7db1-4682-be5f-c1cdf6ec44a9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:07.811775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfccf9-7db1-4682-be5f-c1cdf6ec44a9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:07.811949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfccf9-7db1-4682-be5f-c1cdf6ec44a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:07.829735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-99bfccf9-7db1-4682-be5f-c1cdf6ec44a9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:07.830909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-99bfccf9-7db1-4682-be5f-c1cdf6ec44a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:07.839374 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 535/1071] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:07 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:07.865640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01ff50-f304-48ae-be7c-27ad2fbca118 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:07.877991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01ff50-f304-48ae-be7c-27ad2fbca118 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:07.882759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd243e8c-387c-4186-a121-da260ff232a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:07.883556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243e8c-387c-4186-a121-da260ff232a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:07.883835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243e8c-387c-4186-a121-da260ff232a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:07.884105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd243e8c-387c-4186-a121-da260ff232a2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:07.885284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd243e8c-387c-4186-a121-da260ff232a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:07.886959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd243e8c-387c-4186-a121-da260ff232a2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:07.888686 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 537/1072] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:07.894566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfccf9-7db1-4682-be5f-c1cdf6ec44a9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:07.903969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfccf9-7db1-4682-be5f-c1cdf6ec44a9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:07.908394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110f7ff-e4bf-484c-b84f-27c1a60a7e15 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:07.908628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf849f62-5b76-44e4-9319-b6efb44a4928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:07.908745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110f7ff-e4bf-484c-b84f-27c1a60a7e15 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:07.908952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110f7ff-e4bf-484c-b84f-27c1a60a7e15 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:07.909249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf849f62-5b76-44e4-9319-b6efb44a4928 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:07.909528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf849f62-5b76-44e4-9319-b6efb44a4928 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:07.909798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf849f62-5b76-44e4-9319-b6efb44a4928 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:07.910520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf849f62-5b76-44e4-9319-b6efb44a4928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:07.910901 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 538/1073] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:32:07.912630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf849f62-5b76-44e4-9319-b6efb44a4928 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:07.916351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a1863-ef9f-499c-a5a3-c43bc9d7f805 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:07.916641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a1863-ef9f-499c-a5a3-c43bc9d7f805 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:07.916919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a1863-ef9f-499c-a5a3-c43bc9d7f805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:07.939287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-aa5a1863-ef9f-499c-a5a3-c43bc9d7f805 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:07.939287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aa5a1863-ef9f-499c-a5a3-c43bc9d7f805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:07.939571 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 536/1074] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:32:07 2021] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:32:07.948442 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 539/1075] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:07 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:32:07.974102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf849f62-5b76-44e4-9319-b6efb44a4928 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:07.984287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf849f62-5b76-44e4-9319-b6efb44a4928 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:07.989101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa286fb-bea1-441d-afc7-0284049eddd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:07.989758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa286fb-bea1-441d-afc7-0284049eddd7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:07.990036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa286fb-bea1-441d-afc7-0284049eddd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:07.990306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa286fb-bea1-441d-afc7-0284049eddd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:07.999528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa286fb-bea1-441d-afc7-0284049eddd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:08.001311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa286fb-bea1-441d-afc7-0284049eddd7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:08.013001 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 537/1076] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:07 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:32:08.019440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a1863-ef9f-499c-a5a3-c43bc9d7f805 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:08.029470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a1863-ef9f-499c-a5a3-c43bc9d7f805 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:08.034359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fb7d4-cf48-44f2-ab2a-76a7bde634f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:08.035160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb7d4-cf48-44f2-ab2a-76a7bde634f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.035473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb7d4-cf48-44f2-ab2a-76a7bde634f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.035743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb7d4-cf48-44f2-ab2a-76a7bde634f8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.037030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fb7d4-cf48-44f2-ab2a-76a7bde634f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:08.038752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fb7d4-cf48-44f2-ab2a-76a7bde634f8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:08.040647 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 540/1077] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:08.560085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb65f-3797-4f9f-85a7-36cd1526971c None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.560370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb65f-3797-4f9f-85a7-36cd1526971c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.560646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb65f-3797-4f9f-85a7-36cd1526971c None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.562451 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 538/1078] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:08.568340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b5b4b-3909-41eb-a0ed-77b82566a196 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.568621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b5b4b-3909-41eb-a0ed-77b82566a196 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.568892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b5b4b-3909-41eb-a0ed-77b82566a196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.586263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-610b5b4b-3909-41eb-a0ed-77b82566a196 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:08.587449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-610b5b4b-3909-41eb-a0ed-77b82566a196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:08.594863 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 541/1079] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:08.620022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcb65f-3797-4f9f-85a7-36cd1526971c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:08.632813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcb65f-3797-4f9f-85a7-36cd1526971c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:08.637164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2935b-c0f3-4f86-b5d6-441f35508573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:08.637946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2935b-c0f3-4f86-b5d6-441f35508573 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.638234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2935b-c0f3-4f86-b5d6-441f35508573 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.638509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2935b-c0f3-4f86-b5d6-441f35508573 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.649259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2935b-c0f3-4f86-b5d6-441f35508573 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:08.656585 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-b6a2935b-c0f3-4f86-b5d6-441f35508573 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 27 20:32:08.657735 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 539/1080] 10.222.0.21 () {56 vars in 1141 bytes} [Sat Nov 27 20:32:08 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:08.664193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b5b4b-3909-41eb-a0ed-77b82566a196 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:08.673020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b5b4b-3909-41eb-a0ed-77b82566a196 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:08.677492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c6f21-91c0-4970-85de-efb41ce4c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:08.678139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c6f21-91c0-4970-85de-efb41ce4c56d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.678421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c6f21-91c0-4970-85de-efb41ce4c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.678697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c6f21-91c0-4970-85de-efb41ce4c56d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.679481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c6f21-91c0-4970-85de-efb41ce4c56d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:08.679790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c6f21-91c0-4970-85de-efb41ce4c56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:08.681425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c6f21-91c0-4970-85de-efb41ce4c56d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:08.689384 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 542/1081] 10.222.0.21 () {56 vars in 1136 bytes} [Sat Nov 27 20:32:08 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:08.695701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2935b-c0f3-4f86-b5d6-441f35508573 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:08.705684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2935b-c0f3-4f86-b5d6-441f35508573 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:08.710798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb74f6-9125-4d1c-a5d7-b73385cbb445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:08.711578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb74f6-9125-4d1c-a5d7-b73385cbb445 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.711862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb74f6-9125-4d1c-a5d7-b73385cbb445 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.712137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb74f6-9125-4d1c-a5d7-b73385cbb445 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.721925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb74f6-9125-4d1c-a5d7-b73385cbb445 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:08.723763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb74f6-9125-4d1c-a5d7-b73385cbb445 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:08.739768 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-5ecb74f6-9125-4d1c-a5d7-b73385cbb445 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:32:08.745687 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 540/1082] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:08.746814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c6f21-91c0-4970-85de-efb41ce4c56d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:08.757313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c6f21-91c0-4970-85de-efb41ce4c56d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:08.761895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823f7e-4540-405d-bb34-0d2d9515bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:08.762534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823f7e-4540-405d-bb34-0d2d9515bb90 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.762818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823f7e-4540-405d-bb34-0d2d9515bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.763092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823f7e-4540-405d-bb34-0d2d9515bb90 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.763851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69823f7e-4540-405d-bb34-0d2d9515bb90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:08.764160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69823f7e-4540-405d-bb34-0d2d9515bb90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:08.765768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69823f7e-4540-405d-bb34-0d2d9515bb90 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:08.782699 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 543/1083] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:32:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:08.788780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb74f6-9125-4d1c-a5d7-b73385cbb445 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:08.798386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb74f6-9125-4d1c-a5d7-b73385cbb445 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:08.803446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614eb0c5-7bb1-4ac9-8246-d95e2032e016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:08.804215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614eb0c5-7bb1-4ac9-8246-d95e2032e016 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.804498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614eb0c5-7bb1-4ac9-8246-d95e2032e016 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.804780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614eb0c5-7bb1-4ac9-8246-d95e2032e016 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.812038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614eb0c5-7bb1-4ac9-8246-d95e2032e016 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:08.814029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614eb0c5-7bb1-4ac9-8246-d95e2032e016 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:08.827608 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-614eb0c5-7bb1-4ac9-8246-d95e2032e016 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 27 20:32:08.828935 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 541/1084] 10.222.0.21 () {56 vars in 1114 bytes} [Sat Nov 27 20:32:08 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:08.835744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823f7e-4540-405d-bb34-0d2d9515bb90 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:08.845914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69823f7e-4540-405d-bb34-0d2d9515bb90 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:08.851045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73715d-fb18-49fb-81d0-32a392556408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:08.851729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73715d-fb18-49fb-81d0-32a392556408 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.852280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73715d-fb18-49fb-81d0-32a392556408 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.852564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73715d-fb18-49fb-81d0-32a392556408 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.853412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73715d-fb18-49fb-81d0-32a392556408 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:08.853719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73715d-fb18-49fb-81d0-32a392556408 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:08.855578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73715d-fb18-49fb-81d0-32a392556408 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:08.872674 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 544/1085] 10.222.0.21 () {56 vars in 1154 bytes} [Sat Nov 27 20:32:08 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:08.879130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614eb0c5-7bb1-4ac9-8246-d95e2032e016 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:08.888682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614eb0c5-7bb1-4ac9-8246-d95e2032e016 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:08.893171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71caa6a-2fff-49ba-96e9-29719fadec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:08.893950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71caa6a-2fff-49ba-96e9-29719fadec7e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.894222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71caa6a-2fff-49ba-96e9-29719fadec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.894496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71caa6a-2fff-49ba-96e9-29719fadec7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.905042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71caa6a-2fff-49ba-96e9-29719fadec7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:08.906875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71caa6a-2fff-49ba-96e9-29719fadec7e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:08.924080 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-e71caa6a-2fff-49ba-96e9-29719fadec7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:32:08.925420 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 542/1086] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:08.931654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73715d-fb18-49fb-81d0-32a392556408 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:08.941210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73715d-fb18-49fb-81d0-32a392556408 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:08.945813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7291bb-bfb1-4ed1-9ba6-8021c8e14c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:08.946395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7291bb-bfb1-4ed1-9ba6-8021c8e14c1d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.946675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7291bb-bfb1-4ed1-9ba6-8021c8e14c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.946948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7291bb-bfb1-4ed1-9ba6-8021c8e14c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.947715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7291bb-bfb1-4ed1-9ba6-8021c8e14c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:08.948017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7291bb-bfb1-4ed1-9ba6-8021c8e14c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:08.949600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7291bb-bfb1-4ed1-9ba6-8021c8e14c1d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:08.961238 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 545/1087] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:32:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:08.967211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71caa6a-2fff-49ba-96e9-29719fadec7e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:08.977428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71caa6a-2fff-49ba-96e9-29719fadec7e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:08.981899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b32b48-77e4-4ffa-9f87-8a147dd70b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:08.982659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b32b48-77e4-4ffa-9f87-8a147dd70b83 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:08.982939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b32b48-77e4-4ffa-9f87-8a147dd70b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:08.983208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b32b48-77e4-4ffa-9f87-8a147dd70b83 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:08.989976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b32b48-77e4-4ffa-9f87-8a147dd70b83 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:08.991949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b32b48-77e4-4ffa-9f87-8a147dd70b83 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:09.004751 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-79b32b48-77e4-4ffa-9f87-8a147dd70b83 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:32:09.005891 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 543/1088] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:32:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:09.012256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7291bb-bfb1-4ed1-9ba6-8021c8e14c1d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:09.022372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7291bb-bfb1-4ed1-9ba6-8021c8e14c1d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:09.026883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16455b93-c175-4395-815c-5e9b6c1a705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:09.027551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455b93-c175-4395-815c-5e9b6c1a705e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:09.027839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455b93-c175-4395-815c-5e9b6c1a705e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:09.028114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455b93-c175-4395-815c-5e9b6c1a705e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:09.028899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16455b93-c175-4395-815c-5e9b6c1a705e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:09.029206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16455b93-c175-4395-815c-5e9b6c1a705e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:09.031039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16455b93-c175-4395-815c-5e9b6c1a705e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:09.042930 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 546/1089] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:32:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:09.049217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b32b48-77e4-4ffa-9f87-8a147dd70b83 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:09.061209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b32b48-77e4-4ffa-9f87-8a147dd70b83 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:09.065771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a12f29-9b00-4160-b995-54209df9572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:09.066635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a12f29-9b00-4160-b995-54209df9572d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:09.066920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a12f29-9b00-4160-b995-54209df9572d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:09.067803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a12f29-9b00-4160-b995-54209df9572d admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/aa3373ab52dc4fe680372579cfcde718/roles/00be6a1aa54446848af1e63781d879e5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:09.070048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a12f29-9b00-4160-b995-54209df9572d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=aa3373ab52dc4fe680372579cfcde718, role_id=00be6a1aa54446848af1e63781d879e5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:09.072713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a12f29-9b00-4160-b995-54209df9572d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:09.086574 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 544/1090] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:32:09 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/aa3373ab52dc4fe680372579cfcde718/roles/00be6a1aa54446848af1e63781d879e5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:32:10.424148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9a3eb-75d4-4397-9856-f651a14c65fa None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:10.424677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9a3eb-75d4-4397-9856-f651a14c65fa None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:10.424677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9a3eb-75d4-4397-9856-f651a14c65fa None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:10.427004 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 547/1091] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:10.432943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a627c-bc25-443a-9de5-d5c3984ae9e9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:10.433361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a627c-bc25-443a-9de5-d5c3984ae9e9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:10.433475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a627c-bc25-443a-9de5-d5c3984ae9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:10.454337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b00a627c-bc25-443a-9de5-d5c3984ae9e9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:10.455556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b00a627c-bc25-443a-9de5-d5c3984ae9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:10.511103 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 545/1092] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:10 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:10.536714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9a3eb-75d4-4397-9856-f651a14c65fa None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:10.548623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9a3eb-75d4-4397-9856-f651a14c65fa None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:10.553726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5226138-c950-4a6f-ae64-a5b6ee5c12ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:10.554507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5226138-c950-4a6f-ae64-a5b6ee5c12ad admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:10.554784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5226138-c950-4a6f-ae64-a5b6ee5c12ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:10.555048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5226138-c950-4a6f-ae64-a5b6ee5c12ad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:10.565029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5226138-c950-4a6f-ae64-a5b6ee5c12ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:10.572670 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-f5226138-c950-4a6f-ae64-a5b6ee5c12ad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:32:10.573807 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 548/1093] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:32:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:10.580212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a627c-bc25-443a-9de5-d5c3984ae9e9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:10.589026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a627c-bc25-443a-9de5-d5c3984ae9e9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:10.593567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7d300-7274-43a6-aad1-ba78d0f272c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:10.594208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7d300-7274-43a6-aad1-ba78d0f272c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:10.594487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7d300-7274-43a6-aad1-ba78d0f272c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:10.594760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7d300-7274-43a6-aad1-ba78d0f272c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:10.595545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7d300-7274-43a6-aad1-ba78d0f272c8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:10.595847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7d300-7274-43a6-aad1-ba78d0f272c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:10.597407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7d300-7274-43a6-aad1-ba78d0f272c8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:10.605319 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 546/1094] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:32:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:10.611155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5226138-c950-4a6f-ae64-a5b6ee5c12ad admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:10.621645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5226138-c950-4a6f-ae64-a5b6ee5c12ad admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:10.626285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783707c-eeb6-45cd-a4c0-835d855da1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:10.627095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783707c-eeb6-45cd-a4c0-835d855da1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:10.627414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783707c-eeb6-45cd-a4c0-835d855da1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:10.627688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783707c-eeb6-45cd-a4c0-835d855da1f9 admin admin] PATH_INFO: `/v3/users/4f3d41a3e7d94aef8590439298676a8e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:10.640799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783707c-eeb6-45cd-a4c0-835d855da1f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=4f3d41a3e7d94aef8590439298676a8e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:10.642896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5783707c-eeb6-45cd-a4c0-835d855da1f9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:10.644478 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 549/1095] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:10 2021] GET /identity/v3/users/4f3d41a3e7d94aef8590439298676a8e => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:10.650497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7d300-7274-43a6-aad1-ba78d0f272c8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:10.659902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7d300-7274-43a6-aad1-ba78d0f272c8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:10.665029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788356b-ff8c-439b-812b-814214b337bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:10.665659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788356b-ff8c-439b-812b-814214b337bc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:10.665943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788356b-ff8c-439b-812b-814214b337bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:10.666216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788356b-ff8c-439b-812b-814214b337bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:10.673964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788356b-ff8c-439b-812b-814214b337bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:10.675778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788356b-ff8c-439b-812b-814214b337bc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:10.684897 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 547/1096] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:10 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:32:10.691275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783707c-eeb6-45cd-a4c0-835d855da1f9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:10.700670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783707c-eeb6-45cd-a4c0-835d855da1f9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:10.705073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782dda3-8b38-4fa9-a1cc-f89394d3ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:10.705891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782dda3-8b38-4fa9-a1cc-f89394d3ffde admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:10.706167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782dda3-8b38-4fa9-a1cc-f89394d3ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:10.706433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782dda3-8b38-4fa9-a1cc-f89394d3ffde admin admin] PATH_INFO: `/v3/projects/1d08ed5c7c0642f9baa01c211b161006` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:10.707616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782dda3-8b38-4fa9-a1cc-f89394d3ffde admin admin] RBAC: Authorizing `identity:get_project(project_id=1d08ed5c7c0642f9baa01c211b161006)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:10.709621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782dda3-8b38-4fa9-a1cc-f89394d3ffde admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:10.711208 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 550/1097] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:10 2021] GET /identity/v3/projects/1d08ed5c7c0642f9baa01c211b161006 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:10.717256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788356b-ff8c-439b-812b-814214b337bc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:10.726198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788356b-ff8c-439b-812b-814214b337bc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:10.730687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4cb62-bd31-4803-bb71-318840649f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:10.731330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4cb62-bd31-4803-bb71-318840649f25 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:10.731617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4cb62-bd31-4803-bb71-318840649f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:10.731892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4cb62-bd31-4803-bb71-318840649f25 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:10.732711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4cb62-bd31-4803-bb71-318840649f25 admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=1d08ed5c7c0642f9baa01c211b161006, user.id=4f3d41a3e7d94aef8590439298676a8e) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:10.733022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4cb62-bd31-4803-bb71-318840649f25 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:10.734802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4cb62-bd31-4803-bb71-318840649f25 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:10.740572 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 548/1098] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:32:10 2021] GET /identity/v3/role_assignments?user.id=4f3d41a3e7d94aef8590439298676a8e&scope.project.id=1d08ed5c7c0642f9baa01c211b161006&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:11.505926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb289-aefc-413d-9abb-b64faaf3d245 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.506464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb289-aefc-413d-9abb-b64faaf3d245 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.506464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb289-aefc-413d-9abb-b64faaf3d245 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.508280 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 551/1099] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:11.514053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517baf5-7072-4675-9a90-52fdf0043a85 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.514441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517baf5-7072-4675-9a90-52fdf0043a85 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.514612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517baf5-7072-4675-9a90-52fdf0043a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.532503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8517baf5-7072-4675-9a90-52fdf0043a85 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:11.533681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8517baf5-7072-4675-9a90-52fdf0043a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:11.541249 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 549/1100] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:11.566817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb289-aefc-413d-9abb-b64faaf3d245 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:11.579378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb289-aefc-413d-9abb-b64faaf3d245 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:11.584291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17077-2304-4e97-ad8a-21420d567c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:11.585076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17077-2304-4e97-ad8a-21420d567c6e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.585359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17077-2304-4e97-ad8a-21420d567c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.585632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c17077-2304-4e97-ad8a-21420d567c6e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.595527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c17077-2304-4e97-ad8a-21420d567c6e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:11.602760 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-51c17077-2304-4e97-ad8a-21420d567c6e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 27 20:32:11.603949 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 552/1101] 10.222.0.21 () {56 vars in 1141 bytes} [Sat Nov 27 20:32:11 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:11.610226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517baf5-7072-4675-9a90-52fdf0043a85 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:11.619285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517baf5-7072-4675-9a90-52fdf0043a85 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:11.624151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2985680-23e0-46b2-a9d6-0700135853e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:11.624805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2985680-23e0-46b2-a9d6-0700135853e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.625088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2985680-23e0-46b2-a9d6-0700135853e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.625361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2985680-23e0-46b2-a9d6-0700135853e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.626119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2985680-23e0-46b2-a9d6-0700135853e0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:11.626424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2985680-23e0-46b2-a9d6-0700135853e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:11.628042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2985680-23e0-46b2-a9d6-0700135853e0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:11.636647 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 550/1102] 10.222.0.21 () {56 vars in 1136 bytes} [Sat Nov 27 20:32:11 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:11.642849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17077-2304-4e97-ad8a-21420d567c6e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:11.653600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c17077-2304-4e97-ad8a-21420d567c6e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:11.658043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90e2cd-3d59-422c-a4e5-d823a0376c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:11.658855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90e2cd-3d59-422c-a4e5-d823a0376c10 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.659316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90e2cd-3d59-422c-a4e5-d823a0376c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.659430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90e2cd-3d59-422c-a4e5-d823a0376c10 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.673240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90e2cd-3d59-422c-a4e5-d823a0376c10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:11.675074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90e2cd-3d59-422c-a4e5-d823a0376c10 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:11.691610 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-3c90e2cd-3d59-422c-a4e5-d823a0376c10 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:32:11.693310 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 553/1103] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:11.699573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2985680-23e0-46b2-a9d6-0700135853e0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:11.709023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2985680-23e0-46b2-a9d6-0700135853e0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:11.714090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90219c4-0daf-47a6-ae3a-dc53e20e85bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:11.714731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90219c4-0daf-47a6-ae3a-dc53e20e85bd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.715014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90219c4-0daf-47a6-ae3a-dc53e20e85bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.715310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90219c4-0daf-47a6-ae3a-dc53e20e85bd admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.716040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90219c4-0daf-47a6-ae3a-dc53e20e85bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:11.716341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90219c4-0daf-47a6-ae3a-dc53e20e85bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:11.717904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90219c4-0daf-47a6-ae3a-dc53e20e85bd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:11.729345 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 551/1104] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:32:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:11.735600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90e2cd-3d59-422c-a4e5-d823a0376c10 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:11.745163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90e2cd-3d59-422c-a4e5-d823a0376c10 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:11.749933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554ff86-4a1c-465e-9770-b59a14e5cbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:11.750693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554ff86-4a1c-465e-9770-b59a14e5cbde admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.750974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554ff86-4a1c-465e-9770-b59a14e5cbde admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.751246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554ff86-4a1c-465e-9770-b59a14e5cbde admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.759042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554ff86-4a1c-465e-9770-b59a14e5cbde admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:11.761104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554ff86-4a1c-465e-9770-b59a14e5cbde admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:11.775069 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-8554ff86-4a1c-465e-9770-b59a14e5cbde admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 27 20:32:11.776221 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 554/1105] 10.222.0.21 () {56 vars in 1114 bytes} [Sat Nov 27 20:32:11 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:11.782457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90219c4-0daf-47a6-ae3a-dc53e20e85bd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:11.792615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90219c4-0daf-47a6-ae3a-dc53e20e85bd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:11.797145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d299de-21f3-4af0-8eff-ef05c7e3dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:11.797832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d299de-21f3-4af0-8eff-ef05c7e3dcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.798125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d299de-21f3-4af0-8eff-ef05c7e3dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.798398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d299de-21f3-4af0-8eff-ef05c7e3dcf7 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.799244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d299de-21f3-4af0-8eff-ef05c7e3dcf7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:11.799571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d299de-21f3-4af0-8eff-ef05c7e3dcf7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:11.801875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d299de-21f3-4af0-8eff-ef05c7e3dcf7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:11.819656 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 552/1106] 10.222.0.21 () {56 vars in 1154 bytes} [Sat Nov 27 20:32:11 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:11.825650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554ff86-4a1c-465e-9770-b59a14e5cbde admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:11.835164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554ff86-4a1c-465e-9770-b59a14e5cbde admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:11.839734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bb8c8-ce22-431b-a104-edd75145454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:11.840360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bb8c8-ce22-431b-a104-edd75145454a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.840643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bb8c8-ce22-431b-a104-edd75145454a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.840913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bb8c8-ce22-431b-a104-edd75145454a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.848599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bb8c8-ce22-431b-a104-edd75145454a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:11.850335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bb8c8-ce22-431b-a104-edd75145454a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:11.859173 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 555/1107] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:11 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:32:11.866021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d299de-21f3-4af0-8eff-ef05c7e3dcf7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:11.875852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d299de-21f3-4af0-8eff-ef05c7e3dcf7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:11.880521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5a6e0-e40b-4a5f-9a7e-faa8b8616d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:11.881295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5a6e0-e40b-4a5f-9a7e-faa8b8616d8c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.881578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5a6e0-e40b-4a5f-9a7e-faa8b8616d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.881854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5a6e0-e40b-4a5f-9a7e-faa8b8616d8c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.896926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5a6e0-e40b-4a5f-9a7e-faa8b8616d8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:11.898810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5a6e0-e40b-4a5f-9a7e-faa8b8616d8c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:11.916459 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-19b5a6e0-e40b-4a5f-9a7e-faa8b8616d8c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:32:11.917725 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 553/1108] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:11.924295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bb8c8-ce22-431b-a104-edd75145454a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:11.933501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bb8c8-ce22-431b-a104-edd75145454a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:11.938161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300af64-1297-4053-a0cd-cac51d981127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:11.938809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300af64-1297-4053-a0cd-cac51d981127 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.939089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300af64-1297-4053-a0cd-cac51d981127 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.939404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300af64-1297-4053-a0cd-cac51d981127 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.940134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300af64-1297-4053-a0cd-cac51d981127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:11.940437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300af64-1297-4053-a0cd-cac51d981127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:11.942081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300af64-1297-4053-a0cd-cac51d981127 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:11.953249 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 556/1109] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:32:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:11.960016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5a6e0-e40b-4a5f-9a7e-faa8b8616d8c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:11.969485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5a6e0-e40b-4a5f-9a7e-faa8b8616d8c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:11.974611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffa5e9-826f-4348-869f-7351c6474fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:11.975411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffa5e9-826f-4348-869f-7351c6474fef admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:11.975696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffa5e9-826f-4348-869f-7351c6474fef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:11.975969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffa5e9-826f-4348-869f-7351c6474fef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:11.982599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffa5e9-826f-4348-869f-7351c6474fef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:11.984560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffa5e9-826f-4348-869f-7351c6474fef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:11.997099 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-bfffa5e9-826f-4348-869f-7351c6474fef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:32:11.998602 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 554/1110] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:32:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:32:12.004478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300af64-1297-4053-a0cd-cac51d981127 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:12.013954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300af64-1297-4053-a0cd-cac51d981127 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:12.019363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7729b4f-5ce6-4cf3-a69e-9fb751da26ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:12.020001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7729b4f-5ce6-4cf3-a69e-9fb751da26ca admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:12.020785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7729b4f-5ce6-4cf3-a69e-9fb751da26ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:12.021057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7729b4f-5ce6-4cf3-a69e-9fb751da26ca admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:12.021843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7729b4f-5ce6-4cf3-a69e-9fb751da26ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:12.022147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7729b4f-5ce6-4cf3-a69e-9fb751da26ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:12.024012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7729b4f-5ce6-4cf3-a69e-9fb751da26ca admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:12.036441 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 557/1111] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:32:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:12.042752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffa5e9-826f-4348-869f-7351c6474fef admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:12.052981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffa5e9-826f-4348-869f-7351c6474fef admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:12.057436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916984e2-6011-429e-b197-b3bfd4f78d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:12.058065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916984e2-6011-429e-b197-b3bfd4f78d5a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:12.058348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916984e2-6011-429e-b197-b3bfd4f78d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:12.058754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916984e2-6011-429e-b197-b3bfd4f78d5a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:12.059634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916984e2-6011-429e-b197-b3bfd4f78d5a admin admin] RBAC: Adding query filter params (role.id=00be6a1aa54446848af1e63781d879e5, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=aa3373ab52dc4fe680372579cfcde718) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:12.059954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916984e2-6011-429e-b197-b3bfd4f78d5a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:12.061770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916984e2-6011-429e-b197-b3bfd4f78d5a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:12.075291 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 555/1112] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:32:12 2021] GET /identity/v3/role_assignments?user.id=aa3373ab52dc4fe680372579cfcde718&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=00be6a1aa54446848af1e63781d879e5 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:13.146046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0509751-b4b3-40f9-9f6e-b31db6f3ba46 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:13.146580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0509751-b4b3-40f9-9f6e-b31db6f3ba46 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:13.146580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0509751-b4b3-40f9-9f6e-b31db6f3ba46 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:13.148401 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 558/1113] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:13.154111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f29f38-fffb-461e-a0d1-d70b34f5503e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:13.154532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f29f38-fffb-461e-a0d1-d70b34f5503e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:13.154664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f29f38-fffb-461e-a0d1-d70b34f5503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:13.172292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-83f29f38-fffb-461e-a0d1-d70b34f5503e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:13.173460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-83f29f38-fffb-461e-a0d1-d70b34f5503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:13.181634 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 556/1114] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:13.206119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0509751-b4b3-40f9-9f6e-b31db6f3ba46 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:13.218028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0509751-b4b3-40f9-9f6e-b31db6f3ba46 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:13.222514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ca5ca-fd35-4b39-9d2c-b6e00558def3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:13.223822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ca5ca-fd35-4b39-9d2c-b6e00558def3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:13.224101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ca5ca-fd35-4b39-9d2c-b6e00558def3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:13.224367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ca5ca-fd35-4b39-9d2c-b6e00558def3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:13.234200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ca5ca-fd35-4b39-9d2c-b6e00558def3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:13.241456 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-061ca5ca-fd35-4b39-9d2c-b6e00558def3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:32:13.242571 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 559/1115] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:32:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:13.248879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f29f38-fffb-461e-a0d1-d70b34f5503e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:13.257530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f29f38-fffb-461e-a0d1-d70b34f5503e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:13.262048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfafc6-3f08-47f3-b53e-89d978664c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:13.262689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfafc6-3f08-47f3-b53e-89d978664c56 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:13.262968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfafc6-3f08-47f3-b53e-89d978664c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:13.263240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfafc6-3f08-47f3-b53e-89d978664c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:13.264033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfafc6-3f08-47f3-b53e-89d978664c56 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:13.264336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfafc6-3f08-47f3-b53e-89d978664c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:13.266527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfafc6-3f08-47f3-b53e-89d978664c56 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:13.275172 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 557/1116] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:32:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:13.281430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ca5ca-fd35-4b39-9d2c-b6e00558def3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:13.291898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ca5ca-fd35-4b39-9d2c-b6e00558def3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:13.296257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11f8fd-5109-4367-859d-47d4c2901dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:13.297074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f8fd-5109-4367-859d-47d4c2901dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:13.297348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f8fd-5109-4367-859d-47d4c2901dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:13.297613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f8fd-5109-4367-859d-47d4c2901dd6 admin admin] PATH_INFO: `/v3/users/4f3d41a3e7d94aef8590439298676a8e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:13.298780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11f8fd-5109-4367-859d-47d4c2901dd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=4f3d41a3e7d94aef8590439298676a8e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:13.300921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11f8fd-5109-4367-859d-47d4c2901dd6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:13.302478 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 560/1117] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:13 2021] GET /identity/v3/users/4f3d41a3e7d94aef8590439298676a8e => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:13.308108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfafc6-3f08-47f3-b53e-89d978664c56 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:13.317268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfafc6-3f08-47f3-b53e-89d978664c56 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:13.321739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910031f-a269-4eba-a910-eb122bfe5834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:13.322562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910031f-a269-4eba-a910-eb122bfe5834 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:13.322844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910031f-a269-4eba-a910-eb122bfe5834 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:13.323120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910031f-a269-4eba-a910-eb122bfe5834 admin admin] PATH_INFO: `/v3/projects/1d08ed5c7c0642f9baa01c211b161006` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:13.324321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910031f-a269-4eba-a910-eb122bfe5834 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d08ed5c7c0642f9baa01c211b161006)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:13.326321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910031f-a269-4eba-a910-eb122bfe5834 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:13.328057 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 558/1118] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:13 2021] GET /identity/v3/projects/1d08ed5c7c0642f9baa01c211b161006 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:13.334038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11f8fd-5109-4367-859d-47d4c2901dd6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:13.342997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11f8fd-5109-4367-859d-47d4c2901dd6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:13.347407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a95060-1568-478f-9b75-2a18297de3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:13.348804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a95060-1568-478f-9b75-2a18297de3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:13.349079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a95060-1568-478f-9b75-2a18297de3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:13.349347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a95060-1568-478f-9b75-2a18297de3f1 admin admin] PATH_INFO: `/v3/projects/1d08ed5c7c0642f9baa01c211b161006/users/4f3d41a3e7d94aef8590439298676a8e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:13.351269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a95060-1568-478f-9b75-2a18297de3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d08ed5c7c0642f9baa01c211b161006, user_id=4f3d41a3e7d94aef8590439298676a8e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:13.353814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a95060-1568-478f-9b75-2a18297de3f1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:13.365922 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 561/1119] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:32:13 2021] PUT /identity/v3/projects/1d08ed5c7c0642f9baa01c211b161006/users/4f3d41a3e7d94aef8590439298676a8e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:32:15.738375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98682120-a510-4aa4-b936-0a9870a8d7b4 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:15.738878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98682120-a510-4aa4-b936-0a9870a8d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:15.738878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98682120-a510-4aa4-b936-0a9870a8d7b4 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:15.740709 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 559/1120] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:15.746792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f9704-4bc1-42d0-b7a4-2b50cf9e6c29 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:15.747199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f9704-4bc1-42d0-b7a4-2b50cf9e6c29 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:15.747366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f9704-4bc1-42d0-b7a4-2b50cf9e6c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:15.764759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0f1f9704-4bc1-42d0-b7a4-2b50cf9e6c29 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:15.765933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0f1f9704-4bc1-42d0-b7a4-2b50cf9e6c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:15.821405 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 562/1121] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:15.848341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98682120-a510-4aa4-b936-0a9870a8d7b4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:15.860802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98682120-a510-4aa4-b936-0a9870a8d7b4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:15.865062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e595ee6-a17c-410c-bb04-f7611f0e9580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:15.865817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e595ee6-a17c-410c-bb04-f7611f0e9580 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:15.866092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e595ee6-a17c-410c-bb04-f7611f0e9580 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:15.866362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e595ee6-a17c-410c-bb04-f7611f0e9580 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:15.876388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e595ee6-a17c-410c-bb04-f7611f0e9580 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:15.883584 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-4e595ee6-a17c-410c-bb04-f7611f0e9580 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:32:15.884696 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 560/1122] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:32:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:15.891036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f9704-4bc1-42d0-b7a4-2b50cf9e6c29 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:15.900418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f9704-4bc1-42d0-b7a4-2b50cf9e6c29 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:15.904884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f9c7d-c6cf-4ac2-a100-c2942a8f6f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:15.905528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f9c7d-c6cf-4ac2-a100-c2942a8f6f11 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:15.905811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f9c7d-c6cf-4ac2-a100-c2942a8f6f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:15.906087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f9c7d-c6cf-4ac2-a100-c2942a8f6f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:15.906849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f9c7d-c6cf-4ac2-a100-c2942a8f6f11 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:15.907155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f9c7d-c6cf-4ac2-a100-c2942a8f6f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:15.908800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f9c7d-c6cf-4ac2-a100-c2942a8f6f11 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:15.916963 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 563/1123] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:32:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:15.922825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e595ee6-a17c-410c-bb04-f7611f0e9580 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:15.932415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e595ee6-a17c-410c-bb04-f7611f0e9580 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:15.936747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737381f-da4d-4f2f-9898-1f47cb83226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:15.937552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737381f-da4d-4f2f-9898-1f47cb83226e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:15.937829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737381f-da4d-4f2f-9898-1f47cb83226e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:15.938096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737381f-da4d-4f2f-9898-1f47cb83226e admin admin] PATH_INFO: `/v3/users/4f3d41a3e7d94aef8590439298676a8e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:15.939274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737381f-da4d-4f2f-9898-1f47cb83226e admin admin] RBAC: Authorizing `identity:get_user(user_id=4f3d41a3e7d94aef8590439298676a8e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:15.941383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737381f-da4d-4f2f-9898-1f47cb83226e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:15.943403 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 561/1124] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:15 2021] GET /identity/v3/users/4f3d41a3e7d94aef8590439298676a8e => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:15.948959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f9c7d-c6cf-4ac2-a100-c2942a8f6f11 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:15.958775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f9c7d-c6cf-4ac2-a100-c2942a8f6f11 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:15.963209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d49fc-d8c8-4e3e-a665-09148827d25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:15.963841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d49fc-d8c8-4e3e-a665-09148827d25d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:15.964122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d49fc-d8c8-4e3e-a665-09148827d25d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:15.964396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d49fc-d8c8-4e3e-a665-09148827d25d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:15.971893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d49fc-d8c8-4e3e-a665-09148827d25d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:15.973577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d49fc-d8c8-4e3e-a665-09148827d25d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:15.982126 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 564/1125] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:15 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:32:15.987771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737381f-da4d-4f2f-9898-1f47cb83226e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:15.996806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737381f-da4d-4f2f-9898-1f47cb83226e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:16.001403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded9054-724b-4b06-bf7f-ca9b432fc175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:16.002154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded9054-724b-4b06-bf7f-ca9b432fc175 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:16.002428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded9054-724b-4b06-bf7f-ca9b432fc175 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:16.002696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded9054-724b-4b06-bf7f-ca9b432fc175 admin admin] PATH_INFO: `/v3/projects/1d08ed5c7c0642f9baa01c211b161006` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:16.003861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded9054-724b-4b06-bf7f-ca9b432fc175 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d08ed5c7c0642f9baa01c211b161006)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:16.006317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded9054-724b-4b06-bf7f-ca9b432fc175 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:16.007907 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 562/1126] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:15 2021] GET /identity/v3/projects/1d08ed5c7c0642f9baa01c211b161006 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:16.013835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d49fc-d8c8-4e3e-a665-09148827d25d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:16.022971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d49fc-d8c8-4e3e-a665-09148827d25d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:16.027476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37e953-a214-406e-af03-44ec9ea693d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:16.028085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37e953-a214-406e-af03-44ec9ea693d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:16.028369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37e953-a214-406e-af03-44ec9ea693d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:16.028642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37e953-a214-406e-af03-44ec9ea693d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:16.029462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37e953-a214-406e-af03-44ec9ea693d9 admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=1d08ed5c7c0642f9baa01c211b161006, user.id=4f3d41a3e7d94aef8590439298676a8e) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:16.029770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37e953-a214-406e-af03-44ec9ea693d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:16.031587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37e953-a214-406e-af03-44ec9ea693d9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:16.037141 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 565/1127] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:32:16 2021] GET /identity/v3/role_assignments?user.id=4f3d41a3e7d94aef8590439298676a8e&scope.project.id=1d08ed5c7c0642f9baa01c211b161006&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:18.467117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400b081-508d-42ff-8969-f979610846a3 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:18.467611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400b081-508d-42ff-8969-f979610846a3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:18.467701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400b081-508d-42ff-8969-f979610846a3 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:18.469435 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 563/1128] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:18.475085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400753b9-3d02-4ed0-9120-884ffce3d546 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:18.475527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400753b9-3d02-4ed0-9120-884ffce3d546 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:18.475680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400753b9-3d02-4ed0-9120-884ffce3d546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:18.493359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-400753b9-3d02-4ed0-9120-884ffce3d546 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:18.494539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-400753b9-3d02-4ed0-9120-884ffce3d546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:18.502410 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 566/1129] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:18.529768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400b081-508d-42ff-8969-f979610846a3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:18.541691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400b081-508d-42ff-8969-f979610846a3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:18.545909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3aa6f6-b820-46dd-97cc-8123fc33c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:18.546664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa6f6-b820-46dd-97cc-8123fc33c266 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:18.546940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa6f6-b820-46dd-97cc-8123fc33c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:18.547206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3aa6f6-b820-46dd-97cc-8123fc33c266 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:18.548656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3aa6f6-b820-46dd-97cc-8123fc33c266 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:18.550316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3aa6f6-b820-46dd-97cc-8123fc33c266 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:18.552410 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 564/1130] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:18.558480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400753b9-3d02-4ed0-9120-884ffce3d546 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:18.567997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400753b9-3d02-4ed0-9120-884ffce3d546 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:18.572438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae7bbe-7f6e-4f18-9a8c-6f2212d7bb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:18.573086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7bbe-7f6e-4f18-9a8c-6f2212d7bb53 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:18.573370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7bbe-7f6e-4f18-9a8c-6f2212d7bb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:18.573644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7bbe-7f6e-4f18-9a8c-6f2212d7bb53 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:18.574364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae7bbe-7f6e-4f18-9a8c-6f2212d7bb53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:18.576325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae7bbe-7f6e-4f18-9a8c-6f2212d7bb53 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:18.595700 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 567/1131] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:32:18 2021] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:32:21.017397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39917f9-1071-4b4a-adf6-f26f045d2c5d None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:21.017970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39917f9-1071-4b4a-adf6-f26f045d2c5d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:21.017970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39917f9-1071-4b4a-adf6-f26f045d2c5d None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:21.019946 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 565/1132] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:21.025820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04c91b-6b2a-4692-a368-5abf5c958490 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:21.026257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04c91b-6b2a-4692-a368-5abf5c958490 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:21.026350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04c91b-6b2a-4692-a368-5abf5c958490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:21.044148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5f04c91b-6b2a-4692-a368-5abf5c958490 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:21.045310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5f04c91b-6b2a-4692-a368-5abf5c958490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:21.053318 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 568/1133] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:21.079374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39917f9-1071-4b4a-adf6-f26f045d2c5d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:21.091178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39917f9-1071-4b4a-adf6-f26f045d2c5d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:21.095487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faa506-d924-48ea-bc64-8566b2cd065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:21.096301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faa506-d924-48ea-bc64-8566b2cd065c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:21.096584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faa506-d924-48ea-bc64-8566b2cd065c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:21.096856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faa506-d924-48ea-bc64-8566b2cd065c admin admin] PATH_INFO: `/v3/roles/9a635e239d2c4df7972fb54b7ed42aa6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:21.098351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faa506-d924-48ea-bc64-8566b2cd065c admin admin] RBAC: Authorizing `identity:get_role(role_id=9a635e239d2c4df7972fb54b7ed42aa6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:21.099375 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-19faa506-d924-48ea-bc64-8566b2cd065c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:32:21.099375 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:32:21.099375 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:32:21.100242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faa506-d924-48ea-bc64-8566b2cd065c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:21.101521 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 566/1134] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:21 2021] GET /identity/v3/roles/9a635e239d2c4df7972fb54b7ed42aa6 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:21.107243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04c91b-6b2a-4692-a368-5abf5c958490 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:21.116301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04c91b-6b2a-4692-a368-5abf5c958490 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:21.120669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea8339-0d32-4736-a66f-d30666a0889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:21.121493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8339-0d32-4736-a66f-d30666a0889f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:21.121769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8339-0d32-4736-a66f-d30666a0889f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:21.122037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea8339-0d32-4736-a66f-d30666a0889f admin admin] PATH_INFO: `/v3/users/cc6f0b60b91c493f8a16b6a229c10898` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:21.135655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea8339-0d32-4736-a66f-d30666a0889f admin admin] RBAC: Authorizing `identity:get_user(user_id=cc6f0b60b91c493f8a16b6a229c10898)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:21.137761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea8339-0d32-4736-a66f-d30666a0889f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:21.139327 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 569/1135] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:21 2021] GET /identity/v3/users/cc6f0b60b91c493f8a16b6a229c10898 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:21.145155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faa506-d924-48ea-bc64-8566b2cd065c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:21.154301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faa506-d924-48ea-bc64-8566b2cd065c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:21.158690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203e8e0-209e-4af3-8745-892feda7283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:21.159323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203e8e0-209e-4af3-8745-892feda7283e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:21.159608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203e8e0-209e-4af3-8745-892feda7283e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:21.159882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203e8e0-209e-4af3-8745-892feda7283e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:21.167955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203e8e0-209e-4af3-8745-892feda7283e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:21.169661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203e8e0-209e-4af3-8745-892feda7283e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:21.178796 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 567/1136] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:21 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:32:21.184601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea8339-0d32-4736-a66f-d30666a0889f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:21.193606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea8339-0d32-4736-a66f-d30666a0889f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:21.197942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e5c49-52d0-4ab3-ae3b-4fc45c0258c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:21.198731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e5c49-52d0-4ab3-ae3b-4fc45c0258c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:21.199009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e5c49-52d0-4ab3-ae3b-4fc45c0258c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:21.199301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e5c49-52d0-4ab3-ae3b-4fc45c0258c3 admin admin] PATH_INFO: `/v3/projects/1d08ed5c7c0642f9baa01c211b161006` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:21.200429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e5c49-52d0-4ab3-ae3b-4fc45c0258c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d08ed5c7c0642f9baa01c211b161006)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:21.202382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e5c49-52d0-4ab3-ae3b-4fc45c0258c3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:21.203983 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 570/1137] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:21 2021] GET /identity/v3/projects/1d08ed5c7c0642f9baa01c211b161006 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:21.209883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203e8e0-209e-4af3-8745-892feda7283e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:21.218082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203e8e0-209e-4af3-8745-892feda7283e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:21.222514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1a724-f0bf-4643-9ed7-1c415df15e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:21.223643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a724-f0bf-4643-9ed7-1c415df15e78 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:21.223919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a724-f0bf-4643-9ed7-1c415df15e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:21.224187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1a724-f0bf-4643-9ed7-1c415df15e78 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:21.224986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1a724-f0bf-4643-9ed7-1c415df15e78 admin admin] RBAC: Adding query filter params (role.id=9a635e239d2c4df7972fb54b7ed42aa6, scope.project.id=1d08ed5c7c0642f9baa01c211b161006, user.id=cc6f0b60b91c493f8a16b6a229c10898) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:21.225287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1a724-f0bf-4643-9ed7-1c415df15e78 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:21.227039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1a724-f0bf-4643-9ed7-1c415df15e78 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:21.232150 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 568/1138] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:32:21 2021] GET /identity/v3/role_assignments?user.id=cc6f0b60b91c493f8a16b6a229c10898&scope.project.id=1d08ed5c7c0642f9baa01c211b161006&role.id=9a635e239d2c4df7972fb54b7ed42aa6 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:23.617513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81cf4d-d0ed-4469-84ab-9919801379f0 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:23.618103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81cf4d-d0ed-4469-84ab-9919801379f0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:23.618103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81cf4d-d0ed-4469-84ab-9919801379f0 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:23.619844 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 571/1139] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:23.625800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9977b8-6a80-42cd-99c9-989d74a02f06 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:23.626222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9977b8-6a80-42cd-99c9-989d74a02f06 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:23.626356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9977b8-6a80-42cd-99c9-989d74a02f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:23.643943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9c9977b8-6a80-42cd-99c9-989d74a02f06 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:23.645699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9c9977b8-6a80-42cd-99c9-989d74a02f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:23.653358 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 569/1140] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:23.677678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81cf4d-d0ed-4469-84ab-9919801379f0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:23.689558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81cf4d-d0ed-4469-84ab-9919801379f0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:23.694386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496290b-99b6-4e86-98a6-cba8d3d02cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:23.695201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496290b-99b6-4e86-98a6-cba8d3d02cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:23.695511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496290b-99b6-4e86-98a6-cba8d3d02cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:23.695836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496290b-99b6-4e86-98a6-cba8d3d02cb0 admin admin] PATH_INFO: `/v3/roles/9a635e239d2c4df7972fb54b7ed42aa6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:23.697245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496290b-99b6-4e86-98a6-cba8d3d02cb0 admin admin] RBAC: Authorizing `identity:get_role(role_id=9a635e239d2c4df7972fb54b7ed42aa6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:23.698248 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-c496290b-99b6-4e86-98a6-cba8d3d02cb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:32:23.698248 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:32:23.698248 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:32:23.699148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496290b-99b6-4e86-98a6-cba8d3d02cb0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:23.700473 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 572/1141] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:23 2021] GET /identity/v3/roles/9a635e239d2c4df7972fb54b7ed42aa6 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:23.706242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9977b8-6a80-42cd-99c9-989d74a02f06 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:23.715511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9977b8-6a80-42cd-99c9-989d74a02f06 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:23.719932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3414f-2b75-4720-9d3d-0495a196cf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:23.720793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3414f-2b75-4720-9d3d-0495a196cf88 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:23.721073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3414f-2b75-4720-9d3d-0495a196cf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:23.721346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3414f-2b75-4720-9d3d-0495a196cf88 admin admin] PATH_INFO: `/v3/users/cc6f0b60b91c493f8a16b6a229c10898` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:23.722539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3414f-2b75-4720-9d3d-0495a196cf88 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc6f0b60b91c493f8a16b6a229c10898)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:23.724663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3414f-2b75-4720-9d3d-0495a196cf88 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:23.726314 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 570/1142] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:23 2021] GET /identity/v3/users/cc6f0b60b91c493f8a16b6a229c10898 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:23.731777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496290b-99b6-4e86-98a6-cba8d3d02cb0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:23.740938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496290b-99b6-4e86-98a6-cba8d3d02cb0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:23.745325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff54dab-47a5-4976-bc99-1c541191336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:23.746111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff54dab-47a5-4976-bc99-1c541191336b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:23.746391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff54dab-47a5-4976-bc99-1c541191336b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:23.746701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff54dab-47a5-4976-bc99-1c541191336b admin admin] PATH_INFO: `/v3/projects/1d08ed5c7c0642f9baa01c211b161006` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:23.748141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff54dab-47a5-4976-bc99-1c541191336b admin admin] RBAC: Authorizing `identity:get_project(project_id=1d08ed5c7c0642f9baa01c211b161006)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:23.750116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff54dab-47a5-4976-bc99-1c541191336b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:23.751725 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 573/1143] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:23 2021] GET /identity/v3/projects/1d08ed5c7c0642f9baa01c211b161006 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:23.757891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3414f-2b75-4720-9d3d-0495a196cf88 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:23.766873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3414f-2b75-4720-9d3d-0495a196cf88 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:23.771898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955bf27-c3af-4b32-b885-f563987f4c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:23.772719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955bf27-c3af-4b32-b885-f563987f4c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:23.772997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955bf27-c3af-4b32-b885-f563987f4c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:23.773269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955bf27-c3af-4b32-b885-f563987f4c0f admin admin] PATH_INFO: `/v3/projects/1d08ed5c7c0642f9baa01c211b161006/users/cc6f0b60b91c493f8a16b6a229c10898/roles/9a635e239d2c4df7972fb54b7ed42aa6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:23.775455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955bf27-c3af-4b32-b885-f563987f4c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d08ed5c7c0642f9baa01c211b161006, user_id=cc6f0b60b91c493f8a16b6a229c10898, role_id=9a635e239d2c4df7972fb54b7ed42aa6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:23.777981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955bf27-c3af-4b32-b885-f563987f4c0f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:23.790438 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 571/1144] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:32:23 2021] PUT /identity/v3/projects/1d08ed5c7c0642f9baa01c211b161006/users/cc6f0b60b91c493f8a16b6a229c10898/roles/9a635e239d2c4df7972fb54b7ed42aa6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:32:26.182042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a101c0-ce50-4b91-a1f8-9558fe6bb45a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:26.182581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a101c0-ce50-4b91-a1f8-9558fe6bb45a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:26.182581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a101c0-ce50-4b91-a1f8-9558fe6bb45a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:26.184384 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 574/1145] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:26.190182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7821a-4812-4e6e-8325-512cce5e181e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:26.190592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7821a-4812-4e6e-8325-512cce5e181e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:26.190741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7821a-4812-4e6e-8325-512cce5e181e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:26.208506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5cb7821a-4812-4e6e-8325-512cce5e181e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:26.209684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5cb7821a-4812-4e6e-8325-512cce5e181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:26.264636 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 572/1146] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:26.290996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a101c0-ce50-4b91-a1f8-9558fe6bb45a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:26.302777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a101c0-ce50-4b91-a1f8-9558fe6bb45a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:26.306972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b05a7c-80e8-4fd8-bf96-dbceff80bf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:26.307821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b05a7c-80e8-4fd8-bf96-dbceff80bf60 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:26.308098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b05a7c-80e8-4fd8-bf96-dbceff80bf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:26.308366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b05a7c-80e8-4fd8-bf96-dbceff80bf60 admin admin] PATH_INFO: `/v3/roles/9a635e239d2c4df7972fb54b7ed42aa6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:26.309808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b05a7c-80e8-4fd8-bf96-dbceff80bf60 admin admin] RBAC: Authorizing `identity:get_role(role_id=9a635e239d2c4df7972fb54b7ed42aa6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:26.311439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b05a7c-80e8-4fd8-bf96-dbceff80bf60 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:26.312714 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 575/1147] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:26 2021] GET /identity/v3/roles/9a635e239d2c4df7972fb54b7ed42aa6 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:26.318530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7821a-4812-4e6e-8325-512cce5e181e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:26.327118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7821a-4812-4e6e-8325-512cce5e181e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:26.331604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf7a74-6e51-4929-aab6-ade3c7de0d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:26.332925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf7a74-6e51-4929-aab6-ade3c7de0d7f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:26.333204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf7a74-6e51-4929-aab6-ade3c7de0d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:26.333474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf7a74-6e51-4929-aab6-ade3c7de0d7f admin admin] PATH_INFO: `/v3/users/cc6f0b60b91c493f8a16b6a229c10898` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:26.334667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf7a74-6e51-4929-aab6-ade3c7de0d7f admin admin] RBAC: Authorizing `identity:get_user(user_id=cc6f0b60b91c493f8a16b6a229c10898)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:26.336796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf7a74-6e51-4929-aab6-ade3c7de0d7f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:26.338474 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 573/1148] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:26 2021] GET /identity/v3/users/cc6f0b60b91c493f8a16b6a229c10898 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:26.343991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b05a7c-80e8-4fd8-bf96-dbceff80bf60 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:26.353024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b05a7c-80e8-4fd8-bf96-dbceff80bf60 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:26.357448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0905fb-2418-4fdd-b123-fd8e84f093a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:26.358026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0905fb-2418-4fdd-b123-fd8e84f093a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:26.358303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0905fb-2418-4fdd-b123-fd8e84f093a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:26.358573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0905fb-2418-4fdd-b123-fd8e84f093a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:26.366507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0905fb-2418-4fdd-b123-fd8e84f093a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:26.368186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0905fb-2418-4fdd-b123-fd8e84f093a0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:26.377263 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 576/1149] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:26 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:32:26.383580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf7a74-6e51-4929-aab6-ade3c7de0d7f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:26.392675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf7a74-6e51-4929-aab6-ade3c7de0d7f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:26.397121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83517808-f4cf-4f6a-a537-7f2fccb95975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:26.397904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83517808-f4cf-4f6a-a537-7f2fccb95975 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:26.398187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83517808-f4cf-4f6a-a537-7f2fccb95975 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:26.398461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83517808-f4cf-4f6a-a537-7f2fccb95975 admin admin] PATH_INFO: `/v3/projects/1d08ed5c7c0642f9baa01c211b161006` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:26.399654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83517808-f4cf-4f6a-a537-7f2fccb95975 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d08ed5c7c0642f9baa01c211b161006)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:26.401621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83517808-f4cf-4f6a-a537-7f2fccb95975 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:26.403202 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 574/1150] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:26 2021] GET /identity/v3/projects/1d08ed5c7c0642f9baa01c211b161006 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:26.409086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0905fb-2418-4fdd-b123-fd8e84f093a0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:26.417829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0905fb-2418-4fdd-b123-fd8e84f093a0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:26.422211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a002bde-723a-4caa-b12c-44a2a07b861d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:26.422794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a002bde-723a-4caa-b12c-44a2a07b861d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:26.423071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a002bde-723a-4caa-b12c-44a2a07b861d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:26.423380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a002bde-723a-4caa-b12c-44a2a07b861d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:26.424183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a002bde-723a-4caa-b12c-44a2a07b861d admin admin] RBAC: Adding query filter params (role.id=9a635e239d2c4df7972fb54b7ed42aa6, scope.project.id=1d08ed5c7c0642f9baa01c211b161006, user.id=cc6f0b60b91c493f8a16b6a229c10898) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:26.424482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a002bde-723a-4caa-b12c-44a2a07b861d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:26.427059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a002bde-723a-4caa-b12c-44a2a07b861d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:26.432849 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 577/1151] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:32:26 2021] GET /identity/v3/role_assignments?user.id=cc6f0b60b91c493f8a16b6a229c10898&scope.project.id=1d08ed5c7c0642f9baa01c211b161006&role.id=9a635e239d2c4df7972fb54b7ed42aa6 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:28.831011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f0ee9-cd12-495c-ba7c-3540eee270c6 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:28.831683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f0ee9-cd12-495c-ba7c-3540eee270c6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:28.832269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f0ee9-cd12-495c-ba7c-3540eee270c6 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:28.834004 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 575/1152] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:28.839963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62206c2-5346-473d-a0d2-577c0986412e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:28.840384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62206c2-5346-473d-a0d2-577c0986412e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:28.840516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62206c2-5346-473d-a0d2-577c0986412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:28.858426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d62206c2-5346-473d-a0d2-577c0986412e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:28.859686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d62206c2-5346-473d-a0d2-577c0986412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:28.867233 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 578/1153] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:28 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:28.892986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f0ee9-cd12-495c-ba7c-3540eee270c6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:28.906020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f0ee9-cd12-495c-ba7c-3540eee270c6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:28.910247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc919f3-1c5c-4061-b605-fbfe0ef7202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:28.911002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc919f3-1c5c-4061-b605-fbfe0ef7202d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:28.911306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc919f3-1c5c-4061-b605-fbfe0ef7202d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:28.911579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc919f3-1c5c-4061-b605-fbfe0ef7202d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:28.912739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc919f3-1c5c-4061-b605-fbfe0ef7202d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:28.914400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc919f3-1c5c-4061-b605-fbfe0ef7202d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:28.915975 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 576/1154] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:28.922066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62206c2-5346-473d-a0d2-577c0986412e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:28.930847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62206c2-5346-473d-a0d2-577c0986412e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:28.935313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c955df-a31b-4465-a638-02a68edfefbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:28.935953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c955df-a31b-4465-a638-02a68edfefbd admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:28.936235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c955df-a31b-4465-a638-02a68edfefbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:28.936509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c955df-a31b-4465-a638-02a68edfefbd admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:28.937216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c955df-a31b-4465-a638-02a68edfefbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:28.939079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c955df-a31b-4465-a638-02a68edfefbd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:28.964179 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 579/1155] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:32:28 2021] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:32:31.429795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327ec1c-1d7a-4cfa-8250-fd8b245b87f9 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:31.430373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327ec1c-1d7a-4cfa-8250-fd8b245b87f9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:31.430373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327ec1c-1d7a-4cfa-8250-fd8b245b87f9 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:31.432116 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 577/1156] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:31.438148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d686-358f-4c28-87aa-35378c8eb02f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:31.438583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d686-358f-4c28-87aa-35378c8eb02f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:31.438684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d686-358f-4c28-87aa-35378c8eb02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:31.457002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3b27d686-358f-4c28-87aa-35378c8eb02f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:31.458179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3b27d686-358f-4c28-87aa-35378c8eb02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:31.513271 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 580/1157] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:31.540672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327ec1c-1d7a-4cfa-8250-fd8b245b87f9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:31.553123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327ec1c-1d7a-4cfa-8250-fd8b245b87f9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:31.557489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019352b6-1f67-4042-8271-bb8154ceefa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:31.558240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019352b6-1f67-4042-8271-bb8154ceefa3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:31.558556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019352b6-1f67-4042-8271-bb8154ceefa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:31.558835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019352b6-1f67-4042-8271-bb8154ceefa3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:31.560048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019352b6-1f67-4042-8271-bb8154ceefa3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:31.561720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019352b6-1f67-4042-8271-bb8154ceefa3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:31.563243 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 578/1158] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:32:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:31.569715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27d686-358f-4c28-87aa-35378c8eb02f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:31.578384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27d686-358f-4c28-87aa-35378c8eb02f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:31.582828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a9e2f-70c1-47f8-a874-b1f6e0a65b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:31.583491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9e2f-70c1-47f8-a874-b1f6e0a65b73 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:31.583770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9e2f-70c1-47f8-a874-b1f6e0a65b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:31.584049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a9e2f-70c1-47f8-a874-b1f6e0a65b73 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:31.584752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a9e2f-70c1-47f8-a874-b1f6e0a65b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:31.586667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a9e2f-70c1-47f8-a874-b1f6e0a65b73 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:31.605901 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 581/1159] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:32:31 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:32:34.037754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9a13-4d1f-4732-b390-0dd6fdb23806 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:34.038327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9a13-4d1f-4732-b390-0dd6fdb23806 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:34.038327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9a13-4d1f-4732-b390-0dd6fdb23806 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:34.040081 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 579/1160] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:34.045745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3677e85-7714-4636-9fbc-b645609748a6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:34.046178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3677e85-7714-4636-9fbc-b645609748a6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:34.046281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3677e85-7714-4636-9fbc-b645609748a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:34.063482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f3677e85-7714-4636-9fbc-b645609748a6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:34.064640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f3677e85-7714-4636-9fbc-b645609748a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:34.072616 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 582/1161] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:34.098331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c9a13-4d1f-4732-b390-0dd6fdb23806 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:34.115163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c9a13-4d1f-4732-b390-0dd6fdb23806 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:34.119761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a227c9-3606-4401-99a4-568d3d1a69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:34.120528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a227c9-3606-4401-99a4-568d3d1a69e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:34.120803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a227c9-3606-4401-99a4-568d3d1a69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:34.121069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a227c9-3606-4401-99a4-568d3d1a69e9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:34.131746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a227c9-3606-4401-99a4-568d3d1a69e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:34.138399 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-96a227c9-3606-4401-99a4-568d3d1a69e9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:32:34.139592 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 580/1162] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:32:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:34.146814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3677e85-7714-4636-9fbc-b645609748a6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:34.155732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3677e85-7714-4636-9fbc-b645609748a6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:34.160283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945db6c-d9d9-430a-86e2-53676405e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:34.160928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945db6c-d9d9-430a-86e2-53676405e9bf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:34.161211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945db6c-d9d9-430a-86e2-53676405e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:34.161486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945db6c-d9d9-430a-86e2-53676405e9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:34.162240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945db6c-d9d9-430a-86e2-53676405e9bf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:34.162545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945db6c-d9d9-430a-86e2-53676405e9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:34.164172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945db6c-d9d9-430a-86e2-53676405e9bf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:34.172166 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 583/1163] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:32:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:34.178007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a227c9-3606-4401-99a4-568d3d1a69e9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:34.187830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a227c9-3606-4401-99a4-568d3d1a69e9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:34.192892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa7169-d608-42f7-8292-7904a2a45468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:34.193705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa7169-d608-42f7-8292-7904a2a45468 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:34.193985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa7169-d608-42f7-8292-7904a2a45468 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:34.194257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa7169-d608-42f7-8292-7904a2a45468 admin admin] PATH_INFO: `/v3/users/fec44553cb7043e8906763e273a81ad0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:34.207298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa7169-d608-42f7-8292-7904a2a45468 admin admin] RBAC: Authorizing `identity:get_user(user_id=fec44553cb7043e8906763e273a81ad0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:34.209395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa7169-d608-42f7-8292-7904a2a45468 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:34.210948 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 581/1164] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:34 2021] GET /identity/v3/users/fec44553cb7043e8906763e273a81ad0 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:34.216833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945db6c-d9d9-430a-86e2-53676405e9bf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:34.226345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945db6c-d9d9-430a-86e2-53676405e9bf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:34.230834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a84ff-ddff-43f6-a911-22d54fd4a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:34.231484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a84ff-ddff-43f6-a911-22d54fd4a41e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:34.231772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a84ff-ddff-43f6-a911-22d54fd4a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:34.232051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a84ff-ddff-43f6-a911-22d54fd4a41e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:34.239704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a84ff-ddff-43f6-a911-22d54fd4a41e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:34.241426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a84ff-ddff-43f6-a911-22d54fd4a41e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:34.250289 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 584/1165] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:34 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:32:34.256509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa7169-d608-42f7-8292-7904a2a45468 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:34.265512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa7169-d608-42f7-8292-7904a2a45468 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:34.270600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ef114-5298-4dcd-9391-4c8b767d23b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:34.271428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef114-5298-4dcd-9391-4c8b767d23b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:34.271710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef114-5298-4dcd-9391-4c8b767d23b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:34.271984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef114-5298-4dcd-9391-4c8b767d23b8 admin admin] PATH_INFO: `/v3/projects/f08405d8ce4a441ea41f1527581c7eee` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:34.273142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ef114-5298-4dcd-9391-4c8b767d23b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=f08405d8ce4a441ea41f1527581c7eee)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:34.275092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ef114-5298-4dcd-9391-4c8b767d23b8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:34.276703 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 582/1166] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:34 2021] GET /identity/v3/projects/f08405d8ce4a441ea41f1527581c7eee => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:34.282760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a84ff-ddff-43f6-a911-22d54fd4a41e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:34.291227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a84ff-ddff-43f6-a911-22d54fd4a41e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:34.295689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0026e-7b78-4756-9a21-f77d258a09fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:34.296290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0026e-7b78-4756-9a21-f77d258a09fc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:34.296575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0026e-7b78-4756-9a21-f77d258a09fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:34.296852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0026e-7b78-4756-9a21-f77d258a09fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:34.297665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0026e-7b78-4756-9a21-f77d258a09fc admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=f08405d8ce4a441ea41f1527581c7eee, user.id=fec44553cb7043e8906763e273a81ad0) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:34.297974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0026e-7b78-4756-9a21-f77d258a09fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:34.299786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0026e-7b78-4756-9a21-f77d258a09fc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:34.305483 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 585/1167] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:32:34 2021] GET /identity/v3/role_assignments?user.id=fec44553cb7043e8906763e273a81ad0&scope.project.id=f08405d8ce4a441ea41f1527581c7eee&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:36.663274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78352e3-22f9-494a-8276-a123a8db46e6 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:36.663795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78352e3-22f9-494a-8276-a123a8db46e6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:36.663795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78352e3-22f9-494a-8276-a123a8db46e6 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:36.665556 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 583/1168] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:36.671233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c51a1-9f70-44d7-90e9-b75f6446c92d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:36.671651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c51a1-9f70-44d7-90e9-b75f6446c92d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:36.671821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c51a1-9f70-44d7-90e9-b75f6446c92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:36.690005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-935c51a1-9f70-44d7-90e9-b75f6446c92d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:36.691810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-935c51a1-9f70-44d7-90e9-b75f6446c92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:36.699401 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 586/1169] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:36.723594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78352e3-22f9-494a-8276-a123a8db46e6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:36.735457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78352e3-22f9-494a-8276-a123a8db46e6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:36.740224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b21768-1911-43d2-9c9e-940049ee1170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:36.740979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b21768-1911-43d2-9c9e-940049ee1170 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:36.741256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b21768-1911-43d2-9c9e-940049ee1170 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:36.741523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b21768-1911-43d2-9c9e-940049ee1170 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:36.751499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b21768-1911-43d2-9c9e-940049ee1170 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:36.758745 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-15b21768-1911-43d2-9c9e-940049ee1170 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:32:36.759886 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 584/1170] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:32:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:36.765884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c51a1-9f70-44d7-90e9-b75f6446c92d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:36.774750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c51a1-9f70-44d7-90e9-b75f6446c92d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:36.779128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084f2b4-5e29-4a12-8eff-726a5b796982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:36.779803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f2b4-5e29-4a12-8eff-726a5b796982 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:36.780083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f2b4-5e29-4a12-8eff-726a5b796982 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:36.780356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084f2b4-5e29-4a12-8eff-726a5b796982 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:36.781102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084f2b4-5e29-4a12-8eff-726a5b796982 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:36.781405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084f2b4-5e29-4a12-8eff-726a5b796982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:36.782983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084f2b4-5e29-4a12-8eff-726a5b796982 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:36.791101 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 587/1171] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:32:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:36.796901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b21768-1911-43d2-9c9e-940049ee1170 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:36.807085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b21768-1911-43d2-9c9e-940049ee1170 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:36.811510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891a33-2022-46e5-aa14-5d2df23a3449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:36.812318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891a33-2022-46e5-aa14-5d2df23a3449 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:36.812591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891a33-2022-46e5-aa14-5d2df23a3449 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:36.812857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891a33-2022-46e5-aa14-5d2df23a3449 admin admin] PATH_INFO: `/v3/users/fec44553cb7043e8906763e273a81ad0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:36.814025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891a33-2022-46e5-aa14-5d2df23a3449 admin admin] RBAC: Authorizing `identity:get_user(user_id=fec44553cb7043e8906763e273a81ad0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:36.816734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891a33-2022-46e5-aa14-5d2df23a3449 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:36.818243 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 585/1172] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:36 2021] GET /identity/v3/users/fec44553cb7043e8906763e273a81ad0 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:36.823924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084f2b4-5e29-4a12-8eff-726a5b796982 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:36.833030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084f2b4-5e29-4a12-8eff-726a5b796982 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:36.837448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e8cf9-053f-41ce-a643-902af48f3664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:36.838248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8cf9-053f-41ce-a643-902af48f3664 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:36.838531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8cf9-053f-41ce-a643-902af48f3664 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:36.838805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8cf9-053f-41ce-a643-902af48f3664 admin admin] PATH_INFO: `/v3/projects/f08405d8ce4a441ea41f1527581c7eee` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:36.839961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e8cf9-053f-41ce-a643-902af48f3664 admin admin] RBAC: Authorizing `identity:get_project(project_id=f08405d8ce4a441ea41f1527581c7eee)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:36.841961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e8cf9-053f-41ce-a643-902af48f3664 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:36.843571 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 588/1173] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:36 2021] GET /identity/v3/projects/f08405d8ce4a441ea41f1527581c7eee => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:36.849183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891a33-2022-46e5-aa14-5d2df23a3449 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:36.858067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891a33-2022-46e5-aa14-5d2df23a3449 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:36.862905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba8b56-a40d-4d2f-b14a-8e024b874ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:36.863745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8b56-a40d-4d2f-b14a-8e024b874ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:36.864019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8b56-a40d-4d2f-b14a-8e024b874ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:36.864285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba8b56-a40d-4d2f-b14a-8e024b874ee3 admin admin] PATH_INFO: `/v3/projects/f08405d8ce4a441ea41f1527581c7eee/users/fec44553cb7043e8906763e273a81ad0/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:36.866184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba8b56-a40d-4d2f-b14a-8e024b874ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08405d8ce4a441ea41f1527581c7eee, user_id=fec44553cb7043e8906763e273a81ad0, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:36.868737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba8b56-a40d-4d2f-b14a-8e024b874ee3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:36.881909 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 586/1174] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:32:36 2021] PUT /identity/v3/projects/f08405d8ce4a441ea41f1527581c7eee/users/fec44553cb7043e8906763e273a81ad0/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:32:39.247523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609afb9-218c-4b21-b2b0-d052caceba21 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:39.248059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609afb9-218c-4b21-b2b0-d052caceba21 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:39.248059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609afb9-218c-4b21-b2b0-d052caceba21 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:39.249835 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 589/1175] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:39.255697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621294-87de-4cc1-97cc-9c153a14304a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:39.256088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621294-87de-4cc1-97cc-9c153a14304a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:39.256243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9621294-87de-4cc1-97cc-9c153a14304a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:39.273345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b9621294-87de-4cc1-97cc-9c153a14304a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:39.274509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b9621294-87de-4cc1-97cc-9c153a14304a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:39.328084 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 587/1176] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:39.353522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609afb9-218c-4b21-b2b0-d052caceba21 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:39.366005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609afb9-218c-4b21-b2b0-d052caceba21 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:39.370338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e7c65-4729-4c1f-84f0-07e3400ec589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:39.371093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7c65-4729-4c1f-84f0-07e3400ec589 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:39.371415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7c65-4729-4c1f-84f0-07e3400ec589 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:39.371689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7c65-4729-4c1f-84f0-07e3400ec589 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:39.381924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e7c65-4729-4c1f-84f0-07e3400ec589 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:39.388628 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-329e7c65-4729-4c1f-84f0-07e3400ec589 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:32:39.389747 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 590/1177] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:32:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:39.396308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9621294-87de-4cc1-97cc-9c153a14304a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:39.404995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9621294-87de-4cc1-97cc-9c153a14304a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:39.409975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd8aff-1b2d-4ec1-99e3-61415ac02f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:39.410614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8aff-1b2d-4ec1-99e3-61415ac02f7e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:39.410889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8aff-1b2d-4ec1-99e3-61415ac02f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:39.411155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8aff-1b2d-4ec1-99e3-61415ac02f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:39.411935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8aff-1b2d-4ec1-99e3-61415ac02f7e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:39.412237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8aff-1b2d-4ec1-99e3-61415ac02f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:39.413796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8aff-1b2d-4ec1-99e3-61415ac02f7e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:39.421722 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 588/1178] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:32:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:39.428185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e7c65-4729-4c1f-84f0-07e3400ec589 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:39.438089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e7c65-4729-4c1f-84f0-07e3400ec589 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:39.442612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ca9cd-20e9-4805-830c-c19f80ce4df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:39.443469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ca9cd-20e9-4805-830c-c19f80ce4df6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:39.443754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ca9cd-20e9-4805-830c-c19f80ce4df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:39.444023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ca9cd-20e9-4805-830c-c19f80ce4df6 admin admin] PATH_INFO: `/v3/users/fec44553cb7043e8906763e273a81ad0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:39.445209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ca9cd-20e9-4805-830c-c19f80ce4df6 admin admin] RBAC: Authorizing `identity:get_user(user_id=fec44553cb7043e8906763e273a81ad0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:39.447343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ca9cd-20e9-4805-830c-c19f80ce4df6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:39.448886 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 591/1179] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:39 2021] GET /identity/v3/users/fec44553cb7043e8906763e273a81ad0 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:39.454794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd8aff-1b2d-4ec1-99e3-61415ac02f7e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:39.464352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd8aff-1b2d-4ec1-99e3-61415ac02f7e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:39.468753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aaff5-84e4-43fb-984d-3462ebe8b229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:39.469371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aaff5-84e4-43fb-984d-3462ebe8b229 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:39.469651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aaff5-84e4-43fb-984d-3462ebe8b229 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:39.469924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aaff5-84e4-43fb-984d-3462ebe8b229 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:39.477790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aaff5-84e4-43fb-984d-3462ebe8b229 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:39.479527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aaff5-84e4-43fb-984d-3462ebe8b229 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:39.488613 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 589/1180] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:32:39.494511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ca9cd-20e9-4805-830c-c19f80ce4df6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:39.504095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ca9cd-20e9-4805-830c-c19f80ce4df6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:39.508547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b047bd-d613-4fee-99cd-9bc71247aae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:39.509350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b047bd-d613-4fee-99cd-9bc71247aae8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:39.509632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b047bd-d613-4fee-99cd-9bc71247aae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:39.509905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b047bd-d613-4fee-99cd-9bc71247aae8 admin admin] PATH_INFO: `/v3/projects/f08405d8ce4a441ea41f1527581c7eee` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:39.511064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b047bd-d613-4fee-99cd-9bc71247aae8 admin admin] RBAC: Authorizing `identity:get_project(project_id=f08405d8ce4a441ea41f1527581c7eee)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:39.513147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b047bd-d613-4fee-99cd-9bc71247aae8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:39.514752 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 592/1181] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:39 2021] GET /identity/v3/projects/f08405d8ce4a441ea41f1527581c7eee => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:39.521353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aaff5-84e4-43fb-984d-3462ebe8b229 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:39.529735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aaff5-84e4-43fb-984d-3462ebe8b229 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:39.534737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c33dfd-47e9-48db-b91e-51056fd7026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:39.535373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c33dfd-47e9-48db-b91e-51056fd7026d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:39.535657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c33dfd-47e9-48db-b91e-51056fd7026d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:39.535949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c33dfd-47e9-48db-b91e-51056fd7026d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:39.536837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c33dfd-47e9-48db-b91e-51056fd7026d admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=f08405d8ce4a441ea41f1527581c7eee, user.id=fec44553cb7043e8906763e273a81ad0) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:39.537195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c33dfd-47e9-48db-b91e-51056fd7026d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:39.539121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c33dfd-47e9-48db-b91e-51056fd7026d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:39.544857 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 590/1182] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:32:39 2021] GET /identity/v3/role_assignments?user.id=fec44553cb7043e8906763e273a81ad0&scope.project.id=f08405d8ce4a441ea41f1527581c7eee&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:41.932495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eb8db-d9a2-4d98-bfc2-1cc561589032 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:41.933055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eb8db-d9a2-4d98-bfc2-1cc561589032 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:41.933055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eb8db-d9a2-4d98-bfc2-1cc561589032 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:41.934799 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 593/1183] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:41.941274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfbaa9-8e16-474a-b0ed-a00956e13ce1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:41.941705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfbaa9-8e16-474a-b0ed-a00956e13ce1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:41.941820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfbaa9-8e16-474a-b0ed-a00956e13ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:41.959162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c3bfbaa9-8e16-474a-b0ed-a00956e13ce1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:41.960367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c3bfbaa9-8e16-474a-b0ed-a00956e13ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:41.967834 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 591/1184] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:32:41.992011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eb8db-d9a2-4d98-bfc2-1cc561589032 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:42.004890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eb8db-d9a2-4d98-bfc2-1cc561589032 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:42.009279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038874d-abff-49a3-ba3a-535f99003577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:42.009898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038874d-abff-49a3-ba3a-535f99003577 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:42.010181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038874d-abff-49a3-ba3a-535f99003577 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:42.010455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038874d-abff-49a3-ba3a-535f99003577 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:42.018428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038874d-abff-49a3-ba3a-535f99003577 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:42.020616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038874d-abff-49a3-ba3a-535f99003577 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:42.029523 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 594/1185] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:41 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:32:42.035670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfbaa9-8e16-474a-b0ed-a00956e13ce1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:42.044431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfbaa9-8e16-474a-b0ed-a00956e13ce1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:42.048939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fb559-e790-49f5-ac3e-fa92bcce135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:42.050215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fb559-e790-49f5-ac3e-fa92bcce135b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:42.050497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fb559-e790-49f5-ac3e-fa92bcce135b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:42.050774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fb559-e790-49f5-ac3e-fa92bcce135b admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:42.057580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fb559-e790-49f5-ac3e-fa92bcce135b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:42.059420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fb559-e790-49f5-ac3e-fa92bcce135b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:42.074069 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-531fb559-e790-49f5-ac3e-fa92bcce135b admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 27 20:32:42.075174 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 592/1186] 10.222.0.21 () {56 vars in 1138 bytes} [Sat Nov 27 20:32:42 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:42.081266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038874d-abff-49a3-ba3a-535f99003577 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:42.089952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038874d-abff-49a3-ba3a-535f99003577 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:42.094465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47431fe8-7340-4138-9aae-30aa935ca2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:42.095097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47431fe8-7340-4138-9aae-30aa935ca2ff admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:42.095420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47431fe8-7340-4138-9aae-30aa935ca2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:42.095698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47431fe8-7340-4138-9aae-30aa935ca2ff admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:42.096423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47431fe8-7340-4138-9aae-30aa935ca2ff admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:42.096727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47431fe8-7340-4138-9aae-30aa935ca2ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:42.098285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47431fe8-7340-4138-9aae-30aa935ca2ff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:42.105409 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 595/1187] 10.222.0.21 () {56 vars in 1136 bytes} [Sat Nov 27 20:32:42 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:44.500431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b368f-3088-4b53-8e17-ce3fc25e3b67 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:44.500972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b368f-3088-4b53-8e17-ce3fc25e3b67 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:44.500972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b368f-3088-4b53-8e17-ce3fc25e3b67 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:44.503243 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 593/1188] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:44.508941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405ee52-7d07-496f-9dbb-744484c2bd45 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:44.509369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405ee52-7d07-496f-9dbb-744484c2bd45 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:44.509477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405ee52-7d07-496f-9dbb-744484c2bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:44.527477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5405ee52-7d07-496f-9dbb-744484c2bd45 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:44.528695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5405ee52-7d07-496f-9dbb-744484c2bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:44.536177 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 596/1189] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:44.560322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b368f-3088-4b53-8e17-ce3fc25e3b67 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:44.572481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b368f-3088-4b53-8e17-ce3fc25e3b67 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:44.576707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af332564-7dce-43d8-8f71-9089d7ccc2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:44.577329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332564-7dce-43d8-8f71-9089d7ccc2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:44.577605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332564-7dce-43d8-8f71-9089d7ccc2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:44.577883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af332564-7dce-43d8-8f71-9089d7ccc2f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:44.578626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af332564-7dce-43d8-8f71-9089d7ccc2f5 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:44.579634 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-af332564-7dce-43d8-8f71-9089d7ccc2f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:32:44.579634 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:32:44.579634 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:32:44.580580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af332564-7dce-43d8-8f71-9089d7ccc2f5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:44.599101 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 594/1190] 10.222.0.21 () {60 vars in 1159 bytes} [Sat Nov 27 20:32:44 2021] POST /identity/v3/domains => generated 267 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:32:47.026166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2c2f-61f8-438a-9136-2d94b8970b2d None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:47.026699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2c2f-61f8-438a-9136-2d94b8970b2d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:47.026699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2c2f-61f8-438a-9136-2d94b8970b2d None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:47.028510 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 597/1191] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:47.034208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e6df-3cf9-4f3e-9db7-d0bbd865b532 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:47.034608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e6df-3cf9-4f3e-9db7-d0bbd865b532 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:47.034765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762e6df-3cf9-4f3e-9db7-d0bbd865b532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:47.052644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4762e6df-3cf9-4f3e-9db7-d0bbd865b532 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:47.053813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4762e6df-3cf9-4f3e-9db7-d0bbd865b532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:47.108526 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 595/1192] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:32:47.134852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc2c2f-61f8-438a-9136-2d94b8970b2d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:47.146842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc2c2f-61f8-438a-9136-2d94b8970b2d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:47.151193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e58c29-eaef-4da4-a8d8-049453b5c570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:47.152047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e58c29-eaef-4da4-a8d8-049453b5c570 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:47.152328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e58c29-eaef-4da4-a8d8-049453b5c570 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:47.152603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e58c29-eaef-4da4-a8d8-049453b5c570 admin admin] PATH_INFO: `/v3/domains/548f3bb645e1435687f0e0af43a861b4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:47.162962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e58c29-eaef-4da4-a8d8-049453b5c570 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=548f3bb645e1435687f0e0af43a861b4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:47.164996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e58c29-eaef-4da4-a8d8-049453b5c570 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:47.166594 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 598/1193] 10.222.0.21 () {56 vars in 1204 bytes} [Sat Nov 27 20:32:47 2021] GET /identity/v3/domains/548f3bb645e1435687f0e0af43a861b4 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:47.172936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e6df-3cf9-4f3e-9db7-d0bbd865b532 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:47.182151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762e6df-3cf9-4f3e-9db7-d0bbd865b532 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:47.186644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5bb7d-0dcd-498e-b42f-5572fc1e93ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:47.187299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5bb7d-0dcd-498e-b42f-5572fc1e93ef admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:47.187581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5bb7d-0dcd-498e-b42f-5572fc1e93ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:47.187854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5bb7d-0dcd-498e-b42f-5572fc1e93ef admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:47.188571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5bb7d-0dcd-498e-b42f-5572fc1e93ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:47.191060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5bb7d-0dcd-498e-b42f-5572fc1e93ef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:47.215885 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 596/1194] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:32:47 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:32:49.663635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313c6fb-5199-4873-a575-e8b3cbf9379b None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:49.664153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313c6fb-5199-4873-a575-e8b3cbf9379b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:49.664153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313c6fb-5199-4873-a575-e8b3cbf9379b None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:49.665942 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 599/1195] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:49.671678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0f05a-5dd3-420a-819f-c8b1357435fb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:49.672089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0f05a-5dd3-420a-819f-c8b1357435fb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:49.672237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0f05a-5dd3-420a-819f-c8b1357435fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:49.690127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-40e0f05a-5dd3-420a-819f-c8b1357435fb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:49.691322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-40e0f05a-5dd3-420a-819f-c8b1357435fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:49.746453 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 597/1196] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:49 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:49.772676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313c6fb-5199-4873-a575-e8b3cbf9379b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:49.784997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313c6fb-5199-4873-a575-e8b3cbf9379b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:49.789311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf5e9a-8215-48c1-b3ec-ac14e017acd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:49.790130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf5e9a-8215-48c1-b3ec-ac14e017acd3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:49.790406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf5e9a-8215-48c1-b3ec-ac14e017acd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:49.790674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf5e9a-8215-48c1-b3ec-ac14e017acd3 admin admin] PATH_INFO: `/v3/domains/548f3bb645e1435687f0e0af43a861b4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:49.791867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf5e9a-8215-48c1-b3ec-ac14e017acd3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=548f3bb645e1435687f0e0af43a861b4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:49.793798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf5e9a-8215-48c1-b3ec-ac14e017acd3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:49.795576 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 600/1197] 10.222.0.21 () {56 vars in 1204 bytes} [Sat Nov 27 20:32:49 2021] GET /identity/v3/domains/548f3bb645e1435687f0e0af43a861b4 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:49.801715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0f05a-5dd3-420a-819f-c8b1357435fb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:49.810399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0f05a-5dd3-420a-819f-c8b1357435fb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:49.814858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666b4da-b813-46c8-b167-1506f24e46b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:49.815539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b4da-b813-46c8-b167-1506f24e46b2 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:49.815823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b4da-b813-46c8-b167-1506f24e46b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:49.816097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666b4da-b813-46c8-b167-1506f24e46b2 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:49.816807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666b4da-b813-46c8-b167-1506f24e46b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:49.818674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666b4da-b813-46c8-b167-1506f24e46b2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:49.837319 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 598/1198] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:32:49 2021] POST /identity/v3/users => generated 311 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:32:52.273787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e980b1-7b50-41cd-a9d5-ac7d878cb41e None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:52.274351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e980b1-7b50-41cd-a9d5-ac7d878cb41e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:52.274351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e980b1-7b50-41cd-a9d5-ac7d878cb41e None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:52.276113 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 601/1199] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:52.281798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eba70-a5a7-4388-b153-6addce5ed8f3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:52.282169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eba70-a5a7-4388-b153-6addce5ed8f3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:52.282350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eba70-a5a7-4388-b153-6addce5ed8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:52.300485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bc7eba70-a5a7-4388-b153-6addce5ed8f3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:52.301671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bc7eba70-a5a7-4388-b153-6addce5ed8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:52.309205 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 599/1200] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:52 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:52.335413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e980b1-7b50-41cd-a9d5-ac7d878cb41e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:52.347168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e980b1-7b50-41cd-a9d5-ac7d878cb41e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:52.351517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb968-9ba5-4954-a530-2fc531ba1a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:52.352269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb968-9ba5-4954-a530-2fc531ba1a61 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:52.352544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb968-9ba5-4954-a530-2fc531ba1a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:52.352812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb968-9ba5-4954-a530-2fc531ba1a61 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:52.363458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cb968-9ba5-4954-a530-2fc531ba1a61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:52.370069 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-986cb968-9ba5-4954-a530-2fc531ba1a61 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:32:52.371174 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 602/1201] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:32:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:52.377527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7eba70-a5a7-4388-b153-6addce5ed8f3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:52.386276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7eba70-a5a7-4388-b153-6addce5ed8f3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:52.390808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167f873-b1cc-4af1-b88d-53a9880d9c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:52.391484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167f873-b1cc-4af1-b88d-53a9880d9c26 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:52.391769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167f873-b1cc-4af1-b88d-53a9880d9c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:52.392046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167f873-b1cc-4af1-b88d-53a9880d9c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:52.393311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167f873-b1cc-4af1-b88d-53a9880d9c26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:52.393613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167f873-b1cc-4af1-b88d-53a9880d9c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:52.395185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167f873-b1cc-4af1-b88d-53a9880d9c26 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:52.403272 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 600/1202] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:32:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:52.409896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb968-9ba5-4954-a530-2fc531ba1a61 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:52.419287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb968-9ba5-4954-a530-2fc531ba1a61 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:52.423779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615bb3c-9330-4abf-b3a0-7a459a2dd80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:52.424599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bb3c-9330-4abf-b3a0-7a459a2dd80b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:52.424884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bb3c-9330-4abf-b3a0-7a459a2dd80b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:52.425158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bb3c-9330-4abf-b3a0-7a459a2dd80b admin admin] PATH_INFO: `/v3/users/55af927f3595466a9f8a3906055a420f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:52.438384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615bb3c-9330-4abf-b3a0-7a459a2dd80b admin admin] RBAC: Authorizing `identity:get_user(user_id=55af927f3595466a9f8a3906055a420f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:52.440574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615bb3c-9330-4abf-b3a0-7a459a2dd80b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:52.442193 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 603/1203] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:52 2021] GET /identity/v3/users/55af927f3595466a9f8a3906055a420f => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:52.448422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167f873-b1cc-4af1-b88d-53a9880d9c26 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:52.458411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167f873-b1cc-4af1-b88d-53a9880d9c26 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:52.463040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3317c-8ccb-4c39-9599-bbe4cd476bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:52.463703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3317c-8ccb-4c39-9599-bbe4cd476bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:52.463988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3317c-8ccb-4c39-9599-bbe4cd476bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:52.464265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3317c-8ccb-4c39-9599-bbe4cd476bc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:52.472387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3317c-8ccb-4c39-9599-bbe4cd476bc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:52.474105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3317c-8ccb-4c39-9599-bbe4cd476bc2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:52.482755 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 601/1204] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:52 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:32:52.488556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615bb3c-9330-4abf-b3a0-7a459a2dd80b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:52.498095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615bb3c-9330-4abf-b3a0-7a459a2dd80b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:52.502584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368f9b9-edd0-4571-8d0f-00553d197fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:52.503437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368f9b9-edd0-4571-8d0f-00553d197fae admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:52.503721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368f9b9-edd0-4571-8d0f-00553d197fae admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:52.503995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368f9b9-edd0-4571-8d0f-00553d197fae admin admin] PATH_INFO: `/v3/projects/c330751205614842aa122a686a25a751` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:52.505150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368f9b9-edd0-4571-8d0f-00553d197fae admin admin] RBAC: Authorizing `identity:get_project(project_id=c330751205614842aa122a686a25a751)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:52.507159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368f9b9-edd0-4571-8d0f-00553d197fae admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:52.508937 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 604/1205] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:52 2021] GET /identity/v3/projects/c330751205614842aa122a686a25a751 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:52.514625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3317c-8ccb-4c39-9599-bbe4cd476bc2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:52.523615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3317c-8ccb-4c39-9599-bbe4cd476bc2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:52.528201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c80ed-4f21-40b9-a384-2490b39d9c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:52.528747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c80ed-4f21-40b9-a384-2490b39d9c55 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:52.529030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c80ed-4f21-40b9-a384-2490b39d9c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:52.529306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c80ed-4f21-40b9-a384-2490b39d9c55 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:52.530124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c80ed-4f21-40b9-a384-2490b39d9c55 admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=c330751205614842aa122a686a25a751, user.id=55af927f3595466a9f8a3906055a420f) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:52.530434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c80ed-4f21-40b9-a384-2490b39d9c55 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:52.532251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c80ed-4f21-40b9-a384-2490b39d9c55 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:52.538059 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 602/1206] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:32:52 2021] GET /identity/v3/role_assignments?user.id=55af927f3595466a9f8a3906055a420f&scope.project.id=c330751205614842aa122a686a25a751&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:32:54.989461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eac0f8-da55-46f7-8e8b-9245b8f0efe4 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:54.990018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eac0f8-da55-46f7-8e8b-9245b8f0efe4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:54.990018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eac0f8-da55-46f7-8e8b-9245b8f0efe4 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:54.991806 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 605/1207] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:54.998041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2d3fc-b717-4455-81ef-9af7ce85ca83 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:54.998455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2d3fc-b717-4455-81ef-9af7ce85ca83 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:54.998594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2d3fc-b717-4455-81ef-9af7ce85ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:55.016609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0ee2d3fc-b717-4455-81ef-9af7ce85ca83 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:55.018398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0ee2d3fc-b717-4455-81ef-9af7ce85ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:55.025937 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 603/1208] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:54 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:55.050218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eac0f8-da55-46f7-8e8b-9245b8f0efe4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:55.062072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eac0f8-da55-46f7-8e8b-9245b8f0efe4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:55.066987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b86c0-77be-4ad1-a66b-e1d1816c9487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:55.067778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b86c0-77be-4ad1-a66b-e1d1816c9487 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:55.068060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b86c0-77be-4ad1-a66b-e1d1816c9487 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:55.068331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b86c0-77be-4ad1-a66b-e1d1816c9487 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:55.078184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b86c0-77be-4ad1-a66b-e1d1816c9487 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:55.085465 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-8c5b86c0-77be-4ad1-a66b-e1d1816c9487 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:32:55.086571 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 606/1209] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:32:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:55.092533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2d3fc-b717-4455-81ef-9af7ce85ca83 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:55.101173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2d3fc-b717-4455-81ef-9af7ce85ca83 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:55.105573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57356fd2-2566-463a-a5b2-bf64bdf629fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:55.106203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57356fd2-2566-463a-a5b2-bf64bdf629fc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:55.106482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57356fd2-2566-463a-a5b2-bf64bdf629fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:55.106751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57356fd2-2566-463a-a5b2-bf64bdf629fc admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:55.107517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57356fd2-2566-463a-a5b2-bf64bdf629fc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:55.107815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57356fd2-2566-463a-a5b2-bf64bdf629fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:55.109364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57356fd2-2566-463a-a5b2-bf64bdf629fc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:55.117137 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 604/1210] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:32:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:55.123201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b86c0-77be-4ad1-a66b-e1d1816c9487 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:55.133428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b86c0-77be-4ad1-a66b-e1d1816c9487 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:55.137879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e39a7-26e4-407a-b50c-618b5566ae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:55.138683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e39a7-26e4-407a-b50c-618b5566ae07 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:55.138963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e39a7-26e4-407a-b50c-618b5566ae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:55.139232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e39a7-26e4-407a-b50c-618b5566ae07 admin admin] PATH_INFO: `/v3/users/55af927f3595466a9f8a3906055a420f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:55.140448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e39a7-26e4-407a-b50c-618b5566ae07 admin admin] RBAC: Authorizing `identity:get_user(user_id=55af927f3595466a9f8a3906055a420f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:55.142548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e39a7-26e4-407a-b50c-618b5566ae07 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:55.144695 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 607/1211] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:55 2021] GET /identity/v3/users/55af927f3595466a9f8a3906055a420f => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:55.150758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57356fd2-2566-463a-a5b2-bf64bdf629fc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:55.160803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57356fd2-2566-463a-a5b2-bf64bdf629fc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:55.165633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca124b-a747-404d-a204-c1cae4c65273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:55.166525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca124b-a747-404d-a204-c1cae4c65273 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:55.166843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca124b-a747-404d-a204-c1cae4c65273 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:55.167146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca124b-a747-404d-a204-c1cae4c65273 admin admin] PATH_INFO: `/v3/projects/c330751205614842aa122a686a25a751` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:55.168436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca124b-a747-404d-a204-c1cae4c65273 admin admin] RBAC: Authorizing `identity:get_project(project_id=c330751205614842aa122a686a25a751)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:55.170562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca124b-a747-404d-a204-c1cae4c65273 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:55.172340 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 605/1212] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:55 2021] GET /identity/v3/projects/c330751205614842aa122a686a25a751 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:55.178344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e39a7-26e4-407a-b50c-618b5566ae07 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:55.187696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e39a7-26e4-407a-b50c-618b5566ae07 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:55.192688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79c9c5-064a-4466-8f4e-1548a81e9283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:55.193531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79c9c5-064a-4466-8f4e-1548a81e9283 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:55.193813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79c9c5-064a-4466-8f4e-1548a81e9283 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:55.194086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79c9c5-064a-4466-8f4e-1548a81e9283 admin admin] PATH_INFO: `/v3/projects/c330751205614842aa122a686a25a751/users/55af927f3595466a9f8a3906055a420f/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:55.196118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79c9c5-064a-4466-8f4e-1548a81e9283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c330751205614842aa122a686a25a751, user_id=55af927f3595466a9f8a3906055a420f, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:55.198705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79c9c5-064a-4466-8f4e-1548a81e9283 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:55.211839 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 608/1213] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:32:55 2021] PUT /identity/v3/projects/c330751205614842aa122a686a25a751/users/55af927f3595466a9f8a3906055a420f/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:32:57.601653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f915f-8237-43de-bf0c-678d8547edcb None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:57.602170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f915f-8237-43de-bf0c-678d8547edcb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:57.602258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f915f-8237-43de-bf0c-678d8547edcb None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:57.603989 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 606/1214] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:32:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:32:57.609842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7d36d-dc51-4363-8e68-71041321d909 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:57.610264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7d36d-dc51-4363-8e68-71041321d909 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:57.610404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7d36d-dc51-4363-8e68-71041321d909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:57.629911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ede7d36d-dc51-4363-8e68-71041321d909 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:32:57.631087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ede7d36d-dc51-4363-8e68-71041321d909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:32:57.685578 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 609/1215] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:32:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:32:57.713180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f915f-8237-43de-bf0c-678d8547edcb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:57.725691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f915f-8237-43de-bf0c-678d8547edcb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:57.729952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceb13d-b46f-4649-bad3-e083050dff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:57.730746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb13d-b46f-4649-bad3-e083050dff88 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:57.731044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb13d-b46f-4649-bad3-e083050dff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:57.731373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb13d-b46f-4649-bad3-e083050dff88 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:57.741658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cceb13d-b46f-4649-bad3-e083050dff88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:32:57.748758 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-3cceb13d-b46f-4649-bad3-e083050dff88 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:32:57.749877 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 607/1216] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:32:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:32:57.756134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7d36d-dc51-4363-8e68-71041321d909 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:57.764822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7d36d-dc51-4363-8e68-71041321d909 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:57.769869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c76cf0-5ab7-4244-9ad8-b6227562970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:57.770510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c76cf0-5ab7-4244-9ad8-b6227562970b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:57.770793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c76cf0-5ab7-4244-9ad8-b6227562970b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:57.771066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c76cf0-5ab7-4244-9ad8-b6227562970b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:57.771863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c76cf0-5ab7-4244-9ad8-b6227562970b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:57.772167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c76cf0-5ab7-4244-9ad8-b6227562970b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:57.773809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c76cf0-5ab7-4244-9ad8-b6227562970b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:57.782189 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 610/1217] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:32:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:57.788988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceb13d-b46f-4649-bad3-e083050dff88 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:57.798869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceb13d-b46f-4649-bad3-e083050dff88 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:57.803244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c5d07-0083-45dc-bdfa-4c228ca0ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:57.804096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5d07-0083-45dc-bdfa-4c228ca0ed37 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:57.804376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5d07-0083-45dc-bdfa-4c228ca0ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:57.804645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5d07-0083-45dc-bdfa-4c228ca0ed37 admin admin] PATH_INFO: `/v3/users/55af927f3595466a9f8a3906055a420f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:57.805802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c5d07-0083-45dc-bdfa-4c228ca0ed37 admin admin] RBAC: Authorizing `identity:get_user(user_id=55af927f3595466a9f8a3906055a420f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:57.807931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c5d07-0083-45dc-bdfa-4c228ca0ed37 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:57.809452 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 608/1218] 10.222.0.21 () {56 vars in 1198 bytes} [Sat Nov 27 20:32:57 2021] GET /identity/v3/users/55af927f3595466a9f8a3906055a420f => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:57.815125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c76cf0-5ab7-4244-9ad8-b6227562970b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:57.824424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c76cf0-5ab7-4244-9ad8-b6227562970b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:57.828902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a2db9-1c9c-405b-90e5-634c16387683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:57.829516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2db9-1c9c-405b-90e5-634c16387683 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:57.829799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2db9-1c9c-405b-90e5-634c16387683 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:57.830586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2db9-1c9c-405b-90e5-634c16387683 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:57.839763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a2db9-1c9c-405b-90e5-634c16387683 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:57.842615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a2db9-1c9c-405b-90e5-634c16387683 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:57.853599 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 611/1219] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:32:57 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:32:57.860272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c5d07-0083-45dc-bdfa-4c228ca0ed37 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:57.870037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c5d07-0083-45dc-bdfa-4c228ca0ed37 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:57.874734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d6a0f-399c-4a9c-a355-6d284bd3beb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:57.875587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d6a0f-399c-4a9c-a355-6d284bd3beb8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:57.875867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d6a0f-399c-4a9c-a355-6d284bd3beb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:57.876139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d6a0f-399c-4a9c-a355-6d284bd3beb8 admin admin] PATH_INFO: `/v3/projects/c330751205614842aa122a686a25a751` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:57.877799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d6a0f-399c-4a9c-a355-6d284bd3beb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=c330751205614842aa122a686a25a751)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:57.879844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d6a0f-399c-4a9c-a355-6d284bd3beb8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:57.881535 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 609/1220] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:32:57 2021] GET /identity/v3/projects/c330751205614842aa122a686a25a751 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:32:57.887581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a2db9-1c9c-405b-90e5-634c16387683 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:32:57.896688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a2db9-1c9c-405b-90e5-634c16387683 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:32:57.901222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b848f25-0982-4d88-9b7f-94eb515e78de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:32:57.901837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b848f25-0982-4d88-9b7f-94eb515e78de admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:32:57.902118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b848f25-0982-4d88-9b7f-94eb515e78de admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:32:57.902392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b848f25-0982-4d88-9b7f-94eb515e78de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:32:57.903208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b848f25-0982-4d88-9b7f-94eb515e78de admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=c330751205614842aa122a686a25a751, user.id=55af927f3595466a9f8a3906055a420f) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:32:57.903550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b848f25-0982-4d88-9b7f-94eb515e78de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:32:57.905352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b848f25-0982-4d88-9b7f-94eb515e78de admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:32:57.910937 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 612/1221] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:32:57 2021] GET /identity/v3/role_assignments?user.id=55af927f3595466a9f8a3906055a420f&scope.project.id=c330751205614842aa122a686a25a751&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:33:57.342055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c2278-4fdd-4a8b-866b-33ff8ff61f90 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:33:57.342679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c2278-4fdd-4a8b-866b-33ff8ff61f90 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:33:57.342679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c2278-4fdd-4a8b-866b-33ff8ff61f90 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:33:57.344622 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 610/1222] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:33:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:33:57.350712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7a346-cc4e-4f99-adc7-b5f133055245 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:33:57.351206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7a346-cc4e-4f99-adc7-b5f133055245 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:33:57.351352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7a346-cc4e-4f99-adc7-b5f133055245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:33:57.375501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d1e7a346-cc4e-4f99-adc7-b5f133055245 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:33:57.377051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d1e7a346-cc4e-4f99-adc7-b5f133055245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:33:57.387354 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 613/1223] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:33:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:33:57.415720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c2278-4fdd-4a8b-866b-33ff8ff61f90 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:33:57.430660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c2278-4fdd-4a8b-866b-33ff8ff61f90 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:33:57.436460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ab411-6770-4a6a-aa07-f335ee444a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:33:57.437264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ab411-6770-4a6a-aa07-f335ee444a57 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:33:57.437603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ab411-6770-4a6a-aa07-f335ee444a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:33:57.437834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ab411-6770-4a6a-aa07-f335ee444a57 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:33:57.453283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ab411-6770-4a6a-aa07-f335ee444a57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:33:57.455106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ab411-6770-4a6a-aa07-f335ee444a57 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:33:57.473142 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-1e5ab411-6770-4a6a-aa07-f335ee444a57 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:33:57.474574 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 611/1224] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:33:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:33:57.483282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7a346-cc4e-4f99-adc7-b5f133055245 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:33:57.491073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7a346-cc4e-4f99-adc7-b5f133055245 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:33:57.497816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fa293-77b8-4f37-8cc1-f2e69858b523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:33:57.498586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fa293-77b8-4f37-8cc1-f2e69858b523 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:33:57.498935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fa293-77b8-4f37-8cc1-f2e69858b523 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:33:57.499328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fa293-77b8-4f37-8cc1-f2e69858b523 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:33:57.500168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fa293-77b8-4f37-8cc1-f2e69858b523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:33:57.500534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fa293-77b8-4f37-8cc1-f2e69858b523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:33:57.502204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fa293-77b8-4f37-8cc1-f2e69858b523 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:33:57.519298 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 614/1225] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:33:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:33:57.521510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ab411-6770-4a6a-aa07-f335ee444a57 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:33:57.531929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ab411-6770-4a6a-aa07-f335ee444a57 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:33:57.543994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94417fb-5df2-42a3-8dbd-4a3f78266078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:33:57.544669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94417fb-5df2-42a3-8dbd-4a3f78266078 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:33:57.544954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94417fb-5df2-42a3-8dbd-4a3f78266078 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:33:57.545230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94417fb-5df2-42a3-8dbd-4a3f78266078 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:33:57.547288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94417fb-5df2-42a3-8dbd-4a3f78266078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:33:57.548037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94417fb-5df2-42a3-8dbd-4a3f78266078 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:33:57.572753 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 612/1226] 10.222.0.21 () {60 vars in 1153 bytes} [Sat Nov 27 20:33:57 2021] POST /identity/v3/users => generated 251 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:34:00.314988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f9f96-fbca-43e9-8be6-b3df53d53b28 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.315599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f9f96-fbca-43e9-8be6-b3df53d53b28 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.315599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f9f96-fbca-43e9-8be6-b3df53d53b28 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.317480 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 615/1227] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:34:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:34:00.323408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c6e96-a324-45ff-bf17-b9b839c0436f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.323893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c6e96-a324-45ff-bf17-b9b839c0436f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.323989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c6e96-a324-45ff-bf17-b9b839c0436f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.348212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-428c6e96-a324-45ff-bf17-b9b839c0436f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:34:00.349496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-428c6e96-a324-45ff-bf17-b9b839c0436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:34:00.360593 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 613/1228] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:34:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:34:00.387330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f9f96-fbca-43e9-8be6-b3df53d53b28 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.401633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f9f96-fbca-43e9-8be6-b3df53d53b28 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.407672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eb104-ff78-4ed7-8a2f-9c372f012756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.408527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eb104-ff78-4ed7-8a2f-9c372f012756 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.408896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eb104-ff78-4ed7-8a2f-9c372f012756 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.409175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eb104-ff78-4ed7-8a2f-9c372f012756 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.420499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301eb104-ff78-4ed7-8a2f-9c372f012756 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:34:00.427422 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-301eb104-ff78-4ed7-8a2f-9c372f012756 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:34:00.431286 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 616/1229] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:00.435724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c6e96-a324-45ff-bf17-b9b839c0436f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.447179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c6e96-a324-45ff-bf17-b9b839c0436f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.452178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa48b40-fd49-4cd6-97ac-08baf992cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.453388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48b40-fd49-4cd6-97ac-08baf992cd04 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.453663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48b40-fd49-4cd6-97ac-08baf992cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.454047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48b40-fd49-4cd6-97ac-08baf992cd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.454688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa48b40-fd49-4cd6-97ac-08baf992cd04 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:00.455011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa48b40-fd49-4cd6-97ac-08baf992cd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:00.456625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa48b40-fd49-4cd6-97ac-08baf992cd04 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:00.467295 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 614/1230] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:00.472043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eb104-ff78-4ed7-8a2f-9c372f012756 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.483332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eb104-ff78-4ed7-8a2f-9c372f012756 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.488826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef3124-1c78-41c9-8a83-edabc167bc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.489650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef3124-1c78-41c9-8a83-edabc167bc18 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.489928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef3124-1c78-41c9-8a83-edabc167bc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.490211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef3124-1c78-41c9-8a83-edabc167bc18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.502202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef3124-1c78-41c9-8a83-edabc167bc18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:00.504106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef3124-1c78-41c9-8a83-edabc167bc18 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:00.524454 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-87ef3124-1c78-41c9-8a83-edabc167bc18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:00.526193 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 617/1231] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:34:00.533536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa48b40-fd49-4cd6-97ac-08baf992cd04 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.544747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa48b40-fd49-4cd6-97ac-08baf992cd04 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.550854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074d8f-e690-4168-ab0c-7dc6d57e400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.551714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074d8f-e690-4168-ab0c-7dc6d57e400a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.552002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074d8f-e690-4168-ab0c-7dc6d57e400a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.552283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074d8f-e690-4168-ab0c-7dc6d57e400a admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.553065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51074d8f-e690-4168-ab0c-7dc6d57e400a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:00.553402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51074d8f-e690-4168-ab0c-7dc6d57e400a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:00.555527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51074d8f-e690-4168-ab0c-7dc6d57e400a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:00.572826 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 615/1232] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:34:00.577754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef3124-1c78-41c9-8a83-edabc167bc18 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.589238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef3124-1c78-41c9-8a83-edabc167bc18 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.593866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e7e39-6428-40a1-9a84-486b89291f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.594749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e7e39-6428-40a1-9a84-486b89291f67 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.595145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e7e39-6428-40a1-9a84-486b89291f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.595342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e7e39-6428-40a1-9a84-486b89291f67 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.603010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e7e39-6428-40a1-9a84-486b89291f67 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:00.605099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e7e39-6428-40a1-9a84-486b89291f67 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:00.620764 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-ad8e7e39-6428-40a1-9a84-486b89291f67 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 27 20:34:00.622180 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 618/1233] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:00.629775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074d8f-e690-4168-ab0c-7dc6d57e400a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.642069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074d8f-e690-4168-ab0c-7dc6d57e400a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.647567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d888a0b-f517-467b-8cf3-8a467fe9ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.648492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d888a0b-f517-467b-8cf3-8a467fe9ccda admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.648798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d888a0b-f517-467b-8cf3-8a467fe9ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.649117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d888a0b-f517-467b-8cf3-8a467fe9ccda admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.650009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d888a0b-f517-467b-8cf3-8a467fe9ccda admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:00.650329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d888a0b-f517-467b-8cf3-8a467fe9ccda admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:00.652391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d888a0b-f517-467b-8cf3-8a467fe9ccda admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:00.672000 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 616/1234] 10.222.0.21 () {56 vars in 1164 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:34:00.678834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e7e39-6428-40a1-9a84-486b89291f67 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.690089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e7e39-6428-40a1-9a84-486b89291f67 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.695544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f2ab4-09d7-48bf-a96a-1b31080fddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.696284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f2ab4-09d7-48bf-a96a-1b31080fddbd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.696606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f2ab4-09d7-48bf-a96a-1b31080fddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.696902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f2ab4-09d7-48bf-a96a-1b31080fddbd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.706392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f2ab4-09d7-48bf-a96a-1b31080fddbd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:00.708366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f2ab4-09d7-48bf-a96a-1b31080fddbd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:00.718229 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 619/1235] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:34:00.724537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d888a0b-f517-467b-8cf3-8a467fe9ccda admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.735803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d888a0b-f517-467b-8cf3-8a467fe9ccda admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.740959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b6213-7684-42e5-8c04-2b407cb95a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.741956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b6213-7684-42e5-8c04-2b407cb95a4a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.742363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b6213-7684-42e5-8c04-2b407cb95a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.742746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b6213-7684-42e5-8c04-2b407cb95a4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.755323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b6213-7684-42e5-8c04-2b407cb95a4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:00.757369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b6213-7684-42e5-8c04-2b407cb95a4a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:00.776489 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-301b6213-7684-42e5-8c04-2b407cb95a4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:00.777958 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 617/1236] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:34:00.785460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f2ab4-09d7-48bf-a96a-1b31080fddbd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.797096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f2ab4-09d7-48bf-a96a-1b31080fddbd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.802574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b26cf-3f46-406f-9aa7-c6e73f0f7c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.803313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b26cf-3f46-406f-9aa7-c6e73f0f7c54 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.803624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b26cf-3f46-406f-9aa7-c6e73f0f7c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.803917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b26cf-3f46-406f-9aa7-c6e73f0f7c54 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.804732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b26cf-3f46-406f-9aa7-c6e73f0f7c54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:00.805033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b26cf-3f46-406f-9aa7-c6e73f0f7c54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:00.806624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b26cf-3f46-406f-9aa7-c6e73f0f7c54 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:00.822566 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 620/1237] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:00.829899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b6213-7684-42e5-8c04-2b407cb95a4a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.840310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b6213-7684-42e5-8c04-2b407cb95a4a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.845591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa824c-a29c-405a-939a-dc821e99dc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.846439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa824c-a29c-405a-939a-dc821e99dc2f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.846736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa824c-a29c-405a-939a-dc821e99dc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.847007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa824c-a29c-405a-939a-dc821e99dc2f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.854480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa824c-a29c-405a-939a-dc821e99dc2f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:00.856456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa824c-a29c-405a-939a-dc821e99dc2f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:00.871134 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-53fa824c-a29c-405a-939a-dc821e99dc2f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:34:00.872786 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 618/1238] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:34:00.880054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b26cf-3f46-406f-9aa7-c6e73f0f7c54 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.892965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b26cf-3f46-406f-9aa7-c6e73f0f7c54 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.898388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac2f74-f356-4635-b91c-507119405c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.899067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac2f74-f356-4635-b91c-507119405c14 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.899507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac2f74-f356-4635-b91c-507119405c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.899689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac2f74-f356-4635-b91c-507119405c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.900533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac2f74-f356-4635-b91c-507119405c14 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:00.900835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac2f74-f356-4635-b91c-507119405c14 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:00.902852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac2f74-f356-4635-b91c-507119405c14 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:00.918086 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 621/1239] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:00.924994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa824c-a29c-405a-939a-dc821e99dc2f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:00.936394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa824c-a29c-405a-939a-dc821e99dc2f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:00.942914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f1972-c82d-41fa-a4ae-1051fd7b8f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:00.944010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1972-c82d-41fa-a4ae-1051fd7b8f36 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:00.944303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1972-c82d-41fa-a4ae-1051fd7b8f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:00.944681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f1972-c82d-41fa-a4ae-1051fd7b8f36 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:00.945716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f1972-c82d-41fa-a4ae-1051fd7b8f36 admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=12473c7375ac477a85977655ccb3f514) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:00.946067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f1972-c82d-41fa-a4ae-1051fd7b8f36 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:00.948439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f1972-c82d-41fa-a4ae-1051fd7b8f36 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:00.957242 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 619/1240] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:34:00 2021] GET /identity/v3/role_assignments?user.id=12473c7375ac477a85977655ccb3f514&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:03.511575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd2c97-2ac6-4d26-960f-2b0afd07af2a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:03.512223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd2c97-2ac6-4d26-960f-2b0afd07af2a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:03.512223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd2c97-2ac6-4d26-960f-2b0afd07af2a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:03.519368 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 622/1241] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:34:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:34:03.521277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a33247-9842-41de-9bdf-be783cfe6816 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:03.521737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a33247-9842-41de-9bdf-be783cfe6816 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:03.521864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a33247-9842-41de-9bdf-be783cfe6816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:03.543482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-27a33247-9842-41de-9bdf-be783cfe6816 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:34:03.544853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-27a33247-9842-41de-9bdf-be783cfe6816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:34:03.555292 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 620/1242] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:34:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:34:03.582982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd2c97-2ac6-4d26-960f-2b0afd07af2a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:03.596528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd2c97-2ac6-4d26-960f-2b0afd07af2a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:03.602893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6622f-8e55-4ef9-bd95-679a5e9ac7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:03.603848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6622f-8e55-4ef9-bd95-679a5e9ac7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:03.604176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6622f-8e55-4ef9-bd95-679a5e9ac7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:03.604475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6622f-8e55-4ef9-bd95-679a5e9ac7f4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:03.619202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6622f-8e55-4ef9-bd95-679a5e9ac7f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:34:03.628264 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-58f6622f-8e55-4ef9-bd95-679a5e9ac7f4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:34:03.630168 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 623/1243] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:34:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:03.637037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a33247-9842-41de-9bdf-be783cfe6816 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:03.646436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a33247-9842-41de-9bdf-be783cfe6816 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:03.651555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d0e83-a1f2-494a-af15-8c66816f3138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:03.652464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d0e83-a1f2-494a-af15-8c66816f3138 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:03.652794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d0e83-a1f2-494a-af15-8c66816f3138 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:03.653109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d0e83-a1f2-494a-af15-8c66816f3138 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:03.653868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d0e83-a1f2-494a-af15-8c66816f3138 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:03.654165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d0e83-a1f2-494a-af15-8c66816f3138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:03.655881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d0e83-a1f2-494a-af15-8c66816f3138 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:03.664317 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 621/1244] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:34:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:03.670767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6622f-8e55-4ef9-bd95-679a5e9ac7f4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:03.682568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6622f-8e55-4ef9-bd95-679a5e9ac7f4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:03.688627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5976ff3-9dca-415e-999b-13a4d04a2464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:03.689476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5976ff3-9dca-415e-999b-13a4d04a2464 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:03.689763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5976ff3-9dca-415e-999b-13a4d04a2464 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:03.690040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5976ff3-9dca-415e-999b-13a4d04a2464 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:03.701334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5976ff3-9dca-415e-999b-13a4d04a2464 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:03.703396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5976ff3-9dca-415e-999b-13a4d04a2464 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:03.720785 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-e5976ff3-9dca-415e-999b-13a4d04a2464 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:03.722037 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 624/1245] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:03.728294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d0e83-a1f2-494a-af15-8c66816f3138 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:03.738591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d0e83-a1f2-494a-af15-8c66816f3138 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:03.743542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b9996-2e32-4baf-8f8a-de55e58f01f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:03.744202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9996-2e32-4baf-8f8a-de55e58f01f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:03.744487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9996-2e32-4baf-8f8a-de55e58f01f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:03.744764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9996-2e32-4baf-8f8a-de55e58f01f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:03.745612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b9996-2e32-4baf-8f8a-de55e58f01f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:03.746214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b9996-2e32-4baf-8f8a-de55e58f01f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:03.748217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b9996-2e32-4baf-8f8a-de55e58f01f7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:03.767873 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 622/1246] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:03.769401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5976ff3-9dca-415e-999b-13a4d04a2464 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:03.782169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5976ff3-9dca-415e-999b-13a4d04a2464 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:03.787120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e385e51-a818-4322-8721-9c0ba3508500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:03.787936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e385e51-a818-4322-8721-9c0ba3508500 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:03.788219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e385e51-a818-4322-8721-9c0ba3508500 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:03.788541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e385e51-a818-4322-8721-9c0ba3508500 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:03.797803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e385e51-a818-4322-8721-9c0ba3508500 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:03.800255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e385e51-a818-4322-8721-9c0ba3508500 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:03.816002 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-7e385e51-a818-4322-8721-9c0ba3508500 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 27 20:34:03.819327 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 625/1247] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:03 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:03.823537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b9996-2e32-4baf-8f8a-de55e58f01f7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:03.834710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b9996-2e32-4baf-8f8a-de55e58f01f7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:03.839790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064a490-e764-4572-b904-caf07c43b416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:03.840476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a490-e764-4572-b904-caf07c43b416 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:03.841472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a490-e764-4572-b904-caf07c43b416 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:03.841472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a490-e764-4572-b904-caf07c43b416 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:03.841829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064a490-e764-4572-b904-caf07c43b416 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:03.842136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064a490-e764-4572-b904-caf07c43b416 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:03.844023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064a490-e764-4572-b904-caf07c43b416 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:03.863394 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 623/1248] 10.222.0.21 () {56 vars in 1164 bytes} [Sat Nov 27 20:34:03 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:03.869498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e385e51-a818-4322-8721-9c0ba3508500 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:03.880151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e385e51-a818-4322-8721-9c0ba3508500 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:03.884907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d73ce8-488a-4fd7-9ce7-faa2a2ea7317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:03.885680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d73ce8-488a-4fd7-9ce7-faa2a2ea7317 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:03.885964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d73ce8-488a-4fd7-9ce7-faa2a2ea7317 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:03.886238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d73ce8-488a-4fd7-9ce7-faa2a2ea7317 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:03.896686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d73ce8-488a-4fd7-9ce7-faa2a2ea7317 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:03.898538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d73ce8-488a-4fd7-9ce7-faa2a2ea7317 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:03.916718 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-b3d73ce8-488a-4fd7-9ce7-faa2a2ea7317 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:03.917889 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 626/1249] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:03.924841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064a490-e764-4572-b904-caf07c43b416 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:03.935392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064a490-e764-4572-b904-caf07c43b416 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:03.940080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d6a35-2e3d-42ad-a90d-674dd1fb7755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:03.940722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d6a35-2e3d-42ad-a90d-674dd1fb7755 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:03.940999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d6a35-2e3d-42ad-a90d-674dd1fb7755 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:03.941315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d6a35-2e3d-42ad-a90d-674dd1fb7755 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:03.941998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d6a35-2e3d-42ad-a90d-674dd1fb7755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:03.942296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d6a35-2e3d-42ad-a90d-674dd1fb7755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:03.943917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d6a35-2e3d-42ad-a90d-674dd1fb7755 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:03.955365 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 624/1250] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:03.961511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d73ce8-488a-4fd7-9ce7-faa2a2ea7317 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:03.972129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d73ce8-488a-4fd7-9ce7-faa2a2ea7317 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:03.976746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e1751-2fb6-479f-900b-500327de531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:03.977521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1751-2fb6-479f-900b-500327de531c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:03.977804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1751-2fb6-479f-900b-500327de531c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:03.978078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e1751-2fb6-479f-900b-500327de531c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:03.985000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e1751-2fb6-479f-900b-500327de531c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:03.986961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e1751-2fb6-479f-900b-500327de531c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:04.003592 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-c68e1751-2fb6-479f-900b-500327de531c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:34:04.004927 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 627/1251] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:34:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:04.011578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d6a35-2e3d-42ad-a90d-674dd1fb7755 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:04.022837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d6a35-2e3d-42ad-a90d-674dd1fb7755 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:04.028978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed55fe6-83d5-49d0-89da-790ff24f9dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:04.029631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed55fe6-83d5-49d0-89da-790ff24f9dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:04.029922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed55fe6-83d5-49d0-89da-790ff24f9dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:04.030199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed55fe6-83d5-49d0-89da-790ff24f9dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:04.031023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed55fe6-83d5-49d0-89da-790ff24f9dc5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:04.031483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed55fe6-83d5-49d0-89da-790ff24f9dc5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:04.033800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed55fe6-83d5-49d0-89da-790ff24f9dc5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:04.048070 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 625/1252] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:34:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:34:04.054793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e1751-2fb6-479f-900b-500327de531c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:04.067834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e1751-2fb6-479f-900b-500327de531c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:04.073163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fabb48-c5b5-4d5e-9ef4-5e6eb36b855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:04.074092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fabb48-c5b5-4d5e-9ef4-5e6eb36b855d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:04.074415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fabb48-c5b5-4d5e-9ef4-5e6eb36b855d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:04.074721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fabb48-c5b5-4d5e-9ef4-5e6eb36b855d admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/12473c7375ac477a85977655ccb3f514/roles/9442d70924794d1d9b528d5b470a7366` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:04.091789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fabb48-c5b5-4d5e-9ef4-5e6eb36b855d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=12473c7375ac477a85977655ccb3f514, role_id=9442d70924794d1d9b528d5b470a7366)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:04.094864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fabb48-c5b5-4d5e-9ef4-5e6eb36b855d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:04.107695 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 628/1253] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:34:04 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/12473c7375ac477a85977655ccb3f514/roles/9442d70924794d1d9b528d5b470a7366 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:34:06.680943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cf656-9ca5-4825-9bf1-68e4e669e98b None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:06.681501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cf656-9ca5-4825-9bf1-68e4e669e98b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:06.681501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cf656-9ca5-4825-9bf1-68e4e669e98b None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:06.683455 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 626/1254] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:34:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:34:06.689623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fc766-8c31-49dc-a464-88e1e9769961 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:06.690058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fc766-8c31-49dc-a464-88e1e9769961 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:06.690157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fc766-8c31-49dc-a464-88e1e9769961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:06.710077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-035fc766-8c31-49dc-a464-88e1e9769961 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:34:06.711186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-035fc766-8c31-49dc-a464-88e1e9769961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:34:06.773929 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 629/1255] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:34:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:34:06.805441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0cf656-9ca5-4825-9bf1-68e4e669e98b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:06.819009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0cf656-9ca5-4825-9bf1-68e4e669e98b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:06.824561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388a9a3-77c8-4109-808c-e471be27758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:06.825447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388a9a3-77c8-4109-808c-e471be27758a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:06.825727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388a9a3-77c8-4109-808c-e471be27758a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:06.826003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388a9a3-77c8-4109-808c-e471be27758a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:06.838665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388a9a3-77c8-4109-808c-e471be27758a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:34:06.847158 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-2388a9a3-77c8-4109-808c-e471be27758a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 27 20:34:06.848616 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 627/1256] 10.222.0.21 () {56 vars in 1123 bytes} [Sat Nov 27 20:34:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:34:06.855787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fc766-8c31-49dc-a464-88e1e9769961 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:06.866633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fc766-8c31-49dc-a464-88e1e9769961 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:06.872131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196a5b9-107b-4d1f-aa6e-48839f0e49c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:06.872921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196a5b9-107b-4d1f-aa6e-48839f0e49c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:06.873258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196a5b9-107b-4d1f-aa6e-48839f0e49c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:06.873644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196a5b9-107b-4d1f-aa6e-48839f0e49c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:06.875286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196a5b9-107b-4d1f-aa6e-48839f0e49c8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:06.875705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196a5b9-107b-4d1f-aa6e-48839f0e49c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:06.877541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196a5b9-107b-4d1f-aa6e-48839f0e49c8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:06.885849 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 630/1257] 10.222.0.21 () {56 vars in 1124 bytes} [Sat Nov 27 20:34:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:06.892921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388a9a3-77c8-4109-808c-e471be27758a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:06.904177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388a9a3-77c8-4109-808c-e471be27758a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:06.909315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaae47e-ce55-4707-984e-e0bfe09670cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:06.910079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaae47e-ce55-4707-984e-e0bfe09670cb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:06.910357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaae47e-ce55-4707-984e-e0bfe09670cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:06.910630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaae47e-ce55-4707-984e-e0bfe09670cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:06.921953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaae47e-ce55-4707-984e-e0bfe09670cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:06.923815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaae47e-ce55-4707-984e-e0bfe09670cb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:06.940541 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-ebaae47e-ce55-4707-984e-e0bfe09670cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:06.941725 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 628/1258] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:34:06.948938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196a5b9-107b-4d1f-aa6e-48839f0e49c8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:06.958898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196a5b9-107b-4d1f-aa6e-48839f0e49c8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:06.963830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a434b2-3afd-496f-afa2-4c7890224602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:06.964415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a434b2-3afd-496f-afa2-4c7890224602 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:06.964696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a434b2-3afd-496f-afa2-4c7890224602 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:06.964973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a434b2-3afd-496f-afa2-4c7890224602 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:06.965699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a434b2-3afd-496f-afa2-4c7890224602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:06.966000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a434b2-3afd-496f-afa2-4c7890224602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:06.967612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a434b2-3afd-496f-afa2-4c7890224602 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:06.980321 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 631/1259] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:06.986789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaae47e-ce55-4707-984e-e0bfe09670cb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:06.996447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaae47e-ce55-4707-984e-e0bfe09670cb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:07.001728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8828f5a-8342-48bd-9901-0e16a66a4aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:07.002505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8828f5a-8342-48bd-9901-0e16a66a4aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:07.002788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8828f5a-8342-48bd-9901-0e16a66a4aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:07.003059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8828f5a-8342-48bd-9901-0e16a66a4aa1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:07.010503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8828f5a-8342-48bd-9901-0e16a66a4aa1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:07.012552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8828f5a-8342-48bd-9901-0e16a66a4aa1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:07.027277 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-c8828f5a-8342-48bd-9901-0e16a66a4aa1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 27 20:34:07.028635 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 629/1260] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:06 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:07.036116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a434b2-3afd-496f-afa2-4c7890224602 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:07.047809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a434b2-3afd-496f-afa2-4c7890224602 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:07.053365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b168e4-aef3-4ac8-978d-9771931f00ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:07.054167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b168e4-aef3-4ac8-978d-9771931f00ec admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:07.054510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b168e4-aef3-4ac8-978d-9771931f00ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:07.054792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b168e4-aef3-4ac8-978d-9771931f00ec admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:07.055675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b168e4-aef3-4ac8-978d-9771931f00ec admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:07.055984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b168e4-aef3-4ac8-978d-9771931f00ec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:07.058005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b168e4-aef3-4ac8-978d-9771931f00ec admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:07.080042 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 632/1261] 10.222.0.21 () {56 vars in 1164 bytes} [Sat Nov 27 20:34:07 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:07.086642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8828f5a-8342-48bd-9901-0e16a66a4aa1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:07.097433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8828f5a-8342-48bd-9901-0e16a66a4aa1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:07.102685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f99f76-2cab-487c-beaa-88f2d252cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:07.103356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f99f76-2cab-487c-beaa-88f2d252cb4e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:07.103639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f99f76-2cab-487c-beaa-88f2d252cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:07.103915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f99f76-2cab-487c-beaa-88f2d252cb4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:07.112276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f99f76-2cab-487c-beaa-88f2d252cb4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:07.113998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f99f76-2cab-487c-beaa-88f2d252cb4e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:07.123149 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 630/1262] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:34:07 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:34:07.129963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b168e4-aef3-4ac8-978d-9771931f00ec admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:07.140687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b168e4-aef3-4ac8-978d-9771931f00ec admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:07.145291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9ed45-45c9-42d0-9e43-c60ff3fb1f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:07.146069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9ed45-45c9-42d0-9e43-c60ff3fb1f88 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:07.146351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9ed45-45c9-42d0-9e43-c60ff3fb1f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:07.146623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9ed45-45c9-42d0-9e43-c60ff3fb1f88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:07.156778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9ed45-45c9-42d0-9e43-c60ff3fb1f88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:07.158650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9ed45-45c9-42d0-9e43-c60ff3fb1f88 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:07.176601 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-a6e9ed45-45c9-42d0-9e43-c60ff3fb1f88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:07.177976 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 633/1263] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:07.185234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f99f76-2cab-487c-beaa-88f2d252cb4e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:07.194507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f99f76-2cab-487c-beaa-88f2d252cb4e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:07.199043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a007ab3-40fe-4470-9353-b54809b983b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:07.199718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007ab3-40fe-4470-9353-b54809b983b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:07.199998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007ab3-40fe-4470-9353-b54809b983b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:07.200270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007ab3-40fe-4470-9353-b54809b983b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:07.200996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a007ab3-40fe-4470-9353-b54809b983b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:07.201298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a007ab3-40fe-4470-9353-b54809b983b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:07.203494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a007ab3-40fe-4470-9353-b54809b983b6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:07.214739 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 631/1264] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:07.221292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9ed45-45c9-42d0-9e43-c60ff3fb1f88 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:07.233858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9ed45-45c9-42d0-9e43-c60ff3fb1f88 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:07.239929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6b34d-d2af-4a10-9102-a039712e4cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:07.240998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6b34d-d2af-4a10-9102-a039712e4cef admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:07.241419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6b34d-d2af-4a10-9102-a039712e4cef admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:07.241733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6b34d-d2af-4a10-9102-a039712e4cef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:07.251569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6b34d-d2af-4a10-9102-a039712e4cef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:07.254080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6b34d-d2af-4a10-9102-a039712e4cef admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:07.270534 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-dae6b34d-d2af-4a10-9102-a039712e4cef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:34:07.272083 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 634/1265] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:34:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:07.278548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a007ab3-40fe-4470-9353-b54809b983b6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:07.288128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a007ab3-40fe-4470-9353-b54809b983b6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:07.292964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a20f9-4a8c-4fda-bd09-5e7a2b413fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:07.293639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a20f9-4a8c-4fda-bd09-5e7a2b413fce admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:07.293919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a20f9-4a8c-4fda-bd09-5e7a2b413fce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:07.294202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a20f9-4a8c-4fda-bd09-5e7a2b413fce admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:07.294964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a20f9-4a8c-4fda-bd09-5e7a2b413fce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:07.295274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a20f9-4a8c-4fda-bd09-5e7a2b413fce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:07.297680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a20f9-4a8c-4fda-bd09-5e7a2b413fce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:07.319277 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 632/1266] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:34:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:07.319504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6b34d-d2af-4a10-9102-a039712e4cef admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:07.331721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6b34d-d2af-4a10-9102-a039712e4cef admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:07.336771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06fbce-62c1-45f2-8f49-247864f44cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:07.337409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06fbce-62c1-45f2-8f49-247864f44cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:07.337702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06fbce-62c1-45f2-8f49-247864f44cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:07.337977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06fbce-62c1-45f2-8f49-247864f44cd6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:07.338888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06fbce-62c1-45f2-8f49-247864f44cd6 admin admin] RBAC: Adding query filter params (role.id=9442d70924794d1d9b528d5b470a7366, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=12473c7375ac477a85977655ccb3f514) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:07.339349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06fbce-62c1-45f2-8f49-247864f44cd6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:07.341560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06fbce-62c1-45f2-8f49-247864f44cd6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:07.348380 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 635/1267] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:34:07 2021] GET /identity/v3/role_assignments?user.id=12473c7375ac477a85977655ccb3f514&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=9442d70924794d1d9b528d5b470a7366 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:09.938608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd81c-cb77-415b-87e4-2c4d9014c862 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:09.939392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd81c-cb77-415b-87e4-2c4d9014c862 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:09.939392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd81c-cb77-415b-87e4-2c4d9014c862 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:09.941079 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 633/1268] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:34:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:34:09.947701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddff0f3-4de0-4dad-8391-21462f1805cc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:09.948230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddff0f3-4de0-4dad-8391-21462f1805cc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:09.948358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddff0f3-4de0-4dad-8391-21462f1805cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:09.968395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3ddff0f3-4de0-4dad-8391-21462f1805cc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:34:09.969955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3ddff0f3-4de0-4dad-8391-21462f1805cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:34:09.979888 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 636/1269] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:34:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:34:10.011065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bd81c-cb77-415b-87e4-2c4d9014c862 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.025131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bd81c-cb77-415b-87e4-2c4d9014c862 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.030549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa9067-6e83-4b52-8e92-c0924af6d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.031349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa9067-6e83-4b52-8e92-c0924af6d208 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.031632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa9067-6e83-4b52-8e92-c0924af6d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.031904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa9067-6e83-4b52-8e92-c0924af6d208 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.042599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa9067-6e83-4b52-8e92-c0924af6d208 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:34:10.049430 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-2dfa9067-6e83-4b52-8e92-c0924af6d208 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:34:10.050616 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 634/1270] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:10.058001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddff0f3-4de0-4dad-8391-21462f1805cc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.067666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddff0f3-4de0-4dad-8391-21462f1805cc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.072621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8464f-5eab-4002-a5f6-4688efc95d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.076370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8464f-5eab-4002-a5f6-4688efc95d94 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.076370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8464f-5eab-4002-a5f6-4688efc95d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.076370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8464f-5eab-4002-a5f6-4688efc95d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.076370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8464f-5eab-4002-a5f6-4688efc95d94 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:10.076370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8464f-5eab-4002-a5f6-4688efc95d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:10.076770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8464f-5eab-4002-a5f6-4688efc95d94 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:10.086389 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 637/1271] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:34:10.093480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa9067-6e83-4b52-8e92-c0924af6d208 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.104925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa9067-6e83-4b52-8e92-c0924af6d208 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.110262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ede32-a7e9-4c84-9482-d7b04dcc5517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.111026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ede32-a7e9-4c84-9482-d7b04dcc5517 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.111339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ede32-a7e9-4c84-9482-d7b04dcc5517 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.111614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ede32-a7e9-4c84-9482-d7b04dcc5517 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.124834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ede32-a7e9-4c84-9482-d7b04dcc5517 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:10.126762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ede32-a7e9-4c84-9482-d7b04dcc5517 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:10.146202 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-606ede32-a7e9-4c84-9482-d7b04dcc5517 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:10.147809 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 635/1272] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:10.154181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8464f-5eab-4002-a5f6-4688efc95d94 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.164657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8464f-5eab-4002-a5f6-4688efc95d94 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.169384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d2767-0bf2-46c0-bc2d-39d7f054e2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.170028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d2767-0bf2-46c0-bc2d-39d7f054e2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.170372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d2767-0bf2-46c0-bc2d-39d7f054e2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.170600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d2767-0bf2-46c0-bc2d-39d7f054e2a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.171415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d2767-0bf2-46c0-bc2d-39d7f054e2a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:10.171751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d2767-0bf2-46c0-bc2d-39d7f054e2a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:10.173586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d2767-0bf2-46c0-bc2d-39d7f054e2a3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:10.187544 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 638/1273] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:10.194287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ede32-a7e9-4c84-9482-d7b04dcc5517 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.205452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ede32-a7e9-4c84-9482-d7b04dcc5517 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.211492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2fd07-6ebf-42c7-a665-3563eb4d5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.212271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2fd07-6ebf-42c7-a665-3563eb4d5013 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.212546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2fd07-6ebf-42c7-a665-3563eb4d5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.212857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2fd07-6ebf-42c7-a665-3563eb4d5013 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.221940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2fd07-6ebf-42c7-a665-3563eb4d5013 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:10.224493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2fd07-6ebf-42c7-a665-3563eb4d5013 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:10.239821 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-63c2fd07-6ebf-42c7-a665-3563eb4d5013 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 27 20:34:10.241141 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 636/1274] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:34:10.248138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d2767-0bf2-46c0-bc2d-39d7f054e2a3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.259448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d2767-0bf2-46c0-bc2d-39d7f054e2a3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.264294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22521b1-d2c6-49f9-8af8-dc35187bfd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.265599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22521b1-d2c6-49f9-8af8-dc35187bfd82 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.265931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22521b1-d2c6-49f9-8af8-dc35187bfd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.266320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22521b1-d2c6-49f9-8af8-dc35187bfd82 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.267265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22521b1-d2c6-49f9-8af8-dc35187bfd82 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:10.267596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22521b1-d2c6-49f9-8af8-dc35187bfd82 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:10.269589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22521b1-d2c6-49f9-8af8-dc35187bfd82 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:10.288278 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 639/1275] 10.222.0.21 () {56 vars in 1164 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:34:10.295070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2fd07-6ebf-42c7-a665-3563eb4d5013 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.305143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2fd07-6ebf-42c7-a665-3563eb4d5013 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.310604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c871af-7e54-4230-a46b-666637948a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.311279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c871af-7e54-4230-a46b-666637948a89 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.312129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c871af-7e54-4230-a46b-666637948a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.312415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c871af-7e54-4230-a46b-666637948a89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.323124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c871af-7e54-4230-a46b-666637948a89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:10.324924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c871af-7e54-4230-a46b-666637948a89 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:10.334417 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 637/1276] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:34:10.341422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22521b1-d2c6-49f9-8af8-dc35187bfd82 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.351233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22521b1-d2c6-49f9-8af8-dc35187bfd82 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.356104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edd7d4-0613-42ed-b62a-1d1a7b8b0327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.356973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edd7d4-0613-42ed-b62a-1d1a7b8b0327 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.357250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edd7d4-0613-42ed-b62a-1d1a7b8b0327 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.357517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edd7d4-0613-42ed-b62a-1d1a7b8b0327 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.370006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edd7d4-0613-42ed-b62a-1d1a7b8b0327 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:10.372301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edd7d4-0613-42ed-b62a-1d1a7b8b0327 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:10.391052 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-f7edd7d4-0613-42ed-b62a-1d1a7b8b0327 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:10.392273 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 640/1277] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:10.399214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c871af-7e54-4230-a46b-666637948a89 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.408738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c871af-7e54-4230-a46b-666637948a89 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.413787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8cafd-57e3-459b-812b-c4fb62cf604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.414452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8cafd-57e3-459b-812b-c4fb62cf604b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.414738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8cafd-57e3-459b-812b-c4fb62cf604b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.415015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8cafd-57e3-459b-812b-c4fb62cf604b admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.415786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8cafd-57e3-459b-812b-c4fb62cf604b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:10.416086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8cafd-57e3-459b-812b-c4fb62cf604b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:10.417679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8cafd-57e3-459b-812b-c4fb62cf604b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:10.431306 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 638/1278] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:10.438207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edd7d4-0613-42ed-b62a-1d1a7b8b0327 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.448461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edd7d4-0613-42ed-b62a-1d1a7b8b0327 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.453287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8bbdf-747b-4465-b668-9b65dfd52675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.454057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8bbdf-747b-4465-b668-9b65dfd52675 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.454357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8bbdf-747b-4465-b668-9b65dfd52675 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.454641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8bbdf-747b-4465-b668-9b65dfd52675 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.461947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8bbdf-747b-4465-b668-9b65dfd52675 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:10.464098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8bbdf-747b-4465-b668-9b65dfd52675 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:10.477341 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-21c8bbdf-747b-4465-b668-9b65dfd52675 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:34:10.478509 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 641/1279] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:10.485598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8cafd-57e3-459b-812b-c4fb62cf604b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.495574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8cafd-57e3-459b-812b-c4fb62cf604b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.503606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13c41c-2518-4471-82fc-281e71eb4f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.504274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13c41c-2518-4471-82fc-281e71eb4f31 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.504551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13c41c-2518-4471-82fc-281e71eb4f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.504818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13c41c-2518-4471-82fc-281e71eb4f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.505611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13c41c-2518-4471-82fc-281e71eb4f31 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:10.505950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13c41c-2518-4471-82fc-281e71eb4f31 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:10.507778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13c41c-2518-4471-82fc-281e71eb4f31 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:10.520355 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 639/1280] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:34:10.527561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8bbdf-747b-4465-b668-9b65dfd52675 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:10.538041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8bbdf-747b-4465-b668-9b65dfd52675 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:10.542691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc941917-faf6-494f-9544-b3e062196574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:10.543346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941917-faf6-494f-9544-b3e062196574 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:10.543626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941917-faf6-494f-9544-b3e062196574 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:10.543897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941917-faf6-494f-9544-b3e062196574 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:10.544721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc941917-faf6-494f-9544-b3e062196574 admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=12473c7375ac477a85977655ccb3f514) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:10.545026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc941917-faf6-494f-9544-b3e062196574 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:10.547404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc941917-faf6-494f-9544-b3e062196574 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:10.552735 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 642/1281] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:34:10 2021] GET /identity/v3/role_assignments?user.id=12473c7375ac477a85977655ccb3f514&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:13.107083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1eb9a-e886-4a09-9349-0d6d37c3d1a2 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.107733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1eb9a-e886-4a09-9349-0d6d37c3d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.107733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1eb9a-e886-4a09-9349-0d6d37c3d1a2 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.110007 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 640/1282] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:34:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:34:13.117953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ba17a-1ee6-4565-b1ad-c2f1076c0505 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.117953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ba17a-1ee6-4565-b1ad-c2f1076c0505 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.117953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ba17a-1ee6-4565-b1ad-c2f1076c0505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.141080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c91ba17a-1ee6-4565-b1ad-c2f1076c0505 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:34:13.142292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c91ba17a-1ee6-4565-b1ad-c2f1076c0505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:34:13.150136 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 643/1283] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:34:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:34:13.175843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1eb9a-e886-4a09-9349-0d6d37c3d1a2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:13.188809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1eb9a-e886-4a09-9349-0d6d37c3d1a2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:13.193295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d512032-3e2d-4bc9-9e81-9c6e72cc191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:13.194100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d512032-3e2d-4bc9-9e81-9c6e72cc191d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.194380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d512032-3e2d-4bc9-9e81-9c6e72cc191d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.194651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d512032-3e2d-4bc9-9e81-9c6e72cc191d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.206811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d512032-3e2d-4bc9-9e81-9c6e72cc191d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:34:13.213765 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-6d512032-3e2d-4bc9-9e81-9c6e72cc191d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:34:13.215017 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 641/1284] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:34:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:13.221610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ba17a-1ee6-4565-b1ad-c2f1076c0505 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:13.230653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ba17a-1ee6-4565-b1ad-c2f1076c0505 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:13.235450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144b016-675b-4215-9188-b27f84df3fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:13.236132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144b016-675b-4215-9188-b27f84df3fbc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.236468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144b016-675b-4215-9188-b27f84df3fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.236745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144b016-675b-4215-9188-b27f84df3fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.237515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144b016-675b-4215-9188-b27f84df3fbc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:13.237817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144b016-675b-4215-9188-b27f84df3fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:13.239500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144b016-675b-4215-9188-b27f84df3fbc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:13.249948 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 644/1285] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:34:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:13.256194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d512032-3e2d-4bc9-9e81-9c6e72cc191d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:13.267053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d512032-3e2d-4bc9-9e81-9c6e72cc191d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:13.271745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcaae1c-3e01-4780-a476-296fdcbffd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:13.272538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaae1c-3e01-4780-a476-296fdcbffd44 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.272818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaae1c-3e01-4780-a476-296fdcbffd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.273089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcaae1c-3e01-4780-a476-296fdcbffd44 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.284063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcaae1c-3e01-4780-a476-296fdcbffd44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:13.285916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcaae1c-3e01-4780-a476-296fdcbffd44 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:13.306356 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-1bcaae1c-3e01-4780-a476-296fdcbffd44 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:13.309883 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 642/1286] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:13.318633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144b016-675b-4215-9188-b27f84df3fbc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:13.328894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144b016-675b-4215-9188-b27f84df3fbc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:13.333694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3a0b1-b892-411e-a488-17ab34fa06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:13.334480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3a0b1-b892-411e-a488-17ab34fa06da admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.334833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3a0b1-b892-411e-a488-17ab34fa06da admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.335174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3a0b1-b892-411e-a488-17ab34fa06da admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.336027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3a0b1-b892-411e-a488-17ab34fa06da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:13.336405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3a0b1-b892-411e-a488-17ab34fa06da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:13.338134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3a0b1-b892-411e-a488-17ab34fa06da admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:13.351336 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 645/1287] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:13.357852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcaae1c-3e01-4780-a476-296fdcbffd44 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:13.368209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcaae1c-3e01-4780-a476-296fdcbffd44 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:13.373030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308d3b1-d130-41b1-bee4-1c8270d4591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:13.373833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d3b1-d130-41b1-bee4-1c8270d4591d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.374777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d3b1-d130-41b1-bee4-1c8270d4591d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.375052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d3b1-d130-41b1-bee4-1c8270d4591d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.383036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308d3b1-d130-41b1-bee4-1c8270d4591d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:13.385085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308d3b1-d130-41b1-bee4-1c8270d4591d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:13.400342 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-1308d3b1-d130-41b1-bee4-1c8270d4591d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 27 20:34:13.401592 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 643/1288] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:13 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:13.408015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3a0b1-b892-411e-a488-17ab34fa06da admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:13.418059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3a0b1-b892-411e-a488-17ab34fa06da admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:13.423516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b2ed2-491c-440d-ae67-437a5b963fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:13.424206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b2ed2-491c-440d-ae67-437a5b963fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.424488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b2ed2-491c-440d-ae67-437a5b963fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.424759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b2ed2-491c-440d-ae67-437a5b963fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.425620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b2ed2-491c-440d-ae67-437a5b963fa1 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:13.425926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b2ed2-491c-440d-ae67-437a5b963fa1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:13.427999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b2ed2-491c-440d-ae67-437a5b963fa1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:13.447521 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 646/1289] 10.222.0.21 () {56 vars in 1164 bytes} [Sat Nov 27 20:34:13 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:13.453775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308d3b1-d130-41b1-bee4-1c8270d4591d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:13.463620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308d3b1-d130-41b1-bee4-1c8270d4591d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:13.468179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379cb74-f390-457d-8da1-15bd516b1e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:13.468952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379cb74-f390-457d-8da1-15bd516b1e9f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.469237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379cb74-f390-457d-8da1-15bd516b1e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.469510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379cb74-f390-457d-8da1-15bd516b1e9f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.479691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379cb74-f390-457d-8da1-15bd516b1e9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:13.481507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379cb74-f390-457d-8da1-15bd516b1e9f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:13.498819 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-a379cb74-f390-457d-8da1-15bd516b1e9f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:13.500098 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 644/1290] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:13.506345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b2ed2-491c-440d-ae67-437a5b963fa1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:13.516753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b2ed2-491c-440d-ae67-437a5b963fa1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:13.521325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99114b-b626-45dd-9e9b-8434a102b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:13.521982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99114b-b626-45dd-9e9b-8434a102b75f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.522265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99114b-b626-45dd-9e9b-8434a102b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.522546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99114b-b626-45dd-9e9b-8434a102b75f admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.523951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99114b-b626-45dd-9e9b-8434a102b75f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:13.524332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99114b-b626-45dd-9e9b-8434a102b75f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:13.526000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99114b-b626-45dd-9e9b-8434a102b75f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:13.537480 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 647/1291] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:13.543698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379cb74-f390-457d-8da1-15bd516b1e9f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:13.555028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379cb74-f390-457d-8da1-15bd516b1e9f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:13.559756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90090513-8fd7-420a-bb59-12a6e7711e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:13.560536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090513-8fd7-420a-bb59-12a6e7711e4e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.560813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090513-8fd7-420a-bb59-12a6e7711e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.561083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090513-8fd7-420a-bb59-12a6e7711e4e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.568100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90090513-8fd7-420a-bb59-12a6e7711e4e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:13.570036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90090513-8fd7-420a-bb59-12a6e7711e4e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:13.583275 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-90090513-8fd7-420a-bb59-12a6e7711e4e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:34:13.584438 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 645/1292] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:34:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:13.590865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99114b-b626-45dd-9e9b-8434a102b75f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:13.600798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99114b-b626-45dd-9e9b-8434a102b75f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:13.605378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125cdbf-579d-499a-85b6-8895befbc2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:13.606023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125cdbf-579d-499a-85b6-8895befbc2fc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.606306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125cdbf-579d-499a-85b6-8895befbc2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.606580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125cdbf-579d-499a-85b6-8895befbc2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.607400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125cdbf-579d-499a-85b6-8895befbc2fc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:13.607707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125cdbf-579d-499a-85b6-8895befbc2fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:13.610177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125cdbf-579d-499a-85b6-8895befbc2fc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:13.623674 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 648/1293] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:34:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:13.630232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90090513-8fd7-420a-bb59-12a6e7711e4e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:13.641690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90090513-8fd7-420a-bb59-12a6e7711e4e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:13.646339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7d952-7e70-4f57-9e98-55d9ccb6850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:13.647203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7d952-7e70-4f57-9e98-55d9ccb6850e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:13.647513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7d952-7e70-4f57-9e98-55d9ccb6850e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:13.647785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7d952-7e70-4f57-9e98-55d9ccb6850e admin admin] PATH_INFO: `/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/12473c7375ac477a85977655ccb3f514/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:13.649740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7d952-7e70-4f57-9e98-55d9ccb6850e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c371d9310548a3ac5cf1cb274d0e34, user_id=12473c7375ac477a85977655ccb3f514, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:13.652381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7d952-7e70-4f57-9e98-55d9ccb6850e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:13.666285 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 646/1294] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:34:13 2021] PUT /identity/v3/projects/59c371d9310548a3ac5cf1cb274d0e34/users/12473c7375ac477a85977655ccb3f514/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:34:16.072411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8a669-bbb6-4e68-9e59-8bc18897ef29 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.072953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8a669-bbb6-4e68-9e59-8bc18897ef29 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.073049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8a669-bbb6-4e68-9e59-8bc18897ef29 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.074890 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 649/1295] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:34:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:34:16.081363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a438769-861d-48e6-9f6e-377396ab365b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.081870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a438769-861d-48e6-9f6e-377396ab365b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.081870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a438769-861d-48e6-9f6e-377396ab365b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.100374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1a438769-861d-48e6-9f6e-377396ab365b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:34:16.101584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1a438769-861d-48e6-9f6e-377396ab365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:34:16.159687 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 647/1296] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:34:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:34:16.185795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8a669-bbb6-4e68-9e59-8bc18897ef29 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.197727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8a669-bbb6-4e68-9e59-8bc18897ef29 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.202019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb32d-da0c-4947-a2d3-e0c510eaebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.202775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb32d-da0c-4947-a2d3-e0c510eaebb3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.203058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb32d-da0c-4947-a2d3-e0c510eaebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.203364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deb32d-da0c-4947-a2d3-e0c510eaebb3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.213175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deb32d-da0c-4947-a2d3-e0c510eaebb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:34:16.220473 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-59deb32d-da0c-4947-a2d3-e0c510eaebb3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 27 20:34:16.221615 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 650/1297] 10.222.0.21 () {56 vars in 1117 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:16.227593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a438769-861d-48e6-9f6e-377396ab365b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.236813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a438769-861d-48e6-9f6e-377396ab365b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.241327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896a08f-e882-4d9d-8005-9e99e61dc5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.241964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a08f-e882-4d9d-8005-9e99e61dc5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.242242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a08f-e882-4d9d-8005-9e99e61dc5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.242513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a08f-e882-4d9d-8005-9e99e61dc5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.243306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896a08f-e882-4d9d-8005-9e99e61dc5b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:16.243611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896a08f-e882-4d9d-8005-9e99e61dc5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:16.245164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896a08f-e882-4d9d-8005-9e99e61dc5b7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:16.253413 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 648/1298] 10.222.0.21 () {56 vars in 1120 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:16.259188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb32d-da0c-4947-a2d3-e0c510eaebb3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.268984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deb32d-da0c-4947-a2d3-e0c510eaebb3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.273448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b02bd6-0d39-490b-98c1-34c7fe363eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.274181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b02bd6-0d39-490b-98c1-34c7fe363eae admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.274460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b02bd6-0d39-490b-98c1-34c7fe363eae admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.274730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b02bd6-0d39-490b-98c1-34c7fe363eae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.403815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b02bd6-0d39-490b-98c1-34c7fe363eae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:16.405613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b02bd6-0d39-490b-98c1-34c7fe363eae admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:16.422219 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-57b02bd6-0d39-490b-98c1-34c7fe363eae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:16.423384 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 651/1299] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:16.430038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896a08f-e882-4d9d-8005-9e99e61dc5b7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.440285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896a08f-e882-4d9d-8005-9e99e61dc5b7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.444827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ce47e-57c7-4055-900d-5304ec1f27ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.445825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ce47e-57c7-4055-900d-5304ec1f27ac admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.445825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ce47e-57c7-4055-900d-5304ec1f27ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.446007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ce47e-57c7-4055-900d-5304ec1f27ac admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.446717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ce47e-57c7-4055-900d-5304ec1f27ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:16.447020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ce47e-57c7-4055-900d-5304ec1f27ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:16.448719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ce47e-57c7-4055-900d-5304ec1f27ac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:16.460515 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 649/1300] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:34:16.466504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b02bd6-0d39-490b-98c1-34c7fe363eae admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.475958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b02bd6-0d39-490b-98c1-34c7fe363eae admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.480391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0a5ea-52c6-46d0-ae41-c241be69d28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.481158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0a5ea-52c6-46d0-ae41-c241be69d28e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.481433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0a5ea-52c6-46d0-ae41-c241be69d28e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.481705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0a5ea-52c6-46d0-ae41-c241be69d28e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.489679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0a5ea-52c6-46d0-ae41-c241be69d28e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:16.491723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0a5ea-52c6-46d0-ae41-c241be69d28e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:16.505645 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-3fd0a5ea-52c6-46d0-ae41-c241be69d28e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 27 20:34:16.506741 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 652/1301] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:16.512660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ce47e-57c7-4055-900d-5304ec1f27ac admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.522294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ce47e-57c7-4055-900d-5304ec1f27ac admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.526799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6cb73-89e2-4505-b677-fba8e3b4170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.527483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6cb73-89e2-4505-b677-fba8e3b4170c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.527767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6cb73-89e2-4505-b677-fba8e3b4170c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.528039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6cb73-89e2-4505-b677-fba8e3b4170c admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.528877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6cb73-89e2-4505-b677-fba8e3b4170c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:16.529186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6cb73-89e2-4505-b677-fba8e3b4170c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:16.530990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6cb73-89e2-4505-b677-fba8e3b4170c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:16.548048 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 650/1302] 10.222.0.21 () {56 vars in 1164 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:34:16.553682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0a5ea-52c6-46d0-ae41-c241be69d28e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.563884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0a5ea-52c6-46d0-ae41-c241be69d28e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.568335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407eab5f-a02b-4d95-a740-e3f00f7148cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.568951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eab5f-a02b-4d95-a740-e3f00f7148cb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.569231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eab5f-a02b-4d95-a740-e3f00f7148cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.569503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407eab5f-a02b-4d95-a740-e3f00f7148cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.577121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407eab5f-a02b-4d95-a740-e3f00f7148cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:16.578835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407eab5f-a02b-4d95-a740-e3f00f7148cb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:16.587393 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 653/1303] 10.222.0.21 () {58 vars in 1324 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:34:16.593029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6cb73-89e2-4505-b677-fba8e3b4170c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.602466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6cb73-89e2-4505-b677-fba8e3b4170c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.606972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf61404-c884-493e-8357-0f22b1db6da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.607769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61404-c884-493e-8357-0f22b1db6da9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.608050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61404-c884-493e-8357-0f22b1db6da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.608827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61404-c884-493e-8357-0f22b1db6da9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.618684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf61404-c884-493e-8357-0f22b1db6da9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:16.620512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf61404-c884-493e-8357-0f22b1db6da9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:16.638764 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-4bf61404-c884-493e-8357-0f22b1db6da9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 27 20:34:16.639963 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 651/1304] 10.222.0.21 () {56 vars in 1129 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 27 20:34:16.647864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407eab5f-a02b-4d95-a740-e3f00f7148cb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.658191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407eab5f-a02b-4d95-a740-e3f00f7148cb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.662722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36150d-aec3-4539-8e59-322752fc5fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.663400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36150d-aec3-4539-8e59-322752fc5fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.663683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36150d-aec3-4539-8e59-322752fc5fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.663955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36150d-aec3-4539-8e59-322752fc5fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.664684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36150d-aec3-4539-8e59-322752fc5fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:16.664986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36150d-aec3-4539-8e59-322752fc5fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:16.666596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36150d-aec3-4539-8e59-322752fc5fa1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:16.678842 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 654/1305] 10.222.0.21 () {56 vars in 1130 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:16.684729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf61404-c884-493e-8357-0f22b1db6da9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.694525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf61404-c884-493e-8357-0f22b1db6da9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.698961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaade87-d92a-47cf-a9bf-64bf1acf128b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.699750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaade87-d92a-47cf-a9bf-64bf1acf128b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.700032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaade87-d92a-47cf-a9bf-64bf1acf128b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.700304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaade87-d92a-47cf-a9bf-64bf1acf128b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.706905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaade87-d92a-47cf-a9bf-64bf1acf128b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:16.708871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaade87-d92a-47cf-a9bf-64bf1acf128b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:16.721923 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-afaade87-d92a-47cf-a9bf-64bf1acf128b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 27 20:34:16.723021 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 652/1306] 10.222.0.21 () {56 vars in 1132 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:16.728937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36150d-aec3-4539-8e59-322752fc5fa1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.738772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36150d-aec3-4539-8e59-322752fc5fa1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.743161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee2a41-a89e-4fcc-ab41-76750f7c760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.743828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee2a41-a89e-4fcc-ab41-76750f7c760f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.744105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee2a41-a89e-4fcc-ab41-76750f7c760f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.744371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee2a41-a89e-4fcc-ab41-76750f7c760f admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.745136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee2a41-a89e-4fcc-ab41-76750f7c760f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:16.745434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee2a41-a89e-4fcc-ab41-76750f7c760f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:16.747497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee2a41-a89e-4fcc-ab41-76750f7c760f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:16.758892 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 655/1307] 10.222.0.21 () {56 vars in 1169 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:16.765803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaade87-d92a-47cf-a9bf-64bf1acf128b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:16.776805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaade87-d92a-47cf-a9bf-64bf1acf128b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:16.781764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0e1ef-c0b5-4442-a196-85bfe26c2eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:16.782378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0e1ef-c0b5-4442-a196-85bfe26c2eeb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:16.782658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0e1ef-c0b5-4442-a196-85bfe26c2eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:16.782930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0e1ef-c0b5-4442-a196-85bfe26c2eeb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:16.783793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0e1ef-c0b5-4442-a196-85bfe26c2eeb admin admin] RBAC: Adding query filter params (role.id=f0f7eb6ce00345e79b333982649f1ff7, scope.project.id=59c371d9310548a3ac5cf1cb274d0e34, user.id=12473c7375ac477a85977655ccb3f514) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:16.784103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0e1ef-c0b5-4442-a196-85bfe26c2eeb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:16.785914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0e1ef-c0b5-4442-a196-85bfe26c2eeb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:16.791516 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 653/1308] 10.222.0.21 () {56 vars in 1395 bytes} [Sat Nov 27 20:34:16 2021] GET /identity/v3/role_assignments?user.id=12473c7375ac477a85977655ccb3f514&scope.project.id=59c371d9310548a3ac5cf1cb274d0e34&role.id=f0f7eb6ce00345e79b333982649f1ff7 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:19.207365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea10d7c-91fa-4703-b67b-9971cfbcc419 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:19.207897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea10d7c-91fa-4703-b67b-9971cfbcc419 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:19.207897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea10d7c-91fa-4703-b67b-9971cfbcc419 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:19.209650 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 656/1309] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:34:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:34:19.215562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ed59-7bf9-4b06-8fcf-8bb2ddc026ef None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:19.215987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ed59-7bf9-4b06-8fcf-8bb2ddc026ef None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:19.216105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484ed59-7bf9-4b06-8fcf-8bb2ddc026ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:19.233062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9484ed59-7bf9-4b06-8fcf-8bb2ddc026ef None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:34:19.234253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9484ed59-7bf9-4b06-8fcf-8bb2ddc026ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:34:19.241662 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 654/1310] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:34:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:34:19.266619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea10d7c-91fa-4703-b67b-9971cfbcc419 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:19.278447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea10d7c-91fa-4703-b67b-9971cfbcc419 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:19.282760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7a71e-186d-4d4d-b96e-84d09ab636af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:19.283553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7a71e-186d-4d4d-b96e-84d09ab636af admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:19.283835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7a71e-186d-4d4d-b96e-84d09ab636af admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:19.284106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7a71e-186d-4d4d-b96e-84d09ab636af admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:19.284756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7a71e-186d-4d4d-b96e-84d09ab636af admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:19.286336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7a71e-186d-4d4d-b96e-84d09ab636af admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:19.297410 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-8ed7a71e-186d-4d4d-b96e-84d09ab636af admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 27 20:34:19.298497 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 657/1311] 10.222.0.21 () {56 vars in 1138 bytes} [Sat Nov 27 20:34:19 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:19.304516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484ed59-7bf9-4b06-8fcf-8bb2ddc026ef None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:19.313652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484ed59-7bf9-4b06-8fcf-8bb2ddc026ef None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:19.318111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4aeb45-e7d4-4a15-b65a-a5921ab7edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:19.318738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aeb45-e7d4-4a15-b65a-a5921ab7edd5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:19.319016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aeb45-e7d4-4a15-b65a-a5921ab7edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:19.319322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aeb45-e7d4-4a15-b65a-a5921ab7edd5 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:19.320029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aeb45-e7d4-4a15-b65a-a5921ab7edd5 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:19.320329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aeb45-e7d4-4a15-b65a-a5921ab7edd5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:19.321871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aeb45-e7d4-4a15-b65a-a5921ab7edd5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:19.326674 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 655/1312] 10.222.0.21 () {56 vars in 1137 bytes} [Sat Nov 27 20:34:19 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:19.332221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7a71e-186d-4d4d-b96e-84d09ab636af admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:19.341309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7a71e-186d-4d4d-b96e-84d09ab636af admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:19.345733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfec2e8-2850-46aa-a075-055c3ce4aa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:19.346336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec2e8-2850-46aa-a075-055c3ce4aa23 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:19.346612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec2e8-2850-46aa-a075-055c3ce4aa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:19.346879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfec2e8-2850-46aa-a075-055c3ce4aa23 admin admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:19.347600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfec2e8-2850-46aa-a075-055c3ce4aa23 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:19.347897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfec2e8-2850-46aa-a075-055c3ce4aa23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:19.349449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfec2e8-2850-46aa-a075-055c3ce4aa23 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:19.358902 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 658/1313] 10.222.0.21 () {56 vars in 1137 bytes} [Sat Nov 27 20:34:19 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:21.750974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad306d5-476c-4b66-b9ef-fd38e021adfd None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:21.751526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad306d5-476c-4b66-b9ef-fd38e021adfd None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:21.751526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad306d5-476c-4b66-b9ef-fd38e021adfd None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:21.753230 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 656/1314] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:34:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:34:21.758981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a248fa-91b7-442c-b610-e0d4d3779ed9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:21.759523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a248fa-91b7-442c-b610-e0d4d3779ed9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:21.759616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a248fa-91b7-442c-b610-e0d4d3779ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:21.777434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b0a248fa-91b7-442c-b610-e0d4d3779ed9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:34:21.778608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b0a248fa-91b7-442c-b610-e0d4d3779ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:34:21.786788 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 659/1315] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:34:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:34:21.810979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad306d5-476c-4b66-b9ef-fd38e021adfd None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:21.822912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad306d5-476c-4b66-b9ef-fd38e021adfd None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:21.828124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df223424-f84c-42ba-afce-2b07d2248c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:21.828765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223424-f84c-42ba-afce-2b07d2248c1a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:21.829045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223424-f84c-42ba-afce-2b07d2248c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:21.829323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223424-f84c-42ba-afce-2b07d2248c1a admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:21.830050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df223424-f84c-42ba-afce-2b07d2248c1a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:21.831654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df223424-f84c-42ba-afce-2b07d2248c1a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:21.845205 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 657/1316] 10.222.0.21 () {60 vars in 1162 bytes} [Sat Nov 27 20:34:21 2021] POST /identity/v3/services => generated 246 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:34:24.262407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012ddda-8a6b-4b44-a43e-510f08efd9ad None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:24.262976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012ddda-8a6b-4b44-a43e-510f08efd9ad None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:24.262976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012ddda-8a6b-4b44-a43e-510f08efd9ad None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:24.265355 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 660/1317] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:34:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:34:24.270991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae09f88-c921-49df-9f2b-fde93cacf7e7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:24.271438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae09f88-c921-49df-9f2b-fde93cacf7e7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:24.271577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae09f88-c921-49df-9f2b-fde93cacf7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:24.288750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8ae09f88-c921-49df-9f2b-fde93cacf7e7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:34:24.289925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8ae09f88-c921-49df-9f2b-fde93cacf7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:34:24.306651 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 658/1318] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:34:24 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:34:24.332315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012ddda-8a6b-4b44-a43e-510f08efd9ad None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:24.344271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012ddda-8a6b-4b44-a43e-510f08efd9ad None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:24.348623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553ab8b-74f4-4438-bbc1-1b594704de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:24.349386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553ab8b-74f4-4438-bbc1-1b594704de99 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:24.349666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553ab8b-74f4-4438-bbc1-1b594704de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:24.349937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553ab8b-74f4-4438-bbc1-1b594704de99 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:24.350596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553ab8b-74f4-4438-bbc1-1b594704de99 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:24.352323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553ab8b-74f4-4438-bbc1-1b594704de99 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:24.362949 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-4553ab8b-74f4-4438-bbc1-1b594704de99 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 27 20:34:24.364114 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 661/1319] 10.222.0.21 () {56 vars in 1138 bytes} [Sat Nov 27 20:34:24 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:24.370056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae09f88-c921-49df-9f2b-fde93cacf7e7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:24.379584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae09f88-c921-49df-9f2b-fde93cacf7e7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:24.384069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea596593-5947-4b83-ba11-dc6a6e06782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:24.384706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596593-5947-4b83-ba11-dc6a6e06782e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:24.384990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596593-5947-4b83-ba11-dc6a6e06782e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:24.385267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea596593-5947-4b83-ba11-dc6a6e06782e admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:24.385991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea596593-5947-4b83-ba11-dc6a6e06782e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:24.386297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea596593-5947-4b83-ba11-dc6a6e06782e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:24.387907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea596593-5947-4b83-ba11-dc6a6e06782e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:24.393437 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 659/1320] 10.222.0.21 () {56 vars in 1137 bytes} [Sat Nov 27 20:34:24 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:24.399232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553ab8b-74f4-4438-bbc1-1b594704de99 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:24.408561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553ab8b-74f4-4438-bbc1-1b594704de99 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:24.413096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7031e76-01b6-4d7c-be71-29d5996ee4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:24.413710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7031e76-01b6-4d7c-be71-29d5996ee4df admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:24.413995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7031e76-01b6-4d7c-be71-29d5996ee4df admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:24.414271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7031e76-01b6-4d7c-be71-29d5996ee4df admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:24.415053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7031e76-01b6-4d7c-be71-29d5996ee4df admin admin] RBAC: Adding query filter params (interface=public, service_id=e64b7a6404774ee796d3f00c49489ed6, region_id=RegionOne) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:24.415402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7031e76-01b6-4d7c-be71-29d5996ee4df admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:24.416951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7031e76-01b6-4d7c-be71-29d5996ee4df admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:24.421762 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 662/1321] 10.222.0.21 () {56 vars in 1272 bytes} [Sat Nov 27 20:34:24 2021] GET /identity/v3/endpoints?service_id=e64b7a6404774ee796d3f00c49489ed6&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:34:24.427264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea596593-5947-4b83-ba11-dc6a6e06782e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:24.437200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea596593-5947-4b83-ba11-dc6a6e06782e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:24.441659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb53202-4ca4-421d-83b6-3aac94e01fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:24.442285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53202-4ca4-421d-83b6-3aac94e01fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:24.442562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53202-4ca4-421d-83b6-3aac94e01fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:24.442831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb53202-4ca4-421d-83b6-3aac94e01fe3 admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:24.443539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb53202-4ca4-421d-83b6-3aac94e01fe3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:24.445082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb53202-4ca4-421d-83b6-3aac94e01fe3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:24.451658 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 660/1322] 10.222.0.21 () {56 vars in 1108 bytes} [Sat Nov 27 20:34:24 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:34:26.837492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a944b45-58d5-4814-a6e8-656ad48105c4 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:26.838013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a944b45-58d5-4814-a6e8-656ad48105c4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:26.838104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a944b45-58d5-4814-a6e8-656ad48105c4 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:26.839882 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 663/1323] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:34:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:34:26.846743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec294df-d882-4116-89f6-91f73e383c5a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:26.847196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec294df-d882-4116-89f6-91f73e383c5a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:26.847333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec294df-d882-4116-89f6-91f73e383c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:26.866142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2ec294df-d882-4116-89f6-91f73e383c5a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:34:26.867426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2ec294df-d882-4116-89f6-91f73e383c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:34:26.875459 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 661/1324] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:34:26 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:34:26.901042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a944b45-58d5-4814-a6e8-656ad48105c4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:26.913612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a944b45-58d5-4814-a6e8-656ad48105c4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:26.917922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f9ebc-9539-463e-9542-20c2337e0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:26.918692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f9ebc-9539-463e-9542-20c2337e0171 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:26.918975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f9ebc-9539-463e-9542-20c2337e0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:26.919268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f9ebc-9539-463e-9542-20c2337e0171 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:26.919926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f9ebc-9539-463e-9542-20c2337e0171 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:26.921530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f9ebc-9539-463e-9542-20c2337e0171 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:26.932157 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-8b1f9ebc-9539-463e-9542-20c2337e0171 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 27 20:34:26.933252 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 664/1325] 10.222.0.21 () {56 vars in 1138 bytes} [Sat Nov 27 20:34:26 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:34:26.939246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec294df-d882-4116-89f6-91f73e383c5a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:26.947841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec294df-d882-4116-89f6-91f73e383c5a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:26.952730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e354b57-9be9-4bb5-909a-38f145908c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:26.953358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e354b57-9be9-4bb5-909a-38f145908c8c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:26.953636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e354b57-9be9-4bb5-909a-38f145908c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:26.953904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e354b57-9be9-4bb5-909a-38f145908c8c admin admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:26.954718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e354b57-9be9-4bb5-909a-38f145908c8c admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:34:26.955025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e354b57-9be9-4bb5-909a-38f145908c8c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:26.956621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e354b57-9be9-4bb5-909a-38f145908c8c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:26.961512 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 662/1326] 10.222.0.21 () {56 vars in 1137 bytes} [Sat Nov 27 20:34:26 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:34:26.967158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f9ebc-9539-463e-9542-20c2337e0171 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:34:26.977548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f9ebc-9539-463e-9542-20c2337e0171 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:34:26.982010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b4e8b-c453-444a-8e31-652cdd530117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:34:26.982617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b4e8b-c453-444a-8e31-652cdd530117 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:34:26.982894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b4e8b-c453-444a-8e31-652cdd530117 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:34:26.983163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b4e8b-c453-444a-8e31-652cdd530117 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:34:26.983939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b4e8b-c453-444a-8e31-652cdd530117 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:34:26.985461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b4e8b-c453-444a-8e31-652cdd530117 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:34:27.003082 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 665/1327] 10.222.0.21 () {60 vars in 1165 bytes} [Sat Nov 27 20:34:26 2021] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:35:37.208671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bea3f5-a4f8-4f9c-a569-6e724c735cf7 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:37.209229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bea3f5-a4f8-4f9c-a569-6e724c735cf7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:37.209229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bea3f5-a4f8-4f9c-a569-6e724c735cf7 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:37.211156 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 663/1328] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:35:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:35:37.217599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225cb23-e2a2-4da4-a11c-c9b8d3270a35 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:37.218771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225cb23-e2a2-4da4-a11c-c9b8d3270a35 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:37.219289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225cb23-e2a2-4da4-a11c-c9b8d3270a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:37.362404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7225cb23-e2a2-4da4-a11c-c9b8d3270a35 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:35:37.365303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7225cb23-e2a2-4da4-a11c-c9b8d3270a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:37.527272 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 666/1329] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:35:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:35:37.540452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bea3f5-a4f8-4f9c-a569-6e724c735cf7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:35:37.542731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-32bea3f5-a4f8-4f9c-a569-6e724c735cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:37.743697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bea3f5-a4f8-4f9c-a569-6e724c735cf7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:35:37.853644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0c89d-7a32-4f70-962d-51df230ce657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:35:37.854705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0c89d-7a32-4f70-962d-51df230ce657 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:37.855186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0c89d-7a32-4f70-962d-51df230ce657 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:37.855673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0c89d-7a32-4f70-962d-51df230ce657 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:37.856871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0c89d-7a32-4f70-962d-51df230ce657 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:35:37.859647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0c89d-7a32-4f70-962d-51df230ce657 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:35:37.885444 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 664/1330] 10.222.0.21 () {56 vars in 1108 bytes} [Sat Nov 27 20:35:37 2021] GET /identity/v3/projects => generated 2553 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:35:40.416040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9668-3634-49a4-93ed-1bd4f0e4feab None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:40.416594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9668-3634-49a4-93ed-1bd4f0e4feab None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:40.416594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9668-3634-49a4-93ed-1bd4f0e4feab None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:40.418500 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 667/1331] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:35:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:35:40.424782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07827ea-4e5d-4450-9bbb-f98e9f1d094a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:40.425200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07827ea-4e5d-4450-9bbb-f98e9f1d094a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:40.425374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07827ea-4e5d-4450-9bbb-f98e9f1d094a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:40.518020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f07827ea-4e5d-4450-9bbb-f98e9f1d094a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:35:40.519210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f07827ea-4e5d-4450-9bbb-f98e9f1d094a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:40.610097 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 665/1332] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:35:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:35:40.662659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9ac5-c13d-4e9c-92bd-74e96505e11a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:40.662939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9ac5-c13d-4e9c-92bd-74e96505e11a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:40.663209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f9ac5-c13d-4e9c-92bd-74e96505e11a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:40.665007 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 668/1333] 10.222.0.21 () {54 vars in 964 bytes} [Sat Nov 27 20:35:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:35:40.671829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee2a4a-635f-40e5-9f98-c841d85f20a5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:40.672237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee2a4a-635f-40e5-9f98-c841d85f20a5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:40.672597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee2a4a-635f-40e5-9f98-c841d85f20a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:40.746215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-01ee2a4a-635f-40e5-9f98-c841d85f20a5 None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:35:40.747444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-01ee2a4a-635f-40e5-9f98-c841d85f20a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:40.938157 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 666/1334] 10.222.0.21 () {58 vars in 1061 bytes} [Sat Nov 27 20:35:40 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:35:40.947443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f9ac5-c13d-4e9c-92bd-74e96505e11a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:35:40.948931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-038f9ac5-c13d-4e9c-92bd-74e96505e11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:41.048968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f9ac5-c13d-4e9c-92bd-74e96505e11a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:35:41.132413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f931d6-6aeb-4997-8101-0ee41c5a5f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:35:41.133055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f931d6-6aeb-4997-8101-0ee41c5a5f7c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:41.133331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f931d6-6aeb-4997-8101-0ee41c5a5f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:41.133599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f931d6-6aeb-4997-8101-0ee41c5a5f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:41.135200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-66f931d6-6aeb-4997-8101-0ee41c5a5f7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:41.238126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f931d6-6aeb-4997-8101-0ee41c5a5f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:35:41.239531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f931d6-6aeb-4997-8101-0ee41c5a5f7c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:35:41.257980 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 669/1335] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:35:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:35:43.980303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a6f18-e827-4b3e-972f-655726359a47 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:43.980823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a6f18-e827-4b3e-972f-655726359a47 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:43.980823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a6f18-e827-4b3e-972f-655726359a47 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:43.982591 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 667/1336] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:35:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:35:43.988436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabc626-2553-4eef-a8e2-37babbf70818 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:43.988859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabc626-2553-4eef-a8e2-37babbf70818 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:43.988984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabc626-2553-4eef-a8e2-37babbf70818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:44.051938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6fabc626-2553-4eef-a8e2-37babbf70818 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:35:44.053110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6fabc626-2553-4eef-a8e2-37babbf70818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:44.145194 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 670/1337] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:35:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:35:44.186592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a6f18-e827-4b3e-972f-655726359a47 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:35:44.188123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bd6a6f18-e827-4b3e-972f-655726359a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:44.285733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a6f18-e827-4b3e-972f-655726359a47 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:35:44.354505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc42e7c-0e8e-4968-8b6f-d107a2c6cf69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:35:44.355141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42e7c-0e8e-4968-8b6f-d107a2c6cf69 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:44.355456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42e7c-0e8e-4968-8b6f-d107a2c6cf69 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:44.355735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc42e7c-0e8e-4968-8b6f-d107a2c6cf69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:44.357873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dfc42e7c-0e8e-4968-8b6f-d107a2c6cf69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:44.460764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc42e7c-0e8e-4968-8b6f-d107a2c6cf69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:35:44.462224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc42e7c-0e8e-4968-8b6f-d107a2c6cf69 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:35:44.480162 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 668/1338] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:35:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:35:47.203123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173951a1-78fc-4a8c-a88b-7ff953158efb None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:47.203717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173951a1-78fc-4a8c-a88b-7ff953158efb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:47.203717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173951a1-78fc-4a8c-a88b-7ff953158efb None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:47.205493 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 671/1339] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:35:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:35:47.211320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b464da-980f-495f-8f3e-570b00997ea7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:47.211721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b464da-980f-495f-8f3e-570b00997ea7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:47.211874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b464da-980f-495f-8f3e-570b00997ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:47.273687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b8b464da-980f-495f-8f3e-570b00997ea7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:35:47.274864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b8b464da-980f-495f-8f3e-570b00997ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:47.365706 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 669/1340] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:35:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:35:47.405975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173951a1-78fc-4a8c-a88b-7ff953158efb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:35:47.407600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-173951a1-78fc-4a8c-a88b-7ff953158efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:47.528148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173951a1-78fc-4a8c-a88b-7ff953158efb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:35:47.619191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1245dc-6791-45c4-8ffd-785e99f97127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:35:47.620066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1245dc-6791-45c4-8ffd-785e99f97127 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:47.620344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1245dc-6791-45c4-8ffd-785e99f97127 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:47.620617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1245dc-6791-45c4-8ffd-785e99f97127 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:47.630893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1245dc-6791-45c4-8ffd-785e99f97127 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:35:47.632973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1245dc-6791-45c4-8ffd-785e99f97127 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:35:47.634641 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 672/1341] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:35:47 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:35:47.647940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b464da-980f-495f-8f3e-570b00997ea7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:35:47.649158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b8b464da-980f-495f-8f3e-570b00997ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:47.739166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b464da-980f-495f-8f3e-570b00997ea7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:35:47.809407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab5413-b37f-45c1-b934-4fceb0ee1cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:35:47.810009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5413-b37f-45c1-b934-4fceb0ee1cfa service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:47.810811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5413-b37f-45c1-b934-4fceb0ee1cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:47.811088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab5413-b37f-45c1-b934-4fceb0ee1cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:47.812743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-52ab5413-b37f-45c1-b934-4fceb0ee1cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:47.914703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab5413-b37f-45c1-b934-4fceb0ee1cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:35:47.916163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab5413-b37f-45c1-b934-4fceb0ee1cfa service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:35:47.933791 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 670/1342] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:35:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:35:50.857304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39716-6884-4d9a-8456-037f1ab342d9 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:50.857868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39716-6884-4d9a-8456-037f1ab342d9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:50.857868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f39716-6884-4d9a-8456-037f1ab342d9 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:50.859638 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 673/1343] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:35:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:35:50.865385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56621c-a01e-45fa-aad5-645449fe305d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:50.865810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56621c-a01e-45fa-aad5-645449fe305d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:50.865929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56621c-a01e-45fa-aad5-645449fe305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:50.931178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ac56621c-a01e-45fa-aad5-645449fe305d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:35:50.932377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ac56621c-a01e-45fa-aad5-645449fe305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:51.038576 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 671/1344] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:35:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:35:51.075794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f39716-6884-4d9a-8456-037f1ab342d9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:35:51.077407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-40f39716-6884-4d9a-8456-037f1ab342d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:51.198856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f39716-6884-4d9a-8456-037f1ab342d9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:35:51.287594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f2170-3687-4ae3-a4b3-1aaade03fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:35:51.288442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f2170-3687-4ae3-a4b3-1aaade03fb03 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:51.288723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f2170-3687-4ae3-a4b3-1aaade03fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:51.288994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f2170-3687-4ae3-a4b3-1aaade03fb03 admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:51.299672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f2170-3687-4ae3-a4b3-1aaade03fb03 admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:35:51.301739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f2170-3687-4ae3-a4b3-1aaade03fb03 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:35:51.303587 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 674/1345] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:35:51 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:35:51.315678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56621c-a01e-45fa-aad5-645449fe305d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:35:51.316868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ac56621c-a01e-45fa-aad5-645449fe305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:51.403502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56621c-a01e-45fa-aad5-645449fe305d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:35:51.474287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b2372-f0ea-46e8-89b7-e382d98a8cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:35:51.474894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2372-f0ea-46e8-89b7-e382d98a8cdf service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:51.475178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2372-f0ea-46e8-89b7-e382d98a8cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:51.475482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2372-f0ea-46e8-89b7-e382d98a8cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:51.477101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-879b2372-f0ea-46e8-89b7-e382d98a8cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:51.582475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b2372-f0ea-46e8-89b7-e382d98a8cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:35:51.583950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b2372-f0ea-46e8-89b7-e382d98a8cdf service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:35:51.601797 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 672/1346] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:35:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:35:54.662174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dfc19-bdde-42b4-859c-caab908ad882 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:54.662701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dfc19-bdde-42b4-859c-caab908ad882 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:54.662701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dfc19-bdde-42b4-859c-caab908ad882 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:54.664527 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 675/1347] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:35:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:35:54.670924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c7427-f775-45ad-94db-cad996cff635 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:54.671367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c7427-f775-45ad-94db-cad996cff635 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:54.671512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c7427-f775-45ad-94db-cad996cff635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:54.734188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f09c7427-f775-45ad-94db-cad996cff635 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:35:54.735332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f09c7427-f775-45ad-94db-cad996cff635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:54.826993 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 673/1348] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:35:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:35:54.865429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dfc19-bdde-42b4-859c-caab908ad882 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:35:54.866966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-041dfc19-bdde-42b4-859c-caab908ad882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:54.969582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dfc19-bdde-42b4-859c-caab908ad882 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:35:55.045278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec30f5f-8b0a-4090-a556-2fd763001a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:35:55.045985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec30f5f-8b0a-4090-a556-2fd763001a37 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:55.046271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec30f5f-8b0a-4090-a556-2fd763001a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:55.046545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec30f5f-8b0a-4090-a556-2fd763001a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:55.048336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9ec30f5f-8b0a-4090-a556-2fd763001a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:55.152647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec30f5f-8b0a-4090-a556-2fd763001a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:35:55.154621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec30f5f-8b0a-4090-a556-2fd763001a37 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:35:55.171953 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 676/1349] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:35:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:35:57.648375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17ca0a-b231-49a6-ac3b-866354a2442a None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:57.648964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17ca0a-b231-49a6-ac3b-866354a2442a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:57.648964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17ca0a-b231-49a6-ac3b-866354a2442a None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:57.650868 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 674/1350] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:35:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:35:57.656619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf012c2-f080-4882-bf85-afa113ba1bde None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:57.657039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf012c2-f080-4882-bf85-afa113ba1bde None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:57.657290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf012c2-f080-4882-bf85-afa113ba1bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:57.724578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-abf012c2-f080-4882-bf85-afa113ba1bde None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:35:57.725687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-abf012c2-f080-4882-bf85-afa113ba1bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:57.821035 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 677/1351] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:35:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:35:57.877642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bc278-40ed-445e-9a96-4efe1cb35be9 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:57.878051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bc278-40ed-445e-9a96-4efe1cb35be9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:57.878405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bc278-40ed-445e-9a96-4efe1cb35be9 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:57.880331 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 675/1352] 10.222.0.21 () {54 vars in 964 bytes} [Sat Nov 27 20:35:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:35:57.887278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e0190-1ebd-4179-9530-80df06d677e5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:57.887577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e0190-1ebd-4179-9530-80df06d677e5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:57.887918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e0190-1ebd-4179-9530-80df06d677e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:57.965117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b49e0190-1ebd-4179-9530-80df06d677e5 None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:35:57.966846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b49e0190-1ebd-4179-9530-80df06d677e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:58.040341 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 678/1353] 10.222.0.21 () {58 vars in 1061 bytes} [Sat Nov 27 20:35:57 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:35:58.049701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bc278-40ed-445e-9a96-4efe1cb35be9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:35:58.051186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-102bc278-40ed-445e-9a96-4efe1cb35be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:58.149334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bc278-40ed-445e-9a96-4efe1cb35be9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:35:58.219700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd200b-11fe-4fd6-900c-bab59fff68e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:35:58.220350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd200b-11fe-4fd6-900c-bab59fff68e3 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:35:58.220630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd200b-11fe-4fd6-900c-bab59fff68e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:35:58.220903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd200b-11fe-4fd6-900c-bab59fff68e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:35:58.222529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b5bd200b-11fe-4fd6-900c-bab59fff68e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:35:58.331939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd200b-11fe-4fd6-900c-bab59fff68e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:35:58.333292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd200b-11fe-4fd6-900c-bab59fff68e3 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:35:58.350532 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 676/1354] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:35:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:01.089499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed878d05-5008-438c-9960-1c5685bc8d63 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:01.090050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed878d05-5008-438c-9960-1c5685bc8d63 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:01.090050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed878d05-5008-438c-9960-1c5685bc8d63 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:01.092276 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 679/1355] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:01.097891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375bd37-8432-41aa-b403-fc66541df0a9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:01.098339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375bd37-8432-41aa-b403-fc66541df0a9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:01.098419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375bd37-8432-41aa-b403-fc66541df0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:01.162140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a375bd37-8432-41aa-b403-fc66541df0a9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:01.163341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a375bd37-8432-41aa-b403-fc66541df0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:01.258082 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 677/1356] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:36:01.292538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed878d05-5008-438c-9960-1c5685bc8d63 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:01.294652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ed878d05-5008-438c-9960-1c5685bc8d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:01.424719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed878d05-5008-438c-9960-1c5685bc8d63 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:01.542723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abf506-94f3-4936-ba4a-779a3a200edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:01.543655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf506-94f3-4936-ba4a-779a3a200edc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:01.543935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf506-94f3-4936-ba4a-779a3a200edc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:01.544712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abf506-94f3-4936-ba4a-779a3a200edc admin admin] PATH_INFO: `/v3/projects/838c496dfc884bc0b3b44afdd528b73e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:01.558000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abf506-94f3-4936-ba4a-779a3a200edc admin admin] RBAC: Authorizing `identity:get_project(project_id=838c496dfc884bc0b3b44afdd528b73e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:01.560777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abf506-94f3-4936-ba4a-779a3a200edc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:01.562590 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 680/1357] 10.222.0.21 () {56 vars in 1207 bytes} [Sat Nov 27 20:36:01 2021] GET /identity/v3/projects/838c496dfc884bc0b3b44afdd528b73e => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:36:01.575272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375bd37-8432-41aa-b403-fc66541df0a9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:01.576538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a375bd37-8432-41aa-b403-fc66541df0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:01.667353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375bd37-8432-41aa-b403-fc66541df0a9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:01.737072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f110a5-4116-4949-85e9-376ed46e3f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:01.737685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f110a5-4116-4949-85e9-376ed46e3f20 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:01.738639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f110a5-4116-4949-85e9-376ed46e3f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:01.738639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f110a5-4116-4949-85e9-376ed46e3f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:01.739915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-78f110a5-4116-4949-85e9-376ed46e3f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:01.847133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f110a5-4116-4949-85e9-376ed46e3f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:01.848606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f110a5-4116-4949-85e9-376ed46e3f20 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:01.867894 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 678/1358] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:04.709025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370153bf-1052-4afd-9a6d-edc8981e3604 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:04.709592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370153bf-1052-4afd-9a6d-edc8981e3604 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:04.709592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370153bf-1052-4afd-9a6d-edc8981e3604 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:04.711279 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 681/1359] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:04.717497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbf19d-e3b4-4c5a-a82c-9d7deddc5cce None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:04.717927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbf19d-e3b4-4c5a-a82c-9d7deddc5cce None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:04.718038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbf19d-e3b4-4c5a-a82c-9d7deddc5cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:04.780429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3fcbf19d-e3b4-4c5a-a82c-9d7deddc5cce None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:04.781607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3fcbf19d-e3b4-4c5a-a82c-9d7deddc5cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:04.873645 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 679/1360] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:04.912221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370153bf-1052-4afd-9a6d-edc8981e3604 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:04.913738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-370153bf-1052-4afd-9a6d-edc8981e3604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:05.013631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370153bf-1052-4afd-9a6d-edc8981e3604 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:05.085211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b2e7-f1e6-4972-b7bf-dbd4bcf86bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:05.085851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b2e7-f1e6-4972-b7bf-dbd4bcf86bcd service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:05.086133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b2e7-f1e6-4972-b7bf-dbd4bcf86bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:05.086405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b2e7-f1e6-4972-b7bf-dbd4bcf86bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:05.088058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7878b2e7-f1e6-4972-b7bf-dbd4bcf86bcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:05.192132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878b2e7-f1e6-4972-b7bf-dbd4bcf86bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:05.193560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878b2e7-f1e6-4972-b7bf-dbd4bcf86bcd service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:05.210713 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 682/1361] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:07.645054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ccf43-0a42-4a39-b2d9-e1acb105de90 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:07.645519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ccf43-0a42-4a39-b2d9-e1acb105de90 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:07.645622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ccf43-0a42-4a39-b2d9-e1acb105de90 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:07.647370 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 680/1362] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:07.652831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855387bd-325b-42b3-bc4d-51457d004317 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:07.653777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855387bd-325b-42b3-bc4d-51457d004317 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:07.653924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855387bd-325b-42b3-bc4d-51457d004317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:07.734762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-855387bd-325b-42b3-bc4d-51457d004317 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:07.735905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-855387bd-325b-42b3-bc4d-51457d004317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:07.837872 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 683/1363] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:36:07.883518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ccf43-0a42-4a39-b2d9-e1acb105de90 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:07.885617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f85ccf43-0a42-4a39-b2d9-e1acb105de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:07.977837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ccf43-0a42-4a39-b2d9-e1acb105de90 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:07.982872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4cc8b-7fce-4b1c-999e-b4283d49b3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:07.984018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4cc8b-7fce-4b1c-999e-b4283d49b3bc service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:07.984533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4cc8b-7fce-4b1c-999e-b4283d49b3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:07.985065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4cc8b-7fce-4b1c-999e-b4283d49b3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:07.994740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4cc8b-7fce-4b1c-999e-b4283d49b3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:07.996767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4cc8b-7fce-4b1c-999e-b4283d49b3bc service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:08.006440 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 681/1364] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:10.710761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be454c-af84-4c91-ba2e-a044abf1b072 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:10.711297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be454c-af84-4c91-ba2e-a044abf1b072 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:10.711297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be454c-af84-4c91-ba2e-a044abf1b072 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:10.713039 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 684/1365] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:10.719430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e122e-db27-41f0-80d1-3bb96aad0d11 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:10.719848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e122e-db27-41f0-80d1-3bb96aad0d11 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:10.719979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e122e-db27-41f0-80d1-3bb96aad0d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:10.738002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-335e122e-db27-41f0-80d1-3bb96aad0d11 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:10.739169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-335e122e-db27-41f0-80d1-3bb96aad0d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:10.746741 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 682/1366] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:10.785099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be454c-af84-4c91-ba2e-a044abf1b072 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:10.795974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be454c-af84-4c91-ba2e-a044abf1b072 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:10.799435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2b382-3aa3-4438-b0d7-670b65a992f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:10.800054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b382-3aa3-4438-b0d7-670b65a992f9 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:10.800333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b382-3aa3-4438-b0d7-670b65a992f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:10.800604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b382-3aa3-4438-b0d7-670b65a992f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:10.809131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2b382-3aa3-4438-b0d7-670b65a992f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:10.810582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2b382-3aa3-4438-b0d7-670b65a992f9 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:10.819613 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 685/1367] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:15.173952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747fa1-a581-42b2-bd1b-9dc8d6fa1df2 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:15.174461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747fa1-a581-42b2-bd1b-9dc8d6fa1df2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:15.174461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747fa1-a581-42b2-bd1b-9dc8d6fa1df2 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:15.176320 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 683/1368] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:15.181943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b376dde-fd30-400c-ba1e-061c97828145 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:15.182366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b376dde-fd30-400c-ba1e-061c97828145 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:15.182513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b376dde-fd30-400c-ba1e-061c97828145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:15.200086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6b376dde-fd30-400c-ba1e-061c97828145 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:15.201251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6b376dde-fd30-400c-ba1e-061c97828145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:15.209113 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 686/1369] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:15.250571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54747fa1-a581-42b2-bd1b-9dc8d6fa1df2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:15.261114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54747fa1-a581-42b2-bd1b-9dc8d6fa1df2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:15.264636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f640868-3499-4474-8162-ddc171ef30e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:15.265266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f640868-3499-4474-8162-ddc171ef30e9 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:15.265760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f640868-3499-4474-8162-ddc171ef30e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:15.266037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f640868-3499-4474-8162-ddc171ef30e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:15.274738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f640868-3499-4474-8162-ddc171ef30e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:15.276191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f640868-3499-4474-8162-ddc171ef30e9 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:15.286029 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 684/1370] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:36:18.272570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584fefd-4001-4fff-acd7-0a4566c615b0 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:18.273094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584fefd-4001-4fff-acd7-0a4566c615b0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:18.273094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584fefd-4001-4fff-acd7-0a4566c615b0 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:18.274965 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 687/1371] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:18.281282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fab8c-af1d-4420-ba96-32082fb8ade5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:18.281713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fab8c-af1d-4420-ba96-32082fb8ade5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:18.281837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fab8c-af1d-4420-ba96-32082fb8ade5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:18.299847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-083fab8c-af1d-4420-ba96-32082fb8ade5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:18.301030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-083fab8c-af1d-4420-ba96-32082fb8ade5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:18.308819 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 685/1372] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:18.348230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584fefd-4001-4fff-acd7-0a4566c615b0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:18.349905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3584fefd-4001-4fff-acd7-0a4566c615b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:18.363194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584fefd-4001-4fff-acd7-0a4566c615b0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:18.366677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d39b54-0d63-4b0e-a581-abb130666af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:18.367342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d39b54-0d63-4b0e-a581-abb130666af4 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:18.367626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d39b54-0d63-4b0e-a581-abb130666af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:18.367898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d39b54-0d63-4b0e-a581-abb130666af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:18.376828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d39b54-0d63-4b0e-a581-abb130666af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:18.378250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d39b54-0d63-4b0e-a581-abb130666af4 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:18.387621 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 688/1373] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:23.194675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55ce42-ffde-4f91-b62f-023523aec6d1 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:23.195199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55ce42-ffde-4f91-b62f-023523aec6d1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:23.195536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55ce42-ffde-4f91-b62f-023523aec6d1 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:23.197323 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 686/1374] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:23.203474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe37a44-983d-4b1c-9628-beb3ad67abfe None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:23.203474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe37a44-983d-4b1c-9628-beb3ad67abfe None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:23.203997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe37a44-983d-4b1c-9628-beb3ad67abfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:23.221910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-bfe37a44-983d-4b1c-9628-beb3ad67abfe None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:23.223101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bfe37a44-983d-4b1c-9628-beb3ad67abfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:23.231730 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 689/1375] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:23.273124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55ce42-ffde-4f91-b62f-023523aec6d1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:23.284163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55ce42-ffde-4f91-b62f-023523aec6d1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:23.287683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46ee7d-367b-494f-9468-03a233a06442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:23.288501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46ee7d-367b-494f-9468-03a233a06442 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:23.288787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46ee7d-367b-494f-9468-03a233a06442 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:23.289067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46ee7d-367b-494f-9468-03a233a06442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:23.298183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46ee7d-367b-494f-9468-03a233a06442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:23.299786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46ee7d-367b-494f-9468-03a233a06442 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:23.309372 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 687/1376] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:28.512572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf3035-f476-4731-a607-d562fe5c5b0c None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:28.513479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf3035-f476-4731-a607-d562fe5c5b0c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:28.513991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf3035-f476-4731-a607-d562fe5c5b0c None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:28.517926 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 690/1377] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:36:28 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:28.523455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198b9f9-8114-4627-b140-f47b78aee55e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:28.523892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198b9f9-8114-4627-b140-f47b78aee55e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:28.523998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198b9f9-8114-4627-b140-f47b78aee55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:28.601148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5198b9f9-8114-4627-b140-f47b78aee55e None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:28.603069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5198b9f9-8114-4627-b140-f47b78aee55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:28.722381 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 688/1378] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:36:28 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:33.217525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad594f-188a-4e60-a097-25251ad63743 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:33.218073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad594f-188a-4e60-a097-25251ad63743 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:33.218073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad594f-188a-4e60-a097-25251ad63743 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:33.220050 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 691/1379] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:36:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:33.226037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2b45c-2953-4f10-9149-707b4647f96a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:33.226868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2b45c-2953-4f10-9149-707b4647f96a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:33.227515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2b45c-2953-4f10-9149-707b4647f96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:33.251725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bcb2b45c-2953-4f10-9149-707b4647f96a None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:33.253235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bcb2b45c-2953-4f10-9149-707b4647f96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:33.264033 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 689/1380] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:36:33 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:34.853145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657c470-93e9-48e0-ab2f-41432920b5a3 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:34.853711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657c470-93e9-48e0-ab2f-41432920b5a3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:34.853911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657c470-93e9-48e0-ab2f-41432920b5a3 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:34.855820 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 692/1381] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:36:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:34.861288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08dd24-e85d-4912-b8a4-23692269c947 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:34.861718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08dd24-e85d-4912-b8a4-23692269c947 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:34.861845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08dd24-e85d-4912-b8a4-23692269c947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:34.881075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2e08dd24-e85d-4912-b8a4-23692269c947 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:34.882268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2e08dd24-e85d-4912-b8a4-23692269c947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:34.891730 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 690/1382] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:36:34 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:38.785835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a48b-006b-4b48-b7fa-434230622e71 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:38.786426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a48b-006b-4b48-b7fa-434230622e71 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:38.786683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a48b-006b-4b48-b7fa-434230622e71 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:38.789490 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 693/1383] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:38.799544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfd130-8944-43e6-a3bc-be6dff160a99 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:38.801225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfd130-8944-43e6-a3bc-be6dff160a99 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:38.801568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfd130-8944-43e6-a3bc-be6dff160a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:38.821265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e9dfd130-8944-43e6-a3bc-be6dff160a99 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:38.822755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e9dfd130-8944-43e6-a3bc-be6dff160a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:38.831316 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 691/1384] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:38.884177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb42ebf-1ce6-46db-b210-29f2e759f8b2 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:38.884600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb42ebf-1ce6-46db-b210-29f2e759f8b2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:38.885035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb42ebf-1ce6-46db-b210-29f2e759f8b2 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:38.887555 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 694/1385] 10.222.0.21 () {54 vars in 961 bytes} [Sat Nov 27 20:36:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:38.894865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d046-dfe3-4369-baca-c6ae94cee392 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:38.895586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d046-dfe3-4369-baca-c6ae94cee392 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:38.896110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d046-dfe3-4369-baca-c6ae94cee392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:38.949571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f2c8d046-dfe3-4369-baca-c6ae94cee392 None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:38.950921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f2c8d046-dfe3-4369-baca-c6ae94cee392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:39.031242 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 692/1386] 10.222.0.21 () {58 vars in 1058 bytes} [Sat Nov 27 20:36:38 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:39.039742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb42ebf-1ce6-46db-b210-29f2e759f8b2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:39.055091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb42ebf-1ce6-46db-b210-29f2e759f8b2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:39.062403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc72cbe-c6ef-4a4f-8174-59a9b457c4c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:39.063205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc72cbe-c6ef-4a4f-8174-59a9b457c4c4 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:39.063687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc72cbe-c6ef-4a4f-8174-59a9b457c4c4 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:39.064111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc72cbe-c6ef-4a4f-8174-59a9b457c4c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:39.072590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc72cbe-c6ef-4a4f-8174-59a9b457c4c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:39.074365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc72cbe-c6ef-4a4f-8174-59a9b457c4c4 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:39.084719 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 695/1387] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:41.756219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126abbd-397b-420f-a2ce-5ddddf0b3617 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:41.756795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126abbd-397b-420f-a2ce-5ddddf0b3617 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:41.756795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126abbd-397b-420f-a2ce-5ddddf0b3617 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:41.758672 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 693/1388] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:41.764362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f1de-31d9-4917-b07c-7f01d80f7625 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:41.764774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f1de-31d9-4917-b07c-7f01d80f7625 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:41.764915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f1de-31d9-4917-b07c-7f01d80f7625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:41.782510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a700f1de-31d9-4917-b07c-7f01d80f7625 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:41.783841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a700f1de-31d9-4917-b07c-7f01d80f7625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:41.791710 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 696/1389] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:41.838450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126abbd-397b-420f-a2ce-5ddddf0b3617 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:41.852786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126abbd-397b-420f-a2ce-5ddddf0b3617 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:41.859092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34655525-257a-4b44-988c-dfae588db9a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:41.859832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34655525-257a-4b44-988c-dfae588db9a1 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:41.860194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34655525-257a-4b44-988c-dfae588db9a1 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:41.860550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34655525-257a-4b44-988c-dfae588db9a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:41.868688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34655525-257a-4b44-988c-dfae588db9a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:41.870283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34655525-257a-4b44-988c-dfae588db9a1 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:41.894523 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 694/1390] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:44.625930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfba232-784a-4171-b517-8fcc3d229ea3 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:44.626455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfba232-784a-4171-b517-8fcc3d229ea3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:44.626455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfba232-784a-4171-b517-8fcc3d229ea3 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:44.628286 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 697/1391] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:44.634159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081bc1e-bc6c-4de3-bf53-20c85ab091d6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:44.634594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081bc1e-bc6c-4de3-bf53-20c85ab091d6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:44.634710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081bc1e-bc6c-4de3-bf53-20c85ab091d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:44.653518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5081bc1e-bc6c-4de3-bf53-20c85ab091d6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:44.654765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5081bc1e-bc6c-4de3-bf53-20c85ab091d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:44.662957 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 695/1392] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:44.712419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec25c3-01d3-4412-86b7-771bc2cb82d1 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:44.712700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec25c3-01d3-4412-86b7-771bc2cb82d1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:44.712980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec25c3-01d3-4412-86b7-771bc2cb82d1 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:44.714819 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 698/1393] 10.222.0.21 () {54 vars in 961 bytes} [Sat Nov 27 20:36:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:44.721234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971013a-daec-4de2-91c5-cd0ddb284e42 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:44.721525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971013a-daec-4de2-91c5-cd0ddb284e42 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:44.721805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971013a-daec-4de2-91c5-cd0ddb284e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:44.740464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d971013a-daec-4de2-91c5-cd0ddb284e42 None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:44.741664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d971013a-daec-4de2-91c5-cd0ddb284e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:44.752033 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 696/1394] 10.222.0.21 () {58 vars in 1058 bytes} [Sat Nov 27 20:36:44 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:44.761038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec25c3-01d3-4412-86b7-771bc2cb82d1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:44.779653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec25c3-01d3-4412-86b7-771bc2cb82d1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:44.785552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db3d14-1daa-4cd6-b4ea-422469c90f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:44.786438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db3d14-1daa-4cd6-b4ea-422469c90f2c service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:44.786904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db3d14-1daa-4cd6-b4ea-422469c90f2c service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:44.787408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db3d14-1daa-4cd6-b4ea-422469c90f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:44.797151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db3d14-1daa-4cd6-b4ea-422469c90f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:44.799079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db3d14-1daa-4cd6-b4ea-422469c90f2c service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:44.810062 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 699/1395] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:47.416609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3391025-b7df-4fa9-a49f-1c2e85ae36c2 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:47.417548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3391025-b7df-4fa9-a49f-1c2e85ae36c2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:47.418096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3391025-b7df-4fa9-a49f-1c2e85ae36c2 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:47.426304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeacc0e-7abb-4eb0-aec9-901ca62390c9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:47.427193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeacc0e-7abb-4eb0-aec9-901ca62390c9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:47.427698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeacc0e-7abb-4eb0-aec9-901ca62390c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:47.429953 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 697/1396] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:47 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:47.447629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8aeacc0e-7abb-4eb0-aec9-901ca62390c9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:47.449820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8aeacc0e-7abb-4eb0-aec9-901ca62390c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:47.471720 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 700/1397] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:47.507521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3391025-b7df-4fa9-a49f-1c2e85ae36c2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:47.524288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3391025-b7df-4fa9-a49f-1c2e85ae36c2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:47.530596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671835fd-442c-458d-8372-9a3c88ca4689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:47.531551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671835fd-442c-458d-8372-9a3c88ca4689 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:47.532047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671835fd-442c-458d-8372-9a3c88ca4689 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:47.532526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671835fd-442c-458d-8372-9a3c88ca4689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:47.542002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671835fd-442c-458d-8372-9a3c88ca4689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:47.543936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671835fd-442c-458d-8372-9a3c88ca4689 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:47.570206 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 698/1398] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:50.316455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a14012-8712-4695-8629-47e3103f04d4 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:50.316881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a14012-8712-4695-8629-47e3103f04d4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:50.317044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a14012-8712-4695-8629-47e3103f04d4 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:50.324856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539f5f-b644-40f4-94f4-664604fae2ad None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:50.325240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539f5f-b644-40f4-94f4-664604fae2ad None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:50.325561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539f5f-b644-40f4-94f4-664604fae2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:50.327920 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 701/1399] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:50 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:50.344293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-de539f5f-b644-40f4-94f4-664604fae2ad None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:50.345480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-de539f5f-b644-40f4-94f4-664604fae2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:50.353591 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 699/1400] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:36:50.403069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a14012-8712-4695-8629-47e3103f04d4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:50.418597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a14012-8712-4695-8629-47e3103f04d4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:50.431474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef87148-7eb6-4c6a-b5c1-efcde9786cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:50.432239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef87148-7eb6-4c6a-b5c1-efcde9786cf4 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:50.432624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef87148-7eb6-4c6a-b5c1-efcde9786cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:50.433004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef87148-7eb6-4c6a-b5c1-efcde9786cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:50.455770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef87148-7eb6-4c6a-b5c1-efcde9786cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:50.457729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef87148-7eb6-4c6a-b5c1-efcde9786cf4 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:50.470152 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 702/1401] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:50.898542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103aa9e-e09f-4360-a3bd-731b5af063cb None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:50.898829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103aa9e-e09f-4360-a3bd-731b5af063cb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:50.899301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103aa9e-e09f-4360-a3bd-731b5af063cb None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:50.901084 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 700/1402] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:50.907600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3804af-7ce3-44bf-9d77-72ea45d3f2bd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:50.907890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3804af-7ce3-44bf-9d77-72ea45d3f2bd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:50.908166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3804af-7ce3-44bf-9d77-72ea45d3f2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:50.925872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0f3804af-7ce3-44bf-9d77-72ea45d3f2bd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:50.927064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0f3804af-7ce3-44bf-9d77-72ea45d3f2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:50.935174 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 703/1403] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:50.989246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1cee0-ea92-428a-829a-c8697fca40bb None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:50.989568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1cee0-ea92-428a-829a-c8697fca40bb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:50.989795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1cee0-ea92-428a-829a-c8697fca40bb None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:50.991734 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 701/1404] 10.222.0.21 () {54 vars in 963 bytes} [Sat Nov 27 20:36:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:50.997014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8264-823d-4f5a-8a1d-747febad5538 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:50.997302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8264-823d-4f5a-8a1d-747febad5538 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:50.997578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8264-823d-4f5a-8a1d-747febad5538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:51.048630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-077c8264-823d-4f5a-8a1d-747febad5538 None None] MFA Rules not processed for user `198c9372013440ec942a0192a73a231d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:51.049803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-077c8264-823d-4f5a-8a1d-747febad5538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:51.122543 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 704/1405] 10.222.0.21 () {58 vars in 1060 bytes} [Sat Nov 27 20:36:50 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:36:51.130870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1cee0-ea92-428a-829a-c8697fca40bb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:51.142728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1cee0-ea92-428a-829a-c8697fca40bb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:51.146398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bba988-5870-4738-98a9-8413fa2d7495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:51.147085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bba988-5870-4738-98a9-8413fa2d7495 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:51.147410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bba988-5870-4738-98a9-8413fa2d7495 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:51.147687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bba988-5870-4738-98a9-8413fa2d7495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:51.158296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bba988-5870-4738-98a9-8413fa2d7495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:51.159701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bba988-5870-4738-98a9-8413fa2d7495 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:51.171284 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 702/1406] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:52.993433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c57d3-fc0b-41b1-9f79-35ba56a0d42c None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:52.994001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c57d3-fc0b-41b1-9f79-35ba56a0d42c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:52.994001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c57d3-fc0b-41b1-9f79-35ba56a0d42c None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:52.996126 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 705/1407] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:53.002548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8d57-5cd7-45f9-aaa8-55e4c77232b1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:53.003044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8d57-5cd7-45f9-aaa8-55e4c77232b1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:53.003145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8d57-5cd7-45f9-aaa8-55e4c77232b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:53.021646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-95ad8d57-5cd7-45f9-aaa8-55e4c77232b1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:53.022951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-95ad8d57-5cd7-45f9-aaa8-55e4c77232b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:53.030758 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 703/1408] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:36:53.078690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c57d3-fc0b-41b1-9f79-35ba56a0d42c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:53.093943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c57d3-fc0b-41b1-9f79-35ba56a0d42c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:53.099839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9ab3-3e6a-4679-80a0-a07c40262d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:53.100480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9ab3-3e6a-4679-80a0-a07c40262d69 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:53.100765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9ab3-3e6a-4679-80a0-a07c40262d69 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:53.101041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9ab3-3e6a-4679-80a0-a07c40262d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:53.110306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf9ab3-3e6a-4679-80a0-a07c40262d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:53.111966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf9ab3-3e6a-4679-80a0-a07c40262d69 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:53.122060 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 706/1409] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:55.600378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4c916-6b61-404a-8531-856bc929b18e None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:55.601427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4c916-6b61-404a-8531-856bc929b18e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:55.601427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4c916-6b61-404a-8531-856bc929b18e None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:55.603014 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 704/1410] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:55.608947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058ac6d-07c1-4d4a-9d97-1ec3fad4951e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:55.609772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058ac6d-07c1-4d4a-9d97-1ec3fad4951e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:55.610067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058ac6d-07c1-4d4a-9d97-1ec3fad4951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:55.628778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5058ac6d-07c1-4d4a-9d97-1ec3fad4951e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:55.629951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5058ac6d-07c1-4d4a-9d97-1ec3fad4951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:55.638295 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 707/1411] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:55.682501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4c916-6b61-404a-8531-856bc929b18e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:55.697643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4c916-6b61-404a-8531-856bc929b18e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:55.703713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24757115-f323-4eac-918e-8ae516469499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:55.704494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24757115-f323-4eac-918e-8ae516469499 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:55.704846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24757115-f323-4eac-918e-8ae516469499 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:55.705195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24757115-f323-4eac-918e-8ae516469499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:55.713546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24757115-f323-4eac-918e-8ae516469499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:55.715168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24757115-f323-4eac-918e-8ae516469499 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:55.724597 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 705/1412] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:36:58.212598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ee3b-4770-4294-82f3-b8696048e9bc None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:58.212598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ee3b-4770-4294-82f3-b8696048e9bc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:58.212598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ee3b-4770-4294-82f3-b8696048e9bc None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:58.215049 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 708/1413] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:36:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:36:58.221296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda64ac-5d71-4db2-9f7d-664b3a5bea0a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:58.221811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda64ac-5d71-4db2-9f7d-664b3a5bea0a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:58.221811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda64ac-5d71-4db2-9f7d-664b3a5bea0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:58.240114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-eeda64ac-5d71-4db2-9f7d-664b3a5bea0a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:36:58.241602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-eeda64ac-5d71-4db2-9f7d-664b3a5bea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:36:58.255613 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 706/1414] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:36:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:36:58.297091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984ee3b-4770-4294-82f3-b8696048e9bc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:36:58.314918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984ee3b-4770-4294-82f3-b8696048e9bc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:36:58.320717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f0c53-5226-4d1f-9186-a5ae2020cc19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:36:58.321976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f0c53-5226-4d1f-9186-a5ae2020cc19 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:36:58.322686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f0c53-5226-4d1f-9186-a5ae2020cc19 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:36:58.323172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f0c53-5226-4d1f-9186-a5ae2020cc19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:36:58.333337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f0c53-5226-4d1f-9186-a5ae2020cc19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:36:58.335067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f0c53-5226-4d1f-9186-a5ae2020cc19 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:36:58.347090 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 709/1415] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:36:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:01.125871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839caf7f-a1ab-4c08-b343-fe891880ef16 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:01.126790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839caf7f-a1ab-4c08-b343-fe891880ef16 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:01.126790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839caf7f-a1ab-4c08-b343-fe891880ef16 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:01.128264 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 707/1416] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:37:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:01.135419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dee995-f209-4ffc-bf09-60c2947bbe81 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:01.135891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dee995-f209-4ffc-bf09-60c2947bbe81 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:01.136712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dee995-f209-4ffc-bf09-60c2947bbe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:01.162315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-20dee995-f209-4ffc-bf09-60c2947bbe81 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:01.164211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-20dee995-f209-4ffc-bf09-60c2947bbe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:01.178188 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 710/1417] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:37:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:37:01.227866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839caf7f-a1ab-4c08-b343-fe891880ef16 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:01.247394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839caf7f-a1ab-4c08-b343-fe891880ef16 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:01.254338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9356dc-ca72-43a7-8808-1de1abd1dc93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:01.255187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9356dc-ca72-43a7-8808-1de1abd1dc93 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:01.255546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9356dc-ca72-43a7-8808-1de1abd1dc93 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:01.255852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9356dc-ca72-43a7-8808-1de1abd1dc93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:01.264491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9356dc-ca72-43a7-8808-1de1abd1dc93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:01.266061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9356dc-ca72-43a7-8808-1de1abd1dc93 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:01.275301 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 708/1418] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:04.211077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7130-c124-46e8-8d6c-9641124c46e9 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:04.211713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7130-c124-46e8-8d6c-9641124c46e9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:04.211713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb7130-c124-46e8-8d6c-9641124c46e9 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:04.213341 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 711/1419] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:37:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:37:04.219287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab20bc9-96d6-42de-b3a6-27278d3e432e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:04.219764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab20bc9-96d6-42de-b3a6-27278d3e432e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:04.219869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab20bc9-96d6-42de-b3a6-27278d3e432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:04.238990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4ab20bc9-96d6-42de-b3a6-27278d3e432e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:04.240439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4ab20bc9-96d6-42de-b3a6-27278d3e432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:04.251042 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 709/1420] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:37:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:04.308322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb7130-c124-46e8-8d6c-9641124c46e9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:04.327512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb7130-c124-46e8-8d6c-9641124c46e9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:04.335343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384a7c4-568b-4779-882b-b6e16ad8c6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:04.336715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384a7c4-568b-4779-882b-b6e16ad8c6ee service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:04.337416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384a7c4-568b-4779-882b-b6e16ad8c6ee service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:04.338014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384a7c4-568b-4779-882b-b6e16ad8c6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:04.348636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384a7c4-568b-4779-882b-b6e16ad8c6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:04.350232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384a7c4-568b-4779-882b-b6e16ad8c6ee service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:04.360013 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 712/1421] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:06.844522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fecd30-655f-45d7-81e4-1b40334cd317 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:06.845141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fecd30-655f-45d7-81e4-1b40334cd317 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:06.845141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fecd30-655f-45d7-81e4-1b40334cd317 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:06.845792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43199f-bdb7-48e6-a558-7beb13266616 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:06.846225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43199f-bdb7-48e6-a558-7beb13266616 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:06.846354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43199f-bdb7-48e6-a558-7beb13266616 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:06.847016 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 710/1422] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:37:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:06.848345 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 713/1423] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:37:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:37:06.852878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb12ad-d491-4b7f-9a03-556fe758bc83 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:06.853165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb12ad-d491-4b7f-9a03-556fe758bc83 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:06.853449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb12ad-d491-4b7f-9a03-556fe758bc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:06.853595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22310181-1de9-40e3-a007-a8b8e01b8bf3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:06.853803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22310181-1de9-40e3-a007-a8b8e01b8bf3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:06.854087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22310181-1de9-40e3-a007-a8b8e01b8bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:06.872401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-95cb12ad-d491-4b7f-9a03-556fe758bc83 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:06.873589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-22310181-1de9-40e3-a007-a8b8e01b8bf3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:06.873716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-95cb12ad-d491-4b7f-9a03-556fe758bc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:06.875124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-22310181-1de9-40e3-a007-a8b8e01b8bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:06.881879 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 711/1424] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:37:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:06.883088 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 714/1425] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:37:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:37:06.940143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb12ad-d491-4b7f-9a03-556fe758bc83 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:06.941466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d6a4-c33f-4914-a06f-fb15d000ba52 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:06.941758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d6a4-c33f-4914-a06f-fb15d000ba52 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:06.942064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d6a4-c33f-4914-a06f-fb15d000ba52 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:06.943959 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 715/1426] 10.222.0.21 () {54 vars in 962 bytes} [Sat Nov 27 20:37:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:37:06.949849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8b6b5-deeb-4857-82ad-6f8fb2af83da None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:06.950131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8b6b5-deeb-4857-82ad-6f8fb2af83da None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:06.950439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8b6b5-deeb-4857-82ad-6f8fb2af83da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:06.952752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb12ad-d491-4b7f-9a03-556fe758bc83 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:06.958751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f323154-ab55-4ffe-bec8-c665f316de4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:06.959420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323154-ab55-4ffe-bec8-c665f316de4a service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:06.959700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323154-ab55-4ffe-bec8-c665f316de4a service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:06.959971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f323154-ab55-4ffe-bec8-c665f316de4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:07.024851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f323154-ab55-4ffe-bec8-c665f316de4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:07.024851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f323154-ab55-4ffe-bec8-c665f316de4a service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:07.024851 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 712/1427] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:07.025855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c3e8b6b5-deeb-4857-82ad-6f8fb2af83da None None] MFA Rules not processed for user `7e4c41e7988043c0b3b8e338ccd31d37`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:07.025855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c3e8b6b5-deeb-4857-82ad-6f8fb2af83da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:07.072429 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 716/1428] 10.222.0.21 () {58 vars in 1059 bytes} [Sat Nov 27 20:37:06 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:07.080459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f323154-ab55-4ffe-bec8-c665f316de4a service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:07.090606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f323154-ab55-4ffe-bec8-c665f316de4a service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:07.094178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ef84f-d796-4cf0-8218-c15c90c524e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:07.094891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ef84f-d796-4cf0-8218-c15c90c524e6 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:07.095105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ef84f-d796-4cf0-8218-c15c90c524e6 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:07.095420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ef84f-d796-4cf0-8218-c15c90c524e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:07.105332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ef84f-d796-4cf0-8218-c15c90c524e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:07.106823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ef84f-d796-4cf0-8218-c15c90c524e6 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:07.117481 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 713/1429] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:37:07.557168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cffee-67ad-4337-9764-6b1406d65f0d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:07.557522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cffee-67ad-4337-9764-6b1406d65f0d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:07.558492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cffee-67ad-4337-9764-6b1406d65f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:07.621478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-893cffee-67ad-4337-9764-6b1406d65f0d None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:07.623034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-893cffee-67ad-4337-9764-6b1406d65f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:07.700532 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 717/1430] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:37:07 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:07.756292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc08484-9e6a-46b8-b0f3-9e2c58152937 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:07.756663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc08484-9e6a-46b8-b0f3-9e2c58152937 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:07.757003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc08484-9e6a-46b8-b0f3-9e2c58152937 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:07.758937 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 714/1431] 10.222.0.21 () {54 vars in 942 bytes} [Sat Nov 27 20:37:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:07.766693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2552be-22fe-432b-9744-0afdc7ec1057 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:07.767229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2552be-22fe-432b-9744-0afdc7ec1057 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:07.767743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2552be-22fe-432b-9744-0afdc7ec1057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:07.825191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0e2552be-22fe-432b-9744-0afdc7ec1057 None None] MFA Rules not processed for user `f39a303b702041259ebb6a66c5967528`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:07.826363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0e2552be-22fe-432b-9744-0afdc7ec1057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:07.896144 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 718/1432] 10.222.0.21 () {58 vars in 1039 bytes} [Sat Nov 27 20:37:07 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:07.907729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc08484-9e6a-46b8-b0f3-9e2c58152937 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:07.922402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc08484-9e6a-46b8-b0f3-9e2c58152937 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:07.927468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d4933-00ab-4999-a25b-18dfe50ce2ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:07.928198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d4933-00ab-4999-a25b-18dfe50ce2ce service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:07.928476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d4933-00ab-4999-a25b-18dfe50ce2ce service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:07.928745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d4933-00ab-4999-a25b-18dfe50ce2ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:07.937125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d4933-00ab-4999-a25b-18dfe50ce2ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:07.938691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d4933-00ab-4999-a25b-18dfe50ce2ce service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:07.946765 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 715/1433] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:37:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:37:09.592313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139225f7-5425-40cc-8f18-5f8dd12dafe7 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:09.592903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139225f7-5425-40cc-8f18-5f8dd12dafe7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:09.592903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139225f7-5425-40cc-8f18-5f8dd12dafe7 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:09.594702 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 719/1434] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:37:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:09.601103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7a68-2d91-4ebf-858e-d6e29eaea4a3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:09.602064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7a68-2d91-4ebf-858e-d6e29eaea4a3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:09.602544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e7a68-2d91-4ebf-858e-d6e29eaea4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:09.631495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-886e7a68-2d91-4ebf-858e-d6e29eaea4a3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:09.633763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-886e7a68-2d91-4ebf-858e-d6e29eaea4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:09.647431 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 716/1435] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:37:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:37:09.697606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139225f7-5425-40cc-8f18-5f8dd12dafe7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:09.718242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139225f7-5425-40cc-8f18-5f8dd12dafe7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:09.723827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839d300-29f5-4b43-b0f8-455c341f4fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:09.724492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839d300-29f5-4b43-b0f8-455c341f4fb0 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:09.724776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839d300-29f5-4b43-b0f8-455c341f4fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:09.725051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839d300-29f5-4b43-b0f8-455c341f4fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:09.734236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839d300-29f5-4b43-b0f8-455c341f4fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:09.735846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839d300-29f5-4b43-b0f8-455c341f4fb0 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:09.746972 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 720/1436] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:31.589655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5267-3628-41af-a2e2-e223fd5804b7 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:31.590285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5267-3628-41af-a2e2-e223fd5804b7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:31.590285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5267-3628-41af-a2e2-e223fd5804b7 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:31.592017 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 717/1437] 10.222.0.21 () {54 vars in 918 bytes} [Sat Nov 27 20:37:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:31.598013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a595cd-7680-4390-a6e6-bea15cb8b5fd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:31.598510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a595cd-7680-4390-a6e6-bea15cb8b5fd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:31.598620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a595cd-7680-4390-a6e6-bea15cb8b5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:31.616641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-32a595cd-7680-4390-a6e6-bea15cb8b5fd None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:31.617847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-32a595cd-7680-4390-a6e6-bea15cb8b5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:31.627241 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 721/1438] 10.222.0.21 () {58 vars in 1015 bytes} [Sat Nov 27 20:37:31 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:31.642374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ad577-74be-4370-8564-84ce81b69582 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:31.642662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ad577-74be-4370-8564-84ce81b69582 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:31.642937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ad577-74be-4370-8564-84ce81b69582 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:31.644712 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 718/1439] 10.222.0.21 () {54 vars in 918 bytes} [Sat Nov 27 20:37:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:37:31.649881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a75e3-40ab-4328-bf26-eb5c90d313d5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:31.650168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a75e3-40ab-4328-bf26-eb5c90d313d5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:31.650441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a75e3-40ab-4328-bf26-eb5c90d313d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:31.669042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-027a75e3-40ab-4328-bf26-eb5c90d313d5 None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:31.670201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-027a75e3-40ab-4328-bf26-eb5c90d313d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:31.678988 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 722/1440] 10.222.0.21 () {58 vars in 1015 bytes} [Sat Nov 27 20:37:31 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:34.491584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6415-5e95-4366-8caa-bc3147d3fce3 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:34.492145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6415-5e95-4366-8caa-bc3147d3fce3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:34.492145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6415-5e95-4366-8caa-bc3147d3fce3 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:34.493875 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:37:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:34.500863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a1b63-b3f2-4417-882d-f22c28f5c3eb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:34.501263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a1b63-b3f2-4417-882d-f22c28f5c3eb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:34.501449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a1b63-b3f2-4417-882d-f22c28f5c3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:34.519676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-639a1b63-b3f2-4417-882d-f22c28f5c3eb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:34.520891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-639a1b63-b3f2-4417-882d-f22c28f5c3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:34.528615 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:37:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:34.574156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6415-5e95-4366-8caa-bc3147d3fce3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:34.588361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6415-5e95-4366-8caa-bc3147d3fce3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:34.593647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0229b-9c99-4c12-a818-a13aee4b143a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:34.594267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0229b-9c99-4c12-a818-a13aee4b143a service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:34.594547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0229b-9c99-4c12-a818-a13aee4b143a service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:34.594820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0229b-9c99-4c12-a818-a13aee4b143a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:34.602952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0229b-9c99-4c12-a818-a13aee4b143a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:34.605049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0229b-9c99-4c12-a818-a13aee4b143a service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:34.614065 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 720/1443] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:36.278850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc48b6-f47e-4068-a298-8f4d666475aa None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:36.279428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc48b6-f47e-4068-a298-8f4d666475aa None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:36.279428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc48b6-f47e-4068-a298-8f4d666475aa None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:36.281208 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 901 bytes} [Sat Nov 27 20:37:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:36.286545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d283-b36a-4ba5-8c53-f74609bf853f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:36.286993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d283-b36a-4ba5-8c53-f74609bf853f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:36.287100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425d283-b36a-4ba5-8c53-f74609bf853f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:36.305514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6425d283-b36a-4ba5-8c53-f74609bf853f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:36.306617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6425d283-b36a-4ba5-8c53-f74609bf853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:36.314148 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 998 bytes} [Sat Nov 27 20:37:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:36.528066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc48b6-f47e-4068-a298-8f4d666475aa None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:36.542147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc48b6-f47e-4068-a298-8f4d666475aa None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:36.547580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c336aac-8658-4601-a756-72720aad1f01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:36.548209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c336aac-8658-4601-a756-72720aad1f01 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:36.548491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c336aac-8658-4601-a756-72720aad1f01 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:36.548767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c336aac-8658-4601-a756-72720aad1f01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:36.556926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c336aac-8658-4601-a756-72720aad1f01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:36.558465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c336aac-8658-4601-a756-72720aad1f01 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:36.567529 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 725/1446] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:38.200259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4f0cf-e301-471d-959a-ea4424718190 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:38.200830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4f0cf-e301-471d-959a-ea4424718190 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:38.200830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4f0cf-e301-471d-959a-ea4424718190 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:38.202563 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 901 bytes} [Sat Nov 27 20:37:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:38.208063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f2e6e-1b88-4cfd-ac24-1b6dcbb70a85 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:38.208496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f2e6e-1b88-4cfd-ac24-1b6dcbb70a85 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:38.208610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f2e6e-1b88-4cfd-ac24-1b6dcbb70a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:38.227007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0d2f2e6e-1b88-4cfd-ac24-1b6dcbb70a85 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:38.228268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0d2f2e6e-1b88-4cfd-ac24-1b6dcbb70a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:38.236021 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 998 bytes} [Sat Nov 27 20:37:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:38.396368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4f0cf-e301-471d-959a-ea4424718190 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:38.410402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4f0cf-e301-471d-959a-ea4424718190 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:38.415775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab43df-4d90-41c3-8a5e-3fe38e1fa3a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:38.416400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab43df-4d90-41c3-8a5e-3fe38e1fa3a9 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:38.416681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab43df-4d90-41c3-8a5e-3fe38e1fa3a9 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:38.416957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab43df-4d90-41c3-8a5e-3fe38e1fa3a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:38.424831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab43df-4d90-41c3-8a5e-3fe38e1fa3a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:38.426541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab43df-4d90-41c3-8a5e-3fe38e1fa3a9 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:38.436555 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 723/1449] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:40.022734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab141-8ec3-442a-9ca0-15ec7956a22c None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:40.023239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab141-8ec3-442a-9ca0-15ec7956a22c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:40.023375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab141-8ec3-442a-9ca0-15ec7956a22c None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:40.025121 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 901 bytes} [Sat Nov 27 20:37:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:40.031189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e583c6e-a9ee-4f98-b116-56b96fd1ee02 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:40.031647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e583c6e-a9ee-4f98-b116-56b96fd1ee02 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:40.031819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e583c6e-a9ee-4f98-b116-56b96fd1ee02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:40.050217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5e583c6e-a9ee-4f98-b116-56b96fd1ee02 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:40.051441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5e583c6e-a9ee-4f98-b116-56b96fd1ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:40.059155 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 998 bytes} [Sat Nov 27 20:37:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:40.220984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ab141-8ec3-442a-9ca0-15ec7956a22c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:40.235461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ab141-8ec3-442a-9ca0-15ec7956a22c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:40.240757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7996b-c3c5-49e5-b828-64606d37beda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:40.241484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7996b-c3c5-49e5-b828-64606d37beda service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:40.241770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7996b-c3c5-49e5-b828-64606d37beda service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:40.242042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7996b-c3c5-49e5-b828-64606d37beda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:40.250873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7996b-c3c5-49e5-b828-64606d37beda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:40.252491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7996b-c3c5-49e5-b828-64606d37beda service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:40.262352 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 728/1452] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:41.859344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b3d99-7920-4cb5-b546-35580258851e None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:41.859922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b3d99-7920-4cb5-b546-35580258851e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:41.859922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b3d99-7920-4cb5-b546-35580258851e None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:41.861731 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 901 bytes} [Sat Nov 27 20:37:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:41.867244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260943-2145-4ffb-af9d-845fcbc005cd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:41.867696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260943-2145-4ffb-af9d-845fcbc005cd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:41.867841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260943-2145-4ffb-af9d-845fcbc005cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:41.886343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f9260943-2145-4ffb-af9d-845fcbc005cd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:41.887632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f9260943-2145-4ffb-af9d-845fcbc005cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:41.895365 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 998 bytes} [Sat Nov 27 20:37:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:42.056690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b3d99-7920-4cb5-b546-35580258851e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:42.070485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b3d99-7920-4cb5-b546-35580258851e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:42.076410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d94581-00fa-43d3-805f-399313afc37d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:42.077032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94581-00fa-43d3-805f-399313afc37d service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:42.077311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94581-00fa-43d3-805f-399313afc37d service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:42.077579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d94581-00fa-43d3-805f-399313afc37d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:42.085397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d94581-00fa-43d3-805f-399313afc37d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:42.087010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d94581-00fa-43d3-805f-399313afc37d service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:42.096703 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 726/1455] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:43.668749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe3ff7-dbdf-487f-a70d-157ad915e40a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:43.669317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe3ff7-dbdf-487f-a70d-157ad915e40a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:43.669317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe3ff7-dbdf-487f-a70d-157ad915e40a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:43.671083 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 901 bytes} [Sat Nov 27 20:37:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:43.676500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49dbe5-c929-4e61-9dd9-906d4cedabd6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:43.676937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49dbe5-c929-4e61-9dd9-906d4cedabd6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:43.677050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49dbe5-c929-4e61-9dd9-906d4cedabd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:43.694498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fc49dbe5-c929-4e61-9dd9-906d4cedabd6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:43.695699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fc49dbe5-c929-4e61-9dd9-906d4cedabd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:43.703482 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 998 bytes} [Sat Nov 27 20:37:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:43.865546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe3ff7-dbdf-487f-a70d-157ad915e40a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:43.879674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe3ff7-dbdf-487f-a70d-157ad915e40a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:43.885009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffaff6-e0ac-42b3-a75f-b8080d94f129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:43.885630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffaff6-e0ac-42b3-a75f-b8080d94f129 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:43.885908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffaff6-e0ac-42b3-a75f-b8080d94f129 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:43.886176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffaff6-e0ac-42b3-a75f-b8080d94f129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:43.894065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffaff6-e0ac-42b3-a75f-b8080d94f129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:43.895668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffaff6-e0ac-42b3-a75f-b8080d94f129 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:43.905137 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 731/1458] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:45.438030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856437c2-4165-4dad-9a57-cc072f7935ab None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:45.438602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856437c2-4165-4dad-9a57-cc072f7935ab None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:45.438602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856437c2-4165-4dad-9a57-cc072f7935ab None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:45.440443 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 901 bytes} [Sat Nov 27 20:37:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:45.446164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd6af3-bcf5-405a-bc9f-43e79256d51e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:45.446619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd6af3-bcf5-405a-bc9f-43e79256d51e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:45.447756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd6af3-bcf5-405a-bc9f-43e79256d51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:45.465000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c7cd6af3-bcf5-405a-bc9f-43e79256d51e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:45.466214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c7cd6af3-bcf5-405a-bc9f-43e79256d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:45.474022 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 998 bytes} [Sat Nov 27 20:37:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:45.634823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856437c2-4165-4dad-9a57-cc072f7935ab None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:45.648982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856437c2-4165-4dad-9a57-cc072f7935ab None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:45.654339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d89dda-65f9-4cd6-83b3-4d253ab18ca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:45.654965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d89dda-65f9-4cd6-83b3-4d253ab18ca6 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:45.655244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d89dda-65f9-4cd6-83b3-4d253ab18ca6 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:45.655542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d89dda-65f9-4cd6-83b3-4d253ab18ca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:45.663472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d89dda-65f9-4cd6-83b3-4d253ab18ca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:45.665028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d89dda-65f9-4cd6-83b3-4d253ab18ca6 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:45.674735 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 729/1461] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:47.210604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a91bf-065a-476a-b2e7-86142ba40fdc None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:47.211202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a91bf-065a-476a-b2e7-86142ba40fdc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:47.211202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a91bf-065a-476a-b2e7-86142ba40fdc None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:47.213387 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 901 bytes} [Sat Nov 27 20:37:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:47.220034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082230d7-c769-464c-b00d-eb505eeff21b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:47.220617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082230d7-c769-464c-b00d-eb505eeff21b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:47.220711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082230d7-c769-464c-b00d-eb505eeff21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:47.241050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-082230d7-c769-464c-b00d-eb505eeff21b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:47.242219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-082230d7-c769-464c-b00d-eb505eeff21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:47.250694 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 998 bytes} [Sat Nov 27 20:37:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:37:47.411444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a91bf-065a-476a-b2e7-86142ba40fdc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:47.426040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a91bf-065a-476a-b2e7-86142ba40fdc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:47.431628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b519ba-f872-4f13-8fb9-dcfab0e0047b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:47.432253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b519ba-f872-4f13-8fb9-dcfab0e0047b service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:47.432531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b519ba-f872-4f13-8fb9-dcfab0e0047b service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:47.432798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b519ba-f872-4f13-8fb9-dcfab0e0047b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:47.440943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b519ba-f872-4f13-8fb9-dcfab0e0047b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:47.442548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b519ba-f872-4f13-8fb9-dcfab0e0047b service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:47.451948 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 734/1464] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:48.998164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f0d0c-4d9d-4807-b4ef-7110f1be1493 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:48.998741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f0d0c-4d9d-4807-b4ef-7110f1be1493 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:48.998741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f0d0c-4d9d-4807-b4ef-7110f1be1493 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:49.000781 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 901 bytes} [Sat Nov 27 20:37:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:49.006305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd5374-c3ba-4801-8d72-b64a3f0e9336 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:49.006747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd5374-c3ba-4801-8d72-b64a3f0e9336 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:49.006855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd5374-c3ba-4801-8d72-b64a3f0e9336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:49.024990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-76bd5374-c3ba-4801-8d72-b64a3f0e9336 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:49.026164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-76bd5374-c3ba-4801-8d72-b64a3f0e9336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:49.033717 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 998 bytes} [Sat Nov 27 20:37:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:37:49.199087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f0d0c-4d9d-4807-b4ef-7110f1be1493 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:49.214359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f0d0c-4d9d-4807-b4ef-7110f1be1493 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:49.219659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172223d-ca37-492a-85a9-a63039749f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:49.220293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172223d-ca37-492a-85a9-a63039749f23 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:49.220578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172223d-ca37-492a-85a9-a63039749f23 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:49.220851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172223d-ca37-492a-85a9-a63039749f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:49.228746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172223d-ca37-492a-85a9-a63039749f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:49.230305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172223d-ca37-492a-85a9-a63039749f23 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:49.239820 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 732/1467] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:51.546570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268cdd-1973-4b65-b129-619d23d91baa None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:51.547218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268cdd-1973-4b65-b129-619d23d91baa None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:51.547218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268cdd-1973-4b65-b129-619d23d91baa None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:51.548915 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:37:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:51.556143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b6b37-79b4-4b6e-ac52-744c03268d48 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:51.557178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b6b37-79b4-4b6e-ac52-744c03268d48 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:51.557305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b6b37-79b4-4b6e-ac52-744c03268d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:51.574918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-402b6b37-79b4-4b6e-ac52-744c03268d48 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:51.576146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-402b6b37-79b4-4b6e-ac52-744c03268d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:51.583898 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:37:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:37:51.625514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46268cdd-1973-4b65-b129-619d23d91baa None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:51.636065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46268cdd-1973-4b65-b129-619d23d91baa None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:51.639559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02847bd-48e8-482d-8e42-9aa9f1cc45ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:51.640189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02847bd-48e8-482d-8e42-9aa9f1cc45ca service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:51.640472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02847bd-48e8-482d-8e42-9aa9f1cc45ca service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:51.640747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02847bd-48e8-482d-8e42-9aa9f1cc45ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:51.649789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02847bd-48e8-482d-8e42-9aa9f1cc45ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:51.651209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02847bd-48e8-482d-8e42-9aa9f1cc45ca service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:51.660333 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 737/1470] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:54.216391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae47d84-80f6-44cc-82d2-eff199e59ccf None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:54.216956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae47d84-80f6-44cc-82d2-eff199e59ccf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:54.216956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae47d84-80f6-44cc-82d2-eff199e59ccf None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:54.218772 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 734/1471] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:37:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:37:54.224774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4d096-f4cf-4abd-abc2-89d0019b40a8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:54.225212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4d096-f4cf-4abd-abc2-89d0019b40a8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:54.225353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4d096-f4cf-4abd-abc2-89d0019b40a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:54.243511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-80c4d096-f4cf-4abd-abc2-89d0019b40a8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:54.244640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-80c4d096-f4cf-4abd-abc2-89d0019b40a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:54.252758 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 738/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:37:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:54.294254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae47d84-80f6-44cc-82d2-eff199e59ccf None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:54.309234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae47d84-80f6-44cc-82d2-eff199e59ccf None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:54.313218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671e52a-d92b-4e0c-8d90-231436a7acef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:54.313862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671e52a-d92b-4e0c-8d90-231436a7acef service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:54.314146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671e52a-d92b-4e0c-8d90-231436a7acef service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:54.314428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671e52a-d92b-4e0c-8d90-231436a7acef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:54.323713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671e52a-d92b-4e0c-8d90-231436a7acef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:54.325131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671e52a-d92b-4e0c-8d90-231436a7acef service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:54.334303 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 735/1473] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:57.065759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60cc7c-0b25-4f68-af34-b4cf4015c192 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:57.066332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60cc7c-0b25-4f68-af34-b4cf4015c192 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:57.066332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60cc7c-0b25-4f68-af34-b4cf4015c192 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:57.068135 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 739/1474] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:37:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:57.074735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede5c8e-4e74-4167-9ec0-76ca5eb9e33a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:57.075207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede5c8e-4e74-4167-9ec0-76ca5eb9e33a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:57.075207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede5c8e-4e74-4167-9ec0-76ca5eb9e33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:57.093110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6ede5c8e-4e74-4167-9ec0-76ca5eb9e33a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:57.094295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6ede5c8e-4e74-4167-9ec0-76ca5eb9e33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:57.102004 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 736/1475] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:37:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:57.144303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60cc7c-0b25-4f68-af34-b4cf4015c192 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:57.154671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60cc7c-0b25-4f68-af34-b4cf4015c192 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:57.158102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01c784-b6a1-4dc2-b28a-2da09af4f208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:57.158748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c784-b6a1-4dc2-b28a-2da09af4f208 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:57.159025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c784-b6a1-4dc2-b28a-2da09af4f208 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:57.159326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c784-b6a1-4dc2-b28a-2da09af4f208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:57.168838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01c784-b6a1-4dc2-b28a-2da09af4f208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:57.170502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01c784-b6a1-4dc2-b28a-2da09af4f208 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:57.180214 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 740/1476] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:37:59.758810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d8b9b-726b-4c3c-b1c4-6e6a5011f80d None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:59.759429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d8b9b-726b-4c3c-b1c4-6e6a5011f80d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:59.759539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d8b9b-726b-4c3c-b1c4-6e6a5011f80d None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:59.761211 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 737/1477] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:37:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:37:59.767283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87925b-3128-4142-8f84-ef9b41813768 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:59.767751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87925b-3128-4142-8f84-ef9b41813768 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:59.767879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87925b-3128-4142-8f84-ef9b41813768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:59.785396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4c87925b-3128-4142-8f84-ef9b41813768 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:37:59.786576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4c87925b-3128-4142-8f84-ef9b41813768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:37:59.794833 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 741/1478] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:37:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:37:59.836167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d8b9b-726b-4c3c-b1c4-6e6a5011f80d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:37:59.846549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d8b9b-726b-4c3c-b1c4-6e6a5011f80d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:37:59.850057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8e700-9f72-4214-a614-6a18c0003ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:37:59.850680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e700-9f72-4214-a614-6a18c0003ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:37:59.850964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e700-9f72-4214-a614-6a18c0003ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:37:59.851240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8e700-9f72-4214-a614-6a18c0003ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:37:59.860587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8e700-9f72-4214-a614-6a18c0003ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:37:59.862012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8e700-9f72-4214-a614-6a18c0003ad4 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:37:59.871433 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 738/1479] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:37:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:38:02.344165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b264e-da71-4667-81b5-498d5e696fc5 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:02.344703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b264e-da71-4667-81b5-498d5e696fc5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:02.344703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b264e-da71-4667-81b5-498d5e696fc5 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:02.346525 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 742/1480] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:38:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:02.352569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b650-f5f4-4416-966d-844d2a26d627 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:02.353064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b650-f5f4-4416-966d-844d2a26d627 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:02.353174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38b650-f5f4-4416-966d-844d2a26d627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:02.370857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7c38b650-f5f4-4416-966d-844d2a26d627 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:02.372038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7c38b650-f5f4-4416-966d-844d2a26d627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:02.379960 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 739/1481] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:38:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:02.422516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b264e-da71-4667-81b5-498d5e696fc5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:02.435133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b264e-da71-4667-81b5-498d5e696fc5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:02.438847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17811cea-85bb-4b11-be2f-89d2d5398b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:02.439508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17811cea-85bb-4b11-be2f-89d2d5398b2a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:02.439787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17811cea-85bb-4b11-be2f-89d2d5398b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:02.440056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17811cea-85bb-4b11-be2f-89d2d5398b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:02.450034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17811cea-85bb-4b11-be2f-89d2d5398b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:02.451507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17811cea-85bb-4b11-be2f-89d2d5398b2a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:02.460735 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 743/1482] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:38:04.919063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9703c9d-faa3-43b8-ba78-39f3dd0d3a8c None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:04.919682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9703c9d-faa3-43b8-ba78-39f3dd0d3a8c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:04.919682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9703c9d-faa3-43b8-ba78-39f3dd0d3a8c None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:04.921488 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 740/1483] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:38:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:04.927365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9d71-ff3f-444f-8201-b0fd9d764ba8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:04.927820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9d71-ff3f-444f-8201-b0fd9d764ba8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:04.927941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9d71-ff3f-444f-8201-b0fd9d764ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:04.945619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fb6c9d71-ff3f-444f-8201-b0fd9d764ba8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:04.947427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fb6c9d71-ff3f-444f-8201-b0fd9d764ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:04.955034 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 744/1484] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:38:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:38:04.995438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9703c9d-faa3-43b8-ba78-39f3dd0d3a8c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:05.006137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9703c9d-faa3-43b8-ba78-39f3dd0d3a8c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:05.010215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0213a5-7288-478a-8d02-f268ea1bfa4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:05.010837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0213a5-7288-478a-8d02-f268ea1bfa4e service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:05.011120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0213a5-7288-478a-8d02-f268ea1bfa4e service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:05.011431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0213a5-7288-478a-8d02-f268ea1bfa4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:05.020176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0213a5-7288-478a-8d02-f268ea1bfa4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:05.021590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0213a5-7288-478a-8d02-f268ea1bfa4e service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:05.030653 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 741/1485] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:38:07.506126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b998a81-8251-42ea-907f-9327868a595b None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:07.506719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b998a81-8251-42ea-907f-9327868a595b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:07.506719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b998a81-8251-42ea-907f-9327868a595b None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:07.508570 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 745/1486] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:38:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:07.514590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a740fb-09b8-4e33-bdfd-c7d43cedbcde None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:07.515032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a740fb-09b8-4e33-bdfd-c7d43cedbcde None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:07.515143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a740fb-09b8-4e33-bdfd-c7d43cedbcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:07.532537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-40a740fb-09b8-4e33-bdfd-c7d43cedbcde None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:07.533718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-40a740fb-09b8-4e33-bdfd-c7d43cedbcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:07.542008 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 742/1487] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:38:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:07.582290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b998a81-8251-42ea-907f-9327868a595b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:07.592789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b998a81-8251-42ea-907f-9327868a595b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:07.596248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2a441-5404-4db4-8234-cbd4f34b8a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:07.596868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2a441-5404-4db4-8234-cbd4f34b8a13 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:07.597145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2a441-5404-4db4-8234-cbd4f34b8a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:07.597416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2a441-5404-4db4-8234-cbd4f34b8a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:07.606525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2a441-5404-4db4-8234-cbd4f34b8a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:07.607996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2a441-5404-4db4-8234-cbd4f34b8a13 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:07.617242 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 746/1488] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:38:10.122682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a31f-99a7-42b7-9e1a-b219251499cf None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:10.123238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a31f-99a7-42b7-9e1a-b219251499cf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:10.123238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a31f-99a7-42b7-9e1a-b219251499cf None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:10.125335 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 743/1489] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:38:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:10.131102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeced03-76c3-4e3b-997b-46b231049c26 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:10.131565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeced03-76c3-4e3b-997b-46b231049c26 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:10.131685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeced03-76c3-4e3b-997b-46b231049c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:10.150347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9aeced03-76c3-4e3b-997b-46b231049c26 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:10.151767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9aeced03-76c3-4e3b-997b-46b231049c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:10.159893 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 747/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:38:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:10.200715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9a31f-99a7-42b7-9e1a-b219251499cf None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:10.211813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9a31f-99a7-42b7-9e1a-b219251499cf None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:10.219157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182de399-a598-4002-87ee-ac32623c134d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:10.219840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182de399-a598-4002-87ee-ac32623c134d service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:10.220126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182de399-a598-4002-87ee-ac32623c134d service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:10.220405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182de399-a598-4002-87ee-ac32623c134d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:10.229686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182de399-a598-4002-87ee-ac32623c134d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:10.231135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182de399-a598-4002-87ee-ac32623c134d service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:10.240257 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 744/1491] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:38:12.667621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d85d8-4fce-4051-b031-1ef4868a9eb9 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:12.668192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d85d8-4fce-4051-b031-1ef4868a9eb9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:12.668192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d85d8-4fce-4051-b031-1ef4868a9eb9 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:12.669921 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 748/1492] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:38:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:12.675919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce167f-5b3d-4678-9cbd-b39202fb5dd8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:12.676362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce167f-5b3d-4678-9cbd-b39202fb5dd8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:12.676489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce167f-5b3d-4678-9cbd-b39202fb5dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:12.694259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-dfce167f-5b3d-4678-9cbd-b39202fb5dd8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:12.695452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dfce167f-5b3d-4678-9cbd-b39202fb5dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:12.703093 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 745/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:38:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:12.741034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d85d8-4fce-4051-b031-1ef4868a9eb9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:12.752613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d85d8-4fce-4051-b031-1ef4868a9eb9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:12.756175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e10e0-135e-42e7-8eb7-4c9d2cc73f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:12.756802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e10e0-135e-42e7-8eb7-4c9d2cc73f7d service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:12.757107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e10e0-135e-42e7-8eb7-4c9d2cc73f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:12.757380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e10e0-135e-42e7-8eb7-4c9d2cc73f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:12.766417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e10e0-135e-42e7-8eb7-4c9d2cc73f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:12.767951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e10e0-135e-42e7-8eb7-4c9d2cc73f7d service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:12.777079 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 749/1494] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:38:15.235647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f96be7-92ce-410c-8f45-f868e80ca2b4 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:15.236195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f96be7-92ce-410c-8f45-f868e80ca2b4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:15.236195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f96be7-92ce-410c-8f45-f868e80ca2b4 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:15.237933 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 746/1495] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:38:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:15.244319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949eead-f6b3-42a7-b64d-7c144e6affd2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:15.244709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949eead-f6b3-42a7-b64d-7c144e6affd2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:15.244881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949eead-f6b3-42a7-b64d-7c144e6affd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:15.263536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c949eead-f6b3-42a7-b64d-7c144e6affd2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:15.264746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c949eead-f6b3-42a7-b64d-7c144e6affd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:15.272534 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 750/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:38:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:38:15.311527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f96be7-92ce-410c-8f45-f868e80ca2b4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:15.322550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f96be7-92ce-410c-8f45-f868e80ca2b4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:15.326256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026750b-92cd-4ff7-9e15-c90d372f7bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:15.326917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026750b-92cd-4ff7-9e15-c90d372f7bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:15.327196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026750b-92cd-4ff7-9e15-c90d372f7bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:15.327514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026750b-92cd-4ff7-9e15-c90d372f7bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:15.336373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026750b-92cd-4ff7-9e15-c90d372f7bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:15.337809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026750b-92cd-4ff7-9e15-c90d372f7bb1 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:15.347435 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 747/1497] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:38:33.151497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d89dd-bce4-4e00-983e-fc12f5aeb040 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:33.152107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d89dd-bce4-4e00-983e-fc12f5aeb040 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:33.152107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d89dd-bce4-4e00-983e-fc12f5aeb040 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:33.153863 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 751/1498] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:38:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:33.160039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051083c6-0063-44c7-a836-ed6cc28c0504 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:33.160479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051083c6-0063-44c7-a836-ed6cc28c0504 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:33.160582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051083c6-0063-44c7-a836-ed6cc28c0504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:33.178903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-051083c6-0063-44c7-a836-ed6cc28c0504 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:33.180679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-051083c6-0063-44c7-a836-ed6cc28c0504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:33.189484 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 748/1499] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:38:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:33.242024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdf5c8-252c-4976-826a-c5a789c18e9b None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:33.242887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdf5c8-252c-4976-826a-c5a789c18e9b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:33.243170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdf5c8-252c-4976-826a-c5a789c18e9b None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:33.244993 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 752/1500] 10.222.0.21 () {54 vars in 962 bytes} [Sat Nov 27 20:38:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:33.250868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca8ec0-d65e-4c31-840c-3faa6bca2709 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:33.251270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca8ec0-d65e-4c31-840c-3faa6bca2709 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:33.251552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca8ec0-d65e-4c31-840c-3faa6bca2709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:33.269725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-14ca8ec0-d65e-4c31-840c-3faa6bca2709 None None] MFA Rules not processed for user `7e4c41e7988043c0b3b8e338ccd31d37`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:33.270898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-14ca8ec0-d65e-4c31-840c-3faa6bca2709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:33.277282 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 749/1501] 10.222.0.21 () {58 vars in 1059 bytes} [Sat Nov 27 20:38:33 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:33.285082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdf5c8-252c-4976-826a-c5a789c18e9b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:33.295574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdf5c8-252c-4976-826a-c5a789c18e9b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:33.299094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828f18c-a675-4636-bb62-6eb6baf26914 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:33.299759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828f18c-a675-4636-bb62-6eb6baf26914 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:33.300044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828f18c-a675-4636-bb62-6eb6baf26914 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:33.300318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828f18c-a675-4636-bb62-6eb6baf26914 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:33.309817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828f18c-a675-4636-bb62-6eb6baf26914 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:33.311297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828f18c-a675-4636-bb62-6eb6baf26914 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:33.320293 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 753/1502] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:38:35.862492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5393447-e2fe-402b-b372-d39f70d0069b None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:35.863071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5393447-e2fe-402b-b372-d39f70d0069b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:35.863071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5393447-e2fe-402b-b372-d39f70d0069b None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:35.864823 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 750/1503] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:38:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:35.871174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023042-13ad-4048-883d-06a091d9bd21 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:35.871669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023042-13ad-4048-883d-06a091d9bd21 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:35.871782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80023042-13ad-4048-883d-06a091d9bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:35.889511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-80023042-13ad-4048-883d-06a091d9bd21 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:35.890690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-80023042-13ad-4048-883d-06a091d9bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:35.898728 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 754/1504] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:38:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:35.924633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5393447-e2fe-402b-b372-d39f70d0069b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:35.937276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5393447-e2fe-402b-b372-d39f70d0069b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:35.941642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d69b76-103f-4770-a41a-915a5e334773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:35.942272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d69b76-103f-4770-a41a-915a5e334773 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:35.942546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d69b76-103f-4770-a41a-915a5e334773 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:35.942814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d69b76-103f-4770-a41a-915a5e334773 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:35.943602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d69b76-103f-4770-a41a-915a5e334773 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:35.945403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d69b76-103f-4770-a41a-915a5e334773 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:35.958384 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 751/1505] 10.222.0.21 () {56 vars in 1108 bytes} [Sat Nov 27 20:38:35 2021] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:38:38.422046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d06243-683e-4a1a-b64f-a4404165988d None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:38.422620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d06243-683e-4a1a-b64f-a4404165988d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:38.422620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d06243-683e-4a1a-b64f-a4404165988d None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:38.424430 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 755/1506] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:38:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:38.430412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6316d-fc97-4efa-b648-23b0220c9e58 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:38.430850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6316d-fc97-4efa-b648-23b0220c9e58 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:38.430965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6316d-fc97-4efa-b648-23b0220c9e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:38.448619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f3a6316d-fc97-4efa-b648-23b0220c9e58 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:38.449803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f3a6316d-fc97-4efa-b648-23b0220c9e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:38.457477 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 752/1507] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:38:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:38.503319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d06243-683e-4a1a-b64f-a4404165988d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:38.517491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d06243-683e-4a1a-b64f-a4404165988d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:38.523044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355c81d-73ac-45aa-b0ab-78c1310ff8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:38.524233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355c81d-73ac-45aa-b0ab-78c1310ff8ee service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:38.524513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355c81d-73ac-45aa-b0ab-78c1310ff8ee service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:38.524782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355c81d-73ac-45aa-b0ab-78c1310ff8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:38.532921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355c81d-73ac-45aa-b0ab-78c1310ff8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:38.534522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355c81d-73ac-45aa-b0ab-78c1310ff8ee service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:38.544247 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 756/1508] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:38:41.175618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236eee-8b62-4aee-bcc2-0a978754440c None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:41.176219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236eee-8b62-4aee-bcc2-0a978754440c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:41.176219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236eee-8b62-4aee-bcc2-0a978754440c None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:41.177978 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 753/1509] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:38:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:41.184289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a175134-f711-480c-b013-ced5d07de989 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:41.184752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a175134-f711-480c-b013-ced5d07de989 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:41.184846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a175134-f711-480c-b013-ced5d07de989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:41.202007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6a175134-f711-480c-b013-ced5d07de989 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:41.203173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6a175134-f711-480c-b013-ced5d07de989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:41.210704 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 757/1510] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:38:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:41.249239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c236eee-8b62-4aee-bcc2-0a978754440c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:41.259902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c236eee-8b62-4aee-bcc2-0a978754440c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:41.263342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b80ac-8ac5-4686-879f-12284c10423f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:41.263964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b80ac-8ac5-4686-879f-12284c10423f service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:41.264241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b80ac-8ac5-4686-879f-12284c10423f service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:41.264511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b80ac-8ac5-4686-879f-12284c10423f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:41.273197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b80ac-8ac5-4686-879f-12284c10423f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:41.274616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b80ac-8ac5-4686-879f-12284c10423f service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:41.283898 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 754/1511] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:38:43.759132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eba819-4e60-4f40-9a35-e2c044fdb844 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:43.759724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eba819-4e60-4f40-9a35-e2c044fdb844 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:43.759724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eba819-4e60-4f40-9a35-e2c044fdb844 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:43.761472 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 758/1512] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:38:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:43.767288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388893a-fb99-4b78-abf0-f930b1d5d286 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:43.767724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388893a-fb99-4b78-abf0-f930b1d5d286 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:43.767850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388893a-fb99-4b78-abf0-f930b1d5d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:43.785614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e388893a-fb99-4b78-abf0-f930b1d5d286 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:43.786811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e388893a-fb99-4b78-abf0-f930b1d5d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:43.794530 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 755/1513] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:38:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:43.834678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eba819-4e60-4f40-9a35-e2c044fdb844 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:43.845183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eba819-4e60-4f40-9a35-e2c044fdb844 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:43.848647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbf217-3950-49a7-bcb8-a088684ba2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:43.849269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf217-3950-49a7-bcb8-a088684ba2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:43.849546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf217-3950-49a7-bcb8-a088684ba2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:43.849816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbf217-3950-49a7-bcb8-a088684ba2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:43.858706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbf217-3950-49a7-bcb8-a088684ba2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:43.860160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbf217-3950-49a7-bcb8-a088684ba2b1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:43.869662 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 759/1514] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:38:46.385114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa371383-eb2c-44ce-b8ee-2965fa45ee1e None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:46.385643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa371383-eb2c-44ce-b8ee-2965fa45ee1e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:46.385643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa371383-eb2c-44ce-b8ee-2965fa45ee1e None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:46.387348 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 756/1515] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:38:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:46.393158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a950545-b079-4990-ad92-4b944b360123 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:46.393573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a950545-b079-4990-ad92-4b944b360123 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:46.393687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a950545-b079-4990-ad92-4b944b360123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:46.412012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9a950545-b079-4990-ad92-4b944b360123 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:46.413192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9a950545-b079-4990-ad92-4b944b360123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:46.421474 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 760/1516] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:38:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:46.464042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa371383-eb2c-44ce-b8ee-2965fa45ee1e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:46.474350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa371383-eb2c-44ce-b8ee-2965fa45ee1e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:46.478282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9eb53-02ee-4e81-85f0-9bb99a9472e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:46.478905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9eb53-02ee-4e81-85f0-9bb99a9472e4 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:46.479182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9eb53-02ee-4e81-85f0-9bb99a9472e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:46.479489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9eb53-02ee-4e81-85f0-9bb99a9472e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:46.487983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9eb53-02ee-4e81-85f0-9bb99a9472e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:46.489390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9eb53-02ee-4e81-85f0-9bb99a9472e4 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:46.499010 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 757/1517] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:38:49.094834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb42e6-b7e6-45ed-bb13-f985626d3142 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:49.095413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb42e6-b7e6-45ed-bb13-f985626d3142 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:49.095413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb42e6-b7e6-45ed-bb13-f985626d3142 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:49.097234 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 761/1518] 10.222.0.21 () {54 vars in 926 bytes} [Sat Nov 27 20:38:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:38:49.103827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46a4a-19d9-47e0-b41b-55f1193084fb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:49.104269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46a4a-19d9-47e0-b41b-55f1193084fb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:49.104366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46a4a-19d9-47e0-b41b-55f1193084fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:49.121709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-76a46a4a-19d9-47e0-b41b-55f1193084fb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:38:49.122912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-76a46a4a-19d9-47e0-b41b-55f1193084fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:38:49.130822 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 758/1519] 10.222.0.21 () {58 vars in 1023 bytes} [Sat Nov 27 20:38:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:38:49.172647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb42e6-b7e6-45ed-bb13-f985626d3142 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:38:49.182989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb42e6-b7e6-45ed-bb13-f985626d3142 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:38:49.186499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc82eb-640c-47f2-8a20-869fffac5745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:38:49.187120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc82eb-640c-47f2-8a20-869fffac5745 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:38:49.187436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc82eb-640c-47f2-8a20-869fffac5745 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:38:49.187707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc82eb-640c-47f2-8a20-869fffac5745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:38:49.196360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc82eb-640c-47f2-8a20-869fffac5745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:38:49.197777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc82eb-640c-47f2-8a20-869fffac5745 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:38:49.206785 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 762/1520] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:38:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:40:01.723874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34e94-3b7a-4117-92b4-95725cc350d2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:01.724435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34e94-3b7a-4117-92b4-95725cc350d2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:01.724435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a34e94-3b7a-4117-92b4-95725cc350d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:01.742844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d1a34e94-3b7a-4117-92b4-95725cc350d2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:40:01.744078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d1a34e94-3b7a-4117-92b4-95725cc350d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:40:01.752330 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 759/1521] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:40:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:40:01.766051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d75a0-ae0b-47d6-bf69-2f06974c6caa None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:01.766578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d75a0-ae0b-47d6-bf69-2f06974c6caa None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:01.766578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d75a0-ae0b-47d6-bf69-2f06974c6caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:01.784759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cf4d75a0-ae0b-47d6-bf69-2f06974c6caa None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:40:01.785937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cf4d75a0-ae0b-47d6-bf69-2f06974c6caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:40:01.794511 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 763/1522] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:40:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:40:01.798966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a34e94-3b7a-4117-92b4-95725cc350d2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:40:01.808432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a34e94-3b7a-4117-92b4-95725cc350d2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:40:01.812905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeafa07-6f3f-4efa-9045-85cc6e2732f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:40:01.813546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeafa07-6f3f-4efa-9045-85cc6e2732f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:01.813829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeafa07-6f3f-4efa-9045-85cc6e2732f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:01.814104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeafa07-6f3f-4efa-9045-85cc6e2732f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:01.814838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeafa07-6f3f-4efa-9045-85cc6e2732f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:40:01.815142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeafa07-6f3f-4efa-9045-85cc6e2732f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:40:01.816766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeafa07-6f3f-4efa-9045-85cc6e2732f6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:40:01.827852 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 760/1523] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:40:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:40:01.835971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d75a0-ae0b-47d6-bf69-2f06974c6caa None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:40:01.844810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d75a0-ae0b-47d6-bf69-2f06974c6caa None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:40:01.853637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8032e-fa5d-438b-ae03-3193cb847eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:40:01.854286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8032e-fa5d-438b-ae03-3193cb847eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:01.854567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8032e-fa5d-438b-ae03-3193cb847eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:01.854841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8032e-fa5d-438b-ae03-3193cb847eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:01.855571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8032e-fa5d-438b-ae03-3193cb847eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:40:01.857469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8032e-fa5d-438b-ae03-3193cb847eb9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:40:01.893699 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 764/1524] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:40:01 2021] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:40:01.898373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeafa07-6f3f-4efa-9045-85cc6e2732f6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:40:01.908026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeafa07-6f3f-4efa-9045-85cc6e2732f6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:40:01.961570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177f72e-d574-4c9a-9577-01b1084d1dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:40:01.962230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177f72e-d574-4c9a-9577-01b1084d1dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:01.962512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177f72e-d574-4c9a-9577-01b1084d1dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:01.962791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177f72e-d574-4c9a-9577-01b1084d1dd2 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:01.963609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177f72e-d574-4c9a-9577-01b1084d1dd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:40:01.965616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177f72e-d574-4c9a-9577-01b1084d1dd2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:40:01.985254 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 761/1525] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:40:01 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:40:01.989421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8032e-fa5d-438b-ae03-3193cb847eb9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:40:02.000306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8032e-fa5d-438b-ae03-3193cb847eb9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:40:02.004761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47adb3-87ff-4df7-b561-49b2ab4c3e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:40:02.005410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47adb3-87ff-4df7-b561-49b2ab4c3e34 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:02.005690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47adb3-87ff-4df7-b561-49b2ab4c3e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:02.005962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47adb3-87ff-4df7-b561-49b2ab4c3e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:02.006685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47adb3-87ff-4df7-b561-49b2ab4c3e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:40:02.008912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47adb3-87ff-4df7-b561-49b2ab4c3e34 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:40:02.021232 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 765/1526] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:40:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:40:02.025058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177f72e-d574-4c9a-9577-01b1084d1dd2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:40:02.034771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177f72e-d574-4c9a-9577-01b1084d1dd2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:40:02.039950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a25d4-0426-4ea7-ae25-fb2aec85268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:40:02.040589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a25d4-0426-4ea7-ae25-fb2aec85268e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:02.040875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a25d4-0426-4ea7-ae25-fb2aec85268e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:02.041153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a25d4-0426-4ea7-ae25-fb2aec85268e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:02.041884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a25d4-0426-4ea7-ae25-fb2aec85268e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:40:02.043499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a25d4-0426-4ea7-ae25-fb2aec85268e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:40:02.057584 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 762/1527] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:40:02 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:40:02.061678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47adb3-87ff-4df7-b561-49b2ab4c3e34 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:40:02.072443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47adb3-87ff-4df7-b561-49b2ab4c3e34 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:40:02.077019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f2e01-e1ec-4c60-a6b6-433adff9fcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:40:02.077892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f2e01-e1ec-4c60-a6b6-433adff9fcf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:02.078176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f2e01-e1ec-4c60-a6b6-433adff9fcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:02.078452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f2e01-e1ec-4c60-a6b6-433adff9fcf1 admin admin] PATH_INFO: `/v3/projects/9b27b2c648b24f80a4726ffd15d18047/users/b5cee677ae3b481ab95c6d3281120578/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:02.093149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f2e01-e1ec-4c60-a6b6-433adff9fcf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b27b2c648b24f80a4726ffd15d18047, user_id=b5cee677ae3b481ab95c6d3281120578, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:40:02.095848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f2e01-e1ec-4c60-a6b6-433adff9fcf1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:40:02.108768 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 766/1528] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:40:02 2021] PUT /identity/v3/projects/9b27b2c648b24f80a4726ffd15d18047/users/b5cee677ae3b481ab95c6d3281120578/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:40:02.119974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf0eeb-1604-4191-8b5f-b1ee6fff3b57 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:02.120267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf0eeb-1604-4191-8b5f-b1ee6fff3b57 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:02.120577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf0eeb-1604-4191-8b5f-b1ee6fff3b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:02.146349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c7bf0eeb-1604-4191-8b5f-b1ee6fff3b57 None None] MFA Rules not processed for user `b5cee677ae3b481ab95c6d3281120578`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:40:02.148243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c7bf0eeb-1604-4191-8b5f-b1ee6fff3b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:40:02.208164 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 763/1529] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:40:02 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:40:02.220158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f2e01-e1ec-4c60-a6b6-433adff9fcf1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:40:02.287015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f2e01-e1ec-4c60-a6b6-433adff9fcf1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:40:02.292539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd049cce-ebde-4464-b357-69db44c210c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:40:02.293175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd049cce-ebde-4464-b357-69db44c210c5 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:02.293462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd049cce-ebde-4464-b357-69db44c210c5 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:02.293742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd049cce-ebde-4464-b357-69db44c210c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:02.301369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd049cce-ebde-4464-b357-69db44c210c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:40:02.302958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd049cce-ebde-4464-b357-69db44c210c5 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:40:02.311588 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 767/1530] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:40:02 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:40:02.379660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bcd57-2e41-4a9c-a31e-bb69578418ed None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:02.379949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bcd57-2e41-4a9c-a31e-bb69578418ed None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:02.380228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bcd57-2e41-4a9c-a31e-bb69578418ed None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:02.382515 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 764/1531] 10.222.0.21 () {52 vars in 829 bytes} [Sat Nov 27 20:40:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:40:02.386144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd049cce-ebde-4464-b357-69db44c210c5 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:40:02.445656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd049cce-ebde-4464-b357-69db44c210c5 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:40:02.450185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:40:02.451045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:02.451349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:02.451620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] PATH_INFO: `/v3/users/b5cee677ae3b481ab95c6d3281120578` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:02.452812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5cee677ae3b481ab95c6d3281120578)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:40:02.453832 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:40:02.453832 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:40:02.453832 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:40:02.455032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:40:02.514757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5cee677ae3b481ab95c6d3281120578'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:40:02.515417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5cee677ae3b481ab95c6d3281120578'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:40:02.524392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5cee677ae3b481ab95c6d3281120578'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:40:02.525088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5cee677ae3b481ab95c6d3281120578'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:40:02.536920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5cee677ae3b481ab95c6d3281120578'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:40:02.562463 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 768/1532] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:40:02 2021] DELETE /identity/v3/users/b5cee677ae3b481ab95c6d3281120578 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:40:02.566823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0947f6-7d4d-46b9-a99d-6b1fd96f39b4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:02.567114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0947f6-7d4d-46b9-a99d-6b1fd96f39b4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:02.567422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0947f6-7d4d-46b9-a99d-6b1fd96f39b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:02.585218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5d0947f6-7d4d-46b9-a99d-6b1fd96f39b4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:40:02.586527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5d0947f6-7d4d-46b9-a99d-6b1fd96f39b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:40:02.642246 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 765/1533] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:40:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:40:02.652432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:40:02.653855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:40:02.709832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03541018-8c7b-45d9-ac9b-0b8bf1d90911 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:40:02.713446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0100a-e6a2-449d-a69a-239bb29a3bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:40:02.714116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0100a-e6a2-449d-a69a-239bb29a3bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:02.714382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0100a-e6a2-449d-a69a-239bb29a3bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:02.714652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0100a-e6a2-449d-a69a-239bb29a3bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:02.723372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0100a-e6a2-449d-a69a-239bb29a3bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:40:02.724797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0100a-e6a2-449d-a69a-239bb29a3bb0 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:40:02.733808 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 769/1534] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:40:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:40:03.087101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0947f6-7d4d-46b9-a99d-6b1fd96f39b4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:40:03.088575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5d0947f6-7d4d-46b9-a99d-6b1fd96f39b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:40:03.099971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0947f6-7d4d-46b9-a99d-6b1fd96f39b4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:40:03.105009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:40:03.105851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:40:03.106129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:40:03.106399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] PATH_INFO: `/v3/projects/9b27b2c648b24f80a4726ffd15d18047` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:40:03.107617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b27b2c648b24f80a4726ffd15d18047)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:40:03.109342 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:40:03.109342 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:40:03.109342 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:40:03.109785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:40:03.170776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b27b2c648b24f80a4726ffd15d18047', 'request_id': 'req-630e9028-18f0-4af4-a482-065409c181f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:40:03.179853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b27b2c648b24f80a4726ffd15d18047', 'request_id': 'req-630e9028-18f0-4af4-a482-065409c181f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:40:03.193167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b27b2c648b24f80a4726ffd15d18047', 'request_id': 'req-630e9028-18f0-4af4-a482-065409c181f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:40:03.203801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] The token cache is being invalidate because project 9b27b2c648b24f80a4726ffd15d18047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:40:03.204083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:40:03.204730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-630e9028-18f0-4af4-a482-065409c181f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:40:03.206340 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 766/1535] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:40:03 2021] DELETE /identity/v3/projects/9b27b2c648b24f80a4726ffd15d18047 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:43:16.210215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38189227-5988-49ef-a4b2-d6c186187296 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:16.210703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38189227-5988-49ef-a4b2-d6c186187296 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:16.211472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38189227-5988-49ef-a4b2-d6c186187296 None None] PATH_INFO: `/v3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:16.212674 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 770/1536] 10.222.0.35 () {54 vars in 925 bytes} [Sat Nov 27 20:43:16 2021] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:43:16.233847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14156b-6c33-414e-9283-8acf585b03d9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:16.234295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14156b-6c33-414e-9283-8acf585b03d9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:16.234402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14156b-6c33-414e-9283-8acf585b03d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:16.252324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ea14156b-6c33-414e-9283-8acf585b03d9 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:43:16.253510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ea14156b-6c33-414e-9283-8acf585b03d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:43:16.313667 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 767/1537] 10.222.0.35 () {58 vars in 1015 bytes} [Sat Nov 27 20:43:16 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:43:18.483140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d5713-88d4-4431-9583-c01acd7af4d1 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:18.483666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d5713-88d4-4431-9583-c01acd7af4d1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:18.483893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d5713-88d4-4431-9583-c01acd7af4d1 None None] PATH_INFO: `/v3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:18.485222 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 771/1538] 10.222.0.15 () {54 vars in 925 bytes} [Sat Nov 27 20:43:18 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:43:18.492269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277b7d1-150c-4cf2-a260-847f613acb84 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:18.492740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277b7d1-150c-4cf2-a260-847f613acb84 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:18.493018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277b7d1-150c-4cf2-a260-847f613acb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:18.512073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b277b7d1-150c-4cf2-a260-847f613acb84 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:43:18.513279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b277b7d1-150c-4cf2-a260-847f613acb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:43:18.521775 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 768/1539] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Nov 27 20:43:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:43:20.371183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63971914-a0fb-4ac3-ad4a-debf0b30281e None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:20.371804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63971914-a0fb-4ac3-ad4a-debf0b30281e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:20.371804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63971914-a0fb-4ac3-ad4a-debf0b30281e None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:20.373919 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 772/1540] 10.222.0.21 () {54 vars in 960 bytes} [Sat Nov 27 20:43:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:43:20.379322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3eec3-531d-4e42-9fbe-cbcb72f214ab None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:20.379755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3eec3-531d-4e42-9fbe-cbcb72f214ab None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:20.379878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3eec3-531d-4e42-9fbe-cbcb72f214ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:20.397812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8db3eec3-531d-4e42-9fbe-cbcb72f214ab None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:43:20.399524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8db3eec3-531d-4e42-9fbe-cbcb72f214ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:43:20.407850 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 769/1541] 10.222.0.21 () {58 vars in 1057 bytes} [Sat Nov 27 20:43:20 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:43:20.417613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63971914-a0fb-4ac3-ad4a-debf0b30281e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:43:20.430649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63971914-a0fb-4ac3-ad4a-debf0b30281e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:43:20.435707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c37e35-bc1d-4655-b9b5-56f68d723844 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:43:20.436359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c37e35-bc1d-4655-b9b5-56f68d723844 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:20.436639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c37e35-bc1d-4655-b9b5-56f68d723844 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:20.436912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c37e35-bc1d-4655-b9b5-56f68d723844 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:20.445352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c37e35-bc1d-4655-b9b5-56f68d723844 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:43:20.446946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c37e35-bc1d-4655-b9b5-56f68d723844 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:43:20.456337 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 773/1542] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:43:20 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:43:22.382563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d876ad-8a6b-4b98-9ebe-8361bb69acb3 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:22.383044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d876ad-8a6b-4b98-9ebe-8361bb69acb3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:22.383148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d876ad-8a6b-4b98-9ebe-8361bb69acb3 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:22.384976 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 770/1543] 10.222.0.21 () {54 vars in 960 bytes} [Sat Nov 27 20:43:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:43:22.390334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27bf6-49ea-4830-8be0-7bfe122c1f4d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:22.390770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27bf6-49ea-4830-8be0-7bfe122c1f4d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:22.390922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27bf6-49ea-4830-8be0-7bfe122c1f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:22.409458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a6a27bf6-49ea-4830-8be0-7bfe122c1f4d None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:43:22.410648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a6a27bf6-49ea-4830-8be0-7bfe122c1f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:43:22.419804 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 774/1544] 10.222.0.21 () {58 vars in 1057 bytes} [Sat Nov 27 20:43:22 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:43:22.483893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d876ad-8a6b-4b98-9ebe-8361bb69acb3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:43:22.496973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d876ad-8a6b-4b98-9ebe-8361bb69acb3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:43:22.502127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d5dca-5248-4902-b14f-8fd79b20bc90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:43:22.502755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d5dca-5248-4902-b14f-8fd79b20bc90 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:22.503038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d5dca-5248-4902-b14f-8fd79b20bc90 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:22.503345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d5dca-5248-4902-b14f-8fd79b20bc90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:22.511415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d5dca-5248-4902-b14f-8fd79b20bc90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:43:22.512997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d5dca-5248-4902-b14f-8fd79b20bc90 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:43:22.522290 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 771/1545] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:43:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:43:54.201239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de651f-73fe-4d92-b61c-4f364e09ebf9 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:54.201749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de651f-73fe-4d92-b61c-4f364e09ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:54.201854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de651f-73fe-4d92-b61c-4f364e09ebf9 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:54.203808 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 775/1546] 127.0.0.1 () {54 vars in 901 bytes} [Sat Nov 27 20:43:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:43:54.209261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b33b6-9da0-4cfe-b567-c4073181f0fa None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:54.209709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b33b6-9da0-4cfe-b567-c4073181f0fa None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:54.209890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b33b6-9da0-4cfe-b567-c4073181f0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:54.228096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3b7b33b6-9da0-4cfe-b567-c4073181f0fa None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:43:54.229293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3b7b33b6-9da0-4cfe-b567-c4073181f0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:43:54.285148 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 772/1547] 127.0.0.1 () {58 vars in 998 bytes} [Sat Nov 27 20:43:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:43:54.445870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de651f-73fe-4d92-b61c-4f364e09ebf9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:43:54.448093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d7de651f-73fe-4d92-b61c-4f364e09ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:43:54.519692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de651f-73fe-4d92-b61c-4f364e09ebf9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:43:54.525067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16670644-012a-46b2-919d-50744ceb09df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:43:54.526323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16670644-012a-46b2-919d-50744ceb09df service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:54.526602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16670644-012a-46b2-919d-50744ceb09df service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:54.526873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16670644-012a-46b2-919d-50744ceb09df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:54.534796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16670644-012a-46b2-919d-50744ceb09df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:43:54.536398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16670644-012a-46b2-919d-50744ceb09df service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:43:54.545632 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 776/1548] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:43:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:43:56.193455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42d61d-b005-4244-8b02-f16fddca69a2 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:56.193904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42d61d-b005-4244-8b02-f16fddca69a2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:56.194047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42d61d-b005-4244-8b02-f16fddca69a2 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:56.195919 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 773/1549] 127.0.0.1 () {54 vars in 901 bytes} [Sat Nov 27 20:43:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:43:56.202126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cd18d-3085-40eb-a9f2-211809f27e0c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:56.202561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cd18d-3085-40eb-a9f2-211809f27e0c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:56.202684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cd18d-3085-40eb-a9f2-211809f27e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:56.220301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a93cd18d-3085-40eb-a9f2-211809f27e0c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:43:56.221512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a93cd18d-3085-40eb-a9f2-211809f27e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:43:56.229289 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 777/1550] 127.0.0.1 () {58 vars in 998 bytes} [Sat Nov 27 20:43:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:43:56.389603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42d61d-b005-4244-8b02-f16fddca69a2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:43:56.404341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42d61d-b005-4244-8b02-f16fddca69a2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:43:56.410079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95573dc2-d92e-4eb4-bd22-8b175622b0dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:43:56.410821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95573dc2-d92e-4eb4-bd22-8b175622b0dc service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:43:56.411102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95573dc2-d92e-4eb4-bd22-8b175622b0dc service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:43:56.411404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95573dc2-d92e-4eb4-bd22-8b175622b0dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:43:56.419449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95573dc2-d92e-4eb4-bd22-8b175622b0dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:43:56.421060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95573dc2-d92e-4eb4-bd22-8b175622b0dc service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:43:56.430260 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 774/1551] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:43:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:44:00.727973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4b052-7efe-427a-b314-e31f87716da3 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:44:00.728566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4b052-7efe-427a-b314-e31f87716da3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:44:00.728566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4b052-7efe-427a-b314-e31f87716da3 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:44:00.730271 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 778/1552] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:44:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:44:00.736176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d2c34-04f8-40e9-9a62-86cdc1017eca None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:44:00.736634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d2c34-04f8-40e9-9a62-86cdc1017eca None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:44:00.736762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d2c34-04f8-40e9-9a62-86cdc1017eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:44:00.755389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-aa9d2c34-04f8-40e9-9a62-86cdc1017eca None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:44:00.756592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-aa9d2c34-04f8-40e9-9a62-86cdc1017eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:44:00.764996 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 775/1553] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:44:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:44:00.803706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4b052-7efe-427a-b314-e31f87716da3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:44:00.805391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1ce4b052-7efe-427a-b314-e31f87716da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:44:00.862243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4b052-7efe-427a-b314-e31f87716da3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:44:00.865763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d9a20-8831-4ea8-8686-fe2dd71b1d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:44:00.866400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9a20-8831-4ea8-8686-fe2dd71b1d7d service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:44:00.866683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9a20-8831-4ea8-8686-fe2dd71b1d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:44:00.866957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9a20-8831-4ea8-8686-fe2dd71b1d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:44:00.876637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d9a20-8831-4ea8-8686-fe2dd71b1d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:44:00.878075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d9a20-8831-4ea8-8686-fe2dd71b1d7d service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:44:00.888056 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 779/1554] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:44:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:44:03.304585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb4fb-240d-45ce-9b02-9c855b4739b2 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:44:03.306517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb4fb-240d-45ce-9b02-9c855b4739b2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:44:03.306517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb4fb-240d-45ce-9b02-9c855b4739b2 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:44:03.307440 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 776/1555] 127.0.0.1 () {54 vars in 916 bytes} [Sat Nov 27 20:44:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:44:03.313080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243b006-2f3a-4c19-8d00-7bcfe621030e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:44:03.313519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243b006-2f3a-4c19-8d00-7bcfe621030e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:44:03.313631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243b006-2f3a-4c19-8d00-7bcfe621030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:44:03.331575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0243b006-2f3a-4c19-8d00-7bcfe621030e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:44:03.332758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0243b006-2f3a-4c19-8d00-7bcfe621030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:44:03.341108 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 780/1556] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Nov 27 20:44:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:44:03.378853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb4fb-240d-45ce-9b02-9c855b4739b2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:44:03.390082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb4fb-240d-45ce-9b02-9c855b4739b2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:44:03.393601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d84960-90ac-49a4-8d6f-411b5b782894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:44:03.394225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84960-90ac-49a4-8d6f-411b5b782894 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:44:03.394505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84960-90ac-49a4-8d6f-411b5b782894 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:44:03.394779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d84960-90ac-49a4-8d6f-411b5b782894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:44:03.404264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d84960-90ac-49a4-8d6f-411b5b782894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:44:03.405687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d84960-90ac-49a4-8d6f-411b5b782894 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:44:03.415006 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 777/1557] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:44:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:44:53.290125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcd298-3c70-483e-9fcd-34793a9aa390 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:44:53.290740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcd298-3c70-483e-9fcd-34793a9aa390 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:44:53.290740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcd298-3c70-483e-9fcd-34793a9aa390 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:44:53.292662 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 781/1558] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:44:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:44:53.298544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa776-4618-482d-8a17-4ebcb46b084d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:44:53.299533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa776-4618-482d-8a17-4ebcb46b084d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:44:53.299938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaa776-4618-482d-8a17-4ebcb46b084d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:44:53.317765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8bfaa776-4618-482d-8a17-4ebcb46b084d None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:44:53.318926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8bfaa776-4618-482d-8a17-4ebcb46b084d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:44:53.327273 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 778/1559] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:44:53 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:22.718455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f0c9-628c-439d-8659-aa04e2096120 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:22.719071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f0c9-628c-439d-8659-aa04e2096120 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:22.719071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f0c9-628c-439d-8659-aa04e2096120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:22.743242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-bcf9f0c9-628c-439d-8659-aa04e2096120 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:22.744451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bcf9f0c9-628c-439d-8659-aa04e2096120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:22.757139 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 782/1560] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 27 20:45:22.767913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450447-8c91-43e4-84b7-c774526055c8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:22.768482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450447-8c91-43e4-84b7-c774526055c8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:22.768482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450447-8c91-43e4-84b7-c774526055c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:22.789533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9e450447-8c91-43e4-84b7-c774526055c8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:22.791071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e450447-8c91-43e4-84b7-c774526055c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:22.806014 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 779/1561] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:22.810549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9f0c9-628c-439d-8659-aa04e2096120 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:22.825135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9f0c9-628c-439d-8659-aa04e2096120 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:22.834390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd910c-2ac9-45d6-90fb-0819d52aecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:22.835467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd910c-2ac9-45d6-90fb-0819d52aecc7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:22.835753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd910c-2ac9-45d6-90fb-0819d52aecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:22.836030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd910c-2ac9-45d6-90fb-0819d52aecc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:22.836771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd910c-2ac9-45d6-90fb-0819d52aecc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:22.837077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd910c-2ac9-45d6-90fb-0819d52aecc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:22.838707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd910c-2ac9-45d6-90fb-0819d52aecc7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:22.854397 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 783/1562] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:22.863440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450447-8c91-43e4-84b7-c774526055c8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:22.875754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450447-8c91-43e4-84b7-c774526055c8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:22.883111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068b4e-91ea-4fcf-8bf8-f30a47cd441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:22.883800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068b4e-91ea-4fcf-8bf8-f30a47cd441f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:22.884083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068b4e-91ea-4fcf-8bf8-f30a47cd441f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:22.884419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068b4e-91ea-4fcf-8bf8-f30a47cd441f admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:22.885147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15068b4e-91ea-4fcf-8bf8-f30a47cd441f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:22.887092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15068b4e-91ea-4fcf-8bf8-f30a47cd441f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:22.927979 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 780/1563] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:22 2021] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:45:22.934711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd910c-2ac9-45d6-90fb-0819d52aecc7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:22.954589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd910c-2ac9-45d6-90fb-0819d52aecc7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:23.035997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f3b37-3c06-4f04-88de-c7c3bae4c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:23.036671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f3b37-3c06-4f04-88de-c7c3bae4c380 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.036952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f3b37-3c06-4f04-88de-c7c3bae4c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.037229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f3b37-3c06-4f04-88de-c7c3bae4c380 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.037933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f3b37-3c06-4f04-88de-c7c3bae4c380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:23.045860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f3b37-3c06-4f04-88de-c7c3bae4c380 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:23.072634 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 784/1564] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:22 2021] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:23.077320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068b4e-91ea-4fcf-8bf8-f30a47cd441f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:23.099325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068b4e-91ea-4fcf-8bf8-f30a47cd441f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:23.112549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999992d-1f6b-4034-ba48-586c91841032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:23.113238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999992d-1f6b-4034-ba48-586c91841032 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.113521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999992d-1f6b-4034-ba48-586c91841032 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.113797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999992d-1f6b-4034-ba48-586c91841032 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.114542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999992d-1f6b-4034-ba48-586c91841032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:23.116190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999992d-1f6b-4034-ba48-586c91841032 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:23.136625 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 781/1565] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:23 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:45:23.140762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f3b37-3c06-4f04-88de-c7c3bae4c380 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:23.155045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f3b37-3c06-4f04-88de-c7c3bae4c380 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:23.161621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccb349-5805-411f-b339-12ef6e977683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:23.162287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccb349-5805-411f-b339-12ef6e977683 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.162570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccb349-5805-411f-b339-12ef6e977683 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.162846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccb349-5805-411f-b339-12ef6e977683 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.163656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccb349-5805-411f-b339-12ef6e977683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:23.165281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccb349-5805-411f-b339-12ef6e977683 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:23.180666 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 785/1566] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:23 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:23.185400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999992d-1f6b-4034-ba48-586c91841032 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:23.201032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999992d-1f6b-4034-ba48-586c91841032 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:23.217194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0089142-279c-4e99-970c-7b1e3a9156b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:23.218099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0089142-279c-4e99-970c-7b1e3a9156b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.218379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0089142-279c-4e99-970c-7b1e3a9156b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.218990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0089142-279c-4e99-970c-7b1e3a9156b0 admin admin] PATH_INFO: `/v3/projects/75de5fe7240c4923a26724fd417391e8/users/c6bda78859f14c7a8f397a209503f28e/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.242313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0089142-279c-4e99-970c-7b1e3a9156b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75de5fe7240c4923a26724fd417391e8, user_id=c6bda78859f14c7a8f397a209503f28e, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:23.245630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0089142-279c-4e99-970c-7b1e3a9156b0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:23.266609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017398f-c2d7-4b69-9678-2541044e76e0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.266936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017398f-c2d7-4b69-9678-2541044e76e0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.267797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017398f-c2d7-4b69-9678-2541044e76e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.271100 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 782/1567] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:23 2021] PUT /identity/v3/projects/75de5fe7240c4923a26724fd417391e8/users/c6bda78859f14c7a8f397a209503f28e/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:23.285434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7922f-3e5f-469e-87c4-938b497b5a08 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.285767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7922f-3e5f-469e-87c4-938b497b5a08 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.286065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7922f-3e5f-469e-87c4-938b497b5a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.308539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2017398f-c2d7-4b69-9678-2541044e76e0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:23.309789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2017398f-c2d7-4b69-9678-2541044e76e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:23.331853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f3f7922f-3e5f-469e-87c4-938b497b5a08 None None] MFA Rules not processed for user `c6bda78859f14c7a8f397a209503f28e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:23.333082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f3f7922f-3e5f-469e-87c4-938b497b5a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:23.420097 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 786/1568] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:45:23.420097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501805a-b23e-4c41-a78e-b29e6730e7ce None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.420097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501805a-b23e-4c41-a78e-b29e6730e7ce None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.420097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501805a-b23e-4c41-a78e-b29e6730e7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.455893 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 783/1569] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:23.457228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354214fe-41df-4b3f-92eb-b90ef01f1f4e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.457519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354214fe-41df-4b3f-92eb-b90ef01f1f4e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.457799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354214fe-41df-4b3f-92eb-b90ef01f1f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.471337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2501805a-b23e-4c41-a78e-b29e6730e7ce None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:23.472543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2501805a-b23e-4c41-a78e-b29e6730e7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:23.491937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-354214fe-41df-4b3f-92eb-b90ef01f1f4e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:23.493132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-354214fe-41df-4b3f-92eb-b90ef01f1f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:23.497886 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 787/1570] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:23.498712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501805a-b23e-4c41-a78e-b29e6730e7ce None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:23.515731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501805a-b23e-4c41-a78e-b29e6730e7ce None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:23.516377 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 784/1571] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:23.517743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974667ad-efa7-43d2-8098-248c6591e18a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.518034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974667ad-efa7-43d2-8098-248c6591e18a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.518357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974667ad-efa7-43d2-8098-248c6591e18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.532092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8032304-4c80-4e21-a87b-e1764ac58e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:23.532770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8032304-4c80-4e21-a87b-e1764ac58e7f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.533055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8032304-4c80-4e21-a87b-e1764ac58e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.533333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8032304-4c80-4e21-a87b-e1764ac58e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.534746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8032304-4c80-4e21-a87b-e1764ac58e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:23.536958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8032304-4c80-4e21-a87b-e1764ac58e7f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:23.556266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-974667ad-efa7-43d2-8098-248c6591e18a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:23.557884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-974667ad-efa7-43d2-8098-248c6591e18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:23.573674 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 785/1572] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:23.574521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974667ad-efa7-43d2-8098-248c6591e18a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:23.592599 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 788/1573] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:23.593615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974667ad-efa7-43d2-8098-248c6591e18a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:23.594105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe1a34-194f-4f41-aee9-6177e0885e90 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.594607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe1a34-194f-4f41-aee9-6177e0885e90 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.594807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe1a34-194f-4f41-aee9-6177e0885e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.632339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d6fe1a34-194f-4f41-aee9-6177e0885e90 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:23.633810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d6fe1a34-194f-4f41-aee9-6177e0885e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:23.675503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a6c79-60d7-49ff-a8b1-3c59a2715c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:23.676188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a6c79-60d7-49ff-a8b1-3c59a2715c34 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.676468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a6c79-60d7-49ff-a8b1-3c59a2715c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.676746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a6c79-60d7-49ff-a8b1-3c59a2715c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.677588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a6c79-60d7-49ff-a8b1-3c59a2715c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:23.677898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a6c79-60d7-49ff-a8b1-3c59a2715c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:23.679648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a6c79-60d7-49ff-a8b1-3c59a2715c34 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:23.700055 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 786/1574] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:23.701301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a6c79-60d7-49ff-a8b1-3c59a2715c34 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:23.717137 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 789/1575] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:23.717970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe1a34-194f-4f41-aee9-6177e0885e90 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:23.721205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a6c79-60d7-49ff-a8b1-3c59a2715c34 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:23.730003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe1a34-194f-4f41-aee9-6177e0885e90 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:23.732793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5180db-0ecd-4510-8f1a-703fb067a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:23.733459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5180db-0ecd-4510-8f1a-703fb067a8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.734224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5180db-0ecd-4510-8f1a-703fb067a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.734224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5180db-0ecd-4510-8f1a-703fb067a8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.734734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5180db-0ecd-4510-8f1a-703fb067a8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:23.735039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5180db-0ecd-4510-8f1a-703fb067a8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:23.736676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5180db-0ecd-4510-8f1a-703fb067a8f7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:23.749389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f4c14-5247-454b-8526-6803103e13d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:23.750073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f4c14-5247-454b-8526-6803103e13d5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.750353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f4c14-5247-454b-8526-6803103e13d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.750624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f4c14-5247-454b-8526-6803103e13d5 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.751516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f4c14-5247-454b-8526-6803103e13d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:23.753461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f4c14-5247-454b-8526-6803103e13d5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:23.757169 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 787/1576] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:23.758269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7e1ba-7447-4fc1-9b59-7224915c88b3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.758556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7e1ba-7447-4fc1-9b59-7224915c88b3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.758833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7e1ba-7447-4fc1-9b59-7224915c88b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.790512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-99c7e1ba-7447-4fc1-9b59-7224915c88b3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:23.792545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-99c7e1ba-7447-4fc1-9b59-7224915c88b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:23.799541 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 790/1577] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/users => generated 298 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:23.801243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2ccb1-9998-4905-95d3-1b98227c0b46 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.801850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2ccb1-9998-4905-95d3-1b98227c0b46 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.802427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2ccb1-9998-4905-95d3-1b98227c0b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.805125 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 788/1578] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:23.808679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b6e7c-3b36-4c03-91f5-a77fc283e799 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.808679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b6e7c-3b36-4c03-91f5-a77fc283e799 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.808679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b6e7c-3b36-4c03-91f5-a77fc283e799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.829450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a36b6e7c-3b36-4c03-91f5-a77fc283e799 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:23.830520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0ce2ccb1-9998-4905-95d3-1b98227c0b46 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:23.831019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a36b6e7c-3b36-4c03-91f5-a77fc283e799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:23.832233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0ce2ccb1-9998-4905-95d3-1b98227c0b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:23.842879 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 789/1579] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:23.843829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b6e7c-3b36-4c03-91f5-a77fc283e799 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:23.845333 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 791/1580] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:23.851479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2ccb1-9998-4905-95d3-1b98227c0b46 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:23.856819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b6e7c-3b36-4c03-91f5-a77fc283e799 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:23.861751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6834f90-0d05-44e0-930f-678bcb8d1611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:23.861920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2ccb1-9998-4905-95d3-1b98227c0b46 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:23.862596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6834f90-0d05-44e0-930f-678bcb8d1611 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.862976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6834f90-0d05-44e0-930f-678bcb8d1611 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.863404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6834f90-0d05-44e0-930f-678bcb8d1611 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.864204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6834f90-0d05-44e0-930f-678bcb8d1611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:23.866290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6834f90-0d05-44e0-930f-678bcb8d1611 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:23.870947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bf46a-0a78-4800-a6ba-4f79f46bfb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:23.871936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bf46a-0a78-4800-a6ba-4f79f46bfb48 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.872219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bf46a-0a78-4800-a6ba-4f79f46bfb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.872498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bf46a-0a78-4800-a6ba-4f79f46bfb48 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.873319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bf46a-0a78-4800-a6ba-4f79f46bfb48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:23.875330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bf46a-0a78-4800-a6ba-4f79f46bfb48 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:23.892288 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 790/1581] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:23.893821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7efb4-8551-4e38-81f8-739ac38f939a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.894067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7efb4-8551-4e38-81f8-739ac38f939a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.894356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7efb4-8551-4e38-81f8-739ac38f939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.903345 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 792/1582] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:23.904515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bf46a-0a78-4800-a6ba-4f79f46bfb48 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:23.912724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9fd7efb4-8551-4e38-81f8-739ac38f939a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:23.913897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9fd7efb4-8551-4e38-81f8-739ac38f939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:23.965600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bf46a-0a78-4800-a6ba-4f79f46bfb48 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:23.970074 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 791/1583] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:23.970214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0f761-7489-47f8-818e-851abedcf6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:23.970751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0f761-7489-47f8-818e-851abedcf6cf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.971112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0f761-7489-47f8-818e-851abedcf6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.971435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad230-de15-4929-8663-4f0dabe52962 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.971556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0f761-7489-47f8-818e-851abedcf6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.971869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad230-de15-4929-8663-4f0dabe52962 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.972035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad230-de15-4929-8663-4f0dabe52962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.972168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0f761-7489-47f8-818e-851abedcf6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:23.973805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0f761-7489-47f8-818e-851abedcf6cf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:23.987172 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 793/1584] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:23 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:23.987172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f8e3-796f-42c5-8a64-9eacf1b28115 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:23.987172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f8e3-796f-42c5-8a64-9eacf1b28115 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:23.987172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f8e3-796f-42c5-8a64-9eacf1b28115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:23.991721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c74ad230-de15-4929-8663-4f0dabe52962 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:23.992928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c74ad230-de15-4929-8663-4f0dabe52962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:24.001881 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 792/1585] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:24.005588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ad230-de15-4929-8663-4f0dabe52962 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.005680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3dd8f8e3-796f-42c5-8a64-9eacf1b28115 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:24.006275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3dd8f8e3-796f-42c5-8a64-9eacf1b28115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:24.012243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ad230-de15-4929-8663-4f0dabe52962 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.014871 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 794/1586] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:24.016104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217936b9-ed45-4610-b673-b93257089699 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.016385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217936b9-ed45-4610-b673-b93257089699 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.016656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217936b9-ed45-4610-b673-b93257089699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.016877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2587d-67da-41dc-b2d6-edfd00678a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.017515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2587d-67da-41dc-b2d6-edfd00678a83 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.017797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2587d-67da-41dc-b2d6-edfd00678a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.018069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2587d-67da-41dc-b2d6-edfd00678a83 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.018795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2587d-67da-41dc-b2d6-edfd00678a83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:24.019101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2587d-67da-41dc-b2d6-edfd00678a83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.020735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2587d-67da-41dc-b2d6-edfd00678a83 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.039946 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 793/1587] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:24.039946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2587d-67da-41dc-b2d6-edfd00678a83 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.040257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-217936b9-ed45-4610-b673-b93257089699 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:24.040257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-217936b9-ed45-4610-b673-b93257089699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:24.043313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2587d-67da-41dc-b2d6-edfd00678a83 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.045424 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 795/1588] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:24.046165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217936b9-ed45-4610-b673-b93257089699 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.050520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef76505-c467-4bd8-9bae-1574dcd7545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.051354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76505-c467-4bd8-9bae-1574dcd7545a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.051638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76505-c467-4bd8-9bae-1574dcd7545a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.051917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76505-c467-4bd8-9bae-1574dcd7545a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.052634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef76505-c467-4bd8-9bae-1574dcd7545a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.054531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef76505-c467-4bd8-9bae-1574dcd7545a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.055749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217936b9-ed45-4610-b673-b93257089699 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.060266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec1917-6711-40ba-b3b5-7e5bf06b3417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.060895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec1917-6711-40ba-b3b5-7e5bf06b3417 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.061174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec1917-6711-40ba-b3b5-7e5bf06b3417 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.061444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec1917-6711-40ba-b3b5-7e5bf06b3417 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.062123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec1917-6711-40ba-b3b5-7e5bf06b3417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.064125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec1917-6711-40ba-b3b5-7e5bf06b3417 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.075489 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 794/1589] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:24.076752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248782-b520-4813-b200-59f590af81bb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.077009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248782-b520-4813-b200-59f590af81bb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.077351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248782-b520-4813-b200-59f590af81bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.090889 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 796/1590] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:24.090889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec1917-6711-40ba-b3b5-7e5bf06b3417 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.096541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-53248782-b520-4813-b200-59f590af81bb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:24.097724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-53248782-b520-4813-b200-59f590af81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:24.098971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec1917-6711-40ba-b3b5-7e5bf06b3417 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.103750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a0bfb-bd64-4583-adb8-e8cd7ad28395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.104704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a0bfb-bd64-4583-adb8-e8cd7ad28395 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.104983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a0bfb-bd64-4583-adb8-e8cd7ad28395 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.105256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a0bfb-bd64-4583-adb8-e8cd7ad28395 admin admin] PATH_INFO: `/v3/projects/8e7777e255604cfaa71fbcc6e505061c/users/05b3d69282f44610a7faa4cf5cd4a4fe/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.105668 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 795/1591] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:24.106577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53248782-b520-4813-b200-59f590af81bb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.115728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53248782-b520-4813-b200-59f590af81bb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.120312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c0422-0a45-4751-8f3f-4fa53a4abc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.120947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0422-0a45-4751-8f3f-4fa53a4abc4a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.121230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0422-0a45-4751-8f3f-4fa53a4abc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.121775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0422-0a45-4751-8f3f-4fa53a4abc4a admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.122519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c0422-0a45-4751-8f3f-4fa53a4abc4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:24.122821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c0422-0a45-4751-8f3f-4fa53a4abc4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.123367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a0bfb-bd64-4583-adb8-e8cd7ad28395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7777e255604cfaa71fbcc6e505061c, user_id=05b3d69282f44610a7faa4cf5cd4a4fe, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.124433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c0422-0a45-4751-8f3f-4fa53a4abc4a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.126046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a0bfb-bd64-4583-adb8-e8cd7ad28395 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.136942 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 796/1592] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:24.138311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3e59-b29a-4b26-ad36-8412d11d80c8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.138599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3e59-b29a-4b26-ad36-8412d11d80c8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.138873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3e59-b29a-4b26-ad36-8412d11d80c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.142658 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 797/1593] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:24 2021] PUT /identity/v3/projects/8e7777e255604cfaa71fbcc6e505061c/users/05b3d69282f44610a7faa4cf5cd4a4fe/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:24.143550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a0bfb-bd64-4583-adb8-e8cd7ad28395 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.157770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-be5e3e59-b29a-4b26-ad36-8412d11d80c8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:24.158954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-be5e3e59-b29a-4b26-ad36-8412d11d80c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:24.204837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a0bfb-bd64-4583-adb8-e8cd7ad28395 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.209427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae08c30-d0b2-41d1-a4d9-0a08c7c34c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.210110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae08c30-d0b2-41d1-a4d9-0a08c7c34c3c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.210394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae08c30-d0b2-41d1-a4d9-0a08c7c34c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.210667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae08c30-d0b2-41d1-a4d9-0a08c7c34c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.211398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae08c30-d0b2-41d1-a4d9-0a08c7c34c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.213321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae08c30-d0b2-41d1-a4d9-0a08c7c34c3c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.214331 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 797/1594] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:24.215154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3e59-b29a-4b26-ad36-8412d11d80c8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.224409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3e59-b29a-4b26-ad36-8412d11d80c8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.228361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf40c67-ea41-4c88-907a-1a09442320ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.228992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40c67-ea41-4c88-907a-1a09442320ec admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.229278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40c67-ea41-4c88-907a-1a09442320ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.229575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf40c67-ea41-4c88-907a-1a09442320ec admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.230297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf40c67-ea41-4c88-907a-1a09442320ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:24.230620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf40c67-ea41-4c88-907a-1a09442320ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.232233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf40c67-ea41-4c88-907a-1a09442320ec admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.246556 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 798/1595] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:24.246757 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 798/1596] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:24.246860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae08c30-d0b2-41d1-a4d9-0a08c7c34c3c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.246940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf40c67-ea41-4c88-907a-1a09442320ec admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.256195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf40c67-ea41-4c88-907a-1a09442320ec admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.312645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae08c30-d0b2-41d1-a4d9-0a08c7c34c3c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.312844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c457f-6b67-41cd-8ac5-7d234ce7c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.313358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c457f-6b67-41cd-8ac5-7d234ce7c58f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.313645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c457f-6b67-41cd-8ac5-7d234ce7c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.313988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c457f-6b67-41cd-8ac5-7d234ce7c58f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.314659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c457f-6b67-41cd-8ac5-7d234ce7c58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.316292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c457f-6b67-41cd-8ac5-7d234ce7c58f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.317165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9f787-9429-46b8-9cbc-148b666ce19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.317819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9f787-9429-46b8-9cbc-148b666ce19c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.318096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9f787-9429-46b8-9cbc-148b666ce19c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.318371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9f787-9429-46b8-9cbc-148b666ce19c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.319135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9f787-9429-46b8-9cbc-148b666ce19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.320740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9f787-9429-46b8-9cbc-148b666ce19c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.326283 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 799/1597] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:24 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:24.327319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c457f-6b67-41cd-8ac5-7d234ce7c58f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.330865 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 799/1598] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:24 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:24.331556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9f787-9429-46b8-9cbc-148b666ce19c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.337086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c457f-6b67-41cd-8ac5-7d234ce7c58f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.341096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9f787-9429-46b8-9cbc-148b666ce19c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.342067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f492f-6b0c-43d8-aa4f-e0fef12d5f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.342703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f492f-6b0c-43d8-aa4f-e0fef12d5f7b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.342983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f492f-6b0c-43d8-aa4f-e0fef12d5f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.343286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f492f-6b0c-43d8-aa4f-e0fef12d5f7b admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.344000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f492f-6b0c-43d8-aa4f-e0fef12d5f7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:24.344304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f492f-6b0c-43d8-aa4f-e0fef12d5f7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.345584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169cbf-7d7d-4151-8051-f5422cdb8191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.345865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f492f-6b0c-43d8-aa4f-e0fef12d5f7b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.346203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169cbf-7d7d-4151-8051-f5422cdb8191 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.346480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169cbf-7d7d-4151-8051-f5422cdb8191 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.346750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f169cbf-7d7d-4151-8051-f5422cdb8191 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.347510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f169cbf-7d7d-4151-8051-f5422cdb8191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.349055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f169cbf-7d7d-4151-8051-f5422cdb8191 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.358512 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 800/1599] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:24.359501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f492f-6b0c-43d8-aa4f-e0fef12d5f7b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.360098 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 800/1600] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:24.361224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169cbf-7d7d-4151-8051-f5422cdb8191 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.370017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f492f-6b0c-43d8-aa4f-e0fef12d5f7b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.371211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f169cbf-7d7d-4151-8051-f5422cdb8191 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.374856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f6502-3572-44db-8778-61fd46f68211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.375551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6502-3572-44db-8778-61fd46f68211 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.375861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6502-3572-44db-8778-61fd46f68211 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.376138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f6502-3572-44db-8778-61fd46f68211 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.376309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bb51f-e968-4b2f-b101-c4df90464a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.376834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f6502-3572-44db-8778-61fd46f68211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.376954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb51f-e968-4b2f-b101-c4df90464a00 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.377211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb51f-e968-4b2f-b101-c4df90464a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.377487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb51f-e968-4b2f-b101-c4df90464a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.378251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bb51f-e968-4b2f-b101-c4df90464a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:24.378517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bb51f-e968-4b2f-b101-c4df90464a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.378747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f6502-3572-44db-8778-61fd46f68211 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.380355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bb51f-e968-4b2f-b101-c4df90464a00 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.403093 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 801/1601] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:24.403093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bb51f-e968-4b2f-b101-c4df90464a00 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.406462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bb51f-e968-4b2f-b101-c4df90464a00 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.411778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35e6a0-0896-4dae-b4e1-7a251caa2477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.412642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e6a0-0896-4dae-b4e1-7a251caa2477 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.412921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e6a0-0896-4dae-b4e1-7a251caa2477 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.413242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e6a0-0896-4dae-b4e1-7a251caa2477 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.413979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35e6a0-0896-4dae-b4e1-7a251caa2477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.414100 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 801/1602] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:24.416089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35e6a0-0896-4dae-b4e1-7a251caa2477 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.416223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f6502-3572-44db-8778-61fd46f68211 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.440106 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 802/1603] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:24.444537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35e6a0-0896-4dae-b4e1-7a251caa2477 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.451900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35e6a0-0896-4dae-b4e1-7a251caa2477 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.477799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f6502-3572-44db-8778-61fd46f68211 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.482931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37286546-cfdc-4308-a61a-370dbe7abb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.483622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37286546-cfdc-4308-a61a-370dbe7abb5c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.483904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37286546-cfdc-4308-a61a-370dbe7abb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.484178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37286546-cfdc-4308-a61a-370dbe7abb5c admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.484886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37286546-cfdc-4308-a61a-370dbe7abb5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.486766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37286546-cfdc-4308-a61a-370dbe7abb5c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.508650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff232f5d-3144-4f02-a2a9-8f4f4d757dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.509361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232f5d-3144-4f02-a2a9-8f4f4d757dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.509641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232f5d-3144-4f02-a2a9-8f4f4d757dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.509916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232f5d-3144-4f02-a2a9-8f4f4d757dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.510676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff232f5d-3144-4f02-a2a9-8f4f4d757dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.512398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff232f5d-3144-4f02-a2a9-8f4f4d757dd6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.513038 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 802/1604] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:24.514024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37286546-cfdc-4308-a61a-370dbe7abb5c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.525878 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 803/1605] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:24 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:24.525878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff232f5d-3144-4f02-a2a9-8f4f4d757dd6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.535657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff232f5d-3144-4f02-a2a9-8f4f4d757dd6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.574090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37286546-cfdc-4308-a61a-370dbe7abb5c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.578754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b2710-8b86-4211-857a-269d824e0ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.579453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b2710-8b86-4211-857a-269d824e0ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.579728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b2710-8b86-4211-857a-269d824e0ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.579998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b2710-8b86-4211-857a-269d824e0ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.580732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b2710-8b86-4211-857a-269d824e0ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.582581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b2710-8b86-4211-857a-269d824e0ad0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.590527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c7bad-1fd0-4ea2-a5b6-cde695d4fd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.591427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c7bad-1fd0-4ea2-a5b6-cde695d4fd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.591819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c7bad-1fd0-4ea2-a5b6-cde695d4fd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.592087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c7bad-1fd0-4ea2-a5b6-cde695d4fd78 admin admin] PATH_INFO: `/v3/projects/8e7777e255604cfaa71fbcc6e505061c/users/05b3d69282f44610a7faa4cf5cd4a4fe/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.592955 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 803/1606] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:24 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:24.593724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b2710-8b86-4211-857a-269d824e0ad0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.594052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c7bad-1fd0-4ea2-a5b6-cde695d4fd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7777e255604cfaa71fbcc6e505061c, user_id=05b3d69282f44610a7faa4cf5cd4a4fe, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.596800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c7bad-1fd0-4ea2-a5b6-cde695d4fd78 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.602906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b2710-8b86-4211-857a-269d824e0ad0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.609857 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 804/1607] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:24 2021] PUT /identity/v3/projects/8e7777e255604cfaa71fbcc6e505061c/users/05b3d69282f44610a7faa4cf5cd4a4fe/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:24.610487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c7bad-1fd0-4ea2-a5b6-cde695d4fd78 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.664405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649aa80-e7a4-4f9a-bc9b-673027964bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.665064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649aa80-e7a4-4f9a-bc9b-673027964bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.665349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649aa80-e7a4-4f9a-bc9b-673027964bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.665626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649aa80-e7a4-4f9a-bc9b-673027964bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.666333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649aa80-e7a4-4f9a-bc9b-673027964bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.668300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649aa80-e7a4-4f9a-bc9b-673027964bf9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.672559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c7bad-1fd0-4ea2-a5b6-cde695d4fd78 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.677963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdb9a0-80d8-40c4-b0c6-d9d4fd4a3395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.678670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdb9a0-80d8-40c4-b0c6-d9d4fd4a3395 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.678954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdb9a0-80d8-40c4-b0c6-d9d4fd4a3395 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.679231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdb9a0-80d8-40c4-b0c6-d9d4fd4a3395 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.679963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdb9a0-80d8-40c4-b0c6-d9d4fd4a3395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.681876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdb9a0-80d8-40c4-b0c6-d9d4fd4a3395 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.696676 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 804/1608] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:24.696676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649aa80-e7a4-4f9a-bc9b-673027964bf9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.709192 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 805/1609] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:24.710131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdb9a0-80d8-40c4-b0c6-d9d4fd4a3395 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.758907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649aa80-e7a4-4f9a-bc9b-673027964bf9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.769607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdb9a0-80d8-40c4-b0c6-d9d4fd4a3395 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.774519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddb1da-adfc-40a6-a1da-4045822d529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.775203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddb1da-adfc-40a6-a1da-4045822d529b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.775515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddb1da-adfc-40a6-a1da-4045822d529b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.775788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddb1da-adfc-40a6-a1da-4045822d529b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.777217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddb1da-adfc-40a6-a1da-4045822d529b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.778969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddb1da-adfc-40a6-a1da-4045822d529b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.788986 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 806/1610] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:24 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:24.789834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddb1da-adfc-40a6-a1da-4045822d529b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.803042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddb1da-adfc-40a6-a1da-4045822d529b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.807581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec53d-d9ab-4c5d-b5db-90c4feeb89e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.808209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec53d-d9ab-4c5d-b5db-90c4feeb89e3 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.808494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec53d-d9ab-4c5d-b5db-90c4feeb89e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.808770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec53d-d9ab-4c5d-b5db-90c4feeb89e3 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.809465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ec53d-d9ab-4c5d-b5db-90c4feeb89e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.811457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ec53d-d9ab-4c5d-b5db-90c4feeb89e3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.817869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dada81-1fbe-4186-b125-f2ae29a45ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.818571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dada81-1fbe-4186-b125-f2ae29a45ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.818859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dada81-1fbe-4186-b125-f2ae29a45ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.819169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dada81-1fbe-4186-b125-f2ae29a45ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.820005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dada81-1fbe-4186-b125-f2ae29a45ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.821982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dada81-1fbe-4186-b125-f2ae29a45ee4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.831778 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 807/1611] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/users => generated 300 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:24.832906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec53d-d9ab-4c5d-b5db-90c4feeb89e3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.842895 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 805/1612] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:24.843871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec53d-d9ab-4c5d-b5db-90c4feeb89e3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.844096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dada81-1fbe-4186-b125-f2ae29a45ee4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.848813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb4a1d-5b51-4dcb-bf7e-882d70c059e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.849674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb4a1d-5b51-4dcb-bf7e-882d70c059e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.849955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb4a1d-5b51-4dcb-bf7e-882d70c059e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.850228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb4a1d-5b51-4dcb-bf7e-882d70c059e3 admin admin] PATH_INFO: `/v3/projects/e289b137b09743c399e30e4ffa1bab40/users/2225ee361ad844ff91886aa430272b04/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.853402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dada81-1fbe-4186-b125-f2ae29a45ee4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.858620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e093cd6-0efc-4248-84cb-2715799e8c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.859535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e093cd6-0efc-4248-84cb-2715799e8c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.859825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e093cd6-0efc-4248-84cb-2715799e8c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.860105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e093cd6-0efc-4248-84cb-2715799e8c71 admin admin] PATH_INFO: `/v3/projects/85ec794c7c2d4431bf3936db2a303de4/users/094ca431c39f4e86b6269282a0dedcb0/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.867352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb4a1d-5b51-4dcb-bf7e-882d70c059e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e289b137b09743c399e30e4ffa1bab40, user_id=2225ee361ad844ff91886aa430272b04, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.870583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb4a1d-5b51-4dcb-bf7e-882d70c059e3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.877917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e093cd6-0efc-4248-84cb-2715799e8c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ec794c7c2d4431bf3936db2a303de4, user_id=094ca431c39f4e86b6269282a0dedcb0, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.880761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e093cd6-0efc-4248-84cb-2715799e8c71 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.883158 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 808/1613] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:24 2021] PUT /identity/v3/projects/e289b137b09743c399e30e4ffa1bab40/users/2225ee361ad844ff91886aa430272b04/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:24.884520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da632b-8d37-4e91-98d3-aa25114e3403 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.884812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da632b-8d37-4e91-98d3-aa25114e3403 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.885087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da632b-8d37-4e91-98d3-aa25114e3403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.905497 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 806/1614] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:24 2021] PUT /identity/v3/projects/85ec794c7c2d4431bf3936db2a303de4/users/094ca431c39f4e86b6269282a0dedcb0/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:24.906421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e093cd6-0efc-4248-84cb-2715799e8c71 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.913997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e9da632b-8d37-4e91-98d3-aa25114e3403 None None] MFA Rules not processed for user `05b3d69282f44610a7faa4cf5cd4a4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:24.915284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e9da632b-8d37-4e91-98d3-aa25114e3403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:24.965892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e093cd6-0efc-4248-84cb-2715799e8c71 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:24.970439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd245c-a2c7-487c-96dd-cbf561dea7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:24.971118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd245c-a2c7-487c-96dd-cbf561dea7bb admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:24.971452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd245c-a2c7-487c-96dd-cbf561dea7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:24.971724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd245c-a2c7-487c-96dd-cbf561dea7bb admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:24.972417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd245c-a2c7-487c-96dd-cbf561dea7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:24.974331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd245c-a2c7-487c-96dd-cbf561dea7bb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:24.983068 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 809/1615] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:24.983894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da632b-8d37-4e91-98d3-aa25114e3403 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:24.994731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da632b-8d37-4e91-98d3-aa25114e3403 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.000100 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 807/1616] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:25.001046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd245c-a2c7-487c-96dd-cbf561dea7bb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.003732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bab44-98e8-469b-af56-78cd0b7fe169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.004430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bab44-98e8-469b-af56-78cd0b7fe169 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.004710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bab44-98e8-469b-af56-78cd0b7fe169 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.004982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bab44-98e8-469b-af56-78cd0b7fe169 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.005687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bab44-98e8-469b-af56-78cd0b7fe169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.007719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bab44-98e8-469b-af56-78cd0b7fe169 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.010768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd245c-a2c7-487c-96dd-cbf561dea7bb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.015365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfb10f-0699-484b-b86f-d43f149e8443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.016004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfb10f-0699-484b-b86f-d43f149e8443 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.016314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfb10f-0699-484b-b86f-d43f149e8443 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.016622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfb10f-0699-484b-b86f-d43f149e8443 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.017341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfb10f-0699-484b-b86f-d43f149e8443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.018910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfb10f-0699-484b-b86f-d43f149e8443 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.028072 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 810/1617] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:24 2021] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:25.028906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bab44-98e8-469b-af56-78cd0b7fe169 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.032764 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 808/1618] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:25.052121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfb10f-0699-484b-b86f-d43f149e8443 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.054591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bab44-98e8-469b-af56-78cd0b7fe169 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.055071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfb10f-0699-484b-b86f-d43f149e8443 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.056342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d716193-7394-4866-aef4-2387cd22c630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.056342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d716193-7394-4866-aef4-2387cd22c630 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.056342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d716193-7394-4866-aef4-2387cd22c630 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.056342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d716193-7394-4866-aef4-2387cd22c630 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.056735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d716193-7394-4866-aef4-2387cd22c630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.056735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d716193-7394-4866-aef4-2387cd22c630 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.060128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcea7e-eb75-4140-9fd3-d0834e597ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.060807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcea7e-eb75-4140-9fd3-d0834e597ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.061087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcea7e-eb75-4140-9fd3-d0834e597ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.061360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcea7e-eb75-4140-9fd3-d0834e597ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.062251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcea7e-eb75-4140-9fd3-d0834e597ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.063889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcea7e-eb75-4140-9fd3-d0834e597ac0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.066988 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 811/1619] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:25.066988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3c4f-0ace-45cf-a12a-48090d0642b4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.066988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3c4f-0ace-45cf-a12a-48090d0642b4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.066988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3c4f-0ace-45cf-a12a-48090d0642b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.077560 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 809/1620] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:25.077560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27511516-5cf5-4fc8-a3d9-7103a3d26de8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.077560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27511516-5cf5-4fc8-a3d9-7103a3d26de8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.077560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27511516-5cf5-4fc8-a3d9-7103a3d26de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.092773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c87f3c4f-0ace-45cf-a12a-48090d0642b4 None None] MFA Rules not processed for user `2225ee361ad844ff91886aa430272b04`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:25.093903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c87f3c4f-0ace-45cf-a12a-48090d0642b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:25.103215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-27511516-5cf5-4fc8-a3d9-7103a3d26de8 None None] MFA Rules not processed for user `094ca431c39f4e86b6269282a0dedcb0`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:25.105028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-27511516-5cf5-4fc8-a3d9-7103a3d26de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:25.155350 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 812/1621] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:25 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:25.156673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01c988-9cb7-41d8-9487-b5c5160ecb50 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.156962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01c988-9cb7-41d8-9487-b5c5160ecb50 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.157237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01c988-9cb7-41d8-9487-b5c5160ecb50 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.159013 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 813/1622] 10.222.0.21 () {54 vars in 961 bytes} [Sat Nov 27 20:45:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:45:25.164026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01c988-9cb7-41d8-9487-b5c5160ecb50 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.168262 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 810/1623] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:25 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:25.169020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27511516-5cf5-4fc8-a3d9-7103a3d26de8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.179123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27511516-5cf5-4fc8-a3d9-7103a3d26de8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.180078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01c988-9cb7-41d8-9487-b5c5160ecb50 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.183823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff845d-4a5f-4751-aa31-bb15a94997ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.184467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff845d-4a5f-4751-aa31-bb15a94997ce admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.184604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304b2c4-49f7-46e5-975b-63bdab55eb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.184753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff845d-4a5f-4751-aa31-bb15a94997ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.185031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff845d-4a5f-4751-aa31-bb15a94997ce admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.185220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304b2c4-49f7-46e5-975b-63bdab55eb8f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.185504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304b2c4-49f7-46e5-975b-63bdab55eb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.185762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff845d-4a5f-4751-aa31-bb15a94997ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.185858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304b2c4-49f7-46e5-975b-63bdab55eb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.186495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304b2c4-49f7-46e5-975b-63bdab55eb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.187420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff845d-4a5f-4751-aa31-bb15a94997ce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.188101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304b2c4-49f7-46e5-975b-63bdab55eb8f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.197216 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 811/1624] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:25.197691 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 814/1625] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:25.198313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff845d-4a5f-4751-aa31-bb15a94997ce admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.198507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304b2c4-49f7-46e5-975b-63bdab55eb8f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.207808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304b2c4-49f7-46e5-975b-63bdab55eb8f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.209005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff845d-4a5f-4751-aa31-bb15a94997ce admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.212313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44695e-c589-4dad-b05a-a2a390a85693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.212946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44695e-c589-4dad-b05a-a2a390a85693 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.213253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44695e-c589-4dad-b05a-a2a390a85693 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.213531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44695e-c589-4dad-b05a-a2a390a85693 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.214502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4244d-9a19-4356-809b-6f14f2d69cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.214790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44695e-c589-4dad-b05a-a2a390a85693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.215382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4244d-9a19-4356-809b-6f14f2d69cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.215653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4244d-9a19-4356-809b-6f14f2d69cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.215919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4244d-9a19-4356-809b-6f14f2d69cbd admin admin] PATH_INFO: `/v3/projects/7742e0a2093f4cf6ace16410f4c8d94b/users/7a319f62eda84926989af46e373e18d8/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.216394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44695e-c589-4dad-b05a-a2a390a85693 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.225975 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 815/1626] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:25.226784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44695e-c589-4dad-b05a-a2a390a85693 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.230623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4244d-9a19-4356-809b-6f14f2d69cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7742e0a2093f4cf6ace16410f4c8d94b, user_id=7a319f62eda84926989af46e373e18d8, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.233333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4244d-9a19-4356-809b-6f14f2d69cbd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.238929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44695e-c589-4dad-b05a-a2a390a85693 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.244020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3f8d-6658-4182-8deb-c6717c4397bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.244690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3f8d-6658-4182-8deb-c6717c4397bd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.245063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3f8d-6658-4182-8deb-c6717c4397bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.245278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3f8d-6658-4182-8deb-c6717c4397bd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.245995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef3f8d-6658-4182-8deb-c6717c4397bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.247412 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 812/1627] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:25 2021] PUT /identity/v3/projects/7742e0a2093f4cf6ace16410f4c8d94b/users/7a319f62eda84926989af46e373e18d8/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:25.247861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef3f8d-6658-4182-8deb-c6717c4397bd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.252125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4244d-9a19-4356-809b-6f14f2d69cbd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.258328 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 816/1628] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:25.259841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41778211-b412-40a7-85e9-61d0ce2ea96c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.260130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41778211-b412-40a7-85e9-61d0ce2ea96c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.260402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41778211-b412-40a7-85e9-61d0ce2ea96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.278363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-41778211-b412-40a7-85e9-61d0ce2ea96c None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:25.279596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-41778211-b412-40a7-85e9-61d0ce2ea96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:25.317824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4244d-9a19-4356-809b-6f14f2d69cbd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.323625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3e00c-a0e2-4b47-a453-dcec9f6b6409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.324272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3e00c-a0e2-4b47-a453-dcec9f6b6409 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.324553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3e00c-a0e2-4b47-a453-dcec9f6b6409 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.324847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3e00c-a0e2-4b47-a453-dcec9f6b6409 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.325529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3e00c-a0e2-4b47-a453-dcec9f6b6409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.327435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3e00c-a0e2-4b47-a453-dcec9f6b6409 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.344610 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 817/1629] 10.222.0.21 () {58 vars in 1058 bytes} [Sat Nov 27 20:45:25 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:25.348105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41778211-b412-40a7-85e9-61d0ce2ea96c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.352820 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 813/1630] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:25 2021] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:25.353638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3e00c-a0e2-4b47-a453-dcec9f6b6409 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.358736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41778211-b412-40a7-85e9-61d0ce2ea96c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.414076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3e00c-a0e2-4b47-a453-dcec9f6b6409 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.414255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834f75c-fc24-4719-b044-9a4ca7bf0138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.414738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f75c-fc24-4719-b044-9a4ca7bf0138 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.415021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f75c-fc24-4719-b044-9a4ca7bf0138 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.415324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f75c-fc24-4719-b044-9a4ca7bf0138 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.416053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834f75c-fc24-4719-b044-9a4ca7bf0138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.418018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834f75c-fc24-4719-b044-9a4ca7bf0138 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.418804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bedb4-f9bb-4aed-952d-9b86db57c4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.419491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bedb4-f9bb-4aed-952d-9b86db57c4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.419776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bedb4-f9bb-4aed-952d-9b86db57c4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.420050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bedb4-f9bb-4aed-952d-9b86db57c4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.420779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bedb4-f9bb-4aed-952d-9b86db57c4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.422356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bedb4-f9bb-4aed-952d-9b86db57c4f1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.432103 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 814/1631] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:25.436548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bedb4-f9bb-4aed-952d-9b86db57c4f1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.443284 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 818/1632] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:25 2021] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:25.444374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834f75c-fc24-4719-b044-9a4ca7bf0138 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.446300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bedb4-f9bb-4aed-952d-9b86db57c4f1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.502459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b31f8-b32a-4e36-be8b-f975a6cdc393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.503127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b31f8-b32a-4e36-be8b-f975a6cdc393 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.503450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b31f8-b32a-4e36-be8b-f975a6cdc393 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.503733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b31f8-b32a-4e36-be8b-f975a6cdc393 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.504465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b31f8-b32a-4e36-be8b-f975a6cdc393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.506088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b31f8-b32a-4e36-be8b-f975a6cdc393 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.506676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834f75c-fc24-4719-b044-9a4ca7bf0138 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.511570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343362f-2dbd-4fd7-a520-20f69f046a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.512503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343362f-2dbd-4fd7-a520-20f69f046a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.512793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343362f-2dbd-4fd7-a520-20f69f046a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.513094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343362f-2dbd-4fd7-a520-20f69f046a3e admin admin] PATH_INFO: `/v3/projects/9d8f0c34da8b4307bec3f04575d55849/users/0ca311be98bf4394a3b15147b308f7f4/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.515726 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 815/1633] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:25 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:25.520125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190da83-1c74-42cd-94df-97770efe8a36 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.520419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190da83-1c74-42cd-94df-97770efe8a36 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.520701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190da83-1c74-42cd-94df-97770efe8a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.528506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343362f-2dbd-4fd7-a520-20f69f046a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8f0c34da8b4307bec3f04575d55849, user_id=0ca311be98bf4394a3b15147b308f7f4, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.531180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343362f-2dbd-4fd7-a520-20f69f046a3e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.545557 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 819/1634] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:25 2021] PUT /identity/v3/projects/9d8f0c34da8b4307bec3f04575d55849/users/0ca311be98bf4394a3b15147b308f7f4/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:25.546334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343362f-2dbd-4fd7-a520-20f69f046a3e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.553746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d190da83-1c74-42cd-94df-97770efe8a36 None None] MFA Rules not processed for user `7a319f62eda84926989af46e373e18d8`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:25.554981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d190da83-1c74-42cd-94df-97770efe8a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:25.612710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343362f-2dbd-4fd7-a520-20f69f046a3e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.617335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aca4c-ca37-4972-bcfa-e798c55c2c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.618217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aca4c-ca37-4972-bcfa-e798c55c2c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.618498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aca4c-ca37-4972-bcfa-e798c55c2c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.618774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71aca4c-ca37-4972-bcfa-e798c55c2c3b admin admin] PATH_INFO: `/v3/projects/b8bfde4517ef43ac9022f3d7be7b1c8f/users/86d5ca4bf6754884b0658d7220839f35/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.619450 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 816/1635] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:25 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:25.620298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190da83-1c74-42cd-94df-97770efe8a36 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.633871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71aca4c-ca37-4972-bcfa-e798c55c2c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bfde4517ef43ac9022f3d7be7b1c8f, user_id=86d5ca4bf6754884b0658d7220839f35, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.637130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71aca4c-ca37-4972-bcfa-e798c55c2c3b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.650057 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 820/1636] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:25 2021] PUT /identity/v3/projects/b8bfde4517ef43ac9022f3d7be7b1c8f/users/86d5ca4bf6754884b0658d7220839f35/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:25.650835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aca4c-ca37-4972-bcfa-e798c55c2c3b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.691079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190da83-1c74-42cd-94df-97770efe8a36 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.712776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71aca4c-ca37-4972-bcfa-e798c55c2c3b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.717742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936ba7d-f031-4561-af57-6a8b451bc5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.718402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936ba7d-f031-4561-af57-6a8b451bc5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.718687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936ba7d-f031-4561-af57-6a8b451bc5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.718967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936ba7d-f031-4561-af57-6a8b451bc5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.719705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936ba7d-f031-4561-af57-6a8b451bc5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.721631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936ba7d-f031-4561-af57-6a8b451bc5d6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.742174 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 821/1637] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:25 2021] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:25.743151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936ba7d-f031-4561-af57-6a8b451bc5d6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.753726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936ba7d-f031-4561-af57-6a8b451bc5d6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.753879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4f395-9e7e-45a9-9b9c-eedbc4154ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.754610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f395-9e7e-45a9-9b9c-eedbc4154ad6 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.754893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f395-9e7e-45a9-9b9c-eedbc4154ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.755170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4f395-9e7e-45a9-9b9c-eedbc4154ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.758281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff5f79-785a-4018-9315-8eec6fd35df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.759246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff5f79-785a-4018-9315-8eec6fd35df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.759672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff5f79-785a-4018-9315-8eec6fd35df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.759951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff5f79-785a-4018-9315-8eec6fd35df1 admin admin] PATH_INFO: `/v3/projects/a53c15d688a541849c224abc382dff55/users/8eff5913736b4e77ac2b092534edfcd9/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.774737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff5f79-785a-4018-9315-8eec6fd35df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53c15d688a541849c224abc382dff55, user_id=8eff5913736b4e77ac2b092534edfcd9, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.777520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff5f79-785a-4018-9315-8eec6fd35df1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.790620 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 822/1638] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:25 2021] PUT /identity/v3/projects/a53c15d688a541849c224abc382dff55/users/8eff5913736b4e77ac2b092534edfcd9/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:25.791620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff5f79-785a-4018-9315-8eec6fd35df1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.819491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4f395-9e7e-45a9-9b9c-eedbc4154ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.822776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4f395-9e7e-45a9-9b9c-eedbc4154ad6 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.834261 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 817/1639] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:25 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:25.834912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4f395-9e7e-45a9-9b9c-eedbc4154ad6 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.844795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4f395-9e7e-45a9-9b9c-eedbc4154ad6 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.861032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff5f79-785a-4018-9315-8eec6fd35df1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:25.865856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42441b-5e53-443c-bdb7-5b58eb6f3cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.866467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42441b-5e53-443c-bdb7-5b58eb6f3cba admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.866751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42441b-5e53-443c-bdb7-5b58eb6f3cba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.867028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42441b-5e53-443c-bdb7-5b58eb6f3cba admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.867847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42441b-5e53-443c-bdb7-5b58eb6f3cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.869785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42441b-5e53-443c-bdb7-5b58eb6f3cba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.892979 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 823/1640] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:25 2021] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:25.894503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf275f-392f-4788-9354-ef206e25ccb9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.894797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf275f-392f-4788-9354-ef206e25ccb9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.895077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf275f-392f-4788-9354-ef206e25ccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.906982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d5d1-9531-46df-9d61-a8284b89e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:25.907937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d5d1-9531-46df-9d61-a8284b89e003 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.908213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d5d1-9531-46df-9d61-a8284b89e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.908481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d5d1-9531-46df-9d61-a8284b89e003 admin admin] PATH_INFO: `/v3/projects/0941d60be210490fb2c7c5ecd7226447/users/3c6ba16e4d734dccab91cb1f3df6b1c2/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:25.921995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7d5d1-9531-46df-9d61-a8284b89e003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0941d60be210490fb2c7c5ecd7226447, user_id=3c6ba16e4d734dccab91cb1f3df6b1c2, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:25.922170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4ddf275f-392f-4788-9354-ef206e25ccb9 None None] MFA Rules not processed for user `0ca311be98bf4394a3b15147b308f7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:25.923452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4ddf275f-392f-4788-9354-ef206e25ccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:25.924653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7d5d1-9531-46df-9d61-a8284b89e003 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:25.949780 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 818/1641] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:25 2021] PUT /identity/v3/projects/0941d60be210490fb2c7c5ecd7226447/users/3c6ba16e4d734dccab91cb1f3df6b1c2/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:25.949780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d5d1-9531-46df-9d61-a8284b89e003 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:25.991408 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 824/1642] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:25 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:25.992506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae2e92-5306-4ada-8ce5-ec549ead76b9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:25.992799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae2e92-5306-4ada-8ce5-ec549ead76b9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:25.993081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae2e92-5306-4ada-8ce5-ec549ead76b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.016585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d5d1-9531-46df-9d61-a8284b89e003 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.019978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a9ae2e92-5306-4ada-8ce5-ec549ead76b9 None None] MFA Rules not processed for user `86d5ca4bf6754884b0658d7220839f35`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:26.021178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a9ae2e92-5306-4ada-8ce5-ec549ead76b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:26.021749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cacd5-b054-40c8-ac46-926f59f953d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.022405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cacd5-b054-40c8-ac46-926f59f953d4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.022813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cacd5-b054-40c8-ac46-926f59f953d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.022975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cacd5-b054-40c8-ac46-926f59f953d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.023803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cacd5-b054-40c8-ac46-926f59f953d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.025700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cacd5-b054-40c8-ac46-926f59f953d4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.055425 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 819/1643] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:25 2021] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:26.057164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cacd5-b054-40c8-ac46-926f59f953d4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.090676 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 825/1644] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:25 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:26.091943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d8899-9073-4ea2-9863-2353fe3d3230 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.092233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d8899-9073-4ea2-9863-2353fe3d3230 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.092513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d8899-9073-4ea2-9863-2353fe3d3230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.121567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-292d8899-9073-4ea2-9863-2353fe3d3230 None None] MFA Rules not processed for user `8eff5913736b4e77ac2b092534edfcd9`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:26.122679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-292d8899-9073-4ea2-9863-2353fe3d3230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:26.141307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cacd5-b054-40c8-ac46-926f59f953d4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.147050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb621d7-2fc1-4e63-afd6-3b60999d8761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.147952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb621d7-2fc1-4e63-afd6-3b60999d8761 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.148333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb621d7-2fc1-4e63-afd6-3b60999d8761 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.148669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb621d7-2fc1-4e63-afd6-3b60999d8761 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.149407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb621d7-2fc1-4e63-afd6-3b60999d8761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.151132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb621d7-2fc1-4e63-afd6-3b60999d8761 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.161505 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 820/1645] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:26 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:26.165311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb621d7-2fc1-4e63-afd6-3b60999d8761 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.175818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb621d7-2fc1-4e63-afd6-3b60999d8761 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.180508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32e5bf-bb60-4ceb-8eeb-1cf689c72762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.181212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32e5bf-bb60-4ceb-8eeb-1cf689c72762 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.181496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32e5bf-bb60-4ceb-8eeb-1cf689c72762 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.181721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32e5bf-bb60-4ceb-8eeb-1cf689c72762 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.183033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32e5bf-bb60-4ceb-8eeb-1cf689c72762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.184655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32e5bf-bb60-4ceb-8eeb-1cf689c72762 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.193556 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 826/1646] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:26 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:26.194666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2f996-7b32-4ac5-ae35-7a33052dbac7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.195074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2f996-7b32-4ac5-ae35-7a33052dbac7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.195171 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 821/1647] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:26.195288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2f996-7b32-4ac5-ae35-7a33052dbac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.198863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32e5bf-bb60-4ceb-8eeb-1cf689c72762 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.208341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32e5bf-bb60-4ceb-8eeb-1cf689c72762 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.213104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636a883-8204-4ecb-8e9e-622f7608d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.213772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a883-8204-4ecb-8e9e-622f7608d91f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.214055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a883-8204-4ecb-8e9e-622f7608d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.214332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a883-8204-4ecb-8e9e-622f7608d91f admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.215032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636a883-8204-4ecb-8e9e-622f7608d91f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.216976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636a883-8204-4ecb-8e9e-622f7608d91f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.222256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fcd2f996-7b32-4ac5-ae35-7a33052dbac7 None None] MFA Rules not processed for user `3c6ba16e4d734dccab91cb1f3df6b1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:26.223481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fcd2f996-7b32-4ac5-ae35-7a33052dbac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:26.245688 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 822/1648] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:26 2021] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:26.246775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636a883-8204-4ecb-8e9e-622f7608d91f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.291055 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 827/1649] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:26 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:26.292432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2f996-7b32-4ac5-ae35-7a33052dbac7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.302206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2f996-7b32-4ac5-ae35-7a33052dbac7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.312529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636a883-8204-4ecb-8e9e-622f7608d91f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.317330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ceaef1-7d2f-4bda-a5d5-d9688a1e9ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.317993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceaef1-7d2f-4bda-a5d5-d9688a1e9ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.318277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceaef1-7d2f-4bda-a5d5-d9688a1e9ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.318554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceaef1-7d2f-4bda-a5d5-d9688a1e9ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.319280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ceaef1-7d2f-4bda-a5d5-d9688a1e9ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.321310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ceaef1-7d2f-4bda-a5d5-d9688a1e9ae1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.344801 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 823/1650] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:26 2021] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:26.344801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ceaef1-7d2f-4bda-a5d5-d9688a1e9ae1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.355027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ceaef1-7d2f-4bda-a5d5-d9688a1e9ae1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.359860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4ed8c-9077-452f-9d4e-47ef7ff2ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.360724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ed8c-9077-452f-9d4e-47ef7ff2ae98 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.360999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ed8c-9077-452f-9d4e-47ef7ff2ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.361270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ed8c-9077-452f-9d4e-47ef7ff2ae98 admin admin] PATH_INFO: `/v3/projects/56f9df9b815645cbaf7edf2ff21715b4/users/6d4e98bf3ae14b8db078278b4aa51583/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.362232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e714d86-fc77-4bd4-8380-ac96d20fd714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.362888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e714d86-fc77-4bd4-8380-ac96d20fd714 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.363170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e714d86-fc77-4bd4-8380-ac96d20fd714 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.363492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e714d86-fc77-4bd4-8380-ac96d20fd714 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.364790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e714d86-fc77-4bd4-8380-ac96d20fd714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.366109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e714d86-fc77-4bd4-8380-ac96d20fd714 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.376723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4ed8c-9077-452f-9d4e-47ef7ff2ae98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f9df9b815645cbaf7edf2ff21715b4, user_id=6d4e98bf3ae14b8db078278b4aa51583, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.379282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4ed8c-9077-452f-9d4e-47ef7ff2ae98 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.392470 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 828/1651] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:26 2021] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:26.396955 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 824/1652] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:26 2021] PUT /identity/v3/projects/56f9df9b815645cbaf7edf2ff21715b4/users/6d4e98bf3ae14b8db078278b4aa51583/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:26.397077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e714d86-fc77-4bd4-8380-ac96d20fd714 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.397160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4ed8c-9077-452f-9d4e-47ef7ff2ae98 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.465251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4ed8c-9077-452f-9d4e-47ef7ff2ae98 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.469035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e714d86-fc77-4bd4-8380-ac96d20fd714 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.470984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd959-0827-48e0-9e1a-eabbf0677a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.472109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd959-0827-48e0-9e1a-eabbf0677a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.472548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd959-0827-48e0-9e1a-eabbf0677a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.472930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1bd959-0827-48e0-9e1a-eabbf0677a03 admin admin] PATH_INFO: `/v3/projects/5433cd58699f41948bf541fedb3ed5d1/users/31ff9538d3d94dc18fcb33714beea749/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.474667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786a0a6-11a8-4da0-b241-94ab88a6c991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.475478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a0a6-11a8-4da0-b241-94ab88a6c991 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.475648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a0a6-11a8-4da0-b241-94ab88a6c991 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.475935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786a0a6-11a8-4da0-b241-94ab88a6c991 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.477011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786a0a6-11a8-4da0-b241-94ab88a6c991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.478590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786a0a6-11a8-4da0-b241-94ab88a6c991 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.490727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bd959-0827-48e0-9e1a-eabbf0677a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5433cd58699f41948bf541fedb3ed5d1, user_id=31ff9538d3d94dc18fcb33714beea749, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.493417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1bd959-0827-48e0-9e1a-eabbf0677a03 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.509138 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 825/1653] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:26 2021] PUT /identity/v3/projects/5433cd58699f41948bf541fedb3ed5d1/users/31ff9538d3d94dc18fcb33714beea749/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:26.510143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd959-0827-48e0-9e1a-eabbf0677a03 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.515844 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 829/1654] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:26 2021] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:26.516871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786a0a6-11a8-4da0-b241-94ab88a6c991 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.575740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1bd959-0827-48e0-9e1a-eabbf0677a03 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.580508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494bef8-652d-423e-a18c-0374a4de06fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.581174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494bef8-652d-423e-a18c-0374a4de06fb admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.581461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494bef8-652d-423e-a18c-0374a4de06fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.581737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494bef8-652d-423e-a18c-0374a4de06fb admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.581850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786a0a6-11a8-4da0-b241-94ab88a6c991 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.582539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494bef8-652d-423e-a18c-0374a4de06fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.584562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494bef8-652d-423e-a18c-0374a4de06fb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.587181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a50cf7-2ab0-48b1-b29a-ead350eb6b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.587873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a50cf7-2ab0-48b1-b29a-ead350eb6b5c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.588145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a50cf7-2ab0-48b1-b29a-ead350eb6b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.588453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a50cf7-2ab0-48b1-b29a-ead350eb6b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.589696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a50cf7-2ab0-48b1-b29a-ead350eb6b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.591684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a50cf7-2ab0-48b1-b29a-ead350eb6b5c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.610016 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 826/1655] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:26 2021] POST /identity/v3/users => generated 306 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:26.611178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494bef8-652d-423e-a18c-0374a4de06fb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.622181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494bef8-652d-423e-a18c-0374a4de06fb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.626062 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 830/1656] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:26 2021] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:26.626952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a50cf7-2ab0-48b1-b29a-ead350eb6b5c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.629215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac2eb0-c9c4-4a09-853f-b837ef27e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.630204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac2eb0-c9c4-4a09-853f-b837ef27e65a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.630868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac2eb0-c9c4-4a09-853f-b837ef27e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.631364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac2eb0-c9c4-4a09-853f-b837ef27e65a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.632631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac2eb0-c9c4-4a09-853f-b837ef27e65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.634623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac2eb0-c9c4-4a09-853f-b837ef27e65a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.648059 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 827/1657] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:26 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:26.648059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac2eb0-c9c4-4a09-853f-b837ef27e65a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.656647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac2eb0-c9c4-4a09-853f-b837ef27e65a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.691586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a50cf7-2ab0-48b1-b29a-ead350eb6b5c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.696276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990070ac-f8bf-45f1-ae16-67e90e09ac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.696938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990070ac-f8bf-45f1-ae16-67e90e09ac52 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.697227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990070ac-f8bf-45f1-ae16-67e90e09ac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.697513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990070ac-f8bf-45f1-ae16-67e90e09ac52 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.698265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990070ac-f8bf-45f1-ae16-67e90e09ac52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.700272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990070ac-f8bf-45f1-ae16-67e90e09ac52 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.712014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0af5b0-d34a-4a93-9812-c2b093372a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.712640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0af5b0-d34a-4a93-9812-c2b093372a63 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.712922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0af5b0-d34a-4a93-9812-c2b093372a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.713196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0af5b0-d34a-4a93-9812-c2b093372a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.714456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0af5b0-d34a-4a93-9812-c2b093372a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.716060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0af5b0-d34a-4a93-9812-c2b093372a63 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.721153 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 831/1658] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:26 2021] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:26.721973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990070ac-f8bf-45f1-ae16-67e90e09ac52 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.734592 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 828/1659] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:26 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:26.734592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0af5b0-d34a-4a93-9812-c2b093372a63 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.734861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990070ac-f8bf-45f1-ae16-67e90e09ac52 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.737086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89604-e3e1-4950-b1f7-b9296d88dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.737748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89604-e3e1-4950-b1f7-b9296d88dbde admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.738032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89604-e3e1-4950-b1f7-b9296d88dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.738327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc89604-e3e1-4950-b1f7-b9296d88dbde admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.739044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc89604-e3e1-4950-b1f7-b9296d88dbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.740683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc89604-e3e1-4950-b1f7-b9296d88dbde admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.742273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0af5b0-d34a-4a93-9812-c2b093372a63 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.747208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c82ced-1e05-4541-895a-3a186c603811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.747884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c82ced-1e05-4541-895a-3a186c603811 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.748170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c82ced-1e05-4541-895a-3a186c603811 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.748449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c82ced-1e05-4541-895a-3a186c603811 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.749193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c82ced-1e05-4541-895a-3a186c603811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.751079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c82ced-1e05-4541-895a-3a186c603811 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.751617 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 832/1660] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:26.752538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89604-e3e1-4950-b1f7-b9296d88dbde admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.762171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc89604-e3e1-4950-b1f7-b9296d88dbde admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.767661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e9891-6271-4687-9591-2fa13f3dd2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.768308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e9891-6271-4687-9591-2fa13f3dd2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.768591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e9891-6271-4687-9591-2fa13f3dd2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.768868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e9891-6271-4687-9591-2fa13f3dd2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.769623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e9891-6271-4687-9591-2fa13f3dd2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.771050 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 829/1661] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:26 2021] POST /identity/v3/users => generated 300 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:26.771552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e9891-6271-4687-9591-2fa13f3dd2a1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.771718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c82ced-1e05-4541-895a-3a186c603811 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.782031 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 833/1662] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:26.783318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ca11-0f8a-4244-a545-665de45a4ca9 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.783611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ca11-0f8a-4244-a545-665de45a4ca9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.783885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ca11-0f8a-4244-a545-665de45a4ca9 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.784297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c82ced-1e05-4541-895a-3a186c603811 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.785633 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 834/1663] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:45:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:45:26.786312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ca11-0f8a-4244-a545-665de45a4ca9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.789958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d64a6f-19af-44f8-b9ac-d003e0716c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.790900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d64a6f-19af-44f8-b9ac-d003e0716c71 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.791231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d64a6f-19af-44f8-b9ac-d003e0716c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.791628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d64a6f-19af-44f8-b9ac-d003e0716c71 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.792870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d64a6f-19af-44f8-b9ac-d003e0716c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.794795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d64a6f-19af-44f8-b9ac-d003e0716c71 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.800215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ca11-0f8a-4244-a545-665de45a4ca9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.804821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549374d-882c-4cfa-858f-1893bded89ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.805910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549374d-882c-4cfa-858f-1893bded89ba admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.806262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549374d-882c-4cfa-858f-1893bded89ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.806569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549374d-882c-4cfa-858f-1893bded89ba admin admin] PATH_INFO: `/v3/projects/01ed03f76e8a4ec683d87be6d3ead29d/users/fddc7a2e68d547ef8968d866da3ca70f/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.815323 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 830/1664] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:26 2021] POST /identity/v3/users => generated 308 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:26.816174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d64a6f-19af-44f8-b9ac-d003e0716c71 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.824354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549374d-882c-4cfa-858f-1893bded89ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ed03f76e8a4ec683d87be6d3ead29d, user_id=fddc7a2e68d547ef8968d866da3ca70f, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.827329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549374d-882c-4cfa-858f-1893bded89ba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.829722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d64a6f-19af-44f8-b9ac-d003e0716c71 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.836029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93a642-3dd2-404b-9bc5-eb4fa39b3ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.836804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93a642-3dd2-404b-9bc5-eb4fa39b3ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.837126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93a642-3dd2-404b-9bc5-eb4fa39b3ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.837447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93a642-3dd2-404b-9bc5-eb4fa39b3ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.838288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93a642-3dd2-404b-9bc5-eb4fa39b3ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.841321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93a642-3dd2-404b-9bc5-eb4fa39b3ea8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.845358 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 835/1665] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:26 2021] PUT /identity/v3/projects/01ed03f76e8a4ec683d87be6d3ead29d/users/fddc7a2e68d547ef8968d866da3ca70f/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:26.845983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549374d-882c-4cfa-858f-1893bded89ba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.855308 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 831/1666] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:26 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:26.855308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93a642-3dd2-404b-9bc5-eb4fa39b3ea8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.868399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93a642-3dd2-404b-9bc5-eb4fa39b3ea8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.910624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549374d-882c-4cfa-858f-1893bded89ba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:26.915183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1c029-e991-4950-8385-82732bae5ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.916097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c029-e991-4950-8385-82732bae5ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.916368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c029-e991-4950-8385-82732bae5ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.916633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1c029-e991-4950-8385-82732bae5ff6 admin admin] PATH_INFO: `/v3/projects/56f9df9b815645cbaf7edf2ff21715b4/users/6d4e98bf3ae14b8db078278b4aa51583/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.918686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1c029-e991-4950-8385-82732bae5ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f9df9b815645cbaf7edf2ff21715b4, user_id=6d4e98bf3ae14b8db078278b4aa51583, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.921333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1c029-e991-4950-8385-82732bae5ff6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.924932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41275acd-e768-402d-8b7b-cdd23835bc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:26.925821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41275acd-e768-402d-8b7b-cdd23835bc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:26.926104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41275acd-e768-402d-8b7b-cdd23835bc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:26.926381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41275acd-e768-402d-8b7b-cdd23835bc46 admin admin] PATH_INFO: `/v3/projects/5433cd58699f41948bf541fedb3ed5d1/users/31ff9538d3d94dc18fcb33714beea749/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:26.928506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41275acd-e768-402d-8b7b-cdd23835bc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5433cd58699f41948bf541fedb3ed5d1, user_id=31ff9538d3d94dc18fcb33714beea749, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:26.931185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41275acd-e768-402d-8b7b-cdd23835bc46 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:26.931482 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 836/1667] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:26 2021] PUT /identity/v3/projects/56f9df9b815645cbaf7edf2ff21715b4/users/6d4e98bf3ae14b8db078278b4aa51583/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:26.932360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1c029-e991-4950-8385-82732bae5ff6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:26.941265 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 832/1668] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:26 2021] PUT /identity/v3/projects/5433cd58699f41948bf541fedb3ed5d1/users/31ff9538d3d94dc18fcb33714beea749/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:26.942045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41275acd-e768-402d-8b7b-cdd23835bc46 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.000955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1c029-e991-4950-8385-82732bae5ff6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.001747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41275acd-e768-402d-8b7b-cdd23835bc46 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.005813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef04b1-e379-4f03-9d79-c83a75d63680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.006340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7429fea-de87-417c-8b81-a77fcab27bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.006500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef04b1-e379-4f03-9d79-c83a75d63680 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.006759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef04b1-e379-4f03-9d79-c83a75d63680 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.007034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef04b1-e379-4f03-9d79-c83a75d63680 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.007212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7429fea-de87-417c-8b81-a77fcab27bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.007533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7429fea-de87-417c-8b81-a77fcab27bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.007808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef04b1-e379-4f03-9d79-c83a75d63680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.007909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7429fea-de87-417c-8b81-a77fcab27bfa admin admin] PATH_INFO: `/v3/projects/1173fc8dd8694a209341582ce49219e1/users/b0ae8ce9404e4333816abaafb888a78a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.009406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef04b1-e379-4f03-9d79-c83a75d63680 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.019157 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 837/1669] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:26 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:27.020405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859397bc-56b8-4559-8df3-096714c13b27 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.020692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859397bc-56b8-4559-8df3-096714c13b27 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.020969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859397bc-56b8-4559-8df3-096714c13b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.022609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7429fea-de87-417c-8b81-a77fcab27bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1173fc8dd8694a209341582ce49219e1, user_id=b0ae8ce9404e4333816abaafb888a78a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.025308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7429fea-de87-417c-8b81-a77fcab27bfa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.038451 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 833/1670] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:26 2021] PUT /identity/v3/projects/1173fc8dd8694a209341582ce49219e1/users/b0ae8ce9404e4333816abaafb888a78a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:27.039291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7429fea-de87-417c-8b81-a77fcab27bfa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.042557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-859397bc-56b8-4559-8df3-096714c13b27 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:27.043875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-859397bc-56b8-4559-8df3-096714c13b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:27.098201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7429fea-de87-417c-8b81-a77fcab27bfa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.102831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d15cd8-1c1a-4fcb-892a-cc0d2503d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.103690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d15cd8-1c1a-4fcb-892a-cc0d2503d719 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.103973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d15cd8-1c1a-4fcb-892a-cc0d2503d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.104802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d15cd8-1c1a-4fcb-892a-cc0d2503d719 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.105525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d15cd8-1c1a-4fcb-892a-cc0d2503d719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.106020 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 838/1671] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:45:27 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:27.106858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859397bc-56b8-4559-8df3-096714c13b27 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.108391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d15cd8-1c1a-4fcb-892a-cc0d2503d719 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.116625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859397bc-56b8-4559-8df3-096714c13b27 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.122968 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 834/1672] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:27 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:27.122968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d15cd8-1c1a-4fcb-892a-cc0d2503d719 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.125399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30fac2-ff72-4c24-9f80-c6196c81164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.126070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30fac2-ff72-4c24-9f80-c6196c81164a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.126381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30fac2-ff72-4c24-9f80-c6196c81164a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.126664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30fac2-ff72-4c24-9f80-c6196c81164a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.127437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30fac2-ff72-4c24-9f80-c6196c81164a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.129086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30fac2-ff72-4c24-9f80-c6196c81164a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.133018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d15cd8-1c1a-4fcb-892a-cc0d2503d719 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.138350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84464bc-be65-4eec-8ccb-b50d82efedb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.139221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84464bc-be65-4eec-8ccb-b50d82efedb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.139536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84464bc-be65-4eec-8ccb-b50d82efedb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.139814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84464bc-be65-4eec-8ccb-b50d82efedb0 admin admin] PATH_INFO: `/v3/projects/39b6d05f5755471cb3861cf371120430/users/5344f119b8584fecaa6efdc43cc6c674/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.140540 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 839/1673] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:27 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:27.141788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d964a97-a02c-4351-8917-52feda897ff7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.142072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d964a97-a02c-4351-8917-52feda897ff7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.142353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d964a97-a02c-4351-8917-52feda897ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.157966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84464bc-be65-4eec-8ccb-b50d82efedb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b6d05f5755471cb3861cf371120430, user_id=5344f119b8584fecaa6efdc43cc6c674, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.160746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84464bc-be65-4eec-8ccb-b50d82efedb0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.169889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3d964a97-a02c-4351-8917-52feda897ff7 None None] MFA Rules not processed for user `6d4e98bf3ae14b8db078278b4aa51583`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:27.171077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3d964a97-a02c-4351-8917-52feda897ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:27.174103 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 835/1674] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:27 2021] PUT /identity/v3/projects/39b6d05f5755471cb3861cf371120430/users/5344f119b8584fecaa6efdc43cc6c674/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:27.175401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c96548-cda6-4d93-9277-5b5974424a21 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.175843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c96548-cda6-4d93-9277-5b5974424a21 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.176471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c96548-cda6-4d93-9277-5b5974424a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.200698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b0c96548-cda6-4d93-9277-5b5974424a21 None None] MFA Rules not processed for user `31ff9538d3d94dc18fcb33714beea749`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:27.201922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b0c96548-cda6-4d93-9277-5b5974424a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:27.237384 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 840/1675] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:27 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:27.238204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d964a97-a02c-4351-8917-52feda897ff7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.267695 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 836/1676] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:27 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:27.268372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c96548-cda6-4d93-9277-5b5974424a21 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.300683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d964a97-a02c-4351-8917-52feda897ff7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.305310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a3167-b9f7-4e47-8433-986f754a9278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.306183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a3167-b9f7-4e47-8433-986f754a9278 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.306463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a3167-b9f7-4e47-8433-986f754a9278 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.306737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a3167-b9f7-4e47-8433-986f754a9278 admin admin] PATH_INFO: `/v3/projects/80406563ee66488994c5b0a9329e3348/users/9c0e5e67b40d493bac716792d06824ff/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.324306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a3167-b9f7-4e47-8433-986f754a9278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80406563ee66488994c5b0a9329e3348, user_id=9c0e5e67b40d493bac716792d06824ff, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.327125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a3167-b9f7-4e47-8433-986f754a9278 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.329044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c96548-cda6-4d93-9277-5b5974424a21 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.334948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8c316-10d5-47f2-9ec2-56a8aa245879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.335807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8c316-10d5-47f2-9ec2-56a8aa245879 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.336087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8c316-10d5-47f2-9ec2-56a8aa245879 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.336362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8c316-10d5-47f2-9ec2-56a8aa245879 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.337092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8c316-10d5-47f2-9ec2-56a8aa245879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.338673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8c316-10d5-47f2-9ec2-56a8aa245879 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.340768 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 841/1677] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:27 2021] PUT /identity/v3/projects/80406563ee66488994c5b0a9329e3348/users/9c0e5e67b40d493bac716792d06824ff/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:27.341371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a3167-b9f7-4e47-8433-986f754a9278 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.351156 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 837/1678] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:27 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:27.351928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8c316-10d5-47f2-9ec2-56a8aa245879 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.404770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a3167-b9f7-4e47-8433-986f754a9278 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.409589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d257-d123-4a88-925c-1a84e2830c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.410477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d257-d123-4a88-925c-1a84e2830c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.410810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d257-d123-4a88-925c-1a84e2830c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.411032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d257-d123-4a88-925c-1a84e2830c4d admin admin] PATH_INFO: `/v3/projects/fc2eb222702c4da588deaf85f4b064a5/users/5f3f073e308d4e83aeacd88583fb5960/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.416341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8c316-10d5-47f2-9ec2-56a8aa245879 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.428267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3d257-d123-4a88-925c-1a84e2830c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2eb222702c4da588deaf85f4b064a5, user_id=5f3f073e308d4e83aeacd88583fb5960, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.428267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3d257-d123-4a88-925c-1a84e2830c4d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.442033 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 842/1679] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:27 2021] PUT /identity/v3/projects/fc2eb222702c4da588deaf85f4b064a5/users/5f3f073e308d4e83aeacd88583fb5960/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:27.442989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d257-d123-4a88-925c-1a84e2830c4d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.475369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bfe0b-a866-42fd-bfc3-258c8f36226e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.476046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bfe0b-a866-42fd-bfc3-258c8f36226e service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.476326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bfe0b-a866-42fd-bfc3-258c8f36226e service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.476601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bfe0b-a866-42fd-bfc3-258c8f36226e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.485077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bfe0b-a866-42fd-bfc3-258c8f36226e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.486668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bfe0b-a866-42fd-bfc3-258c8f36226e service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.496908 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 838/1680] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:27.497681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bfe0b-a866-42fd-bfc3-258c8f36226e service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.503501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d257-d123-4a88-925c-1a84e2830c4d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.507159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bfe0b-a866-42fd-bfc3-258c8f36226e service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.508290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa73a38-4b67-470e-bd52-f60f3ebf12a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.509136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa73a38-4b67-470e-bd52-f60f3ebf12a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.509412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa73a38-4b67-470e-bd52-f60f3ebf12a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.509683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa73a38-4b67-470e-bd52-f60f3ebf12a6 admin admin] PATH_INFO: `/v3/projects/01ed03f76e8a4ec683d87be6d3ead29d/users/fddc7a2e68d547ef8968d866da3ca70f/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.512444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa73a38-4b67-470e-bd52-f60f3ebf12a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ed03f76e8a4ec683d87be6d3ead29d, user_id=fddc7a2e68d547ef8968d866da3ca70f, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.512718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0dc7c-f1b6-41c4-9949-c130efc632a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.513433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0dc7c-f1b6-41c4-9949-c130efc632a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.513668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0dc7c-f1b6-41c4-9949-c130efc632a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.513895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0dc7c-f1b6-41c4-9949-c130efc632a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.514611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0dc7c-f1b6-41c4-9949-c130efc632a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.515121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa73a38-4b67-470e-bd52-f60f3ebf12a6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.516212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0dc7c-f1b6-41c4-9949-c130efc632a4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.526650 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 839/1682] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:27.526767 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 843/1682] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:27 2021] PUT /identity/v3/projects/01ed03f76e8a4ec683d87be6d3ead29d/users/fddc7a2e68d547ef8968d866da3ca70f/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:27.527378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0dc7c-f1b6-41c4-9949-c130efc632a4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.527563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa73a38-4b67-470e-bd52-f60f3ebf12a6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.538008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0dc7c-f1b6-41c4-9949-c130efc632a4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.600490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa73a38-4b67-470e-bd52-f60f3ebf12a6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.611539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64568f0-8997-4b4a-a526-0bf61c7ffc27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.612207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64568f0-8997-4b4a-a526-0bf61c7ffc27 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.612519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64568f0-8997-4b4a-a526-0bf61c7ffc27 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.612796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64568f0-8997-4b4a-a526-0bf61c7ffc27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.618448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259eacd0-226d-4dce-b651-cb7757199480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.619214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eacd0-226d-4dce-b651-cb7757199480 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.619619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eacd0-226d-4dce-b651-cb7757199480 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.620671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eacd0-226d-4dce-b651-cb7757199480 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.621656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259eacd0-226d-4dce-b651-cb7757199480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.623895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259eacd0-226d-4dce-b651-cb7757199480 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.653756 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 840/1683] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:27 2021] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:27.654940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259eacd0-226d-4dce-b651-cb7757199480 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.685603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64568f0-8997-4b4a-a526-0bf61c7ffc27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.687135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64568f0-8997-4b4a-a526-0bf61c7ffc27 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.696729 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 844/1684] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:27 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:27.697570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64568f0-8997-4b4a-a526-0bf61c7ffc27 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.707289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64568f0-8997-4b4a-a526-0bf61c7ffc27 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.717693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259eacd0-226d-4dce-b651-cb7757199480 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.722510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4e675-4cce-493d-a33c-41dab776dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.722955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e675-4cce-493d-a33c-41dab776dbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.723235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e675-4cce-493d-a33c-41dab776dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.723544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4e675-4cce-493d-a33c-41dab776dbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.724404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4e675-4cce-493d-a33c-41dab776dbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.726001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4e675-4cce-493d-a33c-41dab776dbf7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.736890 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 841/1685] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:27 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:27.740205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4e675-4cce-493d-a33c-41dab776dbf7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.750996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4e675-4cce-493d-a33c-41dab776dbf7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.755665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead103e-d6e8-43b1-9250-9c065383a634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.756317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead103e-d6e8-43b1-9250-9c065383a634 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.756629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead103e-d6e8-43b1-9250-9c065383a634 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.756901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead103e-d6e8-43b1-9250-9c065383a634 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.757627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead103e-d6e8-43b1-9250-9c065383a634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.759226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead103e-d6e8-43b1-9250-9c065383a634 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.770963 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 842/1686] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:27 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:27.772934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3282f-84c7-4a2c-ad3c-fd679b0ce5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.773853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3282f-84c7-4a2c-ad3c-fd679b0ce5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.774362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3282f-84c7-4a2c-ad3c-fd679b0ce5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.774524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3282f-84c7-4a2c-ad3c-fd679b0ce5d6 admin admin] PATH_INFO: `/v3/projects/1173fc8dd8694a209341582ce49219e1/users/b0ae8ce9404e4333816abaafb888a78a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.775519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338a48-5ba7-4e46-9b6d-086d8f4f7a05 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.775809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338a48-5ba7-4e46-9b6d-086d8f4f7a05 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.776177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06338a48-5ba7-4e46-9b6d-086d8f4f7a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.776715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3282f-84c7-4a2c-ad3c-fd679b0ce5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1173fc8dd8694a209341582ce49219e1, user_id=b0ae8ce9404e4333816abaafb888a78a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.779406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3282f-84c7-4a2c-ad3c-fd679b0ce5d6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.790218 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 845/1687] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:27 2021] PUT /identity/v3/projects/1173fc8dd8694a209341582ce49219e1/users/b0ae8ce9404e4333816abaafb888a78a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:27.791007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3282f-84c7-4a2c-ad3c-fd679b0ce5d6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.806598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-06338a48-5ba7-4e46-9b6d-086d8f4f7a05 None None] MFA Rules not processed for user `fddc7a2e68d547ef8968d866da3ca70f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:27.808425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-06338a48-5ba7-4e46-9b6d-086d8f4f7a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:27.855480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3282f-84c7-4a2c-ad3c-fd679b0ce5d6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.863771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bc2b1-eb35-4dce-92ef-d41979e9a445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.864641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bc2b1-eb35-4dce-92ef-d41979e9a445 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.864968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bc2b1-eb35-4dce-92ef-d41979e9a445 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.865315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bc2b1-eb35-4dce-92ef-d41979e9a445 admin admin] PATH_INFO: `/v3/projects/39b6d05f5755471cb3861cf371120430/users/5344f119b8584fecaa6efdc43cc6c674/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.867539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bc2b1-eb35-4dce-92ef-d41979e9a445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b6d05f5755471cb3861cf371120430, user_id=5344f119b8584fecaa6efdc43cc6c674, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.870878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bc2b1-eb35-4dce-92ef-d41979e9a445 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.880646 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 843/1688] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:27 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:27.881535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06338a48-5ba7-4e46-9b6d-086d8f4f7a05 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.881929 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 846/1689] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:27 2021] PUT /identity/v3/projects/39b6d05f5755471cb3861cf371120430/users/5344f119b8584fecaa6efdc43cc6c674/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:27.883191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe377-2b1a-4bc8-8514-c74c82562d88 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.883510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe377-2b1a-4bc8-8514-c74c82562d88 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.883829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe377-2b1a-4bc8-8514-c74c82562d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.894833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06338a48-5ba7-4e46-9b6d-086d8f4f7a05 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.908005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d20fe377-2b1a-4bc8-8514-c74c82562d88 None None] MFA Rules not processed for user `c6bda78859f14c7a8f397a209503f28e`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:27.909215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d20fe377-2b1a-4bc8-8514-c74c82562d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:27.951939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2a0bf-05aa-48b1-bac3-05095b5bbc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.952537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a0bf-05aa-48b1-bac3-05095b5bbc99 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.952816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a0bf-05aa-48b1-bac3-05095b5bbc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.953091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a0bf-05aa-48b1-bac3-05095b5bbc99 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.953793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2a0bf-05aa-48b1-bac3-05095b5bbc99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.955750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2a0bf-05aa-48b1-bac3-05095b5bbc99 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.965953 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 847/1690] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:27 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:27.966576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fe377-2b1a-4bc8-8514-c74c82562d88 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.977956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fe377-2b1a-4bc8-8514-c74c82562d88 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.982675 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 844/1691] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:27 2021] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:27.982675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2a0bf-05aa-48b1-bac3-05095b5bbc99 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:27.983962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f4048-bd2f-4d6e-90bd-08acbfe038da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.984851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f4048-bd2f-4d6e-90bd-08acbfe038da admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.985136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f4048-bd2f-4d6e-90bd-08acbfe038da admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.985412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f4048-bd2f-4d6e-90bd-08acbfe038da admin admin] PATH_INFO: `/v3/projects/80406563ee66488994c5b0a9329e3348/users/9c0e5e67b40d493bac716792d06824ff/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:27.987473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f4048-bd2f-4d6e-90bd-08acbfe038da admin admin] RBAC: Authorizing `identity:create_grant(project_id=80406563ee66488994c5b0a9329e3348, user_id=9c0e5e67b40d493bac716792d06824ff, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:27.990337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f4048-bd2f-4d6e-90bd-08acbfe038da admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:27.992232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2a0bf-05aa-48b1-bac3-05095b5bbc99 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:27.998322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39275f38-b23e-4821-9d79-f9d088ef2259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:27.999200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39275f38-b23e-4821-9d79-f9d088ef2259 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:27.999518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39275f38-b23e-4821-9d79-f9d088ef2259 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:27.999796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39275f38-b23e-4821-9d79-f9d088ef2259 admin admin] PATH_INFO: `/v3/projects/fc2eb222702c4da588deaf85f4b064a5/users/5f3f073e308d4e83aeacd88583fb5960/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.001781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39275f38-b23e-4821-9d79-f9d088ef2259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2eb222702c4da588deaf85f4b064a5, user_id=5f3f073e308d4e83aeacd88583fb5960, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:28.003160 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 848/1692] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:27 2021] PUT /identity/v3/projects/80406563ee66488994c5b0a9329e3348/users/9c0e5e67b40d493bac716792d06824ff/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:28.004434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48117300-b852-4244-aa2e-8fb148d54e8d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.004610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39275f38-b23e-4821-9d79-f9d088ef2259 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:28.004704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48117300-b852-4244-aa2e-8fb148d54e8d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.004978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48117300-b852-4244-aa2e-8fb148d54e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.017692 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 845/1693] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:27 2021] PUT /identity/v3/projects/fc2eb222702c4da588deaf85f4b064a5/users/5f3f073e308d4e83aeacd88583fb5960/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:28.018945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc3a7-c5f9-4dfb-b6af-26543c0135d9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.019233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc3a7-c5f9-4dfb-b6af-26543c0135d9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.019565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc3a7-c5f9-4dfb-b6af-26543c0135d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.036438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-48117300-b852-4244-aa2e-8fb148d54e8d None None] MFA Rules not processed for user `b0ae8ce9404e4333816abaafb888a78a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:28.037653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-48117300-b852-4244-aa2e-8fb148d54e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.046996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bdcfc3a7-c5f9-4dfb-b6af-26543c0135d9 None None] MFA Rules not processed for user `5344f119b8584fecaa6efdc43cc6c674`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:28.048325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bdcfc3a7-c5f9-4dfb-b6af-26543c0135d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.104956 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 849/1694] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:28 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:28.105874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48117300-b852-4244-aa2e-8fb148d54e8d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:28.115679 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 846/1695] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:28 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:28.116546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfc3a7-c5f9-4dfb-b6af-26543c0135d9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:28.166043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48117300-b852-4244-aa2e-8fb148d54e8d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:28.171282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ca5d5-6f25-4825-8373-7892650a353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:28.172141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ca5d5-6f25-4825-8373-7892650a353c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.172420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ca5d5-6f25-4825-8373-7892650a353c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.172689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ca5d5-6f25-4825-8373-7892650a353c admin admin] PATH_INFO: `/v3/users/7a319f62eda84926989af46e373e18d8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.173886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ca5d5-6f25-4825-8373-7892650a353c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a319f62eda84926989af46e373e18d8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:28.175843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ca5d5-6f25-4825-8373-7892650a353c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:28.183071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfc3a7-c5f9-4dfb-b6af-26543c0135d9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:28.188597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c7d53-5ad1-4675-be91-540f4d612d70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:28.189245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7d53-5ad1-4675-be91-540f4d612d70 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.189523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7d53-5ad1-4675-be91-540f4d612d70 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.189796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c7d53-5ad1-4675-be91-540f4d612d70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.221799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-840ca5d5-6f25-4825-8373-7892650a353c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a319f62eda84926989af46e373e18d8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:28.222381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-840ca5d5-6f25-4825-8373-7892650a353c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a319f62eda84926989af46e373e18d8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:28.231564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-840ca5d5-6f25-4825-8373-7892650a353c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a319f62eda84926989af46e373e18d8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:28.232197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-840ca5d5-6f25-4825-8373-7892650a353c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a319f62eda84926989af46e373e18d8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:28.239190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-840ca5d5-6f25-4825-8373-7892650a353c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a319f62eda84926989af46e373e18d8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:28.244464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c7d53-5ad1-4675-be91-540f4d612d70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:28.246877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c7d53-5ad1-4675-be91-540f4d612d70 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:28.256125 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 847/1696] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:28 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:28.257072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c7d53-5ad1-4675-be91-540f4d612d70 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:28.257871 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 850/1697] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:28 2021] DELETE /identity/v3/users/7a319f62eda84926989af46e373e18d8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:28.259446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdad0c-cae3-4524-b132-f06ff6a26e14 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.259896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdad0c-cae3-4524-b132-f06ff6a26e14 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.260365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdad0c-cae3-4524-b132-f06ff6a26e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.268059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c7d53-5ad1-4675-be91-540f4d612d70 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:28.287524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b3bdad0c-cae3-4524-b132-f06ff6a26e14 None None] MFA Rules not processed for user `9c0e5e67b40d493bac716792d06824ff`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:28.288732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b3bdad0c-cae3-4524-b132-f06ff6a26e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.333962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506152-1936-49f8-91d7-934cd8b25234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:28.334647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506152-1936-49f8-91d7-934cd8b25234 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.334931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506152-1936-49f8-91d7-934cd8b25234 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.335290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506152-1936-49f8-91d7-934cd8b25234 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.335964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3506152-1936-49f8-91d7-934cd8b25234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:28.337664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3506152-1936-49f8-91d7-934cd8b25234 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:28.348109 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 848/1698] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:28 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:28.352143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dfc7a-88c2-4943-82c9-5aceb09d465f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.352962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dfc7a-88c2-4943-82c9-5aceb09d465f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.352962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dfc7a-88c2-4943-82c9-5aceb09d465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.360047 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 851/1699] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:28 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:28.361519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cfb52-9e8d-448e-b8f1-853b36ad7e13 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.361808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cfb52-9e8d-448e-b8f1-853b36ad7e13 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.362081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cfb52-9e8d-448e-b8f1-853b36ad7e13 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.363758 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 852/1700] 10.222.0.21 () {54 vars in 961 bytes} [Sat Nov 27 20:45:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:45:28.364789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54f107-2ef9-4f77-9b01-a3c6ff55c206 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.365076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54f107-2ef9-4f77-9b01-a3c6ff55c206 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.365347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54f107-2ef9-4f77-9b01-a3c6ff55c206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.390563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b07dfc7a-88c2-4943-82c9-5aceb09d465f None None] MFA Rules not processed for user `5f3f073e308d4e83aeacd88583fb5960`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:28.391827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b07dfc7a-88c2-4943-82c9-5aceb09d465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.393291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cd54f107-2ef9-4f77-9b01-a3c6ff55c206 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:28.394489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cd54f107-2ef9-4f77-9b01-a3c6ff55c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.402706 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 853/1701] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:28.403610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54f107-2ef9-4f77-9b01-a3c6ff55c206 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:28.404911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cd54f107-2ef9-4f77-9b01-a3c6ff55c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.417159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54f107-2ef9-4f77-9b01-a3c6ff55c206 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:28.422298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861859d-7580-4776-8846-bdb47761fe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:28.423098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861859d-7580-4776-8846-bdb47761fe5c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.423419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861859d-7580-4776-8846-bdb47761fe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.423811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861859d-7580-4776-8846-bdb47761fe5c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.424886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861859d-7580-4776-8846-bdb47761fe5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:28.426573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861859d-7580-4776-8846-bdb47761fe5c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:28.437586 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 854/1702] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:28 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:28.439078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a067b-ca5b-48bc-8a2b-5b7a69821852 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.439408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a067b-ca5b-48bc-8a2b-5b7a69821852 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.439686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a067b-ca5b-48bc-8a2b-5b7a69821852 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.443307 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 855/1703] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:45:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:45:28.443307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec337a4c-4c61-4151-8938-e024a21fa268 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.443307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec337a4c-4c61-4151-8938-e024a21fa268 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.443534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec337a4c-4c61-4151-8938-e024a21fa268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.461343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ec337a4c-4c61-4151-8938-e024a21fa268 None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:28.462516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec337a4c-4c61-4151-8938-e024a21fa268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.470332 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 849/1704] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:28 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:28.471689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3bc07-a00b-4a54-a5ab-e8ce1d9172b8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.472002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3bc07-a00b-4a54-a5ab-e8ce1d9172b8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.472247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3bc07-a00b-4a54-a5ab-e8ce1d9172b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.489463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-61f3bc07-a00b-4a54-a5ab-e8ce1d9172b8 None None] MFA Rules not processed for user `8eff5913736b4e77ac2b092534edfcd9`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:28.490657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-61f3bc07-a00b-4a54-a5ab-e8ce1d9172b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.530796 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 856/1705] 10.222.0.21 () {58 vars in 1058 bytes} [Sat Nov 27 20:45:28 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:28.531711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec337a4c-4c61-4151-8938-e024a21fa268 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:28.532959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec337a4c-4c61-4151-8938-e024a21fa268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.545190 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 850/1706] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:28 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:28.545994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3bc07-a00b-4a54-a5ab-e8ce1d9172b8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:28.555774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3bc07-a00b-4a54-a5ab-e8ce1d9172b8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:28.561031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6286e2-6212-4f62-a220-567e0cbed276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:28.561889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6286e2-6212-4f62-a220-567e0cbed276 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.562168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6286e2-6212-4f62-a220-567e0cbed276 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.562437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6286e2-6212-4f62-a220-567e0cbed276 admin admin] PATH_INFO: `/v3/projects/ad21beb2525548d0b8ebb140ddae2375/users/4439c27f76ad467fa1a9250a13426234/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.576364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6286e2-6212-4f62-a220-567e0cbed276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad21beb2525548d0b8ebb140ddae2375, user_id=4439c27f76ad467fa1a9250a13426234, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:28.578981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6286e2-6212-4f62-a220-567e0cbed276 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:28.591469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec337a4c-4c61-4151-8938-e024a21fa268 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:28.591637 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 851/1707] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:28 2021] PUT /identity/v3/projects/ad21beb2525548d0b8ebb140ddae2375/users/4439c27f76ad467fa1a9250a13426234/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:28.592921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51027e8b-ac4f-4cc5-bf83-3f9861b183db None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.593210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51027e8b-ac4f-4cc5-bf83-3f9861b183db None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.593481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51027e8b-ac4f-4cc5-bf83-3f9861b183db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.633203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-51027e8b-ac4f-4cc5-bf83-3f9861b183db None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:28.634602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-51027e8b-ac4f-4cc5-bf83-3f9861b183db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.646976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e410aec-f688-4c4f-a57b-7f5e92753652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:28.647707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e410aec-f688-4c4f-a57b-7f5e92753652 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.647990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e410aec-f688-4c4f-a57b-7f5e92753652 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.648260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e410aec-f688-4c4f-a57b-7f5e92753652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.699387 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 852/1708] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:45:28 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:28.700233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51027e8b-ac4f-4cc5-bf83-3f9861b183db None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:28.706709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e410aec-f688-4c4f-a57b-7f5e92753652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:28.708193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e410aec-f688-4c4f-a57b-7f5e92753652 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:28.711502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51027e8b-ac4f-4cc5-bf83-3f9861b183db None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:28.717670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e45f9-7577-4059-8086-dfb018b12863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:28.718294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e45f9-7577-4059-8086-dfb018b12863 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.718576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e45f9-7577-4059-8086-dfb018b12863 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.718668 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 857/1709] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:28.718852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e45f9-7577-4059-8086-dfb018b12863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.719946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d91ea-bc12-4b18-b384-2a291a1e3cca None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.720233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d91ea-bc12-4b18-b384-2a291a1e3cca None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.720512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d91ea-bc12-4b18-b384-2a291a1e3cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.721061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d23e45f9-7577-4059-8086-dfb018b12863 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.747671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-934d91ea-bc12-4b18-b384-2a291a1e3cca None None] MFA Rules not processed for user `4439c27f76ad467fa1a9250a13426234`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:28.748885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-934d91ea-bc12-4b18-b384-2a291a1e3cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.788894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e45f9-7577-4059-8086-dfb018b12863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:28.790825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e45f9-7577-4059-8086-dfb018b12863 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:28.802064 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 853/1710] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:28 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:28.803412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e45f9-7577-4059-8086-dfb018b12863 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:28.805103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d23e45f9-7577-4059-8086-dfb018b12863 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.821193 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 858/1711] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:28 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:28.857225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d91ea-bc12-4b18-b384-2a291a1e3cca None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:28.868920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e45f9-7577-4059-8086-dfb018b12863 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:28.876888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac6de2-8a18-4f2e-a27b-176ac883467f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:28.876888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6de2-8a18-4f2e-a27b-176ac883467f service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.877222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6de2-8a18-4f2e-a27b-176ac883467f service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.877527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac6de2-8a18-4f2e-a27b-176ac883467f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.877806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d91ea-bc12-4b18-b384-2a291a1e3cca None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:28.889894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54b7e8-5324-4cfb-90ed-340e5fb11b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:28.889894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54b7e8-5324-4cfb-90ed-340e5fb11b4d service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:28.889894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54b7e8-5324-4cfb-90ed-340e5fb11b4d service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:28.889894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54b7e8-5324-4cfb-90ed-340e5fb11b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:28.892003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5e54b7e8-5324-4cfb-90ed-340e5fb11b4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:28.896255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac6de2-8a18-4f2e-a27b-176ac883467f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:28.898321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac6de2-8a18-4f2e-a27b-176ac883467f service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:28.919488 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 854/1712] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:28 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:28.970798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54b7e8-5324-4cfb-90ed-340e5fb11b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:28.972460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54b7e8-5324-4cfb-90ed-340e5fb11b4d service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:28.982929 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 859/1713] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:28 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:29.033714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac6de2-8a18-4f2e-a27b-176ac883467f service glance] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:29.046954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac6de2-8a18-4f2e-a27b-176ac883467f service glance] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:29.053038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf3dfc-2560-41ef-9f1d-25cb5144f15a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:29.053681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf3dfc-2560-41ef-9f1d-25cb5144f15a service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.053964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf3dfc-2560-41ef-9f1d-25cb5144f15a service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.054236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf3dfc-2560-41ef-9f1d-25cb5144f15a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.087810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54b7e8-5324-4cfb-90ed-340e5fb11b4d service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:29.089822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5e54b7e8-5324-4cfb-90ed-340e5fb11b4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.104999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54b7e8-5324-4cfb-90ed-340e5fb11b4d service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:29.111946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:29.112994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.113403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.113809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] PATH_INFO: `/v3/projects/7742e0a2093f4cf6ace16410f4c8d94b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.115269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7742e0a2093f4cf6ace16410f4c8d94b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:29.116389 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:29.116389 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:45:29.116389 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:45:29.117962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:29.136024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf3dfc-2560-41ef-9f1d-25cb5144f15a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:29.137903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf3dfc-2560-41ef-9f1d-25cb5144f15a service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:29.153826 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 855/1714] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:29 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:29.184307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf3dfc-2560-41ef-9f1d-25cb5144f15a service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:29.189243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7742e0a2093f4cf6ace16410f4c8d94b', 'request_id': 'req-add2b434-8e50-43cc-8ecc-f244bd373339'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.196306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf3dfc-2560-41ef-9f1d-25cb5144f15a service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:29.203995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7742e0a2093f4cf6ace16410f4c8d94b', 'request_id': 'req-add2b434-8e50-43cc-8ecc-f244bd373339'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.214308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7742e0a2093f4cf6ace16410f4c8d94b', 'request_id': 'req-add2b434-8e50-43cc-8ecc-f244bd373339'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.226377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] The token cache is being invalidate because project 7742e0a2093f4cf6ace16410f4c8d94b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:29.226646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.227389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.231317 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 860/1715] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:29 2021] DELETE /identity/v3/projects/7742e0a2093f4cf6ace16410f4c8d94b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:29.233034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:29.234390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.273530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb131ba1-2fd7-4358-8a21-0491a37b9421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:29.274000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131ba1-2fd7-4358-8a21-0491a37b9421 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.274338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131ba1-2fd7-4358-8a21-0491a37b9421 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.274714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb131ba1-2fd7-4358-8a21-0491a37b9421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.277175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fb131ba1-2fd7-4358-8a21-0491a37b9421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.301390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2b434-8e50-43cc-8ecc-f244bd373339 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:29.306824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:29.307881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.308238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.308593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] PATH_INFO: `/v3/users/fddc7a2e68d547ef8968d866da3ca70f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.309944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddc7a2e68d547ef8968d866da3ca70f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:29.312241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:29.339159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb131ba1-2fd7-4358-8a21-0491a37b9421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:29.340962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb131ba1-2fd7-4358-8a21-0491a37b9421 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:29.353277 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 856/1716] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:29 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:45:29.364263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddc7a2e68d547ef8968d866da3ca70f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.364742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddc7a2e68d547ef8968d866da3ca70f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.373663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddc7a2e68d547ef8968d866da3ca70f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.374408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddc7a2e68d547ef8968d866da3ca70f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.381535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddc7a2e68d547ef8968d866da3ca70f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.397475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239405-2a86-4026-9824-d4766f2aa098 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.397769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239405-2a86-4026-9824-d4766f2aa098 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.398052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239405-2a86-4026-9824-d4766f2aa098 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.400303 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 857/1717] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:45:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:45:29.406060 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 861/1718] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:29 2021] DELETE /identity/v3/users/fddc7a2e68d547ef8968d866da3ca70f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:45:29.406737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb9645-ff00-413a-8c42-b516fb84ad4a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.407034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb9645-ff00-413a-8c42-b516fb84ad4a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.407354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb9645-ff00-413a-8c42-b516fb84ad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.426880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3fdb9645-ff00-413a-8c42-b516fb84ad4a None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:29.428125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3fdb9645-ff00-413a-8c42-b516fb84ad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.493275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:29.495567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.533524 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 858/1719] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:45:29 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:45:29.550636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb9645-ff00-413a-8c42-b516fb84ad4a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:29.556148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3fdb9645-ff00-413a-8c42-b516fb84ad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.612973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468a4f2-2991-40bd-b0ac-b73c78f6667b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:29.619072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacea22f-d412-41ae-a7ed-dd57939837e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:29.620298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacea22f-d412-41ae-a7ed-dd57939837e4 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.620570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacea22f-d412-41ae-a7ed-dd57939837e4 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.620844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacea22f-d412-41ae-a7ed-dd57939837e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.623015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eacea22f-d412-41ae-a7ed-dd57939837e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.639924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb9645-ff00-413a-8c42-b516fb84ad4a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:29.645080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c02af-208c-4605-ad94-d665b7fcf20f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:29.645737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c02af-208c-4605-ad94-d665b7fcf20f service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.646045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c02af-208c-4605-ad94-d665b7fcf20f service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.646326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c02af-208c-4605-ad94-d665b7fcf20f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.659841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c02af-208c-4605-ad94-d665b7fcf20f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:29.662074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c02af-208c-4605-ad94-d665b7fcf20f service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:29.675301 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 859/1720] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:45:29.675893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c02af-208c-4605-ad94-d665b7fcf20f service glance] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:29.677152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b22c02af-208c-4605-ad94-d665b7fcf20f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.711281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacea22f-d412-41ae-a7ed-dd57939837e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:29.716939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacea22f-d412-41ae-a7ed-dd57939837e4 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:29.728715 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 862/1721] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:29 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:45:29.730087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacea22f-d412-41ae-a7ed-dd57939837e4 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:29.731154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eacea22f-d412-41ae-a7ed-dd57939837e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.796867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c02af-208c-4605-ad94-d665b7fcf20f service glance] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:29.802822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db231e-691e-4bad-aec7-0d3028efb132 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:29.803493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db231e-691e-4bad-aec7-0d3028efb132 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.803773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db231e-691e-4bad-aec7-0d3028efb132 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.804043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db231e-691e-4bad-aec7-0d3028efb132 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.806861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-85db231e-691e-4bad-aec7-0d3028efb132 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.811831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacea22f-d412-41ae-a7ed-dd57939837e4 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:29.817385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:29.818491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.818885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.819318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] PATH_INFO: `/v3/projects/01ed03f76e8a4ec683d87be6d3ead29d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.819420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db231e-691e-4bad-aec7-0d3028efb132 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:29.820669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ed03f76e8a4ec683d87be6d3ead29d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:29.820942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db231e-691e-4bad-aec7-0d3028efb132 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:29.823032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:29.831668 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 860/1722] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:29 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:29.832285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db231e-691e-4bad-aec7-0d3028efb132 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:29.845419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db231e-691e-4bad-aec7-0d3028efb132 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:29.851085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732ed54-52b1-4d9c-a910-155a0aa88ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:29.851735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732ed54-52b1-4d9c-a910-155a0aa88ab8 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.852013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732ed54-52b1-4d9c-a910-155a0aa88ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.852282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732ed54-52b1-4d9c-a910-155a0aa88ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.854661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2732ed54-52b1-4d9c-a910-155a0aa88ab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.900901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ed03f76e8a4ec683d87be6d3ead29d', 'request_id': 'req-7e86c57a-fe04-473f-b1d4-15720715067e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.912582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ed03f76e8a4ec683d87be6d3ead29d', 'request_id': 'req-7e86c57a-fe04-473f-b1d4-15720715067e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.925405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ed03f76e8a4ec683d87be6d3ead29d', 'request_id': 'req-7e86c57a-fe04-473f-b1d4-15720715067e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.931751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732ed54-52b1-4d9c-a910-155a0aa88ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:29.937128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732ed54-52b1-4d9c-a910-155a0aa88ab8 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:29.939615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] The token cache is being invalidate because project 01ed03f76e8a4ec683d87be6d3ead29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:29.939971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.940772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e86c57a-fe04-473f-b1d4-15720715067e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:29.943037 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 863/1723] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:29 2021] DELETE /identity/v3/projects/01ed03f76e8a4ec683d87be6d3ead29d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:29.949104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f70fc1-969d-47d0-847e-e943731a8605 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:29.949488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f70fc1-969d-47d0-847e-e943731a8605 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:29.949849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f70fc1-969d-47d0-847e-e943731a8605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:29.950011 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 861/1724] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:29 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:29.974336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732ed54-52b1-4d9c-a910-155a0aa88ab8 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:29.981928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-92f70fc1-969d-47d0-847e-e943731a8605 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:29.986067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-92f70fc1-969d-47d0-847e-e943731a8605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:29.994492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732ed54-52b1-4d9c-a910-155a0aa88ab8 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:30.091640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d5faf-676e-4ea2-8f61-2c77a66fde59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:30.092313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d5faf-676e-4ea2-8f61-2c77a66fde59 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.092599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d5faf-676e-4ea2-8f61-2c77a66fde59 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.092875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d5faf-676e-4ea2-8f61-2c77a66fde59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.095119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-371d5faf-676e-4ea2-8f61-2c77a66fde59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:30.123638 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 864/1725] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:45:30.133040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a1a03-1c15-451d-a089-ab52ad5e508f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.133356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a1a03-1c15-451d-a089-ab52ad5e508f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.133635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a1a03-1c15-451d-a089-ab52ad5e508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.160790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a75a1a03-1c15-451d-a089-ab52ad5e508f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:30.162157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a75a1a03-1c15-451d-a089-ab52ad5e508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:30.172595 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 865/1726] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:30.176596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a1a03-1c15-451d-a089-ab52ad5e508f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:30.188898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a1a03-1c15-451d-a089-ab52ad5e508f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:30.195931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73f56c-7c5b-4947-b7f1-0c6cbff46132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:30.196720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73f56c-7c5b-4947-b7f1-0c6cbff46132 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.197082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73f56c-7c5b-4947-b7f1-0c6cbff46132 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.197477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73f56c-7c5b-4947-b7f1-0c6cbff46132 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.197930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d5faf-676e-4ea2-8f61-2c77a66fde59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:30.198504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73f56c-7c5b-4947-b7f1-0c6cbff46132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:30.198896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73f56c-7c5b-4947-b7f1-0c6cbff46132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:30.201368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d5faf-676e-4ea2-8f61-2c77a66fde59 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:30.201747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73f56c-7c5b-4947-b7f1-0c6cbff46132 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:30.219311 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 866/1727] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:30.232325 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 862/1728] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:29 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:30.232611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73f56c-7c5b-4947-b7f1-0c6cbff46132 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:30.256820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73f56c-7c5b-4947-b7f1-0c6cbff46132 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:30.274577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:30.275621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.276191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.276535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.277389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:30.281058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:30.317052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ba70-6dc6-4125-bb9b-8562de4c8f91 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.317476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ba70-6dc6-4125-bb9b-8562de4c8f91 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.317918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ba70-6dc6-4125-bb9b-8562de4c8f91 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.320166 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 863/1729] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:45:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:45:30.326994 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 867/1730] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:30 2021] POST /identity/v3/projects => generated 399 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:30.328160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ba70-6dc6-4125-bb9b-8562de4c8f91 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:30.332614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:45:30.335131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:30.466246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ba70-6dc6-4125-bb9b-8562de4c8f91 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:30.472910 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 27 20:45:30.473598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:30.475164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:30.481200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2e2e4-12c2-4ed9-a4db-dfd444a1c7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:30.481896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2e2e4-12c2-4ed9-a4db-dfd444a1c7aa admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.482596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2e2e4-12c2-4ed9-a4db-dfd444a1c7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.482596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2e2e4-12c2-4ed9-a4db-dfd444a1c7aa admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.484016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2e2e4-12c2-4ed9-a4db-dfd444a1c7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:30.486117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2e2e4-12c2-4ed9-a4db-dfd444a1c7aa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:30.534676 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 864/1731] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:30 2021] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:45:30.536056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2e2e4-12c2-4ed9-a4db-dfd444a1c7aa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:30.556350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2e2e4-12c2-4ed9-a4db-dfd444a1c7aa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:30.577137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0801e-1fa7-4186-9b4e-065397c044d5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:30.579441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8773095-65e8-4fe7-8737-4f6300594e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:30.583196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8773095-65e8-4fe7-8737-4f6300594e4a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.583520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8773095-65e8-4fe7-8737-4f6300594e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.584351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe051ce4-788d-4b52-8f2c-61825b82e8cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d4e98bf3ae14b8db078278b4aa51583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f9df9b815645cbaf7edf2ff21715b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:30.585383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe051ce4-788d-4b52-8f2c-61825b82e8cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.586074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe051ce4-788d-4b52-8f2c-61825b82e8cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.586527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe051ce4-788d-4b52-8f2c-61825b82e8cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] PATH_INFO: `/v3/projects/e289b137b09743c399e30e4ffa1bab40` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.588105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8773095-65e8-4fe7-8737-4f6300594e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.588309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe051ce4-788d-4b52-8f2c-61825b82e8cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorizing `identity:get_project(project_id=e289b137b09743c399e30e4ffa1bab40)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:30.590938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8773095-65e8-4fe7-8737-4f6300594e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:30.591487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe051ce4-788d-4b52-8f2c-61825b82e8cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:30.593795 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 868/1732] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:45:30 2021] GET /identity/v3/projects/e289b137b09743c399e30e4ffa1bab40 => generated 393 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:30.596046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8773095-65e8-4fe7-8737-4f6300594e4a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:30.613669 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 865/1733] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:30 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:45:30.621673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe051ce4-788d-4b52-8f2c-61825b82e8cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:30.643662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe051ce4-788d-4b52-8f2c-61825b82e8cb tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:30.654768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff2ab2-b6bd-462b-bd92-899a5d9afbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:30.657088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff2ab2-b6bd-462b-bd92-899a5d9afbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.657381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff2ab2-b6bd-462b-bd92-899a5d9afbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.657660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff2ab2-b6bd-462b-bd92-899a5d9afbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.659350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff2ab2-b6bd-462b-bd92-899a5d9afbc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:30.672031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff2ab2-b6bd-462b-bd92-899a5d9afbc5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:30.707122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6510f-dd4c-425f-b340-82915edb988c None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.707531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6510f-dd4c-425f-b340-82915edb988c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.707887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6510f-dd4c-425f-b340-82915edb988c None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.709922 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 866/1734] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:45:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:45:30.712448 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 869/1735] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:30 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:30.716386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6510f-dd4c-425f-b340-82915edb988c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:30.726764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff2ab2-b6bd-462b-bd92-899a5d9afbc5 admin admin] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:45:30.731517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5eff2ab2-b6bd-462b-bd92-899a5d9afbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:30.739510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6510f-dd4c-425f-b340-82915edb988c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:30.747153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891dc49-a1c3-4ca4-a885-723d8c17062c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:30.748687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891dc49-a1c3-4ca4-a885-723d8c17062c admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.750162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891dc49-a1c3-4ca4-a885-723d8c17062c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.750669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891dc49-a1c3-4ca4-a885-723d8c17062c admin admin] PATH_INFO: `/v3/projects/b5c465ec33af4d0e87c28ad2eaa2e42c/users/5a0d5f90acaa4a8e9f302362ef518d9a/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.767527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff2ab2-b6bd-462b-bd92-899a5d9afbc5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:30.771967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891dc49-a1c3-4ca4-a885-723d8c17062c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c465ec33af4d0e87c28ad2eaa2e42c, user_id=5a0d5f90acaa4a8e9f302362ef518d9a, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:30.774976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891dc49-a1c3-4ca4-a885-723d8c17062c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:30.799171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff2ab2-b6bd-462b-bd92-899a5d9afbc5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:30.799484 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 867/1736] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:30 2021] PUT /identity/v3/projects/b5c465ec33af4d0e87c28ad2eaa2e42c/users/5a0d5f90acaa4a8e9f302362ef518d9a/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:30.855691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da85ba2-968f-40c8-a623-bd08464233b5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.855982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da85ba2-968f-40c8-a623-bd08464233b5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.856260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da85ba2-968f-40c8-a623-bd08464233b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.889024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4da85ba2-968f-40c8-a623-bd08464233b5 None None] MFA Rules not processed for user `5a0d5f90acaa4a8e9f302362ef518d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:30.890277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4da85ba2-968f-40c8-a623-bd08464233b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:30.926426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3d643-f1f6-481b-85fa-e8f5653e5306 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d4e98bf3ae14b8db078278b4aa51583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f9df9b815645cbaf7edf2ff21715b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:30.927306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3d643-f1f6-481b-85fa-e8f5653e5306 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:30.927593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3d643-f1f6-481b-85fa-e8f5653e5306 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:30.927867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3d643-f1f6-481b-85fa-e8f5653e5306 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] PATH_INFO: `/v3/projects/e289b137b09743c399e30e4ffa1bab40` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:30.929097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3d643-f1f6-481b-85fa-e8f5653e5306 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorizing `identity:get_project(project_id=e289b137b09743c399e30e4ffa1bab40)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:30.943101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3d643-f1f6-481b-85fa-e8f5653e5306 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:30.946655 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 870/1737] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:45:30 2021] GET /identity/v3/projects/e289b137b09743c399e30e4ffa1bab40 => generated 393 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:45:30.947331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3d643-f1f6-481b-85fa-e8f5653e5306 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:30.949108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5fc3d643-f1f6-481b-85fa-e8f5653e5306 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:31.022773 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 868/1738] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:30 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:45:31.024524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ee97-d098-4843-9819-7d49a53b1aae None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.024816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ee97-d098-4843-9819-7d49a53b1aae None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.025097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ee97-d098-4843-9819-7d49a53b1aae None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.027460 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 869/1739] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:45:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:45:31.028134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57ee97-d098-4843-9819-7d49a53b1aae None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:31.042374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57ee97-d098-4843-9819-7d49a53b1aae None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:31.045577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3d643-f1f6-481b-85fa-e8f5653e5306 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:31.049164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5fc3-df7b-4ea8-97aa-8022f4a70edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:31.051456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5fc3-df7b-4ea8-97aa-8022f4a70edf admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.051456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5fc3-df7b-4ea8-97aa-8022f4a70edf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.051652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:31.051779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5fc3-df7b-4ea8-97aa-8022f4a70edf admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.052693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea5fc3-df7b-4ea8-97aa-8022f4a70edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:31.053028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.053388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.053736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] PATH_INFO: `/v3/users/86d5ca4bf6754884b0658d7220839f35` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.055399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea5fc3-df7b-4ea8-97aa-8022f4a70edf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:31.055510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d5ca4bf6754884b0658d7220839f35)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:31.057959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:31.102878 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 870/1740] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:31 2021] POST /identity/v3/projects => generated 397 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:31.104636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5fc3-df7b-4ea8-97aa-8022f4a70edf admin admin] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:45:31.121894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d5ca4bf6754884b0658d7220839f35'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:31.123102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d5ca4bf6754884b0658d7220839f35'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:31.135633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d5ca4bf6754884b0658d7220839f35'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:31.136640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d5ca4bf6754884b0658d7220839f35'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:31.146551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d5ca4bf6754884b0658d7220839f35'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:31.179423 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 871/1741] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:30 2021] DELETE /identity/v3/users/86d5ca4bf6754884b0658d7220839f35 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:31.181361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:31.185140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:31.207230 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5fc3-df7b-4ea8-97aa-8022f4a70edf admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 27 20:45:31.207714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5fc3-df7b-4ea8-97aa-8022f4a70edf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:31.276818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf662f-eb63-4757-911a-adb1a2d13d0c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:31.283135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266834aa-6c95-4615-9fc1-27efe57a1aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:31.283886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266834aa-6c95-4615-9fc1-27efe57a1aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.284512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266834aa-6c95-4615-9fc1-27efe57a1aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.284804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266834aa-6c95-4615-9fc1-27efe57a1aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.286240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266834aa-6c95-4615-9fc1-27efe57a1aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:31.288903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266834aa-6c95-4615-9fc1-27efe57a1aa8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:31.290309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5fc3-df7b-4ea8-97aa-8022f4a70edf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:31.316296 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 872/1742] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:31 2021] POST /identity/v3/users => generated 305 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:31.320069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266834aa-6c95-4615-9fc1-27efe57a1aa8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:31.321990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-266834aa-6c95-4615-9fc1-27efe57a1aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:31.334396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266834aa-6c95-4615-9fc1-27efe57a1aa8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:31.340621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:31.341638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.341896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.342245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] PATH_INFO: `/v3/users/3c6ba16e4d734dccab91cb1f3df6b1c2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.344749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c6ba16e4d734dccab91cb1f3df6b1c2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:31.346812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:31.360527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d70b-fd52-4455-b9ac-6cbb0d9fd3e5 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d4e98bf3ae14b8db078278b4aa51583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f9df9b815645cbaf7edf2ff21715b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:31.361605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d70b-fd52-4455-b9ac-6cbb0d9fd3e5 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.362469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d70b-fd52-4455-b9ac-6cbb0d9fd3e5 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.362828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d70b-fd52-4455-b9ac-6cbb0d9fd3e5 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] PATH_INFO: `/v3/projects/e289b137b09743c399e30e4ffa1bab40` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.364699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077d70b-fd52-4455-b9ac-6cbb0d9fd3e5 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorizing `identity:get_project(project_id=e289b137b09743c399e30e4ffa1bab40)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:31.368361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077d70b-fd52-4455-b9ac-6cbb0d9fd3e5 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:31.370740 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 871/1743] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:45:31 2021] GET /identity/v3/projects/e289b137b09743c399e30e4ffa1bab40 => generated 393 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:31.373291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c9fee-2e82-469e-8636-641ee6abc18f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.374139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c9fee-2e82-469e-8636-641ee6abc18f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.374927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c9fee-2e82-469e-8636-641ee6abc18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.399996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f24c9fee-2e82-469e-8636-641ee6abc18f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:31.402124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f24c9fee-2e82-469e-8636-641ee6abc18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:31.416099 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 872/1744] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:31.417323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c9fee-2e82-469e-8636-641ee6abc18f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:31.434382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c9fee-2e82-469e-8636-641ee6abc18f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:31.437413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c6ba16e4d734dccab91cb1f3df6b1c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:31.438137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c6ba16e4d734dccab91cb1f3df6b1c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:31.449484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e30a-765b-417f-8b92-8c0d1fdf27a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:31.449765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e30a-765b-417f-8b92-8c0d1fdf27a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.450119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e30a-765b-417f-8b92-8c0d1fdf27a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.451205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c6ba16e4d734dccab91cb1f3df6b1c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:31.452164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c6ba16e4d734dccab91cb1f3df6b1c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:31.455519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e30a-765b-417f-8b92-8c0d1fdf27a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.456545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441e30a-765b-417f-8b92-8c0d1fdf27a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:31.459182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441e30a-765b-417f-8b92-8c0d1fdf27a2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:31.477597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c6ba16e4d734dccab91cb1f3df6b1c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:31.495680 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 873/1745] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:31 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:31.495680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e30a-765b-417f-8b92-8c0d1fdf27a2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:31.501159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3441e30a-765b-417f-8b92-8c0d1fdf27a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:31.512409 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 873/1746] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:31 2021] DELETE /identity/v3/users/3c6ba16e4d734dccab91cb1f3df6b1c2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:31.516514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:31.518374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:31.604646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e30a-765b-417f-8b92-8c0d1fdf27a2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:31.605374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dcff9-0d15-403e-8751-8b7b860b0433 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:31.614816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6851042-5955-4d34-acdf-1421c7b4d6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:31.616268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6851042-5955-4d34-acdf-1421c7b4d6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.616741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6851042-5955-4d34-acdf-1421c7b4d6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.617611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6851042-5955-4d34-acdf-1421c7b4d6ba admin admin] PATH_INFO: `/v3/projects/cce9e9a7290f4bbaa87ee50fa555ad01/users/c639ab4d71ab47dd8e5e9d1ba258facd/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.636048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6851042-5955-4d34-acdf-1421c7b4d6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce9e9a7290f4bbaa87ee50fa555ad01, user_id=c639ab4d71ab47dd8e5e9d1ba258facd, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:31.639595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6851042-5955-4d34-acdf-1421c7b4d6ba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:31.655097 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 874/1747] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:31 2021] PUT /identity/v3/projects/cce9e9a7290f4bbaa87ee50fa555ad01/users/c639ab4d71ab47dd8e5e9d1ba258facd/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:31.656695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66781f-ecc4-4580-8111-146a7b997baf None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.657079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66781f-ecc4-4580-8111-146a7b997baf None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.657457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66781f-ecc4-4580-8111-146a7b997baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.686751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6d66781f-ecc4-4580-8111-146a7b997baf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:31.686751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6d66781f-ecc4-4580-8111-146a7b997baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:31.703151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ef019-6e75-4d80-85c1-d477571a3125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:31.705536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ef019-6e75-4d80-85c1-d477571a3125 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.705825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ef019-6e75-4d80-85c1-d477571a3125 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.706471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ef019-6e75-4d80-85c1-d477571a3125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.711007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-798ef019-6e75-4d80-85c1-d477571a3125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:31.724130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ef019-6e75-4d80-85c1-d477571a3125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:31.727113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ef019-6e75-4d80-85c1-d477571a3125 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:31.745194 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 874/1748] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:31.747995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ef019-6e75-4d80-85c1-d477571a3125 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:31.761376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ef019-6e75-4d80-85c1-d477571a3125 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:31.795500 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 875/1749] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:31.803980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66781f-ecc4-4580-8111-146a7b997baf None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:31.805495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6d66781f-ecc4-4580-8111-146a7b997baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:31.874507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b9f87-87aa-4970-9749-3d7e8a6828db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:31.874691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66781f-ecc4-4580-8111-146a7b997baf None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:31.875294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9f87-87aa-4970-9749-3d7e8a6828db admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.875594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9f87-87aa-4970-9749-3d7e8a6828db admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.875926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9f87-87aa-4970-9749-3d7e8a6828db admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.876745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b9f87-87aa-4970-9749-3d7e8a6828db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:31.878575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b9f87-87aa-4970-9749-3d7e8a6828db admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:31.879793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f2320-35ec-4042-8d6f-4d3d41076312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:31.880763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f2320-35ec-4042-8d6f-4d3d41076312 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.881206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f2320-35ec-4042-8d6f-4d3d41076312 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.881745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f2320-35ec-4042-8d6f-4d3d41076312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.891420 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 875/1750] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:31 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:31.891420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b9f87-87aa-4970-9749-3d7e8a6828db admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:31.891420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-928b9f87-87aa-4970-9749-3d7e8a6828db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:31.896941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f2320-35ec-4042-8d6f-4d3d41076312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:31.898746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f2320-35ec-4042-8d6f-4d3d41076312 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:31.920927 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 876/1751] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:31.922171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f2320-35ec-4042-8d6f-4d3d41076312 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:31.951025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f2320-35ec-4042-8d6f-4d3d41076312 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:31.966040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43f57e-cf9d-4cf3-a391-e3eb8808463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:31.967366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f57e-cf9d-4cf3-a391-e3eb8808463b admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:31.968041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f57e-cf9d-4cf3-a391-e3eb8808463b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:31.968783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f57e-cf9d-4cf3-a391-e3eb8808463b admin admin] PATH_INFO: `/v3/projects/cce9e9a7290f4bbaa87ee50fa555ad01/users/c639ab4d71ab47dd8e5e9d1ba258facd/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:31.974326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43f57e-cf9d-4cf3-a391-e3eb8808463b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce9e9a7290f4bbaa87ee50fa555ad01, user_id=c639ab4d71ab47dd8e5e9d1ba258facd, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:31.977305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43f57e-cf9d-4cf3-a391-e3eb8808463b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:32.015972 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 877/1752] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:31 2021] PUT /identity/v3/projects/cce9e9a7290f4bbaa87ee50fa555ad01/users/c639ab4d71ab47dd8e5e9d1ba258facd/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:32.017788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ff0f8-11e8-4716-898d-d2863e7314e2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:32.018538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ff0f8-11e8-4716-898d-d2863e7314e2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:32.018865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ff0f8-11e8-4716-898d-d2863e7314e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:32.056747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b9f87-87aa-4970-9749-3d7e8a6828db admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:32.075100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-458ff0f8-11e8-4716-898d-d2863e7314e2 None None] MFA Rules not processed for user `c639ab4d71ab47dd8e5e9d1ba258facd`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:32.076764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-458ff0f8-11e8-4716-898d-d2863e7314e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:32.181704 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 878/1753] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:32 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:32.182890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ff0f8-11e8-4716-898d-d2863e7314e2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:32.195698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-458ff0f8-11e8-4716-898d-d2863e7314e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:32.199095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65661f55-2447-4c5a-bcca-ca7bba6030b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:32.200136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65661f55-2447-4c5a-bcca-ca7bba6030b6 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:32.200422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65661f55-2447-4c5a-bcca-ca7bba6030b6 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:32.200698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65661f55-2447-4c5a-bcca-ca7bba6030b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:32.203320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-65661f55-2447-4c5a-bcca-ca7bba6030b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:32.277276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ff0f8-11e8-4716-898d-d2863e7314e2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:32.283454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:32.284353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:32.284655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:32.284916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] PATH_INFO: `/v3/projects/b8bfde4517ef43ac9022f3d7be7b1c8f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:32.286163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8bfde4517ef43ac9022f3d7be7b1c8f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:32.288714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:32.295012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65661f55-2447-4c5a-bcca-ca7bba6030b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:32.297340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65661f55-2447-4c5a-bcca-ca7bba6030b6 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:32.319535 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 876/1754] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:31 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:32.322560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65661f55-2447-4c5a-bcca-ca7bba6030b6 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:32.336222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-65661f55-2447-4c5a-bcca-ca7bba6030b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:32.352496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65661f55-2447-4c5a-bcca-ca7bba6030b6 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:32.355891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8bfde4517ef43ac9022f3d7be7b1c8f', 'request_id': 'req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.362900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8bfde4517ef43ac9022f3d7be7b1c8f', 'request_id': 'req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.378461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8bfde4517ef43ac9022f3d7be7b1c8f', 'request_id': 'req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.393073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] The token cache is being invalidate because project b8bfde4517ef43ac9022f3d7be7b1c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:32.393369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.394022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.396695 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 879/1755] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:32 2021] DELETE /identity/v3/projects/b8bfde4517ef43ac9022f3d7be7b1c8f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:32.401433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:32.402994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:32.533284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfd60a-e05c-4964-916d-ccaa9468a849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:32.533953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfd60a-e05c-4964-916d-ccaa9468a849 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:32.534238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfd60a-e05c-4964-916d-ccaa9468a849 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:32.534722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfd60a-e05c-4964-916d-ccaa9468a849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:32.536556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1abfd60a-e05c-4964-916d-ccaa9468a849 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:32.538514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493c8c9-5adb-4201-9f42-f2d0ccd738e2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:32.546981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:32.549317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:32.550191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:32.550510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] PATH_INFO: `/v3/users/5344f119b8584fecaa6efdc43cc6c674` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:32.552138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5344f119b8584fecaa6efdc43cc6c674)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:32.578384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:32.639994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5344f119b8584fecaa6efdc43cc6c674'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.640784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5344f119b8584fecaa6efdc43cc6c674'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.647088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfd60a-e05c-4964-916d-ccaa9468a849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:32.648803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfd60a-e05c-4964-916d-ccaa9468a849 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:32.651675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5344f119b8584fecaa6efdc43cc6c674'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.653179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5344f119b8584fecaa6efdc43cc6c674'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.659274 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 877/1756] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:32 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:32.660851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e7e1f-6f60-4e4a-b943-24c61bae1581 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:32.661345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e7e1f-6f60-4e4a-b943-24c61bae1581 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:32.661821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e7e1f-6f60-4e4a-b943-24c61bae1581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:32.663128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5344f119b8584fecaa6efdc43cc6c674'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.688090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-523e7e1f-6f60-4e4a-b943-24c61bae1581 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:32.689550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-523e7e1f-6f60-4e4a-b943-24c61bae1581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:32.697889 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 880/1757] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:32 2021] DELETE /identity/v3/users/5344f119b8584fecaa6efdc43cc6c674 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:32.698990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:32.700456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:32.761964 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 878/1758] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:45:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:32.768469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b9f13-573e-4c29-98aa-012b7586646a None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:32.769012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b9f13-573e-4c29-98aa-012b7586646a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:32.770745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b9f13-573e-4c29-98aa-012b7586646a None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:32.783839 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 879/1759] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:45:32 2021] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:45:32.785126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b9f13-573e-4c29-98aa-012b7586646a None None] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:45:32.789134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-623b9f13-573e-4c29-98aa-012b7586646a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:32.828164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e382b1-12ec-462d-b155-7cbcf6cb18fa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:32.834150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:32.835585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:32.835871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:32.836433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] PATH_INFO: `/v3/projects/0941d60be210490fb2c7c5ecd7226447` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:32.837991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0941d60be210490fb2c7c5ecd7226447)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:32.841453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:32.908315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0941d60be210490fb2c7c5ecd7226447', 'request_id': 'req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.915561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b9f13-573e-4c29-98aa-012b7586646a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:32.915899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0941d60be210490fb2c7c5ecd7226447', 'request_id': 'req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.917062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-623b9f13-573e-4c29-98aa-012b7586646a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:32.927791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0941d60be210490fb2c7c5ecd7226447', 'request_id': 'req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.954502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] The token cache is being invalidate because project 0941d60be210490fb2c7c5ecd7226447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:32.955175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.955833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4ca0dfd0-ffdb-43e5-a789-ec115bdc09ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:32.959778 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 881/1760] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:32 2021] DELETE /identity/v3/projects/0941d60be210490fb2c7c5ecd7226447 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:32.963168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce749940-6071-43a1-ae87-023ddc3118ea None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:32.963168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce749940-6071-43a1-ae87-023ddc3118ea None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:32.963168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce749940-6071-43a1-ae87-023ddc3118ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:32.986483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ce749940-6071-43a1-ae87-023ddc3118ea None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:32.988442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ce749940-6071-43a1-ae87-023ddc3118ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:33.043781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b9f13-573e-4c29-98aa-012b7586646a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:33.077605 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 882/1761] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:45:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:33.078967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce749940-6071-43a1-ae87-023ddc3118ea None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:33.081097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ce749940-6071-43a1-ae87-023ddc3118ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:33.131955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c0103-f947-4775-a832-13b98ca56422 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d4e98bf3ae14b8db078278b4aa51583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f9df9b815645cbaf7edf2ff21715b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:33.133825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c0103-f947-4775-a832-13b98ca56422 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:33.134283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c0103-f947-4775-a832-13b98ca56422 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:33.134695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c0103-f947-4775-a832-13b98ca56422 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] PATH_INFO: `/v3/projects/e289b137b09743c399e30e4ffa1bab40` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:33.136915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c0103-f947-4775-a832-13b98ca56422 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorizing `identity:get_project(project_id=e289b137b09743c399e30e4ffa1bab40)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:33.139769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c0103-f947-4775-a832-13b98ca56422 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:33.142187 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 880/1762] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:45:32 2021] GET /identity/v3/projects/e289b137b09743c399e30e4ffa1bab40 => generated 393 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:33.142784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c0103-f947-4775-a832-13b98ca56422 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:33.144540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-553c0103-f947-4775-a832-13b98ca56422 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:33.214985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce749940-6071-43a1-ae87-023ddc3118ea None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:33.238733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:33.240001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:33.240284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:33.240559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] PATH_INFO: `/v3/users/5f3f073e308d4e83aeacd88583fb5960` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:33.241773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3f073e308d4e83aeacd88583fb5960)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:33.243778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:33.251746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c0103-f947-4775-a832-13b98ca56422 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:33.259611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48121bb0-93d4-4b26-9e99-87f201f13f5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:33.260874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48121bb0-93d4-4b26-9e99-87f201f13f5f service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:33.261166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48121bb0-93d4-4b26-9e99-87f201f13f5f service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:33.261439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48121bb0-93d4-4b26-9e99-87f201f13f5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:33.272120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-48121bb0-93d4-4b26-9e99-87f201f13f5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:33.298821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48121bb0-93d4-4b26-9e99-87f201f13f5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:33.299973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3f073e308d4e83aeacd88583fb5960'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:33.300333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48121bb0-93d4-4b26-9e99-87f201f13f5f service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:33.300647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3f073e308d4e83aeacd88583fb5960'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:33.314501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3f073e308d4e83aeacd88583fb5960'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:33.315146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3f073e308d4e83aeacd88583fb5960'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:33.316953 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 881/1763] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:45:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:33.317982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48121bb0-93d4-4b26-9e99-87f201f13f5f service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:33.319311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-48121bb0-93d4-4b26-9e99-87f201f13f5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:33.334185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3f073e308d4e83aeacd88583fb5960'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:33.363874 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 883/1764] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:33 2021] DELETE /identity/v3/users/5f3f073e308d4e83aeacd88583fb5960 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:33.367616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:33.369016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:33.470065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48121bb0-93d4-4b26-9e99-87f201f13f5f service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:33.516250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4d382-5af9-4fd7-b310-0a1dd2238fe2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:33.531735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee0f5e-a980-4369-9aec-01b05cddce84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:33.536421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0f5e-a980-4369-9aec-01b05cddce84 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:33.536892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0f5e-a980-4369-9aec-01b05cddce84 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:33.537924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0f5e-a980-4369-9aec-01b05cddce84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:33.547590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-77ee0f5e-a980-4369-9aec-01b05cddce84 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:33.577170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecdecb-1824-4c41-bd47-c804e3ac9082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:33.578292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecdecb-1824-4c41-bd47-c804e3ac9082 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:33.578756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecdecb-1824-4c41-bd47-c804e3ac9082 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:33.579204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecdecb-1824-4c41-bd47-c804e3ac9082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:33.586027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f6ecdecb-1824-4c41-bd47-c804e3ac9082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:33.710930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecdecb-1824-4c41-bd47-c804e3ac9082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:33.712769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecdecb-1824-4c41-bd47-c804e3ac9082 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:33.725029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee0f5e-a980-4369-9aec-01b05cddce84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:33.735317 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 882/1765] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:33 2021] GET /identity/v3/auth/tokens => generated 3331 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:33.738828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee0f5e-a980-4369-9aec-01b05cddce84 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:33.739550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecdecb-1824-4c41-bd47-c804e3ac9082 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:33.741490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f6ecdecb-1824-4c41-bd47-c804e3ac9082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:33.805936 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 884/1766] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:45:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:45:33.808850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559361aa-80c1-4990-bc01-1df377822f33 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:33.809143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559361aa-80c1-4990-bc01-1df377822f33 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:33.809421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559361aa-80c1-4990-bc01-1df377822f33 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:33.821239 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 885/1767] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:45:33 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:45:33.828522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559361aa-80c1-4990-bc01-1df377822f33 None None] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:45:33.830619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-559361aa-80c1-4990-bc01-1df377822f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:33.873274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559361aa-80c1-4990-bc01-1df377822f33 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:33.876072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-559361aa-80c1-4990-bc01-1df377822f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:33.912938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecdecb-1824-4c41-bd47-c804e3ac9082 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:33.934666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:33.937239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:33.939380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:33.940235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] PATH_INFO: `/v3/projects/39b6d05f5755471cb3861cf371120430` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:33.946891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b6d05f5755471cb3861cf371120430)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:33.952572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:34.007917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559361aa-80c1-4990-bc01-1df377822f33 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:34.014464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7a2f6-8a79-4e40-b33d-3a5542626f46 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d4e98bf3ae14b8db078278b4aa51583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f9df9b815645cbaf7edf2ff21715b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:34.015953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7a2f6-8a79-4e40-b33d-3a5542626f46 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:34.016237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7a2f6-8a79-4e40-b33d-3a5542626f46 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:34.016591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7a2f6-8a79-4e40-b33d-3a5542626f46 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] PATH_INFO: `/v3/projects/e289b137b09743c399e30e4ffa1bab40` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:34.018735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7a2f6-8a79-4e40-b33d-3a5542626f46 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorizing `identity:get_project(project_id=e289b137b09743c399e30e4ffa1bab40)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:34.021719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7a2f6-8a79-4e40-b33d-3a5542626f46 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:34.024647 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 886/1768] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:45:33 2021] GET /identity/v3/projects/e289b137b09743c399e30e4ffa1bab40 => generated 393 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:34.109720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7a2f6-8a79-4e40-b33d-3a5542626f46 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:34.111771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3da7a2f6-8a79-4e40-b33d-3a5542626f46 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:34.140495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7a2f6-8a79-4e40-b33d-3a5542626f46 tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:34.165449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b6d05f5755471cb3861cf371120430', 'request_id': 'req-7d61d6ff-8361-4501-a510-e7663fed2997'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.222012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b6d05f5755471cb3861cf371120430', 'request_id': 'req-7d61d6ff-8361-4501-a510-e7663fed2997'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.276808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b6d05f5755471cb3861cf371120430', 'request_id': 'req-7d61d6ff-8361-4501-a510-e7663fed2997'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.365557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] The token cache is being invalidate because project 39b6d05f5755471cb3861cf371120430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:34.367575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.374253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7d61d6ff-8361-4501-a510-e7663fed2997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.382956 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 883/1769] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:33 2021] DELETE /identity/v3/projects/39b6d05f5755471cb3861cf371120430 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:34.394716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedcf7f-6135-48b5-9633-092ebcabb614 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:34.396676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedcf7f-6135-48b5-9633-092ebcabb614 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:34.398538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedcf7f-6135-48b5-9633-092ebcabb614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:34.447912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:34.450738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:34.451075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:34.452034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] PATH_INFO: `/v3/projects/fc2eb222702c4da588deaf85f4b064a5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:34.453486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-eaedcf7f-6135-48b5-9633-092ebcabb614 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:34.461703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-eaedcf7f-6135-48b5-9633-092ebcabb614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:34.462427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2eb222702c4da588deaf85f4b064a5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:34.467801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:34.492812 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 884/1770] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:34.542672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedcf7f-6135-48b5-9633-092ebcabb614 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:34.544205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-eaedcf7f-6135-48b5-9633-092ebcabb614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:34.573785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedcf7f-6135-48b5-9633-092ebcabb614 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:34.587929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:34.588778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:34.589070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:34.589404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] PATH_INFO: `/v3/users/5a0d5f90acaa4a8e9f302362ef518d9a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:34.593955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0d5f90acaa4a8e9f302362ef518d9a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:34.598008 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:45:34.598008 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:45:34.598008 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:45:34.599337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:34.710057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2eb222702c4da588deaf85f4b064a5', 'request_id': 'req-6d616e0d-2468-479c-b88d-e64005ef3bf4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.726004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2eb222702c4da588deaf85f4b064a5', 'request_id': 'req-6d616e0d-2468-479c-b88d-e64005ef3bf4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.743784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2eb222702c4da588deaf85f4b064a5', 'request_id': 'req-6d616e0d-2468-479c-b88d-e64005ef3bf4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.756969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0d5f90acaa4a8e9f302362ef518d9a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.770713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0d5f90acaa4a8e9f302362ef518d9a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.771515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0d5f90acaa4a8e9f302362ef518d9a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.772241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] The token cache is being invalidate because project fc2eb222702c4da588deaf85f4b064a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:34.772815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.773765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d616e0d-2468-479c-b88d-e64005ef3bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.782487 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 887/1771] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:34 2021] DELETE /identity/v3/projects/fc2eb222702c4da588deaf85f4b064a5 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:34.784760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2f0f4-6300-4b6b-93d6-dfce63bb85b1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:34.785126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2f0f4-6300-4b6b-93d6-dfce63bb85b1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:34.785635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2f0f4-6300-4b6b-93d6-dfce63bb85b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:34.795917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0d5f90acaa4a8e9f302362ef518d9a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.833799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f920d3ae-1adc-496c-9c28-2e8a6eb58d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0d5f90acaa4a8e9f302362ef518d9a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:34.846314 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 885/1772] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:34 2021] DELETE /identity/v3/users/5a0d5f90acaa4a8e9f302362ef518d9a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:45:34.847831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435ad14-6eec-40f9-9c62-3708f4b10cb5 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:34.848221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435ad14-6eec-40f9-9c62-3708f4b10cb5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:34.848812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435ad14-6eec-40f9-9c62-3708f4b10cb5 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:34.851675 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 886/1773] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:45:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:45:34.853016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d01ba-e503-4d63-962d-e2c17840cd58 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:34.853999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d01ba-e503-4d63-962d-e2c17840cd58 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:34.854288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d01ba-e503-4d63-962d-e2c17840cd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:34.857252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-62c2f0f4-6300-4b6b-93d6-dfce63bb85b1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:34.859432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-62c2f0f4-6300-4b6b-93d6-dfce63bb85b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:34.880018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ff6d01ba-e503-4d63-962d-e2c17840cd58 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:34.881444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ff6d01ba-e503-4d63-962d-e2c17840cd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:35.003502 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 887/1774] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:35.005184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e61c3-1a2c-456c-88e7-73b3851d1d4b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:35.005651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e61c3-1a2c-456c-88e7-73b3851d1d4b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:35.005943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e61c3-1a2c-456c-88e7-73b3851d1d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:35.034969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-480e61c3-1a2c-456c-88e7-73b3851d1d4b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:35.036428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-480e61c3-1a2c-456c-88e7-73b3851d1d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:35.084964 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 888/1775] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:35.086005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2f0f4-6300-4b6b-93d6-dfce63bb85b1 None None] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:45:35.087929 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 888/1776] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:35.090067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-62c2f0f4-6300-4b6b-93d6-dfce63bb85b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:35.091337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f402-7a47-4b2f-bc3f-34d70e82f541 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:35.098284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f402-7a47-4b2f-bc3f-34d70e82f541 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:35.098855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54f402-7a47-4b2f-bc3f-34d70e82f541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:35.136928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fd54f402-7a47-4b2f-bc3f-34d70e82f541 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:35.140391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fd54f402-7a47-4b2f-bc3f-34d70e82f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:35.161644 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 889/1777] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:35.163410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54f402-7a47-4b2f-bc3f-34d70e82f541 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:35.185703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54f402-7a47-4b2f-bc3f-34d70e82f541 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:35.208840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e52af-2d76-4bf8-b219-fa5bbf55a068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:35.209768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e52af-2d76-4bf8-b219-fa5bbf55a068 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:35.210037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e52af-2d76-4bf8-b219-fa5bbf55a068 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:35.210302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e52af-2d76-4bf8-b219-fa5bbf55a068 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:35.211217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e52af-2d76-4bf8-b219-fa5bbf55a068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:35.211570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e52af-2d76-4bf8-b219-fa5bbf55a068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:35.216526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e52af-2d76-4bf8-b219-fa5bbf55a068 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:35.240827 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 890/1778] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:35.242474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e52af-2d76-4bf8-b219-fa5bbf55a068 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:35.246088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-529e52af-2d76-4bf8-b219-fa5bbf55a068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:35.288812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2f0f4-6300-4b6b-93d6-dfce63bb85b1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:35.292310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-62c2f0f4-6300-4b6b-93d6-dfce63bb85b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:35.379608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e52af-2d76-4bf8-b219-fa5bbf55a068 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:35.389382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98c24e-1638-40b2-8e98-08015203d6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:35.392253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98c24e-1638-40b2-8e98-08015203d6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:35.392659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98c24e-1638-40b2-8e98-08015203d6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:35.393193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98c24e-1638-40b2-8e98-08015203d6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:35.433767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98c24e-1638-40b2-8e98-08015203d6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:35.436927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98c24e-1638-40b2-8e98-08015203d6c5 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:35.460644 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 891/1779] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:35.461604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98c24e-1638-40b2-8e98-08015203d6c5 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:35.469498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2f0f4-6300-4b6b-93d6-dfce63bb85b1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:35.487761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98c24e-1638-40b2-8e98-08015203d6c5 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:35.496934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065b76e-bafa-4482-9b8b-6dc23fb93dbc tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d4e98bf3ae14b8db078278b4aa51583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56f9df9b815645cbaf7edf2ff21715b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:35.497970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b76e-bafa-4482-9b8b-6dc23fb93dbc tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:35.499543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b76e-bafa-4482-9b8b-6dc23fb93dbc tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:35.499937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065b76e-bafa-4482-9b8b-6dc23fb93dbc tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] PATH_INFO: `/v3/projects/ad21beb2525548d0b8ebb140ddae2375` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:35.503040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065b76e-bafa-4482-9b8b-6dc23fb93dbc tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorizing `identity:get_project(project_id=ad21beb2525548d0b8ebb140ddae2375)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:35.503726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368a87d-e8b5-4616-9fce-990eac33bb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:35.504463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368a87d-e8b5-4616-9fce-990eac33bb42 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:35.504749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368a87d-e8b5-4616-9fce-990eac33bb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:35.505066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368a87d-e8b5-4616-9fce-990eac33bb42 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:35.505899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368a87d-e8b5-4616-9fce-990eac33bb42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:35.506264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368a87d-e8b5-4616-9fce-990eac33bb42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:35.508902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368a87d-e8b5-4616-9fce-990eac33bb42 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:35.509724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065b76e-bafa-4482-9b8b-6dc23fb93dbc tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:35.519435 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 889/1780] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:45:35 2021] GET /identity/v3/projects/ad21beb2525548d0b8ebb140ddae2375 => generated 393 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:35.521697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065b76e-bafa-4482-9b8b-6dc23fb93dbc tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:35.560226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065b76e-bafa-4482-9b8b-6dc23fb93dbc tempest-FlavorsAccessNegativeTestJSON-658927534 tempest-FlavorsAccessNegativeTestJSON-658927534-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:35.571965 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 892/1781] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:35.575718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdcef9-c93d-45fd-a36e-995ef7f28866 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:35.576859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fa545-041a-474d-afc8-36a8aa97a8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:35.577357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdcef9-c93d-45fd-a36e-995ef7f28866 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:35.578038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fa545-041a-474d-afc8-36a8aa97a8ea admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:35.578418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fa545-041a-474d-afc8-36a8aa97a8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:35.578793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fa545-041a-474d-afc8-36a8aa97a8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:35.579646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fa545-041a-474d-afc8-36a8aa97a8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:35.580955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdcef9-c93d-45fd-a36e-995ef7f28866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:35.583165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fa545-041a-474d-afc8-36a8aa97a8ea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:35.669420 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 890/1782] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:35 2021] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:35.682670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fa545-041a-474d-afc8-36a8aa97a8ea admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:35.821040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f6cdcef9-c93d-45fd-a36e-995ef7f28866 None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:35.828537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f6cdcef9-c93d-45fd-a36e-995ef7f28866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:36.001261 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 893/1783] 10.222.0.35 () {58 vars in 1015 bytes} [Sat Nov 27 20:45:35 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:36.001394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fa545-041a-474d-afc8-36a8aa97a8ea admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:36.002634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdcef9-c93d-45fd-a36e-995ef7f28866 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:36.036878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998670e-e636-42fe-bb3c-c5e0a361612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:36.040421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdcef9-c93d-45fd-a36e-995ef7f28866 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:36.049184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998670e-e636-42fe-bb3c-c5e0a361612a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.051558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998670e-e636-42fe-bb3c-c5e0a361612a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.052150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998670e-e636-42fe-bb3c-c5e0a361612a admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.053896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998670e-e636-42fe-bb3c-c5e0a361612a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:36.062164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cbd9a-90e7-47c3-b00f-54acbe46feac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:36.063430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cbd9a-90e7-47c3-b00f-54acbe46feac admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.063944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cbd9a-90e7-47c3-b00f-54acbe46feac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.064443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cbd9a-90e7-47c3-b00f-54acbe46feac admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.066407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cbd9a-90e7-47c3-b00f-54acbe46feac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:36.075287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7cbd9a-90e7-47c3-b00f-54acbe46feac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:36.076567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998670e-e636-42fe-bb3c-c5e0a361612a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:36.145254 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 894/1784] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:36 2021] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:36.146459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cbd9a-90e7-47c3-b00f-54acbe46feac admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:36.148458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8b7cbd9a-90e7-47c3-b00f-54acbe46feac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:36.154140 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 891/1785] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:35 2021] POST /identity/v3/projects => generated 389 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:36.158090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998670e-e636-42fe-bb3c-c5e0a361612a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:36.164191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1998670e-e636-42fe-bb3c-c5e0a361612a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:36.166623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cbd9a-90e7-47c3-b00f-54acbe46feac admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:36.269659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:36.271536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998670e-e636-42fe-bb3c-c5e0a361612a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:36.271708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.271708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.274121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] PATH_INFO: `/v3/users/2225ee361ad844ff91886aa430272b04` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.274121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2225ee361ad844ff91886aa430272b04)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:36.276510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:36.278421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a41bad-af8d-4bc8-9c2f-ed7d0a047628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:36.279233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a41bad-af8d-4bc8-9c2f-ed7d0a047628 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.279541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a41bad-af8d-4bc8-9c2f-ed7d0a047628 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.279814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a41bad-af8d-4bc8-9c2f-ed7d0a047628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.302566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a41bad-af8d-4bc8-9c2f-ed7d0a047628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:36.303499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a41bad-af8d-4bc8-9c2f-ed7d0a047628 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:36.321450 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 892/1786] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:36 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:36.322388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a41bad-af8d-4bc8-9c2f-ed7d0a047628 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:36.358114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a41bad-af8d-4bc8-9c2f-ed7d0a047628 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:36.358114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f75ed-5e59-4782-80a7-a619e6203160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:36.358114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f75ed-5e59-4782-80a7-a619e6203160 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.358114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f75ed-5e59-4782-80a7-a619e6203160 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.358772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f75ed-5e59-4782-80a7-a619e6203160 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.358772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f75ed-5e59-4782-80a7-a619e6203160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:36.358772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f75ed-5e59-4782-80a7-a619e6203160 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:36.399346 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 893/1787] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:36 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:36.400619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f75ed-5e59-4782-80a7-a619e6203160 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:36.414078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f75ed-5e59-4782-80a7-a619e6203160 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:36.421383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb9193-4ec2-41dc-9148-9014459ead9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:36.422822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9193-4ec2-41dc-9148-9014459ead9f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.423312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9193-4ec2-41dc-9148-9014459ead9f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.423857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9193-4ec2-41dc-9148-9014459ead9f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.424732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb9193-4ec2-41dc-9148-9014459ead9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:36.427625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb9193-4ec2-41dc-9148-9014459ead9f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:36.476288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2225ee361ad844ff91886aa430272b04'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:36.492184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2225ee361ad844ff91886aa430272b04'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:36.494341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2225ee361ad844ff91886aa430272b04'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:36.502053 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 894/1788] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:36 2021] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:36.506351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb9193-4ec2-41dc-9148-9014459ead9f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:36.512911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b9eb9193-4ec2-41dc-9148-9014459ead9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:36.513883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2225ee361ad844ff91886aa430272b04'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:36.534830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb9193-4ec2-41dc-9148-9014459ead9f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:36.548554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2225ee361ad844ff91886aa430272b04'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:36.549297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:36.550357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.550786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.551318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] PATH_INFO: `/v3/projects/b5c465ec33af4d0e87c28ad2eaa2e42c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.552987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c465ec33af4d0e87c28ad2eaa2e42c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:36.555440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:36.564476 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 895/1789] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:36 2021] DELETE /identity/v3/users/2225ee361ad844ff91886aa430272b04 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:36.568375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:36.572204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:36.663879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c465ec33af4d0e87c28ad2eaa2e42c', 'request_id': 'req-d4e05d64-dd85-4294-bd0f-cfba70c58adf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:36.672473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c465ec33af4d0e87c28ad2eaa2e42c', 'request_id': 'req-d4e05d64-dd85-4294-bd0f-cfba70c58adf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:36.691927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c465ec33af4d0e87c28ad2eaa2e42c', 'request_id': 'req-d4e05d64-dd85-4294-bd0f-cfba70c58adf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:36.729375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] The token cache is being invalidate because project b5c465ec33af4d0e87c28ad2eaa2e42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:36.730061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:36.731133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4e05d64-dd85-4294-bd0f-cfba70c58adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:36.733313 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 895/1790] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:36 2021] DELETE /identity/v3/projects/b5c465ec33af4d0e87c28ad2eaa2e42c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:36.734873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb4c7f-ac51-478c-820d-b7274be3b7cb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.735665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb4c7f-ac51-478c-820d-b7274be3b7cb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.736160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb4c7f-ac51-478c-820d-b7274be3b7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.777378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-06cb4c7f-ac51-478c-820d-b7274be3b7cb None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:36.779824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-06cb4c7f-ac51-478c-820d-b7274be3b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:36.783466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26affe4-426d-4078-9e77-5700ff1ad5b0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:36.873821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e60ac9-ee13-4414-a390-444b1b96535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:36.875007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e60ac9-ee13-4414-a390-444b1b96535a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.875436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e60ac9-ee13-4414-a390-444b1b96535a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.875953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e60ac9-ee13-4414-a390-444b1b96535a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.876675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e60ac9-ee13-4414-a390-444b1b96535a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:36.878519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e60ac9-ee13-4414-a390-444b1b96535a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:36.880015 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 896/1791] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Nov 27 20:45:36 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:36.881687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb4c7f-ac51-478c-820d-b7274be3b7cb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:36.884189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-06cb4c7f-ac51-478c-820d-b7274be3b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:36.895503 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 896/1792] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:36 2021] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:36.897574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675158fa-ffb7-4bea-9f28-d4ce4e779ab4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.898082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675158fa-ffb7-4bea-9f28-d4ce4e779ab4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.899143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675158fa-ffb7-4bea-9f28-d4ce4e779ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.905369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb4c7f-ac51-478c-820d-b7274be3b7cb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:36.911474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef744-e3f0-4496-a67e-c4cfa2b34bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:36.912630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef744-e3f0-4496-a67e-c4cfa2b34bbd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.912919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef744-e3f0-4496-a67e-c4cfa2b34bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.913203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef744-e3f0-4496-a67e-c4cfa2b34bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.914469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ef744-e3f0-4496-a67e-c4cfa2b34bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:36.916256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ef744-e3f0-4496-a67e-c4cfa2b34bbd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:36.921766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-675158fa-ffb7-4bea-9f28-d4ce4e779ab4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:36.923455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-675158fa-ffb7-4bea-9f28-d4ce4e779ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:36.933741 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 897/1793] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:36.934651 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 897/1794] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:36 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:36.935138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675158fa-ffb7-4bea-9f28-d4ce4e779ab4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:36.935643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef744-e3f0-4496-a67e-c4cfa2b34bbd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:36.938052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-040ef744-e3f0-4496-a67e-c4cfa2b34bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:36.944294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-675158fa-ffb7-4bea-9f28-d4ce4e779ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:36.957653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675158fa-ffb7-4bea-9f28-d4ce4e779ab4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:36.957839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef744-e3f0-4496-a67e-c4cfa2b34bbd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:36.963894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:36.965292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.965874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.966547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] PATH_INFO: `/v3/users/c639ab4d71ab47dd8e5e9d1ba258facd` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.967933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22c217-52ec-4c75-995b-e13542386758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:36.968301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c639ab4d71ab47dd8e5e9d1ba258facd)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:36.969034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c217-52ec-4c75-995b-e13542386758 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:36.969360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c217-52ec-4c75-995b-e13542386758 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:36.969640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c217-52ec-4c75-995b-e13542386758 admin admin] PATH_INFO: `/v3/projects/23c387d34d9c441e875c00ad005d1e93/users/569e6617c02144fd84b26fcf75b60422/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:36.971082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:37.016012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22c217-52ec-4c75-995b-e13542386758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c387d34d9c441e875c00ad005d1e93, user_id=569e6617c02144fd84b26fcf75b60422, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:37.024022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22c217-52ec-4c75-995b-e13542386758 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:37.065519 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 898/1795] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:36 2021] PUT /identity/v3/projects/23c387d34d9c441e875c00ad005d1e93/users/569e6617c02144fd84b26fcf75b60422/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:37.067636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22c217-52ec-4c75-995b-e13542386758 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:37.073414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c639ab4d71ab47dd8e5e9d1ba258facd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:37.080460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fc22c217-52ec-4c75-995b-e13542386758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:37.093178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c639ab4d71ab47dd8e5e9d1ba258facd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:37.094323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c639ab4d71ab47dd8e5e9d1ba258facd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:37.107975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c639ab4d71ab47dd8e5e9d1ba258facd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:37.147217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c639ab4d71ab47dd8e5e9d1ba258facd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:37.168543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22c217-52ec-4c75-995b-e13542386758 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:37.172375 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 898/1796] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:36 2021] DELETE /identity/v3/users/c639ab4d71ab47dd8e5e9d1ba258facd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:37.173577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:37.177452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:37.259475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976a7e-3d8a-4c99-a996-4be32718bfe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:37.263213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976a7e-3d8a-4c99-a996-4be32718bfe7 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:37.263474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976a7e-3d8a-4c99-a996-4be32718bfe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:37.263904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976a7e-3d8a-4c99-a996-4be32718bfe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:37.266241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d2976a7e-3d8a-4c99-a996-4be32718bfe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:37.293550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976a7e-3d8a-4c99-a996-4be32718bfe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:37.302622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976a7e-3d8a-4c99-a996-4be32718bfe7 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:37.319414 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 899/1797] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:37.320274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976a7e-3d8a-4c99-a996-4be32718bfe7 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:37.322057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d2976a7e-3d8a-4c99-a996-4be32718bfe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:37.339902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976a7e-3d8a-4c99-a996-4be32718bfe7 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:37.346614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571a8f2-aaa2-4dba-9192-579aa9c39d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:37.348193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571a8f2-aaa2-4dba-9192-579aa9c39d21 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:37.348524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571a8f2-aaa2-4dba-9192-579aa9c39d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:37.348832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571a8f2-aaa2-4dba-9192-579aa9c39d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:37.351900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5571a8f2-aaa2-4dba-9192-579aa9c39d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:37.398270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc1a2b-6ea7-40c6-a84f-3c9c4a03830b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:37.412060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3c74d-ad91-48cb-9347-2b8236ed96d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:37.415390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3c74d-ad91-48cb-9347-2b8236ed96d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:37.415744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3c74d-ad91-48cb-9347-2b8236ed96d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:37.416026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3c74d-ad91-48cb-9347-2b8236ed96d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:37.418076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3c74d-ad91-48cb-9347-2b8236ed96d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:37.422664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3c74d-ad91-48cb-9347-2b8236ed96d8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:37.455311 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 899/1798] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:37 2021] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:37.456793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee01bc0-f2fc-45c6-8c65-3d9cfb60206d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:37.457080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee01bc0-f2fc-45c6-8c65-3d9cfb60206d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:37.458466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee01bc0-f2fc-45c6-8c65-3d9cfb60206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:37.485617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571a8f2-aaa2-4dba-9192-579aa9c39d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:37.487287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571a8f2-aaa2-4dba-9192-579aa9c39d21 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:37.512301 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 900/1799] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:37.517566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571a8f2-aaa2-4dba-9192-579aa9c39d21 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:37.540064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6ee01bc0-f2fc-45c6-8c65-3d9cfb60206d None None] MFA Rules not processed for user `569e6617c02144fd84b26fcf75b60422`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:37.542463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6ee01bc0-f2fc-45c6-8c65-3d9cfb60206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:37.551858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571a8f2-aaa2-4dba-9192-579aa9c39d21 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:37.566167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e3cd4-e350-452e-9818-708a79b21d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:37.567185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3cd4-e350-452e-9818-708a79b21d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:37.568010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3cd4-e350-452e-9818-708a79b21d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:37.569239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e3cd4-e350-452e-9818-708a79b21d63 admin admin] PATH_INFO: `/v3/projects/d2d7efa965ae4db982301191d1bfe86d/users/c05fd70e91814d00b897ee94f3ebf0be/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:37.602662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3cd4-e350-452e-9818-708a79b21d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d7efa965ae4db982301191d1bfe86d, user_id=c05fd70e91814d00b897ee94f3ebf0be, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:37.606688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e3cd4-e350-452e-9818-708a79b21d63 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:37.636708 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 901/1800] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:37 2021] PUT /identity/v3/projects/d2d7efa965ae4db982301191d1bfe86d/users/c05fd70e91814d00b897ee94f3ebf0be/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:37.648942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f0ed-88c9-4025-8738-9add54fbfad5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:37.649914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f0ed-88c9-4025-8738-9add54fbfad5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:37.650331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7f0ed-88c9-4025-8738-9add54fbfad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:37.719052 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 900/1801] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:37.724286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee01bc0-f2fc-45c6-8c65-3d9cfb60206d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:37.728460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6ee01bc0-f2fc-45c6-8c65-3d9cfb60206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:37.735518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-92c7f0ed-88c9-4025-8738-9add54fbfad5 None None] MFA Rules not processed for user `c05fd70e91814d00b897ee94f3ebf0be`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:37.741860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-92c7f0ed-88c9-4025-8738-9add54fbfad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:37.766496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee01bc0-f2fc-45c6-8c65-3d9cfb60206d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:37.886550 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 902/1802] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:37 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:37.888213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f0ed-88c9-4025-8738-9add54fbfad5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:37.952043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ee1d3-914f-48d5-b0ab-b7f6dbe705f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:37.952723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ee1d3-914f-48d5-b0ab-b7f6dbe705f3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:37.953031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ee1d3-914f-48d5-b0ab-b7f6dbe705f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:37.953282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ee1d3-914f-48d5-b0ab-b7f6dbe705f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:37.959133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ee1d3-914f-48d5-b0ab-b7f6dbe705f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:37.961497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ee1d3-914f-48d5-b0ab-b7f6dbe705f3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:38.043589 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 901/1803] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:37 2021] POST /identity/v3/projects => generated 375 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:38.046032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ee1d3-914f-48d5-b0ab-b7f6dbe705f3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:38.137036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7f0ed-88c9-4025-8738-9add54fbfad5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:38.155620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ee1d3-914f-48d5-b0ab-b7f6dbe705f3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:38.161738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b89ec-35c5-4a93-9d94-965ef89c3c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:38.162875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b89ec-35c5-4a93-9d94-965ef89c3c85 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:38.163232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b89ec-35c5-4a93-9d94-965ef89c3c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:38.163608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b89ec-35c5-4a93-9d94-965ef89c3c85 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:38.165747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b89ec-35c5-4a93-9d94-965ef89c3c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:38.168764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b89ec-35c5-4a93-9d94-965ef89c3c85 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:38.215862 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 902/1804] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:38 2021] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:38.224973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b89ec-35c5-4a93-9d94-965ef89c3c85 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:38.263029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b89ec-35c5-4a93-9d94-965ef89c3c85 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:38.273644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4394223-ff15-4609-a30e-b2528494a088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:38.275516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4394223-ff15-4609-a30e-b2528494a088 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:38.277053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4394223-ff15-4609-a30e-b2528494a088 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:38.277948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4394223-ff15-4609-a30e-b2528494a088 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:38.279779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4394223-ff15-4609-a30e-b2528494a088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:38.282671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4394223-ff15-4609-a30e-b2528494a088 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:38.291167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe701d8f-7064-492d-8b3d-e1ca443569ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:38.298079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe701d8f-7064-492d-8b3d-e1ca443569ae admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:38.298523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe701d8f-7064-492d-8b3d-e1ca443569ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:38.298523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe701d8f-7064-492d-8b3d-e1ca443569ae admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:38.299393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe701d8f-7064-492d-8b3d-e1ca443569ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:38.307051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe701d8f-7064-492d-8b3d-e1ca443569ae admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:38.324889 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 903/1805] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:38 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:38.325782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4394223-ff15-4609-a30e-b2528494a088 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:38.341323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e4394223-ff15-4609-a30e-b2528494a088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:38.374617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4394223-ff15-4609-a30e-b2528494a088 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:38.380123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:38.381023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:38.381277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:38.381579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] PATH_INFO: `/v3/projects/e289b137b09743c399e30e4ffa1bab40` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:38.382790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e289b137b09743c399e30e4ffa1bab40)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:38.385261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:38.392140 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 903/1806] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:37 2021] POST /identity/v3/projects => generated 393 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:38.393099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe701d8f-7064-492d-8b3d-e1ca443569ae admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:38.517315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e289b137b09743c399e30e4ffa1bab40', 'request_id': 'req-445c851a-1ba2-480a-91e2-461e0ed0aa1a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:38.520489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe701d8f-7064-492d-8b3d-e1ca443569ae admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:38.541152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e289b137b09743c399e30e4ffa1bab40', 'request_id': 'req-445c851a-1ba2-480a-91e2-461e0ed0aa1a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:38.576285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e289b137b09743c399e30e4ffa1bab40', 'request_id': 'req-445c851a-1ba2-480a-91e2-461e0ed0aa1a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:38.607877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] The token cache is being invalidate because project e289b137b09743c399e30e4ffa1bab40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:38.611038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:38.612881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:38.619732 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 904/1807] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:38 2021] DELETE /identity/v3/projects/e289b137b09743c399e30e4ffa1bab40 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:38.624636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:38.628455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:38.679114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5a0ad-387f-4d54-9de0-ba9f4f6fa9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:38.682634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5a0ad-387f-4d54-9de0-ba9f4f6fa9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:38.682927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5a0ad-387f-4d54-9de0-ba9f4f6fa9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:38.683213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5a0ad-387f-4d54-9de0-ba9f4f6fa9d9 admin admin] PATH_INFO: `/v3/projects/a41efe841c604284b2f3a5e5b55d77a6/users/10269db4698b4da7ade3edf1040fb4a6/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:38.724573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5a0ad-387f-4d54-9de0-ba9f4f6fa9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41efe841c604284b2f3a5e5b55d77a6, user_id=10269db4698b4da7ade3edf1040fb4a6, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:38.731102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5a0ad-387f-4d54-9de0-ba9f4f6fa9d9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:38.762345 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 904/1808] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:38 2021] PUT /identity/v3/projects/a41efe841c604284b2f3a5e5b55d77a6/users/10269db4698b4da7ade3edf1040fb4a6/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:38.763280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5a0ad-387f-4d54-9de0-ba9f4f6fa9d9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:38.770526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-25f5a0ad-387f-4d54-9de0-ba9f4f6fa9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:38.870218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c851a-1ba2-480a-91e2-461e0ed0aa1a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:38.911945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5a0ad-387f-4d54-9de0-ba9f4f6fa9d9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:38.929892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:38.930749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:38.933694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:38.933812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] PATH_INFO: `/v3/users/6d4e98bf3ae14b8db078278b4aa51583` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:38.938110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4e98bf3ae14b8db078278b4aa51583)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:38.952217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:39.004396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16f20a-a9ef-490e-b9b1-0fb9f4b094ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:39.005095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f20a-a9ef-490e-b9b1-0fb9f4b094ee admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:39.005366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f20a-a9ef-490e-b9b1-0fb9f4b094ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:39.005627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f20a-a9ef-490e-b9b1-0fb9f4b094ee admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:39.006476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16f20a-a9ef-490e-b9b1-0fb9f4b094ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:39.008461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16f20a-a9ef-490e-b9b1-0fb9f4b094ee admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:39.065058 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 905/1809] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:38 2021] POST /identity/v3/users => generated 303 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:39.065058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16f20a-a9ef-490e-b9b1-0fb9f4b094ee admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:39.069267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7c16f20a-a9ef-490e-b9b1-0fb9f4b094ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:39.074994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4e98bf3ae14b8db078278b4aa51583'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:39.077788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4e98bf3ae14b8db078278b4aa51583'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:39.094364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16f20a-a9ef-490e-b9b1-0fb9f4b094ee admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:39.096523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4e98bf3ae14b8db078278b4aa51583'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:39.097362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4e98bf3ae14b8db078278b4aa51583'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:39.112409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256629-25d7-46e6-923a-ef74a9267ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:39.112761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256629-25d7-46e6-923a-ef74a9267ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:39.113045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256629-25d7-46e6-923a-ef74a9267ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:39.113364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256629-25d7-46e6-923a-ef74a9267ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:39.114007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4e98bf3ae14b8db078278b4aa51583'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:39.117201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256629-25d7-46e6-923a-ef74a9267ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:39.136304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256629-25d7-46e6-923a-ef74a9267ca6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:39.185138 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 906/1810] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:39 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:39.186036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256629-25d7-46e6-923a-ef74a9267ca6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:39.196135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2b256629-25d7-46e6-923a-ef74a9267ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:39.196285 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 905/1811] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:38 2021] DELETE /identity/v3/users/6d4e98bf3ae14b8db078278b4aa51583 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:39.198485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:39.201259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:39.241783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256629-25d7-46e6-923a-ef74a9267ca6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:39.397145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9465d4-29f0-44a6-b4a2-f3101f17ef07 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:39.409268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f9470-09e4-4cd6-9952-92494f41d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:39.410176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f9470-09e4-4cd6-9952-92494f41d9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:39.410458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f9470-09e4-4cd6-9952-92494f41d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:39.410735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f9470-09e4-4cd6-9952-92494f41d9b8 admin admin] PATH_INFO: `/v3/projects/a41efe841c604284b2f3a5e5b55d77a6/users/10269db4698b4da7ade3edf1040fb4a6/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:39.413396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32ca99-57d4-4628-959a-4274ce4890e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:39.414084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32ca99-57d4-4628-959a-4274ce4890e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:39.414358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32ca99-57d4-4628-959a-4274ce4890e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:39.414630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32ca99-57d4-4628-959a-4274ce4890e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:39.415459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32ca99-57d4-4628-959a-4274ce4890e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:39.418497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32ca99-57d4-4628-959a-4274ce4890e7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:39.420177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f9470-09e4-4cd6-9952-92494f41d9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41efe841c604284b2f3a5e5b55d77a6, user_id=10269db4698b4da7ade3edf1040fb4a6, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:39.423274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f9470-09e4-4cd6-9952-92494f41d9b8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:39.453799 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 907/1812] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:39 2021] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:39.460581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32ca99-57d4-4628-959a-4274ce4890e7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:39.474114 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 906/1813] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:39 2021] PUT /identity/v3/projects/a41efe841c604284b2f3a5e5b55d77a6/users/10269db4698b4da7ade3edf1040fb4a6/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:39.475802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002f28a-6a4c-418b-bbe1-18f26644bb67 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:39.476247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002f28a-6a4c-418b-bbe1-18f26644bb67 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:39.476446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002f28a-6a4c-418b-bbe1-18f26644bb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:39.498650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32ca99-57d4-4628-959a-4274ce4890e7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:39.518795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1002f28a-6a4c-418b-bbe1-18f26644bb67 None None] MFA Rules not processed for user `10269db4698b4da7ade3edf1040fb4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:39.520328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1002f28a-6a4c-418b-bbe1-18f26644bb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:39.681881 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 907/1814] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:39 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:39.684262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a1a7-a36c-4f31-a39a-f44914ab6f22 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:39.684785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a1a7-a36c-4f31-a39a-f44914ab6f22 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:39.685259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a1a7-a36c-4f31-a39a-f44914ab6f22 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:39.687627 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 908/1815] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:45:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:45:39.689163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a1a7-a36c-4f31-a39a-f44914ab6f22 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:39.691801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3de8a1a7-a36c-4f31-a39a-f44914ab6f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:39.694768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ccea7-3fe7-46e6-bce5-65ea54cd07bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:39.697033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ccea7-3fe7-46e6-bce5-65ea54cd07bc admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:39.698279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ccea7-3fe7-46e6-bce5-65ea54cd07bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:39.699655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ccea7-3fe7-46e6-bce5-65ea54cd07bc admin admin] PATH_INFO: `/v3/projects/32f447e4c64347af941d8a0804675830/users/f77af667443d4f32b12b1bddb3d7fec6/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:39.743119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ccea7-3fe7-46e6-bce5-65ea54cd07bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f447e4c64347af941d8a0804675830, user_id=f77af667443d4f32b12b1bddb3d7fec6, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:39.755671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ccea7-3fe7-46e6-bce5-65ea54cd07bc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:39.796011 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 908/1816] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:39 2021] PUT /identity/v3/projects/32f447e4c64347af941d8a0804675830/users/f77af667443d4f32b12b1bddb3d7fec6/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:39.800333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2acfe-3744-45f1-836c-a990f6943f41 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:39.801824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2acfe-3744-45f1-836c-a990f6943f41 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:39.802113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2acfe-3744-45f1-836c-a990f6943f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:39.803781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a1a7-a36c-4f31-a39a-f44914ab6f22 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:39.849031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-08d2acfe-3744-45f1-836c-a990f6943f41 None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:39.866355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-08d2acfe-3744-45f1-836c-a990f6943f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:40.003696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eb950-df3e-4484-9602-d1117d879ad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:40.003696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eb950-df3e-4484-9602-d1117d879ad5 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:40.003696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eb950-df3e-4484-9602-d1117d879ad5 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:40.003696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eb950-df3e-4484-9602-d1117d879ad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:40.098346 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 909/1817] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:45:39 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:40.099643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2acfe-3744-45f1-836c-a990f6943f41 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:40.222750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78eb950-df3e-4484-9602-d1117d879ad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:40.263175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78eb950-df3e-4484-9602-d1117d879ad5 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:40.294764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2acfe-3744-45f1-836c-a990f6943f41 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:40.301012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f37d-fe8d-42d1-a179-cc8be29c4cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:40.301696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f37d-fe8d-42d1-a179-cc8be29c4cfc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:40.301985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f37d-fe8d-42d1-a179-cc8be29c4cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:40.302263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f37d-fe8d-42d1-a179-cc8be29c4cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:40.303048 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 909/1818] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:39 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:40.303165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f37d-fe8d-42d1-a179-cc8be29c4cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:40.304269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eb950-df3e-4484-9602-d1117d879ad5 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:40.305301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f37d-fe8d-42d1-a179-cc8be29c4cfc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:40.310800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d78eb950-df3e-4484-9602-d1117d879ad5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:40.318471 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 910/1819] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:40 2021] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:40.323208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f37d-fe8d-42d1-a179-cc8be29c4cfc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:40.367794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f37d-fe8d-42d1-a179-cc8be29c4cfc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:40.375077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eb950-df3e-4484-9602-d1117d879ad5 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:40.383824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd683205-8899-44d6-82d8-5f1c557653cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:40.385538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd683205-8899-44d6-82d8-5f1c557653cf admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:40.385926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd683205-8899-44d6-82d8-5f1c557653cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:40.386650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd683205-8899-44d6-82d8-5f1c557653cf admin admin] PATH_INFO: `/v3/projects/32f447e4c64347af941d8a0804675830/users/f77af667443d4f32b12b1bddb3d7fec6/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:40.395871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:40.396863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:40.399423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd683205-8899-44d6-82d8-5f1c557653cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f447e4c64347af941d8a0804675830, user_id=f77af667443d4f32b12b1bddb3d7fec6, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:40.401328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:40.401811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] PATH_INFO: `/v3/projects/cce9e9a7290f4bbaa87ee50fa555ad01` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:40.403058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd683205-8899-44d6-82d8-5f1c557653cf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:40.409702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce9e9a7290f4bbaa87ee50fa555ad01)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:40.426957 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 911/1820] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:40 2021] PUT /identity/v3/projects/32f447e4c64347af941d8a0804675830/users/f77af667443d4f32b12b1bddb3d7fec6/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:40.428260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd683205-8899-44d6-82d8-5f1c557653cf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:40.432891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:40.598932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd683205-8899-44d6-82d8-5f1c557653cf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:40.607864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce9e9a7290f4bbaa87ee50fa555ad01', 'request_id': 'req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:40.629452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce9e9a7290f4bbaa87ee50fa555ad01', 'request_id': 'req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:40.657647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce9e9a7290f4bbaa87ee50fa555ad01', 'request_id': 'req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:40.684723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] The token cache is being invalidate because project cce9e9a7290f4bbaa87ee50fa555ad01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:40.685360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:40.686412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:40.690306 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 910/1821] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:40 2021] DELETE /identity/v3/projects/cce9e9a7290f4bbaa87ee50fa555ad01 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:40.691425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:40.693333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:40.788970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa3eca-3a5c-486f-bb3d-6ff741a8dd77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:40.790219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa3eca-3a5c-486f-bb3d-6ff741a8dd77 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:40.790219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa3eca-3a5c-486f-bb3d-6ff741a8dd77 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:40.790219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa3eca-3a5c-486f-bb3d-6ff741a8dd77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:40.795312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a1fa3eca-3a5c-486f-bb3d-6ff741a8dd77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:40.940911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa3eca-3a5c-486f-bb3d-6ff741a8dd77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:40.942378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa3eca-3a5c-486f-bb3d-6ff741a8dd77 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:40.964482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd796a1c-bcb7-4d6a-aaf2-1b29f90299f5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:40.975174 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 912/1822] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:40 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:40.977382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05406b1-6067-43cb-ae2c-feb598308671 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:40.977834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05406b1-6067-43cb-ae2c-feb598308671 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:40.978248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05406b1-6067-43cb-ae2c-feb598308671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:40.993687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf5e8e-93cd-4cd6-851a-d1151e44c993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:40.995083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf5e8e-93cd-4cd6-851a-d1151e44c993 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:40.997369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf5e8e-93cd-4cd6-851a-d1151e44c993 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:40.997888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf5e8e-93cd-4cd6-851a-d1151e44c993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:41.003163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7ebf5e8e-93cd-4cd6-851a-d1151e44c993 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:41.038423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf5e8e-93cd-4cd6-851a-d1151e44c993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:41.043762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf5e8e-93cd-4cd6-851a-d1151e44c993 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:41.072983 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 911/1823] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:41.076229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf5e8e-93cd-4cd6-851a-d1151e44c993 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:41.081173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7ebf5e8e-93cd-4cd6-851a-d1151e44c993 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:41.101092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a05406b1-6067-43cb-ae2c-feb598308671 None None] MFA Rules not processed for user `f77af667443d4f32b12b1bddb3d7fec6`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:41.102319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a05406b1-6067-43cb-ae2c-feb598308671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:41.251469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf5e8e-93cd-4cd6-851a-d1151e44c993 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:41.261256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:41.263335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:41.265127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:41.265412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] PATH_INFO: `/v3/projects/56f9df9b815645cbaf7edf2ff21715b4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:41.267611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f9df9b815645cbaf7edf2ff21715b4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:41.269715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:41.339574 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 913/1824] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:40 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:41.342903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd587d2-e12a-40af-84a0-acef8dffd05e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:41.343423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd587d2-e12a-40af-84a0-acef8dffd05e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:41.343708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd587d2-e12a-40af-84a0-acef8dffd05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:41.381424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4dd587d2-e12a-40af-84a0-acef8dffd05e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:41.382659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4dd587d2-e12a-40af-84a0-acef8dffd05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:41.397766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f9df9b815645cbaf7edf2ff21715b4', 'request_id': 'req-b836008d-72eb-4f7b-8591-e552a3e035c8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:41.408506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f9df9b815645cbaf7edf2ff21715b4', 'request_id': 'req-b836008d-72eb-4f7b-8591-e552a3e035c8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:41.436694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f9df9b815645cbaf7edf2ff21715b4', 'request_id': 'req-b836008d-72eb-4f7b-8591-e552a3e035c8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:41.493535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] The token cache is being invalidate because project 56f9df9b815645cbaf7edf2ff21715b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:41.493832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:41.495956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:41.500788 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 912/1825] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:41 2021] DELETE /identity/v3/projects/56f9df9b815645cbaf7edf2ff21715b4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:41.503984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:41.506616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:41.595917 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 914/1826] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:41.597022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd587d2-e12a-40af-84a0-acef8dffd05e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:41.598638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4dd587d2-e12a-40af-84a0-acef8dffd05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:41.623465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd587d2-e12a-40af-84a0-acef8dffd05e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:41.631861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99686783-4b8d-45c5-8355-a678fd4324e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:41.633414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686783-4b8d-45c5-8355-a678fd4324e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:41.633944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686783-4b8d-45c5-8355-a678fd4324e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:41.634383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686783-4b8d-45c5-8355-a678fd4324e9 admin admin] PATH_INFO: `/v3/users/4439c27f76ad467fa1a9250a13426234` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:41.636279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99686783-4b8d-45c5-8355-a678fd4324e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4439c27f76ad467fa1a9250a13426234)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:41.641276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99686783-4b8d-45c5-8355-a678fd4324e9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:41.722996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836008d-72eb-4f7b-8591-e552a3e035c8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:41.732637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f813f4-d143-4adf-a563-c21d4546d8d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:41.733331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f813f4-d143-4adf-a563-c21d4546d8d7 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:41.733618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f813f4-d143-4adf-a563-c21d4546d8d7 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:41.733909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f813f4-d143-4adf-a563-c21d4546d8d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:41.743781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b1f813f4-d143-4adf-a563-c21d4546d8d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:41.770548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-99686783-4b8d-45c5-8355-a678fd4324e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4439c27f76ad467fa1a9250a13426234'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:41.792477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-99686783-4b8d-45c5-8355-a678fd4324e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4439c27f76ad467fa1a9250a13426234'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:41.794112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-99686783-4b8d-45c5-8355-a678fd4324e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4439c27f76ad467fa1a9250a13426234'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:41.819709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-99686783-4b8d-45c5-8355-a678fd4324e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4439c27f76ad467fa1a9250a13426234'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:41.847910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-99686783-4b8d-45c5-8355-a678fd4324e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4439c27f76ad467fa1a9250a13426234'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:41.870328 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 915/1827] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:41 2021] DELETE /identity/v3/users/4439c27f76ad467fa1a9250a13426234 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:41.882683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940904-42fc-4609-8185-26f08a9fc9f5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:41.882972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940904-42fc-4609-8185-26f08a9fc9f5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:41.883270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940904-42fc-4609-8185-26f08a9fc9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:41.887296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f813f4-d143-4adf-a563-c21d4546d8d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:41.889237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f813f4-d143-4adf-a563-c21d4546d8d7 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:41.901896 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 913/1828] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:41 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:41.937983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d4940904-42fc-4609-8185-26f08a9fc9f5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:41.939231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d4940904-42fc-4609-8185-26f08a9fc9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:42.044160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f813f4-d143-4adf-a563-c21d4546d8d7 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:42.046108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b1f813f4-d143-4adf-a563-c21d4546d8d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:42.047646 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 916/1829] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:42.062088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f813f4-d143-4adf-a563-c21d4546d8d7 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:42.084542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4940904-42fc-4609-8185-26f08a9fc9f5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:42.086587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d4940904-42fc-4609-8185-26f08a9fc9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:42.087526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c391bc9-f469-44ff-9318-210360c91f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:42.089477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c391bc9-f469-44ff-9318-210360c91f33 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:42.090166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c391bc9-f469-44ff-9318-210360c91f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:42.091041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c391bc9-f469-44ff-9318-210360c91f33 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:42.094270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c391bc9-f469-44ff-9318-210360c91f33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:42.095236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c391bc9-f469-44ff-9318-210360c91f33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:42.101027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c391bc9-f469-44ff-9318-210360c91f33 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:42.112907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4940904-42fc-4609-8185-26f08a9fc9f5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:42.126387 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 914/1830] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:45:42.127633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf755df6-4df2-4f4a-aa7f-b3cc9b3b1ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:42.129075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf755df6-4df2-4f4a-aa7f-b3cc9b3b1ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:42.130982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c391bc9-f469-44ff-9318-210360c91f33 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:42.144228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf755df6-4df2-4f4a-aa7f-b3cc9b3b1ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:42.145076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf755df6-4df2-4f4a-aa7f-b3cc9b3b1ac8 admin admin] PATH_INFO: `/v3/users/569e6617c02144fd84b26fcf75b60422` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:42.148963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf755df6-4df2-4f4a-aa7f-b3cc9b3b1ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=569e6617c02144fd84b26fcf75b60422)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:42.155889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf755df6-4df2-4f4a-aa7f-b3cc9b3b1ac8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:42.164835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c391bc9-f469-44ff-9318-210360c91f33 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:42.179214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16942946-8426-4b38-a29d-ce6effc8dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:42.180476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16942946-8426-4b38-a29d-ce6effc8dbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:42.180972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16942946-8426-4b38-a29d-ce6effc8dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:42.182847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16942946-8426-4b38-a29d-ce6effc8dbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:42.186660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16942946-8426-4b38-a29d-ce6effc8dbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:42.191231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16942946-8426-4b38-a29d-ce6effc8dbe4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:42.232132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cf755df6-4df2-4f4a-aa7f-b3cc9b3b1ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569e6617c02144fd84b26fcf75b60422'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:42.256851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cf755df6-4df2-4f4a-aa7f-b3cc9b3b1ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569e6617c02144fd84b26fcf75b60422'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:42.257950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cf755df6-4df2-4f4a-aa7f-b3cc9b3b1ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569e6617c02144fd84b26fcf75b60422'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:42.267665 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 915/1831] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:42 2021] POST /identity/v3/projects => generated 403 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:42.268937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16942946-8426-4b38-a29d-ce6effc8dbe4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:42.272456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-16942946-8426-4b38-a29d-ce6effc8dbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:42.301049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cf755df6-4df2-4f4a-aa7f-b3cc9b3b1ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569e6617c02144fd84b26fcf75b60422'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:42.356206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cf755df6-4df2-4f4a-aa7f-b3cc9b3b1ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569e6617c02144fd84b26fcf75b60422'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:42.371523 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 917/1832] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:42 2021] DELETE /identity/v3/users/569e6617c02144fd84b26fcf75b60422 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:42.379416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452726f-5eef-4f56-9b2f-d3a06d1a84f9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:42.380119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452726f-5eef-4f56-9b2f-d3a06d1a84f9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:42.380800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452726f-5eef-4f56-9b2f-d3a06d1a84f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:42.435066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6452726f-5eef-4f56-9b2f-d3a06d1a84f9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:42.437524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6452726f-5eef-4f56-9b2f-d3a06d1a84f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:42.460750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16942946-8426-4b38-a29d-ce6effc8dbe4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:42.548437 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 918/1833] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:45:42.549730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452726f-5eef-4f56-9b2f-d3a06d1a84f9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:42.562781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6452726f-5eef-4f56-9b2f-d3a06d1a84f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:42.582736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452726f-5eef-4f56-9b2f-d3a06d1a84f9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:42.586190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b86c5a-4f7d-4094-911e-407e017131ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:42.586908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86c5a-4f7d-4094-911e-407e017131ab admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:42.587179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86c5a-4f7d-4094-911e-407e017131ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:42.587471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b86c5a-4f7d-4094-911e-407e017131ab admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:42.588243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b86c5a-4f7d-4094-911e-407e017131ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:42.590489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b86c5a-4f7d-4094-911e-407e017131ab admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:42.590829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:42.592278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:42.592799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:42.593324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] PATH_INFO: `/v3/users/c05fd70e91814d00b897ee94f3ebf0be` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:42.595078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c05fd70e91814d00b897ee94f3ebf0be)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:42.598822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:42.646844 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 916/1834] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:42 2021] POST /identity/v3/users => generated 302 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:42.648519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b86c5a-4f7d-4094-911e-407e017131ab admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:42.655597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c6b86c5a-4f7d-4094-911e-407e017131ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:42.685454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c05fd70e91814d00b897ee94f3ebf0be'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:42.703566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c05fd70e91814d00b897ee94f3ebf0be'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:42.704080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c05fd70e91814d00b897ee94f3ebf0be'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:42.717801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c05fd70e91814d00b897ee94f3ebf0be'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:42.743831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c05fd70e91814d00b897ee94f3ebf0be'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:42.760986 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 919/1835] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:42 2021] DELETE /identity/v3/users/c05fd70e91814d00b897ee94f3ebf0be => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:42.761844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:42.763186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:42.842004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b86c5a-4f7d-4094-911e-407e017131ab admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:42.929931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6dbc-9b06-4401-86da-c8a09ac3bd4e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:42.943135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac8b38-0256-4baa-945b-5783b36eb8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:42.944285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac8b38-0256-4baa-945b-5783b36eb8dc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:42.946770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac8b38-0256-4baa-945b-5783b36eb8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:42.947361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac8b38-0256-4baa-945b-5783b36eb8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:42.948366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac8b38-0256-4baa-945b-5783b36eb8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:42.954237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac8b38-0256-4baa-945b-5783b36eb8dc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:42.966640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb5a78-79f5-41d6-ab01-71aa714e10c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:42.967368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb5a78-79f5-41d6-ab01-71aa714e10c2 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:42.967798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb5a78-79f5-41d6-ab01-71aa714e10c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:42.968203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb5a78-79f5-41d6-ab01-71aa714e10c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:42.970137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7cdb5a78-79f5-41d6-ab01-71aa714e10c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:42.987810 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 920/1836] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:42 2021] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:42.992364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661473ab-8c84-4ed2-bd84-e73e98680ab8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:42.992952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661473ab-8c84-4ed2-bd84-e73e98680ab8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:42.993476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661473ab-8c84-4ed2-bd84-e73e98680ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:43.006013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb5a78-79f5-41d6-ab01-71aa714e10c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:43.007600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb5a78-79f5-41d6-ab01-71aa714e10c2 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:43.025517 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 917/1837] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:43.026493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb5a78-79f5-41d6-ab01-71aa714e10c2 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:43.045126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb5a78-79f5-41d6-ab01-71aa714e10c2 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:43.050746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1a263-5526-4406-8d71-ccf3b091737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:43.051508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1a263-5526-4406-8d71-ccf3b091737e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:43.051796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1a263-5526-4406-8d71-ccf3b091737e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:43.052185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1a263-5526-4406-8d71-ccf3b091737e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:43.053124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1a263-5526-4406-8d71-ccf3b091737e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:43.054947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1a263-5526-4406-8d71-ccf3b091737e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:43.055440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-661473ab-8c84-4ed2-bd84-e73e98680ab8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:43.058178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-661473ab-8c84-4ed2-bd84-e73e98680ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:43.081927 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 918/1838] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:43 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:43.082504 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 921/1839] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:43.083042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1a263-5526-4406-8d71-ccf3b091737e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:43.098169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1a263-5526-4406-8d71-ccf3b091737e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:43.102955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661473ab-8c84-4ed2-bd84-e73e98680ab8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:43.104882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-661473ab-8c84-4ed2-bd84-e73e98680ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:43.109697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d68cd-669d-440e-b170-758486072f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:43.112675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d68cd-669d-440e-b170-758486072f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:43.113203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d68cd-669d-440e-b170-758486072f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:43.113758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d68cd-669d-440e-b170-758486072f7a admin admin] PATH_INFO: `/v3/projects/3e29963d3e6243cc983112e01c0a6a5b/users/d7a3b1d9173e4090b34095a4d334cd56/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:43.127699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661473ab-8c84-4ed2-bd84-e73e98680ab8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:43.142446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3555eb-8e22-4633-a668-8ba6dd82cd2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:43.142780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d68cd-669d-440e-b170-758486072f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e29963d3e6243cc983112e01c0a6a5b, user_id=d7a3b1d9173e4090b34095a4d334cd56, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:43.143637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3555eb-8e22-4633-a668-8ba6dd82cd2d service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:43.146248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d68cd-669d-440e-b170-758486072f7a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:43.146893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3555eb-8e22-4633-a668-8ba6dd82cd2d service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:43.147349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3555eb-8e22-4633-a668-8ba6dd82cd2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:43.166435 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 919/1840] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:43 2021] PUT /identity/v3/projects/3e29963d3e6243cc983112e01c0a6a5b/users/d7a3b1d9173e4090b34095a4d334cd56/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:43.168665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3555eb-8e22-4633-a668-8ba6dd82cd2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:43.171238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3555eb-8e22-4633-a668-8ba6dd82cd2d service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:43.173088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79e048-d8ea-4d7f-bf55-70c5b091116d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:43.173842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79e048-d8ea-4d7f-bf55-70c5b091116d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:43.174363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79e048-d8ea-4d7f-bf55-70c5b091116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:43.194122 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 922/1841] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:43.223451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ee79e048-d8ea-4d7f-bf55-70c5b091116d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:43.225399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ee79e048-d8ea-4d7f-bf55-70c5b091116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:43.367095 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 920/1842] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:43.383213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3555eb-8e22-4633-a668-8ba6dd82cd2d service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:43.402118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3555eb-8e22-4633-a668-8ba6dd82cd2d service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:43.590625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378e4dc-87a8-40ca-ad64-a73b5e3025f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:43.591683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378e4dc-87a8-40ca-ad64-a73b5e3025f9 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:43.592020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378e4dc-87a8-40ca-ad64-a73b5e3025f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:43.592302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378e4dc-87a8-40ca-ad64-a73b5e3025f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:43.614103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378e4dc-87a8-40ca-ad64-a73b5e3025f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:43.616174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378e4dc-87a8-40ca-ad64-a73b5e3025f9 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:43.641576 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 923/1843] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:43.734204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79e048-d8ea-4d7f-bf55-70c5b091116d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:43.735864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ee79e048-d8ea-4d7f-bf55-70c5b091116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:43.755853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79e048-d8ea-4d7f-bf55-70c5b091116d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:43.769848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:43.770922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:43.771345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:43.771721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] PATH_INFO: `/v3/projects/ad21beb2525548d0b8ebb140ddae2375` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:43.777913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad21beb2525548d0b8ebb140ddae2375)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:43.780379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:43.889288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad21beb2525548d0b8ebb140ddae2375', 'request_id': 'req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:43.926560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad21beb2525548d0b8ebb140ddae2375', 'request_id': 'req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:43.941670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad21beb2525548d0b8ebb140ddae2375', 'request_id': 'req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:43.969789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] The token cache is being invalidate because project ad21beb2525548d0b8ebb140ddae2375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:43.970337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:43.973486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb0c3a32-3fdb-402e-a7ff-5ea6a134f1ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:43.979078 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 921/1844] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:43 2021] DELETE /identity/v3/projects/ad21beb2525548d0b8ebb140ddae2375 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:43.987040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caebe73-c0c3-43fd-97fa-6cfe779b0c80 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:43.988300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caebe73-c0c3-43fd-97fa-6cfe779b0c80 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:43.989510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caebe73-c0c3-43fd-97fa-6cfe779b0c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:44.028551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4caebe73-c0c3-43fd-97fa-6cfe779b0c80 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:44.030098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4caebe73-c0c3-43fd-97fa-6cfe779b0c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:44.166914 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 924/1845] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:45:44.176114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0b5d6-fa3d-4ede-9ec9-674d9e84fd86 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:44.176399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0b5d6-fa3d-4ede-9ec9-674d9e84fd86 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:44.177123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0b5d6-fa3d-4ede-9ec9-674d9e84fd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:44.230527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-01e0b5d6-fa3d-4ede-9ec9-674d9e84fd86 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:44.232858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-01e0b5d6-fa3d-4ede-9ec9-674d9e84fd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:44.258668 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 922/1846] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:44.259017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caebe73-c0c3-43fd-97fa-6cfe779b0c80 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:44.278459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0b5d6-fa3d-4ede-9ec9-674d9e84fd86 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:44.279244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caebe73-c0c3-43fd-97fa-6cfe779b0c80 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:44.281184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-01e0b5d6-fa3d-4ede-9ec9-674d9e84fd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:44.291445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646f156-705a-4a7a-a75a-fa1f9a075d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:44.292491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646f156-705a-4a7a-a75a-fa1f9a075d16 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:44.292857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646f156-705a-4a7a-a75a-fa1f9a075d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:44.293265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646f156-705a-4a7a-a75a-fa1f9a075d16 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:44.294122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646f156-705a-4a7a-a75a-fa1f9a075d16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:44.296515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646f156-705a-4a7a-a75a-fa1f9a075d16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:44.302661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646f156-705a-4a7a-a75a-fa1f9a075d16 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:44.337490 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 925/1847] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:45:44.338630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646f156-705a-4a7a-a75a-fa1f9a075d16 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:44.355179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0b5d6-fa3d-4ede-9ec9-674d9e84fd86 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:44.357254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646f156-705a-4a7a-a75a-fa1f9a075d16 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:44.381247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:44.384225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:44.385395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:44.385741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] PATH_INFO: `/v3/projects/d2d7efa965ae4db982301191d1bfe86d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:44.386790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eea83e-fa5a-48b8-af40-119b5d14c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:44.387505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eea83e-fa5a-48b8-af40-119b5d14c771 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:44.387785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eea83e-fa5a-48b8-af40-119b5d14c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:44.388052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eea83e-fa5a-48b8-af40-119b5d14c771 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:44.388796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eea83e-fa5a-48b8-af40-119b5d14c771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:44.388869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d7efa965ae4db982301191d1bfe86d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:44.392906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eea83e-fa5a-48b8-af40-119b5d14c771 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:44.394598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:44.447928 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 926/1848] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:44 2021] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:44.460193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eea83e-fa5a-48b8-af40-119b5d14c771 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:44.571049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eea83e-fa5a-48b8-af40-119b5d14c771 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:44.582229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6c08d-dd29-49a0-9872-a32de264d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:44.584695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6c08d-dd29-49a0-9872-a32de264d600 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:44.585831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6c08d-dd29-49a0-9872-a32de264d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:44.586965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6c08d-dd29-49a0-9872-a32de264d600 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:44.588510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6c08d-dd29-49a0-9872-a32de264d600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:44.592726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6c08d-dd29-49a0-9872-a32de264d600 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:44.610751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d7efa965ae4db982301191d1bfe86d', 'request_id': 'req-e112dd42-91e9-4efa-a9c4-14d1217c6e25'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:44.621927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d7efa965ae4db982301191d1bfe86d', 'request_id': 'req-e112dd42-91e9-4efa-a9c4-14d1217c6e25'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:44.638530 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 927/1849] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:44 2021] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:44.638530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6c08d-dd29-49a0-9872-a32de264d600 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:44.641399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d7efa965ae4db982301191d1bfe86d', 'request_id': 'req-e112dd42-91e9-4efa-a9c4-14d1217c6e25'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:44.644873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-21e6c08d-dd29-49a0-9872-a32de264d600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:44.662604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6c08d-dd29-49a0-9872-a32de264d600 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:44.674769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] The token cache is being invalidate because project d2d7efa965ae4db982301191d1bfe86d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:44.677129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:44.678751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:44.685213 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 923/1850] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:44 2021] DELETE /identity/v3/projects/d2d7efa965ae4db982301191d1bfe86d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:44.686978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:44.708953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:44.835581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:44.837677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:44.840654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:44.841034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] PATH_INFO: `/v3/projects/23c387d34d9c441e875c00ad005d1e93` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:44.843520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c387d34d9c441e875c00ad005d1e93)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:44.851421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:44.882265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112dd42-91e9-4efa-a9c4-14d1217c6e25 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:44.890653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e80aed-4100-46a4-9a79-9f337d51ffea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:44.892004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e80aed-4100-46a4-9a79-9f337d51ffea admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:44.892758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e80aed-4100-46a4-9a79-9f337d51ffea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:44.893374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e80aed-4100-46a4-9a79-9f337d51ffea admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:44.894674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e80aed-4100-46a4-9a79-9f337d51ffea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:44.896911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e80aed-4100-46a4-9a79-9f337d51ffea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:44.919405 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 924/1851] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:44 2021] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:44.922023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e80aed-4100-46a4-9a79-9f337d51ffea admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:44.924564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f7e80aed-4100-46a4-9a79-9f337d51ffea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:44.945388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e80aed-4100-46a4-9a79-9f337d51ffea admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:44.954179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:44.957086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:44.958604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:44.960006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] PATH_INFO: `/v3/users/f77af667443d4f32b12b1bddb3d7fec6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:44.964481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77af667443d4f32b12b1bddb3d7fec6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:44.968544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:45.020356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c387d34d9c441e875c00ad005d1e93', 'request_id': 'req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.043911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c387d34d9c441e875c00ad005d1e93', 'request_id': 'req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.065227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c387d34d9c441e875c00ad005d1e93', 'request_id': 'req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.102657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] The token cache is being invalidate because project 23c387d34d9c441e875c00ad005d1e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:45.102949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.107279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.117414 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 928/1852] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:44 2021] DELETE /identity/v3/projects/23c387d34d9c441e875c00ad005d1e93 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:45.118527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:45.129292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77af667443d4f32b12b1bddb3d7fec6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.130329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77af667443d4f32b12b1bddb3d7fec6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.130864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:45.160464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77af667443d4f32b12b1bddb3d7fec6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.161883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77af667443d4f32b12b1bddb3d7fec6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.176134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77af667443d4f32b12b1bddb3d7fec6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.245079 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 925/1853] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:44 2021] DELETE /identity/v3/users/f77af667443d4f32b12b1bddb3d7fec6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:45.246323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:45.252917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:45.409843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ba38d-b08d-4b6d-bed4-00bdb9d25274 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:45.544936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81a1c9-9b79-49cf-bbea-3939d81b42a9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:45.557673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:45.560315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:45.560647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:45.560994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] PATH_INFO: `/v3/users/10269db4698b4da7ade3edf1040fb4a6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:45.564850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10269db4698b4da7ade3edf1040fb4a6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:45.571498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:45.580309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f160f-4cc4-4cd7-be86-0a2999825191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:45.582867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f160f-4cc4-4cd7-be86-0a2999825191 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:45.583555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f160f-4cc4-4cd7-be86-0a2999825191 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:45.584535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f160f-4cc4-4cd7-be86-0a2999825191 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:45.586500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f160f-4cc4-4cd7-be86-0a2999825191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:45.592112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f160f-4cc4-4cd7-be86-0a2999825191 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:45.623437 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 929/1854] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:45 2021] GET /identity/v3/roles => generated 1420 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:45.624592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f160f-4cc4-4cd7-be86-0a2999825191 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:45.626855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ed0f160f-4cc4-4cd7-be86-0a2999825191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:45.661286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f160f-4cc4-4cd7-be86-0a2999825191 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:45.675927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875b310-620e-41db-baef-93f37a3c161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:45.676785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10269db4698b4da7ade3edf1040fb4a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.677985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10269db4698b4da7ade3edf1040fb4a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.678762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b310-620e-41db-baef-93f37a3c161d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:45.679538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b310-620e-41db-baef-93f37a3c161d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:45.680622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875b310-620e-41db-baef-93f37a3c161d admin admin] PATH_INFO: `/v3/projects/95c7210651784fa580afdafc24a36ad5/users/ed5856d46c544c52baf6946e2d4cd61e/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:45.695314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10269db4698b4da7ade3edf1040fb4a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.696472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10269db4698b4da7ade3edf1040fb4a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.711555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10269db4698b4da7ade3edf1040fb4a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:45.721125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875b310-620e-41db-baef-93f37a3c161d admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c7210651784fa580afdafc24a36ad5, user_id=ed5856d46c544c52baf6946e2d4cd61e, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:45.726700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875b310-620e-41db-baef-93f37a3c161d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:45.767675 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 930/1855] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:45 2021] PUT /identity/v3/projects/95c7210651784fa580afdafc24a36ad5/users/ed5856d46c544c52baf6946e2d4cd61e/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:45.772294 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 926/1856] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:45 2021] DELETE /identity/v3/users/10269db4698b4da7ade3edf1040fb4a6 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:45.772450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b3a2c-b387-4639-b76f-509444697352 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:45.772450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b3a2c-b387-4639-b76f-509444697352 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:45.772450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b3a2c-b387-4639-b76f-509444697352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:45.805580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b27b3a2c-b387-4639-b76f-509444697352 None None] MFA Rules not processed for user `ed5856d46c544c52baf6946e2d4cd61e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:45.808666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b27b3a2c-b387-4639-b76f-509444697352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:45.918718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:45.920703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:45.933160 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 931/1857] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:45 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:46.063219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4eb176-b457-4bc5-9b3f-78f96ac12dc7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:46.070086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ba44e-5727-4406-949a-6cc6fb21cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:46.071063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ba44e-5727-4406-949a-6cc6fb21cc9c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:46.072632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ba44e-5727-4406-949a-6cc6fb21cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:46.073205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ba44e-5727-4406-949a-6cc6fb21cc9c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:46.074252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ba44e-5727-4406-949a-6cc6fb21cc9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:46.075058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106db4-6011-4447-85ba-53c6b9763423 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:46.076009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106db4-6011-4447-85ba-53c6b9763423 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:46.076009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106db4-6011-4447-85ba-53c6b9763423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:46.082627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ba44e-5727-4406-949a-6cc6fb21cc9c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:46.153462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-98106db4-6011-4447-85ba-53c6b9763423 None None] MFA Rules not processed for user `d7a3b1d9173e4090b34095a4d334cd56`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:46.154758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-98106db4-6011-4447-85ba-53c6b9763423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:46.180825 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 927/1858] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:45 2021] POST /identity/v3/projects => generated 387 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:46.182324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ba44e-5727-4406-949a-6cc6fb21cc9c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:46.198147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e21ba44e-5727-4406-949a-6cc6fb21cc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:46.317461 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 932/1859] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:46 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:46.319203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98106db4-6011-4447-85ba-53c6b9763423 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:46.330608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98106db4-6011-4447-85ba-53c6b9763423 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:46.458711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ba44e-5727-4406-949a-6cc6fb21cc9c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:46.479176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:46.480004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:46.480353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:46.480527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] PATH_INFO: `/v3/projects/32f447e4c64347af941d8a0804675830` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:46.482014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f447e4c64347af941d8a0804675830)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:46.483966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:46.573362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955d8a8-2705-4e28-9c9a-262d37f1665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:46.574350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955d8a8-2705-4e28-9c9a-262d37f1665f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:46.574553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955d8a8-2705-4e28-9c9a-262d37f1665f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:46.574820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955d8a8-2705-4e28-9c9a-262d37f1665f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:46.584895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955d8a8-2705-4e28-9c9a-262d37f1665f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:46.587022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955d8a8-2705-4e28-9c9a-262d37f1665f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:46.599019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f447e4c64347af941d8a0804675830', 'request_id': 'req-ec281c37-1335-434e-8f5a-42709090fba3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:46.627781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f447e4c64347af941d8a0804675830', 'request_id': 'req-ec281c37-1335-434e-8f5a-42709090fba3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:46.645011 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 933/1860] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:46 2021] POST /identity/v3/users => generated 300 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:46.645717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f447e4c64347af941d8a0804675830', 'request_id': 'req-ec281c37-1335-434e-8f5a-42709090fba3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:46.646637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955d8a8-2705-4e28-9c9a-262d37f1665f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:46.652975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2955d8a8-2705-4e28-9c9a-262d37f1665f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:46.676240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] The token cache is being invalidate because project 32f447e4c64347af941d8a0804675830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:46.676240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:46.682017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:46.697389 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 928/1861] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:46 2021] DELETE /identity/v3/projects/32f447e4c64347af941d8a0804675830 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:46.697389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:46.699195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955d8a8-2705-4e28-9c9a-262d37f1665f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:46.700777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:46.886910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec281c37-1335-434e-8f5a-42709090fba3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:46.895112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8309fe-5328-4568-9da6-b6f074718f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:46.896258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8309fe-5328-4568-9da6-b6f074718f7a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:46.896714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8309fe-5328-4568-9da6-b6f074718f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:46.897055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8309fe-5328-4568-9da6-b6f074718f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:46.897896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8309fe-5328-4568-9da6-b6f074718f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:46.898131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c7f82-4e63-4260-ab72-3874fe8a0687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:46.898904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7f82-4e63-4260-ab72-3874fe8a0687 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:46.899784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7f82-4e63-4260-ab72-3874fe8a0687 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:46.900239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8309fe-5328-4568-9da6-b6f074718f7a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:46.900986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7f82-4e63-4260-ab72-3874fe8a0687 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:46.901866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c7f82-4e63-4260-ab72-3874fe8a0687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:46.908436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c7f82-4e63-4260-ab72-3874fe8a0687 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:46.919390 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 929/1862] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:46 2021] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:46.919390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cda04-e2cc-44cd-b500-3287f6d420f2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:46.919390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cda04-e2cc-44cd-b500-3287f6d420f2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:46.919390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cda04-e2cc-44cd-b500-3287f6d420f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:46.945147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-327cda04-e2cc-44cd-b500-3287f6d420f2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:46.948564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-327cda04-e2cc-44cd-b500-3287f6d420f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:46.968983 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 934/1863] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:46 2021] POST /identity/v3/projects => generated 405 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:46.970234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c7f82-4e63-4260-ab72-3874fe8a0687 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:46.970592 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 930/1864] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:46.971834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cda04-e2cc-44cd-b500-3287f6d420f2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:46.979595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-964c7f82-4e63-4260-ab72-3874fe8a0687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:46.986183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cda04-e2cc-44cd-b500-3287f6d420f2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:47.068182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92af6-167d-4892-bfd6-ba39eee1b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:47.072238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92af6-167d-4892-bfd6-ba39eee1b00e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.072714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92af6-167d-4892-bfd6-ba39eee1b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.073015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92af6-167d-4892-bfd6-ba39eee1b00e admin admin] PATH_INFO: `/v3/projects/a8812f28b95f4991a9f6ae089d54e47c/users/17e8196384d04fb298052ef03bb614ba/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.112444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c92af6-167d-4892-bfd6-ba39eee1b00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8812f28b95f4991a9f6ae089d54e47c, user_id=17e8196384d04fb298052ef03bb614ba, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:47.117748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c92af6-167d-4892-bfd6-ba39eee1b00e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:47.128774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c7f82-4e63-4260-ab72-3874fe8a0687 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:47.135534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:47.136550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.136958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.137595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] PATH_INFO: `/v3/projects/a41efe841c604284b2f3a5e5b55d77a6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.139354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41efe841c604284b2f3a5e5b55d77a6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:47.141485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:47.153267 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 931/1865] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:46 2021] PUT /identity/v3/projects/a8812f28b95f4991a9f6ae089d54e47c/users/17e8196384d04fb298052ef03bb614ba/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:47.155209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92af6-167d-4892-bfd6-ba39eee1b00e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:47.157644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-77c92af6-167d-4892-bfd6-ba39eee1b00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:47.206750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41efe841c604284b2f3a5e5b55d77a6', 'request_id': 'req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:47.218850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41efe841c604284b2f3a5e5b55d77a6', 'request_id': 'req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:47.234476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41efe841c604284b2f3a5e5b55d77a6', 'request_id': 'req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:47.252511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] The token cache is being invalidate because project a41efe841c604284b2f3a5e5b55d77a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:47.253154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:47.254178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d3ad81ad-0ecb-483a-9c3e-9d0cbe6c60f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:47.257010 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 935/1866] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:46 2021] DELETE /identity/v3/projects/a41efe841c604284b2f3a5e5b55d77a6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:47.259766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30436576-e3c2-4859-9ec7-6a863b208e10 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.260154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30436576-e3c2-4859-9ec7-6a863b208e10 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.260529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30436576-e3c2-4859-9ec7-6a863b208e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.271980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92af6-167d-4892-bfd6-ba39eee1b00e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:47.289899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-30436576-e3c2-4859-9ec7-6a863b208e10 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:47.291809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-30436576-e3c2-4859-9ec7-6a863b208e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:47.399052 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 936/1867] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:47.400542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30436576-e3c2-4859-9ec7-6a863b208e10 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:47.401876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-30436576-e3c2-4859-9ec7-6a863b208e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:47.404257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c778d49-0d00-47b6-a46b-4214c040a144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:47.405317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c778d49-0d00-47b6-a46b-4214c040a144 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.405817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c778d49-0d00-47b6-a46b-4214c040a144 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.406433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c778d49-0d00-47b6-a46b-4214c040a144 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.408005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c778d49-0d00-47b6-a46b-4214c040a144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:47.410247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c778d49-0d00-47b6-a46b-4214c040a144 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:47.418730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30436576-e3c2-4859-9ec7-6a863b208e10 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:47.427864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63dbd0-079f-403b-b382-9823e9cb4bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:47.427864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63dbd0-079f-403b-b382-9823e9cb4bbe admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.427864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63dbd0-079f-403b-b382-9823e9cb4bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.427864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63dbd0-079f-403b-b382-9823e9cb4bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.428335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63dbd0-079f-403b-b382-9823e9cb4bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:47.429876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63dbd0-079f-403b-b382-9823e9cb4bbe admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:47.452761 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 937/1868] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:47 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:47.459644 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 932/1869] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:47 2021] POST /identity/v3/users => generated 309 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:47.459838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7242110-52d9-40a3-a919-cbe8259fcf76 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.460065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7242110-52d9-40a3-a919-cbe8259fcf76 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.460410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7242110-52d9-40a3-a919-cbe8259fcf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.460872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c778d49-0d00-47b6-a46b-4214c040a144 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:47.475384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c778d49-0d00-47b6-a46b-4214c040a144 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:47.482952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bbf7-f751-464e-b6d7-41ff5350d7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:47.484023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bbf7-f751-464e-b6d7-41ff5350d7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.484439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bbf7-f751-464e-b6d7-41ff5350d7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.484637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f7242110-52d9-40a3-a919-cbe8259fcf76 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:47.485069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bbf7-f751-464e-b6d7-41ff5350d7f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.485990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f7242110-52d9-40a3-a919-cbe8259fcf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:47.486112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5bbf7-f751-464e-b6d7-41ff5350d7f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:47.486760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5bbf7-f751-464e-b6d7-41ff5350d7f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:47.488933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5bbf7-f751-464e-b6d7-41ff5350d7f2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:47.508559 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 938/1870] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:47.510414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7242110-52d9-40a3-a919-cbe8259fcf76 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:47.521669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7242110-52d9-40a3-a919-cbe8259fcf76 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:47.531855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc56a81-1b17-49a3-9522-843194155a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:47.533176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56a81-1b17-49a3-9522-843194155a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.533609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56a81-1b17-49a3-9522-843194155a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.534663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc56a81-1b17-49a3-9522-843194155a1b admin admin] PATH_INFO: `/v3/projects/a8812f28b95f4991a9f6ae089d54e47c/users/17e8196384d04fb298052ef03bb614ba/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.540253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc56a81-1b17-49a3-9522-843194155a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8812f28b95f4991a9f6ae089d54e47c, user_id=17e8196384d04fb298052ef03bb614ba, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:47.541104 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 933/1871] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:47.543148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bbf7-f751-464e-b6d7-41ff5350d7f2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:47.543541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc56a81-1b17-49a3-9522-843194155a1b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:47.549296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f6b5bbf7-f751-464e-b6d7-41ff5350d7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:47.581844 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 939/1872] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:47 2021] PUT /identity/v3/projects/a8812f28b95f4991a9f6ae089d54e47c/users/17e8196384d04fb298052ef03bb614ba/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:47.581844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724f02e-18e2-49a7-9224-aa7c89518350 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.581844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724f02e-18e2-49a7-9224-aa7c89518350 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.583368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bbf7-f751-464e-b6d7-41ff5350d7f2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:47.583485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724f02e-18e2-49a7-9224-aa7c89518350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.621724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a724f02e-18e2-49a7-9224-aa7c89518350 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:47.623301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a724f02e-18e2-49a7-9224-aa7c89518350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:47.742537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9d0ee-1e39-4c1d-9f45-94875223a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:47.743625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9d0ee-1e39-4c1d-9f45-94875223a71f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.744401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9d0ee-1e39-4c1d-9f45-94875223a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.744820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9d0ee-1e39-4c1d-9f45-94875223a71f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.745711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9d0ee-1e39-4c1d-9f45-94875223a71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:47.748240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9d0ee-1e39-4c1d-9f45-94875223a71f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:47.772551 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 934/1873] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:47 2021] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:47.775583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9d0ee-1e39-4c1d-9f45-94875223a71f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:47.791627 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 940/1874] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:47.795687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9d0ee-1e39-4c1d-9f45-94875223a71f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:47.800456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41677ff9-374d-46c9-9647-390b771911ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:47.801329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41677ff9-374d-46c9-9647-390b771911ca admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.801628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41677ff9-374d-46c9-9647-390b771911ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.801884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41677ff9-374d-46c9-9647-390b771911ca admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.802594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41677ff9-374d-46c9-9647-390b771911ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:47.805034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd6ae-b41d-4edd-8e5d-04e26e88ce31 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:47.805463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41677ff9-374d-46c9-9647-390b771911ca admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:47.807466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd6ae-b41d-4edd-8e5d-04e26e88ce31 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:47.807843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd6ae-b41d-4edd-8e5d-04e26e88ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:47.876748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f6dcd6ae-b41d-4edd-8e5d-04e26e88ce31 None None] MFA Rules not processed for user `17e8196384d04fb298052ef03bb614ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:47.878356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f6dcd6ae-b41d-4edd-8e5d-04e26e88ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:47.914829 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 935/1875] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:47 2021] POST /identity/v3/projects => generated 395 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:47.917464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41677ff9-374d-46c9-9647-390b771911ca admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.012829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41677ff9-374d-46c9-9647-390b771911ca admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.017797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf248e07-6d2b-4d56-8188-bf27aad14ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.018784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf248e07-6d2b-4d56-8188-bf27aad14ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.019133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf248e07-6d2b-4d56-8188-bf27aad14ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.019516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf248e07-6d2b-4d56-8188-bf27aad14ac1 admin admin] PATH_INFO: `/v3/projects/216503ed054e4fc38d1a0669179331cb/users/bfd45ab0eb4548c79faa217e815d8922/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.035438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf248e07-6d2b-4d56-8188-bf27aad14ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216503ed054e4fc38d1a0669179331cb, user_id=bfd45ab0eb4548c79faa217e815d8922, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.038331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf248e07-6d2b-4d56-8188-bf27aad14ac1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.040426 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 941/1876] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:47 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:48.042818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd6ae-b41d-4edd-8e5d-04e26e88ce31 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.056064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd6ae-b41d-4edd-8e5d-04e26e88ce31 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.064901 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 936/1877] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:47 2021] PUT /identity/v3/projects/216503ed054e4fc38d1a0669179331cb/users/bfd45ab0eb4548c79faa217e815d8922/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:48.064901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf248e07-6d2b-4d56-8188-bf27aad14ac1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.135889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0488a-2093-44a2-8c4f-c4b9ae5a180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.136851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0488a-2093-44a2-8c4f-c4b9ae5a180b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.137000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf248e07-6d2b-4d56-8188-bf27aad14ac1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.137757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0488a-2093-44a2-8c4f-c4b9ae5a180b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.137757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0488a-2093-44a2-8c4f-c4b9ae5a180b admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.138652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0488a-2093-44a2-8c4f-c4b9ae5a180b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:48.139114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0488a-2093-44a2-8c4f-c4b9ae5a180b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.141968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0488a-2093-44a2-8c4f-c4b9ae5a180b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.142378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58027067-ab66-4a8d-9626-84acda82f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.143043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58027067-ab66-4a8d-9626-84acda82f21c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.143375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58027067-ab66-4a8d-9626-84acda82f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.143717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58027067-ab66-4a8d-9626-84acda82f21c admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.144432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58027067-ab66-4a8d-9626-84acda82f21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.146355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58027067-ab66-4a8d-9626-84acda82f21c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.155687 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 942/1878] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:48.156623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0488a-2093-44a2-8c4f-c4b9ae5a180b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.159025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c3c0488a-2093-44a2-8c4f-c4b9ae5a180b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:48.172682 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 937/1879] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:48 2021] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:48.172682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58027067-ab66-4a8d-9626-84acda82f21c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.179668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58027067-ab66-4a8d-9626-84acda82f21c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.185909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb672554-7160-4105-874b-71e5e2586d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.186502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672554-7160-4105-874b-71e5e2586d33 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.186841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672554-7160-4105-874b-71e5e2586d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.187120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb672554-7160-4105-874b-71e5e2586d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.187913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb672554-7160-4105-874b-71e5e2586d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.189509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb672554-7160-4105-874b-71e5e2586d33 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.200075 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 938/1880] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:48.200848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb672554-7160-4105-874b-71e5e2586d33 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.211779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb672554-7160-4105-874b-71e5e2586d33 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.218726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed922f-21be-44f9-9d7e-f516b19e4d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.219417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed922f-21be-44f9-9d7e-f516b19e4d5b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.219699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed922f-21be-44f9-9d7e-f516b19e4d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.219975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed922f-21be-44f9-9d7e-f516b19e4d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.220682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed922f-21be-44f9-9d7e-f516b19e4d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.222581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed922f-21be-44f9-9d7e-f516b19e4d5b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.234465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0488a-2093-44a2-8c4f-c4b9ae5a180b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.240836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ab001-193f-4a88-8910-d1bb3eab7895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.241477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ab001-193f-4a88-8910-d1bb3eab7895 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.241856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ab001-193f-4a88-8910-d1bb3eab7895 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.242098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ab001-193f-4a88-8910-d1bb3eab7895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.250403 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 939/1881] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:48 2021] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:48.251351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed922f-21be-44f9-9d7e-f516b19e4d5b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.300186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ab001-193f-4a88-8910-d1bb3eab7895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.301773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ab001-193f-4a88-8910-d1bb3eab7895 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.311489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed922f-21be-44f9-9d7e-f516b19e4d5b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.312007 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 943/1882] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:48 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:48.312662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ab001-193f-4a88-8910-d1bb3eab7895 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.316634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894a8a1-3223-4350-88d9-2e8455a627e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.317715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894a8a1-3223-4350-88d9-2e8455a627e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.317715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894a8a1-3223-4350-88d9-2e8455a627e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.317889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894a8a1-3223-4350-88d9-2e8455a627e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.318945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894a8a1-3223-4350-88d9-2e8455a627e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.320663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894a8a1-3223-4350-88d9-2e8455a627e9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.323323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ab001-193f-4a88-8910-d1bb3eab7895 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.328377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cd36c-5e69-4a45-aea8-f6a9f5710f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.329319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cd36c-5e69-4a45-aea8-f6a9f5710f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.329599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cd36c-5e69-4a45-aea8-f6a9f5710f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.329905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cd36c-5e69-4a45-aea8-f6a9f5710f4b admin admin] PATH_INFO: `/v3/projects/216503ed054e4fc38d1a0669179331cb/users/bfd45ab0eb4548c79faa217e815d8922/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.332171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58cd36c-5e69-4a45-aea8-f6a9f5710f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=216503ed054e4fc38d1a0669179331cb, user_id=bfd45ab0eb4548c79faa217e815d8922, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.333285 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 940/1883] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:48 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:48.334080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894a8a1-3223-4350-88d9-2e8455a627e9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.337387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58cd36c-5e69-4a45-aea8-f6a9f5710f4b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.345417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894a8a1-3223-4350-88d9-2e8455a627e9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.357528 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 944/1884] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:48 2021] PUT /identity/v3/projects/216503ed054e4fc38d1a0669179331cb/users/bfd45ab0eb4548c79faa217e815d8922/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:48.357528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cd36c-5e69-4a45-aea8-f6a9f5710f4b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.409094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e73f56-f307-408c-983d-a4c5fd44bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.409750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e73f56-f307-408c-983d-a4c5fd44bec6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.410026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e73f56-f307-408c-983d-a4c5fd44bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.410296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e73f56-f307-408c-983d-a4c5fd44bec6 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.410995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e73f56-f307-408c-983d-a4c5fd44bec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.412951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e73f56-f307-408c-983d-a4c5fd44bec6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.434594 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 941/1885] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:48 2021] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:48.435594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e73f56-f307-408c-983d-a4c5fd44bec6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.438745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cd36c-5e69-4a45-aea8-f6a9f5710f4b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.444834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702f89f-013e-4817-877f-2e26f61f3d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.445515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702f89f-013e-4817-877f-2e26f61f3d3b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.447613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702f89f-013e-4817-877f-2e26f61f3d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.448001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702f89f-013e-4817-877f-2e26f61f3d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.448865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702f89f-013e-4817-877f-2e26f61f3d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.450628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702f89f-013e-4817-877f-2e26f61f3d3b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.464770 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 945/1886] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:48 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:48.464770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702f89f-013e-4817-877f-2e26f61f3d3b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.473620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702f89f-013e-4817-877f-2e26f61f3d3b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.479875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6b593-439f-4bc2-8dae-da1430612e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.480883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6b593-439f-4bc2-8dae-da1430612e77 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.481812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6b593-439f-4bc2-8dae-da1430612e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.482391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6b593-439f-4bc2-8dae-da1430612e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.483435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6b593-439f-4bc2-8dae-da1430612e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.486163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6b593-439f-4bc2-8dae-da1430612e77 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.501486 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 946/1887] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:48 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:48.501486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6b593-439f-4bc2-8dae-da1430612e77 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.513469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6b593-439f-4bc2-8dae-da1430612e77 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.519790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a762c-ee4c-490d-a053-3ed534033f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.520966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a762c-ee4c-490d-a053-3ed534033f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.521428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a762c-ee4c-490d-a053-3ed534033f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.521702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a762c-ee4c-490d-a053-3ed534033f34 admin admin] PATH_INFO: `/v3/projects/f063cedc2fdc401b95e5e62d4de9223a/users/dc0cade33ed6489b9622ae4978b7fa72/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.526571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e73f56-f307-408c-983d-a4c5fd44bec6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.534008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf126db-ce0d-46c7-8cda-ad87e621778f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.534751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf126db-ce0d-46c7-8cda-ad87e621778f service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.535072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf126db-ce0d-46c7-8cda-ad87e621778f service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.535392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf126db-ce0d-46c7-8cda-ad87e621778f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.538056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eaf126db-ce0d-46c7-8cda-ad87e621778f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:48.550118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a762c-ee4c-490d-a053-3ed534033f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f063cedc2fdc401b95e5e62d4de9223a, user_id=dc0cade33ed6489b9622ae4978b7fa72, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.552803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a762c-ee4c-490d-a053-3ed534033f34 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.579362 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 947/1888] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:48 2021] PUT /identity/v3/projects/f063cedc2fdc401b95e5e62d4de9223a/users/dc0cade33ed6489b9622ae4978b7fa72/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:48.579362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a762c-ee4c-490d-a053-3ed534033f34 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.612860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf126db-ce0d-46c7-8cda-ad87e621778f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.614520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf126db-ce0d-46c7-8cda-ad87e621778f service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.631434 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 942/1889] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:48 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:48.634170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c7c1b-bf93-4434-a336-aeb672fb7694 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.634662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c7c1b-bf93-4434-a336-aeb672fb7694 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.635091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c7c1b-bf93-4434-a336-aeb672fb7694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.648258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a762c-ee4c-490d-a053-3ed534033f34 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.653159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a089b-0474-4e49-a9f2-183a661bdb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.653830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a089b-0474-4e49-a9f2-183a661bdb19 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.654117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a089b-0474-4e49-a9f2-183a661bdb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.654397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a089b-0474-4e49-a9f2-183a661bdb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.655141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a089b-0474-4e49-a9f2-183a661bdb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.657230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a089b-0474-4e49-a9f2-183a661bdb19 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.671786 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 948/1890] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:48 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:48.673065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e95c7c1b-bf93-4434-a336-aeb672fb7694 None None] MFA Rules not processed for user `dc0cade33ed6489b9622ae4978b7fa72`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:48.674889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e95c7c1b-bf93-4434-a336-aeb672fb7694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:48.676009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a089b-0474-4e49-a9f2-183a661bdb19 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.695468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a089b-0474-4e49-a9f2-183a661bdb19 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.700666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce317e-4d8a-4e62-9347-b712d64beb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.702270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce317e-4d8a-4e62-9347-b712d64beb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.702564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce317e-4d8a-4e62-9347-b712d64beb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.702842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce317e-4d8a-4e62-9347-b712d64beb1a admin admin] PATH_INFO: `/v3/projects/ee43dcb838a94f45bff48f143d5b69d8/users/24048ed691094dd2953078550b4cf16c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.735621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce317e-4d8a-4e62-9347-b712d64beb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee43dcb838a94f45bff48f143d5b69d8, user_id=24048ed691094dd2953078550b4cf16c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.739842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce317e-4d8a-4e62-9347-b712d64beb1a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.771302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 949/1891] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:48 2021] PUT /identity/v3/projects/ee43dcb838a94f45bff48f143d5b69d8/users/24048ed691094dd2953078550b4cf16c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:48.771529 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 943/1892] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:48 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:48.777374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce317e-4d8a-4e62-9347-b712d64beb1a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.778091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c21ec5-3b06-4c16-bac4-e0d4fb01c9ff None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.778393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c21ec5-3b06-4c16-bac4-e0d4fb01c9ff None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.778677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c21ec5-3b06-4c16-bac4-e0d4fb01c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.824794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-39c21ec5-3b06-4c16-bac4-e0d4fb01c9ff None None] MFA Rules not processed for user `24048ed691094dd2953078550b4cf16c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:48.827454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-39c21ec5-3b06-4c16-bac4-e0d4fb01c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:48.870618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce317e-4d8a-4e62-9347-b712d64beb1a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:48.877515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a1204-e85f-492c-9dd6-8d5085948a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:48.878517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a1204-e85f-492c-9dd6-8d5085948a64 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:48.879140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a1204-e85f-492c-9dd6-8d5085948a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:48.879462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a1204-e85f-492c-9dd6-8d5085948a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:48.880370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a1204-e85f-492c-9dd6-8d5085948a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:48.882672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a1204-e85f-492c-9dd6-8d5085948a64 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:48.926761 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 950/1893] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:48 2021] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:48.930985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a1204-e85f-492c-9dd6-8d5085948a64 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.946355 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 944/1894] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:45:48.950866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c21ec5-3b06-4c16-bac4-e0d4fb01c9ff None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:48.964670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c21ec5-3b06-4c16-bac4-e0d4fb01c9ff None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.024596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a1204-e85f-492c-9dd6-8d5085948a64 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.028097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a9857-04c3-4ec3-84f3-e0fb1659cb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.029036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9857-04c3-4ec3-84f3-e0fb1659cb75 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.029422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9857-04c3-4ec3-84f3-e0fb1659cb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.029737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9857-04c3-4ec3-84f3-e0fb1659cb75 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.030908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a9857-04c3-4ec3-84f3-e0fb1659cb75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.032640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635e93e-adaf-498d-a498-0d3e4a8163d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.033262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a9857-04c3-4ec3-84f3-e0fb1659cb75 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.033525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635e93e-adaf-498d-a498-0d3e4a8163d6 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.033916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635e93e-adaf-498d-a498-0d3e4a8163d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.034652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635e93e-adaf-498d-a498-0d3e4a8163d6 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.035484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635e93e-adaf-498d-a498-0d3e4a8163d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.037832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635e93e-adaf-498d-a498-0d3e4a8163d6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.063288 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 951/1895] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:48 2021] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:45:49.067550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635e93e-adaf-498d-a498-0d3e4a8163d6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.078425 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 945/1896] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:48 2021] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:49.080530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635e93e-adaf-498d-a498-0d3e4a8163d6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.082644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a9857-04c3-4ec3-84f3-e0fb1659cb75 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.151781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b65c3-9bca-408e-9d4b-e619e9ff4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.152406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b65c3-9bca-408e-9d4b-e619e9ff4a83 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.152697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b65c3-9bca-408e-9d4b-e619e9ff4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.153080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b65c3-9bca-408e-9d4b-e619e9ff4a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.154679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b65c3-9bca-408e-9d4b-e619e9ff4a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.155962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b65c3-9bca-408e-9d4b-e619e9ff4a83 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.173182 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 952/1897] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:49 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:49.174420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b65c3-9bca-408e-9d4b-e619e9ff4a83 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.186274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b65c3-9bca-408e-9d4b-e619e9ff4a83 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.192316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973a35-f3ad-473e-8e98-663e48fb212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.193442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973a35-f3ad-473e-8e98-663e48fb212b admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.193735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973a35-f3ad-473e-8e98-663e48fb212b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.194018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973a35-f3ad-473e-8e98-663e48fb212b admin admin] PATH_INFO: `/v3/projects/ab4cd8717c6e40f89cb5e2256e9d17a1/users/72dad88c25524ea78922595820537c0e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.213065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973a35-f3ad-473e-8e98-663e48fb212b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4cd8717c6e40f89cb5e2256e9d17a1, user_id=72dad88c25524ea78922595820537c0e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.216740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e973a35-f3ad-473e-8e98-663e48fb212b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.233092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a9857-04c3-4ec3-84f3-e0fb1659cb75 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.279632 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 953/1898] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:49 2021] PUT /identity/v3/projects/ab4cd8717c6e40f89cb5e2256e9d17a1/users/72dad88c25524ea78922595820537c0e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:49.288094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973a35-f3ad-473e-8e98-663e48fb212b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.327999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f262-b607-42cc-b4bc-30d1efddf77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.329027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f262-b607-42cc-b4bc-30d1efddf77d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.329444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f262-b607-42cc-b4bc-30d1efddf77d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.329814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912f262-b607-42cc-b4bc-30d1efddf77d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.330617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912f262-b607-42cc-b4bc-30d1efddf77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.332885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912f262-b607-42cc-b4bc-30d1efddf77d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.367365 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 946/1899] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:49 2021] POST /identity/v3/users => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:45:49.367955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973a35-f3ad-473e-8e98-663e48fb212b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.371270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f262-b607-42cc-b4bc-30d1efddf77d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.373908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936855df-af20-4987-876c-a0056315d9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.374646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936855df-af20-4987-876c-a0056315d9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.374999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936855df-af20-4987-876c-a0056315d9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.376540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936855df-af20-4987-876c-a0056315d9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.377299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936855df-af20-4987-876c-a0056315d9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.378969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936855df-af20-4987-876c-a0056315d9e3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.382920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912f262-b607-42cc-b4bc-30d1efddf77d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.390438 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 954/1900] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:49 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:49.391817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd2d01-64c4-4cd0-ba51-5c7f51bd2d9c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.392102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd2d01-64c4-4cd0-ba51-5c7f51bd2d9c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.392377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd2d01-64c4-4cd0-ba51-5c7f51bd2d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.397534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.398419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.398681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.398949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] PATH_INFO: `/v3/users/ed5856d46c544c52baf6946e2d4cd61e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.400811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5856d46c544c52baf6946e2d4cd61e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.402737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.420539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-50cd2d01-64c4-4cd0-ba51-5c7f51bd2d9c None None] MFA Rules not processed for user `bfd45ab0eb4548c79faa217e815d8922`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:49.421859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-50cd2d01-64c4-4cd0-ba51-5c7f51bd2d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:49.455745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5856d46c544c52baf6946e2d4cd61e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:49.456363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5856d46c544c52baf6946e2d4cd61e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:49.467300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5856d46c544c52baf6946e2d4cd61e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:49.468282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5856d46c544c52baf6946e2d4cd61e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:49.476248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5856d46c544c52baf6946e2d4cd61e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:49.495065 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 947/1901] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:49 2021] DELETE /identity/v3/users/ed5856d46c544c52baf6946e2d4cd61e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:49.496394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.499354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:49.501835 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 955/1902] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:49 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:49.502691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd2d01-64c4-4cd0-ba51-5c7f51bd2d9c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.504294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-50cd2d01-64c4-4cd0-ba51-5c7f51bd2d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:49.517907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd2d01-64c4-4cd0-ba51-5c7f51bd2d9c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.576205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2b79a-ceee-429e-9745-358d7feea52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.577106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2b79a-ceee-429e-9745-358d7feea52a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.577389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2b79a-ceee-429e-9745-358d7feea52a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.577658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2b79a-ceee-429e-9745-358d7feea52a admin admin] PATH_INFO: `/v3/projects/ab4cd8717c6e40f89cb5e2256e9d17a1/users/72dad88c25524ea78922595820537c0e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.580535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2b79a-ceee-429e-9745-358d7feea52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4cd8717c6e40f89cb5e2256e9d17a1, user_id=72dad88c25524ea78922595820537c0e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.583458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca2b79a-ceee-429e-9745-358d7feea52a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.595824 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 956/1903] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:49 2021] PUT /identity/v3/projects/ab4cd8717c6e40f89cb5e2256e9d17a1/users/72dad88c25524ea78922595820537c0e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:49.597122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fb66e-7598-4550-a8ea-fcc1ba656cb6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.597407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fb66e-7598-4550-a8ea-fcc1ba656cb6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.597672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fb66e-7598-4550-a8ea-fcc1ba656cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.608481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b00cc-b995-4e37-8293-4820b6241cc5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.616787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0c6fb66e-7598-4550-a8ea-fcc1ba656cb6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:49.618163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0c6fb66e-7598-4550-a8ea-fcc1ba656cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:49.677446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59695bf-cbaa-49ec-8657-522cf3200839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.677913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59695bf-cbaa-49ec-8657-522cf3200839 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.678205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59695bf-cbaa-49ec-8657-522cf3200839 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.678484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59695bf-cbaa-49ec-8657-522cf3200839 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.679453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59695bf-cbaa-49ec-8657-522cf3200839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.682152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59695bf-cbaa-49ec-8657-522cf3200839 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.685073 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 957/1904] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:49.686349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec16b-7b0c-4ce4-900d-cb41dd2c754a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.686758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec16b-7b0c-4ce4-900d-cb41dd2c754a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.687039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec16b-7b0c-4ce4-900d-cb41dd2c754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.698771 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 948/1905] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:49 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:49.700020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59695bf-cbaa-49ec-8657-522cf3200839 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.702000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e59695bf-cbaa-49ec-8657-522cf3200839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:49.718093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9b1ec16b-7b0c-4ce4-900d-cb41dd2c754a None None] MFA Rules not processed for user `72dad88c25524ea78922595820537c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:49.719412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9b1ec16b-7b0c-4ce4-900d-cb41dd2c754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:49.764774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59695bf-cbaa-49ec-8657-522cf3200839 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.769163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb2686-6cc6-40be-904f-5f5e032d5732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.769921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb2686-6cc6-40be-904f-5f5e032d5732 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.770336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb2686-6cc6-40be-904f-5f5e032d5732 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.770697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb2686-6cc6-40be-904f-5f5e032d5732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.780533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb2686-6cc6-40be-904f-5f5e032d5732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.782025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb2686-6cc6-40be-904f-5f5e032d5732 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.793437 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 949/1906] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:49.794237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb2686-6cc6-40be-904f-5f5e032d5732 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.799283 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 958/1907] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:49 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:49.804114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb2686-6cc6-40be-904f-5f5e032d5732 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.809928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07e60b-9fb4-4a6d-a0bb-8b4a360f6fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.810735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec16b-7b0c-4ce4-900d-cb41dd2c754a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.810854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07e60b-9fb4-4a6d-a0bb-8b4a360f6fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.811081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07e60b-9fb4-4a6d-a0bb-8b4a360f6fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.811394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07e60b-9fb4-4a6d-a0bb-8b4a360f6fd3 admin admin] PATH_INFO: `/v3/projects/a98f8b636dd94e37b9e99738402906c9/users/866319444e7c4a28896674bf2b8c71d3/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.812169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9b1ec16b-7b0c-4ce4-900d-cb41dd2c754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:49.829256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07e60b-9fb4-4a6d-a0bb-8b4a360f6fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98f8b636dd94e37b9e99738402906c9, user_id=866319444e7c4a28896674bf2b8c71d3, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.831996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07e60b-9fb4-4a6d-a0bb-8b4a360f6fd3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.846648 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 950/1908] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:49 2021] PUT /identity/v3/projects/a98f8b636dd94e37b9e99738402906c9/users/866319444e7c4a28896674bf2b8c71d3/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:49.850938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07e60b-9fb4-4a6d-a0bb-8b4a360f6fd3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.895967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec16b-7b0c-4ce4-900d-cb41dd2c754a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.925403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07e60b-9fb4-4a6d-a0bb-8b4a360f6fd3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.930579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f481d-74a3-418f-9c98-e9ce056337cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.931873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f481d-74a3-418f-9c98-e9ce056337cd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.932331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f481d-74a3-418f-9c98-e9ce056337cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.932682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f481d-74a3-418f-9c98-e9ce056337cd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.933534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f481d-74a3-418f-9c98-e9ce056337cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.935315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f481d-74a3-418f-9c98-e9ce056337cd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.945724 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 951/1909] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:49 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:49.950597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f481d-74a3-418f-9c98-e9ce056337cd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:49.961978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f481d-74a3-418f-9c98-e9ce056337cd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:49.967793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b08f-8eb6-4b76-a26c-5efbbb072186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.968706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b08f-8eb6-4b76-a26c-5efbbb072186 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.968984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b08f-8eb6-4b76-a26c-5efbbb072186 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.969257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b08f-8eb6-4b76-a26c-5efbbb072186 admin admin] PATH_INFO: `/v3/projects/a98f8b636dd94e37b9e99738402906c9/users/866319444e7c4a28896674bf2b8c71d3/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.970612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c101384-79c9-468c-bc44-7ec032a57a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:49.971288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c101384-79c9-468c-bc44-7ec032a57a0f service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.971631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c101384-79c9-468c-bc44-7ec032a57a0f service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.971735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b08f-8eb6-4b76-a26c-5efbbb072186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98f8b636dd94e37b9e99738402906c9, user_id=866319444e7c4a28896674bf2b8c71d3, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:49.971921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c101384-79c9-468c-bc44-7ec032a57a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:49.974336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b08f-8eb6-4b76-a26c-5efbbb072186 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:49.986831 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 952/1910] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:49 2021] PUT /identity/v3/projects/a98f8b636dd94e37b9e99738402906c9/users/866319444e7c4a28896674bf2b8c71d3/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:49.999595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa18e2-fdb2-420f-840c-590e44c46211 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:49.999595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa18e2-fdb2-420f-840c-590e44c46211 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:49.999595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa18e2-fdb2-420f-840c-590e44c46211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:50.029233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9daa18e2-fdb2-420f-840c-590e44c46211 None None] MFA Rules not processed for user `866319444e7c4a28896674bf2b8c71d3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:50.030567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9daa18e2-fdb2-420f-840c-590e44c46211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:50.043905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c101384-79c9-468c-bc44-7ec032a57a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:50.045580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c101384-79c9-468c-bc44-7ec032a57a0f service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:50.056427 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 959/1911] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:49 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:50.112298 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 953/1912] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:49 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:50.117218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c101384-79c9-468c-bc44-7ec032a57a0f service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:50.128811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c101384-79c9-468c-bc44-7ec032a57a0f service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:50.130713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa18e2-fdb2-420f-840c-590e44c46211 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:50.203907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:50.204893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:50.205093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:50.205374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] PATH_INFO: `/v3/users/dc0cade33ed6489b9622ae4978b7fa72` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:50.206720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0cade33ed6489b9622ae4978b7fa72)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:50.208621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa18e2-fdb2-420f-840c-590e44c46211 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:50.208764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:50.219470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b807ae-55c4-448d-94b9-1a60c96738eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:50.220207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b807ae-55c4-448d-94b9-1a60c96738eb service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:50.220778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b807ae-55c4-448d-94b9-1a60c96738eb service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:50.221488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b807ae-55c4-448d-94b9-1a60c96738eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:50.230686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b807ae-55c4-448d-94b9-1a60c96738eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:50.232830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b807ae-55c4-448d-94b9-1a60c96738eb service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:50.245531 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 954/1913] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:50 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:50.258275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0cade33ed6489b9622ae4978b7fa72'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.268113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0cade33ed6489b9622ae4978b7fa72'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.268982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0cade33ed6489b9622ae4978b7fa72'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.278323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0cade33ed6489b9622ae4978b7fa72'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.291987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0cade33ed6489b9622ae4978b7fa72'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.303243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed48c5-bd58-4f9a-9c6d-fcce52018ae8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:50.303506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed48c5-bd58-4f9a-9c6d-fcce52018ae8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:50.303775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed48c5-bd58-4f9a-9c6d-fcce52018ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:50.305127 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 960/1914] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:50 2021] DELETE /identity/v3/users/dc0cade33ed6489b9622ae4978b7fa72 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:50.323047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-efed48c5-bd58-4f9a-9c6d-fcce52018ae8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:50.324297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-efed48c5-bd58-4f9a-9c6d-fcce52018ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:50.405768 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 955/1915] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:50.413659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:50.416112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:50.476370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed48c5-bd58-4f9a-9c6d-fcce52018ae8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:50.479041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-efed48c5-bd58-4f9a-9c6d-fcce52018ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:50.488598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eed57a-dd62-4b7a-85ca-ae47fe102f1e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:50.495049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549261d-c8ca-46b9-b4ce-5513af612092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:50.496282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549261d-c8ca-46b9-b4ce-5513af612092 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:50.496629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549261d-c8ca-46b9-b4ce-5513af612092 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:50.496982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549261d-c8ca-46b9-b4ce-5513af612092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:50.507985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed48c5-bd58-4f9a-9c6d-fcce52018ae8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:50.508166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549261d-c8ca-46b9-b4ce-5513af612092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:50.510695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549261d-c8ca-46b9-b4ce-5513af612092 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:50.514550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:50.515991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:50.516982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:50.517968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] PATH_INFO: `/v3/projects/95c7210651784fa580afdafc24a36ad5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:50.520566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c7210651784fa580afdafc24a36ad5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:50.523165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:50.525276 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 961/1916] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:50.597888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c7210651784fa580afdafc24a36ad5', 'request_id': 'req-df67a5ca-721e-4964-9b9f-c771c587268f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.606504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c7210651784fa580afdafc24a36ad5', 'request_id': 'req-df67a5ca-721e-4964-9b9f-c771c587268f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.619139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c7210651784fa580afdafc24a36ad5', 'request_id': 'req-df67a5ca-721e-4964-9b9f-c771c587268f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.643841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] The token cache is being invalidate because project 95c7210651784fa580afdafc24a36ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:50.644141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.646296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.651314 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 956/1917] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:50 2021] DELETE /identity/v3/projects/95c7210651784fa580afdafc24a36ad5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:45:50.656234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549261d-c8ca-46b9-b4ce-5513af612092 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:50.667971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549261d-c8ca-46b9-b4ce-5513af612092 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:50.765777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:50.766817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:50.767103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:50.767487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] PATH_INFO: `/v3/users/17e8196384d04fb298052ef03bb614ba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:50.768792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e8196384d04fb298052ef03bb614ba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:50.770760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:50.853730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e8196384d04fb298052ef03bb614ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.866187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e8196384d04fb298052ef03bb614ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.867346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e8196384d04fb298052ef03bb614ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.876176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e8196384d04fb298052ef03bb614ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.882917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:50.884433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:50.897565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e8196384d04fb298052ef03bb614ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.905839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67a5ca-721e-4964-9b9f-c771c587268f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:50.909825 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 962/1918] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:50 2021] DELETE /identity/v3/users/17e8196384d04fb298052ef03bb614ba => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:45:50.913510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78913894-dbf3-43b2-9bb2-f2d97769f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:50.915179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78913894-dbf3-43b2-9bb2-f2d97769f236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:50.916949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78913894-dbf3-43b2-9bb2-f2d97769f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:50.917395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78913894-dbf3-43b2-9bb2-f2d97769f236 admin admin] PATH_INFO: `/v3/users/24048ed691094dd2953078550b4cf16c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:50.919484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78913894-dbf3-43b2-9bb2-f2d97769f236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24048ed691094dd2953078550b4cf16c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:50.922578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78913894-dbf3-43b2-9bb2-f2d97769f236 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:50.989412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78913894-dbf3-43b2-9bb2-f2d97769f236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24048ed691094dd2953078550b4cf16c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:50.990075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78913894-dbf3-43b2-9bb2-f2d97769f236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24048ed691094dd2953078550b4cf16c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.001417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78913894-dbf3-43b2-9bb2-f2d97769f236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24048ed691094dd2953078550b4cf16c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.002467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78913894-dbf3-43b2-9bb2-f2d97769f236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24048ed691094dd2953078550b4cf16c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.012349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78913894-dbf3-43b2-9bb2-f2d97769f236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24048ed691094dd2953078550b4cf16c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.032804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:51.036755 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 957/1919] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:50 2021] DELETE /identity/v3/users/24048ed691094dd2953078550b4cf16c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:51.039936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.042324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098557-97df-4ca3-93b3-53688a811348 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.042619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098557-97df-4ca3-93b3-53688a811348 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.042900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c098557-97df-4ca3-93b3-53688a811348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.064677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7c098557-97df-4ca3-93b3-53688a811348 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:51.066652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7c098557-97df-4ca3-93b3-53688a811348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.172198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb367b-0f63-4c73-8ced-4dab8ea65f61 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:51.177943 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 958/1920] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:51.177943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c098557-97df-4ca3-93b3-53688a811348 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:51.179983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7c098557-97df-4ca3-93b3-53688a811348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.186499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:51.187743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.188253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.188702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] PATH_INFO: `/v3/projects/f063cedc2fdc401b95e5e62d4de9223a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.190077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f063cedc2fdc401b95e5e62d4de9223a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:51.192649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c098557-97df-4ca3-93b3-53688a811348 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:51.192788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:51.199035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:51.199940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.200224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.200512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] PATH_INFO: `/v3/users/d7a3b1d9173e4090b34095a4d334cd56` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.201703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a3b1d9173e4090b34095a4d334cd56)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:51.203733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:51.252040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f063cedc2fdc401b95e5e62d4de9223a', 'request_id': 'req-7ffcccc6-0d64-4815-92e7-263a4b2a061b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.258183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a3b1d9173e4090b34095a4d334cd56'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.259828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a3b1d9173e4090b34095a4d334cd56'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.264866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f063cedc2fdc401b95e5e62d4de9223a', 'request_id': 'req-7ffcccc6-0d64-4815-92e7-263a4b2a061b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.270020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a3b1d9173e4090b34095a4d334cd56'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.271695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a3b1d9173e4090b34095a4d334cd56'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.272902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f063cedc2fdc401b95e5e62d4de9223a', 'request_id': 'req-7ffcccc6-0d64-4815-92e7-263a4b2a061b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.285027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a3b1d9173e4090b34095a4d334cd56'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.287185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] The token cache is being invalidate because project f063cedc2fdc401b95e5e62d4de9223a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:51.287518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.288193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.292951 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 963/1921] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:51 2021] DELETE /identity/v3/projects/f063cedc2fdc401b95e5e62d4de9223a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:51.292951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:51.292951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.305374 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 959/1922] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:51 2021] DELETE /identity/v3/users/d7a3b1d9173e4090b34095a4d334cd56 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:51.307073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:51.308669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.360348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcccc6-0d64-4815-92e7-263a4b2a061b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:51.375648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ab1dc-26e1-400e-852e-5712ee7361a7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:51.381047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:51.381911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.382188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.382458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] PATH_INFO: `/v3/projects/a8812f28b95f4991a9f6ae089d54e47c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.383671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8812f28b95f4991a9f6ae089d54e47c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:51.386230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:51.414493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93605722-1e9d-42cc-addd-d957282bd70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:51.415230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605722-1e9d-42cc-addd-d957282bd70b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.415676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605722-1e9d-42cc-addd-d957282bd70b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.415998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93605722-1e9d-42cc-addd-d957282bd70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.417907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-93605722-1e9d-42cc-addd-d957282bd70b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.431840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93605722-1e9d-42cc-addd-d957282bd70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:51.433287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93605722-1e9d-42cc-addd-d957282bd70b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:51.438433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8812f28b95f4991a9f6ae089d54e47c', 'request_id': 'req-0abf054e-91fa-4bc2-94c6-98421d9f13ba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.444980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8812f28b95f4991a9f6ae089d54e47c', 'request_id': 'req-0abf054e-91fa-4bc2-94c6-98421d9f13ba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.446530 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 964/1923] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:51.448447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93605722-1e9d-42cc-addd-d957282bd70b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:51.450191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-93605722-1e9d-42cc-addd-d957282bd70b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.453941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8812f28b95f4991a9f6ae089d54e47c', 'request_id': 'req-0abf054e-91fa-4bc2-94c6-98421d9f13ba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.463821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93605722-1e9d-42cc-addd-d957282bd70b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:51.466518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] The token cache is being invalidate because project a8812f28b95f4991a9f6ae089d54e47c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:51.466806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.467487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0abf054e-91fa-4bc2-94c6-98421d9f13ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.469675 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 960/1924] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:51 2021] DELETE /identity/v3/projects/a8812f28b95f4991a9f6ae089d54e47c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:51.475538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2edca-86b2-4a5a-a99c-f7b35d19a226 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.475807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2edca-86b2-4a5a-a99c-f7b35d19a226 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.476077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2edca-86b2-4a5a-a99c-f7b35d19a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.499153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-49e2edca-86b2-4a5a-a99c-f7b35d19a226 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:51.500579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49e2edca-86b2-4a5a-a99c-f7b35d19a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.528613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dae47a-4f2f-4910-9d66-9d3b321b6dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:51.529494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae47a-4f2f-4910-9d66-9d3b321b6dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.529781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae47a-4f2f-4910-9d66-9d3b321b6dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.530059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae47a-4f2f-4910-9d66-9d3b321b6dd1 admin admin] PATH_INFO: `/v3/users/72dad88c25524ea78922595820537c0e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.533099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dae47a-4f2f-4910-9d66-9d3b321b6dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72dad88c25524ea78922595820537c0e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:51.535053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dae47a-4f2f-4910-9d66-9d3b321b6dd1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:51.587454 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 961/1925] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:51.587454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2edca-86b2-4a5a-a99c-f7b35d19a226 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:51.587454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49e2edca-86b2-4a5a-a99c-f7b35d19a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.610473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2edca-86b2-4a5a-a99c-f7b35d19a226 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:51.610661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5dae47a-4f2f-4910-9d66-9d3b321b6dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72dad88c25524ea78922595820537c0e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.616043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:51.618321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.619184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.619631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] PATH_INFO: `/v3/projects/3e29963d3e6243cc983112e01c0a6a5b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.621173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e29963d3e6243cc983112e01c0a6a5b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:51.622678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5dae47a-4f2f-4910-9d66-9d3b321b6dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72dad88c25524ea78922595820537c0e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.623687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5dae47a-4f2f-4910-9d66-9d3b321b6dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72dad88c25524ea78922595820537c0e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.623937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:51.633665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5dae47a-4f2f-4910-9d66-9d3b321b6dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72dad88c25524ea78922595820537c0e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.646199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5dae47a-4f2f-4910-9d66-9d3b321b6dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72dad88c25524ea78922595820537c0e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.656394 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 965/1926] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:51 2021] DELETE /identity/v3/users/72dad88c25524ea78922595820537c0e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:51.658319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81adb1-97ca-4a44-965f-ae13e3ecad11 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.658565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81adb1-97ca-4a44-965f-ae13e3ecad11 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.659191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81adb1-97ca-4a44-965f-ae13e3ecad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.681848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e29963d3e6243cc983112e01c0a6a5b', 'request_id': 'req-30ba7005-904b-46c8-9551-3113b84868d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.683732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bd81adb1-97ca-4a44-965f-ae13e3ecad11 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:51.684925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bd81adb1-97ca-4a44-965f-ae13e3ecad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.689474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e29963d3e6243cc983112e01c0a6a5b', 'request_id': 'req-30ba7005-904b-46c8-9551-3113b84868d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.701085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e29963d3e6243cc983112e01c0a6a5b', 'request_id': 'req-30ba7005-904b-46c8-9551-3113b84868d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.718462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] The token cache is being invalidate because project 3e29963d3e6243cc983112e01c0a6a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:51.718904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.719623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.725322 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 962/1927] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:51 2021] DELETE /identity/v3/projects/3e29963d3e6243cc983112e01c0a6a5b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:51.726248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:51.727709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.780652 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 966/1928] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:51.784869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81adb1-97ca-4a44-965f-ae13e3ecad11 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:51.805645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81adb1-97ca-4a44-965f-ae13e3ecad11 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:51.812959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02e3b6-c3fb-4600-96b3-3012b9cc0b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:51.813883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02e3b6-c3fb-4600-96b3-3012b9cc0b4b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.814702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02e3b6-c3fb-4600-96b3-3012b9cc0b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.815298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02e3b6-c3fb-4600-96b3-3012b9cc0b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.818193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02e3b6-c3fb-4600-96b3-3012b9cc0b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:51.818904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02e3b6-c3fb-4600-96b3-3012b9cc0b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:51.823943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02e3b6-c3fb-4600-96b3-3012b9cc0b4b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:51.825678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba7005-904b-46c8-9551-3113b84868d6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:51.843335 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 967/1929] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:45:51.848505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:51.849609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02e3b6-c3fb-4600-96b3-3012b9cc0b4b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:51.849717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.850025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.850220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] PATH_INFO: `/v3/users/bfd45ab0eb4548c79faa217e815d8922` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.851584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd45ab0eb4548c79faa217e815d8922)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:51.853839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:51.886553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02e3b6-c3fb-4600-96b3-3012b9cc0b4b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:51.895150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6395ba6-e724-4c79-ba0d-27ace542ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:51.896378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6395ba6-e724-4c79-ba0d-27ace542ad19 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:51.896778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6395ba6-e724-4c79-ba0d-27ace542ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:51.897181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6395ba6-e724-4c79-ba0d-27ace542ad19 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:51.898190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6395ba6-e724-4c79-ba0d-27ace542ad19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:51.900967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6395ba6-e724-4c79-ba0d-27ace542ad19 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:51.931945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd45ab0eb4548c79faa217e815d8922'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.932812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd45ab0eb4548c79faa217e815d8922'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.938860 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 968/1930] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:51 2021] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:51.939994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6395ba6-e724-4c79-ba0d-27ace542ad19 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:51.941935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d6395ba6-e724-4c79-ba0d-27ace542ad19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:51.947455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd45ab0eb4548c79faa217e815d8922'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.948278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd45ab0eb4548c79faa217e815d8922'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.957710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd45ab0eb4548c79faa217e815d8922'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:51.999305 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 963/1931] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:51 2021] DELETE /identity/v3/users/bfd45ab0eb4548c79faa217e815d8922 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:52.000274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.001677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.045114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6395ba6-e724-4c79-ba0d-27ace542ad19 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.079724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aace8-e456-4377-b693-0571edd257c1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.088813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c4aa8-4134-43a1-996f-4451d4e80dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.089932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c4aa8-4134-43a1-996f-4451d4e80dbe admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.090316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c4aa8-4134-43a1-996f-4451d4e80dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.090704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c4aa8-4134-43a1-996f-4451d4e80dbe admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.092430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c4aa8-4134-43a1-996f-4451d4e80dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.096696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c4aa8-4134-43a1-996f-4451d4e80dbe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.129949 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 964/1932] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:51 2021] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:52.130925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c4aa8-4134-43a1-996f-4451d4e80dbe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.135604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.136514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.136795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.142845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c4aa8-4134-43a1-996f-4451d4e80dbe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.143423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] PATH_INFO: `/v3/projects/ee43dcb838a94f45bff48f143d5b69d8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.145455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee43dcb838a94f45bff48f143d5b69d8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.147727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060c6d2-6aa0-47b1-b238-41123f34e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.149546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.149774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c6d2-6aa0-47b1-b238-41123f34e56e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.150164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c6d2-6aa0-47b1-b238-41123f34e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.150510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060c6d2-6aa0-47b1-b238-41123f34e56e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.151432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060c6d2-6aa0-47b1-b238-41123f34e56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.153317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060c6d2-6aa0-47b1-b238-41123f34e56e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.170220 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 965/1933] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:52 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:52.171111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060c6d2-6aa0-47b1-b238-41123f34e56e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.173144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3060c6d2-6aa0-47b1-b238-41123f34e56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.187144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060c6d2-6aa0-47b1-b238-41123f34e56e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.193718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.194752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.195044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.195376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] PATH_INFO: `/v3/projects/ab4cd8717c6e40f89cb5e2256e9d17a1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.197434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4cd8717c6e40f89cb5e2256e9d17a1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.199493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.227167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee43dcb838a94f45bff48f143d5b69d8', 'request_id': 'req-a249d747-6e17-4eec-accb-e51083fd2dbb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.241110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee43dcb838a94f45bff48f143d5b69d8', 'request_id': 'req-a249d747-6e17-4eec-accb-e51083fd2dbb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.249761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee43dcb838a94f45bff48f143d5b69d8', 'request_id': 'req-a249d747-6e17-4eec-accb-e51083fd2dbb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.258684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4cd8717c6e40f89cb5e2256e9d17a1', 'request_id': 'req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.261492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] The token cache is being invalidate because project ee43dcb838a94f45bff48f143d5b69d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:52.261995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.262575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.264201 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 969/1934] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:51 2021] DELETE /identity/v3/projects/ee43dcb838a94f45bff48f143d5b69d8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:52.267757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4cd8717c6e40f89cb5e2256e9d17a1', 'request_id': 'req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.267906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.269174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.277177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4cd8717c6e40f89cb5e2256e9d17a1', 'request_id': 'req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.288935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] The token cache is being invalidate because project ab4cd8717c6e40f89cb5e2256e9d17a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:52.289310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.290006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.292505 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 966/1935] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:52 2021] DELETE /identity/v3/projects/ab4cd8717c6e40f89cb5e2256e9d17a1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:52.298173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.299719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.339910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249d747-6e17-4eec-accb-e51083fd2dbb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.365994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5e4c0-fc3e-42a2-aa20-6946d428f87e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.371680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.372534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.372820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.373099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] PATH_INFO: `/v3/projects/216503ed054e4fc38d1a0669179331cb` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.374292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=216503ed054e4fc38d1a0669179331cb)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.376277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.394919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f306aa-419f-4171-86bb-42c20f8664f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.395620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f306aa-419f-4171-86bb-42c20f8664f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.395929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f306aa-419f-4171-86bb-42c20f8664f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.396203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f306aa-419f-4171-86bb-42c20f8664f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.396941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f306aa-419f-4171-86bb-42c20f8664f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.398507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f306aa-419f-4171-86bb-42c20f8664f2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.409162 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 970/1936] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:52 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:52.409969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f306aa-419f-4171-86bb-42c20f8664f2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.411581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-70f306aa-419f-4171-86bb-42c20f8664f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.423969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216503ed054e4fc38d1a0669179331cb', 'request_id': 'req-880d69f5-e412-4ae5-a84e-118fde5d9aaa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.424401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f306aa-419f-4171-86bb-42c20f8664f2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.430242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216503ed054e4fc38d1a0669179331cb', 'request_id': 'req-880d69f5-e412-4ae5-a84e-118fde5d9aaa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.438064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216503ed054e4fc38d1a0669179331cb', 'request_id': 'req-880d69f5-e412-4ae5-a84e-118fde5d9aaa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.448332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] The token cache is being invalidate because project 216503ed054e4fc38d1a0669179331cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:52.448626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.449318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-880d69f5-e412-4ae5-a84e-118fde5d9aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.451073 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 967/1937] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:52 2021] DELETE /identity/v3/projects/216503ed054e4fc38d1a0669179331cb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:52.452428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99eeb-2967-4e11-b425-65e98018bea5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.452722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99eeb-2967-4e11-b425-65e98018bea5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.453002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99eeb-2967-4e11-b425-65e98018bea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.470510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-21a99eeb-2967-4e11-b425-65e98018bea5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:52.471791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-21a99eeb-2967-4e11-b425-65e98018bea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.486957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d6414-910d-4508-9c25-edc9c0ad3bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.487861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d6414-910d-4508-9c25-edc9c0ad3bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.488136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d6414-910d-4508-9c25-edc9c0ad3bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.488402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d6414-910d-4508-9c25-edc9c0ad3bb2 admin admin] PATH_INFO: `/v3/users/866319444e7c4a28896674bf2b8c71d3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.489749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d6414-910d-4508-9c25-edc9c0ad3bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=866319444e7c4a28896674bf2b8c71d3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.491875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d6414-910d-4508-9c25-edc9c0ad3bb2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.538827 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 968/1938] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:52.539398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99eeb-2967-4e11-b425-65e98018bea5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.541290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-21a99eeb-2967-4e11-b425-65e98018bea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.543966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5a6d6414-910d-4508-9c25-edc9c0ad3bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866319444e7c4a28896674bf2b8c71d3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.551654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5a6d6414-910d-4508-9c25-edc9c0ad3bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866319444e7c4a28896674bf2b8c71d3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.552355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5a6d6414-910d-4508-9c25-edc9c0ad3bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866319444e7c4a28896674bf2b8c71d3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.553587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99eeb-2967-4e11-b425-65e98018bea5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.559541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f91bf-2cf1-4ec3-a77c-a503a046562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.560543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f91bf-2cf1-4ec3-a77c-a503a046562d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.560721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5a6d6414-910d-4508-9c25-edc9c0ad3bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866319444e7c4a28896674bf2b8c71d3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.560867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f91bf-2cf1-4ec3-a77c-a503a046562d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.561141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f91bf-2cf1-4ec3-a77c-a503a046562d admin admin] PATH_INFO: `/v3/projects/bb40949f71d24b4f85ec88db3e96df59/users/0b5a7792dab54c4daa582c88107fbc44/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.573992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5a6d6414-910d-4508-9c25-edc9c0ad3bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866319444e7c4a28896674bf2b8c71d3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:52.576542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f91bf-2cf1-4ec3-a77c-a503a046562d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb40949f71d24b4f85ec88db3e96df59, user_id=0b5a7792dab54c4daa582c88107fbc44, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.579209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f91bf-2cf1-4ec3-a77c-a503a046562d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.581905 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 971/1939] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:52 2021] DELETE /identity/v3/users/866319444e7c4a28896674bf2b8c71d3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:52.583175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e244f6-10a8-454a-b103-ecb779e50da2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.583497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e244f6-10a8-454a-b103-ecb779e50da2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.583772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e244f6-10a8-454a-b103-ecb779e50da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.600135 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 969/1940] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:52 2021] PUT /identity/v3/projects/bb40949f71d24b4f85ec88db3e96df59/users/0b5a7792dab54c4daa582c88107fbc44/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:52.608466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c2e244f6-10a8-454a-b103-ecb779e50da2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:52.609778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c2e244f6-10a8-454a-b103-ecb779e50da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.611452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eddf02-95c0-45a2-8a7d-3c60eca156bc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.611741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eddf02-95c0-45a2-8a7d-3c60eca156bc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.612073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eddf02-95c0-45a2-8a7d-3c60eca156bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.633475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-59eddf02-95c0-45a2-8a7d-3c60eca156bc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:52.635021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-59eddf02-95c0-45a2-8a7d-3c60eca156bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.689553 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 972/1941] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:52.690698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de223293-9e72-41c5-a94a-72e0f589390f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.691196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de223293-9e72-41c5-a94a-72e0f589390f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.691515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de223293-9e72-41c5-a94a-72e0f589390f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.721164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-de223293-9e72-41c5-a94a-72e0f589390f None None] MFA Rules not processed for user `0b5a7792dab54c4daa582c88107fbc44`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:52.722610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-de223293-9e72-41c5-a94a-72e0f589390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.726896 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 970/1942] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:52.726896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24fdad-7baa-4330-b3a3-092865190f66 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.726896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24fdad-7baa-4330-b3a3-092865190f66 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.726896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24fdad-7baa-4330-b3a3-092865190f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.751059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2f24fdad-7baa-4330-b3a3-092865190f66 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:52.752541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2f24fdad-7baa-4330-b3a3-092865190f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.765301 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 971/1943] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:52.766457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24fdad-7baa-4330-b3a3-092865190f66 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.777833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24fdad-7baa-4330-b3a3-092865190f66 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.784364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d89d7-6dda-4f8b-9471-b0d21bd47206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.785152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d89d7-6dda-4f8b-9471-b0d21bd47206 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.785540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d89d7-6dda-4f8b-9471-b0d21bd47206 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.785920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d89d7-6dda-4f8b-9471-b0d21bd47206 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.786775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d89d7-6dda-4f8b-9471-b0d21bd47206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:52.787523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d89d7-6dda-4f8b-9471-b0d21bd47206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.789324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d89d7-6dda-4f8b-9471-b0d21bd47206 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.810615 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 972/1944] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:52.811524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d89d7-6dda-4f8b-9471-b0d21bd47206 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.824621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d89d7-6dda-4f8b-9471-b0d21bd47206 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.826047 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 973/1945] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:52 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:52.826932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de223293-9e72-41c5-a94a-72e0f589390f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.832618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82312e34-ec28-46ab-98e5-144c91509609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.833201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82312e34-ec28-46ab-98e5-144c91509609 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.833530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82312e34-ec28-46ab-98e5-144c91509609 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.834160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82312e34-ec28-46ab-98e5-144c91509609 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.834561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82312e34-ec28-46ab-98e5-144c91509609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:52.834791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82312e34-ec28-46ab-98e5-144c91509609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.836435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82312e34-ec28-46ab-98e5-144c91509609 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.838956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de223293-9e72-41c5-a94a-72e0f589390f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.844034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75d0bd-b3e3-4111-a5ed-4dda316d7acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.844791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d0bd-b3e3-4111-a5ed-4dda316d7acd admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.845115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d0bd-b3e3-4111-a5ed-4dda316d7acd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.845467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d0bd-b3e3-4111-a5ed-4dda316d7acd admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.846246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75d0bd-b3e3-4111-a5ed-4dda316d7acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.848264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75d0bd-b3e3-4111-a5ed-4dda316d7acd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.850251 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 973/1946] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:52.850851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82312e34-ec28-46ab-98e5-144c91509609 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.852537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-82312e34-ec28-46ab-98e5-144c91509609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:52.865655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82312e34-ec28-46ab-98e5-144c91509609 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:52.871191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b5b77-68ee-4d5f-b01f-fedcc5daff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:52.872104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5b77-68ee-4d5f-b01f-fedcc5daff3a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:52.872214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5b77-68ee-4d5f-b01f-fedcc5daff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:52.872416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5b77-68ee-4d5f-b01f-fedcc5daff3a admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:52.873122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b5b77-68ee-4d5f-b01f-fedcc5daff3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:52.875047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b5b77-68ee-4d5f-b01f-fedcc5daff3a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:52.885119 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 974/1947] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:52 2021] POST /identity/v3/projects => generated 409 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:52.885987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75d0bd-b3e3-4111-a5ed-4dda316d7acd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.971183 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 974/1948] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:52 2021] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:52.975715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b5b77-68ee-4d5f-b01f-fedcc5daff3a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:52.993719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75d0bd-b3e3-4111-a5ed-4dda316d7acd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.061260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b5b77-68ee-4d5f-b01f-fedcc5daff3a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.062636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8088cd3-a698-4990-b609-a2f9147fb1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.063555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8088cd3-a698-4990-b609-a2f9147fb1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.063902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8088cd3-a698-4990-b609-a2f9147fb1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.064186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8088cd3-a698-4990-b609-a2f9147fb1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.065001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8088cd3-a698-4990-b609-a2f9147fb1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.067461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8088cd3-a698-4990-b609-a2f9147fb1b4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.067832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef175dc-4d15-4a6c-bf46-315fba152ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.068899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef175dc-4d15-4a6c-bf46-315fba152ead admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.069364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef175dc-4d15-4a6c-bf46-315fba152ead admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.069882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef175dc-4d15-4a6c-bf46-315fba152ead admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.070762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef175dc-4d15-4a6c-bf46-315fba152ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.073531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef175dc-4d15-4a6c-bf46-315fba152ead admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.154483 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 975/1949] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:52 2021] POST /identity/v3/users => generated 305 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:53.155555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef175dc-4d15-4a6c-bf46-315fba152ead admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.159135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eef175dc-4d15-4a6c-bf46-315fba152ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:53.163877 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 975/1950] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:52 2021] POST /identity/v3/projects => generated 393 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:53.164988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8088cd3-a698-4990-b609-a2f9147fb1b4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.175962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef175dc-4d15-4a6c-bf46-315fba152ead admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.232554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8088cd3-a698-4990-b609-a2f9147fb1b4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.241646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c749f01-5167-437c-893f-4f6fc9c469c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.242451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c749f01-5167-437c-893f-4f6fc9c469c0 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.242801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c749f01-5167-437c-893f-4f6fc9c469c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.243149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c749f01-5167-437c-893f-4f6fc9c469c0 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.244224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c749f01-5167-437c-893f-4f6fc9c469c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.246355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c749f01-5167-437c-893f-4f6fc9c469c0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.253043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.253953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.254243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.254559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] PATH_INFO: `/v3/projects/a98f8b636dd94e37b9e99738402906c9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.255973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98f8b636dd94e37b9e99738402906c9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.261046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.267296 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 976/1951] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:53 2021] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:53.267897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c749f01-5167-437c-893f-4f6fc9c469c0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.281508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c749f01-5167-437c-893f-4f6fc9c469c0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.287908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8d4f6-1e66-4c1e-8bda-b0d072abb986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.288710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d4f6-1e66-4c1e-8bda-b0d072abb986 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.289046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d4f6-1e66-4c1e-8bda-b0d072abb986 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.289364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d4f6-1e66-4c1e-8bda-b0d072abb986 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.290635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8d4f6-1e66-4c1e-8bda-b0d072abb986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.292739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8d4f6-1e66-4c1e-8bda-b0d072abb986 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.303586 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 977/1952] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:53 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:53.304230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8d4f6-1e66-4c1e-8bda-b0d072abb986 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.314554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8d4f6-1e66-4c1e-8bda-b0d072abb986 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.316191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98f8b636dd94e37b9e99738402906c9', 'request_id': 'req-49ce8a16-33a4-404f-b626-a7439fc671cc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:53.324054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98f8b636dd94e37b9e99738402906c9', 'request_id': 'req-49ce8a16-33a4-404f-b626-a7439fc671cc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:53.332109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98f8b636dd94e37b9e99738402906c9', 'request_id': 'req-49ce8a16-33a4-404f-b626-a7439fc671cc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:53.345266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] The token cache is being invalidate because project a98f8b636dd94e37b9e99738402906c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:53.345558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:53.346312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:53.353409 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 976/1953] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:53 2021] DELETE /identity/v3/projects/a98f8b636dd94e37b9e99738402906c9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:53.353409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.353409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:53.379968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776afa9d-d633-42a7-8050-b39afee10c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.380746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776afa9d-d633-42a7-8050-b39afee10c7f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.381107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776afa9d-d633-42a7-8050-b39afee10c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.381453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776afa9d-d633-42a7-8050-b39afee10c7f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.382256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776afa9d-d633-42a7-8050-b39afee10c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.384403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776afa9d-d633-42a7-8050-b39afee10c7f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.407957 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 978/1954] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:53 2021] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:53.409025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776afa9d-d633-42a7-8050-b39afee10c7f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.410602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-776afa9d-d633-42a7-8050-b39afee10c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:53.419594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce8a16-33a4-404f-b626-a7439fc671cc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.423289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776afa9d-d633-42a7-8050-b39afee10c7f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.429459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9348c7-2ffd-40fd-b5a5-31eb67acde15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.430263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9348c7-2ffd-40fd-b5a5-31eb67acde15 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.430640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9348c7-2ffd-40fd-b5a5-31eb67acde15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.430944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9348c7-2ffd-40fd-b5a5-31eb67acde15 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.431718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9348c7-2ffd-40fd-b5a5-31eb67acde15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.432801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c27291-b774-4176-805b-a17c23ed3d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.433353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9348c7-2ffd-40fd-b5a5-31eb67acde15 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.433483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c27291-b774-4176-805b-a17c23ed3d77 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.433722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c27291-b774-4176-805b-a17c23ed3d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.433996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c27291-b774-4176-805b-a17c23ed3d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.434731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c27291-b774-4176-805b-a17c23ed3d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.436488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c27291-b774-4176-805b-a17c23ed3d77 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.446606 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 977/1955] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:53 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:53.446606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbbc9a-a359-44a5-9925-92578c3c2430 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.446606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbbc9a-a359-44a5-9925-92578c3c2430 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.446606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbbc9a-a359-44a5-9925-92578c3c2430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.446979 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 979/1956] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:53 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:53.450542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c27291-b774-4176-805b-a17c23ed3d77 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.452203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c0c27291-b774-4176-805b-a17c23ed3d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:53.464580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-02bbbc9a-a359-44a5-9925-92578c3c2430 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:53.464874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c27291-b774-4176-805b-a17c23ed3d77 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.465756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-02bbbc9a-a359-44a5-9925-92578c3c2430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:53.469514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb79fa-dc1f-4b85-9520-79ceb13a8181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.470163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb79fa-dc1f-4b85-9520-79ceb13a8181 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.470446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb79fa-dc1f-4b85-9520-79ceb13a8181 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.470722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb79fa-dc1f-4b85-9520-79ceb13a8181 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.471557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb79fa-dc1f-4b85-9520-79ceb13a8181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.473134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb79fa-dc1f-4b85-9520-79ceb13a8181 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.474384 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 978/1957] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:53.475139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbbc9a-a359-44a5-9925-92578c3c2430 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.486260 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 980/1958] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:53 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:53.486260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb79fa-dc1f-4b85-9520-79ceb13a8181 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.486503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbbc9a-a359-44a5-9925-92578c3c2430 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.489884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f8cc9-32a9-4e94-890d-9a63b005bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.490740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8cc9-32a9-4e94-890d-9a63b005bf41 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.491014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8cc9-32a9-4e94-890d-9a63b005bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.491314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8cc9-32a9-4e94-890d-9a63b005bf41 admin admin] PATH_INFO: `/v3/projects/60925009468f47debdd606cf1eaf7154/users/6b149076c0724f46804a486e4b346db1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.495788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb79fa-dc1f-4b85-9520-79ceb13a8181 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.500726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ff702-6de3-4efe-9b8d-cc7333680358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.501588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ff702-6de3-4efe-9b8d-cc7333680358 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.501875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ff702-6de3-4efe-9b8d-cc7333680358 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.502155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ff702-6de3-4efe-9b8d-cc7333680358 admin admin] PATH_INFO: `/v3/projects/2116bbaf320a4283b72cbea04c986e91/users/a502fc0378a74a6cbe8caa84f781e719/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.506140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f8cc9-32a9-4e94-890d-9a63b005bf41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60925009468f47debdd606cf1eaf7154, user_id=6b149076c0724f46804a486e4b346db1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.508801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f8cc9-32a9-4e94-890d-9a63b005bf41 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.516840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ff702-6de3-4efe-9b8d-cc7333680358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2116bbaf320a4283b72cbea04c986e91, user_id=a502fc0378a74a6cbe8caa84f781e719, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.519469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ff702-6de3-4efe-9b8d-cc7333680358 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.522532 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 979/1959] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:53 2021] PUT /identity/v3/projects/60925009468f47debdd606cf1eaf7154/users/6b149076c0724f46804a486e4b346db1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:53.523826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42630f1-4137-4f6d-999a-e682c18f2126 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.524138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42630f1-4137-4f6d-999a-e682c18f2126 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.524415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42630f1-4137-4f6d-999a-e682c18f2126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.534324 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 981/1960] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:53 2021] PUT /identity/v3/projects/2116bbaf320a4283b72cbea04c986e91/users/a502fc0378a74a6cbe8caa84f781e719/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:53.536351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ff702-6de3-4efe-9b8d-cc7333680358 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.543609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d42630f1-4137-4f6d-999a-e682c18f2126 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:53.544748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d42630f1-4137-4f6d-999a-e682c18f2126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:53.600570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ff702-6de3-4efe-9b8d-cc7333680358 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.601642 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 980/1961] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:53.602471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42630f1-4137-4f6d-999a-e682c18f2126 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.606065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d4ded-30ba-43d7-95ab-e35f304988a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.606726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d4ded-30ba-43d7-95ab-e35f304988a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.607012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d4ded-30ba-43d7-95ab-e35f304988a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.607319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d4ded-30ba-43d7-95ab-e35f304988a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.608064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d4ded-30ba-43d7-95ab-e35f304988a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.609652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d4ded-30ba-43d7-95ab-e35f304988a8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.612264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42630f1-4137-4f6d-999a-e682c18f2126 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.616834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe55ae-81e7-4acc-a265-27fc246a77a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.617472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe55ae-81e7-4acc-a265-27fc246a77a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.617749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe55ae-81e7-4acc-a265-27fc246a77a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.618019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe55ae-81e7-4acc-a265-27fc246a77a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.618778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe55ae-81e7-4acc-a265-27fc246a77a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.622857 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 982/1962] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:53 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:53.622989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe55ae-81e7-4acc-a265-27fc246a77a2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.623096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df9078-7355-4061-89a4-1ce2b55a96e9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.623096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df9078-7355-4061-89a4-1ce2b55a96e9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.623096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df9078-7355-4061-89a4-1ce2b55a96e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.633584 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 981/1963] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:53 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:53.633584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe55ae-81e7-4acc-a265-27fc246a77a2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.641124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe55ae-81e7-4acc-a265-27fc246a77a2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.645852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a65ec-f306-40c2-8e16-a9b0fc6b1e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.646590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a65ec-f306-40c2-8e16-a9b0fc6b1e14 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.646873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a65ec-f306-40c2-8e16-a9b0fc6b1e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.647147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a65ec-f306-40c2-8e16-a9b0fc6b1e14 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.647919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a65ec-f306-40c2-8e16-a9b0fc6b1e14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:53.648227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a65ec-f306-40c2-8e16-a9b0fc6b1e14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.650345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a65ec-f306-40c2-8e16-a9b0fc6b1e14 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.652080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a5df9078-7355-4061-89a4-1ce2b55a96e9 None None] MFA Rules not processed for user `a502fc0378a74a6cbe8caa84f781e719`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:53.653335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a5df9078-7355-4061-89a4-1ce2b55a96e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:53.667282 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 982/1964] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:53.667282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a65ec-f306-40c2-8e16-a9b0fc6b1e14 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.673812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a65ec-f306-40c2-8e16-a9b0fc6b1e14 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.678311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622b32a-21f7-4d89-b0ee-087e194002e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.679153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622b32a-21f7-4d89-b0ee-087e194002e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.679461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622b32a-21f7-4d89-b0ee-087e194002e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.679734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622b32a-21f7-4d89-b0ee-087e194002e2 admin admin] PATH_INFO: `/v3/projects/86ee5c27bb6e4b2d89671817ecd59b63/users/17a180a783424ce88239c7edb25bafc3/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.693508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622b32a-21f7-4d89-b0ee-087e194002e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ee5c27bb6e4b2d89671817ecd59b63, user_id=17a180a783424ce88239c7edb25bafc3, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.696249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622b32a-21f7-4d89-b0ee-087e194002e2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.709191 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 983/1965] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:53 2021] PUT /identity/v3/projects/86ee5c27bb6e4b2d89671817ecd59b63/users/17a180a783424ce88239c7edb25bafc3/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:53.710060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622b32a-21f7-4d89-b0ee-087e194002e2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.719762 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 983/1966] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:53 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:53.719762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df9078-7355-4061-89a4-1ce2b55a96e9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.730340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df9078-7355-4061-89a4-1ce2b55a96e9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.772996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622b32a-21f7-4d89-b0ee-087e194002e2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.778907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401496f7-5519-4de4-b8a2-a3a9a54d12c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.779811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401496f7-5519-4de4-b8a2-a3a9a54d12c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.780095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401496f7-5519-4de4-b8a2-a3a9a54d12c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.780364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401496f7-5519-4de4-b8a2-a3a9a54d12c4 admin admin] PATH_INFO: `/v3/projects/60925009468f47debdd606cf1eaf7154/users/6b149076c0724f46804a486e4b346db1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.782434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401496f7-5519-4de4-b8a2-a3a9a54d12c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60925009468f47debdd606cf1eaf7154, user_id=6b149076c0724f46804a486e4b346db1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.784898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf7cf1-5e34-4553-9a64-2df45bd2a421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.785543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf7cf1-5e34-4553-9a64-2df45bd2a421 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.785650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401496f7-5519-4de4-b8a2-a3a9a54d12c4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.785829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf7cf1-5e34-4553-9a64-2df45bd2a421 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.786107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf7cf1-5e34-4553-9a64-2df45bd2a421 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.786942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf7cf1-5e34-4553-9a64-2df45bd2a421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.788943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf7cf1-5e34-4553-9a64-2df45bd2a421 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.812959 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 984/1967] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:53 2021] PUT /identity/v3/projects/60925009468f47debdd606cf1eaf7154/users/6b149076c0724f46804a486e4b346db1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:53.812959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b95f-a1e2-4d39-ad6a-3f794d2d3891 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.812959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b95f-a1e2-4d39-ad6a-3f794d2d3891 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.812959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659b95f-a1e2-4d39-ad6a-3f794d2d3891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.820491 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 984/1968] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:53 2021] POST /identity/v3/projects => generated 359 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:53.821444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf7cf1-5e34-4553-9a64-2df45bd2a421 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.836874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5659b95f-a1e2-4d39-ad6a-3f794d2d3891 None None] MFA Rules not processed for user `17a180a783424ce88239c7edb25bafc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:53.838643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5659b95f-a1e2-4d39-ad6a-3f794d2d3891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:53.882696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf7cf1-5e34-4553-9a64-2df45bd2a421 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.888051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b36dd-95bd-4e77-963d-9bed556e1f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.888708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b36dd-95bd-4e77-963d-9bed556e1f01 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.888989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b36dd-95bd-4e77-963d-9bed556e1f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.889265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b36dd-95bd-4e77-963d-9bed556e1f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.889968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b36dd-95bd-4e77-963d-9bed556e1f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.891896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b36dd-95bd-4e77-963d-9bed556e1f01 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.901461 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 985/1969] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:53 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:53.902854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c729ce0-752c-41fd-a3b3-adcf5d58d300 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.903226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c729ce0-752c-41fd-a3b3-adcf5d58d300 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.903536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c729ce0-752c-41fd-a3b3-adcf5d58d300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.924708 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 985/1970] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:53 2021] POST /identity/v3/projects => generated 407 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:53.925502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b36dd-95bd-4e77-963d-9bed556e1f01 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:53.930505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1c729ce0-752c-41fd-a3b3-adcf5d58d300 None None] MFA Rules not processed for user `6b149076c0724f46804a486e4b346db1`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:53.931860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1c729ce0-752c-41fd-a3b3-adcf5d58d300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:53.984420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b36dd-95bd-4e77-963d-9bed556e1f01 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:53.989263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cfa5a-87ed-44a4-83b5-30ae9fb62227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:53.989928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cfa5a-87ed-44a4-83b5-30ae9fb62227 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:53.990213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cfa5a-87ed-44a4-83b5-30ae9fb62227 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:53.990497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cfa5a-87ed-44a4-83b5-30ae9fb62227 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:53.991200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cfa5a-87ed-44a4-83b5-30ae9fb62227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:53.993153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cfa5a-87ed-44a4-83b5-30ae9fb62227 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:53.999992 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 986/1971] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:53 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:53.999992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c729ce0-752c-41fd-a3b3-adcf5d58d300 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.008634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c729ce0-752c-41fd-a3b3-adcf5d58d300 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.013851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae289cd-6933-4192-b92e-0a36a7713dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.014524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae289cd-6933-4192-b92e-0a36a7713dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.014823 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 986/1972] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:53 2021] POST /identity/v3/users => generated 280 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:54.014939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae289cd-6933-4192-b92e-0a36a7713dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.015094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae289cd-6933-4192-b92e-0a36a7713dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.015710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cfa5a-87ed-44a4-83b5-30ae9fb62227 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.015815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae289cd-6933-4192-b92e-0a36a7713dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.017847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae289cd-6933-4192-b92e-0a36a7713dc5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.026641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cfa5a-87ed-44a4-83b5-30ae9fb62227 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.031483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598bc10-aebe-4022-8a46-27685f8fb35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.032141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598bc10-aebe-4022-8a46-27685f8fb35b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.032426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598bc10-aebe-4022-8a46-27685f8fb35b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.032699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598bc10-aebe-4022-8a46-27685f8fb35b admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.033526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598bc10-aebe-4022-8a46-27685f8fb35b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.035367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598bc10-aebe-4022-8a46-27685f8fb35b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.044010 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 987/1973] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:53 2021] POST /identity/v3/projects => generated 395 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:54.044594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae289cd-6933-4192-b92e-0a36a7713dc5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.046273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fae289cd-6933-4192-b92e-0a36a7713dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:54.059441 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 987/1974] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:54 2021] POST /identity/v3/users => generated 310 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:54.059441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598bc10-aebe-4022-8a46-27685f8fb35b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.065953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598bc10-aebe-4022-8a46-27685f8fb35b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.116508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae289cd-6933-4192-b92e-0a36a7713dc5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.121897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dafd87-b47e-4702-b85c-8dacecfff16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.122556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafd87-b47e-4702-b85c-8dacecfff16f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.122679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c69ec2-6408-4903-81f6-664d55f68400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.122836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafd87-b47e-4702-b85c-8dacecfff16f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.123102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafd87-b47e-4702-b85c-8dacecfff16f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.123272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69ec2-6408-4903-81f6-664d55f68400 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.123563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69ec2-6408-4903-81f6-664d55f68400 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.123840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69ec2-6408-4903-81f6-664d55f68400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.123941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dafd87-b47e-4702-b85c-8dacecfff16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.125431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dafd87-b47e-4702-b85c-8dacecfff16f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.136126 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 988/1975] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:54.136899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dafd87-b47e-4702-b85c-8dacecfff16f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.146117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dafd87-b47e-4702-b85c-8dacecfff16f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.151465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace29f8-3b56-40fa-a38f-cf2fcaf28b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.152093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace29f8-3b56-40fa-a38f-cf2fcaf28b91 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.152372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace29f8-3b56-40fa-a38f-cf2fcaf28b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.152644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace29f8-3b56-40fa-a38f-cf2fcaf28b91 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.153325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace29f8-3b56-40fa-a38f-cf2fcaf28b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.155335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace29f8-3b56-40fa-a38f-cf2fcaf28b91 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.178276 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 989/1976] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:54 2021] POST /identity/v3/users => generated 304 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:54.179141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace29f8-3b56-40fa-a38f-cf2fcaf28b91 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.185079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c69ec2-6408-4903-81f6-664d55f68400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.186753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c69ec2-6408-4903-81f6-664d55f68400 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.191406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace29f8-3b56-40fa-a38f-cf2fcaf28b91 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.196306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cab64d-90e9-4532-88f1-7f370c1c31de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.197689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab64d-90e9-4532-88f1-7f370c1c31de admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.197968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab64d-90e9-4532-88f1-7f370c1c31de admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.198237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab64d-90e9-4532-88f1-7f370c1c31de admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.198974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cab64d-90e9-4532-88f1-7f370c1c31de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.201567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cab64d-90e9-4532-88f1-7f370c1c31de admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.203049 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 988/1977] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:54 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:54.204126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c69ec2-6408-4903-81f6-664d55f68400 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.215488 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 990/1978] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:54.216051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c69ec2-6408-4903-81f6-664d55f68400 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.216354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cab64d-90e9-4532-88f1-7f370c1c31de admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.221346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0e6c2-e5fb-4268-9569-c97aa4b2e58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.222005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0e6c2-e5fb-4268-9569-c97aa4b2e58c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.222475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0e6c2-e5fb-4268-9569-c97aa4b2e58c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.222714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0e6c2-e5fb-4268-9569-c97aa4b2e58c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.223493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0e6c2-e5fb-4268-9569-c97aa4b2e58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.225111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0e6c2-e5fb-4268-9569-c97aa4b2e58c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.226716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cab64d-90e9-4532-88f1-7f370c1c31de admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.233903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a58c2a-6063-4521-9166-54994ad4d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.234613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a58c2a-6063-4521-9166-54994ad4d572 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.234927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a58c2a-6063-4521-9166-54994ad4d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.235195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a58c2a-6063-4521-9166-54994ad4d572 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.235981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a58c2a-6063-4521-9166-54994ad4d572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.241559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a58c2a-6063-4521-9166-54994ad4d572 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.241703 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 989/1979] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:54.241703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0e6c2-e5fb-4268-9569-c97aa4b2e58c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.253669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0e6c2-e5fb-4268-9569-c97aa4b2e58c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.254008 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 991/1980] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:54.254848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a58c2a-6063-4521-9166-54994ad4d572 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.259193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f425e-6852-4e08-b704-e00d8cd526db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.260627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f425e-6852-4e08-b704-e00d8cd526db admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.260996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f425e-6852-4e08-b704-e00d8cd526db admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.261167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f425e-6852-4e08-b704-e00d8cd526db admin admin] PATH_INFO: `/v3/projects/ec3797ad743d41e8821657b392c5a3d8/users/4992251fb2a34706ba6e0adb28061fa1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.266151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a58c2a-6063-4521-9166-54994ad4d572 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.271607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6db1f-6490-46e5-8518-3841e46851f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.272571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6db1f-6490-46e5-8518-3841e46851f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.272857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6db1f-6490-46e5-8518-3841e46851f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.273212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6db1f-6490-46e5-8518-3841e46851f3 admin admin] PATH_INFO: `/v3/projects/83c2574a07e944fba4dd36b65c965462/users/8b10b2550e884df9a37ccbf578475d8b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.279057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f425e-6852-4e08-b704-e00d8cd526db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3797ad743d41e8821657b392c5a3d8, user_id=4992251fb2a34706ba6e0adb28061fa1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.281875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f425e-6852-4e08-b704-e00d8cd526db admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.291204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6db1f-6490-46e5-8518-3841e46851f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c2574a07e944fba4dd36b65c965462, user_id=8b10b2550e884df9a37ccbf578475d8b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.294467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6db1f-6490-46e5-8518-3841e46851f3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.304971 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 990/1981] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:54 2021] PUT /identity/v3/projects/ec3797ad743d41e8821657b392c5a3d8/users/4992251fb2a34706ba6e0adb28061fa1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:54.305680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f425e-6852-4e08-b704-e00d8cd526db admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.333965 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 992/1982] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:54 2021] PUT /identity/v3/projects/83c2574a07e944fba4dd36b65c965462/users/8b10b2550e884df9a37ccbf578475d8b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:54.333965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6db1f-6490-46e5-8518-3841e46851f3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.376648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f425e-6852-4e08-b704-e00d8cd526db admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.403453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6db1f-6490-46e5-8518-3841e46851f3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.408456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b555525-8ad7-4c08-9fb7-648f67103503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.409133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b555525-8ad7-4c08-9fb7-648f67103503 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.409418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b555525-8ad7-4c08-9fb7-648f67103503 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.410251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b555525-8ad7-4c08-9fb7-648f67103503 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.410467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b555525-8ad7-4c08-9fb7-648f67103503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.412095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b555525-8ad7-4c08-9fb7-648f67103503 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.426464 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 993/1983] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:54.428224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cd059-fba7-4c93-964f-c984a95ffc7a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.431813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cd059-fba7-4c93-964f-c984a95ffc7a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.432297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cd059-fba7-4c93-964f-c984a95ffc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.437446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adb6b2-fdd5-4dbd-8209-3505d99e422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.438309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adb6b2-fdd5-4dbd-8209-3505d99e422d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.438596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adb6b2-fdd5-4dbd-8209-3505d99e422d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.439168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adb6b2-fdd5-4dbd-8209-3505d99e422d admin admin] PATH_INFO: `/v3/projects/12bcac19c3614e2ba7bcd8b63cdbc640/users/a75449ed49664e79ba3f2d49bb5fb032/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.456789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adb6b2-fdd5-4dbd-8209-3505d99e422d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12bcac19c3614e2ba7bcd8b63cdbc640, user_id=a75449ed49664e79ba3f2d49bb5fb032, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.459672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adb6b2-fdd5-4dbd-8209-3505d99e422d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.470619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e75cd059-fba7-4c93-964f-c984a95ffc7a None None] MFA Rules not processed for user `8b10b2550e884df9a37ccbf578475d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:54.470619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e75cd059-fba7-4c93-964f-c984a95ffc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:54.488434 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 991/1984] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:54 2021] PUT /identity/v3/projects/12bcac19c3614e2ba7bcd8b63cdbc640/users/a75449ed49664e79ba3f2d49bb5fb032/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:54.489863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adb6b2-fdd5-4dbd-8209-3505d99e422d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.548370 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 994/1985] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:54 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:54.549445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cd059-fba7-4c93-964f-c984a95ffc7a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.550876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e75cd059-fba7-4c93-964f-c984a95ffc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:54.569594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adb6b2-fdd5-4dbd-8209-3505d99e422d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.575038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5437-85fd-45db-b280-1d8108f1dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.575948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5437-85fd-45db-b280-1d8108f1dcda admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.576228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5437-85fd-45db-b280-1d8108f1dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.576496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5437-85fd-45db-b280-1d8108f1dcda admin admin] PATH_INFO: `/v3/projects/ec3797ad743d41e8821657b392c5a3d8/users/4992251fb2a34706ba6e0adb28061fa1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.578451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb5437-85fd-45db-b280-1d8108f1dcda admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3797ad743d41e8821657b392c5a3d8, user_id=4992251fb2a34706ba6e0adb28061fa1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.581111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb5437-85fd-45db-b280-1d8108f1dcda admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.592344 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 992/1986] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:54 2021] PUT /identity/v3/projects/ec3797ad743d41e8821657b392c5a3d8/users/4992251fb2a34706ba6e0adb28061fa1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:54.592987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5437-85fd-45db-b280-1d8108f1dcda admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.630674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cd059-fba7-4c93-964f-c984a95ffc7a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.667915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5437-85fd-45db-b280-1d8108f1dcda admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.672546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20438861-de7a-4d1b-b1a1-fd6ef0733bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.673207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20438861-de7a-4d1b-b1a1-fd6ef0733bdd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.673517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20438861-de7a-4d1b-b1a1-fd6ef0733bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.673791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20438861-de7a-4d1b-b1a1-fd6ef0733bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.674524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20438861-de7a-4d1b-b1a1-fd6ef0733bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.676157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20438861-de7a-4d1b-b1a1-fd6ef0733bdd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.690352 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 993/1987] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:54 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:54.690352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20438861-de7a-4d1b-b1a1-fd6ef0733bdd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.698861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20438861-de7a-4d1b-b1a1-fd6ef0733bdd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.701852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74152b-c69f-45c4-a199-1889a9c8db6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.702534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74152b-c69f-45c4-a199-1889a9c8db6a service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.702809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74152b-c69f-45c4-a199-1889a9c8db6a service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.703078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74152b-c69f-45c4-a199-1889a9c8db6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.703943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5a4f-2cf0-4c5f-9c95-e3d27ff350c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.704594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5a4f-2cf0-4c5f-9c95-e3d27ff350c6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.705087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5a4f-2cf0-4c5f-9c95-e3d27ff350c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.705213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bd74152b-c69f-45c4-a199-1889a9c8db6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:54.705405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5a4f-2cf0-4c5f-9c95-e3d27ff350c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.706060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5a4f-2cf0-4c5f-9c95-e3d27ff350c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.708422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5a4f-2cf0-4c5f-9c95-e3d27ff350c6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.739559 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 994/1988] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:54 2021] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:54.739559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe566a-135b-4fd2-87d5-71470f74b83b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.739559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe566a-135b-4fd2-87d5-71470f74b83b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.739559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe566a-135b-4fd2-87d5-71470f74b83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.770396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a9fe566a-135b-4fd2-87d5-71470f74b83b None None] MFA Rules not processed for user `4992251fb2a34706ba6e0adb28061fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:54.771804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a9fe566a-135b-4fd2-87d5-71470f74b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:54.779841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74152b-c69f-45c4-a199-1889a9c8db6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.781415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74152b-c69f-45c4-a199-1889a9c8db6a service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.791410 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 995/1989] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:54 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:54.792034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74152b-c69f-45c4-a199-1889a9c8db6a service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.803041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74152b-c69f-45c4-a199-1889a9c8db6a service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.877615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a924e5-02be-4ada-b6be-dbcd27221a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:54.878826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a924e5-02be-4ada-b6be-dbcd27221a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.879111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a924e5-02be-4ada-b6be-dbcd27221a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.879701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a924e5-02be-4ada-b6be-dbcd27221a18 admin admin] PATH_INFO: `/v3/projects/12bcac19c3614e2ba7bcd8b63cdbc640/users/a75449ed49664e79ba3f2d49bb5fb032/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.881992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a924e5-02be-4ada-b6be-dbcd27221a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12bcac19c3614e2ba7bcd8b63cdbc640, user_id=a75449ed49664e79ba3f2d49bb5fb032, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:54.883653 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 995/1990] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:54 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:54.885080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a924e5-02be-4ada-b6be-dbcd27221a18 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:54.890027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0ead-1d05-4610-8112-d36887e73015 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:54.890620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0ead-1d05-4610-8112-d36887e73015 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:54.890974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c0ead-1d05-4610-8112-d36887e73015 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:54.893806 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 996/1991] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:45:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:45:54.894611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c0ead-1d05-4610-8112-d36887e73015 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.898313 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 996/1992] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:54 2021] PUT /identity/v3/projects/12bcac19c3614e2ba7bcd8b63cdbc640/users/a75449ed49664e79ba3f2d49bb5fb032/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:54.900103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a924e5-02be-4ada-b6be-dbcd27221a18 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:54.992791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c0ead-1d05-4610-8112-d36887e73015 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:54.996202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a924e5-02be-4ada-b6be-dbcd27221a18 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:55.000945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90cca4-654f-4b34-b285-61fd497c70ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.002045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90cca4-654f-4b34-b285-61fd497c70ae admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.002524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90cca4-654f-4b34-b285-61fd497c70ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.003382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90cca4-654f-4b34-b285-61fd497c70ae admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.004195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90cca4-654f-4b34-b285-61fd497c70ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.006708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90cca4-654f-4b34-b285-61fd497c70ae admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.006888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805ea07-2131-4c24-8385-7fe373641932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.007578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ea07-2131-4c24-8385-7fe373641932 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.007862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ea07-2131-4c24-8385-7fe373641932 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.008138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805ea07-2131-4c24-8385-7fe373641932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.039361 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 997/1993] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:54 2021] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:55.042390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b7f87-021c-47d5-84c8-5704aa338970 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.042825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b7f87-021c-47d5-84c8-5704aa338970 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.043205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b7f87-021c-47d5-84c8-5704aa338970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.073640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-631b7f87-021c-47d5-84c8-5704aa338970 None None] MFA Rules not processed for user `a75449ed49664e79ba3f2d49bb5fb032`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:55.074875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-631b7f87-021c-47d5-84c8-5704aa338970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.089460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805ea07-2131-4c24-8385-7fe373641932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.092195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805ea07-2131-4c24-8385-7fe373641932 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.105321 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 997/1994] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:54 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:55.106551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4104f-75fc-4258-a774-7d1518ebc86d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.106863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4104f-75fc-4258-a774-7d1518ebc86d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.107137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4104f-75fc-4258-a774-7d1518ebc86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.133515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fee4104f-75fc-4258-a774-7d1518ebc86d None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:55.135009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fee4104f-75fc-4258-a774-7d1518ebc86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.144410 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 998/1995] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:45:55 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:55.145271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4104f-75fc-4258-a774-7d1518ebc86d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:55.155560 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 998/1996] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:55 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:55.156393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b7f87-021c-47d5-84c8-5704aa338970 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:55.161109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4104f-75fc-4258-a774-7d1518ebc86d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:55.167039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b7f87-021c-47d5-84c8-5704aa338970 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:55.167313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b30fd0-b833-4a79-bea4-cbd4f8a50bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.168010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b30fd0-b833-4a79-bea4-cbd4f8a50bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.168294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b30fd0-b833-4a79-bea4-cbd4f8a50bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.168573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b30fd0-b833-4a79-bea4-cbd4f8a50bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.169311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b30fd0-b833-4a79-bea4-cbd4f8a50bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.170900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b30fd0-b833-4a79-bea4-cbd4f8a50bb5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.171852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99a77f-bdfc-46c6-9434-40158910a439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.172733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99a77f-bdfc-46c6-9434-40158910a439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.173016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99a77f-bdfc-46c6-9434-40158910a439 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.173288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99a77f-bdfc-46c6-9434-40158910a439 admin admin] PATH_INFO: `/v3/users/0b5a7792dab54c4daa582c88107fbc44` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.174519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99a77f-bdfc-46c6-9434-40158910a439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5a7792dab54c4daa582c88107fbc44)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.176459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99a77f-bdfc-46c6-9434-40158910a439 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.181574 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 999/1997] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:55 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:55.182485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b30fd0-b833-4a79-bea4-cbd4f8a50bb5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:55.196254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b30fd0-b833-4a79-bea4-cbd4f8a50bb5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:55.202335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495ac81-eae8-49aa-b23b-ef5eabc6308f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.202842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495ac81-eae8-49aa-b23b-ef5eabc6308f service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.203183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495ac81-eae8-49aa-b23b-ef5eabc6308f service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.203463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495ac81-eae8-49aa-b23b-ef5eabc6308f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.222401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b99a77f-bdfc-46c6-9434-40158910a439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5a7792dab54c4daa582c88107fbc44'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:55.223082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b99a77f-bdfc-46c6-9434-40158910a439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5a7792dab54c4daa582c88107fbc44'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:55.230299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b99a77f-bdfc-46c6-9434-40158910a439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5a7792dab54c4daa582c88107fbc44'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:55.230921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b99a77f-bdfc-46c6-9434-40158910a439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5a7792dab54c4daa582c88107fbc44'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:55.238117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b99a77f-bdfc-46c6-9434-40158910a439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5a7792dab54c4daa582c88107fbc44'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:55.254844 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 999/1998] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:55 2021] DELETE /identity/v3/users/0b5a7792dab54c4daa582c88107fbc44 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:55.257920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311675f-3beb-4832-b9ce-bb6bdbfdff09 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.257920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311675f-3beb-4832-b9ce-bb6bdbfdff09 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.257920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311675f-3beb-4832-b9ce-bb6bdbfdff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.261797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495ac81-eae8-49aa-b23b-ef5eabc6308f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.263405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495ac81-eae8-49aa-b23b-ef5eabc6308f service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.272132 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1000/1999] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:55 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:55.272912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0311675f-3beb-4832-b9ce-bb6bdbfdff09 None None] MFA Rules not processed for user `17a180a783424ce88239c7edb25bafc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:55.273719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495ac81-eae8-49aa-b23b-ef5eabc6308f service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:55.274158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0311675f-3beb-4832-b9ce-bb6bdbfdff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.285813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495ac81-eae8-49aa-b23b-ef5eabc6308f service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:55.332590 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1000/2000] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:55 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:55.333687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311675f-3beb-4832-b9ce-bb6bdbfdff09 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:55.340400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0311675f-3beb-4832-b9ce-bb6bdbfdff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.350157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e8106-8ab2-4b6a-9fda-81b7f88f8032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.350815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e8106-8ab2-4b6a-9fda-81b7f88f8032 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.351084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e8106-8ab2-4b6a-9fda-81b7f88f8032 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.351408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e8106-8ab2-4b6a-9fda-81b7f88f8032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.353213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d26e8106-8ab2-4b6a-9fda-81b7f88f8032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.364927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e8106-8ab2-4b6a-9fda-81b7f88f8032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.366447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e8106-8ab2-4b6a-9fda-81b7f88f8032 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.377319 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1001/2001] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:55.380759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb8bb-2116-4a5f-abfe-2da80981a140 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.381065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb8bb-2116-4a5f-abfe-2da80981a140 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.381351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb8bb-2116-4a5f-abfe-2da80981a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.400290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-eedeb8bb-2116-4a5f-abfe-2da80981a140 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:55.401616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-eedeb8bb-2116-4a5f-abfe-2da80981a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.406229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311675f-3beb-4832-b9ce-bb6bdbfdff09 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:55.412432 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1002/2002] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:55.413505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeb8bb-2116-4a5f-abfe-2da80981a140 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:55.414712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-eedeb8bb-2116-4a5f-abfe-2da80981a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.423342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104cad2-f0ff-4da0-9df6-9d112fb692e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.424447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cad2-f0ff-4da0-9df6-9d112fb692e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.424902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cad2-f0ff-4da0-9df6-9d112fb692e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.425321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104cad2-f0ff-4da0-9df6-9d112fb692e4 admin admin] PATH_INFO: `/v3/projects/20eb563b56154e349ab75e2fa09b1dd0/users/aa0e29b6203b446f9b1cf25a68d5b64e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.427980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeb8bb-2116-4a5f-abfe-2da80981a140 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:55.433091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.434742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.435033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.435353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] PATH_INFO: `/v3/users/a502fc0378a74a6cbe8caa84f781e719` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.436865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a502fc0378a74a6cbe8caa84f781e719)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.439641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.445475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104cad2-f0ff-4da0-9df6-9d112fb692e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20eb563b56154e349ab75e2fa09b1dd0, user_id=aa0e29b6203b446f9b1cf25a68d5b64e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.448974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104cad2-f0ff-4da0-9df6-9d112fb692e4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.464225 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1001/2003] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:55 2021] PUT /identity/v3/projects/20eb563b56154e349ab75e2fa09b1dd0/users/aa0e29b6203b446f9b1cf25a68d5b64e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:55.465261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104cad2-f0ff-4da0-9df6-9d112fb692e4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:55.467048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a104cad2-f0ff-4da0-9df6-9d112fb692e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.492942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a502fc0378a74a6cbe8caa84f781e719'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:55.504409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a502fc0378a74a6cbe8caa84f781e719'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:55.505146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a502fc0378a74a6cbe8caa84f781e719'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:55.515220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a502fc0378a74a6cbe8caa84f781e719'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:55.529813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a502fc0378a74a6cbe8caa84f781e719'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:55.537641 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1003/2004] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:55 2021] DELETE /identity/v3/users/a502fc0378a74a6cbe8caa84f781e719 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:55.539469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:55.541865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.580349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104cad2-f0ff-4da0-9df6-9d112fb692e4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:55.610721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d1acf-33f2-4753-96ae-a7f31a35fb65 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:55.615600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f87b4a-8ab8-4243-aef5-fb044fa2bfa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.616275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87b4a-8ab8-4243-aef5-fb044fa2bfa7 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.616636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87b4a-8ab8-4243-aef5-fb044fa2bfa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.617184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87b4a-8ab8-4243-aef5-fb044fa2bfa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.619942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d9f87b4a-8ab8-4243-aef5-fb044fa2bfa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.656167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93394dd-65fa-4a8b-b6ef-dae3f422328d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.657156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93394dd-65fa-4a8b-b6ef-dae3f422328d service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.657657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93394dd-65fa-4a8b-b6ef-dae3f422328d service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.658548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93394dd-65fa-4a8b-b6ef-dae3f422328d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.660989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f93394dd-65fa-4a8b-b6ef-dae3f422328d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.699692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f87b4a-8ab8-4243-aef5-fb044fa2bfa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.702039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f87b4a-8ab8-4243-aef5-fb044fa2bfa7 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.717330 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1004/2005] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:55.718795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f87b4a-8ab8-4243-aef5-fb044fa2bfa7 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:55.720361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d9f87b4a-8ab8-4243-aef5-fb044fa2bfa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.733370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f87b4a-8ab8-4243-aef5-fb044fa2bfa7 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:55.739562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9630c-73b7-48e2-bac3-e3fd5d174712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.740439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9630c-73b7-48e2-bac3-e3fd5d174712 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.740784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9630c-73b7-48e2-bac3-e3fd5d174712 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.741233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9630c-73b7-48e2-bac3-e3fd5d174712 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.742321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9630c-73b7-48e2-bac3-e3fd5d174712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.744446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9630c-73b7-48e2-bac3-e3fd5d174712 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.753814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93394dd-65fa-4a8b-b6ef-dae3f422328d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.755648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93394dd-65fa-4a8b-b6ef-dae3f422328d service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.759458 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1005/2006] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:55 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:55.762418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58384ad-d8b9-411f-9147-6b3042a5535b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.762715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58384ad-d8b9-411f-9147-6b3042a5535b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.762994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58384ad-d8b9-411f-9147-6b3042a5535b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.766216 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1002/2007] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:55 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:55.767127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93394dd-65fa-4a8b-b6ef-dae3f422328d service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:55.779699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93394dd-65fa-4a8b-b6ef-dae3f422328d service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:55.785372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf729251-b6c4-4e02-8a49-a4f511d51582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:55.786446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729251-b6c4-4e02-8a49-a4f511d51582 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.787581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729251-b6c4-4e02-8a49-a4f511d51582 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.787704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf729251-b6c4-4e02-8a49-a4f511d51582 admin admin] PATH_INFO: `/v3/projects/20eb563b56154e349ab75e2fa09b1dd0/users/aa0e29b6203b446f9b1cf25a68d5b64e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.791003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf729251-b6c4-4e02-8a49-a4f511d51582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20eb563b56154e349ab75e2fa09b1dd0, user_id=aa0e29b6203b446f9b1cf25a68d5b64e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:55.794646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf729251-b6c4-4e02-8a49-a4f511d51582 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:55.813229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f58384ad-d8b9-411f-9147-6b3042a5535b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:55.817213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f58384ad-d8b9-411f-9147-6b3042a5535b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.820616 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1003/2008] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:55 2021] PUT /identity/v3/projects/20eb563b56154e349ab75e2fa09b1dd0/users/aa0e29b6203b446f9b1cf25a68d5b64e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:55.832250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0901-aa4b-460c-b85b-170eb451a013 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:55.832707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0901-aa4b-460c-b85b-170eb451a013 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:55.833059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0901-aa4b-460c-b85b-170eb451a013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:55.876703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-65cf0901-aa4b-460c-b85b-170eb451a013 None None] MFA Rules not processed for user `aa0e29b6203b446f9b1cf25a68d5b64e`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:55.878019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-65cf0901-aa4b-460c-b85b-170eb451a013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:55.955390 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1006/2009] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:55.979036 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1004/2010] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:55 2021] POST /identity/v3/auth/tokens => generated 3293 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:45:55.983120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58384ad-d8b9-411f-9147-6b3042a5535b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:56.065073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58384ad-d8b9-411f-9147-6b3042a5535b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:56.068889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955983a3-f702-482c-829c-6fdcf295539f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:56.069786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955983a3-f702-482c-829c-6fdcf295539f service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:56.069786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955983a3-f702-482c-829c-6fdcf295539f service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:56.070084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955983a3-f702-482c-829c-6fdcf295539f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:56.090768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955983a3-f702-482c-829c-6fdcf295539f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:56.092360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955983a3-f702-482c-829c-6fdcf295539f service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:56.104847 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1007/2011] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:45:56.202976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf0901-aa4b-460c-b85b-170eb451a013 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:56.204634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-65cf0901-aa4b-460c-b85b-170eb451a013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:56.222086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955983a3-f702-482c-829c-6fdcf295539f service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:56.225176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-955983a3-f702-482c-829c-6fdcf295539f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:56.241312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955983a3-f702-482c-829c-6fdcf295539f service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:56.275995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:56.280111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:56.282651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:56.283413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] PATH_INFO: `/v3/projects/bb40949f71d24b4f85ec88db3e96df59` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:56.285615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb40949f71d24b4f85ec88db3e96df59)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:56.287054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf0901-aa4b-460c-b85b-170eb451a013 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:56.293123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:56.294378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ac7c0-8253-4cf6-b464-795df5c68097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:56.295041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ac7c0-8253-4cf6-b464-795df5c68097 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:56.295356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ac7c0-8253-4cf6-b464-795df5c68097 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:56.295700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ac7c0-8253-4cf6-b464-795df5c68097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:56.305728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ac7c0-8253-4cf6-b464-795df5c68097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:56.308093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ac7c0-8253-4cf6-b464-795df5c68097 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:56.319393 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1005/2012] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:56 2021] GET /identity/v3/auth/tokens => generated 3293 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:45:56.377607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb40949f71d24b4f85ec88db3e96df59', 'request_id': 'req-0fa1ff78-2b03-45c2-8c93-552951f58dc5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.393404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb40949f71d24b4f85ec88db3e96df59', 'request_id': 'req-0fa1ff78-2b03-45c2-8c93-552951f58dc5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.404254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb40949f71d24b4f85ec88db3e96df59', 'request_id': 'req-0fa1ff78-2b03-45c2-8c93-552951f58dc5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.436045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] The token cache is being invalidate because project bb40949f71d24b4f85ec88db3e96df59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:56.436333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.437013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.438943 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1008/2013] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:56 2021] DELETE /identity/v3/projects/bb40949f71d24b4f85ec88db3e96df59 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:45:56.444409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ac7c0-8253-4cf6-b464-795df5c68097 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:56.459904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ac7c0-8253-4cf6-b464-795df5c68097 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:56.547773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:56.549899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:56.566568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:56.567469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:56.567669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:56.567954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] PATH_INFO: `/v3/users/6b149076c0724f46804a486e4b346db1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:56.569214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b149076c0724f46804a486e4b346db1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:56.571668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:56.645216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b149076c0724f46804a486e4b346db1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.646421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b149076c0724f46804a486e4b346db1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.654753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1ff78-2b03-45c2-8c93-552951f58dc5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:56.658293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b149076c0724f46804a486e4b346db1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.659300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b149076c0724f46804a486e4b346db1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.660663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:56.661581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:56.661937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:56.662214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] PATH_INFO: `/v3/projects/2116bbaf320a4283b72cbea04c986e91` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:56.664349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2116bbaf320a4283b72cbea04c986e91)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:56.667034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:56.671529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b149076c0724f46804a486e4b346db1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.696040 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1006/2014] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:56 2021] DELETE /identity/v3/users/6b149076c0724f46804a486e4b346db1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:56.750420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2116bbaf320a4283b72cbea04c986e91', 'request_id': 'req-44d8f36b-a5a7-4f66-bd96-4041521803bf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.768693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2116bbaf320a4283b72cbea04c986e91', 'request_id': 'req-44d8f36b-a5a7-4f66-bd96-4041521803bf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.778698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2116bbaf320a4283b72cbea04c986e91', 'request_id': 'req-44d8f36b-a5a7-4f66-bd96-4041521803bf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.792918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] The token cache is being invalidate because project 2116bbaf320a4283b72cbea04c986e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:56.793248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.794389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:56.795910 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1009/2015] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:56 2021] DELETE /identity/v3/projects/2116bbaf320a4283b72cbea04c986e91 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:56.799694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:56.801584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:56.876069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:56.878186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:56.928499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945663a9-f20f-47e1-84b5-a687a3b9a0e4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:56.996139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8f36b-a5a7-4f66-bd96-4041521803bf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:57.004157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:57.005047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.005342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.005923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] PATH_INFO: `/v3/users/4992251fb2a34706ba6e0adb28061fa1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.007307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=4992251fb2a34706ba6e0adb28061fa1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:57.012390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:57.015388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0efa0f-2eae-49a5-bdc6-697ac2a19689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:57.016279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0efa0f-2eae-49a5-bdc6-697ac2a19689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.016848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0efa0f-2eae-49a5-bdc6-697ac2a19689 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.016848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0efa0f-2eae-49a5-bdc6-697ac2a19689 admin admin] PATH_INFO: `/v3/users/8b10b2550e884df9a37ccbf578475d8b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.019166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0efa0f-2eae-49a5-bdc6-697ac2a19689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b10b2550e884df9a37ccbf578475d8b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:57.021331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0efa0f-2eae-49a5-bdc6-697ac2a19689 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:57.078862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4992251fb2a34706ba6e0adb28061fa1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.079660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4992251fb2a34706ba6e0adb28061fa1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.095182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ed0efa0f-2eae-49a5-bdc6-697ac2a19689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b10b2550e884df9a37ccbf578475d8b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.099298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4992251fb2a34706ba6e0adb28061fa1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.103723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4992251fb2a34706ba6e0adb28061fa1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.111360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ed0efa0f-2eae-49a5-bdc6-697ac2a19689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b10b2550e884df9a37ccbf578475d8b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.112525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ed0efa0f-2eae-49a5-bdc6-697ac2a19689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b10b2550e884df9a37ccbf578475d8b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.115265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4992251fb2a34706ba6e0adb28061fa1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.126550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ed0efa0f-2eae-49a5-bdc6-697ac2a19689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b10b2550e884df9a37ccbf578475d8b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.146050 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1007/2016] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:56 2021] DELETE /identity/v3/users/4992251fb2a34706ba6e0adb28061fa1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:57.152599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:57.154015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:57.166283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ed0efa0f-2eae-49a5-bdc6-697ac2a19689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b10b2550e884df9a37ccbf578475d8b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.190774 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1010/2017] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:56 2021] DELETE /identity/v3/users/8b10b2550e884df9a37ccbf578475d8b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:57.199395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd8538-b7cc-4497-91c8-f978e3bd162c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.199846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd8538-b7cc-4497-91c8-f978e3bd162c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.200275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd8538-b7cc-4497-91c8-f978e3bd162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.239199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2ddd8538-b7cc-4497-91c8-f978e3bd162c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:57.242927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2ddd8538-b7cc-4497-91c8-f978e3bd162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:57.275746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89543349-c186-4b07-b67f-fb337d90e9ed admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:57.349942 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1011/2018] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:57.359725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:57.360585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.360867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.361221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] PATH_INFO: `/v3/projects/60925009468f47debdd606cf1eaf7154` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.362763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd8538-b7cc-4497-91c8-f978e3bd162c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:57.364167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2ddd8538-b7cc-4497-91c8-f978e3bd162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:57.367285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60925009468f47debdd606cf1eaf7154)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:57.369749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:57.423156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60925009468f47debdd606cf1eaf7154', 'request_id': 'req-eb48bf75-bf75-47c1-9054-971c88eaefd0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.432802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60925009468f47debdd606cf1eaf7154', 'request_id': 'req-eb48bf75-bf75-47c1-9054-971c88eaefd0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.435856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd8538-b7cc-4497-91c8-f978e3bd162c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:57.448913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60925009468f47debdd606cf1eaf7154', 'request_id': 'req-eb48bf75-bf75-47c1-9054-971c88eaefd0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.461542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] The token cache is being invalidate because project 60925009468f47debdd606cf1eaf7154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:57.461916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.462637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb48bf75-bf75-47c1-9054-971c88eaefd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.469123 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1008/2019] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:57 2021] DELETE /identity/v3/projects/60925009468f47debdd606cf1eaf7154 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:45:57.470662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26475-8a49-45dc-8e5e-181eb7d78fdf None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.471018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26475-8a49-45dc-8e5e-181eb7d78fdf None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.471487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26475-8a49-45dc-8e5e-181eb7d78fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.497073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-50b26475-8a49-45dc-8e5e-181eb7d78fdf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:57.498602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-50b26475-8a49-45dc-8e5e-181eb7d78fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:57.512531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385c293-8931-49a4-a056-90c9ab86f1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:57.513199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385c293-8931-49a4-a056-90c9ab86f1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.513715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385c293-8931-49a4-a056-90c9ab86f1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.513857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385c293-8931-49a4-a056-90c9ab86f1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.516037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6385c293-8931-49a4-a056-90c9ab86f1f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:57.576189 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1009/2020] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:45:57.584742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5d7f-e112-47ca-82e4-4ed9d922613e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.585028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5d7f-e112-47ca-82e4-4ed9d922613e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.585304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5d7f-e112-47ca-82e4-4ed9d922613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.605623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5d9c5d7f-e112-47ca-82e4-4ed9d922613e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:57.607375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5d9c5d7f-e112-47ca-82e4-4ed9d922613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:57.618970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385c293-8931-49a4-a056-90c9ab86f1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:57.619663 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1010/2021] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:57.620500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385c293-8931-49a4-a056-90c9ab86f1f2 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:57.621831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c5d7f-e112-47ca-82e4-4ed9d922613e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:57.633162 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1012/2022] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:57.639146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c5d7f-e112-47ca-82e4-4ed9d922613e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:57.645422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125883-bd10-4e48-954f-baa313c63f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:57.646224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125883-bd10-4e48-954f-baa313c63f8a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.646819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125883-bd10-4e48-954f-baa313c63f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.647208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125883-bd10-4e48-954f-baa313c63f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.648760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125883-bd10-4e48-954f-baa313c63f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:57.649175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125883-bd10-4e48-954f-baa313c63f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:57.651003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125883-bd10-4e48-954f-baa313c63f8a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:57.667351 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1011/2023] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:57.671440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385c293-8931-49a4-a056-90c9ab86f1f2 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:57.686800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385c293-8931-49a4-a056-90c9ab86f1f2 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:57.688620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835593e3-02ed-4de6-a7f4-13a3e5b7794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:57.688748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835593e3-02ed-4de6-a7f4-13a3e5b7794b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.689013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835593e3-02ed-4de6-a7f4-13a3e5b7794b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.689280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835593e3-02ed-4de6-a7f4-13a3e5b7794b admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.690021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835593e3-02ed-4de6-a7f4-13a3e5b7794b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:57.691991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835593e3-02ed-4de6-a7f4-13a3e5b7794b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:57.718985 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1013/2024] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:57 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:45:57.723225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125883-bd10-4e48-954f-baa313c63f8a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:57.733894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125883-bd10-4e48-954f-baa313c63f8a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:57.736310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835593e3-02ed-4de6-a7f4-13a3e5b7794b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:57.738264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-835593e3-02ed-4de6-a7f4-13a3e5b7794b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:57.804170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a16ec-544d-4d51-a50f-4221f8f39a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:57.804855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a16ec-544d-4d51-a50f-4221f8f39a7e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.805133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a16ec-544d-4d51-a50f-4221f8f39a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.805407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a16ec-544d-4d51-a50f-4221f8f39a7e admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.806766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a16ec-544d-4d51-a50f-4221f8f39a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:57.808929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a16ec-544d-4d51-a50f-4221f8f39a7e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:57.819101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835593e3-02ed-4de6-a7f4-13a3e5b7794b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:57.824601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:57.825462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.825762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.826084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] PATH_INFO: `/v3/projects/ec3797ad743d41e8821657b392c5a3d8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.827806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3797ad743d41e8821657b392c5a3d8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:57.829705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:57.835296 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1012/2025] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:57 2021] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:57.836209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a16ec-544d-4d51-a50f-4221f8f39a7e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:57.846523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a16ec-544d-4d51-a50f-4221f8f39a7e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:57.853786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363d7d4-3ac6-45f4-913a-95b37bade798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:57.855785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363d7d4-3ac6-45f4-913a-95b37bade798 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.856381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363d7d4-3ac6-45f4-913a-95b37bade798 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.856664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363d7d4-3ac6-45f4-913a-95b37bade798 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.857420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363d7d4-3ac6-45f4-913a-95b37bade798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:57.859228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363d7d4-3ac6-45f4-913a-95b37bade798 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:57.879392 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1013/2026] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:57 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:57.885355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363d7d4-3ac6-45f4-913a-95b37bade798 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:57.892686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3797ad743d41e8821657b392c5a3d8', 'request_id': 'req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.897829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363d7d4-3ac6-45f4-913a-95b37bade798 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:57.901915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3797ad743d41e8821657b392c5a3d8', 'request_id': 'req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.909279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3797ad743d41e8821657b392c5a3d8', 'request_id': 'req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.924960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] The token cache is being invalidate because project ec3797ad743d41e8821657b392c5a3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:57.925219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.925890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8fb0248-4dc5-4d9d-97e5-a8913b253a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:57.931387 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1014/2027] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:57 2021] DELETE /identity/v3/projects/ec3797ad743d41e8821657b392c5a3d8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:57.934989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d304a-dac6-4d9f-be24-13d81493a496 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.935346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d304a-dac6-4d9f-be24-13d81493a496 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.936174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d304a-dac6-4d9f-be24-13d81493a496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.980907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca698a-21cb-42ab-b81f-daf5da1174a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:57.981578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca698a-21cb-42ab-b81f-daf5da1174a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:57.982223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca698a-21cb-42ab-b81f-daf5da1174a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:57.982433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca698a-21cb-42ab-b81f-daf5da1174a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:57.983206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca698a-21cb-42ab-b81f-daf5da1174a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:57.984508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-561d304a-dac6-4d9f-be24-13d81493a496 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:57.985114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca698a-21cb-42ab-b81f-daf5da1174a5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:57.988375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-561d304a-dac6-4d9f-be24-13d81493a496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:58.007519 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1014/2028] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:57 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:45:58.008972 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1015/2029] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:45:58.009601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca698a-21cb-42ab-b81f-daf5da1174a5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.011069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee93da-baba-414d-9458-6aec16f01789 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.011386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee93da-baba-414d-9458-6aec16f01789 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.011666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee93da-baba-414d-9458-6aec16f01789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.027815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8dca698a-21cb-42ab-b81f-daf5da1174a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:58.035063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-eeee93da-baba-414d-9458-6aec16f01789 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:58.036499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-eeee93da-baba-414d-9458-6aec16f01789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:58.050738 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1016/2030] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:58.051022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca698a-21cb-42ab-b81f-daf5da1174a5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.051777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee93da-baba-414d-9458-6aec16f01789 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.058639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae0fc7-d3fe-45b9-a5c2-a9eaf9ac32a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.059977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0fc7-d3fe-45b9-a5c2-a9eaf9ac32a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.060360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0fc7-d3fe-45b9-a5c2-a9eaf9ac32a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.060708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae0fc7-d3fe-45b9-a5c2-a9eaf9ac32a8 admin admin] PATH_INFO: `/v3/projects/7e7fd405b830467db077102575590b2e/users/559cab992ce74bd0b78a639e4001c918/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.062282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee93da-baba-414d-9458-6aec16f01789 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.067818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23929cf3-6391-4f46-90ed-2ddb52ac81db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.068482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23929cf3-6391-4f46-90ed-2ddb52ac81db admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.068764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23929cf3-6391-4f46-90ed-2ddb52ac81db admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.069039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23929cf3-6391-4f46-90ed-2ddb52ac81db admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.069838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23929cf3-6391-4f46-90ed-2ddb52ac81db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:45:58.070449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23929cf3-6391-4f46-90ed-2ddb52ac81db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.072252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23929cf3-6391-4f46-90ed-2ddb52ac81db admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.081409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae0fc7-d3fe-45b9-a5c2-a9eaf9ac32a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7fd405b830467db077102575590b2e, user_id=559cab992ce74bd0b78a639e4001c918, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.085098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae0fc7-d3fe-45b9-a5c2-a9eaf9ac32a8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.106517 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1017/2031] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:45:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:45:58.107488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23929cf3-6391-4f46-90ed-2ddb52ac81db admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.107629 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1015/2032] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:58 2021] PUT /identity/v3/projects/7e7fd405b830467db077102575590b2e/users/559cab992ce74bd0b78a639e4001c918/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:58.120311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0562443-3244-417d-b340-b7675cdfb9ae None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.120513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23929cf3-6391-4f46-90ed-2ddb52ac81db admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.121236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0562443-3244-417d-b340-b7675cdfb9ae None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.121744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0562443-3244-417d-b340-b7675cdfb9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.191332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c0562443-3244-417d-b340-b7675cdfb9ae None None] MFA Rules not processed for user `559cab992ce74bd0b78a639e4001c918`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:58.193119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c0562443-3244-417d-b340-b7675cdfb9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:58.226244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8b3ce-8ec2-46cb-bb19-6733b89ee751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.227304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8b3ce-8ec2-46cb-bb19-6733b89ee751 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.227735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8b3ce-8ec2-46cb-bb19-6733b89ee751 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.228160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8b3ce-8ec2-46cb-bb19-6733b89ee751 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.228977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8b3ce-8ec2-46cb-bb19-6733b89ee751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.231872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8b3ce-8ec2-46cb-bb19-6733b89ee751 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.277776 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1018/2033] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:58 2021] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:58.278921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8b3ce-8ec2-46cb-bb19-6733b89ee751 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.280104 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1016/2034] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:58 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:58.281994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0562443-3244-417d-b340-b7675cdfb9ae None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.283950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a7d8b3ce-8ec2-46cb-bb19-6733b89ee751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:58.294151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0562443-3244-417d-b340-b7675cdfb9ae None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.366250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8b3ce-8ec2-46cb-bb19-6733b89ee751 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.371171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc17e2-bf00-4ef8-b5d0-f8fb90f4034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.371979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc17e2-bf00-4ef8-b5d0-f8fb90f4034e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.372346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc17e2-bf00-4ef8-b5d0-f8fb90f4034e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.372673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc17e2-bf00-4ef8-b5d0-f8fb90f4034e admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.373523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc17e2-bf00-4ef8-b5d0-f8fb90f4034e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.375676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc17e2-bf00-4ef8-b5d0-f8fb90f4034e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.376810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.377994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.378535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.378969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] PATH_INFO: `/v3/projects/83c2574a07e944fba4dd36b65c965462` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.380349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c2574a07e944fba4dd36b65c965462)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.382358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.400027 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1017/2035] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:58 2021] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:58.400831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc17e2-bf00-4ef8-b5d0-f8fb90f4034e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.413389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc17e2-bf00-4ef8-b5d0-f8fb90f4034e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.419615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af92ba9-4425-49c1-b8dc-3d0875f0653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.419765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af92ba9-4425-49c1-b8dc-3d0875f0653c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.419970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af92ba9-4425-49c1-b8dc-3d0875f0653c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.420197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af92ba9-4425-49c1-b8dc-3d0875f0653c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.420908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af92ba9-4425-49c1-b8dc-3d0875f0653c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.422861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af92ba9-4425-49c1-b8dc-3d0875f0653c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.440275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c2574a07e944fba4dd36b65c965462', 'request_id': 'req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:58.450706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c2574a07e944fba4dd36b65c965462', 'request_id': 'req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:58.457437 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1018/2036] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:58 2021] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:58.458350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af92ba9-4425-49c1-b8dc-3d0875f0653c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.461078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c2574a07e944fba4dd36b65c965462', 'request_id': 'req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:58.476227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] The token cache is being invalidate because project 83c2574a07e944fba4dd36b65c965462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:58.476746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:58.478476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:58.482080 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1019/2037] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:58 2021] DELETE /identity/v3/projects/83c2574a07e944fba4dd36b65c965462 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:58.483130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.485632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:58.550462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af92ba9-4425-49c1-b8dc-3d0875f0653c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.564673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e5c5-f9a3-4995-bbc3-b8dcda4aecd8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.568697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f9dc1-929e-464a-9082-c0110dc053fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.569746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f9dc1-929e-464a-9082-c0110dc053fd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.569943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526ce82-a8a1-40b2-aeaa-da587f4b9ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.570391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f9dc1-929e-464a-9082-c0110dc053fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.570622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526ce82-a8a1-40b2-aeaa-da587f4b9ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.570894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f9dc1-929e-464a-9082-c0110dc053fd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.571003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526ce82-a8a1-40b2-aeaa-da587f4b9ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.571168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526ce82-a8a1-40b2-aeaa-da587f4b9ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.571958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f9dc1-929e-464a-9082-c0110dc053fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.572089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526ce82-a8a1-40b2-aeaa-da587f4b9ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.574016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526ce82-a8a1-40b2-aeaa-da587f4b9ec3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.574649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f9dc1-929e-464a-9082-c0110dc053fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.591974 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1019/2038] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:58 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:58.594325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f9dc1-929e-464a-9082-c0110dc053fd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.596424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2a5f9dc1-929e-464a-9082-c0110dc053fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:58.601010 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1020/2039] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:58 2021] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:45:58.602312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526ce82-a8a1-40b2-aeaa-da587f4b9ec3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.605256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f526ce82-a8a1-40b2-aeaa-da587f4b9ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:58.616168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f9dc1-929e-464a-9082-c0110dc053fd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.621438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526ce82-a8a1-40b2-aeaa-da587f4b9ec3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.623148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44fca9-6ff7-47d4-89fd-db730e478c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.624791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44fca9-6ff7-47d4-89fd-db730e478c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.625541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44fca9-6ff7-47d4-89fd-db730e478c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.625973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44fca9-6ff7-47d4-89fd-db730e478c2f admin admin] PATH_INFO: `/v3/users/aa0e29b6203b446f9b1cf25a68d5b64e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.627495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44fca9-6ff7-47d4-89fd-db730e478c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0e29b6203b446f9b1cf25a68d5b64e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.629718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15847366-5119-4ddb-a899-d74dc094c092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.630668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44fca9-6ff7-47d4-89fd-db730e478c2f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.631280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847366-5119-4ddb-a899-d74dc094c092 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.631804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847366-5119-4ddb-a899-d74dc094c092 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.632274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15847366-5119-4ddb-a899-d74dc094c092 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.633311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15847366-5119-4ddb-a899-d74dc094c092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.635419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15847366-5119-4ddb-a899-d74dc094c092 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.647704 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1021/2040] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:58 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:58.649042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15847366-5119-4ddb-a899-d74dc094c092 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.665033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15847366-5119-4ddb-a899-d74dc094c092 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.672581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef4c68-3aa2-480a-b699-27e84d6c109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.673866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef4c68-3aa2-480a-b699-27e84d6c109b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.674379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef4c68-3aa2-480a-b699-27e84d6c109b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.674882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef4c68-3aa2-480a-b699-27e84d6c109b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.675917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef4c68-3aa2-480a-b699-27e84d6c109b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.678005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef4c68-3aa2-480a-b699-27e84d6c109b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.695699 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1022/2041] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:58 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:58.697082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef4c68-3aa2-480a-b699-27e84d6c109b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.707867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef4c68-3aa2-480a-b699-27e84d6c109b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.714253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c0ff6-301f-4ce1-9ff7-2afa979dfbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.715561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0ff6-301f-4ce1-9ff7-2afa979dfbe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.716042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0ff6-301f-4ce1-9ff7-2afa979dfbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.716529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c0ff6-301f-4ce1-9ff7-2afa979dfbe5 admin admin] PATH_INFO: `/v3/projects/4f6f4f6a32fe4be0a6d7be7c75a9cb58/users/e9aa6b9f7f784161b008768c5da9db89/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.730763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb44fca9-6ff7-47d4-89fd-db730e478c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0e29b6203b446f9b1cf25a68d5b64e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:58.733200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb44fca9-6ff7-47d4-89fd-db730e478c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0e29b6203b446f9b1cf25a68d5b64e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:58.736698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c0ff6-301f-4ce1-9ff7-2afa979dfbe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6f4f6a32fe4be0a6d7be7c75a9cb58, user_id=e9aa6b9f7f784161b008768c5da9db89, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:58.740240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c0ff6-301f-4ce1-9ff7-2afa979dfbe5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:58.757275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb44fca9-6ff7-47d4-89fd-db730e478c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0e29b6203b446f9b1cf25a68d5b64e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:58.757946 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1023/2042] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:58 2021] PUT /identity/v3/projects/4f6f4f6a32fe4be0a6d7be7c75a9cb58/users/e9aa6b9f7f784161b008768c5da9db89/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:58.758858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c0ff6-301f-4ce1-9ff7-2afa979dfbe5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.765458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ca0c0ff6-301f-4ce1-9ff7-2afa979dfbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:58.767291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb44fca9-6ff7-47d4-89fd-db730e478c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0e29b6203b446f9b1cf25a68d5b64e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:58.792454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb44fca9-6ff7-47d4-89fd-db730e478c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0e29b6203b446f9b1cf25a68d5b64e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:58.819588 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1020/2043] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:45:58 2021] DELETE /identity/v3/users/aa0e29b6203b446f9b1cf25a68d5b64e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:58.821184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaa518-7c38-4851-8cc5-e467cad646f7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.821711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaa518-7c38-4851-8cc5-e467cad646f7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.822162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaa518-7c38-4851-8cc5-e467cad646f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.858482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0efaa518-7c38-4851-8cc5-e467cad646f7 None None] MFA Rules not processed for user `e9aa6b9f7f784161b008768c5da9db89`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:58.860167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0efaa518-7c38-4851-8cc5-e467cad646f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:58.874292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c0ff6-301f-4ce1-9ff7-2afa979dfbe5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.963948 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1021/2044] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:58 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:58.967994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaa518-7c38-4851-8cc5-e467cad646f7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:58.970077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0efaa518-7c38-4851-8cc5-e467cad646f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:58.980558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4347c95-01e5-43fd-ac89-6386b94cb20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:58.981580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4347c95-01e5-43fd-ac89-6386b94cb20d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:58.981873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4347c95-01e5-43fd-ac89-6386b94cb20d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:58.982141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4347c95-01e5-43fd-ac89-6386b94cb20d admin admin] PATH_INFO: `/v3/projects/3027e754dc9d4f98b1ff4e8daf26d2c9/users/2a57bfbc92294b2aa3b7f23c685456b9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:58.993552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaa518-7c38-4851-8cc5-e467cad646f7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:58.999811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4347c95-01e5-43fd-ac89-6386b94cb20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3027e754dc9d4f98b1ff4e8daf26d2c9, user_id=2a57bfbc92294b2aa3b7f23c685456b9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:59.000538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b82a17-f65c-4c56-bfca-c81cb4cfb74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:59.001627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b82a17-f65c-4c56-bfca-c81cb4cfb74b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.002119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b82a17-f65c-4c56-bfca-c81cb4cfb74b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.002595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b82a17-f65c-4c56-bfca-c81cb4cfb74b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.002934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4347c95-01e5-43fd-ac89-6386b94cb20d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:59.003975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b82a17-f65c-4c56-bfca-c81cb4cfb74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:59.006308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b82a17-f65c-4c56-bfca-c81cb4cfb74b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:59.024056 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1024/2045] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:58 2021] PUT /identity/v3/projects/3027e754dc9d4f98b1ff4e8daf26d2c9/users/2a57bfbc92294b2aa3b7f23c685456b9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:59.026154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4347c95-01e5-43fd-ac89-6386b94cb20d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:59.051368 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1022/2046] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:45:58 2021] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:45:59.053100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b82a17-f65c-4c56-bfca-c81cb4cfb74b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:59.101605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4347c95-01e5-43fd-ac89-6386b94cb20d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:59.122777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b82a17-f65c-4c56-bfca-c81cb4cfb74b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:59.127705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d96da1-ff8f-49ac-9353-60b48430cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:59.128383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96da1-ff8f-49ac-9353-60b48430cfbd admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.128667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96da1-ff8f-49ac-9353-60b48430cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.128947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96da1-ff8f-49ac-9353-60b48430cfbd admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.129818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d96da1-ff8f-49ac-9353-60b48430cfbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:59.131771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d96da1-ff8f-49ac-9353-60b48430cfbd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:59.157974 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1023/2047] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:45:59 2021] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:45:59.159300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d96da1-ff8f-49ac-9353-60b48430cfbd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:59.169074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d96da1-ff8f-49ac-9353-60b48430cfbd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:59.173977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cf30a-6e52-4f2d-a2df-922a87c8801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:59.174380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a16d-a41d-491b-8a6c-bf4e8b454546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:59.174648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cf30a-6e52-4f2d-a2df-922a87c8801c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.174930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cf30a-6e52-4f2d-a2df-922a87c8801c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.175341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a16d-a41d-491b-8a6c-bf4e8b454546 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.175447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cf30a-6e52-4f2d-a2df-922a87c8801c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.175593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a16d-a41d-491b-8a6c-bf4e8b454546 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.175951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a16d-a41d-491b-8a6c-bf4e8b454546 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.176055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cf30a-6e52-4f2d-a2df-922a87c8801c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:59.176949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16a16d-a41d-491b-8a6c-bf4e8b454546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:59.177789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cf30a-6e52-4f2d-a2df-922a87c8801c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:59.178982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16a16d-a41d-491b-8a6c-bf4e8b454546 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:59.192305 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1024/2048] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:59.194608 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1025/2049] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:59 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:45:59.195592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cf30a-6e52-4f2d-a2df-922a87c8801c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:59.195750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a16d-a41d-491b-8a6c-bf4e8b454546 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:59.206890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cf30a-6e52-4f2d-a2df-922a87c8801c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:59.208347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a16d-a41d-491b-8a6c-bf4e8b454546 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:59.211618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de784e14-73ae-40aa-9701-4facfaf0f0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:59.213127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de784e14-73ae-40aa-9701-4facfaf0f0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.213410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de784e14-73ae-40aa-9701-4facfaf0f0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.213683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de784e14-73ae-40aa-9701-4facfaf0f0d5 admin admin] PATH_INFO: `/v3/projects/3027e754dc9d4f98b1ff4e8daf26d2c9/users/2a57bfbc92294b2aa3b7f23c685456b9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.214267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f6525-230a-40f7-8e7f-cdd3d1375b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:59.215321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6525-230a-40f7-8e7f-cdd3d1375b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.215800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6525-230a-40f7-8e7f-cdd3d1375b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.215951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6525-230a-40f7-8e7f-cdd3d1375b4b admin admin] PATH_INFO: `/v3/projects/3894d6693e524e35b6700cdb0feb9ecf/users/ecabbae9ff55474e962adc6cda8a14ba/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.216061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de784e14-73ae-40aa-9701-4facfaf0f0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3027e754dc9d4f98b1ff4e8daf26d2c9, user_id=2a57bfbc92294b2aa3b7f23c685456b9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:59.218813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de784e14-73ae-40aa-9701-4facfaf0f0d5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:59.231364 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1025/2050] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:59 2021] PUT /identity/v3/projects/3027e754dc9d4f98b1ff4e8daf26d2c9/users/2a57bfbc92294b2aa3b7f23c685456b9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:45:59.235650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f6525-230a-40f7-8e7f-cdd3d1375b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3894d6693e524e35b6700cdb0feb9ecf, user_id=ecabbae9ff55474e962adc6cda8a14ba, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:59.237928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f6525-230a-40f7-8e7f-cdd3d1375b4b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:59.241311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba020ca-e474-41e7-b2de-0123d6f38aba None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.241594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba020ca-e474-41e7-b2de-0123d6f38aba None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.241864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba020ca-e474-41e7-b2de-0123d6f38aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.258523 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1026/2051] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:59 2021] PUT /identity/v3/projects/3894d6693e524e35b6700cdb0feb9ecf/users/ecabbae9ff55474e962adc6cda8a14ba/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:59.263068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f6525-230a-40f7-8e7f-cdd3d1375b4b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:59.273886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cba020ca-e474-41e7-b2de-0123d6f38aba None None] MFA Rules not processed for user `2a57bfbc92294b2aa3b7f23c685456b9`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:59.275912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cba020ca-e474-41e7-b2de-0123d6f38aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:59.334034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f6525-230a-40f7-8e7f-cdd3d1375b4b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:59.339441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd081b-27b9-463e-a89f-a69671e06552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:59.340152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd081b-27b9-463e-a89f-a69671e06552 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.340550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd081b-27b9-463e-a89f-a69671e06552 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.341114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd081b-27b9-463e-a89f-a69671e06552 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.341760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd081b-27b9-463e-a89f-a69671e06552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:59.343572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd081b-27b9-463e-a89f-a69671e06552 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:59.357341 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1026/2052] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:59 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:45:59.364660 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1027/2053] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:45:59 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:45:59.369116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba020ca-e474-41e7-b2de-0123d6f38aba None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:59.373264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92ac75-c010-442f-a6ac-b638ce1ad739 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.373772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92ac75-c010-442f-a6ac-b638ce1ad739 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.373772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92ac75-c010-442f-a6ac-b638ce1ad739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.390084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba020ca-e474-41e7-b2de-0123d6f38aba None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:59.397423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fcc29-c48a-46cc-8df2-ede73fb3773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:59.398785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fcc29-c48a-46cc-8df2-ede73fb3773f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.398878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5d92ac75-c010-442f-a6ac-b638ce1ad739 None None] MFA Rules not processed for user `559cab992ce74bd0b78a639e4001c918`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:59.398956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fcc29-c48a-46cc-8df2-ede73fb3773f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.398956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fcc29-c48a-46cc-8df2-ede73fb3773f admin admin] PATH_INFO: `/v3/projects/3894d6693e524e35b6700cdb0feb9ecf/users/ecabbae9ff55474e962adc6cda8a14ba/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.400396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5d92ac75-c010-442f-a6ac-b638ce1ad739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:59.402052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fcc29-c48a-46cc-8df2-ede73fb3773f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3894d6693e524e35b6700cdb0feb9ecf, user_id=ecabbae9ff55474e962adc6cda8a14ba, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:59.405168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fcc29-c48a-46cc-8df2-ede73fb3773f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:59.417469 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1027/2054] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:45:59 2021] PUT /identity/v3/projects/3894d6693e524e35b6700cdb0feb9ecf/users/ecabbae9ff55474e962adc6cda8a14ba/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:59.418466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fcc29-c48a-46cc-8df2-ede73fb3773f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:59.422783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4b3fcc29-c48a-46cc-8df2-ede73fb3773f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:59.510598 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1028/2055] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:59 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:59.513551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f8093-0cf3-43de-96b2-0285c5d6d94a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.513992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f8093-0cf3-43de-96b2-0285c5d6d94a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.521184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f8093-0cf3-43de-96b2-0285c5d6d94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.559776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fcc29-c48a-46cc-8df2-ede73fb3773f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:59.561423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3a9f8093-0cf3-43de-96b2-0285c5d6d94a None None] MFA Rules not processed for user `ecabbae9ff55474e962adc6cda8a14ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:59.562996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3a9f8093-0cf3-43de-96b2-0285c5d6d94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:59.569989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:59.572035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.572654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.573148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] PATH_INFO: `/v3/projects/20eb563b56154e349ab75e2fa09b1dd0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.575399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20eb563b56154e349ab75e2fa09b1dd0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:59.578338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:59.662973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20eb563b56154e349ab75e2fa09b1dd0', 'request_id': 'req-a701bf2b-58c1-4c03-b030-15bae13046c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:59.673414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20eb563b56154e349ab75e2fa09b1dd0', 'request_id': 'req-a701bf2b-58c1-4c03-b030-15bae13046c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:59.677494 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1029/2056] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:59 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:59.678477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f8093-0cf3-43de-96b2-0285c5d6d94a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:59.681082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3a9f8093-0cf3-43de-96b2-0285c5d6d94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:59.685184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20eb563b56154e349ab75e2fa09b1dd0', 'request_id': 'req-a701bf2b-58c1-4c03-b030-15bae13046c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:59.703278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] The token cache is being invalidate because project 20eb563b56154e349ab75e2fa09b1dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:45:59.703625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:59.704512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a701bf2b-58c1-4c03-b030-15bae13046c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:45:59.706666 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1028/2057] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:45:59 2021] DELETE /identity/v3/projects/20eb563b56154e349ab75e2fa09b1dd0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:45:59.712949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1f156-f72d-4f63-827f-1283ba5d862a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.713271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1f156-f72d-4f63-827f-1283ba5d862a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.713543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1f156-f72d-4f63-827f-1283ba5d862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.742608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6bb1f156-f72d-4f63-827f-1283ba5d862a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:45:59.747078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6bb1f156-f72d-4f63-827f-1283ba5d862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:59.776028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f8093-0cf3-43de-96b2-0285c5d6d94a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:59.835610 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1029/2058] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:45:59.842879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1f156-f72d-4f63-827f-1283ba5d862a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:45:59.846163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6bb1f156-f72d-4f63-827f-1283ba5d862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:59.886243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce27d13-058b-4a5b-a3ed-5090d3070506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:59.887585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27d13-058b-4a5b-a3ed-5090d3070506 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.887894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27d13-058b-4a5b-a3ed-5090d3070506 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.888242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27d13-058b-4a5b-a3ed-5090d3070506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.892386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4ce27d13-058b-4a5b-a3ed-5090d3070506 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:59.944405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1f156-f72d-4f63-827f-1283ba5d862a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:45:59.950593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8389dc-0b91-4765-8cbc-f770532a274c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:45:59.951291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8389dc-0b91-4765-8cbc-f770532a274c service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.951763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8389dc-0b91-4765-8cbc-f770532a274c service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.952360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8389dc-0b91-4765-8cbc-f770532a274c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:45:59.954402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6f8389dc-0b91-4765-8cbc-f770532a274c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:45:59.982042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce27d13-058b-4a5b-a3ed-5090d3070506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:45:59.983848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce27d13-058b-4a5b-a3ed-5090d3070506 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:45:59.994082 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1030/2059] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:59 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:45:59.996088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025529-096f-4f3f-8bbe-c27ccf9fc852 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:45:59.996652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025529-096f-4f3f-8bbe-c27ccf9fc852 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:45:59.997277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2025529-096f-4f3f-8bbe-c27ccf9fc852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:00.019159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f2025529-096f-4f3f-8bbe-c27ccf9fc852 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:00.020975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f2025529-096f-4f3f-8bbe-c27ccf9fc852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:00.029048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8389dc-0b91-4765-8cbc-f770532a274c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:00.030949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8389dc-0b91-4765-8cbc-f770532a274c service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:00.038492 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1031/2060] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:45:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:00.042667 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1030/2061] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:45:59 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:00.043073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2025529-096f-4f3f-8bbe-c27ccf9fc852 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:00.052768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2025529-096f-4f3f-8bbe-c27ccf9fc852 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:00.057858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dce4d6-9602-4c49-9716-c1eea70c6fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:00.058658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dce4d6-9602-4c49-9716-c1eea70c6fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:00.058943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dce4d6-9602-4c49-9716-c1eea70c6fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:00.059343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dce4d6-9602-4c49-9716-c1eea70c6fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:00.060106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dce4d6-9602-4c49-9716-c1eea70c6fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:00.060414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dce4d6-9602-4c49-9716-c1eea70c6fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:00.062083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dce4d6-9602-4c49-9716-c1eea70c6fc6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:00.079460 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1032/2062] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:46:00.081568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8389dc-0b91-4765-8cbc-f770532a274c service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:00.094725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8389dc-0b91-4765-8cbc-f770532a274c service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:00.100268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2ef05-4132-4025-b8db-c348a1e6e286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:00.100933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2ef05-4132-4025-b8db-c348a1e6e286 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:00.101216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2ef05-4132-4025-b8db-c348a1e6e286 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:00.101637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2ef05-4132-4025-b8db-c348a1e6e286 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:00.102358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2ef05-4132-4025-b8db-c348a1e6e286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:00.105304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2ef05-4132-4025-b8db-c348a1e6e286 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:00.135025 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1031/2063] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:00 2021] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:00.139198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dce4d6-9602-4c49-9716-c1eea70c6fc6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:00.149823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dce4d6-9602-4c49-9716-c1eea70c6fc6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:00.208811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aed09-31e8-439a-a8df-2f8750e3ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:00.208811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aed09-31e8-439a-a8df-2f8750e3ab32 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:00.209105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aed09-31e8-439a-a8df-2f8750e3ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:00.209210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aed09-31e8-439a-a8df-2f8750e3ab32 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:00.209935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389aed09-31e8-439a-a8df-2f8750e3ab32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:00.214188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389aed09-31e8-439a-a8df-2f8750e3ab32 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:00.243318 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1033/2064] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:00 2021] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:46:00.244887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2ef05-4132-4025-b8db-c348a1e6e286 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:00.265089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2ef05-4132-4025-b8db-c348a1e6e286 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:00.276777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa1d17-87fc-4cba-9402-02ebda4ebc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:00.277782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa1d17-87fc-4cba-9402-02ebda4ebc4f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:00.278274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa1d17-87fc-4cba-9402-02ebda4ebc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:00.278778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa1d17-87fc-4cba-9402-02ebda4ebc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:00.280623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa1d17-87fc-4cba-9402-02ebda4ebc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:00.282466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa1d17-87fc-4cba-9402-02ebda4ebc4f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:00.297457 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1032/2065] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:00 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:00.301782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aed09-31e8-439a-a8df-2f8750e3ab32 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:00.313089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aed09-31e8-439a-a8df-2f8750e3ab32 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:00.320081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b6aaf-3625-447c-8dd6-fdde1d670d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:00.326897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b6aaf-3625-447c-8dd6-fdde1d670d15 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:00.327357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b6aaf-3625-447c-8dd6-fdde1d670d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:00.327653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b6aaf-3625-447c-8dd6-fdde1d670d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:00.328717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b6aaf-3625-447c-8dd6-fdde1d670d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:00.331941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b6aaf-3625-447c-8dd6-fdde1d670d15 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:00.348395 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1034/2066] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:00 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:00.350160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa1d17-87fc-4cba-9402-02ebda4ebc4f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:00.363100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa1d17-87fc-4cba-9402-02ebda4ebc4f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:00.379219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb1bf6-fc03-45a3-9c29-d5c48b62dbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:00.380392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb1bf6-fc03-45a3-9c29-d5c48b62dbe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:00.380687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb1bf6-fc03-45a3-9c29-d5c48b62dbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:00.380957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb1bf6-fc03-45a3-9c29-d5c48b62dbe3 admin admin] PATH_INFO: `/v3/projects/c8c32b0fff364ad7b9bbaf1fb71e3a67/users/1a069b7aa4c94607943e3493c6295fb3/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:00.400572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb1bf6-fc03-45a3-9c29-d5c48b62dbe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c32b0fff364ad7b9bbaf1fb71e3a67, user_id=1a069b7aa4c94607943e3493c6295fb3, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:00.403532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb1bf6-fc03-45a3-9c29-d5c48b62dbe3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:00.424133 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1033/2067] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:00 2021] PUT /identity/v3/projects/c8c32b0fff364ad7b9bbaf1fb71e3a67/users/1a069b7aa4c94607943e3493c6295fb3/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:00.451663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413484b0-0a02-48eb-8343-0f0893368636 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:00.452117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413484b0-0a02-48eb-8343-0f0893368636 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:00.452117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413484b0-0a02-48eb-8343-0f0893368636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:00.498298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-413484b0-0a02-48eb-8343-0f0893368636 None None] MFA Rules not processed for user `1a069b7aa4c94607943e3493c6295fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:00.500575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-413484b0-0a02-48eb-8343-0f0893368636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:00.587746 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1035/2068] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:00 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:00.591895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb1bf6-fc03-45a3-9c29-d5c48b62dbe3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:00.753822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb1bf6-fc03-45a3-9c29-d5c48b62dbe3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:00.762357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c6e22-0beb-4b03-b976-e125ee394b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:00.762928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6e22-0beb-4b03-b976-e125ee394b83 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:00.763216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6e22-0beb-4b03-b976-e125ee394b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:00.763531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c6e22-0beb-4b03-b976-e125ee394b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:00.764256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c6e22-0beb-4b03-b976-e125ee394b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:00.766192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c6e22-0beb-4b03-b976-e125ee394b83 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:00.813440 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1034/2069] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:00 2021] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:46:00.817396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413484b0-0a02-48eb-8343-0f0893368636 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:00.837279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413484b0-0a02-48eb-8343-0f0893368636 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:00.932249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d41ba8-3efe-4f8f-9c3c-1b69a4a14576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:00.932998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d41ba8-3efe-4f8f-9c3c-1b69a4a14576 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:00.933368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d41ba8-3efe-4f8f-9c3c-1b69a4a14576 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:00.933661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d41ba8-3efe-4f8f-9c3c-1b69a4a14576 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:00.934575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d41ba8-3efe-4f8f-9c3c-1b69a4a14576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:00.936556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d41ba8-3efe-4f8f-9c3c-1b69a4a14576 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:00.973475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c6e22-0beb-4b03-b976-e125ee394b83 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:00.979286 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1036/2070] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:00 2021] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:00.982718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d41ba8-3efe-4f8f-9c3c-1b69a4a14576 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:01.008588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d41ba8-3efe-4f8f-9c3c-1b69a4a14576 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:01.015768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31bbd-7c97-4f18-ab67-615ed57501a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:01.016591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31bbd-7c97-4f18-ab67-615ed57501a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:01.017178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31bbd-7c97-4f18-ab67-615ed57501a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:01.017462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31bbd-7c97-4f18-ab67-615ed57501a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:01.018626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d31bbd-7c97-4f18-ab67-615ed57501a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:01.020406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d31bbd-7c97-4f18-ab67-615ed57501a2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:01.047503 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1037/2071] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:00 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:46:01.048875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31bbd-7c97-4f18-ab67-615ed57501a2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:01.060293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31bbd-7c97-4f18-ab67-615ed57501a2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:01.063312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c6e22-0beb-4b03-b976-e125ee394b83 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:01.066310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc97a6-09b4-4501-82c2-f6e59cc2bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:01.067204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc97a6-09b4-4501-82c2-f6e59cc2bbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:01.067544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc97a6-09b4-4501-82c2-f6e59cc2bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:01.067829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc97a6-09b4-4501-82c2-f6e59cc2bbaf admin admin] PATH_INFO: `/v3/projects/03e6f572dbff4069a27888a2ddfaf435/users/451fc18cebb8439c9aa16f0da07600b1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:01.069425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73284d5-9e5d-45d6-b69e-9608007f26f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:01.069829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73284d5-9e5d-45d6-b69e-9608007f26f3 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:01.070290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73284d5-9e5d-45d6-b69e-9608007f26f3 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:01.070622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73284d5-9e5d-45d6-b69e-9608007f26f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:01.073548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a73284d5-9e5d-45d6-b69e-9608007f26f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:01.085300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc97a6-09b4-4501-82c2-f6e59cc2bbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e6f572dbff4069a27888a2ddfaf435, user_id=451fc18cebb8439c9aa16f0da07600b1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:01.089413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc97a6-09b4-4501-82c2-f6e59cc2bbaf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:01.119495 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1038/2072] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:01 2021] PUT /identity/v3/projects/03e6f572dbff4069a27888a2ddfaf435/users/451fc18cebb8439c9aa16f0da07600b1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:01.123321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc97a6-09b4-4501-82c2-f6e59cc2bbaf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:01.189513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73284d5-9e5d-45d6-b69e-9608007f26f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:01.191185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73284d5-9e5d-45d6-b69e-9608007f26f3 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:01.223554 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1035/2073] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:00 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:01.225114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43744fa-da39-4f78-ad8d-b7b643175880 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:01.225407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43744fa-da39-4f78-ad8d-b7b643175880 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:01.225688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43744fa-da39-4f78-ad8d-b7b643175880 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:01.228354 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1036/2074] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:46:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:46:01.238132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920552a-5b02-4158-ab3f-490f62c197ab None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:01.238426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920552a-5b02-4158-ab3f-490f62c197ab None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:01.238730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920552a-5b02-4158-ab3f-490f62c197ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:01.255886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc97a6-09b4-4501-82c2-f6e59cc2bbaf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:01.261726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189e49c-2322-418a-a673-28db1db0c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:01.262627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189e49c-2322-418a-a673-28db1db0c3cf admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:01.263098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189e49c-2322-418a-a673-28db1db0c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:01.263587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189e49c-2322-418a-a673-28db1db0c3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:01.265332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189e49c-2322-418a-a673-28db1db0c3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:01.268791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189e49c-2322-418a-a673-28db1db0c3cf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:01.284455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8920552a-5b02-4158-ab3f-490f62c197ab None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:01.284455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8920552a-5b02-4158-ab3f-490f62c197ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:01.285292 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1039/2075] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:01 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:01.286333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189e49c-2322-418a-a673-28db1db0c3cf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:01.297325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189e49c-2322-418a-a673-28db1db0c3cf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:01.302960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12382828-ba46-4752-add0-c1d1d29df947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:01.304109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12382828-ba46-4752-add0-c1d1d29df947 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:01.304596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12382828-ba46-4752-add0-c1d1d29df947 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:01.305091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12382828-ba46-4752-add0-c1d1d29df947 admin admin] PATH_INFO: `/v3/projects/03e6f572dbff4069a27888a2ddfaf435/users/451fc18cebb8439c9aa16f0da07600b1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:01.308053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12382828-ba46-4752-add0-c1d1d29df947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e6f572dbff4069a27888a2ddfaf435, user_id=451fc18cebb8439c9aa16f0da07600b1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:01.312170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12382828-ba46-4752-add0-c1d1d29df947 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:01.324944 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1040/2076] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:01 2021] PUT /identity/v3/projects/03e6f572dbff4069a27888a2ddfaf435/users/451fc18cebb8439c9aa16f0da07600b1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:01.336844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994c8af-783e-4001-ac82-5de575251a91 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:01.337238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994c8af-783e-4001-ac82-5de575251a91 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:01.337607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994c8af-783e-4001-ac82-5de575251a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:01.368854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6994c8af-783e-4001-ac82-5de575251a91 None None] MFA Rules not processed for user `451fc18cebb8439c9aa16f0da07600b1`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:01.370391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6994c8af-783e-4001-ac82-5de575251a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:01.429738 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1037/2077] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:46:01 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:01.451711 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1041/2078] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:01 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:01.460719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920552a-5b02-4158-ab3f-490f62c197ab None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:01.461356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd14d-9f8b-4605-bba1-c6e89f2a3871 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:01.461733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd14d-9f8b-4605-bba1-c6e89f2a3871 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:01.462135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd14d-9f8b-4605-bba1-c6e89f2a3871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:01.462320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8920552a-5b02-4158-ab3f-490f62c197ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:01.481112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cd1bd14d-9f8b-4605-bba1-c6e89f2a3871 None None] MFA Rules not processed for user `1a069b7aa4c94607943e3493c6295fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:01.482324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cd1bd14d-9f8b-4605-bba1-c6e89f2a3871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:01.487542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920552a-5b02-4158-ab3f-490f62c197ab None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:01.553127 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1042/2079] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:01 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:01.585267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc91c4a-9891-4d3f-bca9-914b1c3a04ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:01.586016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91c4a-9891-4d3f-bca9-914b1c3a04ef service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:01.586518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91c4a-9891-4d3f-bca9-914b1c3a04ef service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:01.586969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91c4a-9891-4d3f-bca9-914b1c3a04ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:01.595649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc91c4a-9891-4d3f-bca9-914b1c3a04ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:01.597487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc91c4a-9891-4d3f-bca9-914b1c3a04ef service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:01.615454 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1038/2080] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:01 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:01.730982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bd14d-9f8b-4605-bba1-c6e89f2a3871 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:01.804217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bd14d-9f8b-4605-bba1-c6e89f2a3871 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:01.810241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33c04-9e5e-45be-95ca-00db072628db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:01.810897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33c04-9e5e-45be-95ca-00db072628db service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:01.811184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33c04-9e5e-45be-95ca-00db072628db service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:01.811494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33c04-9e5e-45be-95ca-00db072628db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:01.819730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af33c04-9e5e-45be-95ca-00db072628db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:01.821659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af33c04-9e5e-45be-95ca-00db072628db service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:01.830987 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1043/2081] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:01 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:02.254077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3947e-456a-4a36-a94c-350c82b1fc0a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:02.254368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3947e-456a-4a36-a94c-350c82b1fc0a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:02.254629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3947e-456a-4a36-a94c-350c82b1fc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:02.293165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-35f3947e-456a-4a36-a94c-350c82b1fc0a None None] MFA Rules not processed for user `1a069b7aa4c94607943e3493c6295fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:02.295362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-35f3947e-456a-4a36-a94c-350c82b1fc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:02.307529 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1039/2082] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:02 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:02.645170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33c04-9e5e-45be-95ca-00db072628db service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:02.647837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0af33c04-9e5e-45be-95ca-00db072628db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:02.776840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33c04-9e5e-45be-95ca-00db072628db service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:02.782814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:02.783918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:02.784208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:02.784537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] PATH_INFO: `/v3/users/e9aa6b9f7f784161b008768c5da9db89` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:02.786411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9aa6b9f7f784161b008768c5da9db89)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:02.788749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:02.908405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9aa6b9f7f784161b008768c5da9db89'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:02.923366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9aa6b9f7f784161b008768c5da9db89'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:02.924260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9aa6b9f7f784161b008768c5da9db89'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:02.959436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9aa6b9f7f784161b008768c5da9db89'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:02.997636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9aa6b9f7f784161b008768c5da9db89'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:03.007461 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1044/2083] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:02 2021] DELETE /identity/v3/users/e9aa6b9f7f784161b008768c5da9db89 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:03.012725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d4f6-2d1f-4607-87c1-b013392394fb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:03.013773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d4f6-2d1f-4607-87c1-b013392394fb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:03.014235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d4f6-2d1f-4607-87c1-b013392394fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:03.054304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3de7d4f6-2d1f-4607-87c1-b013392394fb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:03.055780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3de7d4f6-2d1f-4607-87c1-b013392394fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:03.193257 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1040/2084] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:03.222425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:03.223903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:03.301418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9445fb4-0b97-4c42-8082-e3281ec6f238 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:03.318734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91807a-842b-4fb4-977d-a35404496239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:03.320498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91807a-842b-4fb4-977d-a35404496239 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:03.320851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91807a-842b-4fb4-977d-a35404496239 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:03.321182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91807a-842b-4fb4-977d-a35404496239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:03.333340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91807a-842b-4fb4-977d-a35404496239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:03.334755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91807a-842b-4fb4-977d-a35404496239 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:03.346054 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1045/2085] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:04.688345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7d4f6-2d1f-4607-87c1-b013392394fb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:04.689975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3de7d4f6-2d1f-4607-87c1-b013392394fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:04.711036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7d4f6-2d1f-4607-87c1-b013392394fb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:04.727494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:04.728376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:04.728831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:04.729413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] PATH_INFO: `/v3/projects/4f6f4f6a32fe4be0a6d7be7c75a9cb58` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:04.737873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6f4f6a32fe4be0a6d7be7c75a9cb58)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:04.744535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:04.845510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6f4f6a32fe4be0a6d7be7c75a9cb58', 'request_id': 'req-d586b85e-4aa5-473b-bff8-b79b5ec41071'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:04.856555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6f4f6a32fe4be0a6d7be7c75a9cb58', 'request_id': 'req-d586b85e-4aa5-473b-bff8-b79b5ec41071'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:04.878755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6f4f6a32fe4be0a6d7be7c75a9cb58', 'request_id': 'req-d586b85e-4aa5-473b-bff8-b79b5ec41071'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:04.904159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] The token cache is being invalidate because project 4f6f4f6a32fe4be0a6d7be7c75a9cb58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:04.904714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:04.905591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:04.907488 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1041/2086] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:04 2021] DELETE /identity/v3/projects/4f6f4f6a32fe4be0a6d7be7c75a9cb58 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:04.911949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91807a-842b-4fb4-977d-a35404496239 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:04.924204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91807a-842b-4fb4-977d-a35404496239 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:04.950210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:04.951697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:05.069499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3808d7-ef89-4399-9a78-ea6df10cc301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:05.070529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3808d7-ef89-4399-9a78-ea6df10cc301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:05.071100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3808d7-ef89-4399-9a78-ea6df10cc301 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:05.071574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3808d7-ef89-4399-9a78-ea6df10cc301 admin admin] PATH_INFO: `/v3/users/ecabbae9ff55474e962adc6cda8a14ba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:05.075141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3808d7-ef89-4399-9a78-ea6df10cc301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecabbae9ff55474e962adc6cda8a14ba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:05.077294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3808d7-ef89-4399-9a78-ea6df10cc301 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:05.126254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586b85e-4aa5-473b-bff8-b79b5ec41071 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:05.142721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd000a-6163-4745-ae9a-3639e1697aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:05.143797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd000a-6163-4745-ae9a-3639e1697aef service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:05.145209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd000a-6163-4745-ae9a-3639e1697aef service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:05.147019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd000a-6163-4745-ae9a-3639e1697aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:05.151285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-60cd000a-6163-4745-ae9a-3639e1697aef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:05.176177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd3808d7-ef89-4399-9a78-ea6df10cc301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecabbae9ff55474e962adc6cda8a14ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:05.190315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd3808d7-ef89-4399-9a78-ea6df10cc301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecabbae9ff55474e962adc6cda8a14ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:05.191235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd3808d7-ef89-4399-9a78-ea6df10cc301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecabbae9ff55474e962adc6cda8a14ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:05.206494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd3808d7-ef89-4399-9a78-ea6df10cc301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecabbae9ff55474e962adc6cda8a14ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:05.251557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd3808d7-ef89-4399-9a78-ea6df10cc301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecabbae9ff55474e962adc6cda8a14ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:05.271675 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1046/2087] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:04 2021] DELETE /identity/v3/users/ecabbae9ff55474e962adc6cda8a14ba => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:05.313312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd000a-6163-4745-ae9a-3639e1697aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:05.318625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd000a-6163-4745-ae9a-3639e1697aef service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:05.371603 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1042/2088] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:04 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:06.176562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f1d7-1ddb-4c97-9d2a-9878eb64a52d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:06.177070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f1d7-1ddb-4c97-9d2a-9878eb64a52d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:06.177150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6f1d7-1ddb-4c97-9d2a-9878eb64a52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:06.196466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-22e6f1d7-1ddb-4c97-9d2a-9878eb64a52d None None] MFA Rules not processed for user `8eff5913736b4e77ac2b092534edfcd9`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:06.198008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-22e6f1d7-1ddb-4c97-9d2a-9878eb64a52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:06.231796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd000a-6163-4745-ae9a-3639e1697aef service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:06.234123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-60cd000a-6163-4745-ae9a-3639e1697aef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:06.252984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd000a-6163-4745-ae9a-3639e1697aef service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:06.337126 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1047/2089] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:06 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:06.384737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:06.386015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:06.386370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:06.387885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] PATH_INFO: `/v3/projects/3894d6693e524e35b6700cdb0feb9ecf` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:06.389424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3894d6693e524e35b6700cdb0feb9ecf)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:06.401851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:06.514346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3894d6693e524e35b6700cdb0feb9ecf', 'request_id': 'req-b975fdf5-112f-4382-b8c7-0c63d92a0f74'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:06.521186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3894d6693e524e35b6700cdb0feb9ecf', 'request_id': 'req-b975fdf5-112f-4382-b8c7-0c63d92a0f74'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:06.531284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3894d6693e524e35b6700cdb0feb9ecf', 'request_id': 'req-b975fdf5-112f-4382-b8c7-0c63d92a0f74'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:06.556579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] The token cache is being invalidate because project 3894d6693e524e35b6700cdb0feb9ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:06.557056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:06.558809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:06.562804 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1043/2090] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:06 2021] DELETE /identity/v3/projects/3894d6693e524e35b6700cdb0feb9ecf => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:06.568876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eb972-8a31-4ba7-bc07-191af1f376b6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:06.569171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eb972-8a31-4ba7-bc07-191af1f376b6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:06.569453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2eb972-8a31-4ba7-bc07-191af1f376b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:06.595583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:06.597461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:06.604532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2e2eb972-8a31-4ba7-bc07-191af1f376b6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:06.606002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2e2eb972-8a31-4ba7-bc07-191af1f376b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:06.696187 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1048/2091] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:06.699423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222313d6-eedc-4004-9e7f-de8698bfdd80 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:06.702773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222313d6-eedc-4004-9e7f-de8698bfdd80 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:06.703182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222313d6-eedc-4004-9e7f-de8698bfdd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:06.717174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975fdf5-112f-4382-b8c7-0c63d92a0f74 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:06.733454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb7507-8be6-4049-86a6-2ad49da26057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:06.734347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb7507-8be6-4049-86a6-2ad49da26057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:06.734628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb7507-8be6-4049-86a6-2ad49da26057 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:06.734905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb7507-8be6-4049-86a6-2ad49da26057 admin admin] PATH_INFO: `/v3/users/094ca431c39f4e86b6269282a0dedcb0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:06.736279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb7507-8be6-4049-86a6-2ad49da26057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094ca431c39f4e86b6269282a0dedcb0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:06.738218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb7507-8be6-4049-86a6-2ad49da26057 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:06.746224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-222313d6-eedc-4004-9e7f-de8698bfdd80 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:06.747479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-222313d6-eedc-4004-9e7f-de8698bfdd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:06.769818 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1049/2092] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:06.774198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222313d6-eedc-4004-9e7f-de8698bfdd80 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:06.786699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222313d6-eedc-4004-9e7f-de8698bfdd80 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:06.796083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3066a79-43e4-4168-bacf-f0cc76e56bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:06.796841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066a79-43e4-4168-bacf-f0cc76e56bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:06.797131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066a79-43e4-4168-bacf-f0cc76e56bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:06.797424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066a79-43e4-4168-bacf-f0cc76e56bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:06.798261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3066a79-43e4-4168-bacf-f0cc76e56bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:06.798786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3066a79-43e4-4168-bacf-f0cc76e56bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:06.807071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3066a79-43e4-4168-bacf-f0cc76e56bc4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:06.826946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c0fb7507-8be6-4049-86a6-2ad49da26057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094ca431c39f4e86b6269282a0dedcb0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:06.827873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c0fb7507-8be6-4049-86a6-2ad49da26057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094ca431c39f4e86b6269282a0dedcb0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:06.834911 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1050/2093] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:46:06.835945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3066a79-43e4-4168-bacf-f0cc76e56bc4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:06.837969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f3066a79-43e4-4168-bacf-f0cc76e56bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:06.839914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c0fb7507-8be6-4049-86a6-2ad49da26057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094ca431c39f4e86b6269282a0dedcb0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:06.840594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c0fb7507-8be6-4049-86a6-2ad49da26057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094ca431c39f4e86b6269282a0dedcb0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:06.853157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c0fb7507-8be6-4049-86a6-2ad49da26057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094ca431c39f4e86b6269282a0dedcb0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:06.870043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3066a79-43e4-4168-bacf-f0cc76e56bc4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:06.881571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760620c-4245-4a76-8376-b9873a68c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:06.885078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760620c-4245-4a76-8376-b9873a68c837 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:06.885432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760620c-4245-4a76-8376-b9873a68c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:06.885974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760620c-4245-4a76-8376-b9873a68c837 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:06.886433 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1044/2094] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:06 2021] DELETE /identity/v3/users/094ca431c39f4e86b6269282a0dedcb0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:06.887094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760620c-4245-4a76-8376-b9873a68c837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:06.889275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760620c-4245-4a76-8376-b9873a68c837 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:06.890852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202bc13-98f9-4aba-9bbf-d6df88f13978 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:06.891243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202bc13-98f9-4aba-9bbf-d6df88f13978 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:06.891637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202bc13-98f9-4aba-9bbf-d6df88f13978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:06.923151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2202bc13-98f9-4aba-9bbf-d6df88f13978 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:06.924837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2202bc13-98f9-4aba-9bbf-d6df88f13978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:06.943411 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1051/2095] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:06 2021] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:06.949351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760620c-4245-4a76-8376-b9873a68c837 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:07.047982 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1045/2096] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:07.061653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202bc13-98f9-4aba-9bbf-d6df88f13978 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:07.064578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2202bc13-98f9-4aba-9bbf-d6df88f13978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:07.084437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760620c-4245-4a76-8376-b9873a68c837 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:07.093732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f721-bdfe-4dde-877e-543812af2ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:07.094817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f721-bdfe-4dde-877e-543812af2ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:07.094817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f721-bdfe-4dde-877e-543812af2ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:07.095171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f721-bdfe-4dde-877e-543812af2ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:07.095832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6f721-bdfe-4dde-877e-543812af2ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:07.098146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6f721-bdfe-4dde-877e-543812af2ae3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:07.158931 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1052/2097] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:06 2021] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:07.163126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f721-bdfe-4dde-877e-543812af2ae3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:07.165051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202bc13-98f9-4aba-9bbf-d6df88f13978 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:07.187901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f721-bdfe-4dde-877e-543812af2ae3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:07.201973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd8387-16f8-4779-b850-f0e19275bd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:07.202962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8387-16f8-4779-b850-f0e19275bd0b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:07.203477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8387-16f8-4779-b850-f0e19275bd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:07.203965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8387-16f8-4779-b850-f0e19275bd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:07.204908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd8387-16f8-4779-b850-f0e19275bd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:07.206729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd8387-16f8-4779-b850-f0e19275bd0b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:07.234871 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1053/2098] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:07 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:07.236700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd8387-16f8-4779-b850-f0e19275bd0b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:07.245357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73508548-0a21-4e3b-ac36-d5ec4851b6a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:07.248702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73508548-0a21-4e3b-ac36-d5ec4851b6a1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:07.249196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73508548-0a21-4e3b-ac36-d5ec4851b6a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:07.249660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73508548-0a21-4e3b-ac36-d5ec4851b6a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:07.257181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd8387-16f8-4779-b850-f0e19275bd0b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:07.270349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73508548-0a21-4e3b-ac36-d5ec4851b6a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:07.273250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73508548-0a21-4e3b-ac36-d5ec4851b6a1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:07.273763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697075e7-c9e9-44ee-b300-5217cb9ade17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:07.274993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697075e7-c9e9-44ee-b300-5217cb9ade17 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:07.275347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697075e7-c9e9-44ee-b300-5217cb9ade17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:07.275573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697075e7-c9e9-44ee-b300-5217cb9ade17 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:07.277964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697075e7-c9e9-44ee-b300-5217cb9ade17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:07.279639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697075e7-c9e9-44ee-b300-5217cb9ade17 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:07.292628 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1046/2099] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:07.300552 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1054/2100] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:07 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:07.304382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73508548-0a21-4e3b-ac36-d5ec4851b6a1 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:07.317596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73508548-0a21-4e3b-ac36-d5ec4851b6a1 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:07.326998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f1ab-1587-4cdc-8836-9409f160b6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:07.329990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f1ab-1587-4cdc-8836-9409f160b6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:07.330504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f1ab-1587-4cdc-8836-9409f160b6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:07.330969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382f1ab-1587-4cdc-8836-9409f160b6ea admin admin] PATH_INFO: `/v3/projects/04a17517c2104eeba56ce3a7cd915fb0/users/3cb6bc63929648388ac9648823d4ca88/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:07.360630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382f1ab-1587-4cdc-8836-9409f160b6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a17517c2104eeba56ce3a7cd915fb0, user_id=3cb6bc63929648388ac9648823d4ca88, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:07.365316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382f1ab-1587-4cdc-8836-9409f160b6ea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:07.395307 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1047/2101] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:07 2021] PUT /identity/v3/projects/04a17517c2104eeba56ce3a7cd915fb0/users/3cb6bc63929648388ac9648823d4ca88/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:07.408599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4afa-e6b6-4f37-ab21-447b5f5ced15 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:07.408893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4afa-e6b6-4f37-ab21-447b5f5ced15 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:07.409172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4afa-e6b6-4f37-ab21-447b5f5ced15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:07.462537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-059c4afa-e6b6-4f37-ab21-447b5f5ced15 None None] MFA Rules not processed for user `3cb6bc63929648388ac9648823d4ca88`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:07.463760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-059c4afa-e6b6-4f37-ab21-447b5f5ced15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:07.605140 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1055/2102] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:07 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:07.624271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f1ab-1587-4cdc-8836-9409f160b6ea admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:07.831673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382f1ab-1587-4cdc-8836-9409f160b6ea admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:07.906024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeb6db-0408-4fca-99f8-2f7dcadcd148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:07.906695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb6db-0408-4fca-99f8-2f7dcadcd148 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:07.906977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb6db-0408-4fca-99f8-2f7dcadcd148 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:07.907333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eeb6db-0408-4fca-99f8-2f7dcadcd148 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:07.908472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eeb6db-0408-4fca-99f8-2f7dcadcd148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:07.911303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eeb6db-0408-4fca-99f8-2f7dcadcd148 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:07.999126 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1048/2103] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:07 2021] POST /identity/v3/projects => generated 375 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:08.001441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c4afa-e6b6-4f37-ab21-447b5f5ced15 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:08.079850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c4afa-e6b6-4f37-ab21-447b5f5ced15 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:08.211482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bbe9a-a42f-41ac-9736-2e20b9b7ba0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:08.213096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bbe9a-a42f-41ac-9736-2e20b9b7ba0a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:08.213564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bbe9a-a42f-41ac-9736-2e20b9b7ba0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:08.214019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bbe9a-a42f-41ac-9736-2e20b9b7ba0a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:08.214984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bbe9a-a42f-41ac-9736-2e20b9b7ba0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:08.217255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bbe9a-a42f-41ac-9736-2e20b9b7ba0a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:08.250559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeb6db-0408-4fca-99f8-2f7dcadcd148 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:08.261837 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1056/2104] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:08 2021] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:08.265714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eeb6db-0408-4fca-99f8-2f7dcadcd148 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:08.273034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969216fd-b41b-4500-8c42-802abab87841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:08.273819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969216fd-b41b-4500-8c42-802abab87841 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:08.274436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969216fd-b41b-4500-8c42-802abab87841 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:08.274848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969216fd-b41b-4500-8c42-802abab87841 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:08.275738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969216fd-b41b-4500-8c42-802abab87841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:08.279366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969216fd-b41b-4500-8c42-802abab87841 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:08.299471 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1049/2105] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:08 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:08.300676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bbe9a-a42f-41ac-9736-2e20b9b7ba0a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:08.324577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bbe9a-a42f-41ac-9736-2e20b9b7ba0a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:08.340137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48831a15-5bd0-4f9b-8fb3-9f4460c7d921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:08.343595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48831a15-5bd0-4f9b-8fb3-9f4460c7d921 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:08.345666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48831a15-5bd0-4f9b-8fb3-9f4460c7d921 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:08.346006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48831a15-5bd0-4f9b-8fb3-9f4460c7d921 admin admin] PATH_INFO: `/v3/projects/c59ee766273440ad9e1b4b17af7c1c2d/users/1b2ee0ab190e4d4d9005d8d9f432f414/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:08.395854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48831a15-5bd0-4f9b-8fb3-9f4460c7d921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59ee766273440ad9e1b4b17af7c1c2d, user_id=1b2ee0ab190e4d4d9005d8d9f432f414, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:08.401337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48831a15-5bd0-4f9b-8fb3-9f4460c7d921 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:08.443829 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1057/2106] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:08 2021] PUT /identity/v3/projects/c59ee766273440ad9e1b4b17af7c1c2d/users/1b2ee0ab190e4d4d9005d8d9f432f414/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:08.447820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969216fd-b41b-4500-8c42-802abab87841 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:08.458821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969216fd-b41b-4500-8c42-802abab87841 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:08.522794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c0554-12b6-4876-9a51-fe92c7d37280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:08.523677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0554-12b6-4876-9a51-fe92c7d37280 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:08.526594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0554-12b6-4876-9a51-fe92c7d37280 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:08.526594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0554-12b6-4876-9a51-fe92c7d37280 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:08.526594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c0554-12b6-4876-9a51-fe92c7d37280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:08.528074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c0554-12b6-4876-9a51-fe92c7d37280 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:08.543157 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1050/2107] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:08 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:08.543897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48831a15-5bd0-4f9b-8fb3-9f4460c7d921 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:08.555638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48831a15-5bd0-4f9b-8fb3-9f4460c7d921 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:08.561844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac251f5-6fe8-41d5-b8f1-767888ebb4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:08.563085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac251f5-6fe8-41d5-b8f1-767888ebb4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:08.563593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac251f5-6fe8-41d5-b8f1-767888ebb4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:08.564090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac251f5-6fe8-41d5-b8f1-767888ebb4cf admin admin] PATH_INFO: `/v3/projects/c59ee766273440ad9e1b4b17af7c1c2d/users/1b2ee0ab190e4d4d9005d8d9f432f414/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:08.577357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac251f5-6fe8-41d5-b8f1-767888ebb4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59ee766273440ad9e1b4b17af7c1c2d, user_id=1b2ee0ab190e4d4d9005d8d9f432f414, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:08.584266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac251f5-6fe8-41d5-b8f1-767888ebb4cf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:08.617494 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1058/2108] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:08 2021] PUT /identity/v3/projects/c59ee766273440ad9e1b4b17af7c1c2d/users/1b2ee0ab190e4d4d9005d8d9f432f414/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:08.630778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9495da-879c-484b-8718-ef1cfb1f6de2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:08.631161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9495da-879c-484b-8718-ef1cfb1f6de2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:08.631534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9495da-879c-484b-8718-ef1cfb1f6de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:08.680699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7a9495da-879c-484b-8718-ef1cfb1f6de2 None None] MFA Rules not processed for user `1b2ee0ab190e4d4d9005d8d9f432f414`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:08.682547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7a9495da-879c-484b-8718-ef1cfb1f6de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:08.746182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac251f5-6fe8-41d5-b8f1-767888ebb4cf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:08.748283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8ac251f5-6fe8-41d5-b8f1-767888ebb4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:08.858162 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1051/2109] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:08 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:08.864934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6846-8028-41c8-8a62-dd8d15172c65 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:08.864934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6846-8028-41c8-8a62-dd8d15172c65 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:08.865242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6846-8028-41c8-8a62-dd8d15172c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:08.901958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac251f5-6fe8-41d5-b8f1-767888ebb4cf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:08.908225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:08.909299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:08.911536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:08.912056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] PATH_INFO: `/v3/projects/85ec794c7c2d4431bf3936db2a303de4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:08.917742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-16ff6846-8028-41c8-8a62-dd8d15172c65 None None] MFA Rules not processed for user `3cb6bc63929648388ac9648823d4ca88`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:08.918946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-16ff6846-8028-41c8-8a62-dd8d15172c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:08.929340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ec794c7c2d4431bf3936db2a303de4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:08.937208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:09.096676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ec794c7c2d4431bf3936db2a303de4', 'request_id': 'req-b00cef82-1543-4616-b7f4-ad526a636c55'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:09.110267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ec794c7c2d4431bf3936db2a303de4', 'request_id': 'req-b00cef82-1543-4616-b7f4-ad526a636c55'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:09.126071 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1052/2110] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:08 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:09.127806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c515e2-ece4-451b-b979-1e22cc7a5878 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:09.128100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c515e2-ece4-451b-b979-1e22cc7a5878 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:09.128382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c515e2-ece4-451b-b979-1e22cc7a5878 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:09.135291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ec794c7c2d4431bf3936db2a303de4', 'request_id': 'req-b00cef82-1543-4616-b7f4-ad526a636c55'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:09.138812 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1053/2111] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:46:09 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:46:09.160873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] The token cache is being invalidate because project 85ec794c7c2d4431bf3936db2a303de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:09.161307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:09.162306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b00cef82-1543-4616-b7f4-ad526a636c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:09.164557 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1059/2112] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:08 2021] DELETE /identity/v3/projects/85ec794c7c2d4431bf3936db2a303de4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:09.168789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c515e2-ece4-451b-b979-1e22cc7a5878 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:09.170702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-94c515e2-ece4-451b-b979-1e22cc7a5878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:09.204674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9c33-2e3b-4e34-a4d3-445d6613314f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:09.205460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9c33-2e3b-4e34-a4d3-445d6613314f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:09.205832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9c33-2e3b-4e34-a4d3-445d6613314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:09.256042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ddbc9c33-2e3b-4e34-a4d3-445d6613314f None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:09.258326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ddbc9c33-2e3b-4e34-a4d3-445d6613314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:09.319152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c515e2-ece4-451b-b979-1e22cc7a5878 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:09.331019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:09.332870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:09.333161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:09.333484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] PATH_INFO: `/v3/users/31ff9538d3d94dc18fcb33714beea749` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:09.335029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ff9538d3d94dc18fcb33714beea749)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:09.339308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:09.484949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ff9538d3d94dc18fcb33714beea749'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:09.485908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ff9538d3d94dc18fcb33714beea749'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:09.502417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ff9538d3d94dc18fcb33714beea749'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:09.506960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ff9538d3d94dc18fcb33714beea749'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:09.530817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ff9538d3d94dc18fcb33714beea749'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:09.542148 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1060/2113] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:46:09 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:09.574003 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1054/2114] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:09 2021] DELETE /identity/v3/users/31ff9538d3d94dc18fcb33714beea749 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:09.645982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc9c33-2e3b-4e34-a4d3-445d6613314f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:09.647445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ddbc9c33-2e3b-4e34-a4d3-445d6613314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:09.661832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc9c33-2e3b-4e34-a4d3-445d6613314f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:09.746101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:09.747219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:09.810563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3edb3-1596-4091-a670-984dd158580e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:09.811238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3edb3-1596-4091-a670-984dd158580e service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:09.811557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3edb3-1596-4091-a670-984dd158580e service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:09.812077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3edb3-1596-4091-a670-984dd158580e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:09.816026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-49c3edb3-1596-4091-a670-984dd158580e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:09.918552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3edb3-1596-4091-a670-984dd158580e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:09.921058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3edb3-1596-4091-a670-984dd158580e service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:09.937438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835d987-657b-4beb-b10a-0c455874dac4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:09.950776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee467df6-d236-406c-8b8d-3f38cbfa165d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:09.953521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee467df6-d236-406c-8b8d-3f38cbfa165d service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:09.953986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee467df6-d236-406c-8b8d-3f38cbfa165d service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:09.954838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee467df6-d236-406c-8b8d-3f38cbfa165d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:09.955531 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1061/2115] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:09 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:09.975196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee467df6-d236-406c-8b8d-3f38cbfa165d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:09.977786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee467df6-d236-406c-8b8d-3f38cbfa165d service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:10.003220 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1055/2116] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:10.745865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3edb3-1596-4091-a670-984dd158580e service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:10.747468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-49c3edb3-1596-4091-a670-984dd158580e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:10.928688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3edb3-1596-4091-a670-984dd158580e service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:10.933689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:10.934566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:10.934852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:10.935130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] PATH_INFO: `/v3/projects/5433cd58699f41948bf541fedb3ed5d1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:10.942929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5433cd58699f41948bf541fedb3ed5d1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:10.945358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:11.052001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5433cd58699f41948bf541fedb3ed5d1', 'request_id': 'req-8741e1c9-18ee-4c9f-a184-605bf533ff57'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:11.069486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5433cd58699f41948bf541fedb3ed5d1', 'request_id': 'req-8741e1c9-18ee-4c9f-a184-605bf533ff57'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:11.076523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5433cd58699f41948bf541fedb3ed5d1', 'request_id': 'req-8741e1c9-18ee-4c9f-a184-605bf533ff57'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:11.088187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] The token cache is being invalidate because project 5433cd58699f41948bf541fedb3ed5d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:11.088817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:11.089850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8741e1c9-18ee-4c9f-a184-605bf533ff57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:11.098159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca517cd-d2bb-4cfb-825d-770debff1154 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:11.098744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca517cd-d2bb-4cfb-825d-770debff1154 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:11.098844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca517cd-d2bb-4cfb-825d-770debff1154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:11.100217 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1062/2117] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:10 2021] DELETE /identity/v3/projects/5433cd58699f41948bf541fedb3ed5d1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:11.178278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6ca517cd-d2bb-4cfb-825d-770debff1154 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:11.179866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6ca517cd-d2bb-4cfb-825d-770debff1154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:11.272813 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1056/2118] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:11.287715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79bc5b-b251-4a58-a94c-c3d4d9d7886d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:11.288203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79bc5b-b251-4a58-a94c-c3d4d9d7886d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:11.288661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79bc5b-b251-4a58-a94c-c3d4d9d7886d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:11.315670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6f79bc5b-b251-4a58-a94c-c3d4d9d7886d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:11.317274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6f79bc5b-b251-4a58-a94c-c3d4d9d7886d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:11.334151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca517cd-d2bb-4cfb-825d-770debff1154 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:11.337256 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1063/2119] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:11.346444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca517cd-d2bb-4cfb-825d-770debff1154 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:11.352480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc51f89-3f3e-4f7b-9337-ea265341ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:11.353159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc51f89-3f3e-4f7b-9337-ea265341ae3f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:11.353602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc51f89-3f3e-4f7b-9337-ea265341ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:11.353884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc51f89-3f3e-4f7b-9337-ea265341ae3f admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:11.354638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc51f89-3f3e-4f7b-9337-ea265341ae3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:11.354948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc51f89-3f3e-4f7b-9337-ea265341ae3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:11.356615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc51f89-3f3e-4f7b-9337-ea265341ae3f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:11.384380 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1057/2120] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:11.419094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79bc5b-b251-4a58-a94c-c3d4d9d7886d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:11.435960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79bc5b-b251-4a58-a94c-c3d4d9d7886d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:11.449061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458962e1-8708-42ce-bcc5-751681eb2bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:11.450149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458962e1-8708-42ce-bcc5-751681eb2bfd admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:11.450234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458962e1-8708-42ce-bcc5-751681eb2bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:11.450587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458962e1-8708-42ce-bcc5-751681eb2bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:11.451482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458962e1-8708-42ce-bcc5-751681eb2bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:11.453796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458962e1-8708-42ce-bcc5-751681eb2bfd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:11.499147 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1064/2121] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:11 2021] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:46:11.503301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc51f89-3f3e-4f7b-9337-ea265341ae3f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:11.524328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc51f89-3f3e-4f7b-9337-ea265341ae3f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:11.669125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8243f49-5052-4766-9d7c-e62cb3b5102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:11.670919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8243f49-5052-4766-9d7c-e62cb3b5102e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:11.671985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8243f49-5052-4766-9d7c-e62cb3b5102e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:11.675084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8243f49-5052-4766-9d7c-e62cb3b5102e admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:11.677548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8243f49-5052-4766-9d7c-e62cb3b5102e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:11.680986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8243f49-5052-4766-9d7c-e62cb3b5102e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:11.717907 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1058/2122] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:11 2021] POST /identity/v3/users => generated 290 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:11.722323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458962e1-8708-42ce-bcc5-751681eb2bfd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:11.740368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458962e1-8708-42ce-bcc5-751681eb2bfd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:11.760055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e973fc-7d99-48d2-92d5-ded0923fcf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:11.760747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e973fc-7d99-48d2-92d5-ded0923fcf6a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:11.761413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e973fc-7d99-48d2-92d5-ded0923fcf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:11.761918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e973fc-7d99-48d2-92d5-ded0923fcf6a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:11.765800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e973fc-7d99-48d2-92d5-ded0923fcf6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:11.767527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e973fc-7d99-48d2-92d5-ded0923fcf6a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:11.788841 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1065/2123] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:11 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:11.793447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8243f49-5052-4766-9d7c-e62cb3b5102e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:11.807545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8243f49-5052-4766-9d7c-e62cb3b5102e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:11.812695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f523c2e-d2a0-48da-a1fa-6f8982fb3f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:11.813586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f523c2e-d2a0-48da-a1fa-6f8982fb3f04 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:11.814054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f523c2e-d2a0-48da-a1fa-6f8982fb3f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:11.814511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f523c2e-d2a0-48da-a1fa-6f8982fb3f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:11.815525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f523c2e-d2a0-48da-a1fa-6f8982fb3f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:11.817974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f523c2e-d2a0-48da-a1fa-6f8982fb3f04 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:11.845931 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1059/2124] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:11 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:46:11.854117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e973fc-7d99-48d2-92d5-ded0923fcf6a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:11.876118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e973fc-7d99-48d2-92d5-ded0923fcf6a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:11.891935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e333e3-c364-4f96-9d7f-4f31b4735db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:11.893787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e333e3-c364-4f96-9d7f-4f31b4735db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:11.894264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e333e3-c364-4f96-9d7f-4f31b4735db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:11.894689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e333e3-c364-4f96-9d7f-4f31b4735db2 admin admin] PATH_INFO: `/v3/projects/86a34949582b4aacabbc6d4931b2d9f4/users/808ad0a476af4ee6a1b740c2204e63ea/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:11.920541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e333e3-c364-4f96-9d7f-4f31b4735db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a34949582b4aacabbc6d4931b2d9f4, user_id=808ad0a476af4ee6a1b740c2204e63ea, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:11.924944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e333e3-c364-4f96-9d7f-4f31b4735db2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:11.969655 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1066/2125] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:11 2021] PUT /identity/v3/projects/86a34949582b4aacabbc6d4931b2d9f4/users/808ad0a476af4ee6a1b740c2204e63ea/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:11.980198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d78dc-bbac-47c5-99ac-57208d8ebc42 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:11.981768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d78dc-bbac-47c5-99ac-57208d8ebc42 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:11.982695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d78dc-bbac-47c5-99ac-57208d8ebc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:12.033173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c00d78dc-bbac-47c5-99ac-57208d8ebc42 None None] MFA Rules not processed for user `808ad0a476af4ee6a1b740c2204e63ea`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:12.034584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c00d78dc-bbac-47c5-99ac-57208d8ebc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:12.145651 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1060/2126] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:11 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:12.150521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e333e3-c364-4f96-9d7f-4f31b4735db2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:12.267029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e333e3-c364-4f96-9d7f-4f31b4735db2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:12.273282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae3057-2305-4baf-9041-9048d7685f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:12.274482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae3057-2305-4baf-9041-9048d7685f72 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:12.274911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae3057-2305-4baf-9041-9048d7685f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:12.276774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae3057-2305-4baf-9041-9048d7685f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:12.277761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae3057-2305-4baf-9041-9048d7685f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:12.279850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae3057-2305-4baf-9041-9048d7685f72 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:12.345823 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1067/2127] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:12 2021] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:12.348387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d78dc-bbac-47c5-99ac-57208d8ebc42 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:12.365878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d78dc-bbac-47c5-99ac-57208d8ebc42 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:12.540000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2c1d-ad17-412c-aa58-4c3d30ff68cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:12.540683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2c1d-ad17-412c-aa58-4c3d30ff68cf admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:12.540962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2c1d-ad17-412c-aa58-4c3d30ff68cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:12.541231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2c1d-ad17-412c-aa58-4c3d30ff68cf admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:12.541984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2c1d-ad17-412c-aa58-4c3d30ff68cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:12.543940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2c1d-ad17-412c-aa58-4c3d30ff68cf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:12.580058 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1061/2128] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:12 2021] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:46:12.580191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae3057-2305-4baf-9041-9048d7685f72 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:12.598167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae3057-2305-4baf-9041-9048d7685f72 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:12.607946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01163556-fcf7-4e3c-abab-834e9d178f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:12.608539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163556-fcf7-4e3c-abab-834e9d178f2e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:12.608822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163556-fcf7-4e3c-abab-834e9d178f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:12.609097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01163556-fcf7-4e3c-abab-834e9d178f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:12.609842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01163556-fcf7-4e3c-abab-834e9d178f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:12.611489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01163556-fcf7-4e3c-abab-834e9d178f2e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:12.633863 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1068/2129] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:12 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:12.638213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2c1d-ad17-412c-aa58-4c3d30ff68cf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:12.652667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2c1d-ad17-412c-aa58-4c3d30ff68cf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:12.667134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f175aee-ab42-4de3-9b9c-84a27d831993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:12.668110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f175aee-ab42-4de3-9b9c-84a27d831993 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:12.668388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f175aee-ab42-4de3-9b9c-84a27d831993 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:12.668662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f175aee-ab42-4de3-9b9c-84a27d831993 admin admin] PATH_INFO: `/v3/projects/bf0c5d383e5f4ec2a3ba828d71de74aa/users/6e555240e03f48739b297f6ae8518343/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:12.695904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f175aee-ab42-4de3-9b9c-84a27d831993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0c5d383e5f4ec2a3ba828d71de74aa, user_id=6e555240e03f48739b297f6ae8518343, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:12.701133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f175aee-ab42-4de3-9b9c-84a27d831993 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:12.722544 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1062/2130] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:12 2021] PUT /identity/v3/projects/bf0c5d383e5f4ec2a3ba828d71de74aa/users/6e555240e03f48739b297f6ae8518343/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:12.726364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01163556-fcf7-4e3c-abab-834e9d178f2e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:12.744493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01163556-fcf7-4e3c-abab-834e9d178f2e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:12.844147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9426a75-e1c9-43c1-a0e2-27731b87fd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:12.845606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9426a75-e1c9-43c1-a0e2-27731b87fd5a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:12.846140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9426a75-e1c9-43c1-a0e2-27731b87fd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:12.846657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9426a75-e1c9-43c1-a0e2-27731b87fd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:12.847661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9426a75-e1c9-43c1-a0e2-27731b87fd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:12.849666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9426a75-e1c9-43c1-a0e2-27731b87fd5a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:12.863427 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1069/2131] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:12 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:12.866308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f175aee-ab42-4de3-9b9c-84a27d831993 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:12.883333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f175aee-ab42-4de3-9b9c-84a27d831993 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:12.891454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c618bf-202b-4c0c-824f-b66a89446c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:12.892424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c618bf-202b-4c0c-824f-b66a89446c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:12.892711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c618bf-202b-4c0c-824f-b66a89446c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:12.892984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c618bf-202b-4c0c-824f-b66a89446c79 admin admin] PATH_INFO: `/v3/projects/bf0c5d383e5f4ec2a3ba828d71de74aa/users/6e555240e03f48739b297f6ae8518343/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:12.895001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c618bf-202b-4c0c-824f-b66a89446c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0c5d383e5f4ec2a3ba828d71de74aa, user_id=6e555240e03f48739b297f6ae8518343, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:12.897849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c618bf-202b-4c0c-824f-b66a89446c79 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:12.915341 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1063/2132] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:12 2021] PUT /identity/v3/projects/bf0c5d383e5f4ec2a3ba828d71de74aa/users/6e555240e03f48739b297f6ae8518343/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:12.928339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa7e98-a298-4e28-ae0c-7b7f37bb75ff None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:12.928641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa7e98-a298-4e28-ae0c-7b7f37bb75ff None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:12.928921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa7e98-a298-4e28-ae0c-7b7f37bb75ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:12.999356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4faa7e98-a298-4e28-ae0c-7b7f37bb75ff None None] MFA Rules not processed for user `6e555240e03f48739b297f6ae8518343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:13.003518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4faa7e98-a298-4e28-ae0c-7b7f37bb75ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:13.144803 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1070/2133] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:12 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:13.194633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c618bf-202b-4c0c-824f-b66a89446c79 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:13.197545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d3c618bf-202b-4c0c-824f-b66a89446c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:13.320830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c618bf-202b-4c0c-824f-b66a89446c79 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:13.332214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d709f-1e02-47bc-8efd-d4cd22cd0ea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:13.333134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d709f-1e02-47bc-8efd-d4cd22cd0ea6 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:13.334831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d709f-1e02-47bc-8efd-d4cd22cd0ea6 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:13.334831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d709f-1e02-47bc-8efd-d4cd22cd0ea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:13.349201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d709f-1e02-47bc-8efd-d4cd22cd0ea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:13.351626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d709f-1e02-47bc-8efd-d4cd22cd0ea6 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:13.365520 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1064/2134] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:13 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:13.878334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa7e98-a298-4e28-ae0c-7b7f37bb75ff None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:13.880525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4faa7e98-a298-4e28-ae0c-7b7f37bb75ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:13.929493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d709f-1e02-47bc-8efd-d4cd22cd0ea6 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:14.017372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d709f-1e02-47bc-8efd-d4cd22cd0ea6 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:14.022902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:14.023925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:14.024272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:14.025105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] PATH_INFO: `/v3/users/808ad0a476af4ee6a1b740c2204e63ea` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:14.027326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=808ad0a476af4ee6a1b740c2204e63ea)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:14.029925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:14.109428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa7e98-a298-4e28-ae0c-7b7f37bb75ff None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:14.121048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3d82c-0ad1-485c-ac6a-f997b5a9a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:14.122265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3d82c-0ad1-485c-ac6a-f997b5a9a43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:14.122581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3d82c-0ad1-485c-ac6a-f997b5a9a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:14.123000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3d82c-0ad1-485c-ac6a-f997b5a9a43c admin admin] PATH_INFO: `/v3/users/0ca311be98bf4394a3b15147b308f7f4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:14.123178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808ad0a476af4ee6a1b740c2204e63ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.123946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808ad0a476af4ee6a1b740c2204e63ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.124476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3d82c-0ad1-485c-ac6a-f997b5a9a43c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca311be98bf4394a3b15147b308f7f4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:14.126840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3d82c-0ad1-485c-ac6a-f997b5a9a43c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:14.137692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808ad0a476af4ee6a1b740c2204e63ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.140585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808ad0a476af4ee6a1b740c2204e63ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.156725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808ad0a476af4ee6a1b740c2204e63ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.196553 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1065/2135] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:13 2021] DELETE /identity/v3/users/808ad0a476af4ee6a1b740c2204e63ea => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:14.198425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:14.200594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:14.256638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-54d3d82c-0ad1-485c-ac6a-f997b5a9a43c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca311be98bf4394a3b15147b308f7f4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.266967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-54d3d82c-0ad1-485c-ac6a-f997b5a9a43c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca311be98bf4394a3b15147b308f7f4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.269391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-54d3d82c-0ad1-485c-ac6a-f997b5a9a43c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca311be98bf4394a3b15147b308f7f4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.279034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-54d3d82c-0ad1-485c-ac6a-f997b5a9a43c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca311be98bf4394a3b15147b308f7f4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.294397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-54d3d82c-0ad1-485c-ac6a-f997b5a9a43c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca311be98bf4394a3b15147b308f7f4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.295175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4a2ea-04d7-4e88-ab7a-97a794831eee admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:14.304056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943c499-fc15-46f6-bf8d-84d64578d09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:14.304272 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1071/2136] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:13 2021] DELETE /identity/v3/users/0ca311be98bf4394a3b15147b308f7f4 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:14.306139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c499-fc15-46f6-bf8d-84d64578d09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:14.306429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c499-fc15-46f6-bf8d-84d64578d09f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:14.306701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c499-fc15-46f6-bf8d-84d64578d09f admin admin] PATH_INFO: `/v3/users/c6bda78859f14c7a8f397a209503f28e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:14.306822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bccfc-da5f-4213-a93f-d735a347d468 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:14.307122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bccfc-da5f-4213-a93f-d735a347d468 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:14.307814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bccfc-da5f-4213-a93f-d735a347d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:14.308457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c499-fc15-46f6-bf8d-84d64578d09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bda78859f14c7a8f397a209503f28e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:14.312042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c499-fc15-46f6-bf8d-84d64578d09f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:14.349665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-956bccfc-da5f-4213-a93f-d735a347d468 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:14.359441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-956bccfc-da5f-4213-a93f-d735a347d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:14.380791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7943c499-fc15-46f6-bf8d-84d64578d09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bda78859f14c7a8f397a209503f28e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.381516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7943c499-fc15-46f6-bf8d-84d64578d09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bda78859f14c7a8f397a209503f28e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.389838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7943c499-fc15-46f6-bf8d-84d64578d09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bda78859f14c7a8f397a209503f28e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.391859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7943c499-fc15-46f6-bf8d-84d64578d09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bda78859f14c7a8f397a209503f28e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.429290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7943c499-fc15-46f6-bf8d-84d64578d09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bda78859f14c7a8f397a209503f28e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:14.461055 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1066/2137] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:14 2021] DELETE /identity/v3/users/c6bda78859f14c7a8f397a209503f28e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:14.465994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d46873-da66-48c0-bede-d259c651d486 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:14.466738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d46873-da66-48c0-bede-d259c651d486 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:14.469290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d46873-da66-48c0-bede-d259c651d486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:14.493526 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1072/2138] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:14.494655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada34590-af61-4db5-b90b-9c953aeee97c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:14.494945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada34590-af61-4db5-b90b-9c953aeee97c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:14.495267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada34590-af61-4db5-b90b-9c953aeee97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:14.508873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e5d46873-da66-48c0-bede-d259c651d486 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:14.513563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e5d46873-da66-48c0-bede-d259c651d486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:14.533580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ada34590-af61-4db5-b90b-9c953aeee97c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:14.535194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ada34590-af61-4db5-b90b-9c953aeee97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:14.651587 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1067/2139] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:14.652363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d46873-da66-48c0-bede-d259c651d486 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:14.655748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e5d46873-da66-48c0-bede-d259c651d486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:14.667737 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1073/2140] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:14.701196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada34590-af61-4db5-b90b-9c953aeee97c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:14.704295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ada34590-af61-4db5-b90b-9c953aeee97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:14.830640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d46873-da66-48c0-bede-d259c651d486 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:14.841278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fcb76-57f1-4b6b-9575-2a34ebcd4817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:14.841973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fcb76-57f1-4b6b-9575-2a34ebcd4817 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:14.842275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fcb76-57f1-4b6b-9575-2a34ebcd4817 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:14.842589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fcb76-57f1-4b6b-9575-2a34ebcd4817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:14.848312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada34590-af61-4db5-b90b-9c953aeee97c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:14.866198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fcb76-57f1-4b6b-9575-2a34ebcd4817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:14.869845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af67e2-ab59-4545-93d7-32752972ddaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:14.870826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af67e2-ab59-4545-93d7-32752972ddaf service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:14.872525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fcb76-57f1-4b6b-9575-2a34ebcd4817 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:14.875765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af67e2-ab59-4545-93d7-32752972ddaf service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:14.876054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af67e2-ab59-4545-93d7-32752972ddaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:14.900235 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1068/2141] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:14.901195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af67e2-ab59-4545-93d7-32752972ddaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:14.902598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fcb76-57f1-4b6b-9575-2a34ebcd4817 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:14.904746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af67e2-ab59-4545-93d7-32752972ddaf service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:14.905982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2f4fcb76-57f1-4b6b-9575-2a34ebcd4817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:14.935717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fcb76-57f1-4b6b-9575-2a34ebcd4817 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:14.936255 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1074/2142] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:14.943301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401c93d-527b-45ec-ab09-fb71a33b2b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:14.943968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401c93d-527b-45ec-ab09-fb71a33b2b20 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:14.944251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401c93d-527b-45ec-ab09-fb71a33b2b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:14.944584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401c93d-527b-45ec-ab09-fb71a33b2b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:14.958968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401c93d-527b-45ec-ab09-fb71a33b2b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:14.960981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401c93d-527b-45ec-ab09-fb71a33b2b20 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:14.980380 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1069/2143] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:15.319477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af67e2-ab59-4545-93d7-32752972ddaf service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:15.322116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a1af67e2-ab59-4545-93d7-32752972ddaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:15.447460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401c93d-527b-45ec-ab09-fb71a33b2b20 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:15.449014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e401c93d-527b-45ec-ab09-fb71a33b2b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:15.468988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401c93d-527b-45ec-ab09-fb71a33b2b20 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:15.478803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af67e2-ab59-4545-93d7-32752972ddaf service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:15.481944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:15.482811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:15.483095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:15.483404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] PATH_INFO: `/v3/projects/75de5fe7240c4923a26724fd417391e8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:15.486293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75de5fe7240c4923a26724fd417391e8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:15.487112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f28f42-147a-4cb7-aefe-36877770ea79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:15.488277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:15.488445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f28f42-147a-4cb7-aefe-36877770ea79 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:15.488868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f28f42-147a-4cb7-aefe-36877770ea79 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:15.489226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f28f42-147a-4cb7-aefe-36877770ea79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:15.491211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c9f28f42-147a-4cb7-aefe-36877770ea79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:15.587312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75de5fe7240c4923a26724fd417391e8', 'request_id': 'req-5099fff7-7726-4ef4-b179-f9efa8c446e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:15.593375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f28f42-147a-4cb7-aefe-36877770ea79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:15.596054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f28f42-147a-4cb7-aefe-36877770ea79 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:15.597893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75de5fe7240c4923a26724fd417391e8', 'request_id': 'req-5099fff7-7726-4ef4-b179-f9efa8c446e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:15.611414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75de5fe7240c4923a26724fd417391e8', 'request_id': 'req-5099fff7-7726-4ef4-b179-f9efa8c446e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:15.615827 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1075/2144] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:15 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:15.627588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] The token cache is being invalidate because project 75de5fe7240c4923a26724fd417391e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:15.627806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:15.629259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5099fff7-7726-4ef4-b179-f9efa8c446e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:15.636086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f28f42-147a-4cb7-aefe-36877770ea79 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:15.636287 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1070/2145] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:15 2021] DELETE /identity/v3/projects/75de5fe7240c4923a26724fd417391e8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:15.656791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f28f42-147a-4cb7-aefe-36877770ea79 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:15.760583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c803a-9a84-472a-8639-b042d5f7fdf8 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:15.760792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c803a-9a84-472a-8639-b042d5f7fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:15.761100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c803a-9a84-472a-8639-b042d5f7fdf8 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:15.765357 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1071/2146] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:46:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:46:15.775669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b71b34-e65d-476d-a030-a7a741e11133 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:15.775963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b71b34-e65d-476d-a030-a7a741e11133 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:15.776242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b71b34-e65d-476d-a030-a7a741e11133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:15.803219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:15.804163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:15.804452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:15.804769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] PATH_INFO: `/v3/users/05b3d69282f44610a7faa4cf5cd4a4fe` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:15.809652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b3d69282f44610a7faa4cf5cd4a4fe)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:15.817066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:15.821583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-32b71b34-e65d-476d-a030-a7a741e11133 None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:15.829989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-32b71b34-e65d-476d-a030-a7a741e11133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:15.949113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b3d69282f44610a7faa4cf5cd4a4fe'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:15.968282 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1072/2147] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:46:15 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:15.985171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b3d69282f44610a7faa4cf5cd4a4fe'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:15.987099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b3d69282f44610a7faa4cf5cd4a4fe'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:15.988411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b71b34-e65d-476d-a030-a7a741e11133 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:15.990183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-32b71b34-e65d-476d-a030-a7a741e11133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:16.006047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b71b34-e65d-476d-a030-a7a741e11133 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:16.009145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b3d69282f44610a7faa4cf5cd4a4fe'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:16.014646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a332ab-2ca3-4f6a-aeda-317811b5621c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:16.017187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a332ab-2ca3-4f6a-aeda-317811b5621c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:16.017187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a332ab-2ca3-4f6a-aeda-317811b5621c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:16.018372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a332ab-2ca3-4f6a-aeda-317811b5621c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:16.028887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d7a332ab-2ca3-4f6a-aeda-317811b5621c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:16.036466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b3d69282f44610a7faa4cf5cd4a4fe'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:16.050284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a332ab-2ca3-4f6a-aeda-317811b5621c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:16.050511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a332ab-2ca3-4f6a-aeda-317811b5621c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:16.051043 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1076/2148] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:15 2021] DELETE /identity/v3/users/05b3d69282f44610a7faa4cf5cd4a4fe => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:16.066585 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1073/2149] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:15 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:16.413513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:16.415021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:16.542418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744231-83d9-435f-8240-c397c4301e6b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:16.555547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:16.556426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:16.556708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:16.557022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] PATH_INFO: `/v3/projects/86a34949582b4aacabbc6d4931b2d9f4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:16.558389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a34949582b4aacabbc6d4931b2d9f4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:16.560358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:16.638714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a332ab-2ca3-4f6a-aeda-317811b5621c service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:16.640898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d7a332ab-2ca3-4f6a-aeda-317811b5621c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:16.676403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a332ab-2ca3-4f6a-aeda-317811b5621c service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:16.684759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a34949582b4aacabbc6d4931b2d9f4', 'request_id': 'req-58863480-6159-4f75-b46c-532add1f8ad5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:16.703308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a34949582b4aacabbc6d4931b2d9f4', 'request_id': 'req-58863480-6159-4f75-b46c-532add1f8ad5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:16.717766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a34949582b4aacabbc6d4931b2d9f4', 'request_id': 'req-58863480-6159-4f75-b46c-532add1f8ad5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:16.751338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] The token cache is being invalidate because project 86a34949582b4aacabbc6d4931b2d9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:16.756240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:16.758974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:16.765072 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1077/2150] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:16 2021] DELETE /identity/v3/projects/86a34949582b4aacabbc6d4931b2d9f4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:16.767295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:16.775932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:16.877821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:16.879649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:16.880039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:16.880951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] PATH_INFO: `/v3/projects/9d8f0c34da8b4307bec3f04575d55849` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:16.883757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d8f0c34da8b4307bec3f04575d55849)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:16.887560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:16.940925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58863480-6159-4f75-b46c-532add1f8ad5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:16.956455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:16.958855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:16.959340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:16.959798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] PATH_INFO: `/v3/projects/8e7777e255604cfaa71fbcc6e505061c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:16.962595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7777e255604cfaa71fbcc6e505061c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:16.966364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:16.983001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d8f0c34da8b4307bec3f04575d55849', 'request_id': 'req-9ae90b7c-340c-4cc5-89e0-3dec191518c7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.003942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d8f0c34da8b4307bec3f04575d55849', 'request_id': 'req-9ae90b7c-340c-4cc5-89e0-3dec191518c7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.013833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d8f0c34da8b4307bec3f04575d55849', 'request_id': 'req-9ae90b7c-340c-4cc5-89e0-3dec191518c7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.032192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] The token cache is being invalidate because project 9d8f0c34da8b4307bec3f04575d55849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:17.032681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.033916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.040106 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1074/2151] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:16 2021] DELETE /identity/v3/projects/9d8f0c34da8b4307bec3f04575d55849 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:17.041156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:17.043764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:17.059287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7777e255604cfaa71fbcc6e505061c', 'request_id': 'req-5b4f6c70-949c-4bf7-b891-579b79658dfd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.068727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7777e255604cfaa71fbcc6e505061c', 'request_id': 'req-5b4f6c70-949c-4bf7-b891-579b79658dfd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.077623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7777e255604cfaa71fbcc6e505061c', 'request_id': 'req-5b4f6c70-949c-4bf7-b891-579b79658dfd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.093912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] The token cache is being invalidate because project 8e7777e255604cfaa71fbcc6e505061c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:17.094229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.094945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.097280 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1078/2152] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:16 2021] DELETE /identity/v3/projects/8e7777e255604cfaa71fbcc6e505061c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:17.103751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:17.106550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:17.131810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae90b7c-340c-4cc5-89e0-3dec191518c7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:17.208159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8c645-90aa-4db5-a625-6e4dda195065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:17.209195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8c645-90aa-4db5-a625-6e4dda195065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:17.209577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8c645-90aa-4db5-a625-6e4dda195065 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:17.209963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8c645-90aa-4db5-a625-6e4dda195065 admin admin] PATH_INFO: `/v3/users/6e555240e03f48739b297f6ae8518343` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:17.212089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8c645-90aa-4db5-a625-6e4dda195065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e555240e03f48739b297f6ae8518343)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:17.214432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8c645-90aa-4db5-a625-6e4dda195065 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:17.223574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f6c70-949c-4bf7-b891-579b79658dfd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:17.228544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:17.229414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:17.229696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:17.229970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] PATH_INFO: `/v3/users/17a180a783424ce88239c7edb25bafc3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:17.231480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a180a783424ce88239c7edb25bafc3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:17.233454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:17.296441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a180a783424ce88239c7edb25bafc3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.299326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eeb8c645-90aa-4db5-a625-6e4dda195065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e555240e03f48739b297f6ae8518343'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.300365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eeb8c645-90aa-4db5-a625-6e4dda195065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e555240e03f48739b297f6ae8518343'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.306257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a180a783424ce88239c7edb25bafc3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.306924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a180a783424ce88239c7edb25bafc3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.316850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eeb8c645-90aa-4db5-a625-6e4dda195065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e555240e03f48739b297f6ae8518343'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.317824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eeb8c645-90aa-4db5-a625-6e4dda195065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e555240e03f48739b297f6ae8518343'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.318671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a180a783424ce88239c7edb25bafc3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.337930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eeb8c645-90aa-4db5-a625-6e4dda195065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e555240e03f48739b297f6ae8518343'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.338124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a180a783424ce88239c7edb25bafc3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.345917 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1079/2153] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:17 2021] DELETE /identity/v3/users/17a180a783424ce88239c7edb25bafc3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:17.350608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:17.352922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:17.378407 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1075/2154] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:17 2021] DELETE /identity/v3/users/6e555240e03f48739b297f6ae8518343 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:17.380136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132b438-f084-41cf-a7d7-5cd386cf355a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:17.380545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132b438-f084-41cf-a7d7-5cd386cf355a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:17.381163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132b438-f084-41cf-a7d7-5cd386cf355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:17.441274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7132b438-f084-41cf-a7d7-5cd386cf355a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:17.442591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7132b438-f084-41cf-a7d7-5cd386cf355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:17.492950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b5b91-a39b-49e6-81a0-d8a0f1e39b2d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:17.624027 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1076/2155] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:17.625508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f761a8-34a9-42bc-9fdd-b4a21a8a7f71 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:17.625904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f761a8-34a9-42bc-9fdd-b4a21a8a7f71 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:17.626285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f761a8-34a9-42bc-9fdd-b4a21a8a7f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:17.645380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926989d6-a6c2-459d-974d-5de6465ff40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:17.646278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926989d6-a6c2-459d-974d-5de6465ff40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:17.646563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926989d6-a6c2-459d-974d-5de6465ff40a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:17.646842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926989d6-a6c2-459d-974d-5de6465ff40a admin admin] PATH_INFO: `/v3/users/b0ae8ce9404e4333816abaafb888a78a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:17.649380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926989d6-a6c2-459d-974d-5de6465ff40a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ae8ce9404e4333816abaafb888a78a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:17.652076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926989d6-a6c2-459d-974d-5de6465ff40a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:17.674737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-54f761a8-34a9-42bc-9fdd-b4a21a8a7f71 None None] MFA Rules not processed for user `559cab992ce74bd0b78a639e4001c918`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:17.676445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-54f761a8-34a9-42bc-9fdd-b4a21a8a7f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:17.771888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-926989d6-a6c2-459d-974d-5de6465ff40a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ae8ce9404e4333816abaafb888a78a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.783712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-926989d6-a6c2-459d-974d-5de6465ff40a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ae8ce9404e4333816abaafb888a78a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.785502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-926989d6-a6c2-459d-974d-5de6465ff40a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ae8ce9404e4333816abaafb888a78a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.797624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-926989d6-a6c2-459d-974d-5de6465ff40a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ae8ce9404e4333816abaafb888a78a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.799836 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1077/2156] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:17 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:17.801866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bfa07-0f94-4bce-ae55-5737d84ff9e6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:17.802151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bfa07-0f94-4bce-ae55-5737d84ff9e6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:17.802424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bfa07-0f94-4bce-ae55-5737d84ff9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:17.818778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-926989d6-a6c2-459d-974d-5de6465ff40a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ae8ce9404e4333816abaafb888a78a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:17.826579 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1080/2157] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:17 2021] DELETE /identity/v3/users/b0ae8ce9404e4333816abaafb888a78a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:17.827811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ec8bfa07-0f94-4bce-ae55-5737d84ff9e6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:17.828616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6636-9be9-45ac-8724-c8aef969ff14 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:17.829113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6636-9be9-45ac-8724-c8aef969ff14 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:17.829263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec8bfa07-0f94-4bce-ae55-5737d84ff9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:17.829754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6636-9be9-45ac-8724-c8aef969ff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:17.852425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f2ce6636-9be9-45ac-8724-c8aef969ff14 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:17.854592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f2ce6636-9be9-45ac-8724-c8aef969ff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:17.924016 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1078/2158] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:17.945132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bfa07-0f94-4bce-ae55-5737d84ff9e6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:17.946895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec8bfa07-0f94-4bce-ae55-5737d84ff9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:17.950517 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1081/2159] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:17.955323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce6636-9be9-45ac-8724-c8aef969ff14 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:17.973805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce6636-9be9-45ac-8724-c8aef969ff14 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:17.982479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12243e8-994a-447c-b83d-e0d8806dd3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:17.983231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12243e8-994a-447c-b83d-e0d8806dd3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:17.984112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12243e8-994a-447c-b83d-e0d8806dd3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:17.984308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12243e8-994a-447c-b83d-e0d8806dd3d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:17.985126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12243e8-994a-447c-b83d-e0d8806dd3d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:17.985445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12243e8-994a-447c-b83d-e0d8806dd3d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:17.987628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12243e8-994a-447c-b83d-e0d8806dd3d5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:18.004811 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1082/2160] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:46:18.009444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12243e8-994a-447c-b83d-e0d8806dd3d5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:18.022587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12243e8-994a-447c-b83d-e0d8806dd3d5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:18.025761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bfa07-0f94-4bce-ae55-5737d84ff9e6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:18.031362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ac362-5664-48a9-9077-883d8464503f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:18.032065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ac362-5664-48a9-9077-883d8464503f service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:18.032623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ac362-5664-48a9-9077-883d8464503f service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:18.032736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6566624-9a25-46b7-b838-29c21023295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:18.032888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ac362-5664-48a9-9077-883d8464503f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:18.033543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6566624-9a25-46b7-b838-29c21023295f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:18.034030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6566624-9a25-46b7-b838-29c21023295f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:18.034397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6566624-9a25-46b7-b838-29c21023295f admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:18.036157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6566624-9a25-46b7-b838-29c21023295f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:18.038972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6566624-9a25-46b7-b838-29c21023295f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:18.044211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ac362-5664-48a9-9077-883d8464503f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:18.046129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ac362-5664-48a9-9077-883d8464503f service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:18.058816 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1079/2161] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:18.083612 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1083/2162] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:18 2021] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:18.088101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ac362-5664-48a9-9077-883d8464503f service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:18.108095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ac362-5664-48a9-9077-883d8464503f service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:18.198473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1cfd8-a869-44c2-b71c-4eba090e4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:18.199224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1cfd8-a869-44c2-b71c-4eba090e4c35 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:18.199545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1cfd8-a869-44c2-b71c-4eba090e4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:18.199826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1cfd8-a869-44c2-b71c-4eba090e4c35 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:18.200552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1cfd8-a869-44c2-b71c-4eba090e4c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:18.204271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1cfd8-a869-44c2-b71c-4eba090e4c35 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:18.225871 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1080/2163] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:18 2021] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:46:18.230371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6566624-9a25-46b7-b838-29c21023295f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:18.241810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6566624-9a25-46b7-b838-29c21023295f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:18.249972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b761f8-76e7-4ef2-a6d5-e58a43dce25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:18.251141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b761f8-76e7-4ef2-a6d5-e58a43dce25b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:18.251670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b761f8-76e7-4ef2-a6d5-e58a43dce25b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:18.252154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b761f8-76e7-4ef2-a6d5-e58a43dce25b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:18.253120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b761f8-76e7-4ef2-a6d5-e58a43dce25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:18.255276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b761f8-76e7-4ef2-a6d5-e58a43dce25b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:18.273584 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1084/2164] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:18 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:46:18.277696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1cfd8-a869-44c2-b71c-4eba090e4c35 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:18.293607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1cfd8-a869-44c2-b71c-4eba090e4c35 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:18.300606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1f459-76a5-4fb6-8501-7a5d9e43386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:18.301574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1f459-76a5-4fb6-8501-7a5d9e43386a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:18.301963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1f459-76a5-4fb6-8501-7a5d9e43386a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:18.302626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1f459-76a5-4fb6-8501-7a5d9e43386a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:18.303521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1f459-76a5-4fb6-8501-7a5d9e43386a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:18.306344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1f459-76a5-4fb6-8501-7a5d9e43386a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:18.320894 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1081/2165] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:18 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:46:18.324729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b761f8-76e7-4ef2-a6d5-e58a43dce25b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:18.334841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b761f8-76e7-4ef2-a6d5-e58a43dce25b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:18.340833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c653e2b-8d64-43ac-a4cf-a168c1ec0993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:18.341792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c653e2b-8d64-43ac-a4cf-a168c1ec0993 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:18.342138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c653e2b-8d64-43ac-a4cf-a168c1ec0993 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:18.342487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c653e2b-8d64-43ac-a4cf-a168c1ec0993 admin admin] PATH_INFO: `/v3/projects/bdd7197dea99453d96733be271e26ee5/users/1cdae0dd1fc34ba58e701578da67c310/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:18.362390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c653e2b-8d64-43ac-a4cf-a168c1ec0993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd7197dea99453d96733be271e26ee5, user_id=1cdae0dd1fc34ba58e701578da67c310, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:18.365835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c653e2b-8d64-43ac-a4cf-a168c1ec0993 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:18.384215 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1085/2166] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:18 2021] PUT /identity/v3/projects/bdd7197dea99453d96733be271e26ee5/users/1cdae0dd1fc34ba58e701578da67c310/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:18.397955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ac17f-d036-4602-b362-ccd76c737fd8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:18.398255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ac17f-d036-4602-b362-ccd76c737fd8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:18.398627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ac17f-d036-4602-b362-ccd76c737fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:18.405311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c653e2b-8d64-43ac-a4cf-a168c1ec0993 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:18.408135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8c653e2b-8d64-43ac-a4cf-a168c1ec0993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:18.440544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e32ac17f-d036-4602-b362-ccd76c737fd8 None None] MFA Rules not processed for user `1cdae0dd1fc34ba58e701578da67c310`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:18.450494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e32ac17f-d036-4602-b362-ccd76c737fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:18.499209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c653e2b-8d64-43ac-a4cf-a168c1ec0993 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:18.505733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:18.506665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:18.507017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:18.507522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] PATH_INFO: `/v3/projects/86ee5c27bb6e4b2d89671817ecd59b63` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:18.509496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ee5c27bb6e4b2d89671817ecd59b63)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:18.514539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:18.533917 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1082/2167] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:18 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:18.535287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ac17f-d036-4602-b362-ccd76c737fd8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:18.536797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e32ac17f-d036-4602-b362-ccd76c737fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:18.552318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ac17f-d036-4602-b362-ccd76c737fd8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:18.568400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ee5c27bb6e4b2d89671817ecd59b63', 'request_id': 'req-46e5ab7b-93e6-4fc0-b37e-315d4a486313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:18.576961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ee5c27bb6e4b2d89671817ecd59b63', 'request_id': 'req-46e5ab7b-93e6-4fc0-b37e-315d4a486313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:18.599819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ee5c27bb6e4b2d89671817ecd59b63', 'request_id': 'req-46e5ab7b-93e6-4fc0-b37e-315d4a486313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:18.624540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] The token cache is being invalidate because project 86ee5c27bb6e4b2d89671817ecd59b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:18.624848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:18.625697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:18.628223 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1086/2168] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:18 2021] DELETE /identity/v3/projects/86ee5c27bb6e4b2d89671817ecd59b63 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:18.629128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:18.630893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:18.665321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:18.672535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:18.675177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:18.675812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] PATH_INFO: `/v3/projects/bf0c5d383e5f4ec2a3ba828d71de74aa` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:18.680401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0c5d383e5f4ec2a3ba828d71de74aa)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:18.686315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:18.732277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5ab7b-93e6-4fc0-b37e-315d4a486313 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:18.736765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55210-804a-4e3e-9955-7a6f922d266e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:18.737890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55210-804a-4e3e-9955-7a6f922d266e service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:18.738355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55210-804a-4e3e-9955-7a6f922d266e service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:18.738812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55210-804a-4e3e-9955-7a6f922d266e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:18.741539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-76d55210-804a-4e3e-9955-7a6f922d266e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:18.831890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0c5d383e5f4ec2a3ba828d71de74aa', 'request_id': 'req-adfacb48-d193-478c-99ba-8b0297b5dec2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:18.846758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0c5d383e5f4ec2a3ba828d71de74aa', 'request_id': 'req-adfacb48-d193-478c-99ba-8b0297b5dec2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:18.861660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0c5d383e5f4ec2a3ba828d71de74aa', 'request_id': 'req-adfacb48-d193-478c-99ba-8b0297b5dec2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:18.889494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] The token cache is being invalidate because project bf0c5d383e5f4ec2a3ba828d71de74aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:18.890148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:18.891297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:18.900503 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1083/2169] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:18 2021] DELETE /identity/v3/projects/bf0c5d383e5f4ec2a3ba828d71de74aa => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:18.901494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:18.903230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d55210-804a-4e3e-9955-7a6f922d266e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:18.906411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d55210-804a-4e3e-9955-7a6f922d266e service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:18.908027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:18.921234 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1087/2170] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:18 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:18.922094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55210-804a-4e3e-9955-7a6f922d266e service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:18.923620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-76d55210-804a-4e3e-9955-7a6f922d266e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:18.944979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55210-804a-4e3e-9955-7a6f922d266e service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:19.037355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f40b9-4f66-4368-996d-9e36486ad91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:19.039388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f40b9-4f66-4368-996d-9e36486ad91f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.039679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f40b9-4f66-4368-996d-9e36486ad91f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.040123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f40b9-4f66-4368-996d-9e36486ad91f admin admin] PATH_INFO: `/v3/users/a75449ed49664e79ba3f2d49bb5fb032` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.040756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfacb48-d193-478c-99ba-8b0297b5dec2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:19.042697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f40b9-4f66-4368-996d-9e36486ad91f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75449ed49664e79ba3f2d49bb5fb032)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:19.046910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f40b9-4f66-4368-996d-9e36486ad91f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:19.055287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:19.056611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.057054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.058561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] PATH_INFO: `/v3/projects/1173fc8dd8694a209341582ce49219e1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.061223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1173fc8dd8694a209341582ce49219e1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:19.064167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:19.145914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-256f40b9-4f66-4368-996d-9e36486ad91f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75449ed49664e79ba3f2d49bb5fb032'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:19.161424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-256f40b9-4f66-4368-996d-9e36486ad91f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75449ed49664e79ba3f2d49bb5fb032'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:19.161863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-256f40b9-4f66-4368-996d-9e36486ad91f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75449ed49664e79ba3f2d49bb5fb032'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:19.177059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1173fc8dd8694a209341582ce49219e1', 'request_id': 'req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:19.183337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-256f40b9-4f66-4368-996d-9e36486ad91f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75449ed49664e79ba3f2d49bb5fb032'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:19.185628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1173fc8dd8694a209341582ce49219e1', 'request_id': 'req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:19.201085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1173fc8dd8694a209341582ce49219e1', 'request_id': 'req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:19.220451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-256f40b9-4f66-4368-996d-9e36486ad91f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75449ed49664e79ba3f2d49bb5fb032'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:19.228803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] The token cache is being invalidate because project 1173fc8dd8694a209341582ce49219e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:19.230302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:19.232346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da0c7419-e4d2-4eda-aed2-c13f68cbc94a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:19.237050 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1084/2172] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:18 2021] DELETE /identity/v3/projects/1173fc8dd8694a209341582ce49219e1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:19.237218 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1088/2172] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:18 2021] DELETE /identity/v3/users/a75449ed49664e79ba3f2d49bb5fb032 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:19.238615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7be1-b45d-4617-897e-dd45038f4cc7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.238972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7be1-b45d-4617-897e-dd45038f4cc7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.239353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7be1-b45d-4617-897e-dd45038f4cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.244759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e98025-374e-4b56-b3e4-83f50781567b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.245141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e98025-374e-4b56-b3e4-83f50781567b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.245729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e98025-374e-4b56-b3e4-83f50781567b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.280142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-538d7be1-b45d-4617-897e-dd45038f4cc7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:19.281272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-538d7be1-b45d-4617-897e-dd45038f4cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:19.283074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f2e98025-374e-4b56-b3e4-83f50781567b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:19.284277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f2e98025-374e-4b56-b3e4-83f50781567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:19.396435 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1085/2173] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:19.398370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8795a-cd17-4182-862e-3c7c0e6dde0b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.398821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8795a-cd17-4182-862e-3c7c0e6dde0b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.399291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8795a-cd17-4182-862e-3c7c0e6dde0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.451718 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1089/2174] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:19.462224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c3e8795a-cd17-4182-862e-3c7c0e6dde0b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:19.464701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c3e8795a-cd17-4182-862e-3c7c0e6dde0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:19.487109 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1086/2175] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:19.491671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e98025-374e-4b56-b3e4-83f50781567b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:19.504039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e98025-374e-4b56-b3e4-83f50781567b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:19.507307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911a271-1169-418d-a6ce-0eb4c386a681 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.507627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911a271-1169-418d-a6ce-0eb4c386a681 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.508650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911a271-1169-418d-a6ce-0eb4c386a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.525087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac79b7-6eca-409f-920b-ea444fa64d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:19.528083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac79b7-6eca-409f-920b-ea444fa64d1d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.528931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac79b7-6eca-409f-920b-ea444fa64d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.529970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac79b7-6eca-409f-920b-ea444fa64d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.531153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac79b7-6eca-409f-920b-ea444fa64d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:19.535329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac79b7-6eca-409f-920b-ea444fa64d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:19.536516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac79b7-6eca-409f-920b-ea444fa64d1d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:19.546823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0911a271-1169-418d-a6ce-0eb4c386a681 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:19.548204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0911a271-1169-418d-a6ce-0eb4c386a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:19.561847 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1087/2176] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:19.562883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911a271-1169-418d-a6ce-0eb4c386a681 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:19.570022 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1090/2177] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:19.575003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac79b7-6eca-409f-920b-ea444fa64d1d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:19.585205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911a271-1169-418d-a6ce-0eb4c386a681 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:19.588019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac79b7-6eca-409f-920b-ea444fa64d1d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:19.596328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7699c9-cf9b-4f77-9755-00044f1f011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:19.597150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7699c9-cf9b-4f77-9755-00044f1f011a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.597326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c58a1-36c8-4fab-b738-216f3b59727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:19.597636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7699c9-cf9b-4f77-9755-00044f1f011a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.598035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7699c9-cf9b-4f77-9755-00044f1f011a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.598529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c58a1-36c8-4fab-b738-216f3b59727b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.598962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c58a1-36c8-4fab-b738-216f3b59727b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.599139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7699c9-cf9b-4f77-9755-00044f1f011a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:19.599567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c58a1-36c8-4fab-b738-216f3b59727b admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.599694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7699c9-cf9b-4f77-9755-00044f1f011a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:19.600585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c58a1-36c8-4fab-b738-216f3b59727b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:19.601615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7699c9-cf9b-4f77-9755-00044f1f011a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:19.603280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c58a1-36c8-4fab-b738-216f3b59727b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:19.618978 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1088/2178] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:19.621041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7699c9-cf9b-4f77-9755-00044f1f011a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:19.637400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7699c9-cf9b-4f77-9755-00044f1f011a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:19.645331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916885d-5e7b-4599-8a11-f790900d2539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:19.651561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916885d-5e7b-4599-8a11-f790900d2539 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.652365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916885d-5e7b-4599-8a11-f790900d2539 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.653492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916885d-5e7b-4599-8a11-f790900d2539 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.655618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916885d-5e7b-4599-8a11-f790900d2539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:19.660935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916885d-5e7b-4599-8a11-f790900d2539 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:19.665388 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1091/2179] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:19 2021] POST /identity/v3/projects => generated 397 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:46:19.680155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c58a1-36c8-4fab-b738-216f3b59727b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:19.726124 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1089/2180] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:19 2021] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:19.731976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916885d-5e7b-4599-8a11-f790900d2539 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:19.820900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c58a1-36c8-4fab-b738-216f3b59727b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:19.884080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916885d-5e7b-4599-8a11-f790900d2539 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:19.893651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c395cb0-7be9-4ca5-9f18-2a93028e2b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:19.894633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c395cb0-7be9-4ca5-9f18-2a93028e2b12 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.895699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c395cb0-7be9-4ca5-9f18-2a93028e2b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.896841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c395cb0-7be9-4ca5-9f18-2a93028e2b12 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.900474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c395cb0-7be9-4ca5-9f18-2a93028e2b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:19.909531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c395cb0-7be9-4ca5-9f18-2a93028e2b12 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:19.939639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46998db-3763-45a8-a01f-ef7861cf0f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:19.940953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46998db-3763-45a8-a01f-ef7861cf0f9b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:19.943768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46998db-3763-45a8-a01f-ef7861cf0f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:19.944515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46998db-3763-45a8-a01f-ef7861cf0f9b admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:19.946827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46998db-3763-45a8-a01f-ef7861cf0f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:19.951688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46998db-3763-45a8-a01f-ef7861cf0f9b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:19.953804 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1090/2181] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:19 2021] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:19.954681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c395cb0-7be9-4ca5-9f18-2a93028e2b12 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:19.963071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2c395cb0-7be9-4ca5-9f18-2a93028e2b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:19.992708 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1092/2182] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:19 2021] POST /identity/v3/users => generated 299 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:19.994551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46998db-3763-45a8-a01f-ef7861cf0f9b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:19.998523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c395cb0-7be9-4ca5-9f18-2a93028e2b12 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:20.013746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:20.014617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.014903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.015180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] PATH_INFO: `/v3/users/1cdae0dd1fc34ba58e701578da67c310` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.016988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cdae0dd1fc34ba58e701578da67c310)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:20.017401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46998db-3763-45a8-a01f-ef7861cf0f9b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:20.019435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:20.023871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d4d74-2061-422a-a794-0ba4e1d297e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:20.025533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d4d74-2061-422a-a794-0ba4e1d297e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.026025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d4d74-2061-422a-a794-0ba4e1d297e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.027278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d4d74-2061-422a-a794-0ba4e1d297e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.028216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d4d74-2061-422a-a794-0ba4e1d297e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:20.030082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d4d74-2061-422a-a794-0ba4e1d297e2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:20.045714 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1093/2183] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:19 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:20.048268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d4d74-2061-422a-a794-0ba4e1d297e2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:20.069218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d4d74-2061-422a-a794-0ba4e1d297e2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:20.080922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15a5c-dc60-457e-a9ae-f16f3e0d431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:20.081639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15a5c-dc60-457e-a9ae-f16f3e0d431f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.082208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15a5c-dc60-457e-a9ae-f16f3e0d431f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.082208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c15a5c-dc60-457e-a9ae-f16f3e0d431f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.082927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c15a5c-dc60-457e-a9ae-f16f3e0d431f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:20.085973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c15a5c-dc60-457e-a9ae-f16f3e0d431f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:20.090799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cdae0dd1fc34ba58e701578da67c310'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:20.091598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cdae0dd1fc34ba58e701578da67c310'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:20.102841 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1094/2184] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:20 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:20.103802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15a5c-dc60-457e-a9ae-f16f3e0d431f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:20.105988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cdae0dd1fc34ba58e701578da67c310'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:20.106137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b0c15a5c-dc60-457e-a9ae-f16f3e0d431f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.106744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cdae0dd1fc34ba58e701578da67c310'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:20.114124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cdae0dd1fc34ba58e701578da67c310'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:20.119214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c15a5c-dc60-457e-a9ae-f16f3e0d431f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:20.125924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc385f-40cf-4326-afcd-5daa92cb209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:20.126812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc385f-40cf-4326-afcd-5daa92cb209c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.127145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc385f-40cf-4326-afcd-5daa92cb209c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.127496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc385f-40cf-4326-afcd-5daa92cb209c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.128390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc385f-40cf-4326-afcd-5daa92cb209c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:20.130283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc385f-40cf-4326-afcd-5daa92cb209c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:20.140828 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1091/2185] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:19 2021] DELETE /identity/v3/users/1cdae0dd1fc34ba58e701578da67c310 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:20.142097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:20.143797 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1095/2186] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:20 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:20.144104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.148457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe799840-556a-407b-a550-8ab8e038e7af None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.148831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe799840-556a-407b-a550-8ab8e038e7af None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.149080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe799840-556a-407b-a550-8ab8e038e7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.188072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fe799840-556a-407b-a550-8ab8e038e7af None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:20.189320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fe799840-556a-407b-a550-8ab8e038e7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.259217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced77853-12f5-40b3-97fd-3c4f28b880dc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:20.265417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c70a4-e6f0-426a-857e-8abf631cf6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:20.266219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c70a4-e6f0-426a-857e-8abf631cf6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.266603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c70a4-e6f0-426a-857e-8abf631cf6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.267106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c70a4-e6f0-426a-857e-8abf631cf6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.268001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c70a4-e6f0-426a-857e-8abf631cf6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:20.268495 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1096/2187] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:20.280415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c70a4-e6f0-426a-857e-8abf631cf6e7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:20.281317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe799840-556a-407b-a550-8ab8e038e7af None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:20.295153 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1092/2188] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:20 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:20.295153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c70a4-e6f0-426a-857e-8abf631cf6e7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:20.295153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5c6c70a4-e6f0-426a-857e-8abf631cf6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.310465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe799840-556a-407b-a550-8ab8e038e7af None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:20.323437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c70a4-e6f0-426a-857e-8abf631cf6e7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:20.330262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5f885-cf17-4000-9fd7-6fb333fec718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:20.332193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f885-cf17-4000-9fd7-6fb333fec718 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.332193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f885-cf17-4000-9fd7-6fb333fec718 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.332193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f885-cf17-4000-9fd7-6fb333fec718 admin admin] PATH_INFO: `/v3/projects/422364614bf44a91978a65af181a30ed/users/244467a391564df9ab5b63b118ce8fd3/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.342707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:20.343086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.343412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.343688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] PATH_INFO: `/v3/projects/12bcac19c3614e2ba7bcd8b63cdbc640` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.345055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12bcac19c3614e2ba7bcd8b63cdbc640)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:20.347656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:20.364968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5f885-cf17-4000-9fd7-6fb333fec718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422364614bf44a91978a65af181a30ed, user_id=244467a391564df9ab5b63b118ce8fd3, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:20.368843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5f885-cf17-4000-9fd7-6fb333fec718 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:20.401920 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1097/2189] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:20 2021] PUT /identity/v3/projects/422364614bf44a91978a65af181a30ed/users/244467a391564df9ab5b63b118ce8fd3/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:20.402976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5f885-cf17-4000-9fd7-6fb333fec718 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:20.404807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fda5f885-cf17-4000-9fd7-6fb333fec718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.462364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12bcac19c3614e2ba7bcd8b63cdbc640', 'request_id': 'req-75236cfe-f3d9-45a0-b759-a55ca4a67253'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:20.473080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12bcac19c3614e2ba7bcd8b63cdbc640', 'request_id': 'req-75236cfe-f3d9-45a0-b759-a55ca4a67253'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:20.482377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12bcac19c3614e2ba7bcd8b63cdbc640', 'request_id': 'req-75236cfe-f3d9-45a0-b759-a55ca4a67253'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:20.495360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] The token cache is being invalidate because project 12bcac19c3614e2ba7bcd8b63cdbc640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:20.496009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:20.496760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:20.498795 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1093/2190] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:20 2021] DELETE /identity/v3/projects/12bcac19c3614e2ba7bcd8b63cdbc640 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:20.499883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:20.501305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.518872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5f885-cf17-4000-9fd7-6fb333fec718 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:20.589079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b9819-5828-4f7b-ac06-bbfae6f1ae8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:20.590432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9819-5828-4f7b-ac06-bbfae6f1ae8b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.590716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9819-5828-4f7b-ac06-bbfae6f1ae8b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.591273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9819-5828-4f7b-ac06-bbfae6f1ae8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.594427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-676b9819-5828-4f7b-ac06-bbfae6f1ae8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.617900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75236cfe-f3d9-45a0-b759-a55ca4a67253 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:20.629478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa48eb-b556-469c-9214-cc1a694afb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:20.631074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa48eb-b556-469c-9214-cc1a694afb6f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.631770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa48eb-b556-469c-9214-cc1a694afb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.632797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa48eb-b556-469c-9214-cc1a694afb6f admin admin] PATH_INFO: `/v3/projects/a9eca53282994b4094a056750bb24ccb/users/2d326a07ce104727bec8ae98dabea64d/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.661545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa48eb-b556-469c-9214-cc1a694afb6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9eca53282994b4094a056750bb24ccb, user_id=2d326a07ce104727bec8ae98dabea64d, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:20.665433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa48eb-b556-469c-9214-cc1a694afb6f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:20.691800 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1094/2191] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:20 2021] PUT /identity/v3/projects/a9eca53282994b4094a056750bb24ccb/users/2d326a07ce104727bec8ae98dabea64d/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:20.692979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69876bc0-d30c-4cc8-807c-ea6798330e80 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.693576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69876bc0-d30c-4cc8-807c-ea6798330e80 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.694097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69876bc0-d30c-4cc8-807c-ea6798330e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.718201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b9819-5828-4f7b-ac06-bbfae6f1ae8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:20.719816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b9819-5828-4f7b-ac06-bbfae6f1ae8b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:20.734478 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1098/2192] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:20.734478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97db9c7-c229-4955-bf7a-9e3aff6bc4d5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.734478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97db9c7-c229-4955-bf7a-9e3aff6bc4d5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.734750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97db9c7-c229-4955-bf7a-9e3aff6bc4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.735996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-69876bc0-d30c-4cc8-807c-ea6798330e80 None None] MFA Rules not processed for user `244467a391564df9ab5b63b118ce8fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:20.737250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-69876bc0-d30c-4cc8-807c-ea6798330e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.754395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c97db9c7-c229-4955-bf7a-9e3aff6bc4d5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:20.755820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c97db9c7-c229-4955-bf7a-9e3aff6bc4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.815910 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1095/2193] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:20 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:20.822170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089538-6849-4057-ac8d-4db8cae2e224 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.823199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089538-6849-4057-ac8d-4db8cae2e224 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.823529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089538-6849-4057-ac8d-4db8cae2e224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.843995 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1099/2194] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:20.843995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97db9c7-c229-4955-bf7a-9e3aff6bc4d5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:20.843995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c97db9c7-c229-4955-bf7a-9e3aff6bc4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.847193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-da089538-6849-4057-ac8d-4db8cae2e224 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:20.848600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-da089538-6849-4057-ac8d-4db8cae2e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.854990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97db9c7-c229-4955-bf7a-9e3aff6bc4d5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:20.860012 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1096/2195] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:20.861272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d19dd9-814a-403d-a70a-92c21de13006 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.861564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d19dd9-814a-403d-a70a-92c21de13006 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.861837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d19dd9-814a-403d-a70a-92c21de13006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.864412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfbdcc-e41f-4f5b-895e-8a55414f7df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:20.865993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfbdcc-e41f-4f5b-895e-8a55414f7df4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:20.866533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfbdcc-e41f-4f5b-895e-8a55414f7df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:20.867221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfbdcc-e41f-4f5b-895e-8a55414f7df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:20.868182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfbdcc-e41f-4f5b-895e-8a55414f7df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:20.870295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfbdcc-e41f-4f5b-895e-8a55414f7df4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:20.881619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-17d19dd9-814a-403d-a70a-92c21de13006 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:20.883985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-17d19dd9-814a-403d-a70a-92c21de13006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.898330 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1097/2196] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:20.899839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d19dd9-814a-403d-a70a-92c21de13006 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:20.913350 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1100/2197] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:20 2021] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:20.914827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-17d19dd9-814a-403d-a70a-92c21de13006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:20.916113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfbdcc-e41f-4f5b-895e-8a55414f7df4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:21.007312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfbdcc-e41f-4f5b-895e-8a55414f7df4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.007529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d19dd9-814a-403d-a70a-92c21de13006 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.015998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca30ecd-65f7-48cd-bee9-0508d478bab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.017658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30ecd-65f7-48cd-bee9-0508d478bab9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.018140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30ecd-65f7-48cd-bee9-0508d478bab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.018588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca30ecd-65f7-48cd-bee9-0508d478bab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.020013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca30ecd-65f7-48cd-bee9-0508d478bab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:21.020497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca30ecd-65f7-48cd-bee9-0508d478bab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.022986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca30ecd-65f7-48cd-bee9-0508d478bab9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.043334 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1101/2198] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:21.044985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca30ecd-65f7-48cd-bee9-0508d478bab9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:21.059006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca30ecd-65f7-48cd-bee9-0508d478bab9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.067866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9beb8-2000-4382-902e-65b76b35c562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.072270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d9fc3-74ca-49c3-89f3-42d8cfa5f83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.073259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d9fc3-74ca-49c3-89f3-42d8cfa5f83e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.073736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d9fc3-74ca-49c3-89f3-42d8cfa5f83e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.074292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9beb8-2000-4382-902e-65b76b35c562 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.074747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9beb8-2000-4382-902e-65b76b35c562 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.074885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d9fc3-74ca-49c3-89f3-42d8cfa5f83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.076048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9beb8-2000-4382-902e-65b76b35c562 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.077085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9beb8-2000-4382-902e-65b76b35c562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.080025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9beb8-2000-4382-902e-65b76b35c562 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.093093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d9fc3-74ca-49c3-89f3-42d8cfa5f83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.095284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d9fc3-74ca-49c3-89f3-42d8cfa5f83e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.110582 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1098/2199] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:21.136290 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1102/2200] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:21 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:21.140012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9beb8-2000-4382-902e-65b76b35c562 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:21.141874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d9fc3-74ca-49c3-89f3-42d8cfa5f83e service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:21.155542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9beb8-2000-4382-902e-65b76b35c562 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.165901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be529-18f6-42c6-ba68-af97cba199a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.166357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d9fc3-74ca-49c3-89f3-42d8cfa5f83e service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.166701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be529-18f6-42c6-ba68-af97cba199a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.167093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be529-18f6-42c6-ba68-af97cba199a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.167648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be529-18f6-42c6-ba68-af97cba199a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.168555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7be529-18f6-42c6-ba68-af97cba199a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.171378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7be529-18f6-42c6-ba68-af97cba199a7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.184331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf428-e78b-4f1e-a2c3-7e11ae0ab212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.185457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf428-e78b-4f1e-a2c3-7e11ae0ab212 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.185457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf428-e78b-4f1e-a2c3-7e11ae0ab212 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.185707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbf428-e78b-4f1e-a2c3-7e11ae0ab212 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.186235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbf428-e78b-4f1e-a2c3-7e11ae0ab212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.188033 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1103/2201] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:21 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:21.191769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbf428-e78b-4f1e-a2c3-7e11ae0ab212 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.192222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be529-18f6-42c6-ba68-af97cba199a7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:21.227482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be529-18f6-42c6-ba68-af97cba199a7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.228537 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1099/2202] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:21 2021] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:21.232504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf428-e78b-4f1e-a2c3-7e11ae0ab212 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:21.307941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbf428-e78b-4f1e-a2c3-7e11ae0ab212 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.313507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25cc23-740a-4f67-9f63-11542bd7f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.314584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25cc23-740a-4f67-9f63-11542bd7f471 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.314943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25cc23-740a-4f67-9f63-11542bd7f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.315363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25cc23-740a-4f67-9f63-11542bd7f471 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.316184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25cc23-740a-4f67-9f63-11542bd7f471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.318597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25cc23-740a-4f67-9f63-11542bd7f471 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.347187 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1100/2203] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:21 2021] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:21.352582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25cc23-740a-4f67-9f63-11542bd7f471 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:21.375119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25cc23-740a-4f67-9f63-11542bd7f471 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.390264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb282d-6062-4517-a16d-800bbdcde73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.393191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb282d-6062-4517-a16d-800bbdcde73c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.393637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb282d-6062-4517-a16d-800bbdcde73c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.394022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb282d-6062-4517-a16d-800bbdcde73c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.396336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb282d-6062-4517-a16d-800bbdcde73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.400878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb282d-6062-4517-a16d-800bbdcde73c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.411184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed314d-210c-4565-8410-c241813f1a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.412307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed314d-210c-4565-8410-c241813f1a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.412643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed314d-210c-4565-8410-c241813f1a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.412921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed314d-210c-4565-8410-c241813f1a28 admin admin] PATH_INFO: `/v3/projects/5d66ae1e4d29435e8489bc8f53cf7eb4/users/ed4a333df475465896776b42523256a0/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.432250 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1101/2204] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:21 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:21.435881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb282d-6062-4517-a16d-800bbdcde73c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:21.448416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed314d-210c-4565-8410-c241813f1a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d66ae1e4d29435e8489bc8f53cf7eb4, user_id=ed4a333df475465896776b42523256a0, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.451736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed314d-210c-4565-8410-c241813f1a28 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.454251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb282d-6062-4517-a16d-800bbdcde73c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.477446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1bcf6-014c-46f1-b859-df069f7cd9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.479818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1bcf6-014c-46f1-b859-df069f7cd9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.480108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1bcf6-014c-46f1-b859-df069f7cd9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.482036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1bcf6-014c-46f1-b859-df069f7cd9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.484869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1bcf6-014c-46f1-b859-df069f7cd9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.493373 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1104/2205] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:21 2021] PUT /identity/v3/projects/5d66ae1e4d29435e8489bc8f53cf7eb4/users/ed4a333df475465896776b42523256a0/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:21.493701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1bcf6-014c-46f1-b859-df069f7cd9c1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.498280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed314d-210c-4565-8410-c241813f1a28 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:21.515871 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1102/2206] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:21 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:21.519904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1bcf6-014c-46f1-b859-df069f7cd9c1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:21.537914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1bcf6-014c-46f1-b859-df069f7cd9c1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.673500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed314d-210c-4565-8410-c241813f1a28 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.687671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5d9ac-3ee5-4d05-a0f5-76778513cab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.688693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5d9ac-3ee5-4d05-a0f5-76778513cab3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.688999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5d9ac-3ee5-4d05-a0f5-76778513cab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.689361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5d9ac-3ee5-4d05-a0f5-76778513cab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.690907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5d9ac-3ee5-4d05-a0f5-76778513cab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.694574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5d9ac-3ee5-4d05-a0f5-76778513cab3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.719540 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1105/2207] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:21 2021] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:21.723584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5d9ac-3ee5-4d05-a0f5-76778513cab3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:21.748749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f594067-3d1b-4ab6-8806-ed3eddeb3a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.749673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f594067-3d1b-4ab6-8806-ed3eddeb3a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.750391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f594067-3d1b-4ab6-8806-ed3eddeb3a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.750391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f594067-3d1b-4ab6-8806-ed3eddeb3a3e admin admin] PATH_INFO: `/v3/projects/f859ea45f6e741209af2f0f69b576f42/users/8619ddcc82fe4bf39ec672850f121f23/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.750828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5d9ac-3ee5-4d05-a0f5-76778513cab3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:21.762856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bf9cf-613a-4c9c-bfda-b1d41a601975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:21.763902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bf9cf-613a-4c9c-bfda-b1d41a601975 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.764743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bf9cf-613a-4c9c-bfda-b1d41a601975 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.769807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bf9cf-613a-4c9c-bfda-b1d41a601975 admin admin] PATH_INFO: `/v3/projects/5d66ae1e4d29435e8489bc8f53cf7eb4/users/ed4a333df475465896776b42523256a0/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.773863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2bf9cf-613a-4c9c-bfda-b1d41a601975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d66ae1e4d29435e8489bc8f53cf7eb4, user_id=ed4a333df475465896776b42523256a0, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.778630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2bf9cf-613a-4c9c-bfda-b1d41a601975 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.789754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f594067-3d1b-4ab6-8806-ed3eddeb3a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f859ea45f6e741209af2f0f69b576f42, user_id=8619ddcc82fe4bf39ec672850f121f23, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:21.793027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f594067-3d1b-4ab6-8806-ed3eddeb3a3e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:21.816384 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1106/2208] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:21 2021] PUT /identity/v3/projects/5d66ae1e4d29435e8489bc8f53cf7eb4/users/ed4a333df475465896776b42523256a0/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:21.817988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218e9e-a2b0-4193-a268-b138a7a9f66f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.822425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218e9e-a2b0-4193-a268-b138a7a9f66f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.823729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218e9e-a2b0-4193-a268-b138a7a9f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.827845 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1103/2209] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:21 2021] PUT /identity/v3/projects/f859ea45f6e741209af2f0f69b576f42/users/8619ddcc82fe4bf39ec672850f121f23/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:21.829480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a87694-2da8-4d66-99d0-b65f08d10304 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:21.829690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a87694-2da8-4d66-99d0-b65f08d10304 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:21.829975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a87694-2da8-4d66-99d0-b65f08d10304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:21.884852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b4218e9e-a2b0-4193-a268-b138a7a9f66f None None] MFA Rules not processed for user `ed4a333df475465896776b42523256a0`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:21.886264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b4218e9e-a2b0-4193-a268-b138a7a9f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:21.892030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-50a87694-2da8-4d66-99d0-b65f08d10304 None None] MFA Rules not processed for user `8619ddcc82fe4bf39ec672850f121f23`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:21.893245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-50a87694-2da8-4d66-99d0-b65f08d10304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:22.043235 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1104/2210] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:21 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:22.063025 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1107/2211] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:21 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:22.291458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a87694-2da8-4d66-99d0-b65f08d10304 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:22.293273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-50a87694-2da8-4d66-99d0-b65f08d10304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:22.389209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a87694-2da8-4d66-99d0-b65f08d10304 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:22.400110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9d912-19a6-4c55-b833-b358f25e9591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:22.400729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9d912-19a6-4c55-b833-b358f25e9591 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:22.401200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9d912-19a6-4c55-b833-b358f25e9591 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:22.401315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9d912-19a6-4c55-b833-b358f25e9591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:22.413410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9d912-19a6-4c55-b833-b358f25e9591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:22.416978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9d912-19a6-4c55-b833-b358f25e9591 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:22.442105 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1105/2212] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:22 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:22.475505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4218e9e-a2b0-4193-a268-b138a7a9f66f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:22.493898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4218e9e-a2b0-4193-a268-b138a7a9f66f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:22.503186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c5d66-5caf-4ef8-9f64-66371ab1fd8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:22.503941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c5d66-5caf-4ef8-9f64-66371ab1fd8c service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:22.504232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c5d66-5caf-4ef8-9f64-66371ab1fd8c service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:22.504514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c5d66-5caf-4ef8-9f64-66371ab1fd8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:22.522334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c5d66-5caf-4ef8-9f64-66371ab1fd8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:22.524764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c5d66-5caf-4ef8-9f64-66371ab1fd8c service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:22.530418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9d912-19a6-4c55-b833-b358f25e9591 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:22.531989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c2f9d912-19a6-4c55-b833-b358f25e9591 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:22.545254 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1108/2213] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:22 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:22.630522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9d912-19a6-4c55-b833-b358f25e9591 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:22.652572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:22.654476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:22.654694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:22.654968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] PATH_INFO: `/v3/projects/bdd7197dea99453d96733be271e26ee5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:22.660108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd7197dea99453d96733be271e26ee5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:22.662095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:22.722039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd7197dea99453d96733be271e26ee5', 'request_id': 'req-91dced1b-8107-418c-8ccd-7dec406b3ca2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:22.728483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd7197dea99453d96733be271e26ee5', 'request_id': 'req-91dced1b-8107-418c-8ccd-7dec406b3ca2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:22.738858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd7197dea99453d96733be271e26ee5', 'request_id': 'req-91dced1b-8107-418c-8ccd-7dec406b3ca2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:22.760646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] The token cache is being invalidate because project bdd7197dea99453d96733be271e26ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:22.761155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:22.761258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c5d66-5caf-4ef8-9f64-66371ab1fd8c service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:22.762857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-91dced1b-8107-418c-8ccd-7dec406b3ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:22.765437 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1106/2214] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:22 2021] DELETE /identity/v3/projects/bdd7197dea99453d96733be271e26ee5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:22.778406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0483d2b-68f9-440d-b9fb-26b8de527d52 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:22.778768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0483d2b-68f9-440d-b9fb-26b8de527d52 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:22.779314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0483d2b-68f9-440d-b9fb-26b8de527d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:22.798533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c5d66-5caf-4ef8-9f64-66371ab1fd8c service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:22.818356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d0483d2b-68f9-440d-b9fb-26b8de527d52 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:22.819831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d0483d2b-68f9-440d-b9fb-26b8de527d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:22.919774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a657d2f-97f6-4055-89c5-531e5d75d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:22.921052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a657d2f-97f6-4055-89c5-531e5d75d187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:22.921682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a657d2f-97f6-4055-89c5-531e5d75d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:22.922108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a657d2f-97f6-4055-89c5-531e5d75d187 admin admin] PATH_INFO: `/v3/users/244467a391564df9ab5b63b118ce8fd3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:22.923673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a657d2f-97f6-4055-89c5-531e5d75d187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244467a391564df9ab5b63b118ce8fd3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:22.927177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a657d2f-97f6-4055-89c5-531e5d75d187 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:22.943694 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1107/2215] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:22.951471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a386-a1d6-4393-903a-288547155b9a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:22.959832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a386-a1d6-4393-903a-288547155b9a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:22.959832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a386-a1d6-4393-903a-288547155b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:23.024647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a110a386-a1d6-4393-903a-288547155b9a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:23.024845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0a657d2f-97f6-4055-89c5-531e5d75d187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244467a391564df9ab5b63b118ce8fd3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:23.029539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a110a386-a1d6-4393-903a-288547155b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:23.036801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0a657d2f-97f6-4055-89c5-531e5d75d187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244467a391564df9ab5b63b118ce8fd3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:23.037810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0a657d2f-97f6-4055-89c5-531e5d75d187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244467a391564df9ab5b63b118ce8fd3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:23.056470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0a657d2f-97f6-4055-89c5-531e5d75d187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244467a391564df9ab5b63b118ce8fd3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:23.064096 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1108/2216] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:23.066217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a386-a1d6-4393-903a-288547155b9a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:23.082432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a386-a1d6-4393-903a-288547155b9a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:23.090619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2bf1-9c80-4111-8704-15185437e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:23.091698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2bf1-9c80-4111-8704-15185437e371 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:23.092063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2bf1-9c80-4111-8704-15185437e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:23.092410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c2bf1-9c80-4111-8704-15185437e371 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:23.093747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0a657d2f-97f6-4055-89c5-531e5d75d187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244467a391564df9ab5b63b118ce8fd3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:23.094236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c2bf1-9c80-4111-8704-15185437e371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:23.094879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c2bf1-9c80-4111-8704-15185437e371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:23.110706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c2bf1-9c80-4111-8704-15185437e371 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:23.113916 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1109/2217] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:22 2021] DELETE /identity/v3/users/244467a391564df9ab5b63b118ce8fd3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:23.118417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f114129-c5fa-4dda-92f3-83a5db18b96a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:23.118702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f114129-c5fa-4dda-92f3-83a5db18b96a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:23.119087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f114129-c5fa-4dda-92f3-83a5db18b96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:23.140859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0f114129-c5fa-4dda-92f3-83a5db18b96a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:23.142628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0f114129-c5fa-4dda-92f3-83a5db18b96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:23.155922 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1109/2218] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:23.161203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2bf1-9c80-4111-8704-15185437e371 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:23.204596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c2bf1-9c80-4111-8704-15185437e371 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:23.236707 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1110/2219] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:23.278485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f114129-c5fa-4dda-92f3-83a5db18b96a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:23.282383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0f114129-c5fa-4dda-92f3-83a5db18b96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:23.314006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31bf16-144a-4224-9d4d-3b8c791f8d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:23.314802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31bf16-144a-4224-9d4d-3b8c791f8d9c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:23.315041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31bf16-144a-4224-9d4d-3b8c791f8d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:23.315408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31bf16-144a-4224-9d4d-3b8c791f8d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:23.316179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31bf16-144a-4224-9d4d-3b8c791f8d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:23.318296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31bf16-144a-4224-9d4d-3b8c791f8d9c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:23.371565 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1110/2220] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:23 2021] POST /identity/v3/projects => generated 369 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:23.375680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d849a-c13f-4fd1-96c3-d5a75ff012ea None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:23.377311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d849a-c13f-4fd1-96c3-d5a75ff012ea None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:23.377786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d849a-c13f-4fd1-96c3-d5a75ff012ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:23.423135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4b8d849a-c13f-4fd1-96c3-d5a75ff012ea None None] MFA Rules not processed for user `1a069b7aa4c94607943e3493c6295fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:23.424404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4b8d849a-c13f-4fd1-96c3-d5a75ff012ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:23.492736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f114129-c5fa-4dda-92f3-83a5db18b96a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:23.548257 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1111/2221] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:23 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:23.548919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d849a-c13f-4fd1-96c3-d5a75ff012ea None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:23.640770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1c18b-f435-4680-be6b-3c94a6130f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:23.641396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1c18b-f435-4680-be6b-3c94a6130f4d service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:23.641787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1c18b-f435-4680-be6b-3c94a6130f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:23.642022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1c18b-f435-4680-be6b-3c94a6130f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:23.728476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d849a-c13f-4fd1-96c3-d5a75ff012ea None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:23.739912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac2c05-3553-4f74-bddb-f2bf99cd2ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:23.740593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac2c05-3553-4f74-bddb-f2bf99cd2ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:23.740869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac2c05-3553-4f74-bddb-f2bf99cd2ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:23.741141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac2c05-3553-4f74-bddb-f2bf99cd2ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:23.741882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac2c05-3553-4f74-bddb-f2bf99cd2ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:23.743916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac2c05-3553-4f74-bddb-f2bf99cd2ec0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:23.812191 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1112/2222] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:23 2021] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:23.812191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ce2e-4369-4182-b32a-92fdf201d11b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:23.812191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ce2e-4369-4182-b32a-92fdf201d11b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:23.812191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ce2e-4369-4182-b32a-92fdf201d11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:23.823582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1c18b-f435-4680-be6b-3c94a6130f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:23.825976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1c18b-f435-4680-be6b-3c94a6130f4d service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:23.853600 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1111/2223] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:23.854854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1c18b-f435-4680-be6b-3c94a6130f4d service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:23.861865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5a02ce2e-4369-4182-b32a-92fdf201d11b None None] MFA Rules not processed for user `2d326a07ce104727bec8ae98dabea64d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:23.862889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7ba1c18b-f435-4680-be6b-3c94a6130f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:23.863137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5a02ce2e-4369-4182-b32a-92fdf201d11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:23.887206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1c18b-f435-4680-be6b-3c94a6130f4d service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:23.904787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:23.906715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:23.907152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:23.907589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] PATH_INFO: `/v3/users/8619ddcc82fe4bf39ec672850f121f23` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:23.909639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8619ddcc82fe4bf39ec672850f121f23)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:23.915227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:23.983389 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1113/2224] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:23 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:23.983389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02ce2e-4369-4182-b32a-92fdf201d11b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:24.004652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02ce2e-4369-4182-b32a-92fdf201d11b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:24.008566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8619ddcc82fe4bf39ec672850f121f23'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:24.012920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b5443-011f-4301-91e0-c43388a0bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:24.014267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b5443-011f-4301-91e0-c43388a0bffd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.014805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b5443-011f-4301-91e0-c43388a0bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.015136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b5443-011f-4301-91e0-c43388a0bffd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.019944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b5443-011f-4301-91e0-c43388a0bffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:24.032061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b5443-011f-4301-91e0-c43388a0bffd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:24.041072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8619ddcc82fe4bf39ec672850f121f23'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:24.051531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8619ddcc82fe4bf39ec672850f121f23'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:24.055244 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1114/2225] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:23 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:24.056211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b5443-011f-4301-91e0-c43388a0bffd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:24.058128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f61b5443-011f-4301-91e0-c43388a0bffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:24.078768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8619ddcc82fe4bf39ec672850f121f23'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:24.079579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b5443-011f-4301-91e0-c43388a0bffd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:24.087757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cf9a1-8dd4-430e-84e8-d7980abb56f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:24.088822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cf9a1-8dd4-430e-84e8-d7980abb56f1 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.089360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cf9a1-8dd4-430e-84e8-d7980abb56f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.090128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cf9a1-8dd4-430e-84e8-d7980abb56f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.091448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cf9a1-8dd4-430e-84e8-d7980abb56f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:24.095322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cf9a1-8dd4-430e-84e8-d7980abb56f1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:24.110173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8619ddcc82fe4bf39ec672850f121f23'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:24.142003 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1112/2226] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:23 2021] DELETE /identity/v3/users/8619ddcc82fe4bf39ec672850f121f23 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:24.142208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:24.143608 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1115/2227] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:24 2021] POST /identity/v3/projects => generated 393 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:24.145103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:24.155020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cf9a1-8dd4-430e-84e8-d7980abb56f1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:24.289660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae86564-acd6-452a-80a9-8ebd1845701c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:24.316128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cf9a1-8dd4-430e-84e8-d7980abb56f1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:24.327897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e197975-8005-41d8-bec8-2eacb9cdfc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:24.328727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e197975-8005-41d8-bec8-2eacb9cdfc95 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.329016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e197975-8005-41d8-bec8-2eacb9cdfc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.329324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e197975-8005-41d8-bec8-2eacb9cdfc95 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.330001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e197975-8005-41d8-bec8-2eacb9cdfc95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:24.333206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e197975-8005-41d8-bec8-2eacb9cdfc95 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:24.382491 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1116/2228] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:24 2021] POST /identity/v3/users => generated 303 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:24.385297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfa4e5-287a-4b77-8166-2d8e356986ce None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.386560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfa4e5-287a-4b77-8166-2d8e356986ce None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.387494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfa4e5-287a-4b77-8166-2d8e356986ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.405045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f5bca-8896-41dd-ad43-bf7865fc5ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:24.405643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f5bca-8896-41dd-ad43-bf7865fc5ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.406031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f5bca-8896-41dd-ad43-bf7865fc5ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.407528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f5bca-8896-41dd-ad43-bf7865fc5ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.408353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f5bca-8896-41dd-ad43-bf7865fc5ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:24.410871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f5bca-8896-41dd-ad43-bf7865fc5ca2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:24.415104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f5dfa4e5-287a-4b77-8166-2d8e356986ce None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:24.416699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f5dfa4e5-287a-4b77-8166-2d8e356986ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:24.427442 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1113/2229] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:24 2021] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:24.429496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f5bca-8896-41dd-ad43-bf7865fc5ca2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:24.437647 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1117/2230] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:24.440201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfa4e5-287a-4b77-8166-2d8e356986ce None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:24.455426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f5bca-8896-41dd-ad43-bf7865fc5ca2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:24.462179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfa4e5-287a-4b77-8166-2d8e356986ce None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:24.463025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba16b7-e7ff-44bc-82ae-37600de5674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:24.464055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba16b7-e7ff-44bc-82ae-37600de5674c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.464471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba16b7-e7ff-44bc-82ae-37600de5674c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.464846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba16b7-e7ff-44bc-82ae-37600de5674c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.465689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba16b7-e7ff-44bc-82ae-37600de5674c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:24.467756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba16b7-e7ff-44bc-82ae-37600de5674c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:24.468651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f14a50-47cf-4b35-a008-89a93c2788ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:24.470319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14a50-47cf-4b35-a008-89a93c2788ce admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.470772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14a50-47cf-4b35-a008-89a93c2788ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.471123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f14a50-47cf-4b35-a008-89a93c2788ce admin admin] PATH_INFO: `/v3/projects/c9d19cebb8eb47a8a37231bc16ea8704/users/e2a797e28c1c4b839f00a99bd54ea324/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.489050 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1114/2231] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:24 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:24.490406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba16b7-e7ff-44bc-82ae-37600de5674c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:24.493122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6dba16b7-e7ff-44bc-82ae-37600de5674c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:24.495793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f14a50-47cf-4b35-a008-89a93c2788ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d19cebb8eb47a8a37231bc16ea8704, user_id=e2a797e28c1c4b839f00a99bd54ea324, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:24.499234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f14a50-47cf-4b35-a008-89a93c2788ce admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:24.531423 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1118/2232] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:24 2021] PUT /identity/v3/projects/c9d19cebb8eb47a8a37231bc16ea8704/users/e2a797e28c1c4b839f00a99bd54ea324/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:24.551396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f14a50-47cf-4b35-a008-89a93c2788ce admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:24.574667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba16b7-e7ff-44bc-82ae-37600de5674c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:24.647556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f14a50-47cf-4b35-a008-89a93c2788ce admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:24.653790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c453f83-8267-4753-96b7-bf43366990c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:24.654983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453f83-8267-4753-96b7-bf43366990c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.656280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453f83-8267-4753-96b7-bf43366990c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.656622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453f83-8267-4753-96b7-bf43366990c6 admin admin] PATH_INFO: `/v3/projects/a146d6034f3e4681b6a81cb27ce5f57a/users/49049bebdad54e2ebc4e1d5ba129d299/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.674848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c453f83-8267-4753-96b7-bf43366990c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a146d6034f3e4681b6a81cb27ce5f57a, user_id=49049bebdad54e2ebc4e1d5ba129d299, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:24.678532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c453f83-8267-4753-96b7-bf43366990c6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:24.680974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6afd2-cd56-4d3f-b0e4-9758f8669d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:24.682396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6afd2-cd56-4d3f-b0e4-9758f8669d8b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.682688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6afd2-cd56-4d3f-b0e4-9758f8669d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.683088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6afd2-cd56-4d3f-b0e4-9758f8669d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.693760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6afd2-cd56-4d3f-b0e4-9758f8669d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:24.695379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6afd2-cd56-4d3f-b0e4-9758f8669d8b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:24.700538 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1119/2233] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:24 2021] PUT /identity/v3/projects/a146d6034f3e4681b6a81cb27ce5f57a/users/49049bebdad54e2ebc4e1d5ba129d299/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:24.709072 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1115/2234] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:24.709952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6afd2-cd56-4d3f-b0e4-9758f8669d8b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:24.711430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b4268-7d73-4629-b378-ab8754e92dce None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.713788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b4268-7d73-4629-b378-ab8754e92dce None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.714175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b4268-7d73-4629-b378-ab8754e92dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.721111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6afd2-cd56-4d3f-b0e4-9758f8669d8b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:24.747396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-041b4268-7d73-4629-b378-ab8754e92dce None None] MFA Rules not processed for user `e2a797e28c1c4b839f00a99bd54ea324`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:24.749590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-041b4268-7d73-4629-b378-ab8754e92dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:24.837151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9d49c-7f85-46b3-ae5c-5da9c91f6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:24.838506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9d49c-7f85-46b3-ae5c-5da9c91f6d8b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.839179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9d49c-7f85-46b3-ae5c-5da9c91f6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.839179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9d49c-7f85-46b3-ae5c-5da9c91f6d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.839881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9d49c-7f85-46b3-ae5c-5da9c91f6d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:24.841605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9d49c-7f85-46b3-ae5c-5da9c91f6d8b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:24.860563 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1116/2235] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:24 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:24.865418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9d49c-7f85-46b3-ae5c-5da9c91f6d8b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:24.867995 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1120/2236] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:24 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:24.872456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b4268-7d73-4629-b378-ab8754e92dce None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:24.885765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b4268-7d73-4629-b378-ab8754e92dce None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:24.891322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017774-391a-4dfc-aaab-79c8398ab6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:24.892414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017774-391a-4dfc-aaab-79c8398ab6df admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.893051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017774-391a-4dfc-aaab-79c8398ab6df admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.893536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017774-391a-4dfc-aaab-79c8398ab6df admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.894934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017774-391a-4dfc-aaab-79c8398ab6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:24.896595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9d49c-7f85-46b3-ae5c-5da9c91f6d8b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:24.897699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017774-391a-4dfc-aaab-79c8398ab6df admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:24.902068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bba40-f2dc-40df-a00b-5cb1d5babde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:24.903002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bba40-f2dc-40df-a00b-5cb1d5babde1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:24.903311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bba40-f2dc-40df-a00b-5cb1d5babde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:24.903590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bba40-f2dc-40df-a00b-5cb1d5babde1 admin admin] PATH_INFO: `/v3/projects/a146d6034f3e4681b6a81cb27ce5f57a/users/49049bebdad54e2ebc4e1d5ba129d299/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:24.905632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bba40-f2dc-40df-a00b-5cb1d5babde1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a146d6034f3e4681b6a81cb27ce5f57a, user_id=49049bebdad54e2ebc4e1d5ba129d299, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:24.908723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bba40-f2dc-40df-a00b-5cb1d5babde1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:24.925898 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1117/2237] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:24 2021] PUT /identity/v3/projects/a146d6034f3e4681b6a81cb27ce5f57a/users/49049bebdad54e2ebc4e1d5ba129d299/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:24.947062 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1121/2238] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:24 2021] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:24.947293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bba40-f2dc-40df-a00b-5cb1d5babde1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:25.046344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bba40-f2dc-40df-a00b-5cb1d5babde1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:25.064717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017774-391a-4dfc-aaab-79c8398ab6df admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:25.066776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3e017774-391a-4dfc-aaab-79c8398ab6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:25.200150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55189a02-8724-4763-bbcf-fe2087b09348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:25.200856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55189a02-8724-4763-bbcf-fe2087b09348 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:25.201440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017774-391a-4dfc-aaab-79c8398ab6df admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:25.203739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55189a02-8724-4763-bbcf-fe2087b09348 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:25.204044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55189a02-8724-4763-bbcf-fe2087b09348 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:25.204798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55189a02-8724-4763-bbcf-fe2087b09348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:25.206718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55189a02-8724-4763-bbcf-fe2087b09348 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:25.208697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:25.209570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:25.209865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:25.210120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] PATH_INFO: `/v3/projects/422364614bf44a91978a65af181a30ed` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:25.212549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=422364614bf44a91978a65af181a30ed)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:25.215245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:25.278660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422364614bf44a91978a65af181a30ed', 'request_id': 'req-079cf612-a3b9-4be6-8077-ddae96ff07ac'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.279930 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1118/2239] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:24 2021] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:46:25.285572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55189a02-8724-4763-bbcf-fe2087b09348 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:25.292639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422364614bf44a91978a65af181a30ed', 'request_id': 'req-079cf612-a3b9-4be6-8077-ddae96ff07ac'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.308963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422364614bf44a91978a65af181a30ed', 'request_id': 'req-079cf612-a3b9-4be6-8077-ddae96ff07ac'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.319424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55189a02-8724-4763-bbcf-fe2087b09348 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:25.322713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] The token cache is being invalidate because project 422364614bf44a91978a65af181a30ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:25.323148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.324485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.326777 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1122/2240] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:25 2021] DELETE /identity/v3/projects/422364614bf44a91978a65af181a30ed => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:25.330888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:25.332476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:25.433884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bac99-2fa7-4446-9a42-dd6ade704c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:25.435223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bac99-2fa7-4446-9a42-dd6ade704c90 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:25.435428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bac99-2fa7-4446-9a42-dd6ade704c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:25.435810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bac99-2fa7-4446-9a42-dd6ade704c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:25.436778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bac99-2fa7-4446-9a42-dd6ade704c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:25.438922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bac99-2fa7-4446-9a42-dd6ade704c90 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:25.459434 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1119/2241] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:25 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:25.461525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bac99-2fa7-4446-9a42-dd6ade704c90 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:25.475374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-275bac99-2fa7-4446-9a42-dd6ade704c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:25.483782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cf612-a3b9-4be6-8077-ddae96ff07ac admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:25.490495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9419-bb9a-4da1-9bff-f6c0ceaa0f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:25.490864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bac99-2fa7-4446-9a42-dd6ade704c90 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:25.493446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9419-bb9a-4da1-9bff-f6c0ceaa0f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:25.493446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9419-bb9a-4da1-9bff-f6c0ceaa0f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:25.493446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9419-bb9a-4da1-9bff-f6c0ceaa0f17 admin admin] PATH_INFO: `/v3/users/ed4a333df475465896776b42523256a0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:25.493714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d9419-bb9a-4da1-9bff-f6c0ceaa0f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4a333df475465896776b42523256a0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:25.497717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d9419-bb9a-4da1-9bff-f6c0ceaa0f17 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:25.506651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:25.509583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:25.509876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:25.513770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] PATH_INFO: `/v3/projects/f859ea45f6e741209af2f0f69b576f42` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:25.515224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f859ea45f6e741209af2f0f69b576f42)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:25.518607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:25.593772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5c6d9419-bb9a-4da1-9bff-f6c0ceaa0f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4a333df475465896776b42523256a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.594660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5c6d9419-bb9a-4da1-9bff-f6c0ceaa0f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4a333df475465896776b42523256a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.609324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5c6d9419-bb9a-4da1-9bff-f6c0ceaa0f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4a333df475465896776b42523256a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.610084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5c6d9419-bb9a-4da1-9bff-f6c0ceaa0f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4a333df475465896776b42523256a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.624186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f859ea45f6e741209af2f0f69b576f42', 'request_id': 'req-a7eee62c-2526-4022-b686-605713a2c8b6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.626376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5c6d9419-bb9a-4da1-9bff-f6c0ceaa0f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4a333df475465896776b42523256a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.635715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f859ea45f6e741209af2f0f69b576f42', 'request_id': 'req-a7eee62c-2526-4022-b686-605713a2c8b6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.645523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f859ea45f6e741209af2f0f69b576f42', 'request_id': 'req-a7eee62c-2526-4022-b686-605713a2c8b6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.665515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] The token cache is being invalidate because project f859ea45f6e741209af2f0f69b576f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:25.665716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.666957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:25.669150 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1120/2242] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:25 2021] DELETE /identity/v3/projects/f859ea45f6e741209af2f0f69b576f42 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:25.669995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:25.671627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:25.686490 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1123/2243] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:25 2021] DELETE /identity/v3/users/ed4a333df475465896776b42523256a0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:25.688151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f81fc-c7c7-4106-b6da-0a1b4218eee0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:25.690327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f81fc-c7c7-4106-b6da-0a1b4218eee0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:25.690987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f81fc-c7c7-4106-b6da-0a1b4218eee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:25.722000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-dd8f81fc-c7c7-4106-b6da-0a1b4218eee0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:25.725042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dd8f81fc-c7c7-4106-b6da-0a1b4218eee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:25.838365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eee62c-2526-4022-b686-605713a2c8b6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:25.907996 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1124/2244] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:25.913881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca15e28-0cb5-4b7a-ada2-95d740c5b7e4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:25.914199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca15e28-0cb5-4b7a-ada2-95d740c5b7e4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:25.914464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca15e28-0cb5-4b7a-ada2-95d740c5b7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:25.956245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cca15e28-0cb5-4b7a-ada2-95d740c5b7e4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:25.958188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cca15e28-0cb5-4b7a-ada2-95d740c5b7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:25.963750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a396e77-eb79-4359-889d-e03f83387aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:25.965064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396e77-eb79-4359-889d-e03f83387aea admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:25.966107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396e77-eb79-4359-889d-e03f83387aea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:25.966685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396e77-eb79-4359-889d-e03f83387aea admin admin] PATH_INFO: `/v3/projects/b27fa40e5e8849f9afaa6269ac038aca/users/33a412cca9e74cbd82053730bf6c07ad/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:25.968390 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1125/2245] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:25.973584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca15e28-0cb5-4b7a-ada2-95d740c5b7e4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:25.984454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca15e28-0cb5-4b7a-ada2-95d740c5b7e4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:25.989026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a396e77-eb79-4359-889d-e03f83387aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27fa40e5e8849f9afaa6269ac038aca, user_id=33a412cca9e74cbd82053730bf6c07ad, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:25.992434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b1c2b-d440-4398-8fe0-c65ff45ce52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:25.993254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b1c2b-d440-4398-8fe0-c65ff45ce52b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:25.993421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a396e77-eb79-4359-889d-e03f83387aea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:25.993864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b1c2b-d440-4398-8fe0-c65ff45ce52b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:25.994226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b1c2b-d440-4398-8fe0-c65ff45ce52b admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:25.995109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b1c2b-d440-4398-8fe0-c65ff45ce52b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:25.995863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b1c2b-d440-4398-8fe0-c65ff45ce52b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:25.998032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b1c2b-d440-4398-8fe0-c65ff45ce52b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:26.014162 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1126/2246] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:26.016791 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1121/2247] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:25 2021] PUT /identity/v3/projects/b27fa40e5e8849f9afaa6269ac038aca/users/33a412cca9e74cbd82053730bf6c07ad/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:26.018467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b1c2b-d440-4398-8fe0-c65ff45ce52b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:26.022830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a396e77-eb79-4359-889d-e03f83387aea admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:26.032409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b1c2b-d440-4398-8fe0-c65ff45ce52b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:26.133861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a396e77-eb79-4359-889d-e03f83387aea admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:26.148619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950ba29-f453-4ca4-ab32-50c971ea2035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:26.149586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950ba29-f453-4ca4-ab32-50c971ea2035 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:26.155535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950ba29-f453-4ca4-ab32-50c971ea2035 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:26.156400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950ba29-f453-4ca4-ab32-50c971ea2035 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:26.158459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950ba29-f453-4ca4-ab32-50c971ea2035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:26.160902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950ba29-f453-4ca4-ab32-50c971ea2035 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:26.178422 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1122/2248] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:26 2021] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:46:26.180083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66632413-d792-4e69-902e-b7de7426de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:26.180681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950ba29-f453-4ca4-ab32-50c971ea2035 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:26.181700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66632413-d792-4e69-902e-b7de7426de57 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:26.182177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66632413-d792-4e69-902e-b7de7426de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:26.182598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66632413-d792-4e69-902e-b7de7426de57 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:26.183503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66632413-d792-4e69-902e-b7de7426de57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:26.185857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66632413-d792-4e69-902e-b7de7426de57 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:26.194447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950ba29-f453-4ca4-ab32-50c971ea2035 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:26.201318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68a772-0fa3-4605-bfe4-46fdb2a1f560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:26.203051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a772-0fa3-4605-bfe4-46fdb2a1f560 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:26.203585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a772-0fa3-4605-bfe4-46fdb2a1f560 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:26.204140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a772-0fa3-4605-bfe4-46fdb2a1f560 admin admin] PATH_INFO: `/v3/projects/b27fa40e5e8849f9afaa6269ac038aca/users/33a412cca9e74cbd82053730bf6c07ad/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:26.208233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68a772-0fa3-4605-bfe4-46fdb2a1f560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27fa40e5e8849f9afaa6269ac038aca, user_id=33a412cca9e74cbd82053730bf6c07ad, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:26.211536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68a772-0fa3-4605-bfe4-46fdb2a1f560 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:26.242433 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1123/2249] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:26 2021] PUT /identity/v3/projects/b27fa40e5e8849f9afaa6269ac038aca/users/33a412cca9e74cbd82053730bf6c07ad/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:26.242632 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1127/2250] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:26 2021] POST /identity/v3/projects => generated 397 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:26.244196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66632413-d792-4e69-902e-b7de7426de57 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:26.244411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fec50-39d9-4c5f-a526-09e0c6e0b01a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:26.244669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fec50-39d9-4c5f-a526-09e0c6e0b01a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:26.245002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fec50-39d9-4c5f-a526-09e0c6e0b01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:26.290434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bc2fec50-39d9-4c5f-a526-09e0c6e0b01a None None] MFA Rules not processed for user `33a412cca9e74cbd82053730bf6c07ad`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:26.291863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bc2fec50-39d9-4c5f-a526-09e0c6e0b01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:26.396933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66632413-d792-4e69-902e-b7de7426de57 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:26.403777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73432c1-f026-4bb9-a501-2fa289e6c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:26.404689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73432c1-f026-4bb9-a501-2fa289e6c432 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:26.405152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73432c1-f026-4bb9-a501-2fa289e6c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:26.405588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73432c1-f026-4bb9-a501-2fa289e6c432 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:26.406449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73432c1-f026-4bb9-a501-2fa289e6c432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:26.408626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73432c1-f026-4bb9-a501-2fa289e6c432 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:26.419515 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1124/2251] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:26 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:26.451994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fec50-39d9-4c5f-a526-09e0c6e0b01a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:26.458513 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1128/2252] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:26 2021] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:46:26.475646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fec50-39d9-4c5f-a526-09e0c6e0b01a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:26.483828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3b70d-3877-4d37-9720-b17b69fbb790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:26.484598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b70d-3877-4d37-9720-b17b69fbb790 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:26.484953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b70d-3877-4d37-9720-b17b69fbb790 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:26.485310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3b70d-3877-4d37-9720-b17b69fbb790 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:26.486292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3b70d-3877-4d37-9720-b17b69fbb790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:26.488062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3b70d-3877-4d37-9720-b17b69fbb790 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:26.499593 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1125/2253] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:26 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:26.503378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73432c1-f026-4bb9-a501-2fa289e6c432 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:26.516280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73432c1-f026-4bb9-a501-2fa289e6c432 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:26.522454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db3669-9021-46d6-a49f-c8dc14848e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:26.523984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3b70d-3877-4d37-9720-b17b69fbb790 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:26.526674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3669-9021-46d6-a49f-c8dc14848e83 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:26.527275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a4f3b70d-3877-4d37-9720-b17b69fbb790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:26.527764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3669-9021-46d6-a49f-c8dc14848e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:26.528244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db3669-9021-46d6-a49f-c8dc14848e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:26.529522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db3669-9021-46d6-a49f-c8dc14848e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:26.531991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db3669-9021-46d6-a49f-c8dc14848e83 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:26.556466 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1129/2254] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:26 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:26.557397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db3669-9021-46d6-a49f-c8dc14848e83 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:26.569515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db3669-9021-46d6-a49f-c8dc14848e83 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:26.580509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21f10a-6849-4821-9a13-835e08c96717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:26.581411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f10a-6849-4821-9a13-835e08c96717 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:26.581700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f10a-6849-4821-9a13-835e08c96717 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:26.582118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21f10a-6849-4821-9a13-835e08c96717 admin admin] PATH_INFO: `/v3/projects/bba5dc062b60481085531bc034e45209/users/9322591436e34060a46c6f145dca61d7/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:26.602095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21f10a-6849-4821-9a13-835e08c96717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba5dc062b60481085531bc034e45209, user_id=9322591436e34060a46c6f145dca61d7, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:26.605767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21f10a-6849-4821-9a13-835e08c96717 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:26.627746 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1130/2255] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:26 2021] PUT /identity/v3/projects/bba5dc062b60481085531bc034e45209/users/9322591436e34060a46c6f145dca61d7/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:26.632182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed687a4-79c9-4eda-857c-e67ef7632786 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:26.632182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed687a4-79c9-4eda-857c-e67ef7632786 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:26.632182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed687a4-79c9-4eda-857c-e67ef7632786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:26.644219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3b70d-3877-4d37-9720-b17b69fbb790 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:26.657019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3ed687a4-79c9-4eda-857c-e67ef7632786 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:26.658227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3ed687a4-79c9-4eda-857c-e67ef7632786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:26.766176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c3a13-6b26-4345-9275-c523fb3376bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:26.767464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3a13-6b26-4345-9275-c523fb3376bc service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:26.767984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3a13-6b26-4345-9275-c523fb3376bc service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:26.768365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3a13-6b26-4345-9275-c523fb3376bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:26.789343 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1131/2256] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:26.790420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed687a4-79c9-4eda-857c-e67ef7632786 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:26.792404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3ed687a4-79c9-4eda-857c-e67ef7632786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:26.828868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed687a4-79c9-4eda-857c-e67ef7632786 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:26.837923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:26.839221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:26.840409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:26.840772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] PATH_INFO: `/v3/projects/5d66ae1e4d29435e8489bc8f53cf7eb4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:26.844239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d66ae1e4d29435e8489bc8f53cf7eb4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:26.849762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:26.869483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c3a13-6b26-4345-9275-c523fb3376bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:26.874905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c3a13-6b26-4345-9275-c523fb3376bc service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:26.889152 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1126/2257] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:26 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:26.890301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c3a13-6b26-4345-9275-c523fb3376bc service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:26.892051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-600c3a13-6b26-4345-9275-c523fb3376bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:26.969447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d66ae1e4d29435e8489bc8f53cf7eb4', 'request_id': 'req-3ff5ecc6-140e-4e03-8792-57577222328d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:26.988886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d66ae1e4d29435e8489bc8f53cf7eb4', 'request_id': 'req-3ff5ecc6-140e-4e03-8792-57577222328d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:27.000926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c3a13-6b26-4345-9275-c523fb3376bc service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:27.003737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d66ae1e4d29435e8489bc8f53cf7eb4', 'request_id': 'req-3ff5ecc6-140e-4e03-8792-57577222328d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:27.029453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] The token cache is being invalidate because project 5d66ae1e4d29435e8489bc8f53cf7eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:27.031013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:27.033438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:27.043400 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1132/2258] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:26 2021] DELETE /identity/v3/projects/5d66ae1e4d29435e8489bc8f53cf7eb4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:27.044460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:27.046853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:27.096845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427d8a3-7f42-4174-b041-6833a25e03c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:27.097622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d8a3-7f42-4174-b041-6833a25e03c6 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:27.098002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d8a3-7f42-4174-b041-6833a25e03c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:27.098497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d8a3-7f42-4174-b041-6833a25e03c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:27.100719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1427d8a3-7f42-4174-b041-6833a25e03c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:27.151547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5ecc6-140e-4e03-8792-57577222328d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:27.160365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50089793-f522-4ec6-b7f9-da4a246e448b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:27.161285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50089793-f522-4ec6-b7f9-da4a246e448b service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:27.161725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50089793-f522-4ec6-b7f9-da4a246e448b service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:27.162175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50089793-f522-4ec6-b7f9-da4a246e448b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:27.164906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-50089793-f522-4ec6-b7f9-da4a246e448b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:27.195913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427d8a3-7f42-4174-b041-6833a25e03c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:27.197871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427d8a3-7f42-4174-b041-6833a25e03c6 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:27.210102 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1127/2259] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:27.211700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5fe0-dd39-4e45-95f9-03e49a72f336 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:27.211987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5fe0-dd39-4e45-95f9-03e49a72f336 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:27.212484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5fe0-dd39-4e45-95f9-03e49a72f336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:27.263401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0e8a5fe0-dd39-4e45-95f9-03e49a72f336 None None] MFA Rules not processed for user `49049bebdad54e2ebc4e1d5ba129d299`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:27.265839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0e8a5fe0-dd39-4e45-95f9-03e49a72f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:27.303827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50089793-f522-4ec6-b7f9-da4a246e448b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:27.308544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50089793-f522-4ec6-b7f9-da4a246e448b service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:27.338987 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1133/2260] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:27 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:27.343015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b10d-5c37-4719-bed9-9c5b18506653 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:27.346023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b10d-5c37-4719-bed9-9c5b18506653 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:27.346201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b10d-5c37-4719-bed9-9c5b18506653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:27.401934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-97c5b10d-5c37-4719-bed9-9c5b18506653 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:27.406024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-97c5b10d-5c37-4719-bed9-9c5b18506653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:27.429050 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1134/2261] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:27.429771 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1128/2262] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:27 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:27.434186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22af79-a4e8-42a6-a6aa-d67f14e2bb89 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:27.435000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22af79-a4e8-42a6-a6aa-d67f14e2bb89 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:27.435473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22af79-a4e8-42a6-a6aa-d67f14e2bb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:27.449506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea229b8e-6cd4-4d11-83ba-39d124ecdb0d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:27.449957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea229b8e-6cd4-4d11-83ba-39d124ecdb0d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:27.450479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea229b8e-6cd4-4d11-83ba-39d124ecdb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:27.477826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2b22af79-a4e8-42a6-a6aa-d67f14e2bb89 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:27.479949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2b22af79-a4e8-42a6-a6aa-d67f14e2bb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:27.504857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ea229b8e-6cd4-4d11-83ba-39d124ecdb0d None None] MFA Rules not processed for user `2d326a07ce104727bec8ae98dabea64d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:27.505205 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1135/2263] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:27.506136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22af79-a4e8-42a6-a6aa-d67f14e2bb89 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:27.510943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ea229b8e-6cd4-4d11-83ba-39d124ecdb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:27.521741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22af79-a4e8-42a6-a6aa-d67f14e2bb89 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:27.528716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84a2e-ce3d-4053-abe7-59497f7da9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:27.529385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84a2e-ce3d-4053-abe7-59497f7da9db admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:27.529666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84a2e-ce3d-4053-abe7-59497f7da9db admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:27.529940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84a2e-ce3d-4053-abe7-59497f7da9db admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:27.534388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee84a2e-ce3d-4053-abe7-59497f7da9db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:27.535839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee84a2e-ce3d-4053-abe7-59497f7da9db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:27.539536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee84a2e-ce3d-4053-abe7-59497f7da9db admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:27.586565 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1136/2264] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:27.589161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84a2e-ce3d-4053-abe7-59497f7da9db admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:27.600967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84a2e-ce3d-4053-abe7-59497f7da9db admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:27.608698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d985fbd-9743-4602-abbf-6773fb8ff0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:27.609578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d985fbd-9743-4602-abbf-6773fb8ff0cc admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:27.610151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d985fbd-9743-4602-abbf-6773fb8ff0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:27.610432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d985fbd-9743-4602-abbf-6773fb8ff0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:27.611487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d985fbd-9743-4602-abbf-6773fb8ff0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:27.614713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d985fbd-9743-4602-abbf-6773fb8ff0cc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:27.627882 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1129/2265] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:27 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:27.664432 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1137/2266] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:27 2021] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:27.666160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea229b8e-6cd4-4d11-83ba-39d124ecdb0d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:27.681891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea229b8e-6cd4-4d11-83ba-39d124ecdb0d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:27.797376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bce8a3-1d6d-457e-ac5b-494508d53e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:27.801341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bce8a3-1d6d-457e-ac5b-494508d53e10 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:27.801852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bce8a3-1d6d-457e-ac5b-494508d53e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:27.802583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bce8a3-1d6d-457e-ac5b-494508d53e10 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:27.803692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bce8a3-1d6d-457e-ac5b-494508d53e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:27.809762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bce8a3-1d6d-457e-ac5b-494508d53e10 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:27.865344 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1130/2267] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:27 2021] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:46:27.869424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d985fbd-9743-4602-abbf-6773fb8ff0cc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:27.882653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d985fbd-9743-4602-abbf-6773fb8ff0cc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:27.887816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f80b0-31c5-4bce-a705-db8bd341e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:27.897558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f80b0-31c5-4bce-a705-db8bd341e902 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:27.898738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f80b0-31c5-4bce-a705-db8bd341e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:27.899209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f80b0-31c5-4bce-a705-db8bd341e902 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:27.900224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f80b0-31c5-4bce-a705-db8bd341e902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:27.902065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f80b0-31c5-4bce-a705-db8bd341e902 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:27.918161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bce8a3-1d6d-457e-ac5b-494508d53e10 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:27.925711 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1138/2268] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:27 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:27.929801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bce8a3-1d6d-457e-ac5b-494508d53e10 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:27.935202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0535756-caaf-4ef3-8938-0fb8f2dddce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:27.936009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535756-caaf-4ef3-8938-0fb8f2dddce8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:27.936403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535756-caaf-4ef3-8938-0fb8f2dddce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:27.936771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0535756-caaf-4ef3-8938-0fb8f2dddce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:27.938433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0535756-caaf-4ef3-8938-0fb8f2dddce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:27.941011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0535756-caaf-4ef3-8938-0fb8f2dddce8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:27.963757 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1131/2269] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:27 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:46:27.966529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f80b0-31c5-4bce-a705-db8bd341e902 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:27.994218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f80b0-31c5-4bce-a705-db8bd341e902 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:28.016557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224d5e5-8d12-4bac-a497-9d83a510276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:28.017491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d5e5-8d12-4bac-a497-9d83a510276d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.017735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d5e5-8d12-4bac-a497-9d83a510276d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.018013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d5e5-8d12-4bac-a497-9d83a510276d admin admin] PATH_INFO: `/v3/projects/d9b989c20b5c4459b1d9c5c1a375640b/users/65774597003f4490b5f87a9d5961adb5/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.056398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0535756-caaf-4ef3-8938-0fb8f2dddce8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:28.060517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224d5e5-8d12-4bac-a497-9d83a510276d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b989c20b5c4459b1d9c5c1a375640b, user_id=65774597003f4490b5f87a9d5961adb5, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:28.064271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224d5e5-8d12-4bac-a497-9d83a510276d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:28.084926 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1139/2270] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:27 2021] PUT /identity/v3/projects/d9b989c20b5c4459b1d9c5c1a375640b/users/65774597003f4490b5f87a9d5961adb5/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:28.097547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2957b-5110-4903-9163-169830b2a39d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.097949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2957b-5110-4903-9163-169830b2a39d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.099339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2957b-5110-4903-9163-169830b2a39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.142981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-00a2957b-5110-4903-9163-169830b2a39d None None] MFA Rules not processed for user `65774597003f4490b5f87a9d5961adb5`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:28.144329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-00a2957b-5110-4903-9163-169830b2a39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:28.160748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0535756-caaf-4ef3-8938-0fb8f2dddce8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:28.248315 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1140/2271] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:28 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:28.252221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2957b-5110-4903-9163-169830b2a39d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:28.291326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71561b43-ae9e-494f-b462-1fb5909f35c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:28.292173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561b43-ae9e-494f-b462-1fb5909f35c5 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.292456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561b43-ae9e-494f-b462-1fb5909f35c5 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.292727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561b43-ae9e-494f-b462-1fb5909f35c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.294941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-71561b43-ae9e-494f-b462-1fb5909f35c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:28.331294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2957b-5110-4903-9163-169830b2a39d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:28.339000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc467457-640c-4f1a-88ba-b1b0265c0352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:28.340402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc467457-640c-4f1a-88ba-b1b0265c0352 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.341174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc467457-640c-4f1a-88ba-b1b0265c0352 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.341535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc467457-640c-4f1a-88ba-b1b0265c0352 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.342610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc467457-640c-4f1a-88ba-b1b0265c0352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:28.345972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc467457-640c-4f1a-88ba-b1b0265c0352 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:28.383737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71561b43-ae9e-494f-b462-1fb5909f35c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:28.387155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71561b43-ae9e-494f-b462-1fb5909f35c5 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:28.402750 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1141/2272] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:28 2021] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:28.408993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc467457-640c-4f1a-88ba-b1b0265c0352 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:28.414699 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1132/2273] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:28 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:28.543353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0d3dc-0e2d-435d-98d4-df7962168754 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.543854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0d3dc-0e2d-435d-98d4-df7962168754 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.544202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0d3dc-0e2d-435d-98d4-df7962168754 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.547628 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1133/2274] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:46:28 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:46:28.561429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccd1bb-8b2d-4916-9900-16a7c178edba None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.561717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccd1bb-8b2d-4916-9900-16a7c178edba None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.565900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc467457-640c-4f1a-88ba-b1b0265c0352 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:28.566624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccd1bb-8b2d-4916-9900-16a7c178edba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.573740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cda2c-aaa2-464a-9ec0-aab1515493c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:28.574532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cda2c-aaa2-464a-9ec0-aab1515493c7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.574922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cda2c-aaa2-464a-9ec0-aab1515493c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.575507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cda2c-aaa2-464a-9ec0-aab1515493c7 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.576334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cda2c-aaa2-464a-9ec0-aab1515493c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:28.578876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cda2c-aaa2-464a-9ec0-aab1515493c7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:28.615607 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1142/2275] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:28 2021] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:28.617905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cda2c-aaa2-464a-9ec0-aab1515493c7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:28.630361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cda2c-aaa2-464a-9ec0-aab1515493c7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:28.637382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11970e62-22f0-4e6c-8a04-4f7a589b0e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:28.638310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970e62-22f0-4e6c-8a04-4f7a589b0e57 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.638792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970e62-22f0-4e6c-8a04-4f7a589b0e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.639399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11970e62-22f0-4e6c-8a04-4f7a589b0e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.640348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11970e62-22f0-4e6c-8a04-4f7a589b0e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:28.642193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11970e62-22f0-4e6c-8a04-4f7a589b0e57 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:28.655868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e6ccd1bb-8b2d-4916-9900-16a7c178edba None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:28.657550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e6ccd1bb-8b2d-4916-9900-16a7c178edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:28.659155 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1143/2276] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:28 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:28.660240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11970e62-22f0-4e6c-8a04-4f7a589b0e57 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:28.671736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11970e62-22f0-4e6c-8a04-4f7a589b0e57 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:28.676609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7367a6-761b-49a7-8625-009a8d8702b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:28.677663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7367a6-761b-49a7-8625-009a8d8702b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.677946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7367a6-761b-49a7-8625-009a8d8702b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.678217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7367a6-761b-49a7-8625-009a8d8702b7 admin admin] PATH_INFO: `/v3/projects/0cf2e4fc98de4b15bd55bfd95f3600ff/users/45b2a2b9d7e74285834d3ea248e93c6e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.701378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7367a6-761b-49a7-8625-009a8d8702b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf2e4fc98de4b15bd55bfd95f3600ff, user_id=45b2a2b9d7e74285834d3ea248e93c6e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:28.704372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7367a6-761b-49a7-8625-009a8d8702b7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:28.724924 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1144/2277] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:28 2021] PUT /identity/v3/projects/0cf2e4fc98de4b15bd55bfd95f3600ff/users/45b2a2b9d7e74285834d3ea248e93c6e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:28.726208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7367a6-761b-49a7-8625-009a8d8702b7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:28.738611 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1134/2278] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:46:28 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:28.752221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccd1bb-8b2d-4916-9900-16a7c178edba None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:28.754106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e6ccd1bb-8b2d-4916-9900-16a7c178edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:28.773388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccd1bb-8b2d-4916-9900-16a7c178edba None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:28.849193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7367a6-761b-49a7-8625-009a8d8702b7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:28.869630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac8d38-7a3e-4987-bec3-e46d679d4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:28.870027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac8d38-7a3e-4987-bec3-e46d679d4aee admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.870310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac8d38-7a3e-4987-bec3-e46d679d4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.871204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac8d38-7a3e-4987-bec3-e46d679d4aee admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.871626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac8d38-7a3e-4987-bec3-e46d679d4aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:28.873401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac8d38-7a3e-4987-bec3-e46d679d4aee admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:28.899551 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1145/2279] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:28 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:28.903235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d8ace-6c1d-4631-926c-70442b8ec0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:28.904663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8ace-6c1d-4631-926c-70442b8ec0ff service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.905245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8ace-6c1d-4631-926c-70442b8ec0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.905886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d8ace-6c1d-4631-926c-70442b8ec0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.909370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac8d38-7a3e-4987-bec3-e46d679d4aee admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:28.921320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d8ace-6c1d-4631-926c-70442b8ec0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:28.924185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8d8ace-6c1d-4631-926c-70442b8ec0ff service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:28.934007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac8d38-7a3e-4987-bec3-e46d679d4aee admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:28.940607 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1135/2280] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:28 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:28.961417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacc761-266f-40ff-96fb-191064f0ab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:28.962334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacc761-266f-40ff-96fb-191064f0ab87 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:28.962619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacc761-266f-40ff-96fb-191064f0ab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:28.962896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacc761-266f-40ff-96fb-191064f0ab87 admin admin] PATH_INFO: `/v3/projects/0cf2e4fc98de4b15bd55bfd95f3600ff/users/45b2a2b9d7e74285834d3ea248e93c6e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:28.965044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacc761-266f-40ff-96fb-191064f0ab87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf2e4fc98de4b15bd55bfd95f3600ff, user_id=45b2a2b9d7e74285834d3ea248e93c6e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:28.967830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacc761-266f-40ff-96fb-191064f0ab87 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:29.002422 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1146/2281] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:28 2021] PUT /identity/v3/projects/0cf2e4fc98de4b15bd55bfd95f3600ff/users/45b2a2b9d7e74285834d3ea248e93c6e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:29.009649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f722c6-2cf6-41a4-a3d0-840b10ef86d0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:29.009934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f722c6-2cf6-41a4-a3d0-840b10ef86d0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:29.013575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f722c6-2cf6-41a4-a3d0-840b10ef86d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:29.023433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece7a08-b8ba-436f-a86b-c3efa5f5efa4 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:29.023731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece7a08-b8ba-436f-a86b-c3efa5f5efa4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:29.024010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece7a08-b8ba-436f-a86b-c3efa5f5efa4 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:29.026148 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1147/2282] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:46:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:46:29.032920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955601ad-92f4-4428-bbfa-cd8234b87fae None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:29.032920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955601ad-92f4-4428-bbfa-cd8234b87fae None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:29.032920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955601ad-92f4-4428-bbfa-cd8234b87fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:29.072969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-86f722c6-2cf6-41a4-a3d0-840b10ef86d0 None None] MFA Rules not processed for user `45b2a2b9d7e74285834d3ea248e93c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:29.074838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-86f722c6-2cf6-41a4-a3d0-840b10ef86d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:29.139513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-955601ad-92f4-4428-bbfa-cd8234b87fae None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:29.140742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-955601ad-92f4-4428-bbfa-cd8234b87fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:29.230409 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1136/2283] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:29 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:29.274209 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1148/2284] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:46:29 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:29.309668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f722c6-2cf6-41a4-a3d0-840b10ef86d0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:29.311114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-86f722c6-2cf6-41a4-a3d0-840b10ef86d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:29.343640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f722c6-2cf6-41a4-a3d0-840b10ef86d0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:29.364198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8777e1-b6b6-473d-9aa5-3cdf8e4dd977 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:29.365090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8777e1-b6b6-473d-9aa5-3cdf8e4dd977 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:29.367165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8777e1-b6b6-473d-9aa5-3cdf8e4dd977 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:29.370893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8777e1-b6b6-473d-9aa5-3cdf8e4dd977 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:29.386722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8777e1-b6b6-473d-9aa5-3cdf8e4dd977 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:29.388508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8777e1-b6b6-473d-9aa5-3cdf8e4dd977 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:29.401669 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1137/2285] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:29 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:29.667976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8684d5-7247-49a1-bf93-fe7fbca945d8 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:29.668308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8684d5-7247-49a1-bf93-fe7fbca945d8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:29.668545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8684d5-7247-49a1-bf93-fe7fbca945d8 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:29.671049 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1149/2286] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:46:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:46:29.677799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f194-d4ed-4ab8-aad4-d3b079be5f2f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:29.678081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f194-d4ed-4ab8-aad4-d3b079be5f2f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:29.678354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f194-d4ed-4ab8-aad4-d3b079be5f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:29.709609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5281f194-d4ed-4ab8-aad4-d3b079be5f2f None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:29.711608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5281f194-d4ed-4ab8-aad4-d3b079be5f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:29.797320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8684d5-7247-49a1-bf93-fe7fbca945d8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:29.799584 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1138/2287] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:46:29 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:29.826017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8684d5-7247-49a1-bf93-fe7fbca945d8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:29.830951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f51e44-127f-46d6-a7ad-6a26568dcdb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:29.831649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51e44-127f-46d6-a7ad-6a26568dcdb3 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:29.831934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51e44-127f-46d6-a7ad-6a26568dcdb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:29.832351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51e44-127f-46d6-a7ad-6a26568dcdb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:29.846938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f51e44-127f-46d6-a7ad-6a26568dcdb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:29.851523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f51e44-127f-46d6-a7ad-6a26568dcdb3 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:29.872907 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1150/2288] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:29 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:30.102995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281f194-d4ed-4ab8-aad4-d3b079be5f2f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:30.103826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5281f194-d4ed-4ab8-aad4-d3b079be5f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:30.185076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b20921-922f-4fd6-9ca6-51a89e61fc6a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:30.185634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b20921-922f-4fd6-9ca6-51a89e61fc6a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:30.185634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b20921-922f-4fd6-9ca6-51a89e61fc6a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:30.188211 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1151/2289] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:46:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:46:30.216049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fee6ad-23c5-4b29-b8f8-20a23daf7a28 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:30.216334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fee6ad-23c5-4b29-b8f8-20a23daf7a28 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:30.217335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fee6ad-23c5-4b29-b8f8-20a23daf7a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:30.246260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e7fee6ad-23c5-4b29-b8f8-20a23daf7a28 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:30.249823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e7fee6ad-23c5-4b29-b8f8-20a23daf7a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:30.276269 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1152/2290] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:46:30 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:30.277917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281f194-d4ed-4ab8-aad4-d3b079be5f2f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:30.284085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008e6c1-7e70-4ffb-aadd-7b2993279dc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:30.285024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e6c1-7e70-4ffb-aadd-7b2993279dc9 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:30.285530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e6c1-7e70-4ffb-aadd-7b2993279dc9 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:30.285991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008e6c1-7e70-4ffb-aadd-7b2993279dc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:30.323926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fee6ad-23c5-4b29-b8f8-20a23daf7a28 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:30.337226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fee6ad-23c5-4b29-b8f8-20a23daf7a28 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:30.358964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2164e48-148a-4404-baac-620ef66e8767 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:30.359689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164e48-148a-4404-baac-620ef66e8767 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:30.359973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164e48-148a-4404-baac-620ef66e8767 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:30.360256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164e48-148a-4404-baac-620ef66e8767 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:30.381475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2164e48-148a-4404-baac-620ef66e8767 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:30.383445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2164e48-148a-4404-baac-620ef66e8767 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:30.394859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008e6c1-7e70-4ffb-aadd-7b2993279dc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:30.396513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008e6c1-7e70-4ffb-aadd-7b2993279dc9 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:30.407151 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1153/2291] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:30 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:30.439100 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1139/2292] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:30 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:30.452001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2164e48-148a-4404-baac-620ef66e8767 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:30.601304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2164e48-148a-4404-baac-620ef66e8767 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:30.611398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:30.613280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:30.613733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:30.614016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] PATH_INFO: `/v3/users/65774597003f4490b5f87a9d5961adb5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:30.616627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65774597003f4490b5f87a9d5961adb5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:30.618101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:30.732603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65774597003f4490b5f87a9d5961adb5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:30.732603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65774597003f4490b5f87a9d5961adb5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:30.756231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65774597003f4490b5f87a9d5961adb5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:30.758534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65774597003f4490b5f87a9d5961adb5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:30.773444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65774597003f4490b5f87a9d5961adb5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:30.824334 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1154/2293] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:30 2021] DELETE /identity/v3/users/65774597003f4490b5f87a9d5961adb5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:30.830425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda451-3f71-4de1-8bb4-29a9f6a76787 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:30.830779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda451-3f71-4de1-8bb4-29a9f6a76787 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:30.831134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fda451-3f71-4de1-8bb4-29a9f6a76787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:30.881297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b3fda451-3f71-4de1-8bb4-29a9f6a76787 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:30.885580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b3fda451-3f71-4de1-8bb4-29a9f6a76787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:31.050498 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1140/2294] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:31.062849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:31.064751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:31.230654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc990d-f0c0-4275-8cb1-eed0e2da3ce5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:31.243659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c963abb-3e6d-4a16-91ec-94d742057f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:31.244908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c963abb-3e6d-4a16-91ec-94d742057f87 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:31.245688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c963abb-3e6d-4a16-91ec-94d742057f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:31.246364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c963abb-3e6d-4a16-91ec-94d742057f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:31.262645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c963abb-3e6d-4a16-91ec-94d742057f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:31.264607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c963abb-3e6d-4a16-91ec-94d742057f87 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:31.284572 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1155/2295] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:31.743267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fda451-3f71-4de1-8bb4-29a9f6a76787 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:31.744772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b3fda451-3f71-4de1-8bb4-29a9f6a76787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:31.769245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c963abb-3e6d-4a16-91ec-94d742057f87 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:31.770939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2c963abb-3e6d-4a16-91ec-94d742057f87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:31.792861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fda451-3f71-4de1-8bb4-29a9f6a76787 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:31.802537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c963abb-3e6d-4a16-91ec-94d742057f87 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:31.807704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:31.810820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:31.811934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:31.812373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] PATH_INFO: `/v3/projects/d9b989c20b5c4459b1d9c5c1a375640b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:31.814051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b989c20b5c4459b1d9c5c1a375640b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:31.816368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:31.816738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:31.817506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:31.817892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:31.818395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] PATH_INFO: `/v3/users/e2a797e28c1c4b839f00a99bd54ea324` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:31.821768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a797e28c1c4b839f00a99bd54ea324)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:31.825108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:31.889240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b989c20b5c4459b1d9c5c1a375640b', 'request_id': 'req-abd73cf6-60cc-42d7-b065-f83397ffc732'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:31.903621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b989c20b5c4459b1d9c5c1a375640b', 'request_id': 'req-abd73cf6-60cc-42d7-b065-f83397ffc732'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:31.915581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b989c20b5c4459b1d9c5c1a375640b', 'request_id': 'req-abd73cf6-60cc-42d7-b065-f83397ffc732'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:31.929422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a797e28c1c4b839f00a99bd54ea324'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:31.930427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a797e28c1c4b839f00a99bd54ea324'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:31.946450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a797e28c1c4b839f00a99bd54ea324'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:31.948396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a797e28c1c4b839f00a99bd54ea324'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:31.948584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] The token cache is being invalidate because project d9b989c20b5c4459b1d9c5c1a375640b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:31.948885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:31.949690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:31.958895 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1141/2296] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:31 2021] DELETE /identity/v3/projects/d9b989c20b5c4459b1d9c5c1a375640b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:31.958895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:31.961197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:31.977962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a797e28c1c4b839f00a99bd54ea324'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:32.017660 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1156/2297] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:31 2021] DELETE /identity/v3/users/e2a797e28c1c4b839f00a99bd54ea324 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:32.034237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:32.039788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:32.070569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd73cf6-60cc-42d7-b065-f83397ffc732 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:32.180607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d3de1-51e0-4a24-972a-93f5bd04ef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:32.181784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d3de1-51e0-4a24-972a-93f5bd04ef32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:32.182182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d3de1-51e0-4a24-972a-93f5bd04ef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:32.183085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d3de1-51e0-4a24-972a-93f5bd04ef32 admin admin] PATH_INFO: `/v3/users/8eff5913736b4e77ac2b092534edfcd9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:32.184882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d3de1-51e0-4a24-972a-93f5bd04ef32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eff5913736b4e77ac2b092534edfcd9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:32.187246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d3de1-51e0-4a24-972a-93f5bd04ef32 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:32.265520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b383f-35bd-4d35-8e8b-282b53a7543d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:32.271770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b533be-6893-465d-8683-2ef384dd3afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:32.274809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b533be-6893-465d-8683-2ef384dd3afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:32.275281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b533be-6893-465d-8683-2ef384dd3afd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:32.275706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b533be-6893-465d-8683-2ef384dd3afd admin admin] PATH_INFO: `/v3/users/45b2a2b9d7e74285834d3ea248e93c6e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:32.277321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b533be-6893-465d-8683-2ef384dd3afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b2a2b9d7e74285834d3ea248e93c6e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:32.291835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b533be-6893-465d-8683-2ef384dd3afd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:32.343322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cb3d3de1-51e0-4a24-972a-93f5bd04ef32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eff5913736b4e77ac2b092534edfcd9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:32.374732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cb3d3de1-51e0-4a24-972a-93f5bd04ef32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eff5913736b4e77ac2b092534edfcd9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:32.376330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cb3d3de1-51e0-4a24-972a-93f5bd04ef32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eff5913736b4e77ac2b092534edfcd9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:32.412835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cb3d3de1-51e0-4a24-972a-93f5bd04ef32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eff5913736b4e77ac2b092534edfcd9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:32.448377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8b533be-6893-465d-8683-2ef384dd3afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b2a2b9d7e74285834d3ea248e93c6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:32.459700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8b533be-6893-465d-8683-2ef384dd3afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b2a2b9d7e74285834d3ea248e93c6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:32.463589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cb3d3de1-51e0-4a24-972a-93f5bd04ef32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eff5913736b4e77ac2b092534edfcd9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:32.489369 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1142/2298] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:31 2021] DELETE /identity/v3/users/8eff5913736b4e77ac2b092534edfcd9 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:32.490405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8b533be-6893-465d-8683-2ef384dd3afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b2a2b9d7e74285834d3ea248e93c6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:32.491085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25782a6-3456-4099-843b-16a7af724240 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:32.492071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25782a6-3456-4099-843b-16a7af724240 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:32.492256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8b533be-6893-465d-8683-2ef384dd3afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b2a2b9d7e74285834d3ea248e93c6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:32.492414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25782a6-3456-4099-843b-16a7af724240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:32.506019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8b533be-6893-465d-8683-2ef384dd3afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b2a2b9d7e74285834d3ea248e93c6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:32.516283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e25782a6-3456-4099-843b-16a7af724240 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:32.517906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e25782a6-3456-4099-843b-16a7af724240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:32.557715 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1157/2299] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:32 2021] DELETE /identity/v3/users/45b2a2b9d7e74285834d3ea248e93c6e => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:32.559140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028073-2fc2-46a8-bdf1-e11aebdfac72 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:32.559452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028073-2fc2-46a8-bdf1-e11aebdfac72 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:32.559727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028073-2fc2-46a8-bdf1-e11aebdfac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:32.602750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4d028073-2fc2-46a8-bdf1-e11aebdfac72 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:32.606069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4d028073-2fc2-46a8-bdf1-e11aebdfac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:32.631174 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1143/2300] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:32.667829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25782a6-3456-4099-843b-16a7af724240 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:32.669613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e25782a6-3456-4099-843b-16a7af724240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:32.758462 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1158/2301] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:32.761185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25782a6-3456-4099-843b-16a7af724240 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:32.786386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d028073-2fc2-46a8-bdf1-e11aebdfac72 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:32.788799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4d028073-2fc2-46a8-bdf1-e11aebdfac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:32.831945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d845a-e949-430c-ad45-43cb3946debc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:32.832613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d845a-e949-430c-ad45-43cb3946debc service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:32.832904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d845a-e949-430c-ad45-43cb3946debc service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:32.833161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d845a-e949-430c-ad45-43cb3946debc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:32.844732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d845a-e949-430c-ad45-43cb3946debc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:32.847110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d845a-e949-430c-ad45-43cb3946debc service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:32.859914 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1144/2302] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:32.902721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d028073-2fc2-46a8-bdf1-e11aebdfac72 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:32.907982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e66d34-7807-480a-ab25-794d48662400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:32.909371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66d34-7807-480a-ab25-794d48662400 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:32.909796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66d34-7807-480a-ab25-794d48662400 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:32.910254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66d34-7807-480a-ab25-794d48662400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:32.927072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e66d34-7807-480a-ab25-794d48662400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:32.930285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e66d34-7807-480a-ab25-794d48662400 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:32.945628 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1159/2303] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:34.057559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d845a-e949-430c-ad45-43cb3946debc service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:34.059135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-324d845a-e949-430c-ad45-43cb3946debc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:34.076015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d845a-e949-430c-ad45-43cb3946debc service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:34.083976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:34.085506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:34.086198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:34.086650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] PATH_INFO: `/v3/projects/a53c15d688a541849c224abc382dff55` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:34.088407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53c15d688a541849c224abc382dff55)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:34.091421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:34.174132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53c15d688a541849c224abc382dff55', 'request_id': 'req-927462f8-35ab-4083-8ae7-f116ea71bfed'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.186224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e66d34-7807-480a-ab25-794d48662400 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:34.187571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53c15d688a541849c224abc382dff55', 'request_id': 'req-927462f8-35ab-4083-8ae7-f116ea71bfed'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.188677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e5e66d34-7807-480a-ab25-794d48662400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:34.195540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53c15d688a541849c224abc382dff55', 'request_id': 'req-927462f8-35ab-4083-8ae7-f116ea71bfed'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.211965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e66d34-7807-480a-ab25-794d48662400 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:34.215990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] The token cache is being invalidate because project a53c15d688a541849c224abc382dff55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:34.216692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.236550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.245641 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1145/2304] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:34 2021] DELETE /identity/v3/projects/a53c15d688a541849c224abc382dff55 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:34.258018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:34.262365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:34.379575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:34.380718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:34.381858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:34.382379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] PATH_INFO: `/v3/projects/c9d19cebb8eb47a8a37231bc16ea8704` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:34.384967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d19cebb8eb47a8a37231bc16ea8704)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:34.386946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:34.428877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927462f8-35ab-4083-8ae7-f116ea71bfed admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:34.459073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:34.463128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:34.466827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:34.467780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] PATH_INFO: `/v3/users/9c0e5e67b40d493bac716792d06824ff` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:34.473259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0e5e67b40d493bac716792d06824ff)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:34.478947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:34.495798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d19cebb8eb47a8a37231bc16ea8704', 'request_id': 'req-b8eb9012-634e-42a5-bc56-5889d649f3c4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.515958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d19cebb8eb47a8a37231bc16ea8704', 'request_id': 'req-b8eb9012-634e-42a5-bc56-5889d649f3c4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.534753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d19cebb8eb47a8a37231bc16ea8704', 'request_id': 'req-b8eb9012-634e-42a5-bc56-5889d649f3c4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.562367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] The token cache is being invalidate because project c9d19cebb8eb47a8a37231bc16ea8704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:34.564373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.567549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.572372 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1160/2305] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:34 2021] DELETE /identity/v3/projects/c9d19cebb8eb47a8a37231bc16ea8704 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:34.576814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:34.581091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:34.591754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0e5e67b40d493bac716792d06824ff'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.609342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0e5e67b40d493bac716792d06824ff'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.610827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0e5e67b40d493bac716792d06824ff'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.630690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0e5e67b40d493bac716792d06824ff'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.660354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0e5e67b40d493bac716792d06824ff'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.673430 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1146/2306] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:34 2021] DELETE /identity/v3/users/9c0e5e67b40d493bac716792d06824ff => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:34.674489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:34.676971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:34.712464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb9012-634e-42a5-bc56-5889d649f3c4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:34.768673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bdd7f-30f5-4598-a70d-b72dbad15d7a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:34.776188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1d465-4b14-4e42-a4d8-ff889e8658a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:34.777958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1d465-4b14-4e42-a4d8-ff889e8658a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:34.778515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1d465-4b14-4e42-a4d8-ff889e8658a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:34.778883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1d465-4b14-4e42-a4d8-ff889e8658a3 admin admin] PATH_INFO: `/v3/users/33a412cca9e74cbd82053730bf6c07ad` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:34.781537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1d465-4b14-4e42-a4d8-ff889e8658a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33a412cca9e74cbd82053730bf6c07ad)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:34.784112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1d465-4b14-4e42-a4d8-ff889e8658a3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:34.819929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:34.822285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:34.822572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:34.824201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] PATH_INFO: `/v3/projects/0cf2e4fc98de4b15bd55bfd95f3600ff` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:34.827528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf2e4fc98de4b15bd55bfd95f3600ff)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:34.834089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:34.902266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9df1d465-4b14-4e42-a4d8-ff889e8658a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33a412cca9e74cbd82053730bf6c07ad'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.917137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9df1d465-4b14-4e42-a4d8-ff889e8658a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33a412cca9e74cbd82053730bf6c07ad'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.918816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9df1d465-4b14-4e42-a4d8-ff889e8658a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33a412cca9e74cbd82053730bf6c07ad'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.943626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9df1d465-4b14-4e42-a4d8-ff889e8658a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33a412cca9e74cbd82053730bf6c07ad'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.968542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf2e4fc98de4b15bd55bfd95f3600ff', 'request_id': 'req-ef3d9005-1988-42a5-afd5-5633fa7366ba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.983704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9df1d465-4b14-4e42-a4d8-ff889e8658a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33a412cca9e74cbd82053730bf6c07ad'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.990756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf2e4fc98de4b15bd55bfd95f3600ff', 'request_id': 'req-ef3d9005-1988-42a5-afd5-5633fa7366ba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:34.994101 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1147/2307] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:34 2021] DELETE /identity/v3/users/33a412cca9e74cbd82053730bf6c07ad => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:35.019696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf2e4fc98de4b15bd55bfd95f3600ff', 'request_id': 'req-ef3d9005-1988-42a5-afd5-5633fa7366ba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:35.067879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] The token cache is being invalidate because project 0cf2e4fc98de4b15bd55bfd95f3600ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:35.070343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:35.073496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef3d9005-1988-42a5-afd5-5633fa7366ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:35.076085 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1161/2308] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:34 2021] DELETE /identity/v3/projects/0cf2e4fc98de4b15bd55bfd95f3600ff => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:35.082152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0d598-2038-4122-89a3-909501921841 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:35.083686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0d598-2038-4122-89a3-909501921841 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:35.084181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0d598-2038-4122-89a3-909501921841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:35.123664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c3f0d598-2038-4122-89a3-909501921841 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:35.126780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c3f0d598-2038-4122-89a3-909501921841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:35.214253 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1148/2309] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:35.222495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222086e-3cec-4e97-9f65-f8d509065183 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:35.223040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222086e-3cec-4e97-9f65-f8d509065183 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:35.223128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222086e-3cec-4e97-9f65-f8d509065183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:35.280599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8222086e-3cec-4e97-9f65-f8d509065183 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:35.282145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8222086e-3cec-4e97-9f65-f8d509065183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:35.307576 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1162/2310] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:35.310321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0d598-2038-4122-89a3-909501921841 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:35.321566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0d598-2038-4122-89a3-909501921841 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:35.335577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667abb8-11a3-4e33-8ae1-708952358b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:35.336361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667abb8-11a3-4e33-8ae1-708952358b2b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:35.336663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667abb8-11a3-4e33-8ae1-708952358b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:35.336940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667abb8-11a3-4e33-8ae1-708952358b2b admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:35.337695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667abb8-11a3-4e33-8ae1-708952358b2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:35.338000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667abb8-11a3-4e33-8ae1-708952358b2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:35.340472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667abb8-11a3-4e33-8ae1-708952358b2b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:35.374161 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1149/2311] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:35.378308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222086e-3cec-4e97-9f65-f8d509065183 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:35.396216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222086e-3cec-4e97-9f65-f8d509065183 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:35.405068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be61648-5310-4baa-99de-bf25c22c14fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:35.407568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be61648-5310-4baa-99de-bf25c22c14fe admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:35.408765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be61648-5310-4baa-99de-bf25c22c14fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:35.409567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be61648-5310-4baa-99de-bf25c22c14fe admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:35.410450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be61648-5310-4baa-99de-bf25c22c14fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:35.413699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be61648-5310-4baa-99de-bf25c22c14fe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:35.466913 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1163/2312] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:35 2021] POST /identity/v3/projects => generated 403 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:35.473417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667abb8-11a3-4e33-8ae1-708952358b2b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:35.504713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667abb8-11a3-4e33-8ae1-708952358b2b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:35.623755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ee820-28a9-41f1-9cc7-1b283e103e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:35.624793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee820-28a9-41f1-9cc7-1b283e103e4f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:35.625085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee820-28a9-41f1-9cc7-1b283e103e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:35.625509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee820-28a9-41f1-9cc7-1b283e103e4f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:35.627709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ee820-28a9-41f1-9cc7-1b283e103e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:35.633339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ee820-28a9-41f1-9cc7-1b283e103e4f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:35.675679 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1150/2313] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:35 2021] POST /identity/v3/users => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:35.677291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be61648-5310-4baa-99de-bf25c22c14fe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:35.692439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be61648-5310-4baa-99de-bf25c22c14fe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:35.700020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec2542-e95d-415e-8265-01d200a83f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:35.700953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2542-e95d-415e-8265-01d200a83f82 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:35.701682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2542-e95d-415e-8265-01d200a83f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:35.702310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2542-e95d-415e-8265-01d200a83f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:35.702714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec2542-e95d-415e-8265-01d200a83f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:35.705714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec2542-e95d-415e-8265-01d200a83f82 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:35.723913 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1164/2314] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:35.725942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ee820-28a9-41f1-9cc7-1b283e103e4f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:35.738993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ee820-28a9-41f1-9cc7-1b283e103e4f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:35.748949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda96ef-e6ec-4689-a5a3-061d2af05815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:35.749189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda96ef-e6ec-4689-a5a3-061d2af05815 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:35.749555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda96ef-e6ec-4689-a5a3-061d2af05815 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:35.749842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda96ef-e6ec-4689-a5a3-061d2af05815 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:35.750597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda96ef-e6ec-4689-a5a3-061d2af05815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:35.752451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda96ef-e6ec-4689-a5a3-061d2af05815 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:35.768498 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1151/2315] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:35 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:35.770409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec2542-e95d-415e-8265-01d200a83f82 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:35.783542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec2542-e95d-415e-8265-01d200a83f82 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:35.793335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcf25f-ccd1-42ef-9ce8-300306c24e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:35.794590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcf25f-ccd1-42ef-9ce8-300306c24e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:35.795070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcf25f-ccd1-42ef-9ce8-300306c24e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:35.796733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcf25f-ccd1-42ef-9ce8-300306c24e39 admin admin] PATH_INFO: `/v3/projects/68857c7effec496aa99ff78b76521109/users/5af01920574741f381a5dfefd9282bfc/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:35.823288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcf25f-ccd1-42ef-9ce8-300306c24e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68857c7effec496aa99ff78b76521109, user_id=5af01920574741f381a5dfefd9282bfc, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:35.827456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcf25f-ccd1-42ef-9ce8-300306c24e39 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:35.893029 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1165/2316] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:35 2021] PUT /identity/v3/projects/68857c7effec496aa99ff78b76521109/users/5af01920574741f381a5dfefd9282bfc/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:35.895799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee27fe6-2cc0-4f9f-865c-dd47de8fc1c9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:35.896837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee27fe6-2cc0-4f9f-865c-dd47de8fc1c9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:35.902961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee27fe6-2cc0-4f9f-865c-dd47de8fc1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:35.940209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0ee27fe6-2cc0-4f9f-865c-dd47de8fc1c9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:35.941699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0ee27fe6-2cc0-4f9f-865c-dd47de8fc1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:36.030068 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1152/2317] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:36.053847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcf25f-ccd1-42ef-9ce8-300306c24e39 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:36.056365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e8dcf25f-ccd1-42ef-9ce8-300306c24e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:36.080007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee27fe6-2cc0-4f9f-865c-dd47de8fc1c9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:36.081487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0ee27fe6-2cc0-4f9f-865c-dd47de8fc1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:36.112984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee27fe6-2cc0-4f9f-865c-dd47de8fc1c9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:36.135686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:36.136763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:36.137197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:36.137630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] PATH_INFO: `/v3/projects/80406563ee66488994c5b0a9329e3348` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:36.140586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=80406563ee66488994c5b0a9329e3348)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:36.143698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:36.166136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcf25f-ccd1-42ef-9ce8-300306c24e39 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:36.182169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032f7fa-a816-4590-b1fc-5d540b54bf9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:36.182169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f7fa-a816-4590-b1fc-5d540b54bf9d service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:36.182169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f7fa-a816-4590-b1fc-5d540b54bf9d service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:36.182169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032f7fa-a816-4590-b1fc-5d540b54bf9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:36.203583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032f7fa-a816-4590-b1fc-5d540b54bf9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:36.212890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032f7fa-a816-4590-b1fc-5d540b54bf9d service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:36.248663 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1166/2318] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:36.309571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80406563ee66488994c5b0a9329e3348', 'request_id': 'req-8d84888a-055b-4dda-b092-2d0e71e1cd9a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:36.321890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80406563ee66488994c5b0a9329e3348', 'request_id': 'req-8d84888a-055b-4dda-b092-2d0e71e1cd9a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:36.372936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80406563ee66488994c5b0a9329e3348', 'request_id': 'req-8d84888a-055b-4dda-b092-2d0e71e1cd9a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:36.394892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032f7fa-a816-4590-b1fc-5d540b54bf9d service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:36.396484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c032f7fa-a816-4590-b1fc-5d540b54bf9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:36.416084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] The token cache is being invalidate because project 80406563ee66488994c5b0a9329e3348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:36.416383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:36.417193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8d84888a-055b-4dda-b092-2d0e71e1cd9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:36.419433 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1153/2319] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:36 2021] DELETE /identity/v3/projects/80406563ee66488994c5b0a9329e3348 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:36.422017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032f7fa-a816-4590-b1fc-5d540b54bf9d service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:36.443917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d8847-d575-4a08-b1f8-d62fa2cd47a0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:36.444232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d8847-d575-4a08-b1f8-d62fa2cd47a0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:36.444553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d8847-d575-4a08-b1f8-d62fa2cd47a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:36.539316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-727d8847-d575-4a08-b1f8-d62fa2cd47a0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:36.562234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-727d8847-d575-4a08-b1f8-d62fa2cd47a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:36.604836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:36.609298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:36.609596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:36.610745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] PATH_INFO: `/v3/projects/b27fa40e5e8849f9afaa6269ac038aca` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:36.615036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27fa40e5e8849f9afaa6269ac038aca)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:36.627035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:36.764118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27fa40e5e8849f9afaa6269ac038aca', 'request_id': 'req-7a7a9755-41e9-4f35-a17f-aa120e7e2468'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:36.778618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27fa40e5e8849f9afaa6269ac038aca', 'request_id': 'req-7a7a9755-41e9-4f35-a17f-aa120e7e2468'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:36.795800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27fa40e5e8849f9afaa6269ac038aca', 'request_id': 'req-7a7a9755-41e9-4f35-a17f-aa120e7e2468'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:36.820052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] The token cache is being invalidate because project b27fa40e5e8849f9afaa6269ac038aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:36.821871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:36.823827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a7a9755-41e9-4f35-a17f-aa120e7e2468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:36.826904 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1167/2320] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:36 2021] DELETE /identity/v3/projects/b27fa40e5e8849f9afaa6269ac038aca => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:36.832797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4258-2a95-4e90-a79f-aa29d2dd30b6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:36.833174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4258-2a95-4e90-a79f-aa29d2dd30b6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:36.834116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4258-2a95-4e90-a79f-aa29d2dd30b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:36.844070 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1154/2321] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:36.853106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec259b4-3f97-4593-9631-e4f369f47309 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:36.853106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec259b4-3f97-4593-9631-e4f369f47309 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:36.853106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec259b4-3f97-4593-9631-e4f369f47309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:36.876805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8a7a4258-2a95-4e90-a79f-aa29d2dd30b6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:36.880618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8a7a4258-2a95-4e90-a79f-aa29d2dd30b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:36.885908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8ec259b4-3f97-4593-9631-e4f369f47309 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:36.888668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8ec259b4-3f97-4593-9631-e4f369f47309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:37.015186 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1168/2322] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:37.019465 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1155/2323] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:37.020856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114024b-b272-4a6c-bc08-67897ef39bc1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.021412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114024b-b272-4a6c-bc08-67897ef39bc1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.021840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114024b-b272-4a6c-bc08-67897ef39bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.033008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec259b4-3f97-4593-9631-e4f369f47309 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.046017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec259b4-3f97-4593-9631-e4f369f47309 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.047902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0114024b-b272-4a6c-bc08-67897ef39bc1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:37.049359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0114024b-b272-4a6c-bc08-67897ef39bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:37.052489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fa3ad-a361-47b6-8755-218c6fcb6502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.053427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fa3ad-a361-47b6-8755-218c6fcb6502 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.053756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fa3ad-a361-47b6-8755-218c6fcb6502 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.054133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fa3ad-a361-47b6-8755-218c6fcb6502 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.055472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fa3ad-a361-47b6-8755-218c6fcb6502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:37.056175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fa3ad-a361-47b6-8755-218c6fcb6502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.058100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fa3ad-a361-47b6-8755-218c6fcb6502 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.063975 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1169/2324] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:37.068195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114024b-b272-4a6c-bc08-67897ef39bc1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.081794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114024b-b272-4a6c-bc08-67897ef39bc1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.091372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53b8a5-9d3d-4834-b512-4b7c56dcb55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.092166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53b8a5-9d3d-4834-b512-4b7c56dcb55a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.092498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53b8a5-9d3d-4834-b512-4b7c56dcb55a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.092885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53b8a5-9d3d-4834-b512-4b7c56dcb55a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.093864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53b8a5-9d3d-4834-b512-4b7c56dcb55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:37.094257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53b8a5-9d3d-4834-b512-4b7c56dcb55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.096903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53b8a5-9d3d-4834-b512-4b7c56dcb55a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.098623 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1156/2325] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:37.117432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fa3ad-a361-47b6-8755-218c6fcb6502 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.123963 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1170/2326] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:37.139712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53b8a5-9d3d-4834-b512-4b7c56dcb55a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.161449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fa3ad-a361-47b6-8755-218c6fcb6502 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.178029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95830d07-a0b1-4b81-9926-ea4bdc31dfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.178447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95830d07-a0b1-4b81-9926-ea4bdc31dfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.179901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95830d07-a0b1-4b81-9926-ea4bdc31dfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.179901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95830d07-a0b1-4b81-9926-ea4bdc31dfd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.180506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95830d07-a0b1-4b81-9926-ea4bdc31dfd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.182913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95830d07-a0b1-4b81-9926-ea4bdc31dfd8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.185079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53b8a5-9d3d-4834-b512-4b7c56dcb55a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.207754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f697070-dfe4-459f-8a05-27e6e7d39e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.208585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697070-dfe4-459f-8a05-27e6e7d39e8b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.209302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697070-dfe4-459f-8a05-27e6e7d39e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.209302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f697070-dfe4-459f-8a05-27e6e7d39e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.210776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f697070-dfe4-459f-8a05-27e6e7d39e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.214103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f697070-dfe4-459f-8a05-27e6e7d39e8b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.243695 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1157/2327] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:37 2021] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:37.244801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95830d07-a0b1-4b81-9926-ea4bdc31dfd8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.258657 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1171/2328] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:37 2021] POST /identity/v3/projects => generated 409 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:37.268986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f697070-dfe4-459f-8a05-27e6e7d39e8b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.361251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95830d07-a0b1-4b81-9926-ea4bdc31dfd8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.379591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f697070-dfe4-459f-8a05-27e6e7d39e8b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.390408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae8a2-cab5-443d-9d64-fc4cb61f3eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.391097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae8a2-cab5-443d-9d64-fc4cb61f3eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.391418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae8a2-cab5-443d-9d64-fc4cb61f3eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.392085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae8a2-cab5-443d-9d64-fc4cb61f3eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.392822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ae8a2-cab5-443d-9d64-fc4cb61f3eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.395436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ae8a2-cab5-443d-9d64-fc4cb61f3eb6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.437070 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1172/2329] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:37 2021] POST /identity/v3/users => generated 305 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:37.440559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae8a2-cab5-443d-9d64-fc4cb61f3eb6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.462410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae8a2-cab5-443d-9d64-fc4cb61f3eb6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.469608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79a83f-5c6e-4f3d-8d0d-8c733b2ad5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.471087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79a83f-5c6e-4f3d-8d0d-8c733b2ad5db admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.471541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79a83f-5c6e-4f3d-8d0d-8c733b2ad5db admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.475755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79a83f-5c6e-4f3d-8d0d-8c733b2ad5db admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.476643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79a83f-5c6e-4f3d-8d0d-8c733b2ad5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.478406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79a83f-5c6e-4f3d-8d0d-8c733b2ad5db admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.481005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab904a-9543-4ba5-8b91-e6f6a9520cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.482084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab904a-9543-4ba5-8b91-e6f6a9520cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.482375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab904a-9543-4ba5-8b91-e6f6a9520cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.489994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab904a-9543-4ba5-8b91-e6f6a9520cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.491029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab904a-9543-4ba5-8b91-e6f6a9520cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.493873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab904a-9543-4ba5-8b91-e6f6a9520cd0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.515054 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1173/2330] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:37 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:46:37.518970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79a83f-5c6e-4f3d-8d0d-8c733b2ad5db admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.544937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79a83f-5c6e-4f3d-8d0d-8c733b2ad5db admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.546470 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1158/2331] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:37 2021] POST /identity/v3/users => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:37.550298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab904a-9543-4ba5-8b91-e6f6a9520cd0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.561069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcee603-d892-40ae-8d9d-2e361f51b64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.561811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcee603-d892-40ae-8d9d-2e361f51b64b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.562095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcee603-d892-40ae-8d9d-2e361f51b64b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.562367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcee603-d892-40ae-8d9d-2e361f51b64b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.563108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcee603-d892-40ae-8d9d-2e361f51b64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.568249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcee603-d892-40ae-8d9d-2e361f51b64b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.570252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab904a-9543-4ba5-8b91-e6f6a9520cd0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.583165 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1174/2332] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:37 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:37.587731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcee603-d892-40ae-8d9d-2e361f51b64b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.603623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26525bd8-e7ea-4411-a848-1be44508fe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.604487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26525bd8-e7ea-4411-a848-1be44508fe26 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.604785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26525bd8-e7ea-4411-a848-1be44508fe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.605070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26525bd8-e7ea-4411-a848-1be44508fe26 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.605833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26525bd8-e7ea-4411-a848-1be44508fe26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.607483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26525bd8-e7ea-4411-a848-1be44508fe26 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.618415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcee603-d892-40ae-8d9d-2e361f51b64b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.626031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d6521-e460-4553-a6d8-2a62108f1db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.627724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d6521-e460-4553-a6d8-2a62108f1db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.628893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d6521-e460-4553-a6d8-2a62108f1db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.629281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d6521-e460-4553-a6d8-2a62108f1db3 admin admin] PATH_INFO: `/v3/projects/d1d3787c7e8440b59ed83b4791025546/users/d1761841a6264d6fb141c30558642673/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.645082 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1159/2333] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:37 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:46:37.650400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26525bd8-e7ea-4411-a848-1be44508fe26 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.652685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d6521-e460-4553-a6d8-2a62108f1db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d3787c7e8440b59ed83b4791025546, user_id=d1761841a6264d6fb141c30558642673, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.657475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d6521-e460-4553-a6d8-2a62108f1db3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.668632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26525bd8-e7ea-4411-a848-1be44508fe26 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.687518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7765da-009a-49d0-baec-63b02ee580f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.688363 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1175/2334] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:37 2021] PUT /identity/v3/projects/d1d3787c7e8440b59ed83b4791025546/users/d1761841a6264d6fb141c30558642673/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:37.689222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7765da-009a-49d0-baec-63b02ee580f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.690260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7765da-009a-49d0-baec-63b02ee580f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.690643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7765da-009a-49d0-baec-63b02ee580f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.691551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7765da-009a-49d0-baec-63b02ee580f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.694037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7765da-009a-49d0-baec-63b02ee580f6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.700938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05704bed-5d70-4a55-a4d6-c295263bac92 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.701226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05704bed-5d70-4a55-a4d6-c295263bac92 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.701897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05704bed-5d70-4a55-a4d6-c295263bac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.731972 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1160/2335] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:37 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:37.738087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7765da-009a-49d0-baec-63b02ee580f6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.760345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7765da-009a-49d0-baec-63b02ee580f6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.763305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-05704bed-5d70-4a55-a4d6-c295263bac92 None None] MFA Rules not processed for user `d1761841a6264d6fb141c30558642673`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:37.764542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-05704bed-5d70-4a55-a4d6-c295263bac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:37.873578 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1176/2336] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:37 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:37.874501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7748da-73b9-4080-a795-1bed78968342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.875468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7748da-73b9-4080-a795-1bed78968342 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.877848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05704bed-5d70-4a55-a4d6-c295263bac92 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:37.879810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7748da-73b9-4080-a795-1bed78968342 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.880106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7748da-73b9-4080-a795-1bed78968342 admin admin] PATH_INFO: `/v3/projects/c9cfdf5632874b5d9e4fe5a6d6bc2e20/users/814712598f734cb596b8b6fcac38f321/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.909753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7748da-73b9-4080-a795-1bed78968342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9cfdf5632874b5d9e4fe5a6d6bc2e20, user_id=814712598f734cb596b8b6fcac38f321, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.914487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7748da-73b9-4080-a795-1bed78968342 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.923507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05704bed-5d70-4a55-a4d6-c295263bac92 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:37.942886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433aac-19c1-4529-a71a-d7405dd9dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:37.944895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433aac-19c1-4529-a71a-d7405dd9dc10 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.945202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433aac-19c1-4529-a71a-d7405dd9dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.945545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433aac-19c1-4529-a71a-d7405dd9dc10 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:37.946317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86433aac-19c1-4529-a71a-d7405dd9dc10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:37.948382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86433aac-19c1-4529-a71a-d7405dd9dc10 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:37.957283 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1161/2337] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:37 2021] PUT /identity/v3/projects/c9cfdf5632874b5d9e4fe5a6d6bc2e20/users/814712598f734cb596b8b6fcac38f321/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:37.971221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931a056-60b9-411b-8dbd-beb273c15f55 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:37.971697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931a056-60b9-411b-8dbd-beb273c15f55 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:37.972076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931a056-60b9-411b-8dbd-beb273c15f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:38.018589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c931a056-60b9-411b-8dbd-beb273c15f55 None None] MFA Rules not processed for user `814712598f734cb596b8b6fcac38f321`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:38.020542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c931a056-60b9-411b-8dbd-beb273c15f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:38.024323 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1177/2338] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:37 2021] POST /identity/v3/projects => generated 407 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:38.027769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433aac-19c1-4529-a71a-d7405dd9dc10 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:38.140456 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1162/2339] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:38.144814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931a056-60b9-411b-8dbd-beb273c15f55 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:38.154064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433aac-19c1-4529-a71a-d7405dd9dc10 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:38.161739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e2d11-d5cb-4cae-bb91-80bdcc754d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:38.162116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e2d11-d5cb-4cae-bb91-80bdcc754d55 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:38.162508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e2d11-d5cb-4cae-bb91-80bdcc754d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:38.162889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e2d11-d5cb-4cae-bb91-80bdcc754d55 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:38.163792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e2d11-d5cb-4cae-bb91-80bdcc754d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:38.166503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e2d11-d5cb-4cae-bb91-80bdcc754d55 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:38.167108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931a056-60b9-411b-8dbd-beb273c15f55 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:38.185082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de400061-ff24-4312-b8c4-e5482585df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:38.186377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400061-ff24-4312-b8c4-e5482585df90 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:38.188816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400061-ff24-4312-b8c4-e5482585df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:38.189292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de400061-ff24-4312-b8c4-e5482585df90 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:38.190383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de400061-ff24-4312-b8c4-e5482585df90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:38.193001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de400061-ff24-4312-b8c4-e5482585df90 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:38.203174 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1178/2340] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:38 2021] POST /identity/v3/users => generated 310 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:38.205901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e2d11-d5cb-4cae-bb91-80bdcc754d55 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:38.223463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e2d11-d5cb-4cae-bb91-80bdcc754d55 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:38.234283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06947d79-72c7-4ec7-891f-1c8b8839b242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:38.243464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947d79-72c7-4ec7-891f-1c8b8839b242 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:38.243777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947d79-72c7-4ec7-891f-1c8b8839b242 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:38.244067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947d79-72c7-4ec7-891f-1c8b8839b242 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:38.245009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06947d79-72c7-4ec7-891f-1c8b8839b242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:38.247699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06947d79-72c7-4ec7-891f-1c8b8839b242 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:38.267102 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1179/2341] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:38 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:38.267102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06947d79-72c7-4ec7-891f-1c8b8839b242 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:38.268619 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1163/2342] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:38 2021] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:38.269688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de400061-ff24-4312-b8c4-e5482585df90 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:38.290865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06947d79-72c7-4ec7-891f-1c8b8839b242 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:38.417738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563d61e-795c-4819-9f5d-2494290a67c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:38.418791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d61e-795c-4819-9f5d-2494290a67c3 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:38.420183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d61e-795c-4819-9f5d-2494290a67c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:38.421045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d61e-795c-4819-9f5d-2494290a67c3 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:38.422197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563d61e-795c-4819-9f5d-2494290a67c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:38.430676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de400061-ff24-4312-b8c4-e5482585df90 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:38.439041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563d61e-795c-4819-9f5d-2494290a67c3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:38.444012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc64939-bfd6-4d96-b474-b14d85a0318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:38.445556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64939-bfd6-4d96-b474-b14d85a0318f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:38.445841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64939-bfd6-4d96-b474-b14d85a0318f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:38.446117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64939-bfd6-4d96-b474-b14d85a0318f admin admin] PATH_INFO: `/v3/projects/a69b853f602a432f89a872408b02f835/users/b55634e2eb824f7ab608cd0410d6d266/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:38.477187 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1180/2343] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:38 2021] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:38.478846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563d61e-795c-4819-9f5d-2494290a67c3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:38.483412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc64939-bfd6-4d96-b474-b14d85a0318f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69b853f602a432f89a872408b02f835, user_id=b55634e2eb824f7ab608cd0410d6d266, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:38.486523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc64939-bfd6-4d96-b474-b14d85a0318f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:38.496610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563d61e-795c-4819-9f5d-2494290a67c3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:38.505064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847ee72-6851-42a1-b1de-8c13c3914661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:38.505920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ee72-6851-42a1-b1de-8c13c3914661 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:38.506208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ee72-6851-42a1-b1de-8c13c3914661 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:38.506539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ee72-6851-42a1-b1de-8c13c3914661 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:38.508124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847ee72-6851-42a1-b1de-8c13c3914661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:38.509857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847ee72-6851-42a1-b1de-8c13c3914661 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:38.515636 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1164/2344] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:38 2021] PUT /identity/v3/projects/a69b853f602a432f89a872408b02f835/users/b55634e2eb824f7ab608cd0410d6d266/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:38.520189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc64939-bfd6-4d96-b474-b14d85a0318f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:38.527298 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1181/2345] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:38 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:38.530236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847ee72-6851-42a1-b1de-8c13c3914661 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:38.566254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847ee72-6851-42a1-b1de-8c13c3914661 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:38.676847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc64939-bfd6-4d96-b474-b14d85a0318f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:38.682738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca970c4-edee-45fe-b627-85814a132a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:38.683834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca970c4-edee-45fe-b627-85814a132a50 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:38.684280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca970c4-edee-45fe-b627-85814a132a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:38.684723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca970c4-edee-45fe-b627-85814a132a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:38.685631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca970c4-edee-45fe-b627-85814a132a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:38.687313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca970c4-edee-45fe-b627-85814a132a50 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:38.704576 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1165/2346] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:38 2021] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:38.704576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca970c4-edee-45fe-b627-85814a132a50 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:38.708239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ede8f-472d-478a-a11e-cc64311d754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:38.708408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3ca970c4-edee-45fe-b627-85814a132a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:38.709221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ede8f-472d-478a-a11e-cc64311d754b admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:38.709502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ede8f-472d-478a-a11e-cc64311d754b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:38.709781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ede8f-472d-478a-a11e-cc64311d754b admin admin] PATH_INFO: `/v3/projects/cdf4d721f5cf42b497cd5bb55a5242d8/users/eab71c0353ca4f9cacbb32b6ef95272f/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:38.749786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ede8f-472d-478a-a11e-cc64311d754b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf4d721f5cf42b497cd5bb55a5242d8, user_id=eab71c0353ca4f9cacbb32b6ef95272f, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:38.756118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ede8f-472d-478a-a11e-cc64311d754b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:38.789508 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1182/2347] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:38 2021] PUT /identity/v3/projects/cdf4d721f5cf42b497cd5bb55a5242d8/users/eab71c0353ca4f9cacbb32b6ef95272f/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:38.790356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ede8f-472d-478a-a11e-cc64311d754b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:38.889964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca970c4-edee-45fe-b627-85814a132a50 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:38.957466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ede8f-472d-478a-a11e-cc64311d754b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:38.981528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a44c85-72b8-4e7e-a5be-43fa9a781203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:38.982448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44c85-72b8-4e7e-a5be-43fa9a781203 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:38.982741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44c85-72b8-4e7e-a5be-43fa9a781203 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:38.983012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a44c85-72b8-4e7e-a5be-43fa9a781203 admin admin] PATH_INFO: `/v3/projects/a69b853f602a432f89a872408b02f835/users/b55634e2eb824f7ab608cd0410d6d266/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:38.993978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a44c85-72b8-4e7e-a5be-43fa9a781203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69b853f602a432f89a872408b02f835, user_id=b55634e2eb824f7ab608cd0410d6d266, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:39.004712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a44c85-72b8-4e7e-a5be-43fa9a781203 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:39.028957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4b1d8-dbbf-4a88-a494-14ce82525265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:39.029791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4b1d8-dbbf-4a88-a494-14ce82525265 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:39.030189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4b1d8-dbbf-4a88-a494-14ce82525265 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:39.030576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4b1d8-dbbf-4a88-a494-14ce82525265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:39.031826 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1183/2348] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:38 2021] PUT /identity/v3/projects/a69b853f602a432f89a872408b02f835/users/b55634e2eb824f7ab608cd0410d6d266/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:39.033908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a44c85-72b8-4e7e-a5be-43fa9a781203 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:39.043088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c3a4b1d8-dbbf-4a88-a494-14ce82525265 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:39.144153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a44c85-72b8-4e7e-a5be-43fa9a781203 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:39.153000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59741d65-f671-4fbb-8bef-5b59aa44e769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:39.155153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59741d65-f671-4fbb-8bef-5b59aa44e769 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:39.168767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59741d65-f671-4fbb-8bef-5b59aa44e769 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:39.169156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59741d65-f671-4fbb-8bef-5b59aa44e769 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:39.169941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59741d65-f671-4fbb-8bef-5b59aa44e769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:39.175366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59741d65-f671-4fbb-8bef-5b59aa44e769 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:39.200204 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1184/2349] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:39 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:39.202501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b0ae7-a3b2-4c40-b572-79d4d39d4ea9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:39.202697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b0ae7-a3b2-4c40-b572-79d4d39d4ea9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:39.202935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b0ae7-a3b2-4c40-b572-79d4d39d4ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:39.211711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4b1d8-dbbf-4a88-a494-14ce82525265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:39.215024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4b1d8-dbbf-4a88-a494-14ce82525265 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:39.240932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1166/2350] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:38 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:39.242372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4b1d8-dbbf-4a88-a494-14ce82525265 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:39.268350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4b1d8-dbbf-4a88-a494-14ce82525265 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:39.270466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4a8b0ae7-a3b2-4c40-b572-79d4d39d4ea9 None None] MFA Rules not processed for user `b55634e2eb824f7ab608cd0410d6d266`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:39.271736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4a8b0ae7-a3b2-4c40-b572-79d4d39d4ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:39.279984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9c4cc-fcb7-4ff8-a921-588bf7b7ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:39.280899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c4cc-fcb7-4ff8-a921-588bf7b7ab1f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:39.281337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c4cc-fcb7-4ff8-a921-588bf7b7ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:39.281625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c4cc-fcb7-4ff8-a921-588bf7b7ab1f admin admin] PATH_INFO: `/v3/projects/cdf4d721f5cf42b497cd5bb55a5242d8/users/eab71c0353ca4f9cacbb32b6ef95272f/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:39.285533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9c4cc-fcb7-4ff8-a921-588bf7b7ab1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf4d721f5cf42b497cd5bb55a5242d8, user_id=eab71c0353ca4f9cacbb32b6ef95272f, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:39.291894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9c4cc-fcb7-4ff8-a921-588bf7b7ab1f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:39.318151 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1167/2351] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:39 2021] PUT /identity/v3/projects/cdf4d721f5cf42b497cd5bb55a5242d8/users/eab71c0353ca4f9cacbb32b6ef95272f/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:39.329266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ef1ab-4e2d-4b46-abcd-1b9df8d14476 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:39.329561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ef1ab-4e2d-4b46-abcd-1b9df8d14476 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:39.329845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ef1ab-4e2d-4b46-abcd-1b9df8d14476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:39.391032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ac3ef1ab-4e2d-4b46-abcd-1b9df8d14476 None None] MFA Rules not processed for user `9322591436e34060a46c6f145dca61d7`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:39.392293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ac3ef1ab-4e2d-4b46-abcd-1b9df8d14476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:39.451653 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1185/2352] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:39 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:39.453168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6372da9-f44b-4ba0-ae44-18c30db93825 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:39.453503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6372da9-f44b-4ba0-ae44-18c30db93825 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:39.453823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6372da9-f44b-4ba0-ae44-18c30db93825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:39.511502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e6372da9-f44b-4ba0-ae44-18c30db93825 None None] MFA Rules not processed for user `eab71c0353ca4f9cacbb32b6ef95272f`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:39.513361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e6372da9-f44b-4ba0-ae44-18c30db93825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:39.560263 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1168/2353] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:39 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:39.560768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ef1ab-4e2d-4b46-abcd-1b9df8d14476 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:39.569941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ac3ef1ab-4e2d-4b46-abcd-1b9df8d14476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:39.633230 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1186/2354] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:39 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:39.634950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a355a-8038-4ba4-a128-3374407d5472 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:39.635424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a355a-8038-4ba4-a128-3374407d5472 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:39.635849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a355a-8038-4ba4-a128-3374407d5472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:39.661325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a88a355a-8038-4ba4-a128-3374407d5472 None None] MFA Rules not processed for user `9322591436e34060a46c6f145dca61d7`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:39.663652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a88a355a-8038-4ba4-a128-3374407d5472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:39.676050 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1187/2355] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:39 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:39.733858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ef1ab-4e2d-4b46-abcd-1b9df8d14476 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:39.740678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ce712-9137-4275-9f3f-b430e768ba07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:39.742405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce712-9137-4275-9f3f-b430e768ba07 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:39.742720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce712-9137-4275-9f3f-b430e768ba07 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:39.742993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce712-9137-4275-9f3f-b430e768ba07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:39.856751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ce712-9137-4275-9f3f-b430e768ba07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:39.858366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ce712-9137-4275-9f3f-b430e768ba07 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:39.889146 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1169/2356] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:39 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:40.126396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a355a-8038-4ba4-a128-3374407d5472 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:40.142583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a355a-8038-4ba4-a128-3374407d5472 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:40.149348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485048e-f566-4757-bc47-a4a87401d476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:40.149957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485048e-f566-4757-bc47-a4a87401d476 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:40.150352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485048e-f566-4757-bc47-a4a87401d476 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:40.150700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485048e-f566-4757-bc47-a4a87401d476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:40.160168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485048e-f566-4757-bc47-a4a87401d476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:40.162298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485048e-f566-4757-bc47-a4a87401d476 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:40.184847 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1188/2357] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:40 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:40.467773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ce712-9137-4275-9f3f-b430e768ba07 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:40.481416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ce712-9137-4275-9f3f-b430e768ba07 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:40.488354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca7391-532f-48c1-bbb1-882ed4bb896c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:40.489242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca7391-532f-48c1-bbb1-882ed4bb896c service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:40.489706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca7391-532f-48c1-bbb1-882ed4bb896c service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:40.490129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca7391-532f-48c1-bbb1-882ed4bb896c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:40.500023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca7391-532f-48c1-bbb1-882ed4bb896c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:40.501621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca7391-532f-48c1-bbb1-882ed4bb896c service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:40.528553 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1170/2358] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:40 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:40.652643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485048e-f566-4757-bc47-a4a87401d476 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:40.673838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485048e-f566-4757-bc47-a4a87401d476 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:40.686995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e22c6-179e-4f0f-886e-7c3cacbb14f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:40.687698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e22c6-179e-4f0f-886e-7c3cacbb14f6 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:40.687892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e22c6-179e-4f0f-886e-7c3cacbb14f6 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:40.688153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e22c6-179e-4f0f-886e-7c3cacbb14f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:40.791272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e22c6-179e-4f0f-886e-7c3cacbb14f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:40.792922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e22c6-179e-4f0f-886e-7c3cacbb14f6 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:40.813627 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1189/2359] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:40 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:42.623366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca7391-532f-48c1-bbb1-882ed4bb896c service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:42.841027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca7391-532f-48c1-bbb1-882ed4bb896c service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:42.858314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:42.859443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:42.859740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:42.860021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] PATH_INFO: `/v3/users/d1761841a6264d6fb141c30558642673` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:42.861346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1761841a6264d6fb141c30558642673)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:42.872898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:42.989431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1761841a6264d6fb141c30558642673'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:43.008998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1761841a6264d6fb141c30558642673'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:43.009907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1761841a6264d6fb141c30558642673'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:43.027551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1761841a6264d6fb141c30558642673'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:43.060762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1761841a6264d6fb141c30558642673'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:43.077710 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1171/2360] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:42 2021] DELETE /identity/v3/users/d1761841a6264d6fb141c30558642673 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:43.082496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf421e5-b297-46e8-af54-22e86ece41c3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:43.083349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf421e5-b297-46e8-af54-22e86ece41c3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:43.083775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf421e5-b297-46e8-af54-22e86ece41c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:43.115417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2bf421e5-b297-46e8-af54-22e86ece41c3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:43.129985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2bf421e5-b297-46e8-af54-22e86ece41c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:43.310476 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1190/2361] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:43.339098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:43.340622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:43.537165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b760e8-b14c-4aa4-836b-5c377c033a69 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:43.542514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324d2f0-3957-48f5-925e-7e5387fbe919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:43.543506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324d2f0-3957-48f5-925e-7e5387fbe919 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:43.543978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324d2f0-3957-48f5-925e-7e5387fbe919 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:43.544435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324d2f0-3957-48f5-925e-7e5387fbe919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:43.556336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324d2f0-3957-48f5-925e-7e5387fbe919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:43.558118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324d2f0-3957-48f5-925e-7e5387fbe919 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:43.570698 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1172/2362] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:44.324979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf421e5-b297-46e8-af54-22e86ece41c3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:44.332202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2bf421e5-b297-46e8-af54-22e86ece41c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:44.373180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf421e5-b297-46e8-af54-22e86ece41c3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:44.396938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:44.398369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:44.398649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:44.398919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] PATH_INFO: `/v3/projects/d1d3787c7e8440b59ed83b4791025546` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:44.404078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d3787c7e8440b59ed83b4791025546)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:44.406029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:44.526463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d3787c7e8440b59ed83b4791025546', 'request_id': 'req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:44.539224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d3787c7e8440b59ed83b4791025546', 'request_id': 'req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:44.551454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d3787c7e8440b59ed83b4791025546', 'request_id': 'req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:44.567727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] The token cache is being invalidate because project d1d3787c7e8440b59ed83b4791025546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:44.568340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:44.569821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:44.572363 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1191/2363] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:44 2021] DELETE /identity/v3/projects/d1d3787c7e8440b59ed83b4791025546 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:44.576529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324d2f0-3957-48f5-925e-7e5387fbe919 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:44.591169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324d2f0-3957-48f5-925e-7e5387fbe919 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:44.699752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bfd12-e7b0-4513-b825-3255f686c590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:44.704146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bfd12-e7b0-4513-b825-3255f686c590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:44.704631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bfd12-e7b0-4513-b825-3255f686c590 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:44.705088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bfd12-e7b0-4513-b825-3255f686c590 admin admin] PATH_INFO: `/v3/users/b55634e2eb824f7ab608cd0410d6d266` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:44.706912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bfd12-e7b0-4513-b825-3255f686c590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b55634e2eb824f7ab608cd0410d6d266)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:44.710155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bfd12-e7b0-4513-b825-3255f686c590 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:44.850967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-276bfd12-e7b0-4513-b825-3255f686c590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b55634e2eb824f7ab608cd0410d6d266'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:44.864377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-276bfd12-e7b0-4513-b825-3255f686c590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b55634e2eb824f7ab608cd0410d6d266'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:44.865075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-276bfd12-e7b0-4513-b825-3255f686c590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b55634e2eb824f7ab608cd0410d6d266'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:44.920391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-276bfd12-e7b0-4513-b825-3255f686c590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b55634e2eb824f7ab608cd0410d6d266'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:44.966766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-276bfd12-e7b0-4513-b825-3255f686c590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b55634e2eb824f7ab608cd0410d6d266'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:44.984902 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1173/2364] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:44 2021] DELETE /identity/v3/users/b55634e2eb824f7ab608cd0410d6d266 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:45.582676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:45.591449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:45.618210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c8acb-96ea-45f0-8b5e-5f559cce48a6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:45.808334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:45.809295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:45.809654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:45.810069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] PATH_INFO: `/v3/projects/a69b853f602a432f89a872408b02f835` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:45.811878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69b853f602a432f89a872408b02f835)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:45.822675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:45.965063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69b853f602a432f89a872408b02f835', 'request_id': 'req-86610d25-060d-4666-bfb1-237206b76d73'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:45.974796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69b853f602a432f89a872408b02f835', 'request_id': 'req-86610d25-060d-4666-bfb1-237206b76d73'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:45.993526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69b853f602a432f89a872408b02f835', 'request_id': 'req-86610d25-060d-4666-bfb1-237206b76d73'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:46.038235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] The token cache is being invalidate because project a69b853f602a432f89a872408b02f835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:46.038810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:46.039829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86610d25-060d-4666-bfb1-237206b76d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:46.042692 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1192/2365] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:45 2021] DELETE /identity/v3/projects/a69b853f602a432f89a872408b02f835 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:46.049507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547f660-028e-4d1a-92c0-86048f174995 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:46.051347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547f660-028e-4d1a-92c0-86048f174995 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:46.051718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547f660-028e-4d1a-92c0-86048f174995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:46.076467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6547f660-028e-4d1a-92c0-86048f174995 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:46.077691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6547f660-028e-4d1a-92c0-86048f174995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:46.186900 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1174/2366] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:46.188417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7556-72a7-4e31-b451-0d588acecc94 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:46.188837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7556-72a7-4e31-b451-0d588acecc94 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:46.189196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f7556-72a7-4e31-b451-0d588acecc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:46.220272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fb3f7556-72a7-4e31-b451-0d588acecc94 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:46.224792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fb3f7556-72a7-4e31-b451-0d588acecc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:46.263165 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1193/2367] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:46.265093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547f660-028e-4d1a-92c0-86048f174995 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:46.277279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547f660-028e-4d1a-92c0-86048f174995 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:46.284151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967f0c3-9d0e-4e10-a489-4ef899e03436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:46.285097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967f0c3-9d0e-4e10-a489-4ef899e03436 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:46.285585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967f0c3-9d0e-4e10-a489-4ef899e03436 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:46.286142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967f0c3-9d0e-4e10-a489-4ef899e03436 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:46.287359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967f0c3-9d0e-4e10-a489-4ef899e03436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:46.289026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967f0c3-9d0e-4e10-a489-4ef899e03436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:46.304870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967f0c3-9d0e-4e10-a489-4ef899e03436 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:46.353817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f7556-72a7-4e31-b451-0d588acecc94 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:46.364699 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1175/2368] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:46.367522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f7556-72a7-4e31-b451-0d588acecc94 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:46.385381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372169be-fc18-4684-9871-33afda99244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:46.387634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372169be-fc18-4684-9871-33afda99244c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:46.389022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372169be-fc18-4684-9871-33afda99244c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:46.389646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372169be-fc18-4684-9871-33afda99244c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:46.391381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372169be-fc18-4684-9871-33afda99244c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:46.401858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372169be-fc18-4684-9871-33afda99244c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:46.495610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967f0c3-9d0e-4e10-a489-4ef899e03436 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:46.506862 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1194/2369] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:46 2021] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:46:46.509873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967f0c3-9d0e-4e10-a489-4ef899e03436 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:46.636168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8db54-2b4f-46d7-a7e3-33ff9fd90f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:46.637626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8db54-2b4f-46d7-a7e3-33ff9fd90f60 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:46.638129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8db54-2b4f-46d7-a7e3-33ff9fd90f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:46.638551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8db54-2b4f-46d7-a7e3-33ff9fd90f60 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:46.642911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8db54-2b4f-46d7-a7e3-33ff9fd90f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:46.648037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8db54-2b4f-46d7-a7e3-33ff9fd90f60 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:46.705878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372169be-fc18-4684-9871-33afda99244c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:46.717665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372169be-fc18-4684-9871-33afda99244c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:46.720491 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1176/2370] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:46 2021] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:46.732461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5292b-cd66-4b52-bdef-4bb030057483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:46.733153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5292b-cd66-4b52-bdef-4bb030057483 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:46.733436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5292b-cd66-4b52-bdef-4bb030057483 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:46.733706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5292b-cd66-4b52-bdef-4bb030057483 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:46.757104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5292b-cd66-4b52-bdef-4bb030057483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:46.763119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5292b-cd66-4b52-bdef-4bb030057483 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:46.806228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8db54-2b4f-46d7-a7e3-33ff9fd90f60 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:46.812999 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1195/2371] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:46 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:46:46.821734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8db54-2b4f-46d7-a7e3-33ff9fd90f60 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:46.838939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d499c44-5a90-4349-a431-11396bdbc254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:46.849773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d499c44-5a90-4349-a431-11396bdbc254 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:46.850109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d499c44-5a90-4349-a431-11396bdbc254 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:46.850398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d499c44-5a90-4349-a431-11396bdbc254 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:46.851278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d499c44-5a90-4349-a431-11396bdbc254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:46.853195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d499c44-5a90-4349-a431-11396bdbc254 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:46.869688 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1177/2372] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:46 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:46.873703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5292b-cd66-4b52-bdef-4bb030057483 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:46.910743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5292b-cd66-4b52-bdef-4bb030057483 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:46.918629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e232ec-5d0e-44ae-955c-8bc1ceb0334d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:46.920649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e232ec-5d0e-44ae-955c-8bc1ceb0334d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:46.921239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e232ec-5d0e-44ae-955c-8bc1ceb0334d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:46.921719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e232ec-5d0e-44ae-955c-8bc1ceb0334d admin admin] PATH_INFO: `/v3/projects/149906b8a2744176929b4d314a0de57d/users/1d46c71936aa4118aa36a9e95b95c4f5/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:46.956931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e232ec-5d0e-44ae-955c-8bc1ceb0334d admin admin] RBAC: Authorizing `identity:create_grant(project_id=149906b8a2744176929b4d314a0de57d, user_id=1d46c71936aa4118aa36a9e95b95c4f5, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:46.966957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e232ec-5d0e-44ae-955c-8bc1ceb0334d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:47.003738 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1196/2373] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:46 2021] PUT /identity/v3/projects/149906b8a2744176929b4d314a0de57d/users/1d46c71936aa4118aa36a9e95b95c4f5/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:47.010465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271eb8e-986e-4cb6-a703-64f1f3fc6c8e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:47.010765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271eb8e-986e-4cb6-a703-64f1f3fc6c8e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:47.011044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271eb8e-986e-4cb6-a703-64f1f3fc6c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:47.060463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5271eb8e-986e-4cb6-a703-64f1f3fc6c8e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:47.061692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5271eb8e-986e-4cb6-a703-64f1f3fc6c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:47.108399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e232ec-5d0e-44ae-955c-8bc1ceb0334d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:47.111195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-44e232ec-5d0e-44ae-955c-8bc1ceb0334d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:47.183594 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1178/2374] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:47.196835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271eb8e-986e-4cb6-a703-64f1f3fc6c8e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:47.198257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5271eb8e-986e-4cb6-a703-64f1f3fc6c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:47.283370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e232ec-5d0e-44ae-955c-8bc1ceb0334d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:47.291053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca612f8-525b-4c4e-a0c6-a35b32002c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:47.291910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca612f8-525b-4c4e-a0c6-a35b32002c57 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:47.292223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca612f8-525b-4c4e-a0c6-a35b32002c57 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:47.292524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca612f8-525b-4c4e-a0c6-a35b32002c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:47.296447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eca612f8-525b-4c4e-a0c6-a35b32002c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:47.324434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271eb8e-986e-4cb6-a703-64f1f3fc6c8e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:47.328635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c0a8e-8c16-48ad-9cd1-b4bb5108fdf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:47.329286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c0a8e-8c16-48ad-9cd1-b4bb5108fdf6 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:47.329882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c0a8e-8c16-48ad-9cd1-b4bb5108fdf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:47.330574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c0a8e-8c16-48ad-9cd1-b4bb5108fdf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:47.343039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c0a8e-8c16-48ad-9cd1-b4bb5108fdf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:47.344977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c0a8e-8c16-48ad-9cd1-b4bb5108fdf6 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:47.362781 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1179/2375] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:47.406652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca612f8-525b-4c4e-a0c6-a35b32002c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:47.410835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca612f8-525b-4c4e-a0c6-a35b32002c57 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:47.449370 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1197/2376] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:47 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:48.411947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67802c-5cf1-4fee-ba6a-f350b9c33ee2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:48.413301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67802c-5cf1-4fee-ba6a-f350b9c33ee2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:48.413728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67802c-5cf1-4fee-ba6a-f350b9c33ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:48.484072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ab67802c-5cf1-4fee-ba6a-f350b9c33ee2 None None] MFA Rules not processed for user `5af01920574741f381a5dfefd9282bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:48.490212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ab67802c-5cf1-4fee-ba6a-f350b9c33ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:48.625587 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1180/2377] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:48 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:48.630424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca612f8-525b-4c4e-a0c6-a35b32002c57 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:48.632477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eca612f8-525b-4c4e-a0c6-a35b32002c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:48.666587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca612f8-525b-4c4e-a0c6-a35b32002c57 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:48.682500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc91da-95f0-4909-a89f-bede23f3050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:48.683685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc91da-95f0-4909-a89f-bede23f3050c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:48.684122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc91da-95f0-4909-a89f-bede23f3050c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:48.684677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc91da-95f0-4909-a89f-bede23f3050c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:48.685787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc91da-95f0-4909-a89f-bede23f3050c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:48.702411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc91da-95f0-4909-a89f-bede23f3050c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:48.764768 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1198/2378] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:48 2021] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:48.766481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67802c-5cf1-4fee-ba6a-f350b9c33ee2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:48.786398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67802c-5cf1-4fee-ba6a-f350b9c33ee2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:48.958912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ff24-f648-45d3-800c-3174c238721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:48.961540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ff24-f648-45d3-800c-3174c238721f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:48.962600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ff24-f648-45d3-800c-3174c238721f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:48.963750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818ff24-f648-45d3-800c-3174c238721f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:48.964874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ff24-f648-45d3-800c-3174c238721f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:48.967860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818ff24-f648-45d3-800c-3174c238721f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:49.005179 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1181/2379] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:48 2021] POST /identity/v3/users => generated 308 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:49.007885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc91da-95f0-4909-a89f-bede23f3050c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:49.029720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc91da-95f0-4909-a89f-bede23f3050c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:49.040860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e827d52-1569-4097-8a4d-de49b241caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:49.043214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e827d52-1569-4097-8a4d-de49b241caae admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:49.043641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e827d52-1569-4097-8a4d-de49b241caae admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:49.044568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e827d52-1569-4097-8a4d-de49b241caae admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:49.047034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e827d52-1569-4097-8a4d-de49b241caae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:49.051224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e827d52-1569-4097-8a4d-de49b241caae admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:49.074160 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1199/2380] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:49 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:49.079979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ff24-f648-45d3-800c-3174c238721f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:49.096089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818ff24-f648-45d3-800c-3174c238721f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:49.104689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1ffc1-0c65-437d-9a92-241499ede498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:49.106026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1ffc1-0c65-437d-9a92-241499ede498 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:49.106373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1ffc1-0c65-437d-9a92-241499ede498 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:49.106657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1ffc1-0c65-437d-9a92-241499ede498 admin admin] PATH_INFO: `/v3/projects/67445244452542a2862ec7dc1cf17784/users/63bc0e675c9044e3bda2cd5dadd4fb15/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:49.127384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1ffc1-0c65-437d-9a92-241499ede498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67445244452542a2862ec7dc1cf17784, user_id=63bc0e675c9044e3bda2cd5dadd4fb15, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:49.130232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1ffc1-0c65-437d-9a92-241499ede498 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:49.155393 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1182/2381] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:49 2021] PUT /identity/v3/projects/67445244452542a2862ec7dc1cf17784/users/63bc0e675c9044e3bda2cd5dadd4fb15/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:49.158547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e827d52-1569-4097-8a4d-de49b241caae admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:49.170581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e827d52-1569-4097-8a4d-de49b241caae admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:49.249092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165bcff-770d-4e9a-a621-3f27180a51aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:49.249891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165bcff-770d-4e9a-a621-3f27180a51aa admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:49.250178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165bcff-770d-4e9a-a621-3f27180a51aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:49.250581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165bcff-770d-4e9a-a621-3f27180a51aa admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:49.251744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165bcff-770d-4e9a-a621-3f27180a51aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:49.254437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165bcff-770d-4e9a-a621-3f27180a51aa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:49.269842 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1200/2382] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:49 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:49.275018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1ffc1-0c65-437d-9a92-241499ede498 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:49.307553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1ffc1-0c65-437d-9a92-241499ede498 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:49.323657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150a80a-31f2-4437-ba0f-cddc6dfe59f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:49.325135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150a80a-31f2-4437-ba0f-cddc6dfe59f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:49.325418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150a80a-31f2-4437-ba0f-cddc6dfe59f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:49.325694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150a80a-31f2-4437-ba0f-cddc6dfe59f8 admin admin] PATH_INFO: `/v3/projects/67445244452542a2862ec7dc1cf17784/users/63bc0e675c9044e3bda2cd5dadd4fb15/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:49.332601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150a80a-31f2-4437-ba0f-cddc6dfe59f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67445244452542a2862ec7dc1cf17784, user_id=63bc0e675c9044e3bda2cd5dadd4fb15, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:49.334866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325405-a3f4-47dd-bb6e-3a1fd74ab49b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:49.335153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325405-a3f4-47dd-bb6e-3a1fd74ab49b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:49.335456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325405-a3f4-47dd-bb6e-3a1fd74ab49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:49.337586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150a80a-31f2-4437-ba0f-cddc6dfe59f8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:49.373505 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1183/2383] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:49 2021] PUT /identity/v3/projects/67445244452542a2862ec7dc1cf17784/users/63bc0e675c9044e3bda2cd5dadd4fb15/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:49.374945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150a80a-31f2-4437-ba0f-cddc6dfe59f8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:49.381825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c150a80a-31f2-4437-ba0f-cddc6dfe59f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:49.407093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f1325405-a3f4-47dd-bb6e-3a1fd74ab49b None None] MFA Rules not processed for user `1d46c71936aa4118aa36a9e95b95c4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:49.410984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f1325405-a3f4-47dd-bb6e-3a1fd74ab49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:49.564757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150a80a-31f2-4437-ba0f-cddc6dfe59f8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:49.572854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a4b71-2db3-4961-9869-c8fbcad171f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:49.574636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a4b71-2db3-4961-9869-c8fbcad171f0 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:49.575187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a4b71-2db3-4961-9869-c8fbcad171f0 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:49.575657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a4b71-2db3-4961-9869-c8fbcad171f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:49.577681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7f5a4b71-2db3-4961-9869-c8fbcad171f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:49.605835 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1201/2384] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:49 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:49.606782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1325405-a3f4-47dd-bb6e-3a1fd74ab49b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:49.701205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a4b71-2db3-4961-9869-c8fbcad171f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:49.704654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a4b71-2db3-4961-9869-c8fbcad171f0 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:49.732999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1325405-a3f4-47dd-bb6e-3a1fd74ab49b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:49.748890 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1184/2385] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:49 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:49.756742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f20c1-a1ec-4220-aa57-96f5a8c5f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:49.757494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f20c1-a1ec-4220-aa57-96f5a8c5f771 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:49.757979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f20c1-a1ec-4220-aa57-96f5a8c5f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:49.758416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f20c1-a1ec-4220-aa57-96f5a8c5f771 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:49.763208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f20c1-a1ec-4220-aa57-96f5a8c5f771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:49.765357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f20c1-a1ec-4220-aa57-96f5a8c5f771 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:49.823152 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1202/2386] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:49 2021] POST /identity/v3/projects => generated 371 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:49.828210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a4b71-2db3-4961-9869-c8fbcad171f0 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:49.846403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a4b71-2db3-4961-9869-c8fbcad171f0 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:49.938358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128651da-e3fb-4224-95d7-15f210159a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:49.939144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128651da-e3fb-4224-95d7-15f210159a66 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:49.940264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128651da-e3fb-4224-95d7-15f210159a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:49.940550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128651da-e3fb-4224-95d7-15f210159a66 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:49.941634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128651da-e3fb-4224-95d7-15f210159a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:49.945554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128651da-e3fb-4224-95d7-15f210159a66 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:49.974867 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1185/2387] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:49 2021] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:49.979506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f20c1-a1ec-4220-aa57-96f5a8c5f771 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:49.990247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f20c1-a1ec-4220-aa57-96f5a8c5f771 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:49.996275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd07586-d83b-4546-a93e-76af1fab3564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:49.997174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd07586-d83b-4546-a93e-76af1fab3564 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:49.997679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd07586-d83b-4546-a93e-76af1fab3564 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:49.998114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd07586-d83b-4546-a93e-76af1fab3564 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:49.999138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd07586-d83b-4546-a93e-76af1fab3564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:50.001023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd07586-d83b-4546-a93e-76af1fab3564 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:50.013115 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1203/2388] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:49 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:50.017361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128651da-e3fb-4224-95d7-15f210159a66 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:50.028268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128651da-e3fb-4224-95d7-15f210159a66 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:50.033260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddd0ac-fd6c-4199-9fdd-1caae0cc8610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:50.034495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddd0ac-fd6c-4199-9fdd-1caae0cc8610 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:50.034935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddd0ac-fd6c-4199-9fdd-1caae0cc8610 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:50.035425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddd0ac-fd6c-4199-9fdd-1caae0cc8610 admin admin] PATH_INFO: `/v3/projects/493adc593bae4219a753f10cd4ee463a/users/c88b989975ff48cf98de7e6f9ef6667c/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:50.056105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddd0ac-fd6c-4199-9fdd-1caae0cc8610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493adc593bae4219a753f10cd4ee463a, user_id=c88b989975ff48cf98de7e6f9ef6667c, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:50.059307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddd0ac-fd6c-4199-9fdd-1caae0cc8610 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:50.088588 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1186/2389] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:50 2021] PUT /identity/v3/projects/493adc593bae4219a753f10cd4ee463a/users/c88b989975ff48cf98de7e6f9ef6667c/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:50.092941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd07586-d83b-4546-a93e-76af1fab3564 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:50.139525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd07586-d83b-4546-a93e-76af1fab3564 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:50.316694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0958a-92cb-4aac-9f29-712a21d1ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:50.317610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0958a-92cb-4aac-9f29-712a21d1ea00 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:50.319308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0958a-92cb-4aac-9f29-712a21d1ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:50.319308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0958a-92cb-4aac-9f29-712a21d1ea00 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:50.320224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0958a-92cb-4aac-9f29-712a21d1ea00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:50.322193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0958a-92cb-4aac-9f29-712a21d1ea00 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:50.359528 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1204/2390] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:50 2021] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:50.369249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddd0ac-fd6c-4199-9fdd-1caae0cc8610 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:50.394044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddd0ac-fd6c-4199-9fdd-1caae0cc8610 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:50.413800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125ae41-e25a-4b02-ae57-25b47cc7b66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:50.414894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ae41-e25a-4b02-ae57-25b47cc7b66c admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:50.415370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ae41-e25a-4b02-ae57-25b47cc7b66c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:50.415799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ae41-e25a-4b02-ae57-25b47cc7b66c admin admin] PATH_INFO: `/v3/projects/493adc593bae4219a753f10cd4ee463a/users/c88b989975ff48cf98de7e6f9ef6667c/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:50.418842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ae41-e25a-4b02-ae57-25b47cc7b66c admin admin] RBAC: Authorizing `identity:create_grant(project_id=493adc593bae4219a753f10cd4ee463a, user_id=c88b989975ff48cf98de7e6f9ef6667c, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:50.427915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ae41-e25a-4b02-ae57-25b47cc7b66c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:50.454121 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1187/2391] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:50 2021] PUT /identity/v3/projects/493adc593bae4219a753f10cd4ee463a/users/c88b989975ff48cf98de7e6f9ef6667c/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:51.553390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059a81-abbd-49e9-b04b-b7d0831616b0 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:51.554504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059a81-abbd-49e9-b04b-b7d0831616b0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:51.556008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059a81-abbd-49e9-b04b-b7d0831616b0 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:51.560197 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1205/2392] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:46:51 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:46:51.566877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ed39-41fb-41f0-97d6-45fa262ea434 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:51.568214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ed39-41fb-41f0-97d6-45fa262ea434 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:51.568838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ed39-41fb-41f0-97d6-45fa262ea434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:51.593777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-13f8ed39-41fb-41f0-97d6-45fa262ea434 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:51.595713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-13f8ed39-41fb-41f0-97d6-45fa262ea434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:51.712658 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1188/2393] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:46:51 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:51.738219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70059a81-abbd-49e9-b04b-b7d0831616b0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:51.741476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-70059a81-abbd-49e9-b04b-b7d0831616b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:51.764642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70059a81-abbd-49e9-b04b-b7d0831616b0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:51.772941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a9556-24d7-48ea-bfa7-f1639c3a8038 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:51.773965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9556-24d7-48ea-bfa7-f1639c3a8038 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:51.774864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9556-24d7-48ea-bfa7-f1639c3a8038 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:51.775400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9556-24d7-48ea-bfa7-f1639c3a8038 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:51.788166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a9556-24d7-48ea-bfa7-f1639c3a8038 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:51.790295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a9556-24d7-48ea-bfa7-f1639c3a8038 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:51.809988 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1206/2394] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:51 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:52.089064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8ed39-41fb-41f0-97d6-45fa262ea434 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:52.106526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8ed39-41fb-41f0-97d6-45fa262ea434 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:52.124621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36f84c-bca7-4850-abd0-e10beb2c6acc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:52.126717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36f84c-bca7-4850-abd0-e10beb2c6acc service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:52.127573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36f84c-bca7-4850-abd0-e10beb2c6acc service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:52.128853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36f84c-bca7-4850-abd0-e10beb2c6acc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:52.135189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9d36f84c-bca7-4850-abd0-e10beb2c6acc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:52.171715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36f84c-bca7-4850-abd0-e10beb2c6acc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:52.178417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36f84c-bca7-4850-abd0-e10beb2c6acc service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:52.216301 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1189/2395] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:52 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:52.247180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a9556-24d7-48ea-bfa7-f1639c3a8038 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:52.249366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eb2a9556-24d7-48ea-bfa7-f1639c3a8038 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:52.352134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a9556-24d7-48ea-bfa7-f1639c3a8038 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:52.358070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08f982-8aed-4e6b-9cf9-a08f35f8cffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:52.359117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08f982-8aed-4e6b-9cf9-a08f35f8cffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:52.359828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08f982-8aed-4e6b-9cf9-a08f35f8cffd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:52.360708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08f982-8aed-4e6b-9cf9-a08f35f8cffd admin admin] PATH_INFO: `/v3/users/559cab992ce74bd0b78a639e4001c918` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:52.362071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08f982-8aed-4e6b-9cf9-a08f35f8cffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=559cab992ce74bd0b78a639e4001c918)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:52.364574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08f982-8aed-4e6b-9cf9-a08f35f8cffd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:52.483995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d08f982-8aed-4e6b-9cf9-a08f35f8cffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559cab992ce74bd0b78a639e4001c918'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:52.487317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d08f982-8aed-4e6b-9cf9-a08f35f8cffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559cab992ce74bd0b78a639e4001c918'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:52.504666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d08f982-8aed-4e6b-9cf9-a08f35f8cffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559cab992ce74bd0b78a639e4001c918'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:52.505656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d08f982-8aed-4e6b-9cf9-a08f35f8cffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559cab992ce74bd0b78a639e4001c918'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:52.525399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d08f982-8aed-4e6b-9cf9-a08f35f8cffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559cab992ce74bd0b78a639e4001c918'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:52.588381 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1207/2396] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:52 2021] DELETE /identity/v3/users/559cab992ce74bd0b78a639e4001c918 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:52.593406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fe63f-58a7-4eff-baea-e9c88a95a718 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:52.594254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fe63f-58a7-4eff-baea-e9c88a95a718 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:52.594538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fe63f-58a7-4eff-baea-e9c88a95a718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:52.607960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786d4ea-858d-4a43-aee4-2fcb50712b65 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:52.608233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786d4ea-858d-4a43-aee4-2fcb50712b65 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:52.608508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786d4ea-858d-4a43-aee4-2fcb50712b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:52.656824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1786d4ea-858d-4a43-aee4-2fcb50712b65 None None] MFA Rules not processed for user `c88b989975ff48cf98de7e6f9ef6667c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:52.658919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1786d4ea-858d-4a43-aee4-2fcb50712b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:52.660854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-763fe63f-58a7-4eff-baea-e9c88a95a718 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:52.665878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-763fe63f-58a7-4eff-baea-e9c88a95a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:52.804387 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1190/2397] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:52.812036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f08e0-5284-4142-99d2-624d07b32f93 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:52.812339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f08e0-5284-4142-99d2-624d07b32f93 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:52.812677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f08e0-5284-4142-99d2-624d07b32f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:52.830220 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1208/2398] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:52 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:52.833992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ccc7b-764a-4396-97e2-a9a8a2869bf6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:52.834566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ccc7b-764a-4396-97e2-a9a8a2869bf6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:52.834923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ccc7b-764a-4396-97e2-a9a8a2869bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:52.883436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2a9ccc7b-764a-4396-97e2-a9a8a2869bf6 None None] MFA Rules not processed for user `1d46c71936aa4118aa36a9e95b95c4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:52.887049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2a9ccc7b-764a-4396-97e2-a9a8a2869bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:52.887876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e65f08e0-5284-4142-99d2-624d07b32f93 None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:52.890059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e65f08e0-5284-4142-99d2-624d07b32f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:53.038314 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1209/2399] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:52 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:53.039098 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1191/2400] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:46:52 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:53.045337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ccc7b-764a-4396-97e2-a9a8a2869bf6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:53.045825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f08e0-5284-4142-99d2-624d07b32f93 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:53.046866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2a9ccc7b-764a-4396-97e2-a9a8a2869bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:53.049599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e65f08e0-5284-4142-99d2-624d07b32f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:53.171544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ccc7b-764a-4396-97e2-a9a8a2869bf6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:53.181268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a00735-82b0-415a-a463-ad79c43bd408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:53.182064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00735-82b0-415a-a463-ad79c43bd408 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:53.182344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00735-82b0-415a-a463-ad79c43bd408 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:53.182617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a00735-82b0-415a-a463-ad79c43bd408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:53.184355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f08e0-5284-4142-99d2-624d07b32f93 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:53.192639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8b91e-7c08-4961-8582-2bdd533fe21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:53.194113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8b91e-7c08-4961-8582-2bdd533fe21e service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:53.194610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8b91e-7c08-4961-8582-2bdd533fe21e service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:53.195095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8b91e-7c08-4961-8582-2bdd533fe21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:53.201628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a00735-82b0-415a-a463-ad79c43bd408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:53.204108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a00735-82b0-415a-a463-ad79c43bd408 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:53.218766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8b91e-7c08-4961-8582-2bdd533fe21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:53.222566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8b91e-7c08-4961-8582-2bdd533fe21e service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:53.224607 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1210/2401] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:53.237633 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1192/2402] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:53.531435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a00735-82b0-415a-a463-ad79c43bd408 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:53.533385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-94a00735-82b0-415a-a463-ad79c43bd408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:53.579572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a00735-82b0-415a-a463-ad79c43bd408 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:53.586085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d2c58-1357-46c9-ad7a-484bea6cab51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:53.586749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2c58-1357-46c9-ad7a-484bea6cab51 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:53.587201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2c58-1357-46c9-ad7a-484bea6cab51 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:53.587655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2c58-1357-46c9-ad7a-484bea6cab51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:53.594786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7d2d2c58-1357-46c9-ad7a-484bea6cab51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:53.621057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d2c58-1357-46c9-ad7a-484bea6cab51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:53.622706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d2c58-1357-46c9-ad7a-484bea6cab51 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:53.642714 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1211/2403] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:53 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:46:54.023447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8b91e-7c08-4961-8582-2bdd533fe21e service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:54.024940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-62f8b91e-7c08-4961-8582-2bdd533fe21e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:54.056617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8b91e-7c08-4961-8582-2bdd533fe21e service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:54.063315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:54.064558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:54.065012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:54.065430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] PATH_INFO: `/v3/projects/7e7fd405b830467db077102575590b2e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:54.067208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e7fd405b830467db077102575590b2e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:54.074850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:54.206966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e7fd405b830467db077102575590b2e', 'request_id': 'req-024e3462-2048-4dcb-aa09-2ca53e6c3b85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:54.238134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e7fd405b830467db077102575590b2e', 'request_id': 'req-024e3462-2048-4dcb-aa09-2ca53e6c3b85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:54.260243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e7fd405b830467db077102575590b2e', 'request_id': 'req-024e3462-2048-4dcb-aa09-2ca53e6c3b85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:54.320879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] The token cache is being invalidate because project 7e7fd405b830467db077102575590b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:54.321182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:54.333172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:54.335321 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1193/2404] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:54 2021] DELETE /identity/v3/projects/7e7fd405b830467db077102575590b2e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:54.339580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d2c58-1357-46c9-ad7a-484bea6cab51 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:54.361097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d2c58-1357-46c9-ad7a-484bea6cab51 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:54.483278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69985a2b-0c2b-42dc-a278-c7af3baa73c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:54.484332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69985a2b-0c2b-42dc-a278-c7af3baa73c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:54.484716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69985a2b-0c2b-42dc-a278-c7af3baa73c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:54.485091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69985a2b-0c2b-42dc-a278-c7af3baa73c1 admin admin] PATH_INFO: `/v3/users/2a57bfbc92294b2aa3b7f23c685456b9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:54.486422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69985a2b-0c2b-42dc-a278-c7af3baa73c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a57bfbc92294b2aa3b7f23c685456b9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:54.488793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69985a2b-0c2b-42dc-a278-c7af3baa73c1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:54.604809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-69985a2b-0c2b-42dc-a278-c7af3baa73c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a57bfbc92294b2aa3b7f23c685456b9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:54.605570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-69985a2b-0c2b-42dc-a278-c7af3baa73c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a57bfbc92294b2aa3b7f23c685456b9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:54.623185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-69985a2b-0c2b-42dc-a278-c7af3baa73c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a57bfbc92294b2aa3b7f23c685456b9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:54.624522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-69985a2b-0c2b-42dc-a278-c7af3baa73c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a57bfbc92294b2aa3b7f23c685456b9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:54.646555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-69985a2b-0c2b-42dc-a278-c7af3baa73c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a57bfbc92294b2aa3b7f23c685456b9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:54.692727 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1212/2405] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:54 2021] DELETE /identity/v3/users/2a57bfbc92294b2aa3b7f23c685456b9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:55.786599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:55.789218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:55.810788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e3462-2048-4dcb-aa09-2ca53e6c3b85 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:55.954551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:55.955495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:55.955963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:55.956477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] PATH_INFO: `/v3/projects/3027e754dc9d4f98b1ff4e8daf26d2c9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:55.959801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3027e754dc9d4f98b1ff4e8daf26d2c9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:55.963533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:56.070016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3027e754dc9d4f98b1ff4e8daf26d2c9', 'request_id': 'req-6dc00344-6aeb-4d00-85f8-91cb403184b7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:56.101894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3027e754dc9d4f98b1ff4e8daf26d2c9', 'request_id': 'req-6dc00344-6aeb-4d00-85f8-91cb403184b7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:56.111198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3027e754dc9d4f98b1ff4e8daf26d2c9', 'request_id': 'req-6dc00344-6aeb-4d00-85f8-91cb403184b7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:56.142938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] The token cache is being invalidate because project 3027e754dc9d4f98b1ff4e8daf26d2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:56.143240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:56.144083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6dc00344-6aeb-4d00-85f8-91cb403184b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:56.145926 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1194/2406] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:55 2021] DELETE /identity/v3/projects/3027e754dc9d4f98b1ff4e8daf26d2c9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:56.152356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421038c-7742-4035-99a9-487598724148 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:56.152858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421038c-7742-4035-99a9-487598724148 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:56.153165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421038c-7742-4035-99a9-487598724148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:56.187644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4421038c-7742-4035-99a9-487598724148 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:56.189077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4421038c-7742-4035-99a9-487598724148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:56.367993 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1213/2407] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:56.380049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29efa6-da8f-4e07-b59e-c49f9a7b0dd9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:56.380641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29efa6-da8f-4e07-b59e-c49f9a7b0dd9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:56.381865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29efa6-da8f-4e07-b59e-c49f9a7b0dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:56.421403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bf29efa6-da8f-4e07-b59e-c49f9a7b0dd9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:56.425261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bf29efa6-da8f-4e07-b59e-c49f9a7b0dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:56.448079 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1195/2408] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:56.449626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421038c-7742-4035-99a9-487598724148 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:56.461999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421038c-7742-4035-99a9-487598724148 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:56.492364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a091a2-b378-4e81-a6fe-5b7f25616320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:56.500159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a091a2-b378-4e81-a6fe-5b7f25616320 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:56.500690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a091a2-b378-4e81-a6fe-5b7f25616320 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:56.501300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a091a2-b378-4e81-a6fe-5b7f25616320 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:56.502245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a091a2-b378-4e81-a6fe-5b7f25616320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:56.502769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a091a2-b378-4e81-a6fe-5b7f25616320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:56.504629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a091a2-b378-4e81-a6fe-5b7f25616320 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:56.541505 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1214/2409] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:56.542734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29efa6-da8f-4e07-b59e-c49f9a7b0dd9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:56.559304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29efa6-da8f-4e07-b59e-c49f9a7b0dd9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:56.577551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec923d95-92ba-4cb3-b7a7-fabe1f7e75a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:56.582848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923d95-92ba-4cb3-b7a7-fabe1f7e75a9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:56.583231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923d95-92ba-4cb3-b7a7-fabe1f7e75a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:56.583655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923d95-92ba-4cb3-b7a7-fabe1f7e75a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:56.584658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec923d95-92ba-4cb3-b7a7-fabe1f7e75a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:56.586842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec923d95-92ba-4cb3-b7a7-fabe1f7e75a9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:56.648207 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1196/2410] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:56 2021] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:56.651994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a091a2-b378-4e81-a6fe-5b7f25616320 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:56.667406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a091a2-b378-4e81-a6fe-5b7f25616320 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:56.701438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec923d95-92ba-4cb3-b7a7-fabe1f7e75a9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:56.703466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ec923d95-92ba-4cb3-b7a7-fabe1f7e75a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:56.862250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c019-5596-4a06-84a7-1e9db2233cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:56.863347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c019-5596-4a06-84a7-1e9db2233cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:56.863493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c019-5596-4a06-84a7-1e9db2233cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:56.863857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c019-5596-4a06-84a7-1e9db2233cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:56.866813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422c019-5596-4a06-84a7-1e9db2233cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:56.870479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422c019-5596-4a06-84a7-1e9db2233cf0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:56.906863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec923d95-92ba-4cb3-b7a7-fabe1f7e75a9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:56.917069 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1215/2411] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:56 2021] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:56.923606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d65d73-4a1b-4008-8fa7-d8eb365de49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:56.923970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c019-5596-4a06-84a7-1e9db2233cf0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:56.929863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d65d73-4a1b-4008-8fa7-d8eb365de49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:56.930185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d65d73-4a1b-4008-8fa7-d8eb365de49b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:56.930730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d65d73-4a1b-4008-8fa7-d8eb365de49b admin admin] PATH_INFO: `/v3/users/814712598f734cb596b8b6fcac38f321` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:56.932451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d65d73-4a1b-4008-8fa7-d8eb365de49b admin admin] RBAC: Authorizing `identity:delete_user(user_id=814712598f734cb596b8b6fcac38f321)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:56.939516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d65d73-4a1b-4008-8fa7-d8eb365de49b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:56.952571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c019-5596-4a06-84a7-1e9db2233cf0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:56.980896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38956226-115d-4d69-be9f-313c761a4cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:56.988411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956226-115d-4d69-be9f-313c761a4cff admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:56.988705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956226-115d-4d69-be9f-313c761a4cff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:56.988898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956226-115d-4d69-be9f-313c761a4cff admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:56.989707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38956226-115d-4d69-be9f-313c761a4cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:56.998747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38956226-115d-4d69-be9f-313c761a4cff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:57.045498 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1216/2412] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:56 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:57.076624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38956226-115d-4d69-be9f-313c761a4cff admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:57.112214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13d65d73-4a1b-4008-8fa7-d8eb365de49b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814712598f734cb596b8b6fcac38f321'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:57.129206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38956226-115d-4d69-be9f-313c761a4cff admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:57.153012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13d65d73-4a1b-4008-8fa7-d8eb365de49b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814712598f734cb596b8b6fcac38f321'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:57.153565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13d65d73-4a1b-4008-8fa7-d8eb365de49b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814712598f734cb596b8b6fcac38f321'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:57.155387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffe0e2-500c-4f07-ad13-4bcf13d8259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:57.156085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe0e2-500c-4f07-ad13-4bcf13d8259e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:57.159817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe0e2-500c-4f07-ad13-4bcf13d8259e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:57.160127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffe0e2-500c-4f07-ad13-4bcf13d8259e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:57.164351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffe0e2-500c-4f07-ad13-4bcf13d8259e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:57.170574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffe0e2-500c-4f07-ad13-4bcf13d8259e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:57.178685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13d65d73-4a1b-4008-8fa7-d8eb365de49b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814712598f734cb596b8b6fcac38f321'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:57.202592 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1217/2413] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:57 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:57.210078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffe0e2-500c-4f07-ad13-4bcf13d8259e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:57.214768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-39ffe0e2-500c-4f07-ad13-4bcf13d8259e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:57.219966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13d65d73-4a1b-4008-8fa7-d8eb365de49b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814712598f734cb596b8b6fcac38f321'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:57.241474 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1197/2414] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:56 2021] DELETE /identity/v3/users/814712598f734cb596b8b6fcac38f321 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:57.243383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773780-b9a4-4647-abc1-6518439a3ed5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:57.247739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773780-b9a4-4647-abc1-6518439a3ed5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:57.254887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773780-b9a4-4647-abc1-6518439a3ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:57.265853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffe0e2-500c-4f07-ad13-4bcf13d8259e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:57.304508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2f773780-b9a4-4647-abc1-6518439a3ed5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:57.311381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2f773780-b9a4-4647-abc1-6518439a3ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:57.393773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0580e3c-6527-4fe8-b94f-1d6999a882f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:57.398017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0580e3c-6527-4fe8-b94f-1d6999a882f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:57.399926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0580e3c-6527-4fe8-b94f-1d6999a882f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:57.400489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0580e3c-6527-4fe8-b94f-1d6999a882f0 admin admin] PATH_INFO: `/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9/users/6daf122437744fd0800ee705d9e23b00/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:57.438906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0580e3c-6527-4fe8-b94f-1d6999a882f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a8d93b8e0a432991b59ad1dd23a4c9, user_id=6daf122437744fd0800ee705d9e23b00, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:57.442073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0580e3c-6527-4fe8-b94f-1d6999a882f0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:57.472664 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1218/2415] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:57 2021] PUT /identity/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9/users/6daf122437744fd0800ee705d9e23b00/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:57.483862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29b83b-75e4-42ad-acce-9dd062189b51 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:57.484236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29b83b-75e4-42ad-acce-9dd062189b51 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:57.484792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29b83b-75e4-42ad-acce-9dd062189b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:57.538353 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1198/2416] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:57.560220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3d29b83b-75e4-42ad-acce-9dd062189b51 None None] MFA Rules not processed for user `6daf122437744fd0800ee705d9e23b00`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:57.561446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3d29b83b-75e4-42ad-acce-9dd062189b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:57.606843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773780-b9a4-4647-abc1-6518439a3ed5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:57.611811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2f773780-b9a4-4647-abc1-6518439a3ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:57.714242 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1219/2417] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:57 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:46:57.718498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29b83b-75e4-42ad-acce-9dd062189b51 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:57.766490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773780-b9a4-4647-abc1-6518439a3ed5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:57.884259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29b83b-75e4-42ad-acce-9dd062189b51 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:57.887688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2707f-b4a0-4105-a9bc-f21ca7cc7fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:57.888258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2707f-b4a0-4105-a9bc-f21ca7cc7fcd service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:57.888658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2707f-b4a0-4105-a9bc-f21ca7cc7fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:57.888816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2707f-b4a0-4105-a9bc-f21ca7cc7fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:57.894767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e27908-8d72-4b56-8573-7c7a7a532eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:57.895492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e27908-8d72-4b56-8573-7c7a7a532eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:57.895843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e27908-8d72-4b56-8573-7c7a7a532eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:57.896192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e27908-8d72-4b56-8573-7c7a7a532eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:57.897812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e27908-8d72-4b56-8573-7c7a7a532eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:57.899939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e27908-8d72-4b56-8573-7c7a7a532eb0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:57.906015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2707f-b4a0-4105-a9bc-f21ca7cc7fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:57.912871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2707f-b4a0-4105-a9bc-f21ca7cc7fcd service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:57.951395 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1199/2418] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:57.973661 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1220/2419] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:57 2021] POST /identity/v3/projects => generated 373 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:57.977182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2707f-b4a0-4105-a9bc-f21ca7cc7fcd service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:57.995305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2707f-b4a0-4105-a9bc-f21ca7cc7fcd service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:58.125078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b6444-e3d5-46be-b1cf-d6cdfb8471c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:58.125781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b6444-e3d5-46be-b1cf-d6cdfb8471c4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:58.126067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b6444-e3d5-46be-b1cf-d6cdfb8471c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:58.126349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b6444-e3d5-46be-b1cf-d6cdfb8471c4 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:58.127077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b6444-e3d5-46be-b1cf-d6cdfb8471c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:58.129108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b6444-e3d5-46be-b1cf-d6cdfb8471c4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:58.170351 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1200/2420] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:46:57 2021] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:58.174674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e27908-8d72-4b56-8573-7c7a7a532eb0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:58.191621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e27908-8d72-4b56-8573-7c7a7a532eb0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:58.210437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f273e9-1295-478c-804a-41a4e9dc6999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:58.214797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f273e9-1295-478c-804a-41a4e9dc6999 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:58.215124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f273e9-1295-478c-804a-41a4e9dc6999 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:58.215435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f273e9-1295-478c-804a-41a4e9dc6999 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:58.216260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f273e9-1295-478c-804a-41a4e9dc6999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:58.218172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f273e9-1295-478c-804a-41a4e9dc6999 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:58.235797 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1221/2421] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:58 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:58.236734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b6444-e3d5-46be-b1cf-d6cdfb8471c4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:58.268529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b6444-e3d5-46be-b1cf-d6cdfb8471c4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:58.277403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab536ac-3a78-41e9-b1bc-7560027eb38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:58.278675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab536ac-3a78-41e9-b1bc-7560027eb38b admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:58.278970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab536ac-3a78-41e9-b1bc-7560027eb38b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:58.279260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab536ac-3a78-41e9-b1bc-7560027eb38b admin admin] PATH_INFO: `/v3/projects/1986979ca0fe469ca150e0ecc8a059ea/users/a52683efcc7c4e1597800e2112d2303a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:58.310112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab536ac-3a78-41e9-b1bc-7560027eb38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1986979ca0fe469ca150e0ecc8a059ea, user_id=a52683efcc7c4e1597800e2112d2303a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:58.313114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab536ac-3a78-41e9-b1bc-7560027eb38b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:58.345074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f273e9-1295-478c-804a-41a4e9dc6999 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:58.355831 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1201/2422] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:58 2021] PUT /identity/v3/projects/1986979ca0fe469ca150e0ecc8a059ea/users/a52683efcc7c4e1597800e2112d2303a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:58.359952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f273e9-1295-478c-804a-41a4e9dc6999 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:58.488513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566ba39-166b-4ec1-9050-4d124969b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:58.490073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566ba39-166b-4ec1-9050-4d124969b23f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:58.492068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566ba39-166b-4ec1-9050-4d124969b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:58.492371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566ba39-166b-4ec1-9050-4d124969b23f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:58.493590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566ba39-166b-4ec1-9050-4d124969b23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:58.496129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566ba39-166b-4ec1-9050-4d124969b23f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:58.541659 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1222/2423] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:46:58 2021] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:46:58.547334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab536ac-3a78-41e9-b1bc-7560027eb38b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:58.563669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab536ac-3a78-41e9-b1bc-7560027eb38b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:58.568970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9fd07-50db-4754-820a-c48df52b583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:58.569894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9fd07-50db-4754-820a-c48df52b583e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:58.570442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9fd07-50db-4754-820a-c48df52b583e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:58.570883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9fd07-50db-4754-820a-c48df52b583e admin admin] PATH_INFO: `/v3/projects/1986979ca0fe469ca150e0ecc8a059ea/users/a52683efcc7c4e1597800e2112d2303a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:58.573050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9fd07-50db-4754-820a-c48df52b583e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1986979ca0fe469ca150e0ecc8a059ea, user_id=a52683efcc7c4e1597800e2112d2303a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:58.576690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9fd07-50db-4754-820a-c48df52b583e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:58.597061 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1202/2424] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:46:58 2021] PUT /identity/v3/projects/1986979ca0fe469ca150e0ecc8a059ea/users/a52683efcc7c4e1597800e2112d2303a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:58.601175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ad64-a5ff-4bab-9e37-517ee5b1ab20 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:58.601474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ad64-a5ff-4bab-9e37-517ee5b1ab20 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:58.601772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ad64-a5ff-4bab-9e37-517ee5b1ab20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:58.654857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3970ad64-a5ff-4bab-9e37-517ee5b1ab20 None None] MFA Rules not processed for user `a52683efcc7c4e1597800e2112d2303a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:46:58.656727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3970ad64-a5ff-4bab-9e37-517ee5b1ab20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:58.783162 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1223/2425] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:46:58 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:46:58.791891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9fd07-50db-4754-820a-c48df52b583e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:58.806605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9fd07-50db-4754-820a-c48df52b583e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:58.820444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a9197-b233-4dfa-aee4-84323644cc8b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:58.820968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9197-b233-4dfa-aee4-84323644cc8b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:58.821252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9197-b233-4dfa-aee4-84323644cc8b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:58.821526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9197-b233-4dfa-aee4-84323644cc8b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:58.822571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a9197-b233-4dfa-aee4-84323644cc8b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:58.822901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a9197-b233-4dfa-aee4-84323644cc8b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:58.824908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a9197-b233-4dfa-aee4-84323644cc8b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:58.857506 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1203/2426] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:58.862598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ad64-a5ff-4bab-9e37-517ee5b1ab20 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:58.883455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ad64-a5ff-4bab-9e37-517ee5b1ab20 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:58.900155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd99de-5cca-4833-acc4-59683641b033 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:58.901714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd99de-5cca-4833-acc4-59683641b033 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:58.902935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd99de-5cca-4833-acc4-59683641b033 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:58.904324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd99de-5cca-4833-acc4-59683641b033 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:58.905961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd99de-5cca-4833-acc4-59683641b033 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:58.911766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd99de-5cca-4833-acc4-59683641b033 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:59.016953 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1224/2427] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:46:58 2021] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:46:59.021175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a9197-b233-4dfa-aee4-84323644cc8b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:59.038222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a9197-b233-4dfa-aee4-84323644cc8b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:59.164296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a480a-8614-4283-963e-adec505fee00 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:59.165092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a480a-8614-4283-963e-adec505fee00 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:59.165401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a480a-8614-4283-963e-adec505fee00 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:59.165652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a480a-8614-4283-963e-adec505fee00 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:59.166445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a480a-8614-4283-963e-adec505fee00 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:46:59.166751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a480a-8614-4283-963e-adec505fee00 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:59.168419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a480a-8614-4283-963e-adec505fee00 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:59.194098 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1204/2428] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:46:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:46:59.511086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd99de-5cca-4833-acc4-59683641b033 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:59.513759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fdcd99de-5cca-4833-acc4-59683641b033 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:59.612444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd99de-5cca-4833-acc4-59683641b033 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:59.621372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a480a-8614-4283-963e-adec505fee00 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:59.624223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-549a480a-8614-4283-963e-adec505fee00 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:59.627354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:59.628622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:59.629056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:59.629336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] PATH_INFO: `/v3/projects/c9cfdf5632874b5d9e4fe5a6d6bc2e20` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:59.630651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9cfdf5632874b5d9e4fe5a6d6bc2e20)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:59.632678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:59.686112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9cfdf5632874b5d9e4fe5a6d6bc2e20', 'request_id': 'req-77504bac-769a-4fa7-aced-a850f5003417'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:59.692520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9cfdf5632874b5d9e4fe5a6d6bc2e20', 'request_id': 'req-77504bac-769a-4fa7-aced-a850f5003417'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:59.702807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9cfdf5632874b5d9e4fe5a6d6bc2e20', 'request_id': 'req-77504bac-769a-4fa7-aced-a850f5003417'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:59.706984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a480a-8614-4283-963e-adec505fee00 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:59.715576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] The token cache is being invalidate because project c9cfdf5632874b5d9e4fe5a6d6bc2e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:46:59.715865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:59.716509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:59.721420 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1225/2429] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:46:59 2021] DELETE /identity/v3/projects/c9cfdf5632874b5d9e4fe5a6d6bc2e20 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:46:59.722371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:46:59.723814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:59.788131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121ca98-567a-4bec-9b7e-75786e2da5df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:59.788925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121ca98-567a-4bec-9b7e-75786e2da5df service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:59.789237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121ca98-567a-4bec-9b7e-75786e2da5df service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:59.789509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121ca98-567a-4bec-9b7e-75786e2da5df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:59.792545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7121ca98-567a-4bec-9b7e-75786e2da5df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:46:59.800366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77504bac-769a-4fa7-aced-a850f5003417 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:46:59.805466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65bd91-1d8a-4a86-b640-71505328ba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:46:59.806480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65bd91-1d8a-4a86-b640-71505328ba7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:59.806761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65bd91-1d8a-4a86-b640-71505328ba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:59.807024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65bd91-1d8a-4a86-b640-71505328ba7d admin admin] PATH_INFO: `/v3/users/eab71c0353ca4f9cacbb32b6ef95272f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:59.808726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65bd91-1d8a-4a86-b640-71505328ba7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab71c0353ca4f9cacbb32b6ef95272f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:59.810808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65bd91-1d8a-4a86-b640-71505328ba7d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:59.879779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bb65bd91-1d8a-4a86-b640-71505328ba7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab71c0353ca4f9cacbb32b6ef95272f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:59.880984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bb65bd91-1d8a-4a86-b640-71505328ba7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab71c0353ca4f9cacbb32b6ef95272f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:59.893740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bb65bd91-1d8a-4a86-b640-71505328ba7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab71c0353ca4f9cacbb32b6ef95272f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:59.895097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bb65bd91-1d8a-4a86-b640-71505328ba7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab71c0353ca4f9cacbb32b6ef95272f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:59.905152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121ca98-567a-4bec-9b7e-75786e2da5df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:46:59.906882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121ca98-567a-4bec-9b7e-75786e2da5df service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:46:59.908605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bb65bd91-1d8a-4a86-b640-71505328ba7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab71c0353ca4f9cacbb32b6ef95272f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:46:59.918736 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1205/2430] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:46:59 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:46:59.939213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564d71-1715-43df-9438-c216ac617d5c None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:46:59.939581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564d71-1715-43df-9438-c216ac617d5c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:46:59.939858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564d71-1715-43df-9438-c216ac617d5c None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:46:59.941749 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1206/2431] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:46:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:46:59.943093 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1226/2432] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:46:59 2021] DELETE /identity/v3/users/eab71c0353ca4f9cacbb32b6ef95272f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:46:59.947761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53564d71-1715-43df-9438-c216ac617d5c None None] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:46:59.949501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-53564d71-1715-43df-9438-c216ac617d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:00.065773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53564d71-1715-43df-9438-c216ac617d5c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:00.067199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-53564d71-1715-43df-9438-c216ac617d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:00.158638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53564d71-1715-43df-9438-c216ac617d5c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:00.167758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199a448-f0e2-42b1-b369-1836c5243cc3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:00.168054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199a448-f0e2-42b1-b369-1836c5243cc3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:00.169191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199a448-f0e2-42b1-b369-1836c5243cc3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:00.169482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199a448-f0e2-42b1-b369-1836c5243cc3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/a4aae3b510a74fb49d23b02db72af80b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:00.171163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199a448-f0e2-42b1-b369-1836c5243cc3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:get_project(project_id=a4aae3b510a74fb49d23b02db72af80b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:00.174651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199a448-f0e2-42b1-b369-1836c5243cc3 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:00.183651 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1207/2433] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:46:59 2021] GET /identity/v3/projects/a4aae3b510a74fb49d23b02db72af80b => generated 371 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:00.289718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c512726-dc50-462c-977f-2c2d064588e6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:00.294680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c512726-dc50-462c-977f-2c2d064588e6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:00.295474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c512726-dc50-462c-977f-2c2d064588e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:00.388509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3c512726-dc50-462c-977f-2c2d064588e6 None None] MFA Rules not processed for user `63bc0e675c9044e3bda2cd5dadd4fb15`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:00.389797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3c512726-dc50-462c-977f-2c2d064588e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:00.548776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b68dea-fc24-480c-8914-7168109fe8a1 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:00.549061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b68dea-fc24-480c-8914-7168109fe8a1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:00.549335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b68dea-fc24-480c-8914-7168109fe8a1 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:00.551326 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1208/2434] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:47:00.559750 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1227/2435] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:00 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:00.560267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b68dea-fc24-480c-8914-7168109fe8a1 None None] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:00.561711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e9b68dea-fc24-480c-8914-7168109fe8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:00.621081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b68dea-fc24-480c-8914-7168109fe8a1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:00.653016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b68dea-fc24-480c-8914-7168109fe8a1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:00.670370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ccc3a-2a8d-45a3-9f63-e58b98d1a8c8 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:00.671404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ccc3a-2a8d-45a3-9f63-e58b98d1a8c8 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:00.671888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ccc3a-2a8d-45a3-9f63-e58b98d1a8c8 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:00.672173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ccc3a-2a8d-45a3-9f63-e58b98d1a8c8 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/a4aae3b510a74fb49d23b02db72af80b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:00.683682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ccc3a-2a8d-45a3-9f63-e58b98d1a8c8 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:get_project(project_id=a4aae3b510a74fb49d23b02db72af80b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:00.685859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ccc3a-2a8d-45a3-9f63-e58b98d1a8c8 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:00.691648 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1209/2436] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:00 2021] GET /identity/v3/projects/a4aae3b510a74fb49d23b02db72af80b => generated 371 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:00.719021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c512726-dc50-462c-977f-2c2d064588e6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:00.720508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3c512726-dc50-462c-977f-2c2d064588e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:00.891861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c512726-dc50-462c-977f-2c2d064588e6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:00.925011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:00.926074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:00.926523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:00.926945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] PATH_INFO: `/v3/projects/cdf4d721f5cf42b497cd5bb55a5242d8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:00.934080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf4d721f5cf42b497cd5bb55a5242d8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:00.936252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:00.940510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ccc3a-2a8d-45a3-9f63-e58b98d1a8c8 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:00.960126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ccc3a-2a8d-45a3-9f63-e58b98d1a8c8 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:00.968246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357f35e-f05f-490d-afb8-21e6f5b8efa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:00.970269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f35e-f05f-490d-afb8-21e6f5b8efa6 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:00.970649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f35e-f05f-490d-afb8-21e6f5b8efa6 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:00.970793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f35e-f05f-490d-afb8-21e6f5b8efa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:00.973639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3357f35e-f05f-490d-afb8-21e6f5b8efa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:01.020232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf4d721f5cf42b497cd5bb55a5242d8', 'request_id': 'req-54d5685b-7dee-4977-a58c-91f154a3b6fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:01.036525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf4d721f5cf42b497cd5bb55a5242d8', 'request_id': 'req-54d5685b-7dee-4977-a58c-91f154a3b6fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:01.056815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf4d721f5cf42b497cd5bb55a5242d8', 'request_id': 'req-54d5685b-7dee-4977-a58c-91f154a3b6fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:01.079324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] The token cache is being invalidate because project cdf4d721f5cf42b497cd5bb55a5242d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:47:01.079643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:01.082850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54d5685b-7dee-4977-a58c-91f154a3b6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:01.086644 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1228/2437] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:47:00 2021] DELETE /identity/v3/projects/cdf4d721f5cf42b497cd5bb55a5242d8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:01.089269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357f35e-f05f-490d-afb8-21e6f5b8efa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:01.091218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357f35e-f05f-490d-afb8-21e6f5b8efa6 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:01.092300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f44c0-3b26-4353-9617-a82756699aa9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:01.092599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f44c0-3b26-4353-9617-a82756699aa9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:01.092879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f44c0-3b26-4353-9617-a82756699aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:01.119425 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1210/2438] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:00 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:47:01.146455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-311f44c0-3b26-4353-9617-a82756699aa9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:01.146455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-311f44c0-3b26-4353-9617-a82756699aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:01.263501 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1229/2439] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:01.272469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69949062-3b55-40e0-b2a3-f164bb9cefc7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:01.272819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69949062-3b55-40e0-b2a3-f164bb9cefc7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:01.273748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69949062-3b55-40e0-b2a3-f164bb9cefc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:01.322385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-69949062-3b55-40e0-b2a3-f164bb9cefc7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:01.328211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-69949062-3b55-40e0-b2a3-f164bb9cefc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:01.344704 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1211/2440] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:01.348813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f44c0-3b26-4353-9617-a82756699aa9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:01.367696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f44c0-3b26-4353-9617-a82756699aa9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:01.375012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38a811-26cc-4f0d-84e4-99c426bc6207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:01.376093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a811-26cc-4f0d-84e4-99c426bc6207 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:01.376612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a811-26cc-4f0d-84e4-99c426bc6207 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:01.377097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a811-26cc-4f0d-84e4-99c426bc6207 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:01.378102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38a811-26cc-4f0d-84e4-99c426bc6207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:01.378639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38a811-26cc-4f0d-84e4-99c426bc6207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:01.381703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38a811-26cc-4f0d-84e4-99c426bc6207 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:01.397577 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1230/2441] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:01.402068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69949062-3b55-40e0-b2a3-f164bb9cefc7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:01.413398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69949062-3b55-40e0-b2a3-f164bb9cefc7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:01.418887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e39b86-1cbb-4aa1-afb7-f6c2b37e0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:01.419604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e39b86-1cbb-4aa1-afb7-f6c2b37e0500 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:01.419892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e39b86-1cbb-4aa1-afb7-f6c2b37e0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:01.420166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e39b86-1cbb-4aa1-afb7-f6c2b37e0500 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:01.420885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e39b86-1cbb-4aa1-afb7-f6c2b37e0500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:01.423135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e39b86-1cbb-4aa1-afb7-f6c2b37e0500 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:01.481852 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1212/2442] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:47:01 2021] POST /identity/v3/projects => generated 391 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:01.483709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38a811-26cc-4f0d-84e4-99c426bc6207 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:01.495388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38a811-26cc-4f0d-84e4-99c426bc6207 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:01.564464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dd2d3-1b74-444f-8bc8-5e87ba3233b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:01.565249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dd2d3-1b74-444f-8bc8-5e87ba3233b4 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:01.565771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dd2d3-1b74-444f-8bc8-5e87ba3233b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:01.566161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dd2d3-1b74-444f-8bc8-5e87ba3233b4 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:01.567830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dd2d3-1b74-444f-8bc8-5e87ba3233b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:01.571281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958dd2d3-1b74-444f-8bc8-5e87ba3233b4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:01.606351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e39b86-1cbb-4aa1-afb7-f6c2b37e0500 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:01.608613 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1231/2443] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:47:01 2021] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:01.614837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dd2d3-1b74-444f-8bc8-5e87ba3233b4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:01.621888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e39b86-1cbb-4aa1-afb7-f6c2b37e0500 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:01.622813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-958dd2d3-1b74-444f-8bc8-5e87ba3233b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:01.636344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f6b74-fd1c-4c4c-9db9-d08bdb76511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:01.637737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6b74-fd1c-4c4c-9db9-d08bdb76511d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:01.638123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6b74-fd1c-4c4c-9db9-d08bdb76511d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:01.638494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6b74-fd1c-4c4c-9db9-d08bdb76511d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:01.639392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f6b74-fd1c-4c4c-9db9-d08bdb76511d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:01.643157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f6b74-fd1c-4c4c-9db9-d08bdb76511d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:01.677528 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1213/2444] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:01 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:01.678736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f6b74-fd1c-4c4c-9db9-d08bdb76511d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:01.705048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f6b74-fd1c-4c4c-9db9-d08bdb76511d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:01.719883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765531a9-14d4-4374-8758-63939c6e9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:01.720699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765531a9-14d4-4374-8758-63939c6e9497 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:01.721180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765531a9-14d4-4374-8758-63939c6e9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:01.721550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765531a9-14d4-4374-8758-63939c6e9497 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:01.724884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765531a9-14d4-4374-8758-63939c6e9497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:01.726591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765531a9-14d4-4374-8758-63939c6e9497 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:01.752259 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1214/2445] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:01 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:01.753632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765531a9-14d4-4374-8758-63939c6e9497 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:01.766298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765531a9-14d4-4374-8758-63939c6e9497 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:01.780488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f443c3c-82e1-4a14-9a8c-65b48f3e1c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:01.781556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f443c3c-82e1-4a14-9a8c-65b48f3e1c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:01.782526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f443c3c-82e1-4a14-9a8c-65b48f3e1c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:01.783623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f443c3c-82e1-4a14-9a8c-65b48f3e1c5e admin admin] PATH_INFO: `/v3/projects/6a03ea486bb44aa29cb6760d77139ca1/users/20eeec6e0aa04a599f98e217d1cd3fff/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:01.805047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dd2d3-1b74-444f-8bc8-5e87ba3233b4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:01.818576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4d910-db0e-4512-a5f2-8df8c8de23a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:01.818877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4d910-db0e-4512-a5f2-8df8c8de23a2 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:01.820190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f443c3c-82e1-4a14-9a8c-65b48f3e1c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a03ea486bb44aa29cb6760d77139ca1, user_id=20eeec6e0aa04a599f98e217d1cd3fff, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:01.820764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4d910-db0e-4512-a5f2-8df8c8de23a2 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:01.823596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4d910-db0e-4512-a5f2-8df8c8de23a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:01.825036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f443c3c-82e1-4a14-9a8c-65b48f3e1c5e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:01.826771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9ca4d910-db0e-4512-a5f2-8df8c8de23a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:01.870489 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1215/2446] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:47:01 2021] PUT /identity/v3/projects/6a03ea486bb44aa29cb6760d77139ca1/users/20eeec6e0aa04a599f98e217d1cd3fff/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:01.872254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef8a96-cd5d-4b86-a2b8-2a769497bd8d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:01.872484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef8a96-cd5d-4b86-a2b8-2a769497bd8d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:01.872813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef8a96-cd5d-4b86-a2b8-2a769497bd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:01.924412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8cef8a96-cd5d-4b86-a2b8-2a769497bd8d None None] MFA Rules not processed for user `20eeec6e0aa04a599f98e217d1cd3fff`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:01.926719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8cef8a96-cd5d-4b86-a2b8-2a769497bd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:02.020642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4d910-db0e-4512-a5f2-8df8c8de23a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:02.023443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4d910-db0e-4512-a5f2-8df8c8de23a2 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:02.037435 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1216/2447] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:01 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:02.037661 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1232/2448] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:01 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:02.038732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef8a96-cd5d-4b86-a2b8-2a769497bd8d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:02.039604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eca09-82aa-41a3-b1e5-ff740b4214ac None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:02.040001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eca09-82aa-41a3-b1e5-ff740b4214ac None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:02.040287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eca09-82aa-41a3-b1e5-ff740b4214ac None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:02.044059 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1233/2449] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:02 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:02.055009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eca09-82aa-41a3-b1e5-ff740b4214ac None None] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:02.056852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a25eca09-82aa-41a3-b1e5-ff740b4214ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:02.158549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef8a96-cd5d-4b86-a2b8-2a769497bd8d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:02.166991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf2133-1247-4dd3-8c85-33008ac2fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:02.167725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2133-1247-4dd3-8c85-33008ac2fd17 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:02.168061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2133-1247-4dd3-8c85-33008ac2fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:02.168345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2133-1247-4dd3-8c85-33008ac2fd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:02.169276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf2133-1247-4dd3-8c85-33008ac2fd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:02.171980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf2133-1247-4dd3-8c85-33008ac2fd17 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:02.210294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eca09-82aa-41a3-b1e5-ff740b4214ac None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:02.212476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a25eca09-82aa-41a3-b1e5-ff740b4214ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:02.216501 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1217/2450] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:47:02 2021] POST /identity/v3/projects => generated 391 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:02.220547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf2133-1247-4dd3-8c85-33008ac2fd17 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:02.343495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf2133-1247-4dd3-8c85-33008ac2fd17 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:02.353822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2e71e-bf92-4701-9c2c-2cb2ad54426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:02.355786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2e71e-bf92-4701-9c2c-2cb2ad54426f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:02.356913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2e71e-bf92-4701-9c2c-2cb2ad54426f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:02.357493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2e71e-bf92-4701-9c2c-2cb2ad54426f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:02.358436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2e71e-bf92-4701-9c2c-2cb2ad54426f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:02.361795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2e71e-bf92-4701-9c2c-2cb2ad54426f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:02.371143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eca09-82aa-41a3-b1e5-ff740b4214ac None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:02.422475 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1218/2451] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:47:02 2021] POST /identity/v3/users => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:47:02.425232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2e71e-bf92-4701-9c2c-2cb2ad54426f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:02.449824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2e71e-bf92-4701-9c2c-2cb2ad54426f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:02.461152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c3643-75e7-49c4-be27-16cfeef5476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:02.465208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c3643-75e7-49c4-be27-16cfeef5476d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:02.465901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c3643-75e7-49c4-be27-16cfeef5476d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:02.467473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c3643-75e7-49c4-be27-16cfeef5476d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:02.470818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c3643-75e7-49c4-be27-16cfeef5476d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:02.478674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c3643-75e7-49c4-be27-16cfeef5476d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:02.514108 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1219/2452] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:02 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:02.522335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c3643-75e7-49c4-be27-16cfeef5476d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:02.559922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c3643-75e7-49c4-be27-16cfeef5476d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:02.562219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c329141-93f8-4b2b-93de-1dab21b8b646 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:02.563076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329141-93f8-4b2b-93de-1dab21b8b646 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:02.563383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329141-93f8-4b2b-93de-1dab21b8b646 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:02.563743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c329141-93f8-4b2b-93de-1dab21b8b646 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/a4aae3b510a74fb49d23b02db72af80b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:02.565035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c329141-93f8-4b2b-93de-1dab21b8b646 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:get_project(project_id=a4aae3b510a74fb49d23b02db72af80b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:02.568664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98127d-7178-4017-954b-43bd70f79c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:02.569821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98127d-7178-4017-954b-43bd70f79c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:02.570182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98127d-7178-4017-954b-43bd70f79c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:02.570541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98127d-7178-4017-954b-43bd70f79c92 admin admin] PATH_INFO: `/v3/projects/cfdb8173e3b64499a9ae524eab985b25/users/b7734f16383144daa3a0fe07da592b7a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:02.574573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c329141-93f8-4b2b-93de-1dab21b8b646 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:02.588359 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1234/2453] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:02 2021] GET /identity/v3/projects/a4aae3b510a74fb49d23b02db72af80b => generated 371 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:02.592133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98127d-7178-4017-954b-43bd70f79c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb8173e3b64499a9ae524eab985b25, user_id=b7734f16383144daa3a0fe07da592b7a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:02.595966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98127d-7178-4017-954b-43bd70f79c92 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:02.606599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c329141-93f8-4b2b-93de-1dab21b8b646 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:02.628384 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1220/2454] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:47:02 2021] PUT /identity/v3/projects/cfdb8173e3b64499a9ae524eab985b25/users/b7734f16383144daa3a0fe07da592b7a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:02.629375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98127d-7178-4017-954b-43bd70f79c92 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:02.634271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c329141-93f8-4b2b-93de-1dab21b8b646 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:02.769003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:02.772548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:02.772850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:02.773610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/a4aae3b510a74fb49d23b02db72af80b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:02.774943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a4aae3b510a74fb49d23b02db72af80b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:02.777913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:02.784468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98127d-7178-4017-954b-43bd70f79c92 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:02.797384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff08aeb-d0bf-4989-b5f6-2645c2fe5ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:02.798076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff08aeb-d0bf-4989-b5f6-2645c2fe5ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:02.798362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff08aeb-d0bf-4989-b5f6-2645c2fe5ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:02.801075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff08aeb-d0bf-4989-b5f6-2645c2fe5ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:02.803065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff08aeb-d0bf-4989-b5f6-2645c2fe5ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:02.804702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff08aeb-d0bf-4989-b5f6-2645c2fe5ca3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:02.842230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4aae3b510a74fb49d23b02db72af80b', 'request_id': 'req-508c0f7a-5888-41ec-93c8-2fcab5738a6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:02.843335 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1221/2455] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:02 2021] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:02.844693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff08aeb-d0bf-4989-b5f6-2645c2fe5ca3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:02.853225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4aae3b510a74fb49d23b02db72af80b', 'request_id': 'req-508c0f7a-5888-41ec-93c8-2fcab5738a6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:02.867995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4aae3b510a74fb49d23b02db72af80b', 'request_id': 'req-508c0f7a-5888-41ec-93c8-2fcab5738a6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:02.876273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff08aeb-d0bf-4989-b5f6-2645c2fe5ca3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:02.895144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] The token cache is being invalidate because project a4aae3b510a74fb49d23b02db72af80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:47:02.895370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:02.899917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-508c0f7a-5888-41ec-93c8-2fcab5738a6e tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:02.902220 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1235/2456] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:47:02 2021] DELETE /identity/v3/projects/a4aae3b510a74fb49d23b02db72af80b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:47:02.997649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a816b61-02f4-4498-9b5d-cc738cd653df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:02.998711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816b61-02f4-4498-9b5d-cc738cd653df admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:02.999010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816b61-02f4-4498-9b5d-cc738cd653df admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:02.999888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816b61-02f4-4498-9b5d-cc738cd653df admin admin] PATH_INFO: `/v3/projects/cfdb8173e3b64499a9ae524eab985b25/users/b7734f16383144daa3a0fe07da592b7a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:03.002745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a816b61-02f4-4498-9b5d-cc738cd653df admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb8173e3b64499a9ae524eab985b25, user_id=b7734f16383144daa3a0fe07da592b7a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:03.015855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a816b61-02f4-4498-9b5d-cc738cd653df admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:03.036294 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1222/2457] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:47:02 2021] PUT /identity/v3/projects/cfdb8173e3b64499a9ae524eab985b25/users/b7734f16383144daa3a0fe07da592b7a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:03.040055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4bc33-b51b-4462-b15e-3c1fd63cebd6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:03.040356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4bc33-b51b-4462-b15e-3c1fd63cebd6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:03.040642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4bc33-b51b-4462-b15e-3c1fd63cebd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:03.085981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f3f4bc33-b51b-4462-b15e-3c1fd63cebd6 None None] MFA Rules not processed for user `b7734f16383144daa3a0fe07da592b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:03.087232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f3f4bc33-b51b-4462-b15e-3c1fd63cebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:03.250606 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1236/2458] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:03 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:03.475558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f936b-c576-4f5b-b572-6f2e57a4fe47 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:03.476075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f936b-c576-4f5b-b572-6f2e57a4fe47 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:03.476155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f936b-c576-4f5b-b572-6f2e57a4fe47 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:03.478836 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1223/2459] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:03.484607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4bc33-b51b-4462-b15e-3c1fd63cebd6 None None] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:03.486071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f3f4bc33-b51b-4462-b15e-3c1fd63cebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:03.655964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4bc33-b51b-4462-b15e-3c1fd63cebd6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:03.658744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f3f4bc33-b51b-4462-b15e-3c1fd63cebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:03.757098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4bc33-b51b-4462-b15e-3c1fd63cebd6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:03.762739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9668b-f045-4a6c-bd9f-ffae812ce8d9 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:03.764076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9668b-f045-4a6c-bd9f-ffae812ce8d9 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:03.764566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9668b-f045-4a6c-bd9f-ffae812ce8d9 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:03.764921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9668b-f045-4a6c-bd9f-ffae812ce8d9 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:03.766261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9668b-f045-4a6c-bd9f-ffae812ce8d9 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:get_project(project_id=f3a8d93b8e0a432991b59ad1dd23a4c9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:03.768638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9668b-f045-4a6c-bd9f-ffae812ce8d9 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:03.775220 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1237/2460] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:03 2021] GET /identity/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9 => generated 375 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:03.789248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f936b-c576-4f5b-b572-6f2e57a4fe47 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:03.816062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f936b-c576-4f5b-b572-6f2e57a4fe47 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:03.830396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27da764-41c6-4f56-9afc-dade3face4e0 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:03.831391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27da764-41c6-4f56-9afc-dade3face4e0 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:03.833305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27da764-41c6-4f56-9afc-dade3face4e0 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:03.833750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27da764-41c6-4f56-9afc-dade3face4e0 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:03.834679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27da764-41c6-4f56-9afc-dade3face4e0 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:03.838456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27da764-41c6-4f56-9afc-dade3face4e0 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:03.840763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27da764-41c6-4f56-9afc-dade3face4e0 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:03.874588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9668b-f045-4a6c-bd9f-ffae812ce8d9 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:03.882657 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1224/2461] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:03.890001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9668b-f045-4a6c-bd9f-ffae812ce8d9 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:03.904110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709e0f9-5a72-4e0e-94c4-032a7caa1a70 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:03.904958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709e0f9-5a72-4e0e-94c4-032a7caa1a70 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:03.905424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709e0f9-5a72-4e0e-94c4-032a7caa1a70 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:03.905729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709e0f9-5a72-4e0e-94c4-032a7caa1a70 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:03.906569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709e0f9-5a72-4e0e-94c4-032a7caa1a70 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:03.911094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709e0f9-5a72-4e0e-94c4-032a7caa1a70 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:03.950903 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1238/2462] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:47:03 2021] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:03.954976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27da764-41c6-4f56-9afc-dade3face4e0 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:03.982963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27da764-41c6-4f56-9afc-dade3face4e0 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:04.054913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ed935-65e0-4b9f-8771-4c7831733313 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:04.055755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ed935-65e0-4b9f-8771-4c7831733313 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:04.056057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ed935-65e0-4b9f-8771-4c7831733313 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:04.056477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ed935-65e0-4b9f-8771-4c7831733313 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:04.057626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ed935-65e0-4b9f-8771-4c7831733313 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:04.057626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ed935-65e0-4b9f-8771-4c7831733313 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:04.059322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ed935-65e0-4b9f-8771-4c7831733313 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:04.078844 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1225/2463] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:04.232389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709e0f9-5a72-4e0e-94c4-032a7caa1a70 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:04.329398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709e0f9-5a72-4e0e-94c4-032a7caa1a70 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:04.339432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf1b0f-c67d-4348-abf2-4d5471fcc419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:04.340362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1b0f-c67d-4348-abf2-4d5471fcc419 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:04.340750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1b0f-c67d-4348-abf2-4d5471fcc419 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:04.341891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1b0f-c67d-4348-abf2-4d5471fcc419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:04.344673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7cdf1b0f-c67d-4348-abf2-4d5471fcc419 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:04.465980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf1b0f-c67d-4348-abf2-4d5471fcc419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:04.469063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf1b0f-c67d-4348-abf2-4d5471fcc419 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:04.480919 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1239/2464] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:04 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:05.307935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff13a2-cd1e-4763-b177-33bf8ad7e62d None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:05.308831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff13a2-cd1e-4763-b177-33bf8ad7e62d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:05.309108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff13a2-cd1e-4763-b177-33bf8ad7e62d None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:05.311297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1226/2465] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:05.317318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf1b0f-c67d-4348-abf2-4d5471fcc419 service nova] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:05.330058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf1b0f-c67d-4348-abf2-4d5471fcc419 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:05.341688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf1b0f-c67d-4348-abf2-4d5471fcc419 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:05.346713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f93044-7f02-4858-8880-a66889389573 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:05.347608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f93044-7f02-4858-8880-a66889389573 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:05.347894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f93044-7f02-4858-8880-a66889389573 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:05.348170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f93044-7f02-4858-8880-a66889389573 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/2055b31564c840d798bc8024f85ee32a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:05.349602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f93044-7f02-4858-8880-a66889389573 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:get_project(project_id=2055b31564c840d798bc8024f85ee32a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:05.351960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f93044-7f02-4858-8880-a66889389573 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:05.353680 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1240/2466] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:05 2021] GET /identity/v3/projects/2055b31564c840d798bc8024f85ee32a => generated 369 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:06.121174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d396eb-0d49-4912-9942-90e623053d5f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:06.121810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d396eb-0d49-4912-9942-90e623053d5f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:06.122549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d396eb-0d49-4912-9942-90e623053d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:06.160163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-98d396eb-0d49-4912-9942-90e623053d5f None None] MFA Rules not processed for user `9322591436e34060a46c6f145dca61d7`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:06.162088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-98d396eb-0d49-4912-9942-90e623053d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:06.259641 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1227/2467] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:06 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:06.547436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c9ef-73b5-47fb-a18b-634bd07038b9 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:06.548335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c9ef-73b5-47fb-a18b-634bd07038b9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:06.548649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c9ef-73b5-47fb-a18b-634bd07038b9 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:06.550844 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1241/2468] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:06.557162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d396eb-0d49-4912-9942-90e623053d5f None None] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:06.572587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d396eb-0d49-4912-9942-90e623053d5f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:06.585487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d396eb-0d49-4912-9942-90e623053d5f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:06.591774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b55d5-a0a5-4b06-92cc-04d76cf9d40c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:06.592717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b55d5-a0a5-4b06-92cc-04d76cf9d40c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:06.593554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b55d5-a0a5-4b06-92cc-04d76cf9d40c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:06.593919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b55d5-a0a5-4b06-92cc-04d76cf9d40c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/2055b31564c840d798bc8024f85ee32a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:06.595853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b55d5-a0a5-4b06-92cc-04d76cf9d40c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:get_project(project_id=2055b31564c840d798bc8024f85ee32a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:06.597970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b55d5-a0a5-4b06-92cc-04d76cf9d40c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:06.600304 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1228/2469] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:06 2021] GET /identity/v3/projects/2055b31564c840d798bc8024f85ee32a => generated 369 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:06.646770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4c9ef-73b5-47fb-a18b-634bd07038b9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:06.663453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4c9ef-73b5-47fb-a18b-634bd07038b9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:06.669332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b03d45-d384-4f9e-bbb6-d69e7f3754d6 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:06.669988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b03d45-d384-4f9e-bbb6-d69e7f3754d6 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:06.670318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b03d45-d384-4f9e-bbb6-d69e7f3754d6 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:06.670629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b03d45-d384-4f9e-bbb6-d69e7f3754d6 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:06.671416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b03d45-d384-4f9e-bbb6-d69e7f3754d6 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:06.671729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b03d45-d384-4f9e-bbb6-d69e7f3754d6 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:06.674646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b03d45-d384-4f9e-bbb6-d69e7f3754d6 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:06.692304 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1242/2470] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:06.693829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b55d5-a0a5-4b06-92cc-04d76cf9d40c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:06.704562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b55d5-a0a5-4b06-92cc-04d76cf9d40c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:06.713548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9635-d623-47e6-abe9-f4899d2b0be2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:06.714623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9635-d623-47e6-abe9-f4899d2b0be2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:06.715184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9635-d623-47e6-abe9-f4899d2b0be2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:06.716001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9635-d623-47e6-abe9-f4899d2b0be2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:06.717587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f9635-d623-47e6-abe9-f4899d2b0be2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:06.719985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f9635-d623-47e6-abe9-f4899d2b0be2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:06.752224 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1229/2471] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:47:06 2021] POST /identity/v3/users => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:06.757552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b03d45-d384-4f9e-bbb6-d69e7f3754d6 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:06.774249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b03d45-d384-4f9e-bbb6-d69e7f3754d6 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:06.781481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80930b-1e3f-4214-a0fb-8918d477d3af tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:06.782493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80930b-1e3f-4214-a0fb-8918d477d3af tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:06.782924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80930b-1e3f-4214-a0fb-8918d477d3af tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:06.783415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80930b-1e3f-4214-a0fb-8918d477d3af tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:06.784360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80930b-1e3f-4214-a0fb-8918d477d3af tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:06.784833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80930b-1e3f-4214-a0fb-8918d477d3af tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:06.787794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80930b-1e3f-4214-a0fb-8918d477d3af tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:06.802912 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1243/2472] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:07.442023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9635-d623-47e6-abe9-f4899d2b0be2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:07.461383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9635-d623-47e6-abe9-f4899d2b0be2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:07.468681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215be47-70ad-4901-b053-09372f109352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:07.470344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215be47-70ad-4901-b053-09372f109352 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:07.470954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215be47-70ad-4901-b053-09372f109352 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:07.471713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215be47-70ad-4901-b053-09372f109352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:07.562259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215be47-70ad-4901-b053-09372f109352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:07.567246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e215be47-70ad-4901-b053-09372f109352 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:07.591803 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1230/2473] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:07 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:08.330879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70497-4d6e-4a50-87a8-e907d8b830a1 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:08.331365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70497-4d6e-4a50-87a8-e907d8b830a1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:08.331526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e70497-4d6e-4a50-87a8-e907d8b830a1 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:08.333988 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1244/2474] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:08.341490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215be47-70ad-4901-b053-09372f109352 service nova] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:08.355526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215be47-70ad-4901-b053-09372f109352 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:08.375769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215be47-70ad-4901-b053-09372f109352 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:08.381643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ce937-b059-47d9-abe3-ca7b87ca2a2b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:08.382540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce937-b059-47d9-abe3-ca7b87ca2a2b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:08.382876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce937-b059-47d9-abe3-ca7b87ca2a2b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:08.383153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ce937-b059-47d9-abe3-ca7b87ca2a2b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/2055b31564c840d798bc8024f85ee32a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:08.384398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ce937-b059-47d9-abe3-ca7b87ca2a2b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:get_project(project_id=2055b31564c840d798bc8024f85ee32a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:08.386419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ce937-b059-47d9-abe3-ca7b87ca2a2b tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:08.388219 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1231/2475] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:08 2021] GET /identity/v3/projects/2055b31564c840d798bc8024f85ee32a => generated 369 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:47:08.818808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6a13-c1e4-4280-a1a2-676cbf34351a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:08.819572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6a13-c1e4-4280-a1a2-676cbf34351a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:08.819857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f6a13-c1e4-4280-a1a2-676cbf34351a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:08.885603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-347f6a13-c1e4-4280-a1a2-676cbf34351a None None] MFA Rules not processed for user `5af01920574741f381a5dfefd9282bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:08.888603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-347f6a13-c1e4-4280-a1a2-676cbf34351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:09.027413 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1245/2476] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:08 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:09.125269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656913-1619-440d-b697-3e32f07ae7f9 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:09.126378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656913-1619-440d-b697-3e32f07ae7f9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:09.126378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656913-1619-440d-b697-3e32f07ae7f9 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:09.127715 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1232/2477] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:47:09.136804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f6a13-c1e4-4280-a1a2-676cbf34351a None None] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:09.137934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-347f6a13-c1e4-4280-a1a2-676cbf34351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:09.164035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f6a13-c1e4-4280-a1a2-676cbf34351a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:09.178247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f6a13-c1e4-4280-a1a2-676cbf34351a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:09.185178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19585ea0-7d09-4c99-ba17-078d50ad1e33 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:09.186473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585ea0-7d09-4c99-ba17-078d50ad1e33 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:09.186972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585ea0-7d09-4c99-ba17-078d50ad1e33 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:09.187503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585ea0-7d09-4c99-ba17-078d50ad1e33 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/2055b31564c840d798bc8024f85ee32a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:09.189245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19585ea0-7d09-4c99-ba17-078d50ad1e33 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:get_project(project_id=2055b31564c840d798bc8024f85ee32a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:09.193806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19585ea0-7d09-4c99-ba17-078d50ad1e33 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:09.215746 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1246/2478] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:09 2021] GET /identity/v3/projects/2055b31564c840d798bc8024f85ee32a => generated 369 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:09.247831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b656913-1619-440d-b697-3e32f07ae7f9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:09.266065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b656913-1619-440d-b697-3e32f07ae7f9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:09.286650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed07668-58ad-4814-b893-15b3b2d3fa7c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:09.288337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed07668-58ad-4814-b893-15b3b2d3fa7c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:09.288791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed07668-58ad-4814-b893-15b3b2d3fa7c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:09.289215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed07668-58ad-4814-b893-15b3b2d3fa7c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/users/64a9a2965ca3428ca61072d671945b37` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:09.319049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed07668-58ad-4814-b893-15b3b2d3fa7c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:delete_user(user_id=64a9a2965ca3428ca61072d671945b37)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:09.322505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed07668-58ad-4814-b893-15b3b2d3fa7c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:09.406798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ed07668-58ad-4814-b893-15b3b2d3fa7c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a9a2965ca3428ca61072d671945b37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:09.423077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ed07668-58ad-4814-b893-15b3b2d3fa7c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a9a2965ca3428ca61072d671945b37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:09.436633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ed07668-58ad-4814-b893-15b3b2d3fa7c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a9a2965ca3428ca61072d671945b37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:09.460357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ed07668-58ad-4814-b893-15b3b2d3fa7c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a9a2965ca3428ca61072d671945b37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:09.476224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ed07668-58ad-4814-b893-15b3b2d3fa7c tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a9a2965ca3428ca61072d671945b37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:09.484766 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1233/2479] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:47:09 2021] DELETE /identity/v3/users/64a9a2965ca3428ca61072d671945b37 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:09.488629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19585ea0-7d09-4c99-ba17-078d50ad1e33 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:09.491068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-19585ea0-7d09-4c99-ba17-078d50ad1e33 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:09.516892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19585ea0-7d09-4c99-ba17-078d50ad1e33 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:09.611389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:09.613009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:09.613531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:09.614017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/2055b31564c840d798bc8024f85ee32a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:09.616265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2055b31564c840d798bc8024f85ee32a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:09.618870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:09.677885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2055b31564c840d798bc8024f85ee32a', 'request_id': 'req-8dae3fa6-686c-49c7-8766-364a7530d6c5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:09.684551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2055b31564c840d798bc8024f85ee32a', 'request_id': 'req-8dae3fa6-686c-49c7-8766-364a7530d6c5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:09.692140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2055b31564c840d798bc8024f85ee32a', 'request_id': 'req-8dae3fa6-686c-49c7-8766-364a7530d6c5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:09.703110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] The token cache is being invalidate because project 2055b31564c840d798bc8024f85ee32a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:47:09.703519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:09.704309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8dae3fa6-686c-49c7-8766-364a7530d6c5 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:09.706309 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1247/2480] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:47:09 2021] DELETE /identity/v3/projects/2055b31564c840d798bc8024f85ee32a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:10.254263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36734531-b602-4d01-b0e9-7c9a3b5ff58e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:10.254802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36734531-b602-4d01-b0e9-7c9a3b5ff58e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:10.254802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36734531-b602-4d01-b0e9-7c9a3b5ff58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:10.275240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-36734531-b602-4d01-b0e9-7c9a3b5ff58e None None] MFA Rules not processed for user `2d326a07ce104727bec8ae98dabea64d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:10.276667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-36734531-b602-4d01-b0e9-7c9a3b5ff58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:10.368879 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1234/2481] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:10 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:10.523823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15c0b-dd73-45b2-8654-28e55b48d07a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:10.524327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15c0b-dd73-45b2-8654-28e55b48d07a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:10.524449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15c0b-dd73-45b2-8654-28e55b48d07a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:10.526750 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1248/2482] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:10.533060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36734531-b602-4d01-b0e9-7c9a3b5ff58e None None] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:10.535140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-36734531-b602-4d01-b0e9-7c9a3b5ff58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:10.655149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36734531-b602-4d01-b0e9-7c9a3b5ff58e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:10.656692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-36734531-b602-4d01-b0e9-7c9a3b5ff58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:10.761788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36734531-b602-4d01-b0e9-7c9a3b5ff58e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:10.767790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe2a5-2060-4f44-8b95-fc71be09f620 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:10.770739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe2a5-2060-4f44-8b95-fc71be09f620 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:10.771392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe2a5-2060-4f44-8b95-fc71be09f620 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:10.771991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fe2a5-2060-4f44-8b95-fc71be09f620 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:10.775344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fe2a5-2060-4f44-8b95-fc71be09f620 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:get_project(project_id=f3a8d93b8e0a432991b59ad1dd23a4c9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:10.777871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fe2a5-2060-4f44-8b95-fc71be09f620 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:10.796874 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1235/2483] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:10 2021] GET /identity/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9 => generated 375 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:12.430978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18cb58-1132-4004-839b-c847e089820f None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:12.431460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18cb58-1132-4004-839b-c847e089820f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:12.431561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18cb58-1132-4004-839b-c847e089820f None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:12.433440 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1249/2484] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:12.439552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe2a5-2060-4f44-8b95-fc71be09f620 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:12.456109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe2a5-2060-4f44-8b95-fc71be09f620 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:12.467196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fe2a5-2060-4f44-8b95-fc71be09f620 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:12.473921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aec79e-f92d-460f-bc89-ae7fd264e6b7 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:12.474948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec79e-f92d-460f-bc89-ae7fd264e6b7 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:12.475354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec79e-f92d-460f-bc89-ae7fd264e6b7 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:12.475720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aec79e-f92d-460f-bc89-ae7fd264e6b7 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:12.477398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aec79e-f92d-460f-bc89-ae7fd264e6b7 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:get_project(project_id=f3a8d93b8e0a432991b59ad1dd23a4c9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:12.479931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aec79e-f92d-460f-bc89-ae7fd264e6b7 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:12.482158 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1236/2485] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:12 2021] GET /identity/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9 => generated 375 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:13.548838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99386a55-71c9-4be8-bbf3-71c80ee1714a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:13.549361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99386a55-71c9-4be8-bbf3-71c80ee1714a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:13.549549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99386a55-71c9-4be8-bbf3-71c80ee1714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:13.573815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-99386a55-71c9-4be8-bbf3-71c80ee1714a None None] MFA Rules not processed for user `3cb6bc63929648388ac9648823d4ca88`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:13.575367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-99386a55-71c9-4be8-bbf3-71c80ee1714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:13.641321 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1250/2486] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:13 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:47:13.804448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894876-8400-450e-a770-697b432b1958 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:13.805511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894876-8400-450e-a770-697b432b1958 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:13.806022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65894876-8400-450e-a770-697b432b1958 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:13.808112 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1237/2487] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:13.820654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99386a55-71c9-4be8-bbf3-71c80ee1714a None None] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:13.834702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99386a55-71c9-4be8-bbf3-71c80ee1714a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:13.858395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99386a55-71c9-4be8-bbf3-71c80ee1714a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:13.866433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec673a3-6636-4eec-b066-a756715287e2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a52683efcc7c4e1597800e2112d2303a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1986979ca0fe469ca150e0ecc8a059ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:13.867644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec673a3-6636-4eec-b066-a756715287e2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:13.868275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec673a3-6636-4eec-b066-a756715287e2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:13.868777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec673a3-6636-4eec-b066-a756715287e2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] PATH_INFO: `/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:13.870897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec673a3-6636-4eec-b066-a756715287e2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorizing `identity:get_project(project_id=f3a8d93b8e0a432991b59ad1dd23a4c9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:13.885793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec673a3-6636-4eec-b066-a756715287e2 tempest-QuotasAdminTestJSON-792169355 tempest-QuotasAdminTestJSON-792169355-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:13.891554 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1251/2488] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:13 2021] GET /identity/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9 => generated 375 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:14.409835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65894876-8400-450e-a770-697b432b1958 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:14.411993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-65894876-8400-450e-a770-697b432b1958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:14.534608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65894876-8400-450e-a770-697b432b1958 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:14.542955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:14.544264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:14.544762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:14.545267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] PATH_INFO: `/v3/users/6daf122437744fd0800ee705d9e23b00` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:14.547287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6daf122437744fd0800ee705d9e23b00)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:14.549494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:14.620884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6daf122437744fd0800ee705d9e23b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:14.630583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6daf122437744fd0800ee705d9e23b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:14.631694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6daf122437744fd0800ee705d9e23b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:14.640826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6daf122437744fd0800ee705d9e23b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:14.657588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6daf122437744fd0800ee705d9e23b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:14.671346 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1238/2489] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:47:14 2021] DELETE /identity/v3/users/6daf122437744fd0800ee705d9e23b00 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:14.675865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ffb6-76d7-4a53-bf0d-733f47edfb4e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:14.676801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ffb6-76d7-4a53-bf0d-733f47edfb4e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:14.677247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ffb6-76d7-4a53-bf0d-733f47edfb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:14.725128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c576ffb6-76d7-4a53-bf0d-733f47edfb4e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:14.727462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c576ffb6-76d7-4a53-bf0d-733f47edfb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:14.807714 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1252/2490] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:14.846504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:14.849560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:14.920723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d402e9-f2e8-4951-b1e3-e78e2968fc26 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:14.924843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f168572-7afc-44ad-80c0-59d7c40bc6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:14.925664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f168572-7afc-44ad-80c0-59d7c40bc6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:14.926122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f168572-7afc-44ad-80c0-59d7c40bc6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:14.926545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f168572-7afc-44ad-80c0-59d7c40bc6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:14.937769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f168572-7afc-44ad-80c0-59d7c40bc6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:14.939602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f168572-7afc-44ad-80c0-59d7c40bc6a8 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:14.951765 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1239/2491] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:15.430573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576ffb6-76d7-4a53-bf0d-733f47edfb4e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:15.434571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c576ffb6-76d7-4a53-bf0d-733f47edfb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:15.459193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576ffb6-76d7-4a53-bf0d-733f47edfb4e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:15.472902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:15.474327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:15.476419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:15.476741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] PATH_INFO: `/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:15.479279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a8d93b8e0a432991b59ad1dd23a4c9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:15.482304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:15.539702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a8d93b8e0a432991b59ad1dd23a4c9', 'request_id': 'req-646f91b1-fb42-40cb-9a70-e249743e91a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:15.547568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a8d93b8e0a432991b59ad1dd23a4c9', 'request_id': 'req-646f91b1-fb42-40cb-9a70-e249743e91a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:15.558818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a8d93b8e0a432991b59ad1dd23a4c9', 'request_id': 'req-646f91b1-fb42-40cb-9a70-e249743e91a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:15.574185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] The token cache is being invalidate because project f3a8d93b8e0a432991b59ad1dd23a4c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:47:15.574565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:15.575469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:15.577578 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1253/2492] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:47:15 2021] DELETE /identity/v3/projects/f3a8d93b8e0a432991b59ad1dd23a4c9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:15.582185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f168572-7afc-44ad-80c0-59d7c40bc6a8 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:15.595431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f168572-7afc-44ad-80c0-59d7c40bc6a8 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:15.673490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:15.674428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:15.674646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:15.674979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] PATH_INFO: `/v3/users/a52683efcc7c4e1597800e2112d2303a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:15.676645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52683efcc7c4e1597800e2112d2303a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:15.679317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:15.737982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52683efcc7c4e1597800e2112d2303a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:15.752895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52683efcc7c4e1597800e2112d2303a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:15.754207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52683efcc7c4e1597800e2112d2303a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:15.766433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52683efcc7c4e1597800e2112d2303a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:15.797655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52683efcc7c4e1597800e2112d2303a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:15.809516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:15.811187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:15.818429 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1240/2493] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:47:15 2021] DELETE /identity/v3/users/a52683efcc7c4e1597800e2112d2303a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:47:15.912785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f91b1-fb42-40cb-9a70-e249743e91a0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:16.017985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918f696-56e1-40fc-942d-1cbf1bd18498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:16.019510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918f696-56e1-40fc-942d-1cbf1bd18498 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:16.019969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918f696-56e1-40fc-942d-1cbf1bd18498 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:16.020918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918f696-56e1-40fc-942d-1cbf1bd18498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:16.024613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f918f696-56e1-40fc-942d-1cbf1bd18498 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:16.134706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918f696-56e1-40fc-942d-1cbf1bd18498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:16.138770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918f696-56e1-40fc-942d-1cbf1bd18498 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:16.156654 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1254/2494] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:15 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:47:16.898520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:16.900780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:16.979224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e82ad4-59d2-4ac0-b3ee-1ed3d3f7ef87 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:16.990001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:16.996867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:16.997166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:16.997611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] PATH_INFO: `/v3/projects/1986979ca0fe469ca150e0ecc8a059ea` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:16.999601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1986979ca0fe469ca150e0ecc8a059ea)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:17.001668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:17.067978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1986979ca0fe469ca150e0ecc8a059ea', 'request_id': 'req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:17.078819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1986979ca0fe469ca150e0ecc8a059ea', 'request_id': 'req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:17.088992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1986979ca0fe469ca150e0ecc8a059ea', 'request_id': 'req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:17.104853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] The token cache is being invalidate because project 1986979ca0fe469ca150e0ecc8a059ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:47:17.105486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:17.106281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94ef0d49-9eb4-42bc-a6cc-44c43d3020b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:17.111305 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1241/2495] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:47:16 2021] DELETE /identity/v3/projects/1986979ca0fe469ca150e0ecc8a059ea => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:17.116813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7ffb-b4f6-470d-bea0-f905d9656194 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:17.117338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7ffb-b4f6-470d-bea0-f905d9656194 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:17.117753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7ffb-b4f6-470d-bea0-f905d9656194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:17.147307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-db4c7ffb-b4f6-470d-bea0-f905d9656194 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:17.149918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-db4c7ffb-b4f6-470d-bea0-f905d9656194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:17.226329 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1255/2496] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:17.234716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81df71-3909-41ee-b535-11064e0ee6b7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:17.235232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81df71-3909-41ee-b535-11064e0ee6b7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:17.236249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81df71-3909-41ee-b535-11064e0ee6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:17.255074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ff81df71-3909-41ee-b535-11064e0ee6b7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:17.256430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ff81df71-3909-41ee-b535-11064e0ee6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:17.267302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1242/2497] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:17.269992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c7ffb-b4f6-470d-bea0-f905d9656194 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:17.280157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c7ffb-b4f6-470d-bea0-f905d9656194 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:17.285051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5692e-f22e-4a1a-a82d-377fc499a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:17.286469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5692e-f22e-4a1a-a82d-377fc499a457 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:17.287059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5692e-f22e-4a1a-a82d-377fc499a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:17.287562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5692e-f22e-4a1a-a82d-377fc499a457 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:17.289700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5692e-f22e-4a1a-a82d-377fc499a457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:17.290019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5692e-f22e-4a1a-a82d-377fc499a457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:17.291644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5692e-f22e-4a1a-a82d-377fc499a457 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:17.306341 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1256/2498] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:47:17.315117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81df71-3909-41ee-b535-11064e0ee6b7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:17.325581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81df71-3909-41ee-b535-11064e0ee6b7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:17.331011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492ccf4-69bd-426e-b19f-c92bb2fc00af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:17.332537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ccf4-69bd-426e-b19f-c92bb2fc00af admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:17.333174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ccf4-69bd-426e-b19f-c92bb2fc00af admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:17.333746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ccf4-69bd-426e-b19f-c92bb2fc00af admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:17.334346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492ccf4-69bd-426e-b19f-c92bb2fc00af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:17.336388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492ccf4-69bd-426e-b19f-c92bb2fc00af admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:17.372834 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1243/2499] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:47:17 2021] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:17.376510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5692e-f22e-4a1a-a82d-377fc499a457 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:17.389541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5692e-f22e-4a1a-a82d-377fc499a457 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:17.458618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8792edb-799c-4c30-a4c8-2c532a59e288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:17.459376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8792edb-799c-4c30-a4c8-2c532a59e288 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:17.459656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8792edb-799c-4c30-a4c8-2c532a59e288 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:17.459925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8792edb-799c-4c30-a4c8-2c532a59e288 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:17.460634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8792edb-799c-4c30-a4c8-2c532a59e288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:17.462664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8792edb-799c-4c30-a4c8-2c532a59e288 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:17.491455 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1257/2500] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:47:17 2021] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:17.497300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492ccf4-69bd-426e-b19f-c92bb2fc00af admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:17.513569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492ccf4-69bd-426e-b19f-c92bb2fc00af admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:17.519771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2b1e4-0047-4658-ba03-7cbb254cf79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:17.522513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2b1e4-0047-4658-ba03-7cbb254cf79d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:17.523143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2b1e4-0047-4658-ba03-7cbb254cf79d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:17.523662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2b1e4-0047-4658-ba03-7cbb254cf79d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:17.524630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2b1e4-0047-4658-ba03-7cbb254cf79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:17.526754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2b1e4-0047-4658-ba03-7cbb254cf79d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:17.546323 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1244/2501] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:17 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:17.550862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8792edb-799c-4c30-a4c8-2c532a59e288 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:17.570728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8792edb-799c-4c30-a4c8-2c532a59e288 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:17.587763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c463d5-c5ba-48da-88fb-bbe9d16a7518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:17.588909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c463d5-c5ba-48da-88fb-bbe9d16a7518 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:17.589987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c463d5-c5ba-48da-88fb-bbe9d16a7518 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:17.590486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c463d5-c5ba-48da-88fb-bbe9d16a7518 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:17.591709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c463d5-c5ba-48da-88fb-bbe9d16a7518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:17.593622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c463d5-c5ba-48da-88fb-bbe9d16a7518 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:17.610491 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1258/2502] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:17 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:17.611485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2b1e4-0047-4658-ba03-7cbb254cf79d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:17.624818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2b1e4-0047-4658-ba03-7cbb254cf79d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:17.635384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c9781-273e-417e-a598-1b4b5b14902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:17.637351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c9781-273e-417e-a598-1b4b5b14902d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:17.639287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c9781-273e-417e-a598-1b4b5b14902d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:17.639665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c9781-273e-417e-a598-1b4b5b14902d admin admin] PATH_INFO: `/v3/projects/f4c4ec547cb840df84c2c625324d2608/users/11c877def93543b5978814a3cc0fa0b5/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:17.677344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c9781-273e-417e-a598-1b4b5b14902d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c4ec547cb840df84c2c625324d2608, user_id=11c877def93543b5978814a3cc0fa0b5, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:17.681175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c9781-273e-417e-a598-1b4b5b14902d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:17.718021 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1245/2503] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:47:17 2021] PUT /identity/v3/projects/f4c4ec547cb840df84c2c625324d2608/users/11c877def93543b5978814a3cc0fa0b5/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:17.729372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd30ed-de84-4c33-b7cb-f030270c27ad None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:17.729674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd30ed-de84-4c33-b7cb-f030270c27ad None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:17.729909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd30ed-de84-4c33-b7cb-f030270c27ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:17.805739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cafd30ed-de84-4c33-b7cb-f030270c27ad None None] MFA Rules not processed for user `11c877def93543b5978814a3cc0fa0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:17.807286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cafd30ed-de84-4c33-b7cb-f030270c27ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:17.955092 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1259/2504] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:17 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:17.955299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c9781-273e-417e-a598-1b4b5b14902d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:18.038647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c9781-273e-417e-a598-1b4b5b14902d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:18.044909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478b519-c15a-49ef-98c7-8f9ee7d8c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:18.045688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478b519-c15a-49ef-98c7-8f9ee7d8c5ea admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.046076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478b519-c15a-49ef-98c7-8f9ee7d8c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.046420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478b519-c15a-49ef-98c7-8f9ee7d8c5ea admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.047162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478b519-c15a-49ef-98c7-8f9ee7d8c5ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:18.049363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478b519-c15a-49ef-98c7-8f9ee7d8c5ea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:18.079318 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1246/2505] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:47:17 2021] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:18.082154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd30ed-de84-4c33-b7cb-f030270c27ad None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:18.096370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd30ed-de84-4c33-b7cb-f030270c27ad None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:18.166676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c74b1b-276b-4f51-8a95-9e4dec445a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:18.167367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74b1b-276b-4f51-8a95-9e4dec445a1c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.167646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74b1b-276b-4f51-8a95-9e4dec445a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.167927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74b1b-276b-4f51-8a95-9e4dec445a1c admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.168947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c74b1b-276b-4f51-8a95-9e4dec445a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:18.170557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c74b1b-276b-4f51-8a95-9e4dec445a1c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:18.201520 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1260/2506] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:47:18 2021] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:18.202777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478b519-c15a-49ef-98c7-8f9ee7d8c5ea admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:18.216610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478b519-c15a-49ef-98c7-8f9ee7d8c5ea admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:18.222257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bff9fd-7172-429a-9039-5a9695551415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:18.223057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bff9fd-7172-429a-9039-5a9695551415 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.223450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bff9fd-7172-429a-9039-5a9695551415 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.223728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bff9fd-7172-429a-9039-5a9695551415 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.224466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bff9fd-7172-429a-9039-5a9695551415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:18.226445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bff9fd-7172-429a-9039-5a9695551415 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:18.239892 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1247/2507] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:18 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:18.244044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c74b1b-276b-4f51-8a95-9e4dec445a1c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:18.255932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c74b1b-276b-4f51-8a95-9e4dec445a1c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:18.261953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49731e8b-8f74-4263-b388-17a0e9641c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:18.262861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49731e8b-8f74-4263-b388-17a0e9641c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.263145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49731e8b-8f74-4263-b388-17a0e9641c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.263511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49731e8b-8f74-4263-b388-17a0e9641c49 admin admin] PATH_INFO: `/v3/projects/f72dbd4a564c4ae5bdf68f6f98f06c5c/users/9c47869491c3420aa9eb54c6cf417d37/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.282922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49731e8b-8f74-4263-b388-17a0e9641c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72dbd4a564c4ae5bdf68f6f98f06c5c, user_id=9c47869491c3420aa9eb54c6cf417d37, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:18.286494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49731e8b-8f74-4263-b388-17a0e9641c49 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:18.306606 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1261/2508] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:47:18 2021] PUT /identity/v3/projects/f72dbd4a564c4ae5bdf68f6f98f06c5c/users/9c47869491c3420aa9eb54c6cf417d37/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:18.310745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bff9fd-7172-429a-9039-5a9695551415 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:18.324688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df21c73-5250-435c-b462-34d258e600e1 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.325212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df21c73-5250-435c-b462-34d258e600e1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.325814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df21c73-5250-435c-b462-34d258e600e1 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.328262 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1262/2509] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:47:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:18.330749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bff9fd-7172-429a-9039-5a9695551415 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:18.336297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c89537-6cf8-4e18-a41b-f2ab0de27717 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.336776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c89537-6cf8-4e18-a41b-f2ab0de27717 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.337252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c89537-6cf8-4e18-a41b-f2ab0de27717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.371793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c1c89537-6cf8-4e18-a41b-f2ab0de27717 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:18.373294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c1c89537-6cf8-4e18-a41b-f2ab0de27717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:18.423213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c737c1-da1f-492e-819c-9be08edc1d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:18.424093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c737c1-da1f-492e-819c-9be08edc1d78 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.424499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c737c1-da1f-492e-819c-9be08edc1d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.429762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c737c1-da1f-492e-819c-9be08edc1d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.429762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c737c1-da1f-492e-819c-9be08edc1d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:18.429762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c737c1-da1f-492e-819c-9be08edc1d78 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:18.443015 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1248/2510] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:18 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:18.444424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c737c1-da1f-492e-819c-9be08edc1d78 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:18.459840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c737c1-da1f-492e-819c-9be08edc1d78 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:18.472826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf377e44-768a-4c14-b7c9-c7f003395bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:18.473927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf377e44-768a-4c14-b7c9-c7f003395bab admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.474204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf377e44-768a-4c14-b7c9-c7f003395bab admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.474471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf377e44-768a-4c14-b7c9-c7f003395bab admin admin] PATH_INFO: `/v3/projects/f72dbd4a564c4ae5bdf68f6f98f06c5c/users/9c47869491c3420aa9eb54c6cf417d37/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.477128 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1263/2511] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:47:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:18.479245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf377e44-768a-4c14-b7c9-c7f003395bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72dbd4a564c4ae5bdf68f6f98f06c5c, user_id=9c47869491c3420aa9eb54c6cf417d37, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:18.483054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf377e44-768a-4c14-b7c9-c7f003395bab admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:18.497398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c89537-6cf8-4e18-a41b-f2ab0de27717 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:18.498776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c1c89537-6cf8-4e18-a41b-f2ab0de27717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:18.500130 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1249/2512] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:47:18 2021] PUT /identity/v3/projects/f72dbd4a564c4ae5bdf68f6f98f06c5c/users/9c47869491c3420aa9eb54c6cf417d37/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:18.511572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0189-3615-4cfe-802c-6b655adcd184 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.511859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0189-3615-4cfe-802c-6b655adcd184 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.512136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0189-3615-4cfe-802c-6b655adcd184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.514984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c89537-6cf8-4e18-a41b-f2ab0de27717 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:18.570273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-36ad0189-3615-4cfe-802c-6b655adcd184 None None] MFA Rules not processed for user `9c47869491c3420aa9eb54c6cf417d37`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:18.572067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-36ad0189-3615-4cfe-802c-6b655adcd184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:18.622751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c04c5-864b-40a2-b389-d86ee076e9c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:18.624678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c04c5-864b-40a2-b389-d86ee076e9c0 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.625152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c04c5-864b-40a2-b389-d86ee076e9c0 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.626168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c04c5-864b-40a2-b389-d86ee076e9c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.639668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c04c5-864b-40a2-b389-d86ee076e9c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:18.641929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c04c5-864b-40a2-b389-d86ee076e9c0 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:18.667949 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1264/2513] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:47:18.670605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c04c5-864b-40a2-b389-d86ee076e9c0 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:18.673353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4e1c04c5-864b-40a2-b389-d86ee076e9c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:18.698503 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1250/2514] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:18 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:18.699662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad0189-3615-4cfe-802c-6b655adcd184 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:18.710361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad0189-3615-4cfe-802c-6b655adcd184 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:18.716740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808d501-b82d-4f6a-83d4-22029ecab82d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:18.726847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808d501-b82d-4f6a-83d4-22029ecab82d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.727275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808d501-b82d-4f6a-83d4-22029ecab82d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.727584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808d501-b82d-4f6a-83d4-22029ecab82d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.728491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808d501-b82d-4f6a-83d4-22029ecab82d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:18.728965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808d501-b82d-4f6a-83d4-22029ecab82d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:18.732909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5808d501-b82d-4f6a-83d4-22029ecab82d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:18.749942 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1251/2515] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:18.753957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808d501-b82d-4f6a-83d4-22029ecab82d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:18.765101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5808d501-b82d-4f6a-83d4-22029ecab82d tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:18.771425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66fa89-8886-4807-9f83-a7367fac8c28 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:18.772405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66fa89-8886-4807-9f83-a7367fac8c28 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.772894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66fa89-8886-4807-9f83-a7367fac8c28 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.773572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66fa89-8886-4807-9f83-a7367fac8c28 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.775301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66fa89-8886-4807-9f83-a7367fac8c28 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:18.777596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66fa89-8886-4807-9f83-a7367fac8c28 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:18.810834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c04c5-864b-40a2-b389-d86ee076e9c0 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:18.816232 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1252/2516] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:47:18 2021] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:18.820907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66fa89-8886-4807-9f83-a7367fac8c28 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:18.822580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:18.823500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.826818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.827108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] PATH_INFO: `/v3/users/20eeec6e0aa04a599f98e217d1cd3fff` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.831505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=20eeec6e0aa04a599f98e217d1cd3fff)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:18.833715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:18.932087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66fa89-8886-4807-9f83-a7367fac8c28 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:18.932643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20eeec6e0aa04a599f98e217d1cd3fff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:18.933508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20eeec6e0aa04a599f98e217d1cd3fff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:18.940384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c03384-edff-4b78-8014-1469bac9f943 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:18.941222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03384-edff-4b78-8014-1469bac9f943 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.941670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03384-edff-4b78-8014-1469bac9f943 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.942118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03384-edff-4b78-8014-1469bac9f943 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:18.943555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c03384-edff-4b78-8014-1469bac9f943 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:18.943823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c03384-edff-4b78-8014-1469bac9f943 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:18.944444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20eeec6e0aa04a599f98e217d1cd3fff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:18.945218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20eeec6e0aa04a599f98e217d1cd3fff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:18.945644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c03384-edff-4b78-8014-1469bac9f943 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:18.961684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20eeec6e0aa04a599f98e217d1cd3fff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:18.985554 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1253/2517] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:18.993701 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1265/2518] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:47:18 2021] DELETE /identity/v3/users/20eeec6e0aa04a599f98e217d1cd3fff => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:18.998850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a46d-c895-4101-965c-a2aee3149c42 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:18.999233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a46d-c895-4101-965c-a2aee3149c42 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:18.999783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360a46d-c895-4101-965c-a2aee3149c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:19.033227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1360a46d-c895-4101-965c-a2aee3149c42 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:19.037652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1360a46d-c895-4101-965c-a2aee3149c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:19.126620 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1254/2519] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:19.137086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:19.138640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:19.200803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660af634-b599-40fd-b29e-def22ff7e2dc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:19.214129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ff3b7-f600-4f49-a705-657eaa0d33a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:19.214522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff3b7-f600-4f49-a705-657eaa0d33a4 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:19.214805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff3b7-f600-4f49-a705-657eaa0d33a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:19.215078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff3b7-f600-4f49-a705-657eaa0d33a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:19.226234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ff3b7-f600-4f49-a705-657eaa0d33a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:19.228265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ff3b7-f600-4f49-a705-657eaa0d33a4 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:19.240290 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1266/2520] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:19.353737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e079d-eb58-4fba-900d-d46b8aba7303 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:19.353997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e079d-eb58-4fba-900d-d46b8aba7303 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:19.354171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e079d-eb58-4fba-900d-d46b8aba7303 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:19.356868 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1255/2521] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:47:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:19.363024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd0b6-49db-4f8e-b500-7f9c743b838e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:19.363430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd0b6-49db-4f8e-b500-7f9c743b838e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:19.363802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd0b6-49db-4f8e-b500-7f9c743b838e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:19.397865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6a3cd0b6-49db-4f8e-b500-7f9c743b838e None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:19.399926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6a3cd0b6-49db-4f8e-b500-7f9c743b838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:19.508022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e079d-eb58-4fba-900d-d46b8aba7303 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:19.510934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4b6e079d-eb58-4fba-900d-d46b8aba7303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:19.544737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e079d-eb58-4fba-900d-d46b8aba7303 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:19.569721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:19.573471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:19.573875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:19.575604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] PATH_INFO: `/v3/projects/6a03ea486bb44aa29cb6760d77139ca1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:19.577490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a03ea486bb44aa29cb6760d77139ca1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:19.581001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:19.581671 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1267/2522] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:47:19 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:47:19.604021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cd0b6-49db-4f8e-b500-7f9c743b838e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:19.618685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cd0b6-49db-4f8e-b500-7f9c743b838e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:19.635816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afbd4d-4e29-45cc-8df3-b11268cd49bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:19.636639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afbd4d-4e29-45cc-8df3-b11268cd49bb service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:19.640600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afbd4d-4e29-45cc-8df3-b11268cd49bb service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:19.641047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afbd4d-4e29-45cc-8df3-b11268cd49bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:19.673775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afbd4d-4e29-45cc-8df3-b11268cd49bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:19.675959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afbd4d-4e29-45cc-8df3-b11268cd49bb service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:19.699048 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1268/2523] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:19 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:47:19.710141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a03ea486bb44aa29cb6760d77139ca1', 'request_id': 'req-2f1c4d80-e109-4f21-a993-1236ca47bbd7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:19.718158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a4eda-bcff-42ee-95e2-a299adabc5a8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:19.718706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a4eda-bcff-42ee-95e2-a299adabc5a8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:19.719287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a4eda-bcff-42ee-95e2-a299adabc5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:19.729293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a03ea486bb44aa29cb6760d77139ca1', 'request_id': 'req-2f1c4d80-e109-4f21-a993-1236ca47bbd7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:19.744335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a03ea486bb44aa29cb6760d77139ca1', 'request_id': 'req-2f1c4d80-e109-4f21-a993-1236ca47bbd7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:19.751464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-441a4eda-bcff-42ee-95e2-a299adabc5a8 None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:19.753000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-441a4eda-bcff-42ee-95e2-a299adabc5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:19.767289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] The token cache is being invalidate because project 6a03ea486bb44aa29cb6760d77139ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:47:19.767289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:19.769121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:19.775144 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1256/2524] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:47:19 2021] DELETE /identity/v3/projects/6a03ea486bb44aa29cb6760d77139ca1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:47:19.776503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:19.779421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:19.895987 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1269/2525] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:47:19 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:19.896990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a4eda-bcff-42ee-95e2-a299adabc5a8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:19.898553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-441a4eda-bcff-42ee-95e2-a299adabc5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:19.930107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c4d80-e109-4f21-a993-1236ca47bbd7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:19.937437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:19.938552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:19.938989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:19.939439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] PATH_INFO: `/v3/users/b7734f16383144daa3a0fe07da592b7a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:19.944186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7734f16383144daa3a0fe07da592b7a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:19.946892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:20.050922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7734f16383144daa3a0fe07da592b7a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:20.061484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7734f16383144daa3a0fe07da592b7a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:20.063051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7734f16383144daa3a0fe07da592b7a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:20.068702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a4eda-bcff-42ee-95e2-a299adabc5a8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:20.074914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7734f16383144daa3a0fe07da592b7a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:20.075344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b4cb4-897d-4274-a37a-6653460e1d0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:20.076004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4cb4-897d-4274-a37a-6653460e1d0b service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:20.076269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4cb4-897d-4274-a37a-6653460e1d0b service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:20.076540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b4cb4-897d-4274-a37a-6653460e1d0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:20.078364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5b1b4cb4-897d-4274-a37a-6653460e1d0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:20.093492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7734f16383144daa3a0fe07da592b7a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:20.108035 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1257/2526] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:47:19 2021] DELETE /identity/v3/users/b7734f16383144daa3a0fe07da592b7a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:20.108035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:20.110761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:20.198392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b4cb4-897d-4274-a37a-6653460e1d0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:20.202311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b4cb4-897d-4274-a37a-6653460e1d0b service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:20.225134 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1270/2527] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:19 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:20.225773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b0247-0b24-45d1-bdb8-34cd1751e85b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:20.232044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5402-63e2-4b64-ab41-db595f95ff6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:20.233061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5402-63e2-4b64-ab41-db595f95ff6e service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:20.233342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5402-63e2-4b64-ab41-db595f95ff6e service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:20.233614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5402-63e2-4b64-ab41-db595f95ff6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:20.235896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cf8a5402-63e2-4b64-ab41-db595f95ff6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:20.251109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a5402-63e2-4b64-ab41-db595f95ff6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:20.253877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a5402-63e2-4b64-ab41-db595f95ff6e service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:20.257833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3082f-5c42-42fd-8f43-af2a18243102 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:20.258166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3082f-5c42-42fd-8f43-af2a18243102 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:20.258412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f3082f-5c42-42fd-8f43-af2a18243102 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:20.260667 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1271/2528] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:47:20.265448 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1258/2529] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:20.265607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3082f-5c42-42fd-8f43-af2a18243102 None None] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:20.267353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f3f3082f-5c42-42fd-8f43-af2a18243102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:20.368484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3082f-5c42-42fd-8f43-af2a18243102 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:20.471300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f3082f-5c42-42fd-8f43-af2a18243102 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:20.476568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3662cd2-db18-4674-bcd0-d4c275ac7c02 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:20.477304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662cd2-db18-4674-bcd0-d4c275ac7c02 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:20.477597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662cd2-db18-4674-bcd0-d4c275ac7c02 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:20.477875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662cd2-db18-4674-bcd0-d4c275ac7c02 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/projects/f55cafe46c304ef18fdfa71c9e03fd4e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:20.479126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3662cd2-db18-4674-bcd0-d4c275ac7c02 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:get_project(project_id=f55cafe46c304ef18fdfa71c9e03fd4e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:20.482376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3662cd2-db18-4674-bcd0-d4c275ac7c02 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:20.483331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5402-63e2-4b64-ab41-db595f95ff6e service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:20.483998 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1272/2530] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:20 2021] GET /identity/v3/projects/f55cafe46c304ef18fdfa71c9e03fd4e => generated 371 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:20.485335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cf8a5402-63e2-4b64-ab41-db595f95ff6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:20.596085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5402-63e2-4b64-ab41-db595f95ff6e service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:20.610380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:20.611282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:20.611713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:20.612096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] PATH_INFO: `/v3/projects/cfdb8173e3b64499a9ae524eab985b25` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:20.613481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfdb8173e3b64499a9ae524eab985b25)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:20.618006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:20.695880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfdb8173e3b64499a9ae524eab985b25', 'request_id': 'req-15976db8-3d1d-4e5e-a7f2-bce538b8de97'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:20.720629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfdb8173e3b64499a9ae524eab985b25', 'request_id': 'req-15976db8-3d1d-4e5e-a7f2-bce538b8de97'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:20.730506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfdb8173e3b64499a9ae524eab985b25', 'request_id': 'req-15976db8-3d1d-4e5e-a7f2-bce538b8de97'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:20.747222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] The token cache is being invalidate because project cfdb8173e3b64499a9ae524eab985b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:47:20.747826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:20.748693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-15976db8-3d1d-4e5e-a7f2-bce538b8de97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:20.757179 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1259/2531] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:47:20 2021] DELETE /identity/v3/projects/cfdb8173e3b64499a9ae524eab985b25 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:47:20.758702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97d04f-c4b5-401f-9ced-201a16a7753a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:20.758933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97d04f-c4b5-401f-9ced-201a16a7753a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:20.759208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97d04f-c4b5-401f-9ced-201a16a7753a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:20.807162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1e97d04f-c4b5-401f-9ced-201a16a7753a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:20.809755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1e97d04f-c4b5-401f-9ced-201a16a7753a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:20.937158 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1273/2532] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:20.949203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152547-62e8-4bb3-a15d-3ebe31bb24e9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:20.949491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152547-62e8-4bb3-a15d-3ebe31bb24e9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:20.949772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18152547-62e8-4bb3-a15d-3ebe31bb24e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:20.980687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-18152547-62e8-4bb3-a15d-3ebe31bb24e9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:20.982197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-18152547-62e8-4bb3-a15d-3ebe31bb24e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:20.997926 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1260/2533] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:20.998806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97d04f-c4b5-401f-9ced-201a16a7753a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.019506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97d04f-c4b5-401f-9ced-201a16a7753a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:21.030385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d02d0-f50c-484e-abb1-1d23d1b8f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:21.031040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d02d0-f50c-484e-abb1-1d23d1b8f445 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.031427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d02d0-f50c-484e-abb1-1d23d1b8f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.032152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d02d0-f50c-484e-abb1-1d23d1b8f445 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.032586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d02d0-f50c-484e-abb1-1d23d1b8f445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:21.032967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d02d0-f50c-484e-abb1-1d23d1b8f445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:21.035006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d02d0-f50c-484e-abb1-1d23d1b8f445 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:21.061927 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1274/2534] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:47:21.066723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18152547-62e8-4bb3-a15d-3ebe31bb24e9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.083543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18152547-62e8-4bb3-a15d-3ebe31bb24e9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:21.089539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25282-0af8-4b6f-b7b5-8d90d6b75fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:21.090202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25282-0af8-4b6f-b7b5-8d90d6b75fac admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.090482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25282-0af8-4b6f-b7b5-8d90d6b75fac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.090754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25282-0af8-4b6f-b7b5-8d90d6b75fac admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.091504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac25282-0af8-4b6f-b7b5-8d90d6b75fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:21.093784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac25282-0af8-4b6f-b7b5-8d90d6b75fac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:21.135722 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1261/2535] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:47:21 2021] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:21.139773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d02d0-f50c-484e-abb1-1d23d1b8f445 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.151348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d02d0-f50c-484e-abb1-1d23d1b8f445 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:21.225276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd1e32-5387-4b2e-85e9-dff690f4eabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:21.226974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd1e32-5387-4b2e-85e9-dff690f4eabb admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.227449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd1e32-5387-4b2e-85e9-dff690f4eabb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.228205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd1e32-5387-4b2e-85e9-dff690f4eabb admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.228611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd1e32-5387-4b2e-85e9-dff690f4eabb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:21.231076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd1e32-5387-4b2e-85e9-dff690f4eabb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:21.260434 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1275/2536] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:47:21 2021] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:47:21.265605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25282-0af8-4b6f-b7b5-8d90d6b75fac admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.277639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25282-0af8-4b6f-b7b5-8d90d6b75fac admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:21.284173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0376c9-03e4-465d-882c-85053e23f6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:21.284902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0376c9-03e4-465d-882c-85053e23f6fe admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.285332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0376c9-03e4-465d-882c-85053e23f6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.285608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0376c9-03e4-465d-882c-85053e23f6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.286823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0376c9-03e4-465d-882c-85053e23f6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:21.288804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0376c9-03e4-465d-882c-85053e23f6fe admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:21.314489 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1262/2537] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:21 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:21.314670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7f31b-71ce-4300-b577-adcf2377e252 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.314670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7f31b-71ce-4300-b577-adcf2377e252 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.314670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7f31b-71ce-4300-b577-adcf2377e252 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.316280 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1276/2538] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:47:21.317999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0376c9-03e4-465d-882c-85053e23f6fe admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.329147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7f31b-71ce-4300-b577-adcf2377e252 None None] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:21.331778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-25e7f31b-71ce-4300-b577-adcf2377e252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:21.334783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0376c9-03e4-465d-882c-85053e23f6fe admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:21.346374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48936cba-1fc0-4b05-9d7a-b751e9670255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:21.347049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48936cba-1fc0-4b05-9d7a-b751e9670255 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.347358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48936cba-1fc0-4b05-9d7a-b751e9670255 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.347632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48936cba-1fc0-4b05-9d7a-b751e9670255 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.348409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48936cba-1fc0-4b05-9d7a-b751e9670255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:21.350182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48936cba-1fc0-4b05-9d7a-b751e9670255 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:21.365231 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1263/2539] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:21 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:21.366438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48936cba-1fc0-4b05-9d7a-b751e9670255 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.383053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48936cba-1fc0-4b05-9d7a-b751e9670255 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:21.391173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d4404-09e9-4814-8b34-4b2f523b92e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:21.393744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d4404-09e9-4814-8b34-4b2f523b92e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.396940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d4404-09e9-4814-8b34-4b2f523b92e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.396940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d4404-09e9-4814-8b34-4b2f523b92e0 admin admin] PATH_INFO: `/v3/projects/a6d0433d36494c339de083939adfa30d/users/4230d9b8ef6540bfbc4f034885d418e8/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.420562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d4404-09e9-4814-8b34-4b2f523b92e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d0433d36494c339de083939adfa30d, user_id=4230d9b8ef6540bfbc4f034885d418e8, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:21.424945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d4404-09e9-4814-8b34-4b2f523b92e0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:21.448482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7f31b-71ce-4300-b577-adcf2377e252 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.450886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-25e7f31b-71ce-4300-b577-adcf2377e252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:21.455267 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1264/2540] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:47:21 2021] PUT /identity/v3/projects/a6d0433d36494c339de083939adfa30d/users/4230d9b8ef6540bfbc4f034885d418e8/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:21.457309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179893-9ffd-4e98-a37f-4e5db829b89b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.457639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179893-9ffd-4e98-a37f-4e5db829b89b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.457922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d179893-9ffd-4e98-a37f-4e5db829b89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.477597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7d179893-9ffd-4e98-a37f-4e5db829b89b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:21.480006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7d179893-9ffd-4e98-a37f-4e5db829b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:21.554181 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1265/2541] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:21.557458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7f31b-71ce-4300-b577-adcf2377e252 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:21.567821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d179893-9ffd-4e98-a37f-4e5db829b89b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.569584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7d179893-9ffd-4e98-a37f-4e5db829b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:21.652434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677472e5-28fd-4fd6-bd69-12a8223581e9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:21.653876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677472e5-28fd-4fd6-bd69-12a8223581e9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.654378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677472e5-28fd-4fd6-bd69-12a8223581e9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.654864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677472e5-28fd-4fd6-bd69-12a8223581e9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/projects/f55cafe46c304ef18fdfa71c9e03fd4e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.657599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677472e5-28fd-4fd6-bd69-12a8223581e9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:get_project(project_id=f55cafe46c304ef18fdfa71c9e03fd4e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:21.659338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d179893-9ffd-4e98-a37f-4e5db829b89b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:21.659897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677472e5-28fd-4fd6-bd69-12a8223581e9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:21.661972 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1277/2542] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:21 2021] GET /identity/v3/projects/f55cafe46c304ef18fdfa71c9e03fd4e => generated 371 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:21.676948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63b3aa-7088-47da-bac3-c15d393d55cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:21.677778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63b3aa-7088-47da-bac3-c15d393d55cb service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.678067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63b3aa-7088-47da-bac3-c15d393d55cb service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.678347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63b3aa-7088-47da-bac3-c15d393d55cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.698187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63b3aa-7088-47da-bac3-c15d393d55cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:21.700034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63b3aa-7088-47da-bac3-c15d393d55cb service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:21.712522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677472e5-28fd-4fd6-bd69-12a8223581e9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.721277 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1266/2543] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:47:21.722622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677472e5-28fd-4fd6-bd69-12a8223581e9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:21.728239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d6d12-4ebc-4ca6-89c9-d669c50ada9b tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:21.728900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6d12-4ebc-4ca6-89c9-d669c50ada9b tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.729184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6d12-4ebc-4ca6-89c9-d669c50ada9b tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.729461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d6d12-4ebc-4ca6-89c9-d669c50ada9b tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.730200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d6d12-4ebc-4ca6-89c9-d669c50ada9b tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:21.730510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d6d12-4ebc-4ca6-89c9-d669c50ada9b tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:21.732152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d6d12-4ebc-4ca6-89c9-d669c50ada9b tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:21.747159 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1278/2544] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:47:21.748931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63b3aa-7088-47da-bac3-c15d393d55cb service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.760698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63b3aa-7088-47da-bac3-c15d393d55cb service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:21.765585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0720bf-c2bb-4819-90a7-934792375ff9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:21.766585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0720bf-c2bb-4819-90a7-934792375ff9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.766942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0720bf-c2bb-4819-90a7-934792375ff9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.767319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0720bf-c2bb-4819-90a7-934792375ff9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.768107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0720bf-c2bb-4819-90a7-934792375ff9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:21.770198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0720bf-c2bb-4819-90a7-934792375ff9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:21.797254 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1267/2545] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:47:21 2021] POST /identity/v3/users => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:21.801960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d6d12-4ebc-4ca6-89c9-d669c50ada9b tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.814311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d6d12-4ebc-4ca6-89c9-d669c50ada9b tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:21.820073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981176f-cad8-442e-ae94-41daf66eb717 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:21.820741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981176f-cad8-442e-ae94-41daf66eb717 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.821181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981176f-cad8-442e-ae94-41daf66eb717 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.821491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981176f-cad8-442e-ae94-41daf66eb717 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.822224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981176f-cad8-442e-ae94-41daf66eb717 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:21.822536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981176f-cad8-442e-ae94-41daf66eb717 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:21.824962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981176f-cad8-442e-ae94-41daf66eb717 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:21.842387 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1279/2546] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:21.868831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6630655-ade0-4a01-b17e-2fcad24499af None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:21.869204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6630655-ade0-4a01-b17e-2fcad24499af None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:21.870040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6630655-ade0-4a01-b17e-2fcad24499af None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:21.874606 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1268/2547] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:21 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:21.880880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981176f-cad8-442e-ae94-41daf66eb717 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:21.983380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981176f-cad8-442e-ae94-41daf66eb717 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:21.996821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981176f-cad8-442e-ae94-41daf66eb717 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:22.005612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166b96-21a2-4269-b027-e8d65364f809 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:22.007771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166b96-21a2-4269-b027-e8d65364f809 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:22.008220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166b96-21a2-4269-b027-e8d65364f809 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:22.008638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166b96-21a2-4269-b027-e8d65364f809 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/projects/f55cafe46c304ef18fdfa71c9e03fd4e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:22.010465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d166b96-21a2-4269-b027-e8d65364f809 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:get_project(project_id=f55cafe46c304ef18fdfa71c9e03fd4e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:22.014156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d166b96-21a2-4269-b027-e8d65364f809 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:22.022204 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1280/2548] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:21 2021] GET /identity/v3/projects/f55cafe46c304ef18fdfa71c9e03fd4e => generated 371 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:22.336581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74990e-b37a-4b17-9890-d7aab6098f4d None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:22.337072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74990e-b37a-4b17-9890-d7aab6098f4d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:22.337152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74990e-b37a-4b17-9890-d7aab6098f4d None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:22.339098 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1269/2549] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:47:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:22.357724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166b96-21a2-4269-b027-e8d65364f809 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:47:22.372373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166b96-21a2-4269-b027-e8d65364f809 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:22.383231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166b96-21a2-4269-b027-e8d65364f809 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:22.389444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cd5c4-ea21-42f0-b1e5-4240405d85a9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:22.390286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd5c4-ea21-42f0-b1e5-4240405d85a9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:22.390572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd5c4-ea21-42f0-b1e5-4240405d85a9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:22.390913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd5c4-ea21-42f0-b1e5-4240405d85a9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/projects/f55cafe46c304ef18fdfa71c9e03fd4e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:22.392502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cd5c4-ea21-42f0-b1e5-4240405d85a9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:get_project(project_id=f55cafe46c304ef18fdfa71c9e03fd4e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:22.396152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cd5c4-ea21-42f0-b1e5-4240405d85a9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:22.397950 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1281/2550] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:47:22 2021] GET /identity/v3/projects/f55cafe46c304ef18fdfa71c9e03fd4e => generated 371 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:22.446798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74990e-b37a-4b17-9890-d7aab6098f4d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:22.475171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74990e-b37a-4b17-9890-d7aab6098f4d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:22.492177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:22.493142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:22.493564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:22.493912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/users/47e04e53c91a459da6146e5c52efc841` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:22.512892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:delete_user(user_id=47e04e53c91a459da6146e5c52efc841)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:22.514893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:22.607805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e04e53c91a459da6146e5c52efc841'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:22.622057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e04e53c91a459da6146e5c52efc841'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:22.623695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e04e53c91a459da6146e5c52efc841'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:22.635814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e04e53c91a459da6146e5c52efc841'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:22.657265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e04e53c91a459da6146e5c52efc841'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:22.667089 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1270/2551] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:47:22 2021] DELETE /identity/v3/users/47e04e53c91a459da6146e5c52efc841 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:22.672210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cd5c4-ea21-42f0-b1e5-4240405d85a9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:22.674306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-772cd5c4-ea21-42f0-b1e5-4240405d85a9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:22.689751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cd5c4-ea21-42f0-b1e5-4240405d85a9 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:22.760942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c47869491c3420aa9eb54c6cf417d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:22.764048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:22.764343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:22.764626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] PATH_INFO: `/v3/projects/f55cafe46c304ef18fdfa71c9e03fd4e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:22.767283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f55cafe46c304ef18fdfa71c9e03fd4e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:22.768825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:22.842698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55cafe46c304ef18fdfa71c9e03fd4e', 'request_id': 'req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:22.852069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55cafe46c304ef18fdfa71c9e03fd4e', 'request_id': 'req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:22.865572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55cafe46c304ef18fdfa71c9e03fd4e', 'request_id': 'req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:22.879816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] The token cache is being invalidate because project f55cafe46c304ef18fdfa71c9e03fd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:47:22.879975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:22.880613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ebd0ea4b-e523-4c6b-a8a9-4b2f4176ab34 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:22.882917 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1282/2552] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:47:22 2021] DELETE /identity/v3/projects/f55cafe46c304ef18fdfa71c9e03fd4e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:47:22.888901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:22.890636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:22.990305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06cb63-956f-4552-8dd3-ddd4dde5d1e7 tempest-QuotasAdminTestV236-1677827754 tempest-QuotasAdminTestV236-1677827754-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:23.121474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:23.123082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:23.124113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:23.125107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] PATH_INFO: `/v3/users/11c877def93543b5978814a3cc0fa0b5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:23.126847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c877def93543b5978814a3cc0fa0b5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:23.130240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:23.234392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c877def93543b5978814a3cc0fa0b5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:23.242861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c877def93543b5978814a3cc0fa0b5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:23.243931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c877def93543b5978814a3cc0fa0b5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:23.253628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c877def93543b5978814a3cc0fa0b5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:23.267063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c877def93543b5978814a3cc0fa0b5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:23.278105 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1271/2553] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:47:22 2021] DELETE /identity/v3/users/11c877def93543b5978814a3cc0fa0b5 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:23.283005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8ce15-bb8f-4ff4-8abc-5cab54ffcbfa None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:23.283376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8ce15-bb8f-4ff4-8abc-5cab54ffcbfa None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:23.283660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8ce15-bb8f-4ff4-8abc-5cab54ffcbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:23.304657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d1d8ce15-bb8f-4ff4-8abc-5cab54ffcbfa None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:23.305429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d1d8ce15-bb8f-4ff4-8abc-5cab54ffcbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:23.385956 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1283/2554] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:47:23.393561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:23.398306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:23.493710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e6f76-0298-46c3-83cd-4bb0e8ccf80d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:23.498349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273b669-e090-4b8b-aea9-57e7bb48e50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:23.499145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b669-e090-4b8b-aea9-57e7bb48e50f service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:23.499876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b669-e090-4b8b-aea9-57e7bb48e50f service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:23.500200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273b669-e090-4b8b-aea9-57e7bb48e50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:23.514685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273b669-e090-4b8b-aea9-57e7bb48e50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:23.516516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273b669-e090-4b8b-aea9-57e7bb48e50f service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:23.530690 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1272/2555] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:47:24.646840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8ce15-bb8f-4ff4-8abc-5cab54ffcbfa None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:24.651548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d1d8ce15-bb8f-4ff4-8abc-5cab54ffcbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:24.694941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8ce15-bb8f-4ff4-8abc-5cab54ffcbfa None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:24.700427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:24.701582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:24.702036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:24.702486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] PATH_INFO: `/v3/projects/f4c4ec547cb840df84c2c625324d2608` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:24.704323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c4ec547cb840df84c2c625324d2608)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:24.707492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:24.790376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c4ec547cb840df84c2c625324d2608', 'request_id': 'req-6f968090-bbb9-4508-a577-be105eeaa8e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:24.797743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c4ec547cb840df84c2c625324d2608', 'request_id': 'req-6f968090-bbb9-4508-a577-be105eeaa8e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:24.807695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c4ec547cb840df84c2c625324d2608', 'request_id': 'req-6f968090-bbb9-4508-a577-be105eeaa8e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:24.821010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] The token cache is being invalidate because project f4c4ec547cb840df84c2c625324d2608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:47:24.821292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:24.822167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:24.824891 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1284/2556] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:47:24 2021] DELETE /identity/v3/projects/f4c4ec547cb840df84c2c625324d2608 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:24.828554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273b669-e090-4b8b-aea9-57e7bb48e50f service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:24.842221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273b669-e090-4b8b-aea9-57e7bb48e50f service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:24.921429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e0f99-25c0-47e3-9958-e33271d43fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:24.922783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e0f99-25c0-47e3-9958-e33271d43fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:24.923238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e0f99-25c0-47e3-9958-e33271d43fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:24.923548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e0f99-25c0-47e3-9958-e33271d43fa5 admin admin] PATH_INFO: `/v3/users/9c47869491c3420aa9eb54c6cf417d37` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:24.924807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e0f99-25c0-47e3-9958-e33271d43fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c47869491c3420aa9eb54c6cf417d37)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:24.926756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e0f99-25c0-47e3-9958-e33271d43fa5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:24.986959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd7e0f99-25c0-47e3-9958-e33271d43fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c47869491c3420aa9eb54c6cf417d37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:25.016561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd7e0f99-25c0-47e3-9958-e33271d43fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c47869491c3420aa9eb54c6cf417d37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:25.018250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd7e0f99-25c0-47e3-9958-e33271d43fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c47869491c3420aa9eb54c6cf417d37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:25.030640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd7e0f99-25c0-47e3-9958-e33271d43fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c47869491c3420aa9eb54c6cf417d37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:25.051873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd7e0f99-25c0-47e3-9958-e33271d43fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c47869491c3420aa9eb54c6cf417d37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:25.064798 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1273/2557] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:47:24 2021] DELETE /identity/v3/users/9c47869491c3420aa9eb54c6cf417d37 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:25.788440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:25.793258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:25.837818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f968090-bbb9-4508-a577-be105eeaa8e1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:25.962967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:25.964955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:25.965521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:25.965965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] PATH_INFO: `/v3/projects/f72dbd4a564c4ae5bdf68f6f98f06c5c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:25.967941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72dbd4a564c4ae5bdf68f6f98f06c5c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:25.972245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:26.054253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'request_id': 'req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:26.057939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'request_id': 'req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:26.070938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72dbd4a564c4ae5bdf68f6f98f06c5c', 'request_id': 'req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:26.086483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] The token cache is being invalidate because project f72dbd4a564c4ae5bdf68f6f98f06c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:47:26.086772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:26.087635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f17ccb05-f7d1-4556-861d-fc3c4affbe1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:26.097620 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1285/2558] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:47:25 2021] DELETE /identity/v3/projects/f72dbd4a564c4ae5bdf68f6f98f06c5c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:26.098841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f2b2-6b35-44cf-ae63-ef45da93b57f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:26.099366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f2b2-6b35-44cf-ae63-ef45da93b57f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:26.099920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f2b2-6b35-44cf-ae63-ef45da93b57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:26.137980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5575f2b2-6b35-44cf-ae63-ef45da93b57f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:26.139221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5575f2b2-6b35-44cf-ae63-ef45da93b57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:26.252850 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1274/2559] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:26.256446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e8f2b-a5ef-46ea-91e5-acafc15b6e41 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:26.256955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e8f2b-a5ef-46ea-91e5-acafc15b6e41 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:26.257268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e8f2b-a5ef-46ea-91e5-acafc15b6e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:26.283495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-af9e8f2b-a5ef-46ea-91e5-acafc15b6e41 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:26.284795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-af9e8f2b-a5ef-46ea-91e5-acafc15b6e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:26.307307 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1286/2560] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:47:26.311443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575f2b2-6b35-44cf-ae63-ef45da93b57f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:26.337143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575f2b2-6b35-44cf-ae63-ef45da93b57f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:26.351963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1a421-ef5d-4916-b408-ee30be39ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:26.352656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1a421-ef5d-4916-b408-ee30be39ea4e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:26.352942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1a421-ef5d-4916-b408-ee30be39ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:26.353219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1a421-ef5d-4916-b408-ee30be39ea4e admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:26.353967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1a421-ef5d-4916-b408-ee30be39ea4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:26.354824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1a421-ef5d-4916-b408-ee30be39ea4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:26.360788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1a421-ef5d-4916-b408-ee30be39ea4e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:26.386468 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1275/2561] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:26.387669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e8f2b-a5ef-46ea-91e5-acafc15b6e41 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:26.404163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e8f2b-a5ef-46ea-91e5-acafc15b6e41 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:26.422407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1fc42-83a5-4cfc-a393-eed36b8817ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:26.423190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1fc42-83a5-4cfc-a393-eed36b8817ac admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:26.423832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1fc42-83a5-4cfc-a393-eed36b8817ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:26.424278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1fc42-83a5-4cfc-a393-eed36b8817ac admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:26.425624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1fc42-83a5-4cfc-a393-eed36b8817ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:26.428212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1fc42-83a5-4cfc-a393-eed36b8817ac admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:26.514418 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1287/2562] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:47:26 2021] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:47:26.515971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1a421-ef5d-4916-b408-ee30be39ea4e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:26.527205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1a421-ef5d-4916-b408-ee30be39ea4e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:26.614269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c589ede-31ef-4dce-9642-a5875a2bb747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:26.615308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c589ede-31ef-4dce-9642-a5875a2bb747 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:26.615705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c589ede-31ef-4dce-9642-a5875a2bb747 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:26.616086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c589ede-31ef-4dce-9642-a5875a2bb747 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:26.617091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c589ede-31ef-4dce-9642-a5875a2bb747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:26.620666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c589ede-31ef-4dce-9642-a5875a2bb747 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:26.657803 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1276/2563] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:47:26 2021] POST /identity/v3/users => generated 295 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:47:26.659328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1fc42-83a5-4cfc-a393-eed36b8817ac admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:26.675599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1fc42-83a5-4cfc-a393-eed36b8817ac admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:26.683236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436340bf-324b-4104-ba2d-44fb40826f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:26.684117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436340bf-324b-4104-ba2d-44fb40826f8b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:26.684527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436340bf-324b-4104-ba2d-44fb40826f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:26.684808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436340bf-324b-4104-ba2d-44fb40826f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:26.685704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436340bf-324b-4104-ba2d-44fb40826f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:26.687638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436340bf-324b-4104-ba2d-44fb40826f8b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:26.709226 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1288/2564] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:26 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:26.710381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c589ede-31ef-4dce-9642-a5875a2bb747 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:26.725116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c589ede-31ef-4dce-9642-a5875a2bb747 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:26.731774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79579daa-c107-4f99-8b42-17e0ccf158f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:26.732582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79579daa-c107-4f99-8b42-17e0ccf158f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:26.732975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79579daa-c107-4f99-8b42-17e0ccf158f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:26.733360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79579daa-c107-4f99-8b42-17e0ccf158f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:26.734211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79579daa-c107-4f99-8b42-17e0ccf158f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:26.735947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79579daa-c107-4f99-8b42-17e0ccf158f6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:26.757127 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1277/2565] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:26 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:26.758333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436340bf-324b-4104-ba2d-44fb40826f8b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:26.768923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436340bf-324b-4104-ba2d-44fb40826f8b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:26.774964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94c1a9-56d6-4b08-8c66-5b26e1f74ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:26.776434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c1a9-56d6-4b08-8c66-5b26e1f74ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:26.776821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c1a9-56d6-4b08-8c66-5b26e1f74ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:26.777224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94c1a9-56d6-4b08-8c66-5b26e1f74ddd admin admin] PATH_INFO: `/v3/projects/4f730ab339a540fea192c1f8539b7fa8/users/3c2b70c5ae1842b8ab1ab2ba8a16fc4b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:26.809484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94c1a9-56d6-4b08-8c66-5b26e1f74ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f730ab339a540fea192c1f8539b7fa8, user_id=3c2b70c5ae1842b8ab1ab2ba8a16fc4b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:26.813378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94c1a9-56d6-4b08-8c66-5b26e1f74ddd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:26.830660 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1289/2566] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:47:26 2021] PUT /identity/v3/projects/4f730ab339a540fea192c1f8539b7fa8/users/3c2b70c5ae1842b8ab1ab2ba8a16fc4b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:26.836095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e0f2-6f43-4e6a-908a-3882d406ee65 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:26.836463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e0f2-6f43-4e6a-908a-3882d406ee65 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:26.836662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e0f2-6f43-4e6a-908a-3882d406ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:26.855928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7424e0f2-6f43-4e6a-908a-3882d406ee65 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:26.857244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7424e0f2-6f43-4e6a-908a-3882d406ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:26.932196 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1278/2567] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:26.947963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94c1a9-56d6-4b08-8c66-5b26e1f74ddd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:26.950697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9f94c1a9-56d6-4b08-8c66-5b26e1f74ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:27.062436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94c1a9-56d6-4b08-8c66-5b26e1f74ddd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:27.069158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf2cbf-f743-4b9b-a285-063dfd136197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:27.070504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf2cbf-f743-4b9b-a285-063dfd136197 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:27.070981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf2cbf-f743-4b9b-a285-063dfd136197 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:27.071449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf2cbf-f743-4b9b-a285-063dfd136197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:27.088045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf2cbf-f743-4b9b-a285-063dfd136197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:27.090432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf2cbf-f743-4b9b-a285-063dfd136197 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:27.112347 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1290/2568] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:32.363008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53ea8-1652-4bf6-9f03-2beed451aa14 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:32.364093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53ea8-1652-4bf6-9f03-2beed451aa14 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:32.364503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd53ea8-1652-4bf6-9f03-2beed451aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:32.436992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-dcd53ea8-1652-4bf6-9f03-2beed451aa14 None None] MFA Rules not processed for user `4230d9b8ef6540bfbc4f034885d418e8`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:32.438238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dcd53ea8-1652-4bf6-9f03-2beed451aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:32.653450 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1279/2569] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:32 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:32.656377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf2cbf-f743-4b9b-a285-063dfd136197 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:32.657940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a7cf2cbf-f743-4b9b-a285-063dfd136197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:32.673809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf2cbf-f743-4b9b-a285-063dfd136197 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:32.689265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f22d05-be5a-4175-ae34-09f25a4731db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:32.690112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22d05-be5a-4175-ae34-09f25a4731db admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:32.690486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22d05-be5a-4175-ae34-09f25a4731db admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:32.691002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22d05-be5a-4175-ae34-09f25a4731db admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:32.692163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f22d05-be5a-4175-ae34-09f25a4731db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:32.696935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f22d05-be5a-4175-ae34-09f25a4731db admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:32.737492 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1291/2570] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:47:32 2021] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:32.739088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd53ea8-1652-4bf6-9f03-2beed451aa14 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:32.753237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd53ea8-1652-4bf6-9f03-2beed451aa14 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:32.846982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716ad40-7df3-4774-aa0f-b1270be0a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:32.848471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716ad40-7df3-4774-aa0f-b1270be0a632 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:32.850891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716ad40-7df3-4774-aa0f-b1270be0a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:32.851285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716ad40-7df3-4774-aa0f-b1270be0a632 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:32.854180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716ad40-7df3-4774-aa0f-b1270be0a632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:32.856909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716ad40-7df3-4774-aa0f-b1270be0a632 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:32.896717 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1280/2571] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:47:32 2021] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:32.897885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f22d05-be5a-4175-ae34-09f25a4731db admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:32.922091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f22d05-be5a-4175-ae34-09f25a4731db admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:32.937750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779dcdb-042b-4e4d-b8a1-49d6df765f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:32.946579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779dcdb-042b-4e4d-b8a1-49d6df765f9d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:32.947556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779dcdb-042b-4e4d-b8a1-49d6df765f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:32.948316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779dcdb-042b-4e4d-b8a1-49d6df765f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:32.950500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779dcdb-042b-4e4d-b8a1-49d6df765f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:32.958953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779dcdb-042b-4e4d-b8a1-49d6df765f9d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:32.984540 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1292/2572] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:32 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:32.989999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716ad40-7df3-4774-aa0f-b1270be0a632 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:33.007685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716ad40-7df3-4774-aa0f-b1270be0a632 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:33.014039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4dfc7-268c-4c6f-a431-f089f8cbc033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:33.015785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4dfc7-268c-4c6f-a431-f089f8cbc033 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:33.016962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4dfc7-268c-4c6f-a431-f089f8cbc033 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:33.016962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4dfc7-268c-4c6f-a431-f089f8cbc033 admin admin] PATH_INFO: `/v3/projects/d61eba1a7f8f4515a0c7ec1489d0b15f/users/5dc5126a45fa41ca9d89a09735492620/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:33.036569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4dfc7-268c-4c6f-a431-f089f8cbc033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61eba1a7f8f4515a0c7ec1489d0b15f, user_id=5dc5126a45fa41ca9d89a09735492620, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:33.040678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4dfc7-268c-4c6f-a431-f089f8cbc033 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:33.066874 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1281/2573] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:47:32 2021] PUT /identity/v3/projects/d61eba1a7f8f4515a0c7ec1489d0b15f/users/5dc5126a45fa41ca9d89a09735492620/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:33.071208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779dcdb-042b-4e4d-b8a1-49d6df765f9d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:33.083571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779dcdb-042b-4e4d-b8a1-49d6df765f9d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:33.156684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712b09a-9d62-4882-8f7c-c9983964a2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:33.158453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712b09a-9d62-4882-8f7c-c9983964a2ca admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:33.158913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712b09a-9d62-4882-8f7c-c9983964a2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:33.159405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712b09a-9d62-4882-8f7c-c9983964a2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:33.160441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712b09a-9d62-4882-8f7c-c9983964a2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:33.162766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712b09a-9d62-4882-8f7c-c9983964a2ca admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:33.174800 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1293/2574] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:33 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:33.179476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4dfc7-268c-4c6f-a431-f089f8cbc033 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:33.196992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4dfc7-268c-4c6f-a431-f089f8cbc033 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:33.218588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9acd5b-ebee-4f01-81a3-68074505e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:33.220700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9acd5b-ebee-4f01-81a3-68074505e0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:33.224881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9acd5b-ebee-4f01-81a3-68074505e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:33.225375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9acd5b-ebee-4f01-81a3-68074505e0f5 admin admin] PATH_INFO: `/v3/projects/d61eba1a7f8f4515a0c7ec1489d0b15f/users/5dc5126a45fa41ca9d89a09735492620/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:33.234474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9acd5b-ebee-4f01-81a3-68074505e0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61eba1a7f8f4515a0c7ec1489d0b15f, user_id=5dc5126a45fa41ca9d89a09735492620, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:33.237387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9acd5b-ebee-4f01-81a3-68074505e0f5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:33.250215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a603a-7a1a-4f25-a19a-4976f05eaf3a None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:33.250514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a603a-7a1a-4f25-a19a-4976f05eaf3a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:33.250797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a603a-7a1a-4f25-a19a-4976f05eaf3a None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:33.253262 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1294/2575] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:47:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:33.259843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3c2b-225e-4ef6-96f4-759a00990a63 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:33.260136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3c2b-225e-4ef6-96f4-759a00990a63 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:33.260425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c3c2b-225e-4ef6-96f4-759a00990a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:33.267332 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1282/2576] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:47:33 2021] PUT /identity/v3/projects/d61eba1a7f8f4515a0c7ec1489d0b15f/users/5dc5126a45fa41ca9d89a09735492620/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:33.286433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4d2c3c2b-225e-4ef6-96f4-759a00990a63 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:33.287775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4d2c3c2b-225e-4ef6-96f4-759a00990a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:33.389478 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1295/2577] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:47:33 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:33.422000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9acd5b-ebee-4f01-81a3-68074505e0f5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:33.436668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e9acd5b-ebee-4f01-81a3-68074505e0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:33.461993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9acd5b-ebee-4f01-81a3-68074505e0f5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:33.476563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ccdf7-b02c-451f-8439-e1c323064c62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:33.481634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ccdf7-b02c-451f-8439-e1c323064c62 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:33.481995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ccdf7-b02c-451f-8439-e1c323064c62 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:33.482661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ccdf7-b02c-451f-8439-e1c323064c62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:33.514444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ccdf7-b02c-451f-8439-e1c323064c62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:33.519560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ccdf7-b02c-451f-8439-e1c323064c62 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:33.533529 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1283/2578] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:33 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:37.971937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fce92-f7af-4267-99b4-f587020bbff5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:37.972467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fce92-f7af-4267-99b4-f587020bbff5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:37.972562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fce92-f7af-4267-99b4-f587020bbff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:38.024600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-182fce92-f7af-4267-99b4-f587020bbff5 None None] MFA Rules not processed for user `3c2b70c5ae1842b8ab1ab2ba8a16fc4b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:38.026514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-182fce92-f7af-4267-99b4-f587020bbff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:38.260584 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1296/2579] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:37 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:38.760564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ccdf7-b02c-451f-8439-e1c323064c62 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:38.768807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7a7ccdf7-b02c-451f-8439-e1c323064c62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:38.905367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ccdf7-b02c-451f-8439-e1c323064c62 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:38.923633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ee2cc-1854-4a82-8e23-90dd45823149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:38.924759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee2cc-1854-4a82-8e23-90dd45823149 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:38.925257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee2cc-1854-4a82-8e23-90dd45823149 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:38.925818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ee2cc-1854-4a82-8e23-90dd45823149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:38.935121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ee2cc-1854-4a82-8e23-90dd45823149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:38.937128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ee2cc-1854-4a82-8e23-90dd45823149 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:38.951126 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1284/2580] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:38 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:43.508719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0f86e-9cab-4190-9e6f-7e54400499a5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:43.509826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0f86e-9cab-4190-9e6f-7e54400499a5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:43.510332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0f86e-9cab-4190-9e6f-7e54400499a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:43.546734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-99a0f86e-9cab-4190-9e6f-7e54400499a5 None None] MFA Rules not processed for user `1d46c71936aa4118aa36a9e95b95c4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:43.548741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-99a0f86e-9cab-4190-9e6f-7e54400499a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:43.650296 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1297/2581] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:43 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:45.862302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd91e2-c877-424e-8253-a024e8fcb797 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:45.864376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd91e2-c877-424e-8253-a024e8fcb797 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:45.864376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd91e2-c877-424e-8253-a024e8fcb797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:45.929159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c8cd91e2-c877-424e-8253-a024e8fcb797 None None] MFA Rules not processed for user `5dc5126a45fa41ca9d89a09735492620`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:45.930129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c8cd91e2-c877-424e-8253-a024e8fcb797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:46.135712 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1285/2582] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:45 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:46.151090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0f86e-9cab-4190-9e6f-7e54400499a5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:46.152647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-99a0f86e-9cab-4190-9e6f-7e54400499a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:46.366707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0f86e-9cab-4190-9e6f-7e54400499a5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:46.379619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20759f98-6b57-49e2-8600-0998bbae1c1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:46.380688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759f98-6b57-49e2-8600-0998bbae1c1d service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:46.381071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759f98-6b57-49e2-8600-0998bbae1c1d service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:46.381432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20759f98-6b57-49e2-8600-0998bbae1c1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:46.395134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20759f98-6b57-49e2-8600-0998bbae1c1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:46.397000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20759f98-6b57-49e2-8600-0998bbae1c1d service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:46.410322 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1298/2583] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:46 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:47.990267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ab4e6-7750-4b30-a0c1-9c1f746efd13 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:47.991752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ab4e6-7750-4b30-a0c1-9c1f746efd13 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:47.992219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ab4e6-7750-4b30-a0c1-9c1f746efd13 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:47.997359 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1286/2584] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:47:47 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:47:48.006823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e19e-fdd6-4ef2-83b6-269237ed0bbb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:48.009746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e19e-fdd6-4ef2-83b6-269237ed0bbb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:48.009974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e19e-fdd6-4ef2-83b6-269237ed0bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:48.089421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f402e19e-fdd6-4ef2-83b6-269237ed0bbb None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:48.102412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f402e19e-fdd6-4ef2-83b6-269237ed0bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:48.147486 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1299/2585] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:47:48 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:48.182423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ab4e6-7750-4b30-a0c1-9c1f746efd13 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:48.185006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-342ab4e6-7750-4b30-a0c1-9c1f746efd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:48.224550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ab4e6-7750-4b30-a0c1-9c1f746efd13 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:48.239353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf93cfe-0d9f-429c-acba-6277bc3d7def service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:48.241667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf93cfe-0d9f-429c-acba-6277bc3d7def service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:48.243813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf93cfe-0d9f-429c-acba-6277bc3d7def service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:48.244134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf93cfe-0d9f-429c-acba-6277bc3d7def service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:48.270992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf93cfe-0d9f-429c-acba-6277bc3d7def service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:48.275262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf93cfe-0d9f-429c-acba-6277bc3d7def service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:48.303307 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1287/2586] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:48 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:47:57.050138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402e19e-fdd6-4ef2-83b6-269237ed0bbb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:57.208385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402e19e-fdd6-4ef2-83b6-269237ed0bbb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:57.218090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96250b20-428b-4811-a466-f421fd048c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:57.222050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250b20-428b-4811-a466-f421fd048c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:57.223858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250b20-428b-4811-a466-f421fd048c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:57.224383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250b20-428b-4811-a466-f421fd048c2d admin admin] PATH_INFO: `/v3/users/3c2b70c5ae1842b8ab1ab2ba8a16fc4b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:57.226702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96250b20-428b-4811-a466-f421fd048c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2b70c5ae1842b8ab1ab2ba8a16fc4b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:57.230238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96250b20-428b-4811-a466-f421fd048c2d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:57.355349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-96250b20-428b-4811-a466-f421fd048c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2b70c5ae1842b8ab1ab2ba8a16fc4b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:57.358648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-96250b20-428b-4811-a466-f421fd048c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2b70c5ae1842b8ab1ab2ba8a16fc4b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:57.388461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-96250b20-428b-4811-a466-f421fd048c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2b70c5ae1842b8ab1ab2ba8a16fc4b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:57.389819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-96250b20-428b-4811-a466-f421fd048c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2b70c5ae1842b8ab1ab2ba8a16fc4b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:57.400871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-96250b20-428b-4811-a466-f421fd048c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2b70c5ae1842b8ab1ab2ba8a16fc4b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:57.430958 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1300/2587] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:47:57 2021] DELETE /identity/v3/users/3c2b70c5ae1842b8ab1ab2ba8a16fc4b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:57.898677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf93cfe-0d9f-429c-acba-6277bc3d7def service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:57.912090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf93cfe-0d9f-429c-acba-6277bc3d7def service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:58.053775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:58.055207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:58.055655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:58.058903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] PATH_INFO: `/v3/projects/4f730ab339a540fea192c1f8539b7fa8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:58.063879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f730ab339a540fea192c1f8539b7fa8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:58.066133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:58.150199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f730ab339a540fea192c1f8539b7fa8', 'request_id': 'req-55b40e22-aa4e-4d99-a39c-8c42df513332'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:58.166341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f730ab339a540fea192c1f8539b7fa8', 'request_id': 'req-55b40e22-aa4e-4d99-a39c-8c42df513332'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:58.192717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f730ab339a540fea192c1f8539b7fa8', 'request_id': 'req-55b40e22-aa4e-4d99-a39c-8c42df513332'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:58.232495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] The token cache is being invalidate because project 4f730ab339a540fea192c1f8539b7fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:47:58.232712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:58.235780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-55b40e22-aa4e-4d99-a39c-8c42df513332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:47:58.243876 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1288/2588] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:47:57 2021] DELETE /identity/v3/projects/4f730ab339a540fea192c1f8539b7fa8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:47:58.246125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81674de-3a43-484b-8492-fe103fb8172a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:58.247318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81674de-3a43-484b-8492-fe103fb8172a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:58.247884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81674de-3a43-484b-8492-fe103fb8172a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:58.320331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e81674de-3a43-484b-8492-fe103fb8172a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:58.322721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e81674de-3a43-484b-8492-fe103fb8172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:58.514612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65396a-0904-4762-995c-f0213c4344fe None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:58.515366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65396a-0904-4762-995c-f0213c4344fe None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:58.515870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65396a-0904-4762-995c-f0213c4344fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:58.530001 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1301/2589] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:58.556464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-eb65396a-0904-4762-995c-f0213c4344fe None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:58.561443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-eb65396a-0904-4762-995c-f0213c4344fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:58.583897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81674de-3a43-484b-8492-fe103fb8172a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:58.594332 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1289/2590] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:58.599027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81674de-3a43-484b-8492-fe103fb8172a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:58.605426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679392e-0b1d-4603-8ee1-9cd0b06d0f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:58.606783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679392e-0b1d-4603-8ee1-9cd0b06d0f75 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:58.607373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679392e-0b1d-4603-8ee1-9cd0b06d0f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:58.607881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679392e-0b1d-4603-8ee1-9cd0b06d0f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:58.617513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679392e-0b1d-4603-8ee1-9cd0b06d0f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:47:58.618207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679392e-0b1d-4603-8ee1-9cd0b06d0f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:58.620541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679392e-0b1d-4603-8ee1-9cd0b06d0f75 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:58.662257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65396a-0904-4762-995c-f0213c4344fe None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:58.668456 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1302/2591] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:47:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:47:58.676742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65396a-0904-4762-995c-f0213c4344fe None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:58.688936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747787a-2497-4df4-92ea-f6e0a98474f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:58.690569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747787a-2497-4df4-92ea-f6e0a98474f6 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:58.691738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747787a-2497-4df4-92ea-f6e0a98474f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:58.692242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747787a-2497-4df4-92ea-f6e0a98474f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:58.693287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747787a-2497-4df4-92ea-f6e0a98474f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:58.696146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747787a-2497-4df4-92ea-f6e0a98474f6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:58.780304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679392e-0b1d-4603-8ee1-9cd0b06d0f75 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:58.785341 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1290/2592] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:47:58 2021] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:47:58.793492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679392e-0b1d-4603-8ee1-9cd0b06d0f75 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:58.916055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde9104-3553-4adb-8393-0183f193de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:58.917345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde9104-3553-4adb-8393-0183f193de3f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:58.917630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde9104-3553-4adb-8393-0183f193de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:58.917904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde9104-3553-4adb-8393-0183f193de3f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:58.920738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde9104-3553-4adb-8393-0183f193de3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:58.922728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde9104-3553-4adb-8393-0183f193de3f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:58.979441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747787a-2497-4df4-92ea-f6e0a98474f6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:58.987328 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1303/2593] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:47:58 2021] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:47:59.012229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747787a-2497-4df4-92ea-f6e0a98474f6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:59.043943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b42cb8-c772-4c71-bfa5-39177a0b8595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:59.044727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b42cb8-c772-4c71-bfa5-39177a0b8595 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:59.045083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b42cb8-c772-4c71-bfa5-39177a0b8595 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:59.045439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b42cb8-c772-4c71-bfa5-39177a0b8595 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:59.046271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b42cb8-c772-4c71-bfa5-39177a0b8595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:59.047991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b42cb8-c772-4c71-bfa5-39177a0b8595 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:59.059806 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1291/2594] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:58 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:59.063432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde9104-3553-4adb-8393-0183f193de3f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:59.076936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde9104-3553-4adb-8393-0183f193de3f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:59.083324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7237cf-f5c0-44fb-8dca-c28349fddd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:59.084526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7237cf-f5c0-44fb-8dca-c28349fddd96 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:59.085088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7237cf-f5c0-44fb-8dca-c28349fddd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:59.085469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7237cf-f5c0-44fb-8dca-c28349fddd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:59.086319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7237cf-f5c0-44fb-8dca-c28349fddd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:59.088271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7237cf-f5c0-44fb-8dca-c28349fddd96 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:59.128347 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1304/2595] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:47:59 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:47:59.128895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b42cb8-c772-4c71-bfa5-39177a0b8595 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:59.144093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b42cb8-c772-4c71-bfa5-39177a0b8595 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:59.161696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997b36d-94f0-4ad4-9540-fd523ef6614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:59.162610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b36d-94f0-4ad4-9540-fd523ef6614e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:59.165627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b36d-94f0-4ad4-9540-fd523ef6614e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:59.166131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997b36d-94f0-4ad4-9540-fd523ef6614e admin admin] PATH_INFO: `/v3/projects/362ae85fdb0f47298d68a24282d26caa/users/482bc1724ad345e1ad0bf612856423d5/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:59.193452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b383-3651-46b4-86c3-a53ce3e85e5b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:59.193743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b383-3651-46b4-86c3-a53ce3e85e5b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:59.194019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b383-3651-46b4-86c3-a53ce3e85e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:59.201153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997b36d-94f0-4ad4-9540-fd523ef6614e admin admin] RBAC: Authorizing `identity:create_grant(project_id=362ae85fdb0f47298d68a24282d26caa, user_id=482bc1724ad345e1ad0bf612856423d5, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:59.204349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997b36d-94f0-4ad4-9540-fd523ef6614e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:59.234722 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1292/2596] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:47:59 2021] PUT /identity/v3/projects/362ae85fdb0f47298d68a24282d26caa/users/482bc1724ad345e1ad0bf612856423d5/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:47:59.236483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9b8e8-ee8c-40d7-836a-4d2435f130c1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:59.236883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9b8e8-ee8c-40d7-836a-4d2435f130c1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:59.237230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9b8e8-ee8c-40d7-836a-4d2435f130c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:59.275696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-03e9b8e8-ee8c-40d7-836a-4d2435f130c1 None None] MFA Rules not processed for user `482bc1724ad345e1ad0bf612856423d5`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:59.277050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-03e9b8e8-ee8c-40d7-836a-4d2435f130c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:59.291355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ddd7b383-3651-46b4-86c3-a53ce3e85e5b None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:47:59.292588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ddd7b383-3651-46b4-86c3-a53ce3e85e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:59.364188 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1293/2597] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:47:59 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:47:59.400358 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1305/2598] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:47:59 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:47:59.470895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9b8e8-ee8c-40d7-836a-4d2435f130c1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:59.473298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-03e9b8e8-ee8c-40d7-836a-4d2435f130c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:59.579080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7b383-3651-46b4-86c3-a53ce3e85e5b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:47:59.580786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ddd7b383-3651-46b4-86c3-a53ce3e85e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:47:59.639161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9b8e8-ee8c-40d7-836a-4d2435f130c1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:59.646595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70319caa-051c-4e2e-946e-41e683d56921 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:59.647667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70319caa-051c-4e2e-946e-41e683d56921 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:59.648085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70319caa-051c-4e2e-946e-41e683d56921 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:59.648463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70319caa-051c-4e2e-946e-41e683d56921 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:59.660107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70319caa-051c-4e2e-946e-41e683d56921 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:59.662914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70319caa-051c-4e2e-946e-41e683d56921 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:59.678390 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1294/2599] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:47:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:47:59.747603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7b383-3651-46b4-86c3-a53ce3e85e5b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:47:59.756246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62b15c-4a3f-420e-85c0-a19541a070c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:47:59.756922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b15c-4a3f-420e-85c0-a19541a070c5 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:47:59.757204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b15c-4a3f-420e-85c0-a19541a070c5 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:47:59.757481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b15c-4a3f-420e-85c0-a19541a070c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:47:59.773007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62b15c-4a3f-420e-85c0-a19541a070c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:47:59.774699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62b15c-4a3f-420e-85c0-a19541a070c5 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:47:59.787240 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1306/2600] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:47:59 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:47:59.861671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70319caa-051c-4e2e-946e-41e683d56921 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:00.020479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70319caa-051c-4e2e-946e-41e683d56921 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:00.035262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:00.036902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:00.036902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:00.036902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] PATH_INFO: `/v3/users/482bc1724ad345e1ad0bf612856423d5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:00.039317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=482bc1724ad345e1ad0bf612856423d5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:00.040992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:00.145607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482bc1724ad345e1ad0bf612856423d5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:00.159490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482bc1724ad345e1ad0bf612856423d5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:00.161044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482bc1724ad345e1ad0bf612856423d5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:00.174983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482bc1724ad345e1ad0bf612856423d5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:00.189043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482bc1724ad345e1ad0bf612856423d5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:00.196960 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1295/2601] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:47:59 2021] DELETE /identity/v3/users/482bc1724ad345e1ad0bf612856423d5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:00.202743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f49bdd-fd10-4fad-ad9a-3c7fdcaeacdd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:00.203037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f49bdd-fd10-4fad-ad9a-3c7fdcaeacdd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:00.203337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f49bdd-fd10-4fad-ad9a-3c7fdcaeacdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:00.246260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-99f49bdd-fd10-4fad-ad9a-3c7fdcaeacdd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:00.249475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-99f49bdd-fd10-4fad-ad9a-3c7fdcaeacdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:00.414949 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1307/2602] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:00.429199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:00.430898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:00.611435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e159627-daee-48c2-a5f8-16ae626c0f67 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:00.623805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd600f-94dd-44b6-b3bb-1f36a4b18f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:00.624687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd600f-94dd-44b6-b3bb-1f36a4b18f22 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:00.625229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd600f-94dd-44b6-b3bb-1f36a4b18f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:00.625579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd600f-94dd-44b6-b3bb-1f36a4b18f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:00.646965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd600f-94dd-44b6-b3bb-1f36a4b18f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:00.650547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd600f-94dd-44b6-b3bb-1f36a4b18f22 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:00.679301 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1296/2603] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:01.622925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f49bdd-fd10-4fad-ad9a-3c7fdcaeacdd None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:01.625930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-99f49bdd-fd10-4fad-ad9a-3c7fdcaeacdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:01.649313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f49bdd-fd10-4fad-ad9a-3c7fdcaeacdd None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:01.665592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:01.666508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:01.666794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:01.667071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] PATH_INFO: `/v3/projects/362ae85fdb0f47298d68a24282d26caa` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:01.668496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=362ae85fdb0f47298d68a24282d26caa)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:01.670442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:01.769883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362ae85fdb0f47298d68a24282d26caa', 'request_id': 'req-5f285de5-a60d-4da1-b088-45eace3632ff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:01.779538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362ae85fdb0f47298d68a24282d26caa', 'request_id': 'req-5f285de5-a60d-4da1-b088-45eace3632ff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:01.797692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362ae85fdb0f47298d68a24282d26caa', 'request_id': 'req-5f285de5-a60d-4da1-b088-45eace3632ff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:01.821773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] The token cache is being invalidate because project 362ae85fdb0f47298d68a24282d26caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:48:01.822768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:01.824349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5f285de5-a60d-4da1-b088-45eace3632ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:01.829498 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1308/2604] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:48:01 2021] DELETE /identity/v3/projects/362ae85fdb0f47298d68a24282d26caa => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:01.836036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20612-a25b-4eb7-b5ca-5e5887bf575e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:01.836565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20612-a25b-4eb7-b5ca-5e5887bf575e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:01.836565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20612-a25b-4eb7-b5ca-5e5887bf575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:01.871295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a7c20612-a25b-4eb7-b5ca-5e5887bf575e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:01.872691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a7c20612-a25b-4eb7-b5ca-5e5887bf575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:02.008525 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1297/2605] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:02.015559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1ef78-4f27-496d-972c-0e54aba798b9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:02.016104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1ef78-4f27-496d-972c-0e54aba798b9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:02.016599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1ef78-4f27-496d-972c-0e54aba798b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:02.050607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3fd1ef78-4f27-496d-972c-0e54aba798b9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:02.052457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3fd1ef78-4f27-496d-972c-0e54aba798b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:02.066951 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1309/2606] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:02.070844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c20612-a25b-4eb7-b5ca-5e5887bf575e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:02.081986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c20612-a25b-4eb7-b5ca-5e5887bf575e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:02.098068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd086b-6386-42d9-a3ea-6f0884b80c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:02.098832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd086b-6386-42d9-a3ea-6f0884b80c35 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:02.099215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd086b-6386-42d9-a3ea-6f0884b80c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:02.100161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd086b-6386-42d9-a3ea-6f0884b80c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:02.100553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd086b-6386-42d9-a3ea-6f0884b80c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:48:02.100937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd086b-6386-42d9-a3ea-6f0884b80c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:02.102637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd086b-6386-42d9-a3ea-6f0884b80c35 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:02.126778 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1298/2607] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:48:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:48:02.132283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1ef78-4f27-496d-972c-0e54aba798b9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:02.157749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1ef78-4f27-496d-972c-0e54aba798b9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:02.164424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e68bd-e51d-4f1d-a65c-5af11955c1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:02.165490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e68bd-e51d-4f1d-a65c-5af11955c1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:02.166099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e68bd-e51d-4f1d-a65c-5af11955c1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:02.166535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e68bd-e51d-4f1d-a65c-5af11955c1d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:02.168274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e68bd-e51d-4f1d-a65c-5af11955c1d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:02.171151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e68bd-e51d-4f1d-a65c-5af11955c1d1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:02.207979 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1310/2608] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:48:02 2021] POST /identity/v3/projects => generated 397 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:48:02.212612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd086b-6386-42d9-a3ea-6f0884b80c35 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:02.224716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd086b-6386-42d9-a3ea-6f0884b80c35 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:02.330067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c2da3-8ad9-4038-a129-f41794de2a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:02.330803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c2da3-8ad9-4038-a129-f41794de2a77 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:02.331093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c2da3-8ad9-4038-a129-f41794de2a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:02.331989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c2da3-8ad9-4038-a129-f41794de2a77 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:02.332856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c2da3-8ad9-4038-a129-f41794de2a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:02.335055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c2da3-8ad9-4038-a129-f41794de2a77 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:02.368651 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1299/2609] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:48:02 2021] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:48:02.370848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e68bd-e51d-4f1d-a65c-5af11955c1d1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:02.386143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e68bd-e51d-4f1d-a65c-5af11955c1d1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:02.394674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516233d2-41b3-4b73-8974-198cc24a6174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:02.395678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516233d2-41b3-4b73-8974-198cc24a6174 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:02.396712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516233d2-41b3-4b73-8974-198cc24a6174 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:02.397221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516233d2-41b3-4b73-8974-198cc24a6174 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:02.398169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516233d2-41b3-4b73-8974-198cc24a6174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:02.401041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516233d2-41b3-4b73-8974-198cc24a6174 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:02.432546 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1311/2610] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:48:02.433593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c2da3-8ad9-4038-a129-f41794de2a77 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:02.447319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c2da3-8ad9-4038-a129-f41794de2a77 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:02.462029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106600a-c491-4080-afe8-f140c61116d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:02.462726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106600a-c491-4080-afe8-f140c61116d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:02.463009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106600a-c491-4080-afe8-f140c61116d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:02.463307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106600a-c491-4080-afe8-f140c61116d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:02.464056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106600a-c491-4080-afe8-f140c61116d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:02.465726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106600a-c491-4080-afe8-f140c61116d0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:02.485270 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1300/2611] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:48:02.487957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516233d2-41b3-4b73-8974-198cc24a6174 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:02.501317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516233d2-41b3-4b73-8974-198cc24a6174 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:02.507806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165465cb-e7ea-4b31-861f-85e87e7d2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:02.509491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165465cb-e7ea-4b31-861f-85e87e7d2db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:02.510159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165465cb-e7ea-4b31-861f-85e87e7d2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:02.510929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165465cb-e7ea-4b31-861f-85e87e7d2db6 admin admin] PATH_INFO: `/v3/projects/9ad7d5043f534761a5ec7fd800939007/users/8e3b2b2696c149dfa23d54c91fe98a13/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:02.539685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165465cb-e7ea-4b31-861f-85e87e7d2db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad7d5043f534761a5ec7fd800939007, user_id=8e3b2b2696c149dfa23d54c91fe98a13, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:02.542818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165465cb-e7ea-4b31-861f-85e87e7d2db6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:02.559524 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1312/2612] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:48:02 2021] PUT /identity/v3/projects/9ad7d5043f534761a5ec7fd800939007/users/8e3b2b2696c149dfa23d54c91fe98a13/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:02.564926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd62a-98a4-4970-baeb-7606ae06b92c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:02.565545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd62a-98a4-4970-baeb-7606ae06b92c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:02.565936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dd62a-98a4-4970-baeb-7606ae06b92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:02.615575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-338dd62a-98a4-4970-baeb-7606ae06b92c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:02.615575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-338dd62a-98a4-4970-baeb-7606ae06b92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:02.749381 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1301/2613] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:02.757504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165465cb-e7ea-4b31-861f-85e87e7d2db6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:02.760411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-165465cb-e7ea-4b31-861f-85e87e7d2db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:02.855970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165465cb-e7ea-4b31-861f-85e87e7d2db6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:02.861236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d00458-4c0d-46d7-a4c4-837ac9861308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:02.862164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d00458-4c0d-46d7-a4c4-837ac9861308 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:02.862657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d00458-4c0d-46d7-a4c4-837ac9861308 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:02.863135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d00458-4c0d-46d7-a4c4-837ac9861308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:02.876530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d00458-4c0d-46d7-a4c4-837ac9861308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:02.879045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d00458-4c0d-46d7-a4c4-837ac9861308 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:02.892448 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1313/2614] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:04.899331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e234cb-c76b-435e-b040-e3d6bab7ca2e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:04.900087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e234cb-c76b-435e-b040-e3d6bab7ca2e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:04.900087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e234cb-c76b-435e-b040-e3d6bab7ca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:04.936485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bc1f9-c842-4a37-99d4-2210f59ad889 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:04.937075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bc1f9-c842-4a37-99d4-2210f59ad889 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:04.938199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bc1f9-c842-4a37-99d4-2210f59ad889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:04.994248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-61e234cb-c76b-435e-b040-e3d6bab7ca2e None None] MFA Rules not processed for user `2d326a07ce104727bec8ae98dabea64d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:04.997848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-61e234cb-c76b-435e-b040-e3d6bab7ca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:05.043235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b28bc1f9-c842-4a37-99d4-2210f59ad889 None None] MFA Rules not processed for user `8e3b2b2696c149dfa23d54c91fe98a13`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:05.045592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b28bc1f9-c842-4a37-99d4-2210f59ad889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:05.133716 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1302/2615] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:04 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:48:05.217823 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1314/2616] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:04 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:06.055360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e234cb-c76b-435e-b040-e3d6bab7ca2e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:06.057765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-61e234cb-c76b-435e-b040-e3d6bab7ca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:06.208138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e234cb-c76b-435e-b040-e3d6bab7ca2e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:06.223841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05542d04-8646-4451-addf-ede871c0258a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:06.224822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542d04-8646-4451-addf-ede871c0258a service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:06.225318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542d04-8646-4451-addf-ede871c0258a service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:06.225804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542d04-8646-4451-addf-ede871c0258a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:06.236087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05542d04-8646-4451-addf-ede871c0258a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:06.238618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05542d04-8646-4451-addf-ede871c0258a service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:06.258833 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1303/2617] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:06 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:08.419799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bc1f9-c842-4a37-99d4-2210f59ad889 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:08.437142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bc1f9-c842-4a37-99d4-2210f59ad889 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:08.454364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d3500-9cb7-4735-8d53-bb0a1447c5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:08.456318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3500-9cb7-4735-8d53-bb0a1447c5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:08.458875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3500-9cb7-4735-8d53-bb0a1447c5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:08.459420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d3500-9cb7-4735-8d53-bb0a1447c5e7 admin admin] PATH_INFO: `/v3/users/8e3b2b2696c149dfa23d54c91fe98a13` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:08.461440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3500-9cb7-4735-8d53-bb0a1447c5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3b2b2696c149dfa23d54c91fe98a13)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:08.467826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d3500-9cb7-4735-8d53-bb0a1447c5e7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:08.561288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b95d3500-9cb7-4735-8d53-bb0a1447c5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3b2b2696c149dfa23d54c91fe98a13'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:08.563512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b95d3500-9cb7-4735-8d53-bb0a1447c5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3b2b2696c149dfa23d54c91fe98a13'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:08.587205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b95d3500-9cb7-4735-8d53-bb0a1447c5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3b2b2696c149dfa23d54c91fe98a13'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:08.587994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b95d3500-9cb7-4735-8d53-bb0a1447c5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3b2b2696c149dfa23d54c91fe98a13'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:08.596464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b95d3500-9cb7-4735-8d53-bb0a1447c5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3b2b2696c149dfa23d54c91fe98a13'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:08.619741 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1315/2618] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:48:08 2021] DELETE /identity/v3/users/8e3b2b2696c149dfa23d54c91fe98a13 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:09.299491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05542d04-8646-4451-addf-ede871c0258a service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:09.319703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05542d04-8646-4451-addf-ede871c0258a service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:09.461828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:09.463847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:09.465390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:09.465942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] PATH_INFO: `/v3/projects/9ad7d5043f534761a5ec7fd800939007` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:09.468074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad7d5043f534761a5ec7fd800939007)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:09.470406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:09.549227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad7d5043f534761a5ec7fd800939007', 'request_id': 'req-32de6e29-b832-4d6c-97b8-4888b82b492e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:09.561586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad7d5043f534761a5ec7fd800939007', 'request_id': 'req-32de6e29-b832-4d6c-97b8-4888b82b492e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:09.575663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad7d5043f534761a5ec7fd800939007', 'request_id': 'req-32de6e29-b832-4d6c-97b8-4888b82b492e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:09.601267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] The token cache is being invalidate because project 9ad7d5043f534761a5ec7fd800939007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:48:09.603061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:09.604474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-32de6e29-b832-4d6c-97b8-4888b82b492e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:09.607370 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1304/2619] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:48:09 2021] DELETE /identity/v3/projects/9ad7d5043f534761a5ec7fd800939007 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:09.615664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e12981-40af-4af2-8e0e-5e421c6d9996 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:09.616785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e12981-40af-4af2-8e0e-5e421c6d9996 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:09.617278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e12981-40af-4af2-8e0e-5e421c6d9996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:09.663509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-34e12981-40af-4af2-8e0e-5e421c6d9996 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:09.669665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-34e12981-40af-4af2-8e0e-5e421c6d9996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:09.791178 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1316/2620] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:09.801259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76affd92-fddf-4674-93bb-336e3557d446 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:09.801989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76affd92-fddf-4674-93bb-336e3557d446 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:09.803003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76affd92-fddf-4674-93bb-336e3557d446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:09.872004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-76affd92-fddf-4674-93bb-336e3557d446 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:09.879390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-76affd92-fddf-4674-93bb-336e3557d446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:09.898117 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1305/2621] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:48:09.901974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e12981-40af-4af2-8e0e-5e421c6d9996 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:09.915572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e12981-40af-4af2-8e0e-5e421c6d9996 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:09.922910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b49b0-04fd-4098-8e21-0c5c8aa4a513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:09.923076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b49b0-04fd-4098-8e21-0c5c8aa4a513 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:09.923711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b49b0-04fd-4098-8e21-0c5c8aa4a513 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:09.923711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b49b0-04fd-4098-8e21-0c5c8aa4a513 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:09.925297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b49b0-04fd-4098-8e21-0c5c8aa4a513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:48:09.925448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b49b0-04fd-4098-8e21-0c5c8aa4a513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:09.927718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b49b0-04fd-4098-8e21-0c5c8aa4a513 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:09.956960 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1317/2622] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:48:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:48:09.961811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76affd92-fddf-4674-93bb-336e3557d446 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:09.989918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76affd92-fddf-4674-93bb-336e3557d446 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:09.995843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0332-0ec8-4bd2-adff-db64e869ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:09.996737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0332-0ec8-4bd2-adff-db64e869ccb6 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:09.997226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0332-0ec8-4bd2-adff-db64e869ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:09.997686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0332-0ec8-4bd2-adff-db64e869ccb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:09.998661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e0332-0ec8-4bd2-adff-db64e869ccb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:10.002667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e0332-0ec8-4bd2-adff-db64e869ccb6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:10.051013 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1306/2623] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:48:09 2021] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:48:10.062968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b49b0-04fd-4098-8e21-0c5c8aa4a513 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:10.082019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b49b0-04fd-4098-8e21-0c5c8aa4a513 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:10.279089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a89d5-32a2-4559-9c30-e880fef7ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:10.280207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a89d5-32a2-4559-9c30-e880fef7ebb5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:10.280737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a89d5-32a2-4559-9c30-e880fef7ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:10.281150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a89d5-32a2-4559-9c30-e880fef7ebb5 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:10.282174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a89d5-32a2-4559-9c30-e880fef7ebb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:10.287860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a89d5-32a2-4559-9c30-e880fef7ebb5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:10.325222 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1318/2624] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:48:10 2021] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:48:10.326396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0332-0ec8-4bd2-adff-db64e869ccb6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:10.349462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0332-0ec8-4bd2-adff-db64e869ccb6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:10.362646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b9e68-5ad5-4c08-98e3-14e5c27bc3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:10.363368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b9e68-5ad5-4c08-98e3-14e5c27bc3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:10.363762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b9e68-5ad5-4c08-98e3-14e5c27bc3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:10.364272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b9e68-5ad5-4c08-98e3-14e5c27bc3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:10.369377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b9e68-5ad5-4c08-98e3-14e5c27bc3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:10.372000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b9e68-5ad5-4c08-98e3-14e5c27bc3b6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:10.406013 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1307/2625] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:48:10 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:48:10.406662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a89d5-32a2-4559-9c30-e880fef7ebb5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:10.419476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a89d5-32a2-4559-9c30-e880fef7ebb5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:10.446256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2a511-1f23-4ac6-86ec-d0dea5ca68c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:10.446256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a511-1f23-4ac6-86ec-d0dea5ca68c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:10.446256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a511-1f23-4ac6-86ec-d0dea5ca68c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:10.446256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a511-1f23-4ac6-86ec-d0dea5ca68c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:10.446683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2a511-1f23-4ac6-86ec-d0dea5ca68c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:10.447675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2a511-1f23-4ac6-86ec-d0dea5ca68c4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:10.463542 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1319/2626] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:48:10 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:48:10.468236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b9e68-5ad5-4c08-98e3-14e5c27bc3b6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:10.484927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b9e68-5ad5-4c08-98e3-14e5c27bc3b6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:10.498077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fed2eb-4359-4069-ae15-ddf4ed908074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:10.499514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fed2eb-4359-4069-ae15-ddf4ed908074 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:10.500184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fed2eb-4359-4069-ae15-ddf4ed908074 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:10.500698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fed2eb-4359-4069-ae15-ddf4ed908074 admin admin] PATH_INFO: `/v3/projects/72659aa0252c4e7491effb8522dd5a1c/users/bb85b086594c4389b15420a56941c229/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:10.519970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fed2eb-4359-4069-ae15-ddf4ed908074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72659aa0252c4e7491effb8522dd5a1c, user_id=bb85b086594c4389b15420a56941c229, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:10.524514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fed2eb-4359-4069-ae15-ddf4ed908074 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:10.552595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1308/2627] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:48:10 2021] PUT /identity/v3/projects/72659aa0252c4e7491effb8522dd5a1c/users/bb85b086594c4389b15420a56941c229/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:10.554658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede7733-7727-4c5c-a0fa-ed235a10b4dc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:10.555546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede7733-7727-4c5c-a0fa-ed235a10b4dc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:10.556107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede7733-7727-4c5c-a0fa-ed235a10b4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:10.581446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cede7733-7727-4c5c-a0fa-ed235a10b4dc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:10.582886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cede7733-7727-4c5c-a0fa-ed235a10b4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:10.620858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8e5f1-04e5-4ea4-896e-22970c9798f0 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:10.621143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8e5f1-04e5-4ea4-896e-22970c9798f0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:10.621451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8e5f1-04e5-4ea4-896e-22970c9798f0 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:10.623621 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1309/2628] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:48:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:48:10.629102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bace96d-5df1-4050-b329-19c36b4ab7d9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:10.629570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bace96d-5df1-4050-b329-19c36b4ab7d9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:10.630003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bace96d-5df1-4050-b329-19c36b4ab7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:10.667191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0bace96d-5df1-4050-b329-19c36b4ab7d9 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:10.671448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0bace96d-5df1-4050-b329-19c36b4ab7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:10.720324 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1320/2629] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:10.760483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede7733-7727-4c5c-a0fa-ed235a10b4dc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:10.762531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cede7733-7727-4c5c-a0fa-ed235a10b4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:10.794250 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1310/2630] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:48:10 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:48:10.831613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bace96d-5df1-4050-b329-19c36b4ab7d9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:10.836394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0bace96d-5df1-4050-b329-19c36b4ab7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:10.873081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bace96d-5df1-4050-b329-19c36b4ab7d9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:10.896070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37593f24-79a4-4917-bf9c-f0f54ec1b92b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:10.897217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37593f24-79a4-4917-bf9c-f0f54ec1b92b service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:10.899657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37593f24-79a4-4917-bf9c-f0f54ec1b92b service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:10.901433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37593f24-79a4-4917-bf9c-f0f54ec1b92b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:10.925968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37593f24-79a4-4917-bf9c-f0f54ec1b92b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:10.929220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37593f24-79a4-4917-bf9c-f0f54ec1b92b service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:10.948286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede7733-7727-4c5c-a0fa-ed235a10b4dc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:10.955424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387698b-0dea-46bb-b327-2985c2cd8146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:10.957724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387698b-0dea-46bb-b327-2985c2cd8146 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:10.958068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387698b-0dea-46bb-b327-2985c2cd8146 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:10.958575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387698b-0dea-46bb-b327-2985c2cd8146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:10.963367 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1311/2631] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:10 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:10.974504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387698b-0dea-46bb-b327-2985c2cd8146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:10.977822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387698b-0dea-46bb-b327-2985c2cd8146 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:10.991289 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1321/2632] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:48:13.383072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632d1db-489e-4dc1-8a55-e5446127a97f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:13.383812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632d1db-489e-4dc1-8a55-e5446127a97f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:13.384171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632d1db-489e-4dc1-8a55-e5446127a97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:13.508169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3632d1db-489e-4dc1-8a55-e5446127a97f None None] MFA Rules not processed for user `bb85b086594c4389b15420a56941c229`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:13.509877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3632d1db-489e-4dc1-8a55-e5446127a97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:13.710371 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1312/2633] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:13 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:48:13.722179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a616c05-c1a4-4eb0-83d9-e3d98a5c0b31 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:13.723114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a616c05-c1a4-4eb0-83d9-e3d98a5c0b31 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:13.723645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a616c05-c1a4-4eb0-83d9-e3d98a5c0b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:13.747980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5a616c05-c1a4-4eb0-83d9-e3d98a5c0b31 None None] MFA Rules not processed for user `bb85b086594c4389b15420a56941c229`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:13.749546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5a616c05-c1a4-4eb0-83d9-e3d98a5c0b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:13.775952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e439c6-d664-4b7b-8a1e-4ac463992e3b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:13.778682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e439c6-d664-4b7b-8a1e-4ac463992e3b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:13.779732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e439c6-d664-4b7b-8a1e-4ac463992e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:13.795141 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1322/2634] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:13 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:13.809539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a8e439c6-d664-4b7b-8a1e-4ac463992e3b None None] MFA Rules not processed for user `bb85b086594c4389b15420a56941c229`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:13.811449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a8e439c6-d664-4b7b-8a1e-4ac463992e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:13.823593 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1313/2635] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:13 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:13.901704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a616c05-c1a4-4eb0-83d9-e3d98a5c0b31 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:13.903717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5a616c05-c1a4-4eb0-83d9-e3d98a5c0b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:14.053089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a616c05-c1a4-4eb0-83d9-e3d98a5c0b31 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:14.059611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee787da-1d6b-43b2-bf38-117ece1f1769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:14.060203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee787da-1d6b-43b2-bf38-117ece1f1769 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:14.060489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee787da-1d6b-43b2-bf38-117ece1f1769 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:14.061012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee787da-1d6b-43b2-bf38-117ece1f1769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:14.069897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee787da-1d6b-43b2-bf38-117ece1f1769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:14.071818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee787da-1d6b-43b2-bf38-117ece1f1769 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:14.083006 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1323/2636] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:13 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:15.422882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09e0e-c434-4c8b-8d99-6a3564730547 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:15.423426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09e0e-c434-4c8b-8d99-6a3564730547 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:15.431561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09e0e-c434-4c8b-8d99-6a3564730547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:15.485518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-28c09e0e-c434-4c8b-8d99-6a3564730547 None None] MFA Rules not processed for user `bb85b086594c4389b15420a56941c229`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:15.487323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-28c09e0e-c434-4c8b-8d99-6a3564730547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:15.523353 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1314/2637] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:15 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:17.051904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee787da-1d6b-43b2-bf38-117ece1f1769 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:17.053967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cee787da-1d6b-43b2-bf38-117ece1f1769 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:17.097192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee787da-1d6b-43b2-bf38-117ece1f1769 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:17.119670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0c87d-9505-4603-9cce-398c47846351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:17.126371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c87d-9505-4603-9cce-398c47846351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:17.128457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c87d-9505-4603-9cce-398c47846351 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:17.129615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c87d-9505-4603-9cce-398c47846351 admin admin] PATH_INFO: `/v3/users/1a069b7aa4c94607943e3493c6295fb3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:17.135418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0c87d-9505-4603-9cce-398c47846351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a069b7aa4c94607943e3493c6295fb3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:17.142601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0c87d-9505-4603-9cce-398c47846351 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:17.195556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09e0e-c434-4c8b-8d99-6a3564730547 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:17.197813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-28c09e0e-c434-4c8b-8d99-6a3564730547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:17.233043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09e0e-c434-4c8b-8d99-6a3564730547 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:17.253610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:17.258276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:17.262890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:17.263389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] PATH_INFO: `/v3/users/9322591436e34060a46c6f145dca61d7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:17.267894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9322591436e34060a46c6f145dca61d7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:17.270279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:17.294290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-92f0c87d-9505-4603-9cce-398c47846351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a069b7aa4c94607943e3493c6295fb3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:17.295231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-92f0c87d-9505-4603-9cce-398c47846351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a069b7aa4c94607943e3493c6295fb3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:17.318807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-92f0c87d-9505-4603-9cce-398c47846351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a069b7aa4c94607943e3493c6295fb3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:17.319902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-92f0c87d-9505-4603-9cce-398c47846351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a069b7aa4c94607943e3493c6295fb3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:17.330906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-92f0c87d-9505-4603-9cce-398c47846351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a069b7aa4c94607943e3493c6295fb3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:17.365197 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1324/2638] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:48:17 2021] DELETE /identity/v3/users/1a069b7aa4c94607943e3493c6295fb3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:17.371660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc23e2-9b02-4c92-91d3-0ef064637f03 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:17.372265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc23e2-9b02-4c92-91d3-0ef064637f03 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:17.372690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc23e2-9b02-4c92-91d3-0ef064637f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:17.418216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d8cc23e2-9b02-4c92-91d3-0ef064637f03 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:17.421115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9322591436e34060a46c6f145dca61d7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:17.424036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d8cc23e2-9b02-4c92-91d3-0ef064637f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:17.449076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9322591436e34060a46c6f145dca61d7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:17.449972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9322591436e34060a46c6f145dca61d7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:17.470574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9322591436e34060a46c6f145dca61d7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:17.503656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9322591436e34060a46c6f145dca61d7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:17.523519 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1315/2639] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:48:17 2021] DELETE /identity/v3/users/9322591436e34060a46c6f145dca61d7 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:48:17.588282 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1325/2640] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:17.666888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:17.668563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:17.776883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb92a1e-9221-4baa-ae68-9baa93e57d13 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:17.791399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58f94e-6944-4734-afb5-be280bb2d81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:17.796801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58f94e-6944-4734-afb5-be280bb2d81b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:17.797356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58f94e-6944-4734-afb5-be280bb2d81b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:17.797844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58f94e-6944-4734-afb5-be280bb2d81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:18.244446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc23e2-9b02-4c92-91d3-0ef064637f03 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:18.246821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d8cc23e2-9b02-4c92-91d3-0ef064637f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:18.265398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58f94e-6944-4734-afb5-be280bb2d81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:18.266184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc23e2-9b02-4c92-91d3-0ef064637f03 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:18.278028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58f94e-6944-4734-afb5-be280bb2d81b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:18.284489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:18.285531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:18.286173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:18.286599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] PATH_INFO: `/v3/projects/bba5dc062b60481085531bc034e45209` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:18.291094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba5dc062b60481085531bc034e45209)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:18.294034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:18.343819 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1316/2641] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:18.448380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba5dc062b60481085531bc034e45209', 'request_id': 'req-b86a1073-2be7-4412-b02f-17d339694dbb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:18.462545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba5dc062b60481085531bc034e45209', 'request_id': 'req-b86a1073-2be7-4412-b02f-17d339694dbb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:18.488635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba5dc062b60481085531bc034e45209', 'request_id': 'req-b86a1073-2be7-4412-b02f-17d339694dbb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:18.536380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] The token cache is being invalidate because project bba5dc062b60481085531bc034e45209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:48:18.537335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:18.540545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b86a1073-2be7-4412-b02f-17d339694dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:18.550555 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1326/2642] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:48:18 2021] DELETE /identity/v3/projects/bba5dc062b60481085531bc034e45209 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:18.556587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17585d03-e5ef-4b3e-b196-3568bc1d3079 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:18.557174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17585d03-e5ef-4b3e-b196-3568bc1d3079 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:18.557658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17585d03-e5ef-4b3e-b196-3568bc1d3079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:18.594543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb5af-a70c-4cb0-90fa-c6b10b90c107 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:18.595175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb5af-a70c-4cb0-90fa-c6b10b90c107 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:18.595635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb5af-a70c-4cb0-90fa-c6b10b90c107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:18.625207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-772bb5af-a70c-4cb0-90fa-c6b10b90c107 None None] MFA Rules not processed for user `bb85b086594c4389b15420a56941c229`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:18.627292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-772bb5af-a70c-4cb0-90fa-c6b10b90c107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:18.629886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-17585d03-e5ef-4b3e-b196-3568bc1d3079 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:18.641019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-17585d03-e5ef-4b3e-b196-3568bc1d3079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:18.713264 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1327/2643] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:18 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:18.853591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e74f41-0b04-499a-93c7-160a1983e902 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:18.854114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e74f41-0b04-499a-93c7-160a1983e902 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:18.854604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e74f41-0b04-499a-93c7-160a1983e902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:18.859838 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1317/2644] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:18.901820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-57e74f41-0b04-499a-93c7-160a1983e902 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:18.903729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-57e74f41-0b04-499a-93c7-160a1983e902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:18.940072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17585d03-e5ef-4b3e-b196-3568bc1d3079 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:18.943612 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1328/2645] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:18.990603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17585d03-e5ef-4b3e-b196-3568bc1d3079 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:19.023190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecc3ea-1b09-45c3-b567-5b28278a37dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:19.026244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecc3ea-1b09-45c3-b567-5b28278a37dc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:19.028994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecc3ea-1b09-45c3-b567-5b28278a37dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:19.029888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ecc3ea-1b09-45c3-b567-5b28278a37dc admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:19.037202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecc3ea-1b09-45c3-b567-5b28278a37dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:48:19.037600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecc3ea-1b09-45c3-b567-5b28278a37dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:19.045973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ecc3ea-1b09-45c3-b567-5b28278a37dc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:19.070280 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1318/2646] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:48:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:48:19.071515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e74f41-0b04-499a-93c7-160a1983e902 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:19.081803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e74f41-0b04-499a-93c7-160a1983e902 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:19.100979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad2dd8-2cd5-49fe-9e06-16b2006609b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:19.101787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2dd8-2cd5-49fe-9e06-16b2006609b5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:19.102091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2dd8-2cd5-49fe-9e06-16b2006609b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:19.102769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2dd8-2cd5-49fe-9e06-16b2006609b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:19.103550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad2dd8-2cd5-49fe-9e06-16b2006609b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:19.105684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad2dd8-2cd5-49fe-9e06-16b2006609b5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:19.187808 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1329/2647] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:48:19 2021] POST /identity/v3/projects => generated 413 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:48:19.193013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecc3ea-1b09-45c3-b567-5b28278a37dc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:19.208012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ecc3ea-1b09-45c3-b567-5b28278a37dc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:19.350421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77acd77-5f9c-46ee-8024-4017e5e864db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:19.353930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77acd77-5f9c-46ee-8024-4017e5e864db admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:19.354411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77acd77-5f9c-46ee-8024-4017e5e864db admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:19.354842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77acd77-5f9c-46ee-8024-4017e5e864db admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:19.357147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77acd77-5f9c-46ee-8024-4017e5e864db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:19.361410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77acd77-5f9c-46ee-8024-4017e5e864db admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:19.410500 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1319/2648] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:48:19 2021] POST /identity/v3/users => generated 307 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:48:19.416215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad2dd8-2cd5-49fe-9e06-16b2006609b5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:19.431901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad2dd8-2cd5-49fe-9e06-16b2006609b5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:19.448965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b83b29-9dbf-4b8e-882c-70bcbc4d31b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:19.450196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b83b29-9dbf-4b8e-882c-70bcbc4d31b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:19.451210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b83b29-9dbf-4b8e-882c-70bcbc4d31b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:19.452383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b83b29-9dbf-4b8e-882c-70bcbc4d31b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:19.453810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b83b29-9dbf-4b8e-882c-70bcbc4d31b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:19.456907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b83b29-9dbf-4b8e-882c-70bcbc4d31b4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:19.479667 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1330/2649] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:48:19 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:48:19.483735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77acd77-5f9c-46ee-8024-4017e5e864db admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:19.499137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77acd77-5f9c-46ee-8024-4017e5e864db admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:19.519075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3613d24-43da-4777-bc03-9788d974eedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:19.520248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3613d24-43da-4777-bc03-9788d974eedb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:19.520791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3613d24-43da-4777-bc03-9788d974eedb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:19.521473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3613d24-43da-4777-bc03-9788d974eedb admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:19.522660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3613d24-43da-4777-bc03-9788d974eedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:19.532076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3613d24-43da-4777-bc03-9788d974eedb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:19.560811 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1320/2650] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:48:19 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:48:19.566256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b83b29-9dbf-4b8e-882c-70bcbc4d31b4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:19.586470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b83b29-9dbf-4b8e-882c-70bcbc4d31b4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:19.601332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113523e-0d0b-4187-a2a5-5e14869679ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:19.602724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113523e-0d0b-4187-a2a5-5e14869679ca admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:19.603302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113523e-0d0b-4187-a2a5-5e14869679ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:19.604686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113523e-0d0b-4187-a2a5-5e14869679ca admin admin] PATH_INFO: `/v3/projects/e11cec7060094963bccef4d0cadba71d/users/367987f33e48490a94602847ed0881e7/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:19.646384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113523e-0d0b-4187-a2a5-5e14869679ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11cec7060094963bccef4d0cadba71d, user_id=367987f33e48490a94602847ed0881e7, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:19.652770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113523e-0d0b-4187-a2a5-5e14869679ca admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:19.690433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274bd8e-ad0d-4d97-a970-78c9b0fc4614 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:19.691575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274bd8e-ad0d-4d97-a970-78c9b0fc4614 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:19.692061 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1331/2651] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:48:19 2021] PUT /identity/v3/projects/e11cec7060094963bccef4d0cadba71d/users/367987f33e48490a94602847ed0881e7/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:19.695124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274bd8e-ad0d-4d97-a970-78c9b0fc4614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:19.766739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0274bd8e-ad0d-4d97-a970-78c9b0fc4614 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:19.769146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0274bd8e-ad0d-4d97-a970-78c9b0fc4614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:19.922551 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1321/2652] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:48:20.005570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113523e-0d0b-4187-a2a5-5e14869679ca admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:20.008474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4113523e-0d0b-4187-a2a5-5e14869679ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:20.153589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274bd8e-ad0d-4d97-a970-78c9b0fc4614 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:20.155023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0274bd8e-ad0d-4d97-a970-78c9b0fc4614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:20.176170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274bd8e-ad0d-4d97-a970-78c9b0fc4614 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:20.188334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:20.189778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:20.191654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:20.192297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] PATH_INFO: `/v3/projects/c8c32b0fff364ad7b9bbaf1fb71e3a67` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:20.203493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c32b0fff364ad7b9bbaf1fb71e3a67)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:20.207630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:20.242210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113523e-0d0b-4187-a2a5-5e14869679ca admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:20.261775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c87669-1120-4450-9d26-38e737252777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:20.263471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c87669-1120-4450-9d26-38e737252777 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:20.263766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c87669-1120-4450-9d26-38e737252777 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:20.264046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c87669-1120-4450-9d26-38e737252777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:20.291761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c87669-1120-4450-9d26-38e737252777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:20.293265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c87669-1120-4450-9d26-38e737252777 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:20.321289 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1332/2653] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:20.368329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'request_id': 'req-62684327-cec2-46ff-a3be-709f075bbb79'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:20.393913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'request_id': 'req-62684327-cec2-46ff-a3be-709f075bbb79'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:20.402753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c32b0fff364ad7b9bbaf1fb71e3a67', 'request_id': 'req-62684327-cec2-46ff-a3be-709f075bbb79'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:20.417648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] The token cache is being invalidate because project c8c32b0fff364ad7b9bbaf1fb71e3a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:48:20.418284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:20.419712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:20.422053 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1322/2654] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:48:20 2021] DELETE /identity/v3/projects/c8c32b0fff364ad7b9bbaf1fb71e3a67 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:48:20.426943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c87669-1120-4450-9d26-38e737252777 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:20.447794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c87669-1120-4450-9d26-38e737252777 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:20.560038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:20.562410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:20.562757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:20.563103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] PATH_INFO: `/v3/users/451fc18cebb8439c9aa16f0da07600b1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:20.566048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=451fc18cebb8439c9aa16f0da07600b1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:20.569487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:20.690302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:20.691758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:20.696387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451fc18cebb8439c9aa16f0da07600b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:20.698076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451fc18cebb8439c9aa16f0da07600b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:20.717244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451fc18cebb8439c9aa16f0da07600b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:20.718294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451fc18cebb8439c9aa16f0da07600b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:20.734709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451fc18cebb8439c9aa16f0da07600b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:20.780304 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1333/2655] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:48:20 2021] DELETE /identity/v3/users/451fc18cebb8439c9aa16f0da07600b1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:20.846112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62684327-cec2-46ff-a3be-709f075bbb79 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:21.014103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e83151-7161-45ed-898d-878ec3f17fa0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:21.014895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83151-7161-45ed-898d-878ec3f17fa0 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:21.015305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83151-7161-45ed-898d-878ec3f17fa0 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:21.015717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83151-7161-45ed-898d-878ec3f17fa0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:21.024387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e9e83151-7161-45ed-898d-878ec3f17fa0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:21.049569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e83151-7161-45ed-898d-878ec3f17fa0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:21.051343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e83151-7161-45ed-898d-878ec3f17fa0 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:21.075515 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1323/2656] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:20 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:48:21.195532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:21.197100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:21.302333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a3e32-f661-4cea-9eaa-c6e42c6ee6f4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:21.307188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:21.308380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:21.308767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:21.309132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] PATH_INFO: `/v3/projects/03e6f572dbff4069a27888a2ddfaf435` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:21.310605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e6f572dbff4069a27888a2ddfaf435)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:21.312864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:21.380875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47077b-116b-4c7f-ba90-3d8604c537e1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:21.381712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e6f572dbff4069a27888a2ddfaf435', 'request_id': 'req-f3c1556f-3f46-4189-b580-29aaf3d0ba49'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:21.381994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47077b-116b-4c7f-ba90-3d8604c537e1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:21.383652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47077b-116b-4c7f-ba90-3d8604c537e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:21.390072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e6f572dbff4069a27888a2ddfaf435', 'request_id': 'req-f3c1556f-3f46-4189-b580-29aaf3d0ba49'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:21.399041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e6f572dbff4069a27888a2ddfaf435', 'request_id': 'req-f3c1556f-3f46-4189-b580-29aaf3d0ba49'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:21.403842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6a47077b-116b-4c7f-ba90-3d8604c537e1 None None] MFA Rules not processed for user `4230d9b8ef6540bfbc4f034885d418e8`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:21.405056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6a47077b-116b-4c7f-ba90-3d8604c537e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:21.432222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] The token cache is being invalidate because project 03e6f572dbff4069a27888a2ddfaf435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:48:21.433118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:21.434071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f3c1556f-3f46-4189-b580-29aaf3d0ba49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:48:21.437755 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1334/2657] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:48:21 2021] DELETE /identity/v3/projects/03e6f572dbff4069a27888a2ddfaf435 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:21.447873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb43632-e11a-45c7-98df-c382132f5d3a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:21.450386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb43632-e11a-45c7-98df-c382132f5d3a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:21.450683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb43632-e11a-45c7-98df-c382132f5d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:21.474654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0fb43632-e11a-45c7-98df-c382132f5d3a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:21.476280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0fb43632-e11a-45c7-98df-c382132f5d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:21.487314 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1324/2658] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:21 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:48:21.619608 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1335/2659] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:21.630652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd966-90ef-46d7-b832-6a4748d99750 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:21.632493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd966-90ef-46d7-b832-6a4748d99750 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:21.633477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dd966-90ef-46d7-b832-6a4748d99750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:21.653044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb43632-e11a-45c7-98df-c382132f5d3a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:21.657909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0fb43632-e11a-45c7-98df-c382132f5d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:21.697731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0a6dd966-90ef-46d7-b832-6a4748d99750 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:21.700148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0a6dd966-90ef-46d7-b832-6a4748d99750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:21.712399 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1325/2660] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:21.718870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dd966-90ef-46d7-b832-6a4748d99750 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:21.737716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dd966-90ef-46d7-b832-6a4748d99750 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:21.752433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f8a1-8619-4b40-b630-5e870ba047b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:21.753123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f8a1-8619-4b40-b630-5e870ba047b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:21.753422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f8a1-8619-4b40-b630-5e870ba047b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:21.753670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f8a1-8619-4b40-b630-5e870ba047b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:21.755539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660f8a1-8619-4b40-b630-5e870ba047b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:48:21.757778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660f8a1-8619-4b40-b630-5e870ba047b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:21.778420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660f8a1-8619-4b40-b630-5e870ba047b7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:21.825519 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1326/2661] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:48:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:48:21.829735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f8a1-8619-4b40-b630-5e870ba047b7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:21.861262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb43632-e11a-45c7-98df-c382132f5d3a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:21.868505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f8a1-8619-4b40-b630-5e870ba047b7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:21.878758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14ed51-8262-4037-a151-cc5335049355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:21.880857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ee843-88d2-4d20-a859-e9944d9237e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:21.881445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14ed51-8262-4037-a151-cc5335049355 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:21.881756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14ed51-8262-4037-a151-cc5335049355 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:21.882032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14ed51-8262-4037-a151-cc5335049355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:21.882985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ee843-88d2-4d20-a859-e9944d9237e9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:21.883280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ee843-88d2-4d20-a859-e9944d9237e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:21.884391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ee843-88d2-4d20-a859-e9944d9237e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:21.885129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ee843-88d2-4d20-a859-e9944d9237e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:21.887672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8f14ed51-8262-4037-a151-cc5335049355 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:21.894659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ee843-88d2-4d20-a859-e9944d9237e9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:21.923641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14ed51-8262-4037-a151-cc5335049355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:21.930411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14ed51-8262-4037-a151-cc5335049355 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:21.962124 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1336/2662] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:21 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:48:21.965209 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1327/2663] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:48:21 2021] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:48:21.971597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14ed51-8262-4037-a151-cc5335049355 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:22.001793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14ed51-8262-4037-a151-cc5335049355 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:22.182969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94812dd9-2caa-410b-b99d-4e0a87f0f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:22.183688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94812dd9-2caa-410b-b99d-4e0a87f0f856 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:22.184290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94812dd9-2caa-410b-b99d-4e0a87f0f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:22.184648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94812dd9-2caa-410b-b99d-4e0a87f0f856 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:22.185367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94812dd9-2caa-410b-b99d-4e0a87f0f856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:22.191432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94812dd9-2caa-410b-b99d-4e0a87f0f856 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:22.231599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ee843-88d2-4d20-a859-e9944d9237e9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:22.240817 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1337/2664] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:48:21 2021] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:48:22.247772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ee843-88d2-4d20-a859-e9944d9237e9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:22.262752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b17e3-e1c0-4b7b-b7e1-6866bf2010ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:22.262752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b17e3-e1c0-4b7b-b7e1-6866bf2010ed admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:22.262752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b17e3-e1c0-4b7b-b7e1-6866bf2010ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:22.262752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b17e3-e1c0-4b7b-b7e1-6866bf2010ed admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:22.263082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b17e3-e1c0-4b7b-b7e1-6866bf2010ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:22.264580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b17e3-e1c0-4b7b-b7e1-6866bf2010ed admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:22.295288 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1328/2665] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:48:22 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:48:22.299915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94812dd9-2caa-410b-b99d-4e0a87f0f856 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:22.313664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94812dd9-2caa-410b-b99d-4e0a87f0f856 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:22.329211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84806f-1a39-4ce9-9754-fe50c1b304bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:22.329878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84806f-1a39-4ce9-9754-fe50c1b304bd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:22.330679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84806f-1a39-4ce9-9754-fe50c1b304bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:22.330961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84806f-1a39-4ce9-9754-fe50c1b304bd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:22.332586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84806f-1a39-4ce9-9754-fe50c1b304bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:22.336710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84806f-1a39-4ce9-9754-fe50c1b304bd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:22.364120 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1338/2666] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:48:22 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:48:22.369218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b17e3-e1c0-4b7b-b7e1-6866bf2010ed admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:22.398016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b17e3-e1c0-4b7b-b7e1-6866bf2010ed admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:22.410668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b0852-bcaa-4e25-a167-38fbf812bc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:22.412073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b0852-bcaa-4e25-a167-38fbf812bc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:22.412360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b0852-bcaa-4e25-a167-38fbf812bc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:22.412684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b0852-bcaa-4e25-a167-38fbf812bc94 admin admin] PATH_INFO: `/v3/projects/c03fae8406904a0da2046c097555cf58/users/4561f04227544d2ca76bce3dc5618c7f/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:22.474525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b0852-bcaa-4e25-a167-38fbf812bc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03fae8406904a0da2046c097555cf58, user_id=4561f04227544d2ca76bce3dc5618c7f, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:22.489132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b0852-bcaa-4e25-a167-38fbf812bc94 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:22.510571 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1329/2667] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:48:22 2021] PUT /identity/v3/projects/c03fae8406904a0da2046c097555cf58/users/4561f04227544d2ca76bce3dc5618c7f/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:22.523914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f611-1e4c-4039-97b7-672970a77f93 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:22.524497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f611-1e4c-4039-97b7-672970a77f93 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:22.524497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f611-1e4c-4039-97b7-672970a77f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:22.585058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d178f611-1e4c-4039-97b7-672970a77f93 None None] MFA Rules not processed for user `4561f04227544d2ca76bce3dc5618c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:22.589663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d178f611-1e4c-4039-97b7-672970a77f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:22.736272 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1339/2668] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:22 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:22.740556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b0852-bcaa-4e25-a167-38fbf812bc94 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:22.876543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b0852-bcaa-4e25-a167-38fbf812bc94 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:22.882545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3c72-de44-47e3-8c3f-d842c6a4df30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:22.883454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3c72-de44-47e3-8c3f-d842c6a4df30 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:22.883814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3c72-de44-47e3-8c3f-d842c6a4df30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:22.884163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3c72-de44-47e3-8c3f-d842c6a4df30 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:22.884955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3c72-de44-47e3-8c3f-d842c6a4df30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:22.887296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3c72-de44-47e3-8c3f-d842c6a4df30 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:22.953011 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1330/2669] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:48:22 2021] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:48:22.957507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f611-1e4c-4039-97b7-672970a77f93 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:22.977032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f611-1e4c-4039-97b7-672970a77f93 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:23.082927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6885b2-d029-4a25-bf7d-7fcc38481095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:23.084785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6885b2-d029-4a25-bf7d-7fcc38481095 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:23.084785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6885b2-d029-4a25-bf7d-7fcc38481095 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:23.085371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6885b2-d029-4a25-bf7d-7fcc38481095 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:23.086349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6885b2-d029-4a25-bf7d-7fcc38481095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:23.088546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6885b2-d029-4a25-bf7d-7fcc38481095 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:23.117661 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1340/2670] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:48:22 2021] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:48:23.119302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3c72-de44-47e3-8c3f-d842c6a4df30 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:23.136525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3c72-de44-47e3-8c3f-d842c6a4df30 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:23.150426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407404e-1c37-40a6-a244-521f5d69a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:23.151272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407404e-1c37-40a6-a244-521f5d69a727 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:23.151648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407404e-1c37-40a6-a244-521f5d69a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:23.152020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407404e-1c37-40a6-a244-521f5d69a727 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:23.152871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407404e-1c37-40a6-a244-521f5d69a727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:23.154597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407404e-1c37-40a6-a244-521f5d69a727 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:23.166122 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1331/2671] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:48:23 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:48:23.170451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6885b2-d029-4a25-bf7d-7fcc38481095 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:23.186932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6885b2-d029-4a25-bf7d-7fcc38481095 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:23.196145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c847b-18d2-4b44-b78d-496a929512cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:23.197330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c847b-18d2-4b44-b78d-496a929512cb admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:23.197772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c847b-18d2-4b44-b78d-496a929512cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:23.198500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c847b-18d2-4b44-b78d-496a929512cb admin admin] PATH_INFO: `/v3/projects/6d0232d0e6ad4f948c0ebf33ef3bca81/users/516331a90cf4475b84723f44ea82d77f/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:23.236631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c847b-18d2-4b44-b78d-496a929512cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0232d0e6ad4f948c0ebf33ef3bca81, user_id=516331a90cf4475b84723f44ea82d77f, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:23.243000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c847b-18d2-4b44-b78d-496a929512cb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:23.273260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407404e-1c37-40a6-a244-521f5d69a727 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:23.275048 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1341/2672] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:48:23 2021] PUT /identity/v3/projects/6d0232d0e6ad4f948c0ebf33ef3bca81/users/516331a90cf4475b84723f44ea82d77f/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:48:23.285657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407404e-1c37-40a6-a244-521f5d69a727 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:23.493543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921004a8-ab3c-4e27-8c70-0a4e3bb4d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:23.495213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921004a8-ab3c-4e27-8c70-0a4e3bb4d752 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:23.495680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921004a8-ab3c-4e27-8c70-0a4e3bb4d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:23.496108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921004a8-ab3c-4e27-8c70-0a4e3bb4d752 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:23.497006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921004a8-ab3c-4e27-8c70-0a4e3bb4d752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:23.498773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921004a8-ab3c-4e27-8c70-0a4e3bb4d752 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:23.514470 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1332/2673] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:48:23 2021] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:48:23.519051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c847b-18d2-4b44-b78d-496a929512cb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:23.533218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c847b-18d2-4b44-b78d-496a929512cb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:23.548579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b771ff0-06ba-48cd-875c-9aae3dc42e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:23.549680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b771ff0-06ba-48cd-875c-9aae3dc42e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:23.550276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b771ff0-06ba-48cd-875c-9aae3dc42e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:23.550623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b771ff0-06ba-48cd-875c-9aae3dc42e92 admin admin] PATH_INFO: `/v3/projects/6d0232d0e6ad4f948c0ebf33ef3bca81/users/516331a90cf4475b84723f44ea82d77f/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:23.553334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b771ff0-06ba-48cd-875c-9aae3dc42e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0232d0e6ad4f948c0ebf33ef3bca81, user_id=516331a90cf4475b84723f44ea82d77f, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:23.556990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b771ff0-06ba-48cd-875c-9aae3dc42e92 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:23.570153 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1342/2674] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:48:23 2021] PUT /identity/v3/projects/6d0232d0e6ad4f948c0ebf33ef3bca81/users/516331a90cf4475b84723f44ea82d77f/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:48:23.581212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ff3f5-30a5-49ef-b554-1792a70de2e0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:23.581532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ff3f5-30a5-49ef-b554-1792a70de2e0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:23.581798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ff3f5-30a5-49ef-b554-1792a70de2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:23.638678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-096ff3f5-30a5-49ef-b554-1792a70de2e0 None None] MFA Rules not processed for user `516331a90cf4475b84723f44ea82d77f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:23.639990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-096ff3f5-30a5-49ef-b554-1792a70de2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:23.849257 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1333/2675] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:23 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:23.862464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5c3eb-7ecc-440b-99d7-8db517a69c92 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:23.863014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5c3eb-7ecc-440b-99d7-8db517a69c92 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:23.863656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5c3eb-7ecc-440b-99d7-8db517a69c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:23.887543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fde5c3eb-7ecc-440b-99d7-8db517a69c92 None None] MFA Rules not processed for user `4561f04227544d2ca76bce3dc5618c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:23.888925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fde5c3eb-7ecc-440b-99d7-8db517a69c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:24.025347 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1343/2676] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:23 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:24.416969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ff3f5-30a5-49ef-b554-1792a70de2e0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:24.564082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ff3f5-30a5-49ef-b554-1792a70de2e0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:24.578762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a9d3f-5327-4448-aa6b-0c5841104974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:24.580535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a9d3f-5327-4448-aa6b-0c5841104974 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:24.581091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a9d3f-5327-4448-aa6b-0c5841104974 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:24.581573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a9d3f-5327-4448-aa6b-0c5841104974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:24.591975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a9d3f-5327-4448-aa6b-0c5841104974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:24.596235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a9d3f-5327-4448-aa6b-0c5841104974 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:24.625138 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1334/2677] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:24 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:25.340156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f432d-e2d2-4a42-9530-b062f1fc3afd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:25.340672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f432d-e2d2-4a42-9530-b062f1fc3afd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:25.340781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f432d-e2d2-4a42-9530-b062f1fc3afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:25.392759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9a4f432d-e2d2-4a42-9530-b062f1fc3afd None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:25.393967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9a4f432d-e2d2-4a42-9530-b062f1fc3afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:25.506779 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1344/2678] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:48:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:25.522761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a9d3f-5327-4448-aa6b-0c5841104974 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:25.524708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1d4a9d3f-5327-4448-aa6b-0c5841104974 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:25.625540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a9d3f-5327-4448-aa6b-0c5841104974 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:25.633519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcac222-893a-4038-bbb2-b005989097b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:25.634440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac222-893a-4038-bbb2-b005989097b8 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:25.634824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac222-893a-4038-bbb2-b005989097b8 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:25.635487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcac222-893a-4038-bbb2-b005989097b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:25.647605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcac222-893a-4038-bbb2-b005989097b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:25.650147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcac222-893a-4038-bbb2-b005989097b8 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:25.664734 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1335/2679] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:48:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:48:28.733873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e717c-314f-4224-86a0-1498350e3749 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:28.734415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e717c-314f-4224-86a0-1498350e3749 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:28.734415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e717c-314f-4224-86a0-1498350e3749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:28.796375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e43e717c-314f-4224-86a0-1498350e3749 None None] MFA Rules not processed for user `3cb6bc63929648388ac9648823d4ca88`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:28.797616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e43e717c-314f-4224-86a0-1498350e3749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:28.945759 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1345/2680] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:28 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:30.996789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733df3-fefb-4a92-b2fd-53675a06b8b0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:30.997353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733df3-fefb-4a92-b2fd-53675a06b8b0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:30.997353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733df3-fefb-4a92-b2fd-53675a06b8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:31.033561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-77733df3-fefb-4a92-b2fd-53675a06b8b0 None None] MFA Rules not processed for user `367987f33e48490a94602847ed0881e7`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:31.036472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-77733df3-fefb-4a92-b2fd-53675a06b8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:31.196884 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1336/2681] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:30 2021] POST /identity/v3/auth/tokens => generated 3280 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:48:31.207128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb63a-57c0-4f3a-a6db-4b0958a68d3f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:31.208158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb63a-57c0-4f3a-a6db-4b0958a68d3f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:31.208660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb63a-57c0-4f3a-a6db-4b0958a68d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:31.238622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-bc0bb63a-57c0-4f3a-a6db-4b0958a68d3f None None] MFA Rules not processed for user `367987f33e48490a94602847ed0881e7`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:31.250594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bc0bb63a-57c0-4f3a-a6db-4b0958a68d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:31.260893 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1346/2682] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:31 2021] POST /identity/v3/auth/tokens => generated 3280 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:31.847392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77733df3-fefb-4a92-b2fd-53675a06b8b0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:31.849455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-77733df3-fefb-4a92-b2fd-53675a06b8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:31.866239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77733df3-fefb-4a92-b2fd-53675a06b8b0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:31.872409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d5464-24d2-455d-ac65-0091ed00e0a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:31.873138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d5464-24d2-455d-ac65-0091ed00e0a6 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:31.873495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d5464-24d2-455d-ac65-0091ed00e0a6 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:31.873869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d5464-24d2-455d-ac65-0091ed00e0a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:31.882856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d5464-24d2-455d-ac65-0091ed00e0a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:31.884523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d5464-24d2-455d-ac65-0091ed00e0a6 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:31.894806 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1337/2683] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:31 2021] GET /identity/v3/auth/tokens => generated 3280 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:36.538324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bb63a-57c0-4f3a-a6db-4b0958a68d3f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:36.539762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bc0bb63a-57c0-4f3a-a6db-4b0958a68d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:36.617887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bb63a-57c0-4f3a-a6db-4b0958a68d3f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:36.623430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a26f5e-9cc4-4001-93cf-f87c9804fc5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:36.624083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a26f5e-9cc4-4001-93cf-f87c9804fc5d service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:36.624365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a26f5e-9cc4-4001-93cf-f87c9804fc5d service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:36.624642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a26f5e-9cc4-4001-93cf-f87c9804fc5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:36.627115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-11a26f5e-9cc4-4001-93cf-f87c9804fc5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:36.638956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a26f5e-9cc4-4001-93cf-f87c9804fc5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:36.642221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a26f5e-9cc4-4001-93cf-f87c9804fc5d service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:36.652324 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1347/2684] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:45.803814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bc46-2611-4742-96f5-0c1d1388bf87 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:45.804923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bc46-2611-4742-96f5-0c1d1388bf87 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:45.805350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bc46-2611-4742-96f5-0c1d1388bf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:45.833642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3369bc46-2611-4742-96f5-0c1d1388bf87 None None] MFA Rules not processed for user `1d46c71936aa4118aa36a9e95b95c4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:45.835129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3369bc46-2611-4742-96f5-0c1d1388bf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:45.959377 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1338/2685] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:45 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:55.340794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0274b-d926-4dec-8040-301e00f8ccdc None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:55.341413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0274b-d926-4dec-8040-301e00f8ccdc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:55.341413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0274b-d926-4dec-8040-301e00f8ccdc None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:55.343098 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1348/2686] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:48:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:48:55.349014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb251-8f6d-4da6-bfc0-613c15bd1de7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:55.349461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb251-8f6d-4da6-bfc0-613c15bd1de7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:55.349607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb251-8f6d-4da6-bfc0-613c15bd1de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:55.368405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d89eb251-8f6d-4da6-bfc0-613c15bd1de7 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:55.369581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d89eb251-8f6d-4da6-bfc0-613c15bd1de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:55.378506 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1339/2687] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:48:55 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:48:55.401660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0274b-d926-4dec-8040-301e00f8ccdc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:55.415659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0274b-d926-4dec-8040-301e00f8ccdc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:55.420718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325fc22-2875-4de7-8366-a470d1f5c46f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:55.421628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325fc22-2875-4de7-8366-a470d1f5c46f service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:55.422014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325fc22-2875-4de7-8366-a470d1f5c46f service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:55.422395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325fc22-2875-4de7-8366-a470d1f5c46f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:55.431920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325fc22-2875-4de7-8366-a470d1f5c46f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:55.433631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325fc22-2875-4de7-8366-a470d1f5c46f service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:55.448189 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1349/2688] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:55 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:56.994960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba77c43-569f-4051-82e5-e72506277113 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:56.995529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba77c43-569f-4051-82e5-e72506277113 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:56.995629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba77c43-569f-4051-82e5-e72506277113 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:57.001105 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1340/2689] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:48:56 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:48:57.011880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab29e1-47f1-4bde-b983-b3fe93f283e2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:57.013126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab29e1-47f1-4bde-b983-b3fe93f283e2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:57.013843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab29e1-47f1-4bde-b983-b3fe93f283e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:57.043514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-48ab29e1-47f1-4bde-b983-b3fe93f283e2 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:57.044804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-48ab29e1-47f1-4bde-b983-b3fe93f283e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:57.055854 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1350/2690] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:48:57 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:48:57.079293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba77c43-569f-4051-82e5-e72506277113 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:57.101682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba77c43-569f-4051-82e5-e72506277113 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:57.114349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf620ba-f44d-4ae4-a67b-197558e6e5a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:57.115065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf620ba-f44d-4ae4-a67b-197558e6e5a4 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:57.115556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf620ba-f44d-4ae4-a67b-197558e6e5a4 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:57.115837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf620ba-f44d-4ae4-a67b-197558e6e5a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:57.126653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf620ba-f44d-4ae4-a67b-197558e6e5a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:57.128778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf620ba-f44d-4ae4-a67b-197558e6e5a4 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:57.139474 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1341/2691] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:57 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:48:57.302759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab29e1-47f1-4bde-b983-b3fe93f283e2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:48:57.316036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab29e1-47f1-4bde-b983-b3fe93f283e2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:48:57.322078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd757654-300e-4b6c-9ef9-50868d4e2ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:48:57.322723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757654-300e-4b6c-9ef9-50868d4e2ebf service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:57.323009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757654-300e-4b6c-9ef9-50868d4e2ebf service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:57.323312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd757654-300e-4b6c-9ef9-50868d4e2ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:57.332857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd757654-300e-4b6c-9ef9-50868d4e2ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:48:57.334652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd757654-300e-4b6c-9ef9-50868d4e2ebf service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:48:57.345699 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1351/2692] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:48:57 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:48:57.841215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4f85-5991-490c-8695-adf19d64a5f2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:48:57.841956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4f85-5991-490c-8695-adf19d64a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:48:57.842435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4f85-5991-490c-8695-adf19d64a5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:48:57.870811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-996d4f85-5991-490c-8695-adf19d64a5f2 None None] MFA Rules not processed for user `4561f04227544d2ca76bce3dc5618c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:48:57.873186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-996d4f85-5991-490c-8695-adf19d64a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:48:57.880881 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1342/2693] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:48:57 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:10.137542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441983c-118e-4973-8da4-81ef2667e4f6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:10.138090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441983c-118e-4973-8da4-81ef2667e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:10.138348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441983c-118e-4973-8da4-81ef2667e4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:10.156733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1441983c-118e-4973-8da4-81ef2667e4f6 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:10.158585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1441983c-118e-4973-8da4-81ef2667e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:10.166697 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1352/2694] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:49:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:10.191066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d4f85-5991-490c-8695-adf19d64a5f2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:10.204028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d4f85-5991-490c-8695-adf19d64a5f2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:10.209461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cd4e7-c9c9-4ce9-be01-f9cd38d27b91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:10.210225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cd4e7-c9c9-4ce9-be01-f9cd38d27b91 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:10.210616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cd4e7-c9c9-4ce9-be01-f9cd38d27b91 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:10.210971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cd4e7-c9c9-4ce9-be01-f9cd38d27b91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:10.222857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cd4e7-c9c9-4ce9-be01-f9cd38d27b91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:10.224981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cd4e7-c9c9-4ce9-be01-f9cd38d27b91 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:10.239729 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1343/2695] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:49:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:49:11.541333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aad94-331a-4ddf-b322-f0d21e8c433c None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:11.541895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aad94-331a-4ddf-b322-f0d21e8c433c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:11.542166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149aad94-331a-4ddf-b322-f0d21e8c433c None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:11.544726 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1353/2696] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:49:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:49:11.551029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3afa1-3ed7-405d-acc0-2f7cbff6523f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:11.551616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3afa1-3ed7-405d-acc0-2f7cbff6523f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:11.551616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3afa1-3ed7-405d-acc0-2f7cbff6523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:11.574099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3dc3afa1-3ed7-405d-acc0-2f7cbff6523f None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:11.575789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3dc3afa1-3ed7-405d-acc0-2f7cbff6523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:11.596073 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1344/2697] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:49:11 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:11.622689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aad94-331a-4ddf-b322-f0d21e8c433c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:11.625767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-149aad94-331a-4ddf-b322-f0d21e8c433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:11.647686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149aad94-331a-4ddf-b322-f0d21e8c433c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:11.653588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f7390-447b-4689-b272-dea4469ee585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:11.654863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f7390-447b-4689-b272-dea4469ee585 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:11.655369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f7390-447b-4689-b272-dea4469ee585 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:11.655823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f7390-447b-4689-b272-dea4469ee585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:11.668629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f7390-447b-4689-b272-dea4469ee585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:11.670500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f7390-447b-4689-b272-dea4469ee585 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:11.683878 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1354/2698] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:49:11 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:49:16.058197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957664f-1055-4443-adf2-29e86e206513 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:16.058788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957664f-1055-4443-adf2-29e86e206513 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:16.059002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957664f-1055-4443-adf2-29e86e206513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:16.079376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e957664f-1055-4443-adf2-29e86e206513 None None] MFA Rules not processed for user `2d326a07ce104727bec8ae98dabea64d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:16.080722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e957664f-1055-4443-adf2-29e86e206513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:16.158903 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1345/2699] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:16 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:49:20.492031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ccbc0-dedc-4164-b634-296725afb006 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:20.492616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ccbc0-dedc-4164-b634-296725afb006 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:20.493188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ccbc0-dedc-4164-b634-296725afb006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:20.543344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-303ccbc0-dedc-4164-b634-296725afb006 None None] MFA Rules not processed for user `4561f04227544d2ca76bce3dc5618c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:20.553994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-303ccbc0-dedc-4164-b634-296725afb006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:20.587046 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1355/2700] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:20 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:27.240506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957664f-1055-4443-adf2-29e86e206513 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:27.242240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e957664f-1055-4443-adf2-29e86e206513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:27.427984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957664f-1055-4443-adf2-29e86e206513 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:27.436339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:27.438240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:27.438905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:27.439483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] PATH_INFO: `/v3/users/367987f33e48490a94602847ed0881e7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:27.449965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=367987f33e48490a94602847ed0881e7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:27.452492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:27.573233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367987f33e48490a94602847ed0881e7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:27.604647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367987f33e48490a94602847ed0881e7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:27.605590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367987f33e48490a94602847ed0881e7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:27.623897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367987f33e48490a94602847ed0881e7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:27.679069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367987f33e48490a94602847ed0881e7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:27.712246 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1346/2701] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:49:27 2021] DELETE /identity/v3/users/367987f33e48490a94602847ed0881e7 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:49:29.354628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ccbc0-dedc-4164-b634-296725afb006 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:29.374554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ccbc0-dedc-4164-b634-296725afb006 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:29.404694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:29.406734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:29.480467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:29.482902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:29.483502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:29.483953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] PATH_INFO: `/v3/projects/e11cec7060094963bccef4d0cadba71d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:29.485966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11cec7060094963bccef4d0cadba71d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:29.488524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:29.515995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30840d56-339e-4573-a079-e94d6306fd9f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:29.528830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6baf17-b21a-4fe7-9f02-519cbe202617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:29.532718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6baf17-b21a-4fe7-9f02-519cbe202617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:29.533252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6baf17-b21a-4fe7-9f02-519cbe202617 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:29.533778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6baf17-b21a-4fe7-9f02-519cbe202617 admin admin] PATH_INFO: `/v3/users/4230d9b8ef6540bfbc4f034885d418e8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:29.536319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6baf17-b21a-4fe7-9f02-519cbe202617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4230d9b8ef6540bfbc4f034885d418e8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:29.539542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6baf17-b21a-4fe7-9f02-519cbe202617 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:29.585286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11cec7060094963bccef4d0cadba71d', 'request_id': 'req-de3e9645-e7a1-49c3-8a82-fea2876db082'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:29.601090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11cec7060094963bccef4d0cadba71d', 'request_id': 'req-de3e9645-e7a1-49c3-8a82-fea2876db082'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:29.619879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11cec7060094963bccef4d0cadba71d', 'request_id': 'req-de3e9645-e7a1-49c3-8a82-fea2876db082'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:29.629583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4c6baf17-b21a-4fe7-9f02-519cbe202617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4230d9b8ef6540bfbc4f034885d418e8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:29.647562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4c6baf17-b21a-4fe7-9f02-519cbe202617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4230d9b8ef6540bfbc4f034885d418e8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:29.649212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] The token cache is being invalidate because project e11cec7060094963bccef4d0cadba71d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:49:29.650492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4c6baf17-b21a-4fe7-9f02-519cbe202617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4230d9b8ef6540bfbc4f034885d418e8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:29.651473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:29.654168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-de3e9645-e7a1-49c3-8a82-fea2876db082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:29.671359 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1356/2702] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:49:29 2021] DELETE /identity/v3/projects/e11cec7060094963bccef4d0cadba71d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:49:29.675953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d14415-e470-4160-b944-4a2503b29080 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:29.676635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d14415-e470-4160-b944-4a2503b29080 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:29.679456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d14415-e470-4160-b944-4a2503b29080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:29.687996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4c6baf17-b21a-4fe7-9f02-519cbe202617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4230d9b8ef6540bfbc4f034885d418e8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:29.720163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4c6baf17-b21a-4fe7-9f02-519cbe202617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4230d9b8ef6540bfbc4f034885d418e8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:29.722442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-81d14415-e470-4160-b944-4a2503b29080 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:29.723791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-81d14415-e470-4160-b944-4a2503b29080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:29.739595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1347/2703] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:49:29 2021] DELETE /identity/v3/users/4230d9b8ef6540bfbc4f034885d418e8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:49:29.864035 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1357/2704] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:29.875048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11700738-cc17-496d-8941-9bb52d0d2073 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:29.875412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11700738-cc17-496d-8941-9bb52d0d2073 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:29.875695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11700738-cc17-496d-8941-9bb52d0d2073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:29.980186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-11700738-cc17-496d-8941-9bb52d0d2073 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:29.985581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-11700738-cc17-496d-8941-9bb52d0d2073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:30.144750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d14415-e470-4160-b944-4a2503b29080 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:30.153943 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1348/2705] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:30.164066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d14415-e470-4160-b944-4a2503b29080 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:30.176390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11700738-cc17-496d-8941-9bb52d0d2073 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:30.176944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-11700738-cc17-496d-8941-9bb52d0d2073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:30.193789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceb42e-e963-47d8-90df-355b89ca5e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:30.194517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceb42e-e963-47d8-90df-355b89ca5e9c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:30.194954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceb42e-e963-47d8-90df-355b89ca5e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:30.195235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceb42e-e963-47d8-90df-355b89ca5e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:30.196035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ceb42e-e963-47d8-90df-355b89ca5e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:49:30.196691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ceb42e-e963-47d8-90df-355b89ca5e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:30.199182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ceb42e-e963-47d8-90df-355b89ca5e9c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:30.212046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11700738-cc17-496d-8941-9bb52d0d2073 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:30.220763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:30.222570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:30.222973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:30.223383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] PATH_INFO: `/v3/projects/a6d0433d36494c339de083939adfa30d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:30.225477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d0433d36494c339de083939adfa30d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:30.228692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:30.238180 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1358/2706] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:49:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:49:30.242282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceb42e-e963-47d8-90df-355b89ca5e9c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:30.257567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceb42e-e963-47d8-90df-355b89ca5e9c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:30.267801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df4865-114e-49e4-9236-160caa849eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:30.268912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df4865-114e-49e4-9236-160caa849eec admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:30.269386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df4865-114e-49e4-9236-160caa849eec admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:30.269798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df4865-114e-49e4-9236-160caa849eec admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:30.271199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df4865-114e-49e4-9236-160caa849eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:30.273434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df4865-114e-49e4-9236-160caa849eec admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:30.319423 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1359/2707] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:49:30 2021] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:49:30.323615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df4865-114e-49e4-9236-160caa849eec admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:30.343951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d0433d36494c339de083939adfa30d', 'request_id': 'req-8b017438-a3fa-41de-a791-45d882baf9d1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:30.363348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d0433d36494c339de083939adfa30d', 'request_id': 'req-8b017438-a3fa-41de-a791-45d882baf9d1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:30.378701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d0433d36494c339de083939adfa30d', 'request_id': 'req-8b017438-a3fa-41de-a791-45d882baf9d1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:30.408583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] The token cache is being invalidate because project a6d0433d36494c339de083939adfa30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:49:30.409191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:30.411943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:30.418958 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1349/2708] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:49:30 2021] DELETE /identity/v3/projects/a6d0433d36494c339de083939adfa30d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:49:30.424397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:30.428199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:30.464523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df4865-114e-49e4-9236-160caa849eec admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:30.470970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca70214-fed8-48af-8ee9-f43b9b51cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:30.472614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca70214-fed8-48af-8ee9-f43b9b51cfb5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:30.472891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca70214-fed8-48af-8ee9-f43b9b51cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:30.474229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca70214-fed8-48af-8ee9-f43b9b51cfb5 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:30.476296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca70214-fed8-48af-8ee9-f43b9b51cfb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:30.478606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca70214-fed8-48af-8ee9-f43b9b51cfb5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:30.537846 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1360/2709] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:49:30 2021] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:49:30.543014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca70214-fed8-48af-8ee9-f43b9b51cfb5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:30.545055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dca70214-fed8-48af-8ee9-f43b9b51cfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:30.559873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca70214-fed8-48af-8ee9-f43b9b51cfb5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:30.568968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f0be0-5432-46d5-b272-bbd4105e6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:30.569999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b017438-a3fa-41de-a791-45d882baf9d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:30.570571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f0be0-5432-46d5-b272-bbd4105e6bad admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:30.571003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f0be0-5432-46d5-b272-bbd4105e6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:30.571472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f0be0-5432-46d5-b272-bbd4105e6bad admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:30.572666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f0be0-5432-46d5-b272-bbd4105e6bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:30.574544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f0be0-5432-46d5-b272-bbd4105e6bad admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:30.576946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e8b1d-9993-4eb7-9563-9e7cd8197638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:30.577940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e8b1d-9993-4eb7-9563-9e7cd8197638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:30.578854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e8b1d-9993-4eb7-9563-9e7cd8197638 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:30.579509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e8b1d-9993-4eb7-9563-9e7cd8197638 admin admin] PATH_INFO: `/v3/users/5dc5126a45fa41ca9d89a09735492620` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:30.581693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e8b1d-9993-4eb7-9563-9e7cd8197638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc5126a45fa41ca9d89a09735492620)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:30.584479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e8b1d-9993-4eb7-9563-9e7cd8197638 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:30.590924 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1361/2710] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:49:30 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:49:30.594336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f0be0-5432-46d5-b272-bbd4105e6bad admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:30.621870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f0be0-5432-46d5-b272-bbd4105e6bad admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:30.632341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096375f6-ba7e-498c-9470-dac34090dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:30.633130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096375f6-ba7e-498c-9470-dac34090dbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:30.633485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096375f6-ba7e-498c-9470-dac34090dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:30.633766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096375f6-ba7e-498c-9470-dac34090dbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:30.635807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096375f6-ba7e-498c-9470-dac34090dbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:30.638331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096375f6-ba7e-498c-9470-dac34090dbb3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:30.662372 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1362/2711] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:49:30 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:49:30.664190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096375f6-ba7e-498c-9470-dac34090dbb3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:30.666698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef1e8b1d-9993-4eb7-9563-9e7cd8197638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc5126a45fa41ca9d89a09735492620'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:30.684528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096375f6-ba7e-498c-9470-dac34090dbb3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:30.685030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef1e8b1d-9993-4eb7-9563-9e7cd8197638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc5126a45fa41ca9d89a09735492620'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:30.687028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef1e8b1d-9993-4eb7-9563-9e7cd8197638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc5126a45fa41ca9d89a09735492620'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:30.699650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef1e8b1d-9993-4eb7-9563-9e7cd8197638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc5126a45fa41ca9d89a09735492620'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:30.700472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe778e-7e7e-42dc-a146-3531d65ab50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:30.701384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe778e-7e7e-42dc-a146-3531d65ab50e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:30.701672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe778e-7e7e-42dc-a146-3531d65ab50e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:30.701946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe778e-7e7e-42dc-a146-3531d65ab50e admin admin] PATH_INFO: `/v3/projects/0d7f9b1bff9d44649f6d199a1d7a0fbb/users/6d449ec5849a4fe7aeb4cc51a3099bd1/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:30.716200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef1e8b1d-9993-4eb7-9563-9e7cd8197638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc5126a45fa41ca9d89a09735492620'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:30.740595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1350/2712] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:49:30 2021] DELETE /identity/v3/users/5dc5126a45fa41ca9d89a09735492620 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:49:30.764396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe778e-7e7e-42dc-a146-3531d65ab50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7f9b1bff9d44649f6d199a1d7a0fbb, user_id=6d449ec5849a4fe7aeb4cc51a3099bd1, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:30.769472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe778e-7e7e-42dc-a146-3531d65ab50e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:30.802311 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1363/2713] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:49:30 2021] PUT /identity/v3/projects/0d7f9b1bff9d44649f6d199a1d7a0fbb/users/6d449ec5849a4fe7aeb4cc51a3099bd1/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:49:30.807177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c54ea-a920-4aad-88e8-57625367a0d2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:30.807505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c54ea-a920-4aad-88e8-57625367a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:30.807804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c54ea-a920-4aad-88e8-57625367a0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:30.829282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-252c54ea-a920-4aad-88e8-57625367a0d2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:30.830518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-252c54ea-a920-4aad-88e8-57625367a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:30.917576 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1351/2714] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:30.931778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe778e-7e7e-42dc-a146-3531d65ab50e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:30.931778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a8fe778e-7e7e-42dc-a146-3531d65ab50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:31.044929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe778e-7e7e-42dc-a146-3531d65ab50e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:31.065987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9f558-1d1a-4746-8fa4-bcd22a10de9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:31.067018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9f558-1d1a-4746-8fa4-bcd22a10de9b service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:31.067579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9f558-1d1a-4746-8fa4-bcd22a10de9b service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:31.068078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9f558-1d1a-4746-8fa4-bcd22a10de9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:31.081574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9f558-1d1a-4746-8fa4-bcd22a10de9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:31.083814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9f558-1d1a-4746-8fa4-bcd22a10de9b service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:31.113397 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1364/2715] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:49:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:49:31.468891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c54ea-a920-4aad-88e8-57625367a0d2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:31.470377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-252c54ea-a920-4aad-88e8-57625367a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:31.485878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c54ea-a920-4aad-88e8-57625367a0d2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:31.493464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:31.496081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:31.496856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:31.497298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] PATH_INFO: `/v3/projects/d61eba1a7f8f4515a0c7ec1489d0b15f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:31.501972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61eba1a7f8f4515a0c7ec1489d0b15f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:31.504598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:31.598379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61eba1a7f8f4515a0c7ec1489d0b15f', 'request_id': 'req-5e955b2d-1001-4adf-b968-5b478b7dd243'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:31.615770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61eba1a7f8f4515a0c7ec1489d0b15f', 'request_id': 'req-5e955b2d-1001-4adf-b968-5b478b7dd243'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:31.634037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61eba1a7f8f4515a0c7ec1489d0b15f', 'request_id': 'req-5e955b2d-1001-4adf-b968-5b478b7dd243'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:31.666806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] The token cache is being invalidate because project d61eba1a7f8f4515a0c7ec1489d0b15f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:49:31.667279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:31.675741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e955b2d-1001-4adf-b968-5b478b7dd243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:49:31.677632 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1352/2716] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:49:31 2021] DELETE /identity/v3/projects/d61eba1a7f8f4515a0c7ec1489d0b15f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:49:31.685919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa21de-db20-4d0d-9789-ce253a60e26c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:31.686832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa21de-db20-4d0d-9789-ce253a60e26c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:31.687168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa21de-db20-4d0d-9789-ce253a60e26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:31.725812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-71fa21de-db20-4d0d-9789-ce253a60e26c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:31.729227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-71fa21de-db20-4d0d-9789-ce253a60e26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:31.854577 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1365/2717] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:31.863460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251575-8ad3-4242-95bf-625b3115ac27 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:31.864140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251575-8ad3-4242-95bf-625b3115ac27 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:31.864681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251575-8ad3-4242-95bf-625b3115ac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:31.914401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1a251575-8ad3-4242-95bf-625b3115ac27 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:31.916197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1a251575-8ad3-4242-95bf-625b3115ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:31.932425 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1353/2718] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:31.936876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa21de-db20-4d0d-9789-ce253a60e26c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:31.957931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa21de-db20-4d0d-9789-ce253a60e26c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:31.965611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4755b5-e53f-4284-8cc8-ac25aac99402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:31.966902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4755b5-e53f-4284-8cc8-ac25aac99402 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:31.968049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4755b5-e53f-4284-8cc8-ac25aac99402 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:31.968677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4755b5-e53f-4284-8cc8-ac25aac99402 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:31.969555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4755b5-e53f-4284-8cc8-ac25aac99402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:49:31.970172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4755b5-e53f-4284-8cc8-ac25aac99402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:31.972319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4755b5-e53f-4284-8cc8-ac25aac99402 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:31.992389 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1366/2719] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:49:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:49:31.997299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a251575-8ad3-4242-95bf-625b3115ac27 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:32.016447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a251575-8ad3-4242-95bf-625b3115ac27 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:32.031817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e85f7-b4b8-4eb9-8de2-559f987e3eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:32.032487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e85f7-b4b8-4eb9-8de2-559f987e3eda admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:32.032767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e85f7-b4b8-4eb9-8de2-559f987e3eda admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:32.033041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e85f7-b4b8-4eb9-8de2-559f987e3eda admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:32.033757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e85f7-b4b8-4eb9-8de2-559f987e3eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:32.044814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e85f7-b4b8-4eb9-8de2-559f987e3eda admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:32.131887 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1354/2720] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:49:31 2021] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:49:32.132721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4755b5-e53f-4284-8cc8-ac25aac99402 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:32.147034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4755b5-e53f-4284-8cc8-ac25aac99402 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:32.271615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d3d48-cac8-4ae7-b715-53fee00c8e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:32.272306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d3d48-cac8-4ae7-b715-53fee00c8e83 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:32.272590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d3d48-cac8-4ae7-b715-53fee00c8e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:32.272855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d3d48-cac8-4ae7-b715-53fee00c8e83 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:32.273740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d3d48-cac8-4ae7-b715-53fee00c8e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:32.277951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d3d48-cac8-4ae7-b715-53fee00c8e83 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:32.318528 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1367/2721] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:49:32 2021] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:49:32.322491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e85f7-b4b8-4eb9-8de2-559f987e3eda admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:32.348887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e85f7-b4b8-4eb9-8de2-559f987e3eda admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:32.363526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d34397-7ec8-49a6-8b4c-4dbdb62d6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:32.364125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d34397-7ec8-49a6-8b4c-4dbdb62d6852 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:32.365361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d34397-7ec8-49a6-8b4c-4dbdb62d6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:32.365361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d34397-7ec8-49a6-8b4c-4dbdb62d6852 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:32.367449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d34397-7ec8-49a6-8b4c-4dbdb62d6852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:32.370129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d34397-7ec8-49a6-8b4c-4dbdb62d6852 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:32.391306 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1355/2722] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:49:32 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:49:32.395515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d3d48-cac8-4ae7-b715-53fee00c8e83 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:32.410395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d3d48-cac8-4ae7-b715-53fee00c8e83 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:32.416067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f29db-f133-436a-abec-c688942c2a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:32.416836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f29db-f133-436a-abec-c688942c2a31 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:32.417199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f29db-f133-436a-abec-c688942c2a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:32.417547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f29db-f133-436a-abec-c688942c2a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:32.418482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f29db-f133-436a-abec-c688942c2a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:32.424600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f29db-f133-436a-abec-c688942c2a31 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:32.450142 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1368/2723] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:49:32 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:49:32.453990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d34397-7ec8-49a6-8b4c-4dbdb62d6852 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:32.473508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d34397-7ec8-49a6-8b4c-4dbdb62d6852 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:32.482673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af61863-cb9b-4536-84bb-41035454349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:32.484933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af61863-cb9b-4536-84bb-41035454349d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:32.485866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af61863-cb9b-4536-84bb-41035454349d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:32.486071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af61863-cb9b-4536-84bb-41035454349d admin admin] PATH_INFO: `/v3/projects/3452ada55fe043918a4bf028d75b070d/users/dd54936ebf874a45800b444b942c6e76/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:32.542825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af61863-cb9b-4536-84bb-41035454349d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3452ada55fe043918a4bf028d75b070d, user_id=dd54936ebf874a45800b444b942c6e76, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:32.548411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af61863-cb9b-4536-84bb-41035454349d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:32.589300 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1356/2724] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:49:32 2021] PUT /identity/v3/projects/3452ada55fe043918a4bf028d75b070d/users/dd54936ebf874a45800b444b942c6e76/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:49:32.590177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23183a1b-3d55-40df-86fd-e1ab3238f17a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:32.590660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23183a1b-3d55-40df-86fd-e1ab3238f17a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:32.591032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23183a1b-3d55-40df-86fd-e1ab3238f17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:32.635159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-23183a1b-3d55-40df-86fd-e1ab3238f17a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:32.636913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-23183a1b-3d55-40df-86fd-e1ab3238f17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:32.751673 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1369/2725] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:49:32.779467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af61863-cb9b-4536-84bb-41035454349d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:32.783982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4af61863-cb9b-4536-84bb-41035454349d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:32.870639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af61863-cb9b-4536-84bb-41035454349d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:32.882394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88870afc-1cc4-4c3d-8fb5-610972ad5f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:32.884014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88870afc-1cc4-4c3d-8fb5-610972ad5f95 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:32.884532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88870afc-1cc4-4c3d-8fb5-610972ad5f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:32.884963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88870afc-1cc4-4c3d-8fb5-610972ad5f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:32.909873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88870afc-1cc4-4c3d-8fb5-610972ad5f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:32.912372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88870afc-1cc4-4c3d-8fb5-610972ad5f95 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:32.927998 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1357/2726] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:49:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:49:39.234444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465cdf-742b-41bf-ad4e-66282327124f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:39.235454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465cdf-742b-41bf-ad4e-66282327124f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:39.235883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465cdf-742b-41bf-ad4e-66282327124f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:39.285614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-49465cdf-742b-41bf-ad4e-66282327124f None None] MFA Rules not processed for user `1d46c71936aa4118aa36a9e95b95c4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:39.287709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49465cdf-742b-41bf-ad4e-66282327124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:39.447155 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1370/2727] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:39 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:46.445691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba3e2-c7d0-4959-8e36-4be53b9dd6e2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:46.446821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba3e2-c7d0-4959-8e36-4be53b9dd6e2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:46.447329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cba3e2-c7d0-4959-8e36-4be53b9dd6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:46.496713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-92cba3e2-c7d0-4959-8e36-4be53b9dd6e2 None None] MFA Rules not processed for user `6d449ec5849a4fe7aeb4cc51a3099bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:46.502977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-92cba3e2-c7d0-4959-8e36-4be53b9dd6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:46.628678 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1358/2728] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:46 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:46.894105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49465cdf-742b-41bf-ad4e-66282327124f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:46.897346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49465cdf-742b-41bf-ad4e-66282327124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:47.138160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49465cdf-742b-41bf-ad4e-66282327124f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:47.156372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08246d-e59c-4b43-bbbf-592e294f56ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:47.157847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08246d-e59c-4b43-bbbf-592e294f56ac service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:47.158411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08246d-e59c-4b43-bbbf-592e294f56ac service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:47.160267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08246d-e59c-4b43-bbbf-592e294f56ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:47.190392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08246d-e59c-4b43-bbbf-592e294f56ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:47.200674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08246d-e59c-4b43-bbbf-592e294f56ac service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:47.242248 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1371/2729] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:49:46 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:49:50.821306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f1fac-e220-4993-a1ea-febd9f3db80e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:50.821306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f1fac-e220-4993-a1ea-febd9f3db80e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:50.821306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f1fac-e220-4993-a1ea-febd9f3db80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:50.849261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0c1f1fac-e220-4993-a1ea-febd9f3db80e None None] MFA Rules not processed for user `dd54936ebf874a45800b444b942c6e76`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:50.850638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0c1f1fac-e220-4993-a1ea-febd9f3db80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:51.007701 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1359/2730] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:50 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:51.425561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08246d-e59c-4b43-bbbf-592e294f56ac service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:49:51.427823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec08246d-e59c-4b43-bbbf-592e294f56ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:51.451167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08246d-e59c-4b43-bbbf-592e294f56ac service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:49:51.456907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca36e8-da15-4cc9-94a2-53294c25753b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:49:51.457624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca36e8-da15-4cc9-94a2-53294c25753b service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:51.457986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca36e8-da15-4cc9-94a2-53294c25753b service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:51.458339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca36e8-da15-4cc9-94a2-53294c25753b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:51.466652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca36e8-da15-4cc9-94a2-53294c25753b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:49:51.468823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca36e8-da15-4cc9-94a2-53294c25753b service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:49:51.477603 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1372/2731] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:49:51 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:49:51.866005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23ec4-cc6e-4bb0-9def-320998787f4a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:51.866479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23ec4-cc6e-4bb0-9def-320998787f4a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:51.866958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23ec4-cc6e-4bb0-9def-320998787f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:51.927872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f7b23ec4-cc6e-4bb0-9def-320998787f4a None None] MFA Rules not processed for user `4561f04227544d2ca76bce3dc5618c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:51.931637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f7b23ec4-cc6e-4bb0-9def-320998787f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:52.124926 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1360/2732] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:51 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:49:54.653958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395ed39-0147-4731-8188-7d1185c19d76 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:49:54.655282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395ed39-0147-4731-8188-7d1185c19d76 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:49:54.655588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395ed39-0147-4731-8188-7d1185c19d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:49:54.693197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4395ed39-0147-4731-8188-7d1185c19d76 None None] MFA Rules not processed for user `dd54936ebf874a45800b444b942c6e76`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:49:54.693982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4395ed39-0147-4731-8188-7d1185c19d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:49:54.725130 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1373/2733] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:49:54 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:00.945569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89602e17-4287-491b-85f5-d8cead00c38a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:00.946574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89602e17-4287-491b-85f5-d8cead00c38a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:00.949131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89602e17-4287-491b-85f5-d8cead00c38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:00.972041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-89602e17-4287-491b-85f5-d8cead00c38a None None] MFA Rules not processed for user `3cb6bc63929648388ac9648823d4ca88`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:00.973259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-89602e17-4287-491b-85f5-d8cead00c38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:01.056782 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1361/2734] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:00 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:08.991573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395ed39-0147-4731-8188-7d1185c19d76 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:08.993832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4395ed39-0147-4731-8188-7d1185c19d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:09.024252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395ed39-0147-4731-8188-7d1185c19d76 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:09.040262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7152bd-f872-41eb-9241-58dd93a0157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:09.041166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7152bd-f872-41eb-9241-58dd93a0157a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:09.041446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7152bd-f872-41eb-9241-58dd93a0157a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:09.042309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7152bd-f872-41eb-9241-58dd93a0157a admin admin] PATH_INFO: `/v3/users/bb85b086594c4389b15420a56941c229` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:09.044790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7152bd-f872-41eb-9241-58dd93a0157a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb85b086594c4389b15420a56941c229)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:09.057147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7152bd-f872-41eb-9241-58dd93a0157a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:09.130625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c7152bd-f872-41eb-9241-58dd93a0157a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb85b086594c4389b15420a56941c229'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:09.131811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c7152bd-f872-41eb-9241-58dd93a0157a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb85b086594c4389b15420a56941c229'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:09.146607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c7152bd-f872-41eb-9241-58dd93a0157a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb85b086594c4389b15420a56941c229'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:09.151835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c7152bd-f872-41eb-9241-58dd93a0157a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb85b086594c4389b15420a56941c229'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:09.167535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c7152bd-f872-41eb-9241-58dd93a0157a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb85b086594c4389b15420a56941c229'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:09.191443 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1374/2735] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:50:08 2021] DELETE /identity/v3/users/bb85b086594c4389b15420a56941c229 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:50:09.507675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89602e17-4287-491b-85f5-d8cead00c38a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:09.523591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89602e17-4287-491b-85f5-d8cead00c38a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:09.744752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:09.745734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:09.746119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:09.746511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] PATH_INFO: `/v3/projects/72659aa0252c4e7491effb8522dd5a1c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:09.747900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] RBAC: Authorizing `identity:delete_project(project_id=72659aa0252c4e7491effb8522dd5a1c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:09.749890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:09.801477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72659aa0252c4e7491effb8522dd5a1c', 'request_id': 'req-2dd5dbda-33df-4b5a-80da-42a78571153b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:09.811303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72659aa0252c4e7491effb8522dd5a1c', 'request_id': 'req-2dd5dbda-33df-4b5a-80da-42a78571153b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:09.818352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72659aa0252c4e7491effb8522dd5a1c', 'request_id': 'req-2dd5dbda-33df-4b5a-80da-42a78571153b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:09.831633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] The token cache is being invalidate because project 72659aa0252c4e7491effb8522dd5a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:50:09.832258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:09.833298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2dd5dbda-33df-4b5a-80da-42a78571153b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:09.835390 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1362/2736] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:50:09 2021] DELETE /identity/v3/projects/72659aa0252c4e7491effb8522dd5a1c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:50:09.844909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075b8c-9f22-48d4-8100-b82a92e2aad2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:09.845440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075b8c-9f22-48d4-8100-b82a92e2aad2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:09.845888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b075b8c-9f22-48d4-8100-b82a92e2aad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:09.866821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8b075b8c-9f22-48d4-8100-b82a92e2aad2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:09.868542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8b075b8c-9f22-48d4-8100-b82a92e2aad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:09.932768 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1375/2737] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:09.941153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f1a25-0077-4ae2-a6aa-0fc3a75e3f5b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:09.941440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f1a25-0077-4ae2-a6aa-0fc3a75e3f5b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:09.941801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f1a25-0077-4ae2-a6aa-0fc3a75e3f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:09.959714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-260f1a25-0077-4ae2-a6aa-0fc3a75e3f5b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:09.961018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-260f1a25-0077-4ae2-a6aa-0fc3a75e3f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:09.969130 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1363/2738] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:50:09.973247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b075b8c-9f22-48d4-8100-b82a92e2aad2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:09.983831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b075b8c-9f22-48d4-8100-b82a92e2aad2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:09.988584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a915c-f444-47e6-bf38-c9c7b9038a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:09.989235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a915c-f444-47e6-bf38-c9c7b9038a8a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:09.989511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a915c-f444-47e6-bf38-c9c7b9038a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:09.989779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a915c-f444-47e6-bf38-c9c7b9038a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:09.990504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a915c-f444-47e6-bf38-c9c7b9038a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:50:09.990804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a915c-f444-47e6-bf38-c9c7b9038a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:09.992697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a915c-f444-47e6-bf38-c9c7b9038a8a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:10.006272 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1376/2739] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:50:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:50:10.010244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f1a25-0077-4ae2-a6aa-0fc3a75e3f5b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:10.021972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f1a25-0077-4ae2-a6aa-0fc3a75e3f5b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:10.027728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c4446-64cf-4ea7-90b3-56d6a6883fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:10.028406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4446-64cf-4ea7-90b3-56d6a6883fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:10.028679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4446-64cf-4ea7-90b3-56d6a6883fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:10.029529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c4446-64cf-4ea7-90b3-56d6a6883fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:10.030935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c4446-64cf-4ea7-90b3-56d6a6883fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:10.032863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c4446-64cf-4ea7-90b3-56d6a6883fe4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:10.070923 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1364/2740] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:50:10 2021] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:50:10.075043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a915c-f444-47e6-bf38-c9c7b9038a8a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:10.089080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a915c-f444-47e6-bf38-c9c7b9038a8a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:10.170791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a3b92-ddcc-4db4-bd66-59205e611d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:10.171490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a3b92-ddcc-4db4-bd66-59205e611d42 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:10.171769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a3b92-ddcc-4db4-bd66-59205e611d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:10.172040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a3b92-ddcc-4db4-bd66-59205e611d42 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:10.172741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a3b92-ddcc-4db4-bd66-59205e611d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:10.174647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a3b92-ddcc-4db4-bd66-59205e611d42 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:10.204284 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1377/2741] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:50:10 2021] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:50:10.209003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c4446-64cf-4ea7-90b3-56d6a6883fe4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:10.225837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c4446-64cf-4ea7-90b3-56d6a6883fe4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:10.230533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4ba8d-b3a4-406f-b4f7-6d3b0ab68a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:10.231187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ba8d-b3a4-406f-b4f7-6d3b0ab68a23 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:10.231497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ba8d-b3a4-406f-b4f7-6d3b0ab68a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:10.231774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4ba8d-b3a4-406f-b4f7-6d3b0ab68a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:10.233621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4ba8d-b3a4-406f-b4f7-6d3b0ab68a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:10.234476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4ba8d-b3a4-406f-b4f7-6d3b0ab68a23 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:10.245842 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1365/2742] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:50:10 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:50:10.249841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a3b92-ddcc-4db4-bd66-59205e611d42 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:10.259918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a3b92-ddcc-4db4-bd66-59205e611d42 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:10.265295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12fca2-36e1-4b1e-b89f-560132c30f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:10.265953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fca2-36e1-4b1e-b89f-560132c30f0c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:10.266241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fca2-36e1-4b1e-b89f-560132c30f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:10.266548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12fca2-36e1-4b1e-b89f-560132c30f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:10.267306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12fca2-36e1-4b1e-b89f-560132c30f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:10.268908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12fca2-36e1-4b1e-b89f-560132c30f0c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:10.279697 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1378/2743] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:50:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:50:10.283837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4ba8d-b3a4-406f-b4f7-6d3b0ab68a23 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:10.293424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4ba8d-b3a4-406f-b4f7-6d3b0ab68a23 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:10.298131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f2290-d883-43ff-877a-2b965ee676b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:10.298996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f2290-d883-43ff-877a-2b965ee676b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:10.299302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f2290-d883-43ff-877a-2b965ee676b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:10.299583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f2290-d883-43ff-877a-2b965ee676b9 admin admin] PATH_INFO: `/v3/projects/49bcc58fc8444ca188eb8b273931ea09/users/ce7415c3ef574fde8b4e378d3f787cbc/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:10.314270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f2290-d883-43ff-877a-2b965ee676b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bcc58fc8444ca188eb8b273931ea09, user_id=ce7415c3ef574fde8b4e378d3f787cbc, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:10.316959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f2290-d883-43ff-877a-2b965ee676b9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:10.330533 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1366/2744] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:50:10 2021] PUT /identity/v3/projects/49bcc58fc8444ca188eb8b273931ea09/users/ce7415c3ef574fde8b4e378d3f787cbc/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:50:10.341412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e4a54-e7d5-4315-9782-64f38e148269 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:10.341699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e4a54-e7d5-4315-9782-64f38e148269 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:10.341975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e4a54-e7d5-4315-9782-64f38e148269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:10.381817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-557e4a54-e7d5-4315-9782-64f38e148269 None None] MFA Rules not processed for user `ce7415c3ef574fde8b4e378d3f787cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:10.383057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-557e4a54-e7d5-4315-9782-64f38e148269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:10.463703 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1379/2745] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:10 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:50:10.473934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d2b5b-4eff-453f-8869-5a3bffd1a62e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:10.474149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d2b5b-4eff-453f-8869-5a3bffd1a62e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:10.474427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d2b5b-4eff-453f-8869-5a3bffd1a62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:10.491883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-993d2b5b-4eff-453f-8869-5a3bffd1a62e None None] MFA Rules not processed for user `ce7415c3ef574fde8b4e378d3f787cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:10.493344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-993d2b5b-4eff-453f-8869-5a3bffd1a62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:10.501078 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1367/2746] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:10 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:10.543977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e4a54-e7d5-4315-9782-64f38e148269 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:10.545419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-557e4a54-e7d5-4315-9782-64f38e148269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:10.617985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e4a54-e7d5-4315-9782-64f38e148269 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:10.624103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e677f-d415-45fa-8ba0-c6cbec6c2725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:10.624756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e677f-d415-45fa-8ba0-c6cbec6c2725 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:10.625040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e677f-d415-45fa-8ba0-c6cbec6c2725 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:10.625317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e677f-d415-45fa-8ba0-c6cbec6c2725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:10.633153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e677f-d415-45fa-8ba0-c6cbec6c2725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:10.634747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e677f-d415-45fa-8ba0-c6cbec6c2725 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:10.645601 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1380/2747] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:10 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:11.824137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf006c6-1fdc-4089-a0e2-8f17535bee62 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:11.824668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf006c6-1fdc-4089-a0e2-8f17535bee62 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:11.824668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf006c6-1fdc-4089-a0e2-8f17535bee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:11.844279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-daf006c6-1fdc-4089-a0e2-8f17535bee62 None None] MFA Rules not processed for user `4561f04227544d2ca76bce3dc5618c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:11.845586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-daf006c6-1fdc-4089-a0e2-8f17535bee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:11.909471 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1368/2748] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:11 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:17.125015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e677f-d415-45fa-8ba0-c6cbec6c2725 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:17.126640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c69e677f-d415-45fa-8ba0-c6cbec6c2725 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:17.244849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e677f-d415-45fa-8ba0-c6cbec6c2725 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:17.251755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9038c5-9b56-4bd4-bb86-3ec1bb98f519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:17.252637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9038c5-9b56-4bd4-bb86-3ec1bb98f519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:17.252917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9038c5-9b56-4bd4-bb86-3ec1bb98f519 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:17.253189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9038c5-9b56-4bd4-bb86-3ec1bb98f519 admin admin] PATH_INFO: `/v3/users/6d449ec5849a4fe7aeb4cc51a3099bd1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:17.254438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9038c5-9b56-4bd4-bb86-3ec1bb98f519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d449ec5849a4fe7aeb4cc51a3099bd1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:17.257096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9038c5-9b56-4bd4-bb86-3ec1bb98f519 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:17.316114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fd9038c5-9b56-4bd4-bb86-3ec1bb98f519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d449ec5849a4fe7aeb4cc51a3099bd1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:17.317006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fd9038c5-9b56-4bd4-bb86-3ec1bb98f519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d449ec5849a4fe7aeb4cc51a3099bd1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:17.328594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fd9038c5-9b56-4bd4-bb86-3ec1bb98f519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d449ec5849a4fe7aeb4cc51a3099bd1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:17.329541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fd9038c5-9b56-4bd4-bb86-3ec1bb98f519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d449ec5849a4fe7aeb4cc51a3099bd1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:17.344616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fd9038c5-9b56-4bd4-bb86-3ec1bb98f519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d449ec5849a4fe7aeb4cc51a3099bd1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:17.363443 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1381/2749] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:50:17 2021] DELETE /identity/v3/users/6d449ec5849a4fe7aeb4cc51a3099bd1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:50:17.654179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf006c6-1fdc-4089-a0e2-8f17535bee62 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:17.665593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf006c6-1fdc-4089-a0e2-8f17535bee62 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:17.761494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:17.762343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:17.762605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:17.762924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] PATH_INFO: `/v3/projects/0d7f9b1bff9d44649f6d199a1d7a0fbb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:17.764193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7f9b1bff9d44649f6d199a1d7a0fbb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:17.766888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:17.861031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7f9b1bff9d44649f6d199a1d7a0fbb', 'request_id': 'req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:17.878952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7f9b1bff9d44649f6d199a1d7a0fbb', 'request_id': 'req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:17.886458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7f9b1bff9d44649f6d199a1d7a0fbb', 'request_id': 'req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:17.898721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] The token cache is being invalidate because project 0d7f9b1bff9d44649f6d199a1d7a0fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:50:17.899081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:17.899840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-79fb9c86-42d1-4d1b-8d97-dff5fddbbe59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:17.901393 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1369/2750] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:50:17 2021] DELETE /identity/v3/projects/0d7f9b1bff9d44649f6d199a1d7a0fbb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:50:17.907731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7eee0-a95b-4dc3-a7f4-14d163619bbe None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:17.908017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7eee0-a95b-4dc3-a7f4-14d163619bbe None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:17.908701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7eee0-a95b-4dc3-a7f4-14d163619bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:17.940153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e5f7eee0-a95b-4dc3-a7f4-14d163619bbe None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:17.943834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e5f7eee0-a95b-4dc3-a7f4-14d163619bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:18.027875 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1382/2751] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:18.037161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c75e-e8f7-43d3-a166-b0c6fa592139 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.037451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c75e-e8f7-43d3-a166-b0c6fa592139 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.037731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c75e-e8f7-43d3-a166-b0c6fa592139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.058444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9b18c75e-e8f7-43d3-a166-b0c6fa592139 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:18.059731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9b18c75e-e8f7-43d3-a166-b0c6fa592139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:18.067749 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1370/2752] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:50:18.072016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7eee0-a95b-4dc3-a7f4-14d163619bbe None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:18.082928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7eee0-a95b-4dc3-a7f4-14d163619bbe None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:18.092390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1633c9-b595-47ed-8cb4-87c8465077bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:18.092577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1633c9-b595-47ed-8cb4-87c8465077bb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.092814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1633c9-b595-47ed-8cb4-87c8465077bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.093094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1633c9-b595-47ed-8cb4-87c8465077bb admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.093913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1633c9-b595-47ed-8cb4-87c8465077bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:50:18.094144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1633c9-b595-47ed-8cb4-87c8465077bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:18.095985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1633c9-b595-47ed-8cb4-87c8465077bb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:18.112258 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1383/2753] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:50:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:50:18.113634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18c75e-e8f7-43d3-a166-b0c6fa592139 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:18.124402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18c75e-e8f7-43d3-a166-b0c6fa592139 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:18.137797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1f64c-9932-4aa2-8622-6651485403a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:18.138600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1f64c-9932-4aa2-8622-6651485403a3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.138892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1f64c-9932-4aa2-8622-6651485403a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.139168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1f64c-9932-4aa2-8622-6651485403a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.140072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1f64c-9932-4aa2-8622-6651485403a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:18.142406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1f64c-9932-4aa2-8622-6651485403a3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:18.197193 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1371/2754] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:50:18 2021] POST /identity/v3/projects => generated 391 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:50:18.198455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1633c9-b595-47ed-8cb4-87c8465077bb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:18.209722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1633c9-b595-47ed-8cb4-87c8465077bb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:18.279198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab07ad-601e-4835-a231-7d7bb534de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:18.279600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab07ad-601e-4835-a231-7d7bb534de8b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.280068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab07ad-601e-4835-a231-7d7bb534de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.280517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab07ad-601e-4835-a231-7d7bb534de8b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.281375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab07ad-601e-4835-a231-7d7bb534de8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:18.283540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab07ad-601e-4835-a231-7d7bb534de8b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:18.315578 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1384/2755] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:50:18 2021] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:50:18.319303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1f64c-9932-4aa2-8622-6651485403a3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:18.330461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1f64c-9932-4aa2-8622-6651485403a3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:18.335458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cf044-321e-47ff-a1ba-f2ad0e02db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:18.336116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf044-321e-47ff-a1ba-f2ad0e02db21 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.336395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf044-321e-47ff-a1ba-f2ad0e02db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.336666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf044-321e-47ff-a1ba-f2ad0e02db21 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.337399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cf044-321e-47ff-a1ba-f2ad0e02db21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:18.339201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cf044-321e-47ff-a1ba-f2ad0e02db21 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:18.359009 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1372/2756] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:50:18 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:50:18.360496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab07ad-601e-4835-a231-7d7bb534de8b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:18.371365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab07ad-601e-4835-a231-7d7bb534de8b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:18.376942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f697d-2096-4eb4-a6b1-b60f4088e8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:18.377624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f697d-2096-4eb4-a6b1-b60f4088e8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.377937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f697d-2096-4eb4-a6b1-b60f4088e8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.378226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f697d-2096-4eb4-a6b1-b60f4088e8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.379156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f697d-2096-4eb4-a6b1-b60f4088e8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:18.380939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f697d-2096-4eb4-a6b1-b60f4088e8b3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:18.393093 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1385/2757] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:50:18 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:50:18.397266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cf044-321e-47ff-a1ba-f2ad0e02db21 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:18.409443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cf044-321e-47ff-a1ba-f2ad0e02db21 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:18.415188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a884547d-0f9e-48ea-b14f-d4d9a750c79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:18.416246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884547d-0f9e-48ea-b14f-d4d9a750c79d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.416674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884547d-0f9e-48ea-b14f-d4d9a750c79d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.416961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884547d-0f9e-48ea-b14f-d4d9a750c79d admin admin] PATH_INFO: `/v3/projects/7f6808ea6651429d8cee52be08a49be3/users/8088ae5339424680bf9fa03cc27a81c0/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.447145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884547d-0f9e-48ea-b14f-d4d9a750c79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6808ea6651429d8cee52be08a49be3, user_id=8088ae5339424680bf9fa03cc27a81c0, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:18.452935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180618d-aa9e-43c5-9dd9-82c5288ce07d None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.453342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180618d-aa9e-43c5-9dd9-82c5288ce07d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.453521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180618d-aa9e-43c5-9dd9-82c5288ce07d None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.455821 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1386/2758] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:50:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:50:18.456028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a884547d-0f9e-48ea-b14f-d4d9a750c79d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:18.461641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88689d74-845f-4a8d-89b1-3bd72717889c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.461941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88689d74-845f-4a8d-89b1-3bd72717889c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.462224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88689d74-845f-4a8d-89b1-3bd72717889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.482877 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1373/2759] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:50:18 2021] PUT /identity/v3/projects/7f6808ea6651429d8cee52be08a49be3/users/8088ae5339424680bf9fa03cc27a81c0/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:50:18.485608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-88689d74-845f-4a8d-89b1-3bd72717889c None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:18.487495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-88689d74-845f-4a8d-89b1-3bd72717889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:18.493545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a465a-bd3d-4905-b882-d39af65e820b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.493841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a465a-bd3d-4905-b882-d39af65e820b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.494159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a465a-bd3d-4905-b882-d39af65e820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.550033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-192a465a-bd3d-4905-b882-d39af65e820b None None] MFA Rules not processed for user `8088ae5339424680bf9fa03cc27a81c0`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:18.553048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-192a465a-bd3d-4905-b882-d39af65e820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:18.579414 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1387/2760] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:50:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:18.611646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88689d74-845f-4a8d-89b1-3bd72717889c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:18.613124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-88689d74-845f-4a8d-89b1-3bd72717889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:18.641086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88689d74-845f-4a8d-89b1-3bd72717889c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:18.648448 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1374/2761] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:18 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:18.657910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28272b5-000f-4042-bb26-2fe4dd0d2a73 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.658535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28272b5-000f-4042-bb26-2fe4dd0d2a73 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.658535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28272b5-000f-4042-bb26-2fe4dd0d2a73 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.659419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc9adf-94a1-4f68-90d8-85f0fb1f0ce4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:18.660153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc9adf-94a1-4f68-90d8-85f0fb1f0ce4 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.660407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc9adf-94a1-4f68-90d8-85f0fb1f0ce4 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.660689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc9adf-94a1-4f68-90d8-85f0fb1f0ce4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.661144 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1375/2762] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:50:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:50:18.665747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5356b-13d7-467d-8a50-29f015535d2c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.666304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5356b-13d7-467d-8a50-29f015535d2c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.666800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5356b-13d7-467d-8a50-29f015535d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.675004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc9adf-94a1-4f68-90d8-85f0fb1f0ce4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:18.678475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc9adf-94a1-4f68-90d8-85f0fb1f0ce4 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:18.693799 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1388/2763] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:18.697750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-26b5356b-13d7-467d-8a50-29f015535d2c None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:18.699236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-26b5356b-13d7-467d-8a50-29f015535d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:18.711630 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1376/2764] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:50:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:50:18.735543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc9adf-94a1-4f68-90d8-85f0fb1f0ce4 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:18.737056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-64cc9adf-94a1-4f68-90d8-85f0fb1f0ce4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:18.756676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc9adf-94a1-4f68-90d8-85f0fb1f0ce4 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:18.763609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a549ef-1825-431a-9e7c-d6656504945e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:18.764268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a549ef-1825-431a-9e7c-d6656504945e service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.764555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a549ef-1825-431a-9e7c-d6656504945e service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.764842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a549ef-1825-431a-9e7c-d6656504945e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.790145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a549ef-1825-431a-9e7c-d6656504945e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:18.796184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a549ef-1825-431a-9e7c-d6656504945e service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:18.824026 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1389/2765] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:18.970926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b680bbc-5c45-4649-8957-2df62d940325 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.971361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b680bbc-5c45-4649-8957-2df62d940325 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.971646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b680bbc-5c45-4649-8957-2df62d940325 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:18.973583 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1377/2766] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 20:50:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:50:18.982744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc6127-3851-4b73-bfea-cdf8d1853c75 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:18.983294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc6127-3851-4b73-bfea-cdf8d1853c75 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:18.983769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc6127-3851-4b73-bfea-cdf8d1853c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:19.005824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-45fc6127-3851-4b73-bfea-cdf8d1853c75 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:19.007414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-45fc6127-3851-4b73-bfea-cdf8d1853c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:19.020075 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1390/2767] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 20:50:18 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:19.053246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b680bbc-5c45-4649-8957-2df62d940325 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:19.072179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b680bbc-5c45-4649-8957-2df62d940325 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:19.077927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805233c-5469-4262-b257-76a1e90f9877 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:19.079036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805233c-5469-4262-b257-76a1e90f9877 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:19.079036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805233c-5469-4262-b257-76a1e90f9877 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:19.079466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805233c-5469-4262-b257-76a1e90f9877 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:19.087997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805233c-5469-4262-b257-76a1e90f9877 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:19.089601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805233c-5469-4262-b257-76a1e90f9877 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:19.106339 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1378/2768] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:19 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:20.082347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc6127-3851-4b73-bfea-cdf8d1853c75 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:20.082347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-45fc6127-3851-4b73-bfea-cdf8d1853c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:20.289106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc6127-3851-4b73-bfea-cdf8d1853c75 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:20.295393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bc7ec-aa28-43f7-afcd-7c32e6191564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:20.296047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bc7ec-aa28-43f7-afcd-7c32e6191564 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:20.296334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bc7ec-aa28-43f7-afcd-7c32e6191564 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:20.296611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bc7ec-aa28-43f7-afcd-7c32e6191564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:20.304646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bc7ec-aa28-43f7-afcd-7c32e6191564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:20.306240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bc7ec-aa28-43f7-afcd-7c32e6191564 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:20.320817 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1391/2769] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:20 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:21.331951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805233c-5469-4262-b257-76a1e90f9877 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:21.401946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805233c-5469-4262-b257-76a1e90f9877 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:21.406850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:21.407857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:21.408233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:21.408578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] PATH_INFO: `/v3/users/8088ae5339424680bf9fa03cc27a81c0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:21.410108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8088ae5339424680bf9fa03cc27a81c0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:21.412164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:21.478560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8088ae5339424680bf9fa03cc27a81c0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:21.489448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8088ae5339424680bf9fa03cc27a81c0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:21.491209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8088ae5339424680bf9fa03cc27a81c0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:21.503550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8088ae5339424680bf9fa03cc27a81c0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:21.520222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8088ae5339424680bf9fa03cc27a81c0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:21.532896 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1379/2770] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:50:21 2021] DELETE /identity/v3/users/8088ae5339424680bf9fa03cc27a81c0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:50:21.537566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d5338-b9b2-499d-95c4-b6bc91fcc68e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:21.538046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d5338-b9b2-499d-95c4-b6bc91fcc68e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:21.538133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d5338-b9b2-499d-95c4-b6bc91fcc68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:21.574198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b90d5338-b9b2-499d-95c4-b6bc91fcc68e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:21.575714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b90d5338-b9b2-499d-95c4-b6bc91fcc68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:21.637340 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1392/2771] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:21.648260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:21.649908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:21.710560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165b43b-942f-4037-99f0-49b23014fe3f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:21.715558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320658b-3a15-4874-ab5c-04e5adfafd02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:21.717002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320658b-3a15-4874-ab5c-04e5adfafd02 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:21.717466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320658b-3a15-4874-ab5c-04e5adfafd02 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:21.717739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320658b-3a15-4874-ab5c-04e5adfafd02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:21.729592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320658b-3a15-4874-ab5c-04e5adfafd02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:21.731242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320658b-3a15-4874-ab5c-04e5adfafd02 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:21.743121 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1380/2772] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:22.363526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d5338-b9b2-499d-95c4-b6bc91fcc68e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:22.366571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b90d5338-b9b2-499d-95c4-b6bc91fcc68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:22.414300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d5338-b9b2-499d-95c4-b6bc91fcc68e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:22.427171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:22.428286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:22.428730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:22.429155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] PATH_INFO: `/v3/projects/7f6808ea6651429d8cee52be08a49be3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:22.440519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f6808ea6651429d8cee52be08a49be3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:22.443143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:22.581200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f6808ea6651429d8cee52be08a49be3', 'request_id': 'req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:22.599376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f6808ea6651429d8cee52be08a49be3', 'request_id': 'req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:22.614434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f6808ea6651429d8cee52be08a49be3', 'request_id': 'req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:22.639280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] The token cache is being invalidate because project 7f6808ea6651429d8cee52be08a49be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:50:22.640165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:22.642309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b853dce-8ea9-4abf-b6c4-e44cc6d0a623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:50:22.646047 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1393/2773] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:50:22 2021] DELETE /identity/v3/projects/7f6808ea6651429d8cee52be08a49be3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:50:22.652399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad629-b6b9-4d33-8612-35c5e5ef009c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:22.652933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad629-b6b9-4d33-8612-35c5e5ef009c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:22.654098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad629-b6b9-4d33-8612-35c5e5ef009c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:22.680123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ef8ad629-b6b9-4d33-8612-35c5e5ef009c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:22.682343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ef8ad629-b6b9-4d33-8612-35c5e5ef009c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:22.823401 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1381/2774] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:22.831728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb156-1445-4369-ad59-40adecd9fb22 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:22.832061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb156-1445-4369-ad59-40adecd9fb22 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:22.832273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb156-1445-4369-ad59-40adecd9fb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:22.873043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d81bb156-1445-4369-ad59-40adecd9fb22 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:22.874657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d81bb156-1445-4369-ad59-40adecd9fb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:22.888426 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1394/2775] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:22.892912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad629-b6b9-4d33-8612-35c5e5ef009c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:22.919378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad629-b6b9-4d33-8612-35c5e5ef009c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:22.932835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61429-85eb-4f44-93c0-f0781c82d802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:22.933511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61429-85eb-4f44-93c0-f0781c82d802 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:22.933795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61429-85eb-4f44-93c0-f0781c82d802 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:22.934239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f61429-85eb-4f44-93c0-f0781c82d802 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:22.935238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61429-85eb-4f44-93c0-f0781c82d802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:50:22.935520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61429-85eb-4f44-93c0-f0781c82d802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:22.937184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f61429-85eb-4f44-93c0-f0781c82d802 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:22.955379 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1382/2776] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:50:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:50:22.956150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb156-1445-4369-ad59-40adecd9fb22 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:22.967524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb156-1445-4369-ad59-40adecd9fb22 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:22.972756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438b653-d173-4bf0-adce-1aa3805e5dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:22.973437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b653-d173-4bf0-adce-1aa3805e5dec admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:22.973724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b653-d173-4bf0-adce-1aa3805e5dec admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:22.974007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438b653-d173-4bf0-adce-1aa3805e5dec admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:22.974733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438b653-d173-4bf0-adce-1aa3805e5dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:22.976966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438b653-d173-4bf0-adce-1aa3805e5dec admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:23.007394 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1395/2777] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:50:22 2021] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:50:23.011376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61429-85eb-4f44-93c0-f0781c82d802 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:23.023636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f61429-85eb-4f44-93c0-f0781c82d802 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:23.091448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0fa51-6660-4d8d-8930-76bc7f9267fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:23.092041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0fa51-6660-4d8d-8930-76bc7f9267fd admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:23.092326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0fa51-6660-4d8d-8930-76bc7f9267fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:23.092605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0fa51-6660-4d8d-8930-76bc7f9267fd admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:23.093321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0fa51-6660-4d8d-8930-76bc7f9267fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:23.095352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0fa51-6660-4d8d-8930-76bc7f9267fd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:23.155504 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1383/2778] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:50:23 2021] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:50:23.156870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438b653-d173-4bf0-adce-1aa3805e5dec admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:23.179935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438b653-d173-4bf0-adce-1aa3805e5dec admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:23.186934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e4dcb-94b3-42ce-8915-4dfdd1b138c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:23.188184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4dcb-94b3-42ce-8915-4dfdd1b138c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:23.188864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4dcb-94b3-42ce-8915-4dfdd1b138c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:23.189373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4dcb-94b3-42ce-8915-4dfdd1b138c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:23.190414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e4dcb-94b3-42ce-8915-4dfdd1b138c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:23.193113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e4dcb-94b3-42ce-8915-4dfdd1b138c7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:23.207480 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1396/2779] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:50:23 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:50:23.211075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0fa51-6660-4d8d-8930-76bc7f9267fd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:23.225511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0fa51-6660-4d8d-8930-76bc7f9267fd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:23.233083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45824358-2ab6-4d51-b5eb-f3e94434034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:23.233855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45824358-2ab6-4d51-b5eb-f3e94434034b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:23.234205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45824358-2ab6-4d51-b5eb-f3e94434034b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:23.234538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45824358-2ab6-4d51-b5eb-f3e94434034b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:23.235379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45824358-2ab6-4d51-b5eb-f3e94434034b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:23.237840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45824358-2ab6-4d51-b5eb-f3e94434034b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:23.251723 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1384/2780] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:50:23 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:50:23.255537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e4dcb-94b3-42ce-8915-4dfdd1b138c7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:23.269043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e4dcb-94b3-42ce-8915-4dfdd1b138c7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:23.275187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dabac-a74f-4c38-bc53-1cfc4b9968b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:23.276267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dabac-a74f-4c38-bc53-1cfc4b9968b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:23.276653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dabac-a74f-4c38-bc53-1cfc4b9968b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:23.277251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dabac-a74f-4c38-bc53-1cfc4b9968b8 admin admin] PATH_INFO: `/v3/projects/5274d71e0622482a82d08375f9c081b2/users/8854f64f47034358971c9d2ea40a3074/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:23.304959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dabac-a74f-4c38-bc53-1cfc4b9968b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5274d71e0622482a82d08375f9c081b2, user_id=8854f64f47034358971c9d2ea40a3074, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:23.307787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dabac-a74f-4c38-bc53-1cfc4b9968b8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:23.352259 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1397/2781] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:50:23 2021] PUT /identity/v3/projects/5274d71e0622482a82d08375f9c081b2/users/8854f64f47034358971c9d2ea40a3074/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:50:23.358789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab571-3c93-47f4-91d0-aaf1164ec89f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:23.359078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab571-3c93-47f4-91d0-aaf1164ec89f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:23.359425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab571-3c93-47f4-91d0-aaf1164ec89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:23.386796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-962ab571-3c93-47f4-91d0-aaf1164ec89f None None] MFA Rules not processed for user `8854f64f47034358971c9d2ea40a3074`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:23.388113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-962ab571-3c93-47f4-91d0-aaf1164ec89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:23.494640 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1385/2782] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:23 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:23.496299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ea37-1cdf-47ac-a0f1-68456fb5a74d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:23.496589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ea37-1cdf-47ac-a0f1-68456fb5a74d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:23.497415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ea37-1cdf-47ac-a0f1-68456fb5a74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:23.515651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d8c7ea37-1cdf-47ac-a0f1-68456fb5a74d None None] MFA Rules not processed for user `8854f64f47034358971c9d2ea40a3074`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:23.516902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d8c7ea37-1cdf-47ac-a0f1-68456fb5a74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:23.529400 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1398/2783] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:23 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:50:23.613546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab571-3c93-47f4-91d0-aaf1164ec89f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:23.615060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-962ab571-3c93-47f4-91d0-aaf1164ec89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:23.722467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab571-3c93-47f4-91d0-aaf1164ec89f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:23.733076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7eacaf-190b-4299-b19d-4772938c3a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:23.736173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eacaf-190b-4299-b19d-4772938c3a23 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:23.736524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eacaf-190b-4299-b19d-4772938c3a23 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:23.736765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eacaf-190b-4299-b19d-4772938c3a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:23.746561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7eacaf-190b-4299-b19d-4772938c3a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:23.748827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7eacaf-190b-4299-b19d-4772938c3a23 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:23.758089 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1386/2784] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:23 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:29.037957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7ea37-1cdf-47ac-a0f1-68456fb5a74d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:29.039677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d8c7ea37-1cdf-47ac-a0f1-68456fb5a74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:29.099235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7ea37-1cdf-47ac-a0f1-68456fb5a74d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:29.102895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf7e9a-f594-473a-8f76-5b1e2cfc958e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:29.103581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7e9a-f594-473a-8f76-5b1e2cfc958e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:29.103986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7e9a-f594-473a-8f76-5b1e2cfc958e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:29.104127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf7e9a-f594-473a-8f76-5b1e2cfc958e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:29.106014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6caf7e9a-f594-473a-8f76-5b1e2cfc958e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:29.120711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf7e9a-f594-473a-8f76-5b1e2cfc958e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:29.122733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf7e9a-f594-473a-8f76-5b1e2cfc958e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:29.134618 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1399/2785] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:29.177888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7eacaf-190b-4299-b19d-4772938c3a23 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:29.179948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8f7eacaf-190b-4299-b19d-4772938c3a23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:29.193083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7eacaf-190b-4299-b19d-4772938c3a23 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:29.196679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feefea0-db6e-412e-a123-0b976b065bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:29.197314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feefea0-db6e-412e-a123-0b976b065bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:29.197654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feefea0-db6e-412e-a123-0b976b065bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:29.197848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feefea0-db6e-412e-a123-0b976b065bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:29.200309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5feefea0-db6e-412e-a123-0b976b065bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:29.226360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feefea0-db6e-412e-a123-0b976b065bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:29.227837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feefea0-db6e-412e-a123-0b976b065bf5 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:29.241039 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1387/2786] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:46.206689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf7e9a-f594-473a-8f76-5b1e2cfc958e service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:46.215324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf7e9a-f594-473a-8f76-5b1e2cfc958e service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:46.219448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3b88d-0553-4151-96c3-6dbcff73f7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:46.220079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3b88d-0553-4151-96c3-6dbcff73f7be service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:46.220354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3b88d-0553-4151-96c3-6dbcff73f7be service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:46.221089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3b88d-0553-4151-96c3-6dbcff73f7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:46.223029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fec3b88d-0553-4151-96c3-6dbcff73f7be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:46.236160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3b88d-0553-4151-96c3-6dbcff73f7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:46.237600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3b88d-0553-4151-96c3-6dbcff73f7be service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:46.246406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1400/2787] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:46 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:56.250640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feefea0-db6e-412e-a123-0b976b065bf5 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:56.261080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feefea0-db6e-412e-a123-0b976b065bf5 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:56.265499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e58b9-2060-4c02-9007-c17af045b318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:56.266357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e58b9-2060-4c02-9007-c17af045b318 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:56.266538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e58b9-2060-4c02-9007-c17af045b318 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:56.266712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e58b9-2060-4c02-9007-c17af045b318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:56.269453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-873e58b9-2060-4c02-9007-c17af045b318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:56.281524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e58b9-2060-4c02-9007-c17af045b318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:56.284563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e58b9-2060-4c02-9007-c17af045b318 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:56.298136 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1388/2788] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:56 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:57.080754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3b88d-0553-4151-96c3-6dbcff73f7be service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:50:57.097955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3b88d-0553-4151-96c3-6dbcff73f7be service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:50:57.109425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fcab3-2adf-4182-8258-d6a8522c5e18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:50:57.111044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fcab3-2adf-4182-8258-d6a8522c5e18 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:57.111432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fcab3-2adf-4182-8258-d6a8522c5e18 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:57.111824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fcab3-2adf-4182-8258-d6a8522c5e18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:57.115919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-af0fcab3-2adf-4182-8258-d6a8522c5e18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:57.132186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fcab3-2adf-4182-8258-d6a8522c5e18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:50:57.134070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fcab3-2adf-4182-8258-d6a8522c5e18 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:50:57.152646 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1401/2789] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:50:57 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:50:58.170180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3ec61-014c-4021-8505-efa34d230827 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:50:58.170806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3ec61-014c-4021-8505-efa34d230827 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:50:58.170806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3ec61-014c-4021-8505-efa34d230827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:50:58.192054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5cf3ec61-014c-4021-8505-efa34d230827 None None] MFA Rules not processed for user `5af01920574741f381a5dfefd9282bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:50:58.193367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5cf3ec61-014c-4021-8505-efa34d230827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:50:58.255491 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1389/2790] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:50:58 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:00.018813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fcab3-2adf-4182-8258-d6a8522c5e18 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:00.026855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-af0fcab3-2adf-4182-8258-d6a8522c5e18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:00.180316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fcab3-2adf-4182-8258-d6a8522c5e18 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:00.195015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c9299-9260-428b-a9a6-1a46cf4696f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:00.195812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c9299-9260-428b-a9a6-1a46cf4696f4 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:00.196089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c9299-9260-428b-a9a6-1a46cf4696f4 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:00.197404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c9299-9260-428b-a9a6-1a46cf4696f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:00.206275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-959c9299-9260-428b-a9a6-1a46cf4696f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:00.225837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c9299-9260-428b-a9a6-1a46cf4696f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:00.232370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c9299-9260-428b-a9a6-1a46cf4696f4 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:00.251919 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1402/2791] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:00 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:00.353452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3ec61-014c-4021-8505-efa34d230827 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:00.385029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3ec61-014c-4021-8505-efa34d230827 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:00.422503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066a77-ac5c-47bc-8948-fb3f0f85b2dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:00.424207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066a77-ac5c-47bc-8948-fb3f0f85b2dc service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:00.425043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066a77-ac5c-47bc-8948-fb3f0f85b2dc service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:00.425471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066a77-ac5c-47bc-8948-fb3f0f85b2dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:00.433753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-49066a77-ac5c-47bc-8948-fb3f0f85b2dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:00.491598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49066a77-ac5c-47bc-8948-fb3f0f85b2dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:00.496492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49066a77-ac5c-47bc-8948-fb3f0f85b2dc service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:00.531137 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1390/2792] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:00 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:02.956297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c9299-9260-428b-a9a6-1a46cf4696f4 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:03.080880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c9299-9260-428b-a9a6-1a46cf4696f4 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:03.087785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:03.089103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:03.089631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:03.090129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] PATH_INFO: `/v3/users/8854f64f47034358971c9d2ea40a3074` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:03.092225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8854f64f47034358971c9d2ea40a3074)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:03.098312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:03.218597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8854f64f47034358971c9d2ea40a3074'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:03.221258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8854f64f47034358971c9d2ea40a3074'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:03.244362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8854f64f47034358971c9d2ea40a3074'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:03.245285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8854f64f47034358971c9d2ea40a3074'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:03.262663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8854f64f47034358971c9d2ea40a3074'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:03.312593 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1403/2793] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:02 2021] DELETE /identity/v3/users/8854f64f47034358971c9d2ea40a3074 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:03.318465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3decef8-01c7-42a1-88ab-437a21b52795 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:03.319036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3decef8-01c7-42a1-88ab-437a21b52795 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:03.319188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3decef8-01c7-42a1-88ab-437a21b52795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:03.348259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f3decef8-01c7-42a1-88ab-437a21b52795 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:03.350319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f3decef8-01c7-42a1-88ab-437a21b52795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:03.446891 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1391/2794] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:03.459224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:03.460977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:03.545223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6a836-d6d5-4c0c-871a-d3a7c982096f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:03.550253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c88f3b-3192-49cd-9e26-1aef88d3f74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:03.551186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c88f3b-3192-49cd-9e26-1aef88d3f74c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:03.553045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c88f3b-3192-49cd-9e26-1aef88d3f74c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:03.553508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c88f3b-3192-49cd-9e26-1aef88d3f74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:03.565903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c88f3b-3192-49cd-9e26-1aef88d3f74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:03.567594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c88f3b-3192-49cd-9e26-1aef88d3f74c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:03.595154 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1404/2795] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:03.834266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3decef8-01c7-42a1-88ab-437a21b52795 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:03.837810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f3decef8-01c7-42a1-88ab-437a21b52795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:03.854661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3decef8-01c7-42a1-88ab-437a21b52795 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:03.861890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:03.863462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:03.864068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:03.864610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] PATH_INFO: `/v3/projects/5274d71e0622482a82d08375f9c081b2` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:03.866268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5274d71e0622482a82d08375f9c081b2)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:03.869673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:03.940586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5274d71e0622482a82d08375f9c081b2', 'request_id': 'req-969863da-098a-4348-8539-06d7b54aaa7e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:03.955752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5274d71e0622482a82d08375f9c081b2', 'request_id': 'req-969863da-098a-4348-8539-06d7b54aaa7e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:03.971162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5274d71e0622482a82d08375f9c081b2', 'request_id': 'req-969863da-098a-4348-8539-06d7b54aaa7e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:03.989691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] The token cache is being invalidate because project 5274d71e0622482a82d08375f9c081b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:03.990540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:03.991620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-969863da-098a-4348-8539-06d7b54aaa7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:03.994266 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1392/2796] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:03 2021] DELETE /identity/v3/projects/5274d71e0622482a82d08375f9c081b2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:04.000634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113d937-a15e-4d31-b4ee-94bab849b236 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:04.001198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113d937-a15e-4d31-b4ee-94bab849b236 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:04.001198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113d937-a15e-4d31-b4ee-94bab849b236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:04.035583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9113d937-a15e-4d31-b4ee-94bab849b236 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:04.037047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9113d937-a15e-4d31-b4ee-94bab849b236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:04.141098 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1405/2797] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:04.148480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18da48f-abaf-4057-97eb-30b42e1e0682 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:04.148809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18da48f-abaf-4057-97eb-30b42e1e0682 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:04.149050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18da48f-abaf-4057-97eb-30b42e1e0682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:04.180964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f18da48f-abaf-4057-97eb-30b42e1e0682 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:04.183756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f18da48f-abaf-4057-97eb-30b42e1e0682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:04.202253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113d937-a15e-4d31-b4ee-94bab849b236 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:04.202790 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1393/2798] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:04.215244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113d937-a15e-4d31-b4ee-94bab849b236 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:04.228929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415b7b5-0ac6-4986-9fa6-d4ec0b9b4b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:04.234901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415b7b5-0ac6-4986-9fa6-d4ec0b9b4b17 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:04.235351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415b7b5-0ac6-4986-9fa6-d4ec0b9b4b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:04.235722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415b7b5-0ac6-4986-9fa6-d4ec0b9b4b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:04.236828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415b7b5-0ac6-4986-9fa6-d4ec0b9b4b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:51:04.237902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415b7b5-0ac6-4986-9fa6-d4ec0b9b4b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:04.240335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415b7b5-0ac6-4986-9fa6-d4ec0b9b4b17 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:04.258626 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1406/2799] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:51:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:04.264080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18da48f-abaf-4057-97eb-30b42e1e0682 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:04.277013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18da48f-abaf-4057-97eb-30b42e1e0682 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:04.283994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38e73b-4a58-44e9-baaf-0990243cf4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:04.286271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e73b-4a58-44e9-baaf-0990243cf4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:04.286910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e73b-4a58-44e9-baaf-0990243cf4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:04.287448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e73b-4a58-44e9-baaf-0990243cf4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:04.288442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38e73b-4a58-44e9-baaf-0990243cf4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:04.291077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38e73b-4a58-44e9-baaf-0990243cf4d2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:04.328517 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1394/2800] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:04 2021] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:04.333242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415b7b5-0ac6-4986-9fa6-d4ec0b9b4b17 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:04.347844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415b7b5-0ac6-4986-9fa6-d4ec0b9b4b17 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:04.478686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a17ec-9c88-4239-b3f0-f58010c9aa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:04.479472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a17ec-9c88-4239-b3f0-f58010c9aa19 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:04.479755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a17ec-9c88-4239-b3f0-f58010c9aa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:04.480027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a17ec-9c88-4239-b3f0-f58010c9aa19 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:04.486457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a17ec-9c88-4239-b3f0-f58010c9aa19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:04.489285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a17ec-9c88-4239-b3f0-f58010c9aa19 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:04.526486 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1407/2801] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:04 2021] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:04.527363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38e73b-4a58-44e9-baaf-0990243cf4d2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:04.542249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38e73b-4a58-44e9-baaf-0990243cf4d2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:04.556152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e351d3a-2d6c-4545-8c26-ac0b2970fe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:04.557246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e351d3a-2d6c-4545-8c26-ac0b2970fe1d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:04.557752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e351d3a-2d6c-4545-8c26-ac0b2970fe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:04.558404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e351d3a-2d6c-4545-8c26-ac0b2970fe1d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:04.559426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e351d3a-2d6c-4545-8c26-ac0b2970fe1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:04.561402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e351d3a-2d6c-4545-8c26-ac0b2970fe1d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:04.576064 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1395/2802] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:04 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:51:04.581544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a17ec-9c88-4239-b3f0-f58010c9aa19 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:04.594908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a17ec-9c88-4239-b3f0-f58010c9aa19 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:04.600130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeca3c0-9795-4951-8d6d-1dfe8d3ef0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:04.600960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca3c0-9795-4951-8d6d-1dfe8d3ef0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:04.601235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca3c0-9795-4951-8d6d-1dfe8d3ef0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:04.602313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca3c0-9795-4951-8d6d-1dfe8d3ef0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:04.604432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeca3c0-9795-4951-8d6d-1dfe8d3ef0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:04.606078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeca3c0-9795-4951-8d6d-1dfe8d3ef0c4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:04.651722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e351d3a-2d6c-4545-8c26-ac0b2970fe1d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:04.658143 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1408/2803] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:04 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:04.667752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e351d3a-2d6c-4545-8c26-ac0b2970fe1d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:04.674167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0802b3-cafa-4bfe-9139-934918b73676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:04.676207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0802b3-cafa-4bfe-9139-934918b73676 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:04.677641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0802b3-cafa-4bfe-9139-934918b73676 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:04.678127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0802b3-cafa-4bfe-9139-934918b73676 admin admin] PATH_INFO: `/v3/projects/eb7f37181c464b6fbd15d9f235d94086/users/7e10693bd4a2442cb7c75cc61ccccc16/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:04.698020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0802b3-cafa-4bfe-9139-934918b73676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7f37181c464b6fbd15d9f235d94086, user_id=7e10693bd4a2442cb7c75cc61ccccc16, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:04.702096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0802b3-cafa-4bfe-9139-934918b73676 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:04.723817 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1396/2804] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:04 2021] PUT /identity/v3/projects/eb7f37181c464b6fbd15d9f235d94086/users/7e10693bd4a2442cb7c75cc61ccccc16/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:04.734318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5252e1-eee5-48d4-a3e6-0af0acc67661 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:04.734623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5252e1-eee5-48d4-a3e6-0af0acc67661 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:04.734880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5252e1-eee5-48d4-a3e6-0af0acc67661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:04.776463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cc5252e1-eee5-48d4-a3e6-0af0acc67661 None None] MFA Rules not processed for user `7e10693bd4a2442cb7c75cc61ccccc16`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:04.777898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cc5252e1-eee5-48d4-a3e6-0af0acc67661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:04.897745 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1409/2805] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:04 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:04.899681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13efaa-8c84-472a-bc7d-dbc2f8709d2b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:04.900226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13efaa-8c84-472a-bc7d-dbc2f8709d2b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:04.900495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13efaa-8c84-472a-bc7d-dbc2f8709d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:04.920481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1f13efaa-8c84-472a-bc7d-dbc2f8709d2b None None] MFA Rules not processed for user `7e10693bd4a2442cb7c75cc61ccccc16`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:04.921754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1f13efaa-8c84-472a-bc7d-dbc2f8709d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:04.930672 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1397/2806] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:04 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:05.406661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5252e1-eee5-48d4-a3e6-0af0acc67661 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:05.408366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cc5252e1-eee5-48d4-a3e6-0af0acc67661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:05.490441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5252e1-eee5-48d4-a3e6-0af0acc67661 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:05.496868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d996b05-2222-411c-bbb8-2a03529e470a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:05.498112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d996b05-2222-411c-bbb8-2a03529e470a service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:05.498491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d996b05-2222-411c-bbb8-2a03529e470a service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:05.498942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d996b05-2222-411c-bbb8-2a03529e470a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:05.510371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d996b05-2222-411c-bbb8-2a03529e470a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:05.512351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d996b05-2222-411c-bbb8-2a03529e470a service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:05.524069 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1410/2807] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:05 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:09.291241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13efaa-8c84-472a-bc7d-dbc2f8709d2b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:09.292836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1f13efaa-8c84-472a-bc7d-dbc2f8709d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:09.439765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13efaa-8c84-472a-bc7d-dbc2f8709d2b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:09.454978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689792c-71d5-430e-a1c6-4a8b970bbc23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:09.455933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689792c-71d5-430e-a1c6-4a8b970bbc23 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:09.456530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689792c-71d5-430e-a1c6-4a8b970bbc23 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:09.456809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689792c-71d5-430e-a1c6-4a8b970bbc23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:09.458831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1689792c-71d5-430e-a1c6-4a8b970bbc23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:09.540639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689792c-71d5-430e-a1c6-4a8b970bbc23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:09.542095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689792c-71d5-430e-a1c6-4a8b970bbc23 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:09.556508 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1398/2808] 10.222.0.21 () {60 vars in 1396 bytes} [Sat Nov 27 20:51:09 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:13.538310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d996b05-2222-411c-bbb8-2a03529e470a service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:13.539833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7d996b05-2222-411c-bbb8-2a03529e470a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:13.559429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d996b05-2222-411c-bbb8-2a03529e470a service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:13.565991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35f1b2-8084-4ac0-bf2e-3e265f33708f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:13.567412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35f1b2-8084-4ac0-bf2e-3e265f33708f service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:13.568051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35f1b2-8084-4ac0-bf2e-3e265f33708f service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:13.568547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35f1b2-8084-4ac0-bf2e-3e265f33708f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:13.571152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fb35f1b2-8084-4ac0-bf2e-3e265f33708f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:13.586374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35f1b2-8084-4ac0-bf2e-3e265f33708f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:13.588665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35f1b2-8084-4ac0-bf2e-3e265f33708f service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:13.615351 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1411/2809] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:21.732202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85300b5-66dd-459d-9323-54c6737f6440 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:21.732769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85300b5-66dd-459d-9323-54c6737f6440 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:21.732875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85300b5-66dd-459d-9323-54c6737f6440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:21.750597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e85300b5-66dd-459d-9323-54c6737f6440 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:21.751828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e85300b5-66dd-459d-9323-54c6737f6440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:21.812248 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1399/2810] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:51:21 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:51:21.869086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35f1b2-8084-4ac0-bf2e-3e265f33708f service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:21.870488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fb35f1b2-8084-4ac0-bf2e-3e265f33708f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:21.941030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35f1b2-8084-4ac0-bf2e-3e265f33708f service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:21.946162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f15f-b673-47b4-9c0c-606450268112 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:21.946806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f15f-b673-47b4-9c0c-606450268112 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:21.947091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f15f-b673-47b4-9c0c-606450268112 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:21.947437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f15f-b673-47b4-9c0c-606450268112 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:21.957394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3f15f-b673-47b4-9c0c-606450268112 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:21.958990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3f15f-b673-47b4-9c0c-606450268112 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:21.967677 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1412/2811] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:51:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:24.593872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85300b5-66dd-459d-9323-54c6737f6440 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:24.596026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e85300b5-66dd-459d-9323-54c6737f6440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:24.607805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85300b5-66dd-459d-9323-54c6737f6440 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:24.612757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd67a0d-d0b5-493a-aac8-d3944b150878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:24.613651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd67a0d-d0b5-493a-aac8-d3944b150878 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:24.613931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd67a0d-d0b5-493a-aac8-d3944b150878 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:24.614200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd67a0d-d0b5-493a-aac8-d3944b150878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:24.616025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4bd67a0d-d0b5-493a-aac8-d3944b150878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:24.685349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd67a0d-d0b5-493a-aac8-d3944b150878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:24.687086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd67a0d-d0b5-493a-aac8-d3944b150878 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:24.697860 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1400/2812] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:26.334734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f15f-b673-47b4-9c0c-606450268112 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:26.336321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-80f3f15f-b673-47b4-9c0c-606450268112 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:26.359407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f15f-b673-47b4-9c0c-606450268112 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:26.369414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:26.371346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:26.371825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:26.372278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] PATH_INFO: `/v3/users/2d326a07ce104727bec8ae98dabea64d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:26.374351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d326a07ce104727bec8ae98dabea64d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:26.377694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:26.445040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d326a07ce104727bec8ae98dabea64d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:26.446464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d326a07ce104727bec8ae98dabea64d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:26.461480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d326a07ce104727bec8ae98dabea64d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:26.462420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d326a07ce104727bec8ae98dabea64d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:26.478180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d326a07ce104727bec8ae98dabea64d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:26.506250 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1413/2813] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:26 2021] DELETE /identity/v3/users/2d326a07ce104727bec8ae98dabea64d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:26.872196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd67a0d-d0b5-493a-aac8-d3944b150878 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:26.890522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd67a0d-d0b5-493a-aac8-d3944b150878 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:26.970606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:26.971768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:26.972122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:26.972719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] PATH_INFO: `/v3/projects/a9eca53282994b4094a056750bb24ccb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:26.974689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9eca53282994b4094a056750bb24ccb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:26.977863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:27.044757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9eca53282994b4094a056750bb24ccb', 'request_id': 'req-f893a6f7-2df1-49eb-88dc-246b0188987f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:27.067271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9eca53282994b4094a056750bb24ccb', 'request_id': 'req-f893a6f7-2df1-49eb-88dc-246b0188987f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:27.091936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9eca53282994b4094a056750bb24ccb', 'request_id': 'req-f893a6f7-2df1-49eb-88dc-246b0188987f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:27.156827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] The token cache is being invalidate because project a9eca53282994b4094a056750bb24ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:27.157442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:27.160447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:27.163777 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1401/2814] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:26 2021] DELETE /identity/v3/projects/a9eca53282994b4094a056750bb24ccb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:27.167698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:27.169792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:27.208778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd06360-86c6-47f8-be97-1458fa44cc6f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:27.367861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff920ea9-e9af-4a3b-9216-eda372f8deed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:27.374343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff920ea9-e9af-4a3b-9216-eda372f8deed admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:27.375479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff920ea9-e9af-4a3b-9216-eda372f8deed admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:27.375952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff920ea9-e9af-4a3b-9216-eda372f8deed admin admin] PATH_INFO: `/v3/users/49049bebdad54e2ebc4e1d5ba129d299` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:27.379236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff920ea9-e9af-4a3b-9216-eda372f8deed admin admin] RBAC: Authorizing `identity:delete_user(user_id=49049bebdad54e2ebc4e1d5ba129d299)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:27.382759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff920ea9-e9af-4a3b-9216-eda372f8deed admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:27.468099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff920ea9-e9af-4a3b-9216-eda372f8deed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49049bebdad54e2ebc4e1d5ba129d299'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:27.469376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff920ea9-e9af-4a3b-9216-eda372f8deed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49049bebdad54e2ebc4e1d5ba129d299'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:27.495846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff920ea9-e9af-4a3b-9216-eda372f8deed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49049bebdad54e2ebc4e1d5ba129d299'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:27.496845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff920ea9-e9af-4a3b-9216-eda372f8deed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49049bebdad54e2ebc4e1d5ba129d299'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:27.509065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff920ea9-e9af-4a3b-9216-eda372f8deed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49049bebdad54e2ebc4e1d5ba129d299'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:27.549927 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1414/2815] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:27 2021] DELETE /identity/v3/users/49049bebdad54e2ebc4e1d5ba129d299 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:28.307898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:28.310405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:28.343116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893a6f7-2df1-49eb-88dc-246b0188987f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:28.493412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:28.494477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:28.494743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:28.495087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] PATH_INFO: `/v3/projects/a146d6034f3e4681b6a81cb27ce5f57a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:28.496379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a146d6034f3e4681b6a81cb27ce5f57a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:28.498260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:28.567445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a146d6034f3e4681b6a81cb27ce5f57a', 'request_id': 'req-4af80b90-f032-48b9-bc7c-1ccda37d442a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:28.584627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a146d6034f3e4681b6a81cb27ce5f57a', 'request_id': 'req-4af80b90-f032-48b9-bc7c-1ccda37d442a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:28.593224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a146d6034f3e4681b6a81cb27ce5f57a', 'request_id': 'req-4af80b90-f032-48b9-bc7c-1ccda37d442a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:28.607951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] The token cache is being invalidate because project a146d6034f3e4681b6a81cb27ce5f57a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:28.608250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:28.609345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4af80b90-f032-48b9-bc7c-1ccda37d442a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:28.612242 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1402/2816] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:28 2021] DELETE /identity/v3/projects/a146d6034f3e4681b6a81cb27ce5f57a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:28.619029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f994be0-1aac-481b-bc7b-5222cedb6931 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:28.619627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f994be0-1aac-481b-bc7b-5222cedb6931 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:28.619627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f994be0-1aac-481b-bc7b-5222cedb6931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:28.648685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4f994be0-1aac-481b-bc7b-5222cedb6931 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:28.650235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4f994be0-1aac-481b-bc7b-5222cedb6931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:28.742169 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1415/2817] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:28.744323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258e779-78df-42cb-80aa-5a26706ca086 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:28.744933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258e779-78df-42cb-80aa-5a26706ca086 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:28.745231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258e779-78df-42cb-80aa-5a26706ca086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:28.775215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d258e779-78df-42cb-80aa-5a26706ca086 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:28.776901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d258e779-78df-42cb-80aa-5a26706ca086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:28.789223 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1403/2818] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:51:28.793805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f994be0-1aac-481b-bc7b-5222cedb6931 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:28.806657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f994be0-1aac-481b-bc7b-5222cedb6931 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:28.812274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf6ecb-8b56-407d-8500-b7f503856294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:28.813396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6ecb-8b56-407d-8500-b7f503856294 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:28.814345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6ecb-8b56-407d-8500-b7f503856294 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:28.815051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6ecb-8b56-407d-8500-b7f503856294 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:28.816044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf6ecb-8b56-407d-8500-b7f503856294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:51:28.816425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf6ecb-8b56-407d-8500-b7f503856294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:28.818281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf6ecb-8b56-407d-8500-b7f503856294 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:28.840299 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1416/2819] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:51:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:28.841041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258e779-78df-42cb-80aa-5a26706ca086 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:28.852162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258e779-78df-42cb-80aa-5a26706ca086 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:28.867240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a1d1e-cb97-464f-88e8-1045bee91078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:28.868980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1d1e-cb97-464f-88e8-1045bee91078 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:28.869490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1d1e-cb97-464f-88e8-1045bee91078 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:28.869827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1d1e-cb97-464f-88e8-1045bee91078 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:28.872427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a1d1e-cb97-464f-88e8-1045bee91078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:28.872674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a1d1e-cb97-464f-88e8-1045bee91078 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:28.912508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf6ecb-8b56-407d-8500-b7f503856294 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:28.918149 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1404/2820] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:28 2021] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:28.923920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf6ecb-8b56-407d-8500-b7f503856294 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:29.035289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f06ff-bcdd-46e7-b088-8e1919f885ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:29.035493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f06ff-bcdd-46e7-b088-8e1919f885ed admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:29.035866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f06ff-bcdd-46e7-b088-8e1919f885ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:29.036238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f06ff-bcdd-46e7-b088-8e1919f885ed admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:29.037030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f06ff-bcdd-46e7-b088-8e1919f885ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:29.039032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f06ff-bcdd-46e7-b088-8e1919f885ed admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:29.072004 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1417/2821] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:28 2021] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:51:29.073435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a1d1e-cb97-464f-88e8-1045bee91078 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:29.095962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a1d1e-cb97-464f-88e8-1045bee91078 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:29.122087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cc452-b376-471a-98dc-dde89e699d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:29.122087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cc452-b376-471a-98dc-dde89e699d7f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:29.122922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cc452-b376-471a-98dc-dde89e699d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:29.123946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cc452-b376-471a-98dc-dde89e699d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:29.125179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cc452-b376-471a-98dc-dde89e699d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:29.127790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cc452-b376-471a-98dc-dde89e699d7f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:29.150158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f06ff-bcdd-46e7-b088-8e1919f885ed admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:29.150738 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1405/2822] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:29 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:29.172366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f06ff-bcdd-46e7-b088-8e1919f885ed admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:29.179176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20259729-f2b3-4ba3-a030-56d516d874b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:29.179591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20259729-f2b3-4ba3-a030-56d516d874b2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:29.179884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20259729-f2b3-4ba3-a030-56d516d874b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:29.180148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20259729-f2b3-4ba3-a030-56d516d874b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:29.180989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20259729-f2b3-4ba3-a030-56d516d874b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:29.182726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20259729-f2b3-4ba3-a030-56d516d874b2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:29.201335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cc452-b376-471a-98dc-dde89e699d7f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:29.210194 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1418/2823] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:29 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:29.214807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cc452-b376-471a-98dc-dde89e699d7f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:29.223894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6683ee9-537e-439f-8848-6f4b6ef598d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:29.225181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6683ee9-537e-439f-8848-6f4b6ef598d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:29.225669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6683ee9-537e-439f-8848-6f4b6ef598d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:29.226173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6683ee9-537e-439f-8848-6f4b6ef598d2 admin admin] PATH_INFO: `/v3/projects/7096bfbf5c8e42f09551e4c84ea8de02/users/e39495438d7c40a780a68e2cf38d6ba2/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:29.261512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6683ee9-537e-439f-8848-6f4b6ef598d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7096bfbf5c8e42f09551e4c84ea8de02, user_id=e39495438d7c40a780a68e2cf38d6ba2, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:29.270360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6683ee9-537e-439f-8848-6f4b6ef598d2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:29.298628 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1406/2824] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:29 2021] PUT /identity/v3/projects/7096bfbf5c8e42f09551e4c84ea8de02/users/e39495438d7c40a780a68e2cf38d6ba2/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:29.308376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656271b-ff94-42c3-b2ee-ef5d3ae2b9a4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:29.308662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656271b-ff94-42c3-b2ee-ef5d3ae2b9a4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:29.308951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656271b-ff94-42c3-b2ee-ef5d3ae2b9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:29.351054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6656271b-ff94-42c3-b2ee-ef5d3ae2b9a4 None None] MFA Rules not processed for user `e39495438d7c40a780a68e2cf38d6ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:29.352628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6656271b-ff94-42c3-b2ee-ef5d3ae2b9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:29.514433 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1419/2825] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:29 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:29.515739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6683ee9-537e-439f-8848-6f4b6ef598d2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:29.625743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6683ee9-537e-439f-8848-6f4b6ef598d2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:29.633148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f17c40-9d32-41d0-88cb-4673dcc34ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:29.633866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f17c40-9d32-41d0-88cb-4673dcc34ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:29.634154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f17c40-9d32-41d0-88cb-4673dcc34ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:29.634426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f17c40-9d32-41d0-88cb-4673dcc34ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:29.635150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f17c40-9d32-41d0-88cb-4673dcc34ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:29.637202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f17c40-9d32-41d0-88cb-4673dcc34ce2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:29.670176 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1407/2826] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:29 2021] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:29.674333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656271b-ff94-42c3-b2ee-ef5d3ae2b9a4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:29.685337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656271b-ff94-42c3-b2ee-ef5d3ae2b9a4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:29.759165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46ec8c-4328-4f0a-940f-c8feea257266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:29.760027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ec8c-4328-4f0a-940f-c8feea257266 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:29.760719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ec8c-4328-4f0a-940f-c8feea257266 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:29.761075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ec8c-4328-4f0a-940f-c8feea257266 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:29.763273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46ec8c-4328-4f0a-940f-c8feea257266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:29.765501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46ec8c-4328-4f0a-940f-c8feea257266 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:29.805758 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1420/2827] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:29 2021] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:29.809276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f17c40-9d32-41d0-88cb-4673dcc34ce2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:29.832198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f17c40-9d32-41d0-88cb-4673dcc34ce2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:29.848465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6299-0b3b-4f79-ac64-01a07d42d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:29.849275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6299-0b3b-4f79-ac64-01a07d42d5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:29.849466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6299-0b3b-4f79-ac64-01a07d42d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:29.849766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa6299-0b3b-4f79-ac64-01a07d42d5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:29.850809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa6299-0b3b-4f79-ac64-01a07d42d5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:29.853837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa6299-0b3b-4f79-ac64-01a07d42d5a1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:29.886067 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1408/2828] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:29 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:29.886239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46ec8c-4328-4f0a-940f-c8feea257266 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:29.900053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46ec8c-4328-4f0a-940f-c8feea257266 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:29.908464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb38862-360f-435f-8de2-69ba568c6351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:29.910121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb38862-360f-435f-8de2-69ba568c6351 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:29.910584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb38862-360f-435f-8de2-69ba568c6351 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:29.913631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb38862-360f-435f-8de2-69ba568c6351 admin admin] PATH_INFO: `/v3/projects/ba71d35c2a7b46fda183ec8b161dc3fa/users/ee70c6c98e6648779459a3a395586170/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:29.952301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb38862-360f-435f-8de2-69ba568c6351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba71d35c2a7b46fda183ec8b161dc3fa, user_id=ee70c6c98e6648779459a3a395586170, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:29.956294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb38862-360f-435f-8de2-69ba568c6351 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:29.978497 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1421/2829] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:29 2021] PUT /identity/v3/projects/ba71d35c2a7b46fda183ec8b161dc3fa/users/ee70c6c98e6648779459a3a395586170/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:29.982121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6299-0b3b-4f79-ac64-01a07d42d5a1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:29.995369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa6299-0b3b-4f79-ac64-01a07d42d5a1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:30.143891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1a441-4e44-46ed-a0d1-94c5ea284d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:30.144738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1a441-4e44-46ed-a0d1-94c5ea284d00 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:30.145154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1a441-4e44-46ed-a0d1-94c5ea284d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:30.145384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1a441-4e44-46ed-a0d1-94c5ea284d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:30.146588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1a441-4e44-46ed-a0d1-94c5ea284d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:30.157572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1a441-4e44-46ed-a0d1-94c5ea284d00 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:30.179039 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1409/2830] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:29 2021] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:30.183222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb38862-360f-435f-8de2-69ba568c6351 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:30.201517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb38862-360f-435f-8de2-69ba568c6351 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:30.235157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb942a3-e170-4bb1-b26d-5ec5c090a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:30.240135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb942a3-e170-4bb1-b26d-5ec5c090a959 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:30.240420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb942a3-e170-4bb1-b26d-5ec5c090a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:30.241490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb942a3-e170-4bb1-b26d-5ec5c090a959 admin admin] PATH_INFO: `/v3/projects/ba71d35c2a7b46fda183ec8b161dc3fa/users/ee70c6c98e6648779459a3a395586170/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:30.252898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb942a3-e170-4bb1-b26d-5ec5c090a959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba71d35c2a7b46fda183ec8b161dc3fa, user_id=ee70c6c98e6648779459a3a395586170, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:30.256796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb942a3-e170-4bb1-b26d-5ec5c090a959 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:30.280604 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1422/2831] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:30 2021] PUT /identity/v3/projects/ba71d35c2a7b46fda183ec8b161dc3fa/users/ee70c6c98e6648779459a3a395586170/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:30.291305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264a15b-6811-4eed-9126-fa8a034587a9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:30.291588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264a15b-6811-4eed-9126-fa8a034587a9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:30.291867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264a15b-6811-4eed-9126-fa8a034587a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:30.333290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7264a15b-6811-4eed-9126-fa8a034587a9 None None] MFA Rules not processed for user `ee70c6c98e6648779459a3a395586170`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:30.335075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7264a15b-6811-4eed-9126-fa8a034587a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:30.461630 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1410/2832] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:30 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:30.474277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce61c2d-7442-4896-945f-652ea0d626ae None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:30.474612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce61c2d-7442-4896-945f-652ea0d626ae None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:30.474893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce61c2d-7442-4896-945f-652ea0d626ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:30.514305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8ce61c2d-7442-4896-945f-652ea0d626ae None None] MFA Rules not processed for user `e39495438d7c40a780a68e2cf38d6ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:30.517072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8ce61c2d-7442-4896-945f-652ea0d626ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:30.630765 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1423/2833] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:30 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:30.659787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264a15b-6811-4eed-9126-fa8a034587a9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:30.661391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7264a15b-6811-4eed-9126-fa8a034587a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:30.777773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264a15b-6811-4eed-9126-fa8a034587a9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:30.785186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd4771-f9f8-4e32-b24f-1d8eaeb06aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:30.785863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd4771-f9f8-4e32-b24f-1d8eaeb06aef service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:30.786157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd4771-f9f8-4e32-b24f-1d8eaeb06aef service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:30.786450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd4771-f9f8-4e32-b24f-1d8eaeb06aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:30.795337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd4771-f9f8-4e32-b24f-1d8eaeb06aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:30.799551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd4771-f9f8-4e32-b24f-1d8eaeb06aef service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:30.810861 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1411/2834] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:30 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:36.480035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce61c2d-7442-4896-945f-652ea0d626ae None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:36.517183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce61c2d-7442-4896-945f-652ea0d626ae None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:36.531722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd4fd7-0fc2-4008-af7a-8c1eb8d0deed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:36.532438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4fd7-0fc2-4008-af7a-8c1eb8d0deed service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:36.532720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4fd7-0fc2-4008-af7a-8c1eb8d0deed service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:36.532997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4fd7-0fc2-4008-af7a-8c1eb8d0deed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:36.534853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-30bd4fd7-0fc2-4008-af7a-8c1eb8d0deed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:36.628238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4fd7-0fc2-4008-af7a-8c1eb8d0deed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:36.630608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4fd7-0fc2-4008-af7a-8c1eb8d0deed service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:36.650378 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1424/2835] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:36 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:37.076178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a838df0-bee6-4395-a16b-f2b39ec8c164 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:37.076700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a838df0-bee6-4395-a16b-f2b39ec8c164 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:37.076803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a838df0-bee6-4395-a16b-f2b39ec8c164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:37.095960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7a838df0-bee6-4395-a16b-f2b39ec8c164 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:37.097093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7a838df0-bee6-4395-a16b-f2b39ec8c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:37.155730 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1412/2836] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:51:37 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:37.170384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd4fd7-0fc2-4008-af7a-8c1eb8d0deed service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:37.175204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-30bd4fd7-0fc2-4008-af7a-8c1eb8d0deed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:37.252293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd4fd7-0fc2-4008-af7a-8c1eb8d0deed service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:37.257657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89db0d-0e53-4aef-9543-2c0b1c4f4420 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:37.258355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89db0d-0e53-4aef-9543-2c0b1c4f4420 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:37.258645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89db0d-0e53-4aef-9543-2c0b1c4f4420 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:37.258922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89db0d-0e53-4aef-9543-2c0b1c4f4420 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:37.268249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89db0d-0e53-4aef-9543-2c0b1c4f4420 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:37.269860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89db0d-0e53-4aef-9543-2c0b1c4f4420 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:37.278660 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1425/2837] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:51:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:40.830063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a838df0-bee6-4395-a16b-f2b39ec8c164 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:40.831710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7a838df0-bee6-4395-a16b-f2b39ec8c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:40.898814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a838df0-bee6-4395-a16b-f2b39ec8c164 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:40.903377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:40.904234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:40.904520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:40.904798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] PATH_INFO: `/v3/users/1d46c71936aa4118aa36a9e95b95c4f5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:40.906040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d46c71936aa4118aa36a9e95b95c4f5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:40.908029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:40.952655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d46c71936aa4118aa36a9e95b95c4f5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:40.959715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d46c71936aa4118aa36a9e95b95c4f5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:40.960484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d46c71936aa4118aa36a9e95b95c4f5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:40.967211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d46c71936aa4118aa36a9e95b95c4f5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:40.978479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d46c71936aa4118aa36a9e95b95c4f5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:40.984384 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1413/2838] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:40 2021] DELETE /identity/v3/users/1d46c71936aa4118aa36a9e95b95c4f5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:41.153154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89db0d-0e53-4aef-9543-2c0b1c4f4420 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:41.165299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89db0d-0e53-4aef-9543-2c0b1c4f4420 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:41.229335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:41.230186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:41.230467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:41.230742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] PATH_INFO: `/v3/projects/149906b8a2744176929b4d314a0de57d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:41.231944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=149906b8a2744176929b4d314a0de57d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:41.233879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:41.283395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149906b8a2744176929b4d314a0de57d', 'request_id': 'req-260607ab-bf03-4fe4-bba9-97df832cb18c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:41.290051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149906b8a2744176929b4d314a0de57d', 'request_id': 'req-260607ab-bf03-4fe4-bba9-97df832cb18c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:41.299930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149906b8a2744176929b4d314a0de57d', 'request_id': 'req-260607ab-bf03-4fe4-bba9-97df832cb18c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:41.311047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] The token cache is being invalidate because project 149906b8a2744176929b4d314a0de57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:41.311366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:41.312014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:41.313831 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1426/2839] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:41 2021] DELETE /identity/v3/projects/149906b8a2744176929b4d314a0de57d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:41.317931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:41.319492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:41.333057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232360f-9f92-47cb-85b5-1fede956e24f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:41.405673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88052cd8-7807-46ae-aac3-c14821089eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:41.407122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052cd8-7807-46ae-aac3-c14821089eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:41.408564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052cd8-7807-46ae-aac3-c14821089eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:41.409096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052cd8-7807-46ae-aac3-c14821089eaa admin admin] PATH_INFO: `/v3/users/c88b989975ff48cf98de7e6f9ef6667c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:41.410780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88052cd8-7807-46ae-aac3-c14821089eaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88b989975ff48cf98de7e6f9ef6667c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:41.413260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88052cd8-7807-46ae-aac3-c14821089eaa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:41.485281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-88052cd8-7807-46ae-aac3-c14821089eaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88b989975ff48cf98de7e6f9ef6667c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:41.498580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-88052cd8-7807-46ae-aac3-c14821089eaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88b989975ff48cf98de7e6f9ef6667c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:41.500051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-88052cd8-7807-46ae-aac3-c14821089eaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88b989975ff48cf98de7e6f9ef6667c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:41.512448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-88052cd8-7807-46ae-aac3-c14821089eaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88b989975ff48cf98de7e6f9ef6667c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:41.530825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-88052cd8-7807-46ae-aac3-c14821089eaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88b989975ff48cf98de7e6f9ef6667c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:41.539550 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1414/2840] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:41 2021] DELETE /identity/v3/users/c88b989975ff48cf98de7e6f9ef6667c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:41.839280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:41.840949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:41.862111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260607ab-bf03-4fe4-bba9-97df832cb18c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:41.990624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:41.991540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:41.991817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:41.992257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] PATH_INFO: `/v3/projects/493adc593bae4219a753f10cd4ee463a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:41.994233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=493adc593bae4219a753f10cd4ee463a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:41.996230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:42.078475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493adc593bae4219a753f10cd4ee463a', 'request_id': 'req-585abe71-fb9c-4564-8249-01ddebc309ed'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:42.087704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493adc593bae4219a753f10cd4ee463a', 'request_id': 'req-585abe71-fb9c-4564-8249-01ddebc309ed'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:42.097032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493adc593bae4219a753f10cd4ee463a', 'request_id': 'req-585abe71-fb9c-4564-8249-01ddebc309ed'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:42.118375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] The token cache is being invalidate because project 493adc593bae4219a753f10cd4ee463a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:42.118729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:42.119505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-585abe71-fb9c-4564-8249-01ddebc309ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:42.131806 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1427/2841] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:41 2021] DELETE /identity/v3/projects/493adc593bae4219a753f10cd4ee463a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:42.134684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469d8b-7691-4b2f-9e72-987606efb9e0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.135380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469d8b-7691-4b2f-9e72-987606efb9e0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.135469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469d8b-7691-4b2f-9e72-987606efb9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.167679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f4469d8b-7691-4b2f-9e72-987606efb9e0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:42.168887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f4469d8b-7691-4b2f-9e72-987606efb9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:42.218807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466780-0b81-4540-a15a-55b8d1f98084 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.219768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466780-0b81-4540-a15a-55b8d1f98084 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.220237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35466780-0b81-4540-a15a-55b8d1f98084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.240428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-35466780-0b81-4540-a15a-55b8d1f98084 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:42.241378 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1415/2842] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:42.247957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-35466780-0b81-4540-a15a-55b8d1f98084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:42.249527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b94e-7658-463e-955c-a6a2a25e3b87 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.249811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b94e-7658-463e-955c-a6a2a25e3b87 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.250081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72b94e-7658-463e-955c-a6a2a25e3b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.271939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ba72b94e-7658-463e-955c-a6a2a25e3b87 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:42.273158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ba72b94e-7658-463e-955c-a6a2a25e3b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:42.281244 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1416/2843] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:51:42.285551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b94e-7658-463e-955c-a6a2a25e3b87 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:42.294194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72b94e-7658-463e-955c-a6a2a25e3b87 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:42.299203 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1428/2844] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:51:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:42.299372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e7cb-bf3b-49ff-8a7b-bdcb3e52bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:42.300132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e7cb-bf3b-49ff-8a7b-bdcb3e52bb19 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.300415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e7cb-bf3b-49ff-8a7b-bdcb3e52bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.300712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e7cb-bf3b-49ff-8a7b-bdcb3e52bb19 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.301443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e7cb-bf3b-49ff-8a7b-bdcb3e52bb19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:51:42.301745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e7cb-bf3b-49ff-8a7b-bdcb3e52bb19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:42.303348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e7cb-bf3b-49ff-8a7b-bdcb3e52bb19 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:42.312189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35466780-0b81-4540-a15a-55b8d1f98084 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:42.314206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-35466780-0b81-4540-a15a-55b8d1f98084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:42.316428 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1417/2845] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:51:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:51:42.320412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e7cb-bf3b-49ff-8a7b-bdcb3e52bb19 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:42.330396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e7cb-bf3b-49ff-8a7b-bdcb3e52bb19 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:42.334994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcb27f-83c1-424b-9209-86aa24f38bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:42.335683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcb27f-83c1-424b-9209-86aa24f38bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.335967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcb27f-83c1-424b-9209-86aa24f38bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.336242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcb27f-83c1-424b-9209-86aa24f38bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.336936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcb27f-83c1-424b-9209-86aa24f38bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:42.338802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcb27f-83c1-424b-9209-86aa24f38bf0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:42.365066 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1418/2846] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:42 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:42.369632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcb27f-83c1-424b-9209-86aa24f38bf0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:42.383883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35466780-0b81-4540-a15a-55b8d1f98084 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:42.432113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcb27f-83c1-424b-9209-86aa24f38bf0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:42.436988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4f2a8-6d4d-41fb-b236-84bd61ecccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:42.437680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4f2a8-6d4d-41fb-b236-84bd61ecccfd admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.437967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4f2a8-6d4d-41fb-b236-84bd61ecccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.438242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4f2a8-6d4d-41fb-b236-84bd61ecccfd admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.439563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4f2a8-6d4d-41fb-b236-84bd61ecccfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:42.441495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4f2a8-6d4d-41fb-b236-84bd61ecccfd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:42.445697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22175a63-9011-4a69-8fd4-20987658d107 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:42.446344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175a63-9011-4a69-8fd4-20987658d107 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.446627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175a63-9011-4a69-8fd4-20987658d107 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.446900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22175a63-9011-4a69-8fd4-20987658d107 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.464247 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1419/2847] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:42 2021] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:42.468155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4f2a8-6d4d-41fb-b236-84bd61ecccfd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:42.477507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4f2a8-6d4d-41fb-b236-84bd61ecccfd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:42.482204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7bdbb-0809-401b-877f-7045fa86eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:42.482839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7bdbb-0809-401b-877f-7045fa86eab6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.483158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7bdbb-0809-401b-877f-7045fa86eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.483521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7bdbb-0809-401b-877f-7045fa86eab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.484241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7bdbb-0809-401b-877f-7045fa86eab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:42.486600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7bdbb-0809-401b-877f-7045fa86eab6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:42.497568 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1420/2848] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:51:42.502011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7bdbb-0809-401b-877f-7045fa86eab6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:42.505659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22175a63-9011-4a69-8fd4-20987658d107 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:42.507310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22175a63-9011-4a69-8fd4-20987658d107 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:42.511142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7bdbb-0809-401b-877f-7045fa86eab6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:42.515354 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1429/2849] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:51:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:51:42.516053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270c95b-9b3f-42e2-9d0e-0ba8a9afbadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:42.516712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c95b-9b3f-42e2-9d0e-0ba8a9afbadb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.517207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c95b-9b3f-42e2-9d0e-0ba8a9afbadb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.517605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c95b-9b3f-42e2-9d0e-0ba8a9afbadb admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.518259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270c95b-9b3f-42e2-9d0e-0ba8a9afbadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:42.519960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270c95b-9b3f-42e2-9d0e-0ba8a9afbadb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:42.530529 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1421/2850] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:42 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:51:42.534713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22175a63-9011-4a69-8fd4-20987658d107 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:42.545529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22175a63-9011-4a69-8fd4-20987658d107 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:42.552580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfb91a-2f42-4569-af26-fe3dbb336caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:42.553550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfb91a-2f42-4569-af26-fe3dbb336caf admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.553912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfb91a-2f42-4569-af26-fe3dbb336caf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.554242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfb91a-2f42-4569-af26-fe3dbb336caf admin admin] PATH_INFO: `/v3/projects/81fd849e4df54e0183a5b96d27a65dfb/users/761eae018a724bd98183ecf2cfe00d7a/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.581482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfb91a-2f42-4569-af26-fe3dbb336caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fd849e4df54e0183a5b96d27a65dfb, user_id=761eae018a724bd98183ecf2cfe00d7a, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:42.584275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfb91a-2f42-4569-af26-fe3dbb336caf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:42.605054 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1430/2851] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:42 2021] PUT /identity/v3/projects/81fd849e4df54e0183a5b96d27a65dfb/users/761eae018a724bd98183ecf2cfe00d7a/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:42.615478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408047a6-0911-4ed0-8bd2-58c826d4ad9d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.615894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408047a6-0911-4ed0-8bd2-58c826d4ad9d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.616313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408047a6-0911-4ed0-8bd2-58c826d4ad9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.669701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-408047a6-0911-4ed0-8bd2-58c826d4ad9d None None] MFA Rules not processed for user `761eae018a724bd98183ecf2cfe00d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:42.673427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-408047a6-0911-4ed0-8bd2-58c826d4ad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:42.773650 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1422/2852] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:42 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:42.777995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfb91a-2f42-4569-af26-fe3dbb336caf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:42.861699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfb91a-2f42-4569-af26-fe3dbb336caf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:42.866687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20ac8e-cd63-48e0-b9db-d607ce9a478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:42.867527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20ac8e-cd63-48e0-b9db-d607ce9a478e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:42.868068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20ac8e-cd63-48e0-b9db-d607ce9a478e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:42.868342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20ac8e-cd63-48e0-b9db-d607ce9a478e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:42.869046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20ac8e-cd63-48e0-b9db-d607ce9a478e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:42.870963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20ac8e-cd63-48e0-b9db-d607ce9a478e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:42.924453 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1431/2853] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:42 2021] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:42.928560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408047a6-0911-4ed0-8bd2-58c826d4ad9d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:42.944428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408047a6-0911-4ed0-8bd2-58c826d4ad9d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:43.038689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907df9-e8eb-4ab9-aced-200ed4430a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:43.039538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907df9-e8eb-4ab9-aced-200ed4430a7c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:43.039981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907df9-e8eb-4ab9-aced-200ed4430a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:43.040332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907df9-e8eb-4ab9-aced-200ed4430a7c admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:43.041167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e907df9-e8eb-4ab9-aced-200ed4430a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:43.043653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e907df9-e8eb-4ab9-aced-200ed4430a7c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:43.086899 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1423/2854] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:42 2021] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:43.091227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20ac8e-cd63-48e0-b9db-d607ce9a478e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:43.104625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20ac8e-cd63-48e0-b9db-d607ce9a478e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:43.115853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d00258-1be5-4710-a798-ccf555628905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:43.116690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d00258-1be5-4710-a798-ccf555628905 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:43.116877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d00258-1be5-4710-a798-ccf555628905 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:43.117150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d00258-1be5-4710-a798-ccf555628905 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:43.118151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d00258-1be5-4710-a798-ccf555628905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:43.120880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d00258-1be5-4710-a798-ccf555628905 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:43.138192 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1432/2855] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:43 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:43.138426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907df9-e8eb-4ab9-aced-200ed4430a7c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:43.152621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907df9-e8eb-4ab9-aced-200ed4430a7c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:43.159837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc75e44-a7c5-4dab-b03e-4611ec8c0008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:43.160988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc75e44-a7c5-4dab-b03e-4611ec8c0008 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:43.161454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc75e44-a7c5-4dab-b03e-4611ec8c0008 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:43.161979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc75e44-a7c5-4dab-b03e-4611ec8c0008 admin admin] PATH_INFO: `/v3/projects/0b6c42ba6c324dd5b943f5384ab8d0c2/users/cdead8e70f9447c99d018f53bd9bc6ec/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:43.184790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc75e44-a7c5-4dab-b03e-4611ec8c0008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6c42ba6c324dd5b943f5384ab8d0c2, user_id=cdead8e70f9447c99d018f53bd9bc6ec, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:43.187778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc75e44-a7c5-4dab-b03e-4611ec8c0008 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:43.211627 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1424/2856] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:43 2021] PUT /identity/v3/projects/0b6c42ba6c324dd5b943f5384ab8d0c2/users/cdead8e70f9447c99d018f53bd9bc6ec/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:51:43.215789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d00258-1be5-4710-a798-ccf555628905 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:43.230556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d00258-1be5-4710-a798-ccf555628905 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:43.366902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd197de3-d601-4e7b-8b1b-1d14ba6e5bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:43.367699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd197de3-d601-4e7b-8b1b-1d14ba6e5bfb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:43.368854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd197de3-d601-4e7b-8b1b-1d14ba6e5bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:43.369313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd197de3-d601-4e7b-8b1b-1d14ba6e5bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:43.370208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd197de3-d601-4e7b-8b1b-1d14ba6e5bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:43.372019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd197de3-d601-4e7b-8b1b-1d14ba6e5bfb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:43.411101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc75e44-a7c5-4dab-b03e-4611ec8c0008 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:43.411555 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1433/2857] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:43 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:51:43.430002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc75e44-a7c5-4dab-b03e-4611ec8c0008 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:43.439498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9fa31-4a0a-4156-ad9e-65df1207a1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:43.445999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9fa31-4a0a-4156-ad9e-65df1207a1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:43.445999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9fa31-4a0a-4156-ad9e-65df1207a1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:43.445999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9fa31-4a0a-4156-ad9e-65df1207a1a4 admin admin] PATH_INFO: `/v3/projects/0b6c42ba6c324dd5b943f5384ab8d0c2/users/cdead8e70f9447c99d018f53bd9bc6ec/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:43.447057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9fa31-4a0a-4156-ad9e-65df1207a1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6c42ba6c324dd5b943f5384ab8d0c2, user_id=cdead8e70f9447c99d018f53bd9bc6ec, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:43.455505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9fa31-4a0a-4156-ad9e-65df1207a1a4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:43.477817 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1425/2858] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:43 2021] PUT /identity/v3/projects/0b6c42ba6c324dd5b943f5384ab8d0c2/users/cdead8e70f9447c99d018f53bd9bc6ec/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:51:43.488077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c7bc-71ad-44c8-8be8-9ee476d42118 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:43.488636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c7bc-71ad-44c8-8be8-9ee476d42118 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:43.489129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981c7bc-71ad-44c8-8be8-9ee476d42118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:43.548002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b981c7bc-71ad-44c8-8be8-9ee476d42118 None None] MFA Rules not processed for user `cdead8e70f9447c99d018f53bd9bc6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:43.552721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b981c7bc-71ad-44c8-8be8-9ee476d42118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:43.679542 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1434/2859] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:43 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:43.680890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9fa31-4a0a-4156-ad9e-65df1207a1a4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:43.696721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9fa31-4a0a-4156-ad9e-65df1207a1a4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:43.710628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903855-c5ad-4600-8213-968e93e3058b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:43.711662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903855-c5ad-4600-8213-968e93e3058b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:43.712011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903855-c5ad-4600-8213-968e93e3058b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:43.712393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903855-c5ad-4600-8213-968e93e3058b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:43.713283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27903855-c5ad-4600-8213-968e93e3058b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:51:43.713782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27903855-c5ad-4600-8213-968e93e3058b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:43.715531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27903855-c5ad-4600-8213-968e93e3058b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:43.746015 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1426/2860] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:51:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:43.747197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981c7bc-71ad-44c8-8be8-9ee476d42118 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:43.760132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981c7bc-71ad-44c8-8be8-9ee476d42118 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:43.771937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d58fff-9dd8-4690-adb5-c0f713c009d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:43.772600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d58fff-9dd8-4690-adb5-c0f713c009d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:43.772876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d58fff-9dd8-4690-adb5-c0f713c009d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:43.773147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d58fff-9dd8-4690-adb5-c0f713c009d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:43.773855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d58fff-9dd8-4690-adb5-c0f713c009d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:43.778208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d58fff-9dd8-4690-adb5-c0f713c009d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:43.818156 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1435/2861] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:43 2021] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:43.822279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903855-c5ad-4600-8213-968e93e3058b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:43.834147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903855-c5ad-4600-8213-968e93e3058b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:43.905713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e392d1c-6ee8-4704-a44e-a24312e819fa tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:43.906344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e392d1c-6ee8-4704-a44e-a24312e819fa tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:43.906637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e392d1c-6ee8-4704-a44e-a24312e819fa tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:43.907195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e392d1c-6ee8-4704-a44e-a24312e819fa tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:43.909196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e392d1c-6ee8-4704-a44e-a24312e819fa tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:51:43.909196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e392d1c-6ee8-4704-a44e-a24312e819fa tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:43.910779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e392d1c-6ee8-4704-a44e-a24312e819fa tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:43.936624 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1427/2862] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:51:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:44.247906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d58fff-9dd8-4690-adb5-c0f713c009d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:44.252148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-43d58fff-9dd8-4690-adb5-c0f713c009d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:44.384644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d58fff-9dd8-4690-adb5-c0f713c009d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:44.390819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035279d-ffeb-4b03-b67c-4c1175eff41c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:44.392474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035279d-ffeb-4b03-b67c-4c1175eff41c service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:44.393126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035279d-ffeb-4b03-b67c-4c1175eff41c service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:44.394020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035279d-ffeb-4b03-b67c-4c1175eff41c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:44.405226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035279d-ffeb-4b03-b67c-4c1175eff41c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:44.406966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035279d-ffeb-4b03-b67c-4c1175eff41c service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:44.429786 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1436/2863] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:44 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:44.435039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e00d5-1344-41dd-b60e-f67fa67e158d None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:44.435556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e00d5-1344-41dd-b60e-f67fa67e158d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:44.435815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e00d5-1344-41dd-b60e-f67fa67e158d None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:44.437719 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1428/2864] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:51:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:51:44.450559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035279d-ffeb-4b03-b67c-4c1175eff41c service nova] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:51:44.463702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035279d-ffeb-4b03-b67c-4c1175eff41c service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:44.474860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035279d-ffeb-4b03-b67c-4c1175eff41c service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:44.479775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649acbf-8d20-42a2-81b8-a36596fe835b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:44.481103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649acbf-8d20-42a2-81b8-a36596fe835b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:44.481549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649acbf-8d20-42a2-81b8-a36596fe835b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:44.482164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649acbf-8d20-42a2-81b8-a36596fe835b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/projects/ea942997af134af78b6019c8c3b907b6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:44.483762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649acbf-8d20-42a2-81b8-a36596fe835b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:get_project(project_id=ea942997af134af78b6019c8c3b907b6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:44.486067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649acbf-8d20-42a2-81b8-a36596fe835b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:44.491707 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1437/2865] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:51:44 2021] GET /identity/v3/projects/ea942997af134af78b6019c8c3b907b6 => generated 371 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:45.015468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38612e23-8f72-4ac0-85c3-01f4b4e3a251 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:45.015852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38612e23-8f72-4ac0-85c3-01f4b4e3a251 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:45.016289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38612e23-8f72-4ac0-85c3-01f4b4e3a251 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:45.018886 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1429/2866] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:51:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:51:45.024267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649acbf-8d20-42a2-81b8-a36596fe835b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:51:45.038170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649acbf-8d20-42a2-81b8-a36596fe835b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:45.047396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649acbf-8d20-42a2-81b8-a36596fe835b tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:45.052248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cee5b-1d22-4154-8f78-4a1b6c079e73 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:45.055301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cee5b-1d22-4154-8f78-4a1b6c079e73 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:45.055301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cee5b-1d22-4154-8f78-4a1b6c079e73 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:45.055301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cee5b-1d22-4154-8f78-4a1b6c079e73 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/projects/ea942997af134af78b6019c8c3b907b6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:45.055301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cee5b-1d22-4154-8f78-4a1b6c079e73 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:get_project(project_id=ea942997af134af78b6019c8c3b907b6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:45.056922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cee5b-1d22-4154-8f78-4a1b6c079e73 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:45.059016 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1438/2867] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:51:45 2021] GET /identity/v3/projects/ea942997af134af78b6019c8c3b907b6 => generated 371 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:45.105930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38612e23-8f72-4ac0-85c3-01f4b4e3a251 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:45.121471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38612e23-8f72-4ac0-85c3-01f4b4e3a251 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:45.126991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb98b63-3b24-486b-ae0b-fb4e49a38878 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:45.127809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb98b63-3b24-486b-ae0b-fb4e49a38878 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:45.128226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb98b63-3b24-486b-ae0b-fb4e49a38878 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:45.128591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb98b63-3b24-486b-ae0b-fb4e49a38878 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:45.129438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb98b63-3b24-486b-ae0b-fb4e49a38878 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:51:45.129873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb98b63-3b24-486b-ae0b-fb4e49a38878 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:45.132294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb98b63-3b24-486b-ae0b-fb4e49a38878 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:45.150760 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1430/2868] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:51:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:45.152115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cee5b-1d22-4154-8f78-4a1b6c079e73 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:45.163500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cee5b-1d22-4154-8f78-4a1b6c079e73 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:45.171329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9c50a-4da1-4bd8-a4d5-97c80f0ae9d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:45.172136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c50a-4da1-4bd8-a4d5-97c80f0ae9d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:45.172531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c50a-4da1-4bd8-a4d5-97c80f0ae9d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:45.172982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c50a-4da1-4bd8-a4d5-97c80f0ae9d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:45.173987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9c50a-4da1-4bd8-a4d5-97c80f0ae9d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:45.176055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9c50a-4da1-4bd8-a4d5-97c80f0ae9d8 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:45.211578 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1439/2869] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:45 2021] POST /identity/v3/users => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:45.216060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb98b63-3b24-486b-ae0b-fb4e49a38878 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:45.230262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb98b63-3b24-486b-ae0b-fb4e49a38878 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:45.241840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27411a41-21fa-4ea8-b0eb-93298b93cbe7 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:45.245820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27411a41-21fa-4ea8-b0eb-93298b93cbe7 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:45.247868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27411a41-21fa-4ea8-b0eb-93298b93cbe7 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:45.250198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27411a41-21fa-4ea8-b0eb-93298b93cbe7 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:45.251773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27411a41-21fa-4ea8-b0eb-93298b93cbe7 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:51:45.252199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27411a41-21fa-4ea8-b0eb-93298b93cbe7 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:45.254041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27411a41-21fa-4ea8-b0eb-93298b93cbe7 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:45.272092 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1431/2870] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:51:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:51:45.534549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453168ff-729c-47d2-a2c9-a50bf0c78fca None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:45.535044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453168ff-729c-47d2-a2c9-a50bf0c78fca None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:45.535167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453168ff-729c-47d2-a2c9-a50bf0c78fca None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:45.536961 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1440/2871] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:51:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:51:45.542248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27411a41-21fa-4ea8-b0eb-93298b93cbe7 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:51:45.556194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27411a41-21fa-4ea8-b0eb-93298b93cbe7 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:45.566091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27411a41-21fa-4ea8-b0eb-93298b93cbe7 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:45.571426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4c0dc-ae41-4184-bb17-bf4768505240 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:45.572281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4c0dc-ae41-4184-bb17-bf4768505240 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:45.572761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4c0dc-ae41-4184-bb17-bf4768505240 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:45.573048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4c0dc-ae41-4184-bb17-bf4768505240 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/projects/ea942997af134af78b6019c8c3b907b6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:45.574253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4c0dc-ae41-4184-bb17-bf4768505240 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:get_project(project_id=ea942997af134af78b6019c8c3b907b6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:45.576335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4c0dc-ae41-4184-bb17-bf4768505240 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:45.578020 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1432/2872] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:51:45 2021] GET /identity/v3/projects/ea942997af134af78b6019c8c3b907b6 => generated 371 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:45.777762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8135fe-9f5f-4e99-a913-77780aed8bd1 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:45.778044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8135fe-9f5f-4e99-a913-77780aed8bd1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:45.778318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8135fe-9f5f-4e99-a913-77780aed8bd1 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:45.780169 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1441/2873] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:51:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:51:45.786644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4c0dc-ae41-4184-bb17-bf4768505240 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:51:45.804979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4c0dc-ae41-4184-bb17-bf4768505240 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:45.821756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4c0dc-ae41-4184-bb17-bf4768505240 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:45.831046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af622d8-1023-4600-91a7-2ff2382d3f40 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:45.832550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af622d8-1023-4600-91a7-2ff2382d3f40 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:45.832775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af622d8-1023-4600-91a7-2ff2382d3f40 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:45.833154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af622d8-1023-4600-91a7-2ff2382d3f40 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/projects/ea942997af134af78b6019c8c3b907b6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:45.834706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af622d8-1023-4600-91a7-2ff2382d3f40 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:get_project(project_id=ea942997af134af78b6019c8c3b907b6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:45.837489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af622d8-1023-4600-91a7-2ff2382d3f40 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:45.842865 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1433/2874] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:51:45 2021] GET /identity/v3/projects/ea942997af134af78b6019c8c3b907b6 => generated 371 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:45.879471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8135fe-9f5f-4e99-a913-77780aed8bd1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:45.916001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8135fe-9f5f-4e99-a913-77780aed8bd1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:45.929476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:45.930985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:45.931303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:45.932003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/users/3d4e2b752cb642dfba189937748ef8eb` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:45.958317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3d4e2b752cb642dfba189937748ef8eb)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:45.960658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:46.042881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4e2b752cb642dfba189937748ef8eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.044024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4e2b752cb642dfba189937748ef8eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.059858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4e2b752cb642dfba189937748ef8eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.061060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4e2b752cb642dfba189937748ef8eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.074961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4e2b752cb642dfba189937748ef8eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.102052 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1442/2875] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:45 2021] DELETE /identity/v3/users/3d4e2b752cb642dfba189937748ef8eb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:46.103029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af622d8-1023-4600-91a7-2ff2382d3f40 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:46.107012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7af622d8-1023-4600-91a7-2ff2382d3f40 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:46.125432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af622d8-1023-4600-91a7-2ff2382d3f40 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:46.230460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdead8e70f9447c99d018f53bd9bc6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:46.231491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:46.231786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:46.233039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] PATH_INFO: `/v3/projects/ea942997af134af78b6019c8c3b907b6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:46.234565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ea942997af134af78b6019c8c3b907b6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:46.236698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:46.356677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea942997af134af78b6019c8c3b907b6', 'request_id': 'req-36819eaa-f944-42e8-86cb-d6f626d0b0ac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.370081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea942997af134af78b6019c8c3b907b6', 'request_id': 'req-36819eaa-f944-42e8-86cb-d6f626d0b0ac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.380630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea942997af134af78b6019c8c3b907b6', 'request_id': 'req-36819eaa-f944-42e8-86cb-d6f626d0b0ac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.393190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] The token cache is being invalidate because project ea942997af134af78b6019c8c3b907b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:46.393637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.394316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-36819eaa-f944-42e8-86cb-d6f626d0b0ac tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.395886 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1434/2876] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:46 2021] DELETE /identity/v3/projects/ea942997af134af78b6019c8c3b907b6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:46.401613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:46.403017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:46.499706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca677216-802c-45ff-b36b-092e71f28933 tempest-QuotasAdminTestV257-1762258634 tempest-QuotasAdminTestV257-1762258634-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:46.565454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:46.567078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:46.567571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:46.567848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] PATH_INFO: `/v3/users/761eae018a724bd98183ecf2cfe00d7a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:46.569079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] RBAC: Authorizing `identity:delete_user(user_id=761eae018a724bd98183ecf2cfe00d7a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:46.570991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:46.634854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761eae018a724bd98183ecf2cfe00d7a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.637555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761eae018a724bd98183ecf2cfe00d7a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.648174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761eae018a724bd98183ecf2cfe00d7a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.649137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761eae018a724bd98183ecf2cfe00d7a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.657427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761eae018a724bd98183ecf2cfe00d7a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:46.677903 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1443/2877] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:46 2021] DELETE /identity/v3/users/761eae018a724bd98183ecf2cfe00d7a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:46.685343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9f715-e97c-40b8-998d-cfe809e60537 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:46.685343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9f715-e97c-40b8-998d-cfe809e60537 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:46.685343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9f715-e97c-40b8-998d-cfe809e60537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:46.710221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5ea9f715-e97c-40b8-998d-cfe809e60537 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:46.710221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5ea9f715-e97c-40b8-998d-cfe809e60537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:46.794685 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1435/2878] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:46.807219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:46.808669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:46.907846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05312be-1a71-4c6f-ac45-31311b2a792e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:46.915980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8a07d-08ac-4551-a0b7-88e9712e4236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:46.916625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8a07d-08ac-4551-a0b7-88e9712e4236 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:46.916907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8a07d-08ac-4551-a0b7-88e9712e4236 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:46.917180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8a07d-08ac-4551-a0b7-88e9712e4236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:46.927376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8a07d-08ac-4551-a0b7-88e9712e4236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:46.928829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8a07d-08ac-4551-a0b7-88e9712e4236 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:46.947530 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1444/2879] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:47.305897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9f715-e97c-40b8-998d-cfe809e60537 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:47.307907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5ea9f715-e97c-40b8-998d-cfe809e60537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:47.324497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9f715-e97c-40b8-998d-cfe809e60537 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:47.329648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:47.330149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:47.330435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:47.330710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] PATH_INFO: `/v3/projects/81fd849e4df54e0183a5b96d27a65dfb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:47.334212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=81fd849e4df54e0183a5b96d27a65dfb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:47.336741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:47.428965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fd849e4df54e0183a5b96d27a65dfb', 'request_id': 'req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:47.455210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fd849e4df54e0183a5b96d27a65dfb', 'request_id': 'req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:47.468215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fd849e4df54e0183a5b96d27a65dfb', 'request_id': 'req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:47.496436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] The token cache is being invalidate because project 81fd849e4df54e0183a5b96d27a65dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:47.496812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:47.497941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:47.499966 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1436/2880] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:47 2021] DELETE /identity/v3/projects/81fd849e4df54e0183a5b96d27a65dfb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:47.504209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8a07d-08ac-4551-a0b7-88e9712e4236 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:47.516957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8a07d-08ac-4551-a0b7-88e9712e4236 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:47.591412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:47.592377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:47.592885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:47.593335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] PATH_INFO: `/v3/users/cdead8e70f9447c99d018f53bd9bc6ec` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:47.597790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdead8e70f9447c99d018f53bd9bc6ec)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:47.599978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:47.659991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdead8e70f9447c99d018f53bd9bc6ec'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:47.660725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdead8e70f9447c99d018f53bd9bc6ec'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:47.670838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdead8e70f9447c99d018f53bd9bc6ec'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:47.671880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdead8e70f9447c99d018f53bd9bc6ec'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:47.681186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdead8e70f9447c99d018f53bd9bc6ec'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:47.703291 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1445/2881] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:47 2021] DELETE /identity/v3/users/cdead8e70f9447c99d018f53bd9bc6ec => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:48.085340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:48.087055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:48.214514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf625a7-56f1-4ef8-8686-b3722dfd1c0a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:48.312044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49848fdf-7616-4d4c-94ed-640678428552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:48.312981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49848fdf-7616-4d4c-94ed-640678428552 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:48.313845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49848fdf-7616-4d4c-94ed-640678428552 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:48.314270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49848fdf-7616-4d4c-94ed-640678428552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:48.318716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-49848fdf-7616-4d4c-94ed-640678428552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:48.332443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:48.334316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:48.472313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49848fdf-7616-4d4c-94ed-640678428552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:48.476507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49848fdf-7616-4d4c-94ed-640678428552 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:48.479607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0209e-d101-4ef7-a02f-2b1a12be6087 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:48.491994 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1437/2882] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:48 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:48.495912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:48.497221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:48.497935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:48.497935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] PATH_INFO: `/v3/projects/0b6c42ba6c324dd5b943f5384ab8d0c2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:48.499618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6c42ba6c324dd5b943f5384ab8d0c2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:48.501669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:48.579967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'request_id': 'req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:48.595208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'request_id': 'req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:48.612479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6c42ba6c324dd5b943f5384ab8d0c2', 'request_id': 'req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:48.640998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] The token cache is being invalidate because project 0b6c42ba6c324dd5b943f5384ab8d0c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:48.641875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:48.642782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-327bb67b-f85a-4c0e-b86f-4eae2d32dcc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:48.646738 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1446/2883] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:48 2021] DELETE /identity/v3/projects/0b6c42ba6c324dd5b943f5384ab8d0c2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:51:48.654711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eff90-17b0-4998-90ef-ad1bd414a200 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:48.654920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eff90-17b0-4998-90ef-ad1bd414a200 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:48.655209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eff90-17b0-4998-90ef-ad1bd414a200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:48.702401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4a8eff90-17b0-4998-90ef-ad1bd414a200 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:48.703984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4a8eff90-17b0-4998-90ef-ad1bd414a200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:48.860841 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1438/2884] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:51:48.861796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86306e-c5b7-4850-ab6a-ff541fd459f6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:48.862179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86306e-c5b7-4850-ab6a-ff541fd459f6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:48.862554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86306e-c5b7-4850-ab6a-ff541fd459f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:48.901999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-da86306e-c5b7-4850-ab6a-ff541fd459f6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:48.904224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-da86306e-c5b7-4850-ab6a-ff541fd459f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:48.931401 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1447/2885] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:51:48.936741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eff90-17b0-4998-90ef-ad1bd414a200 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:48.990220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eff90-17b0-4998-90ef-ad1bd414a200 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:49.011737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab657d-7de0-4616-8ab6-6e153533a5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:49.014574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab657d-7de0-4616-8ab6-6e153533a5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:49.015042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab657d-7de0-4616-8ab6-6e153533a5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:49.016356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab657d-7de0-4616-8ab6-6e153533a5b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:49.017170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab657d-7de0-4616-8ab6-6e153533a5b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:51:49.028405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab657d-7de0-4616-8ab6-6e153533a5b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:49.033459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab657d-7de0-4616-8ab6-6e153533a5b7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:49.078396 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1439/2886] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:51:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:49.082623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86306e-c5b7-4850-ab6a-ff541fd459f6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:49.093998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86306e-c5b7-4850-ab6a-ff541fd459f6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:49.111083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf1920-edc8-4542-b2c3-324480549bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:49.111794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf1920-edc8-4542-b2c3-324480549bdb admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:49.114048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf1920-edc8-4542-b2c3-324480549bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:49.114048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf1920-edc8-4542-b2c3-324480549bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:49.114048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf1920-edc8-4542-b2c3-324480549bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:49.114958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf1920-edc8-4542-b2c3-324480549bdb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:49.180648 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1448/2887] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:49 2021] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:49.184305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab657d-7de0-4616-8ab6-6e153533a5b7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:49.196054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab657d-7de0-4616-8ab6-6e153533a5b7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:49.283313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09507704-cb3d-40c0-813d-f91e2caa6973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:49.290997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09507704-cb3d-40c0-813d-f91e2caa6973 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:49.291540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09507704-cb3d-40c0-813d-f91e2caa6973 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:49.292042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09507704-cb3d-40c0-813d-f91e2caa6973 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:49.293354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09507704-cb3d-40c0-813d-f91e2caa6973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:49.295737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09507704-cb3d-40c0-813d-f91e2caa6973 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:49.361984 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1440/2888] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:49 2021] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:49.366139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf1920-edc8-4542-b2c3-324480549bdb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:49.386384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf1920-edc8-4542-b2c3-324480549bdb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:49.401741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d518b-5791-42f2-b84b-b68f9764f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:49.402445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d518b-5791-42f2-b84b-b68f9764f1cb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:49.402718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d518b-5791-42f2-b84b-b68f9764f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:49.402998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d518b-5791-42f2-b84b-b68f9764f1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:49.403782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d518b-5791-42f2-b84b-b68f9764f1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:49.408888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d518b-5791-42f2-b84b-b68f9764f1cb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:49.445194 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1449/2889] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:49 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:49.446468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09507704-cb3d-40c0-813d-f91e2caa6973 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:49.465510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09507704-cb3d-40c0-813d-f91e2caa6973 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:49.504810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b68ec6-8df0-4ae1-aa46-d578fa813c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:49.505682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68ec6-8df0-4ae1-aa46-d578fa813c7b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:49.506078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68ec6-8df0-4ae1-aa46-d578fa813c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:49.506450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68ec6-8df0-4ae1-aa46-d578fa813c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:49.507362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b68ec6-8df0-4ae1-aa46-d578fa813c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:49.509192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b68ec6-8df0-4ae1-aa46-d578fa813c7b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:49.524813 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1441/2890] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:49 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:49.529014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d518b-5791-42f2-b84b-b68f9764f1cb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:49.540829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d518b-5791-42f2-b84b-b68f9764f1cb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:49.548287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96ab08-f0ac-4c03-88c0-5a99cddb9a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:49.549182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ab08-f0ac-4c03-88c0-5a99cddb9a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:49.549946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ab08-f0ac-4c03-88c0-5a99cddb9a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:49.550318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96ab08-f0ac-4c03-88c0-5a99cddb9a61 admin admin] PATH_INFO: `/v3/projects/e4aa31d233c54e67aee9939f89d9b8ed/users/d9ace11ab09c4185a7a7385a6e111313/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:49.567392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96ab08-f0ac-4c03-88c0-5a99cddb9a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4aa31d233c54e67aee9939f89d9b8ed, user_id=d9ace11ab09c4185a7a7385a6e111313, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:49.570167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96ab08-f0ac-4c03-88c0-5a99cddb9a61 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:49.586282 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1450/2891] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:49 2021] PUT /identity/v3/projects/e4aa31d233c54e67aee9939f89d9b8ed/users/d9ace11ab09c4185a7a7385a6e111313/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:49.601724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7eb4d-ee91-44aa-8f02-b03bbb70927a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:49.602011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7eb4d-ee91-44aa-8f02-b03bbb70927a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:49.602285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7eb4d-ee91-44aa-8f02-b03bbb70927a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:49.640378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2db7eb4d-ee91-44aa-8f02-b03bbb70927a None None] MFA Rules not processed for user `d9ace11ab09c4185a7a7385a6e111313`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:49.641905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2db7eb4d-ee91-44aa-8f02-b03bbb70927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:49.713904 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1442/2892] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:49 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:49.718199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96ab08-f0ac-4c03-88c0-5a99cddb9a61 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:49.787795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96ab08-f0ac-4c03-88c0-5a99cddb9a61 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:49.792944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcad2c-eff0-4dbe-8e56-9cfb15057064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:49.793796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcad2c-eff0-4dbe-8e56-9cfb15057064 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:49.794181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcad2c-eff0-4dbe-8e56-9cfb15057064 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:49.794554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcad2c-eff0-4dbe-8e56-9cfb15057064 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:49.795443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcad2c-eff0-4dbe-8e56-9cfb15057064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:49.797516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcad2c-eff0-4dbe-8e56-9cfb15057064 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:49.829339 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1451/2893] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:49 2021] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:49.832448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7eb4d-ee91-44aa-8f02-b03bbb70927a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:49.846275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7eb4d-ee91-44aa-8f02-b03bbb70927a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:49.909760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a27e-6aba-48fc-b2a5-8c70142e29b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:49.910470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a27e-6aba-48fc-b2a5-8c70142e29b6 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:49.910847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a27e-6aba-48fc-b2a5-8c70142e29b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:49.911190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164a27e-6aba-48fc-b2a5-8c70142e29b6 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:49.911927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164a27e-6aba-48fc-b2a5-8c70142e29b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:49.913854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164a27e-6aba-48fc-b2a5-8c70142e29b6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:49.939881 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1443/2894] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:49 2021] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:49.944341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcad2c-eff0-4dbe-8e56-9cfb15057064 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:49.963234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcad2c-eff0-4dbe-8e56-9cfb15057064 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:49.968938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff46da5-11b2-4e60-ad71-7583aca3dd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:49.969681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff46da5-11b2-4e60-ad71-7583aca3dd1d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:49.970505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff46da5-11b2-4e60-ad71-7583aca3dd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:49.991871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff46da5-11b2-4e60-ad71-7583aca3dd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:49.991871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff46da5-11b2-4e60-ad71-7583aca3dd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:49.991871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff46da5-11b2-4e60-ad71-7583aca3dd1d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:49.991871 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1452/2895] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:49 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:49.992508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a27e-6aba-48fc-b2a5-8c70142e29b6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:50.000114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164a27e-6aba-48fc-b2a5-8c70142e29b6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:50.004723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54073751-8b50-4aa9-8c0a-e93a1801d23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:50.005798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54073751-8b50-4aa9-8c0a-e93a1801d23e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:50.006200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54073751-8b50-4aa9-8c0a-e93a1801d23e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:50.006771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54073751-8b50-4aa9-8c0a-e93a1801d23e admin admin] PATH_INFO: `/v3/projects/86d4fae5b1a047ac9a3143b0266a165d/users/c1ca9870d1124f4b8d60ee2cc820648a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:50.022121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54073751-8b50-4aa9-8c0a-e93a1801d23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d4fae5b1a047ac9a3143b0266a165d, user_id=c1ca9870d1124f4b8d60ee2cc820648a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:50.024761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54073751-8b50-4aa9-8c0a-e93a1801d23e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:50.039501 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1444/2896] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:49 2021] PUT /identity/v3/projects/86d4fae5b1a047ac9a3143b0266a165d/users/c1ca9870d1124f4b8d60ee2cc820648a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:50.043500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff46da5-11b2-4e60-ad71-7583aca3dd1d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:50.076022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff46da5-11b2-4e60-ad71-7583aca3dd1d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:50.170311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ee60e-555e-4179-a2b8-cc33b4e2304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:50.170995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ee60e-555e-4179-a2b8-cc33b4e2304e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:50.171310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ee60e-555e-4179-a2b8-cc33b4e2304e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:50.171613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ee60e-555e-4179-a2b8-cc33b4e2304e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:50.173910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ee60e-555e-4179-a2b8-cc33b4e2304e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:50.174039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ee60e-555e-4179-a2b8-cc33b4e2304e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:50.190729 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1453/2897] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:50 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:50.196918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54073751-8b50-4aa9-8c0a-e93a1801d23e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:50.210239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54073751-8b50-4aa9-8c0a-e93a1801d23e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:50.235980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628777d8-6669-4887-b395-26f74ae33237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:50.236988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628777d8-6669-4887-b395-26f74ae33237 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:50.237368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628777d8-6669-4887-b395-26f74ae33237 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:50.237740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628777d8-6669-4887-b395-26f74ae33237 admin admin] PATH_INFO: `/v3/projects/86d4fae5b1a047ac9a3143b0266a165d/users/c1ca9870d1124f4b8d60ee2cc820648a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:50.242397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628777d8-6669-4887-b395-26f74ae33237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d4fae5b1a047ac9a3143b0266a165d, user_id=c1ca9870d1124f4b8d60ee2cc820648a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:50.245959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628777d8-6669-4887-b395-26f74ae33237 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:50.280620 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1445/2898] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:50 2021] PUT /identity/v3/projects/86d4fae5b1a047ac9a3143b0266a165d/users/c1ca9870d1124f4b8d60ee2cc820648a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:50.284094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50670acd-efd9-4832-aa4a-b6400038b86d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:50.284702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50670acd-efd9-4832-aa4a-b6400038b86d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:50.285206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50670acd-efd9-4832-aa4a-b6400038b86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:50.321183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-50670acd-efd9-4832-aa4a-b6400038b86d None None] MFA Rules not processed for user `c1ca9870d1124f4b8d60ee2cc820648a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:50.322445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-50670acd-efd9-4832-aa4a-b6400038b86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:50.427014 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1454/2899] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:50 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:51:50.511462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628777d8-6669-4887-b395-26f74ae33237 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:50.513845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-628777d8-6669-4887-b395-26f74ae33237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:50.606381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628777d8-6669-4887-b395-26f74ae33237 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:50.612440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214e652-cf19-4e2f-9310-469eeea35c99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:50.613365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e652-cf19-4e2f-9310-469eeea35c99 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:50.613871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e652-cf19-4e2f-9310-469eeea35c99 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:50.614240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e652-cf19-4e2f-9310-469eeea35c99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:50.633178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214e652-cf19-4e2f-9310-469eeea35c99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:50.635387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214e652-cf19-4e2f-9310-469eeea35c99 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:50.648892 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1446/2900] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:50 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:51.019497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50670acd-efd9-4832-aa4a-b6400038b86d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:51.034378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50670acd-efd9-4832-aa4a-b6400038b86d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:51.043858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a087f4e-bf35-4729-95e9-ef9e86881584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:51.044505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087f4e-bf35-4729-95e9-ef9e86881584 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:51.044801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087f4e-bf35-4729-95e9-ef9e86881584 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:51.045064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a087f4e-bf35-4729-95e9-ef9e86881584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:51.124032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a087f4e-bf35-4729-95e9-ef9e86881584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:51.125967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a087f4e-bf35-4729-95e9-ef9e86881584 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:51.137944 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1455/2901] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:51 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:51:51.155614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214e652-cf19-4e2f-9310-469eeea35c99 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:51.229703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214e652-cf19-4e2f-9310-469eeea35c99 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:51.239304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:51.240440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:51.240891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:51.241349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] PATH_INFO: `/v3/users/d9ace11ab09c4185a7a7385a6e111313` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:51.242772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ace11ab09c4185a7a7385a6e111313)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:51.245174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:51.338645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ace11ab09c4185a7a7385a6e111313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:51.354709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ace11ab09c4185a7a7385a6e111313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:51.355879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ace11ab09c4185a7a7385a6e111313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:51.371860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ace11ab09c4185a7a7385a6e111313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:51.384559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ace11ab09c4185a7a7385a6e111313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:51.391678 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1447/2902] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:51 2021] DELETE /identity/v3/users/d9ace11ab09c4185a7a7385a6e111313 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:51.395933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecf960-7db9-4505-98a8-2c7628f5d828 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:51.396507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecf960-7db9-4505-98a8-2c7628f5d828 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:51.397016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecf960-7db9-4505-98a8-2c7628f5d828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:51.418450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-51ecf960-7db9-4505-98a8-2c7628f5d828 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:51.420587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-51ecf960-7db9-4505-98a8-2c7628f5d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:51.522965 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1456/2903] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:51:51.533280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:51.534739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:51.609956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406ac91-70ad-49c2-ad5c-3a4c4350dfe3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:51.617121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf646af-8d00-45cd-9013-202aa969b697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:51.617786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf646af-8d00-45cd-9013-202aa969b697 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:51.618468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf646af-8d00-45cd-9013-202aa969b697 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:51.618750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf646af-8d00-45cd-9013-202aa969b697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:51.631757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf646af-8d00-45cd-9013-202aa969b697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:51.634005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf646af-8d00-45cd-9013-202aa969b697 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:51.661496 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1448/2904] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:52.330241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecf960-7db9-4505-98a8-2c7628f5d828 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:52.333431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-51ecf960-7db9-4505-98a8-2c7628f5d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:52.351204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecf960-7db9-4505-98a8-2c7628f5d828 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:52.370123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:52.372280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:52.372839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:52.373349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] PATH_INFO: `/v3/projects/e4aa31d233c54e67aee9939f89d9b8ed` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:52.375150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4aa31d233c54e67aee9939f89d9b8ed)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:52.379123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:52.475584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4aa31d233c54e67aee9939f89d9b8ed', 'request_id': 'req-4e470d92-debf-4e15-af61-ac0c742cdc30'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:52.483243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4aa31d233c54e67aee9939f89d9b8ed', 'request_id': 'req-4e470d92-debf-4e15-af61-ac0c742cdc30'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:52.494059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4aa31d233c54e67aee9939f89d9b8ed', 'request_id': 'req-4e470d92-debf-4e15-af61-ac0c742cdc30'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:52.529942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] The token cache is being invalidate because project e4aa31d233c54e67aee9939f89d9b8ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:52.530247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:52.531536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:52.534357 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1457/2905] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:52 2021] DELETE /identity/v3/projects/e4aa31d233c54e67aee9939f89d9b8ed => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:52.538036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf646af-8d00-45cd-9013-202aa969b697 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:52.551484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf646af-8d00-45cd-9013-202aa969b697 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:52.678491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c187858-f41f-4d6e-9f4c-8b42921f0960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:52.680528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c187858-f41f-4d6e-9f4c-8b42921f0960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:52.680808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c187858-f41f-4d6e-9f4c-8b42921f0960 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:52.681087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c187858-f41f-4d6e-9f4c-8b42921f0960 admin admin] PATH_INFO: `/v3/users/c1ca9870d1124f4b8d60ee2cc820648a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:52.691013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c187858-f41f-4d6e-9f4c-8b42921f0960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ca9870d1124f4b8d60ee2cc820648a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:52.696461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c187858-f41f-4d6e-9f4c-8b42921f0960 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:52.775024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8c187858-f41f-4d6e-9f4c-8b42921f0960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ca9870d1124f4b8d60ee2cc820648a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:52.792771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8c187858-f41f-4d6e-9f4c-8b42921f0960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ca9870d1124f4b8d60ee2cc820648a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:52.795362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8c187858-f41f-4d6e-9f4c-8b42921f0960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ca9870d1124f4b8d60ee2cc820648a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:52.815947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8c187858-f41f-4d6e-9f4c-8b42921f0960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ca9870d1124f4b8d60ee2cc820648a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:52.834910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8c187858-f41f-4d6e-9f4c-8b42921f0960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ca9870d1124f4b8d60ee2cc820648a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:52.843408 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1449/2906] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:52 2021] DELETE /identity/v3/users/c1ca9870d1124f4b8d60ee2cc820648a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:53.173805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:53.175245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:53.199379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e470d92-debf-4e15-af61-ac0c742cdc30 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:53.331741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:53.332618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:53.332880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:53.333178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] PATH_INFO: `/v3/users/e39495438d7c40a780a68e2cf38d6ba2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:53.335106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39495438d7c40a780a68e2cf38d6ba2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:53.337552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:53.394512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5275dd-6a52-4355-828d-45acaf159879 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:53.394899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5275dd-6a52-4355-828d-45acaf159879 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:53.395354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5275dd-6a52-4355-828d-45acaf159879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:53.425785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39495438d7c40a780a68e2cf38d6ba2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:53.426735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39495438d7c40a780a68e2cf38d6ba2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:53.435785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4d5275dd-6a52-4355-828d-45acaf159879 None None] MFA Rules not processed for user `4561f04227544d2ca76bce3dc5618c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:53.437231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4d5275dd-6a52-4355-828d-45acaf159879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:53.444499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39495438d7c40a780a68e2cf38d6ba2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:53.447239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39495438d7c40a780a68e2cf38d6ba2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:53.465633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39495438d7c40a780a68e2cf38d6ba2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:53.530088 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1458/2907] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:53 2021] DELETE /identity/v3/users/e39495438d7c40a780a68e2cf38d6ba2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:53.532755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:53.536238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:53.596640 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1450/2908] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:53 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:53.599501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e603e-d3b3-49d8-a8b8-8226fb121da7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:53.600499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e603e-d3b3-49d8-a8b8-8226fb121da7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:53.601024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e603e-d3b3-49d8-a8b8-8226fb121da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:53.634329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-777e603e-d3b3-49d8-a8b8-8226fb121da7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:53.636030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-777e603e-d3b3-49d8-a8b8-8226fb121da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:53.654437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c54759-2ae7-4d5a-b223-c20fa90dc2f2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:53.663791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:53.665722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:53.666175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:53.666903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] PATH_INFO: `/v3/projects/86d4fae5b1a047ac9a3143b0266a165d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:53.668837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d4fae5b1a047ac9a3143b0266a165d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:53.671179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:53.761490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d4fae5b1a047ac9a3143b0266a165d', 'request_id': 'req-b4ecb73d-5a54-4773-9e2d-600265f3e840'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:53.775688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d4fae5b1a047ac9a3143b0266a165d', 'request_id': 'req-b4ecb73d-5a54-4773-9e2d-600265f3e840'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:53.783147 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1451/2909] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:53.796497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e603e-d3b3-49d8-a8b8-8226fb121da7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:53.797090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d4fae5b1a047ac9a3143b0266a165d', 'request_id': 'req-b4ecb73d-5a54-4773-9e2d-600265f3e840'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:53.800078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-777e603e-d3b3-49d8-a8b8-8226fb121da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:53.833655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] The token cache is being invalidate because project 86d4fae5b1a047ac9a3143b0266a165d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:53.833939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:53.836326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b4ecb73d-5a54-4773-9e2d-600265f3e840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:53.843377 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1459/2910] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:53 2021] DELETE /identity/v3/projects/86d4fae5b1a047ac9a3143b0266a165d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:53.852667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cca7-27b8-4296-b85e-3629a7d700d3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:53.854940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cca7-27b8-4296-b85e-3629a7d700d3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:53.855425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cca7-27b8-4296-b85e-3629a7d700d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:53.900478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-93f6cca7-27b8-4296-b85e-3629a7d700d3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:53.902463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-93f6cca7-27b8-4296-b85e-3629a7d700d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:53.906795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e603e-d3b3-49d8-a8b8-8226fb121da7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:53.990994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf71c7f-c58e-4ac9-8a20-5f5c7ad371b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:53.992798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf71c7f-c58e-4ac9-8a20-5f5c7ad371b4 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:53.993343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf71c7f-c58e-4ac9-8a20-5f5c7ad371b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:53.993619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf71c7f-c58e-4ac9-8a20-5f5c7ad371b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:53.998579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bdf71c7f-c58e-4ac9-8a20-5f5c7ad371b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:54.005166 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1460/2911] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:54.014284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8351-d5d0-4ead-916a-2c1c9394f5d1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:54.014595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8351-d5d0-4ead-916a-2c1c9394f5d1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:54.014846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8351-d5d0-4ead-916a-2c1c9394f5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:54.022888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf71c7f-c58e-4ac9-8a20-5f5c7ad371b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:54.024349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf71c7f-c58e-4ac9-8a20-5f5c7ad371b4 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:54.045417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9abf8351-d5d0-4ead-916a-2c1c9394f5d1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:54.046081 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1452/2912] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:54.046841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9abf8351-d5d0-4ead-916a-2c1c9394f5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:54.059801 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1461/2913] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:54.061006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf71c7f-c58e-4ac9-8a20-5f5c7ad371b4 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:54.079894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf71c7f-c58e-4ac9-8a20-5f5c7ad371b4 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:54.086517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393b1e-f073-4101-bf55-5a11033ed1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:54.087699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393b1e-f073-4101-bf55-5a11033ed1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:54.088113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393b1e-f073-4101-bf55-5a11033ed1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:54.089498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a393b1e-f073-4101-bf55-5a11033ed1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:54.089624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a393b1e-f073-4101-bf55-5a11033ed1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:51:54.089927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a393b1e-f073-4101-bf55-5a11033ed1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:54.092075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a393b1e-f073-4101-bf55-5a11033ed1a2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:54.118348 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1453/2914] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:51:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:54.119720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf8351-d5d0-4ead-916a-2c1c9394f5d1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:54.133799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf8351-d5d0-4ead-916a-2c1c9394f5d1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:54.140018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3ac1d-1f98-4554-ad70-3d7e1215fb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:54.140018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3ac1d-1f98-4554-ad70-3d7e1215fb9f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:54.140299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3ac1d-1f98-4554-ad70-3d7e1215fb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:54.140565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3ac1d-1f98-4554-ad70-3d7e1215fb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:54.141310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3ac1d-1f98-4554-ad70-3d7e1215fb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:54.143953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3ac1d-1f98-4554-ad70-3d7e1215fb9f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:54.183938 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1462/2915] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:54 2021] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:54.187819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393b1e-f073-4101-bf55-5a11033ed1a2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:54.201337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a393b1e-f073-4101-bf55-5a11033ed1a2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:54.350943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3ac1d-1f98-4554-ad70-3d7e1215fb9f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:54.353480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bba63-4798-4c74-b14d-3c0fba3d5039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:54.354231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bba63-4798-4c74-b14d-3c0fba3d5039 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:54.354517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bba63-4798-4c74-b14d-3c0fba3d5039 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:54.354794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bba63-4798-4c74-b14d-3c0fba3d5039 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:54.355178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-85e3ac1d-1f98-4554-ad70-3d7e1215fb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:54.355552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bba63-4798-4c74-b14d-3c0fba3d5039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:54.357630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bba63-4798-4c74-b14d-3c0fba3d5039 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:54.407808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3ac1d-1f98-4554-ad70-3d7e1215fb9f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:54.417452 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1454/2916] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:54 2021] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:51:54.420522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bba63-4798-4c74-b14d-3c0fba3d5039 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:54.425548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:54.435846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:54.436133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:54.441811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] PATH_INFO: `/v3/projects/7096bfbf5c8e42f09551e4c84ea8de02` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:54.446752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7096bfbf5c8e42f09551e4c84ea8de02)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:54.462066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:54.492769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bba63-4798-4c74-b14d-3c0fba3d5039 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:54.505289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd68d6-8ab2-42fd-8343-394ba774a66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:54.506124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd68d6-8ab2-42fd-8343-394ba774a66f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:54.507068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd68d6-8ab2-42fd-8343-394ba774a66f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:54.507483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd68d6-8ab2-42fd-8343-394ba774a66f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:54.508336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd68d6-8ab2-42fd-8343-394ba774a66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:54.510011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd68d6-8ab2-42fd-8343-394ba774a66f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:54.524923 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1455/2917] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:54 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:54.525927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd68d6-8ab2-42fd-8343-394ba774a66f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:54.529077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-04bd68d6-8ab2-42fd-8343-394ba774a66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:54.546822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd68d6-8ab2-42fd-8343-394ba774a66f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:54.553408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:54.554531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:54.554901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:54.555145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] PATH_INFO: `/v3/users/3cb6bc63929648388ac9648823d4ca88` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:54.556678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb6bc63929648388ac9648823d4ca88)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:54.558755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:54.614641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb6bc63929648388ac9648823d4ca88'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:54.620090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7096bfbf5c8e42f09551e4c84ea8de02', 'request_id': 'req-d6ee7908-4895-4a64-80f1-c0c461d19f31'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:54.629722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb6bc63929648388ac9648823d4ca88'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:54.630488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb6bc63929648388ac9648823d4ca88'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:54.633439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7096bfbf5c8e42f09551e4c84ea8de02', 'request_id': 'req-d6ee7908-4895-4a64-80f1-c0c461d19f31'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:54.641993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb6bc63929648388ac9648823d4ca88'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:54.651387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7096bfbf5c8e42f09551e4c84ea8de02', 'request_id': 'req-d6ee7908-4895-4a64-80f1-c0c461d19f31'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:54.668158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] The token cache is being invalidate because project 7096bfbf5c8e42f09551e4c84ea8de02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:54.668871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb6bc63929648388ac9648823d4ca88'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:54.669529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:54.671613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:54.685106 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1463/2918] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:54 2021] DELETE /identity/v3/projects/7096bfbf5c8e42f09551e4c84ea8de02 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:51:54.686610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:54.690451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:54.690709 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1456/2919] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:54 2021] DELETE /identity/v3/users/3cb6bc63929648388ac9648823d4ca88 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:54.691702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:54.693463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:54.807020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee7908-4895-4a64-80f1-c0c461d19f31 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:54.898812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d31928-294f-44d5-b9d5-d26fe2a4c4f6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:54.903703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022951a9-bef9-4df3-8885-40e6c7bfbeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:54.904377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022951a9-bef9-4df3-8885-40e6c7bfbeae admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:54.904658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022951a9-bef9-4df3-8885-40e6c7bfbeae admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:54.904930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022951a9-bef9-4df3-8885-40e6c7bfbeae admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:54.905802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022951a9-bef9-4df3-8885-40e6c7bfbeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:54.908166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022951a9-bef9-4df3-8885-40e6c7bfbeae admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:54.922037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731d6ba-fd68-4156-81ae-8893d9ae8a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:54.923528 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1464/2920] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:54 2021] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:54.923666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731d6ba-fd68-4156-81ae-8893d9ae8a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:54.923948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731d6ba-fd68-4156-81ae-8893d9ae8a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:54.924235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731d6ba-fd68-4156-81ae-8893d9ae8a48 admin admin] PATH_INFO: `/v3/users/ee70c6c98e6648779459a3a395586170` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:54.924977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1ff6-5e49-455b-94c7-33670f6d950d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:54.925296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1ff6-5e49-455b-94c7-33670f6d950d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:54.925769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1ff6-5e49-455b-94c7-33670f6d950d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:54.925970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731d6ba-fd68-4156-81ae-8893d9ae8a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee70c6c98e6648779459a3a395586170)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:54.927987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731d6ba-fd68-4156-81ae-8893d9ae8a48 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:54.959581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a9ae1ff6-5e49-455b-94c7-33670f6d950d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:54.960797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a9ae1ff6-5e49-455b-94c7-33670f6d950d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:54.990532 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1465/2921] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:54.991896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1ff6-5e49-455b-94c7-33670f6d950d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:55.015601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1ff6-5e49-455b-94c7-33670f6d950d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:55.028831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969fd16-f8cb-431c-b04c-81f5ef5380be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:55.030355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969fd16-f8cb-431c-b04c-81f5ef5380be admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:55.031307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969fd16-f8cb-431c-b04c-81f5ef5380be admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:55.031791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969fd16-f8cb-431c-b04c-81f5ef5380be admin admin] PATH_INFO: `/v3/projects/84f220a6252a4356997445be8c77c335/users/b3f8e462094c4456b13e2c9da35a8a46/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:55.032647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c731d6ba-fd68-4156-81ae-8893d9ae8a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee70c6c98e6648779459a3a395586170'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.050648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c731d6ba-fd68-4156-81ae-8893d9ae8a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee70c6c98e6648779459a3a395586170'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.051826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c731d6ba-fd68-4156-81ae-8893d9ae8a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee70c6c98e6648779459a3a395586170'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.052046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969fd16-f8cb-431c-b04c-81f5ef5380be admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f220a6252a4356997445be8c77c335, user_id=b3f8e462094c4456b13e2c9da35a8a46, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:55.055705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969fd16-f8cb-431c-b04c-81f5ef5380be admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:55.065707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c731d6ba-fd68-4156-81ae-8893d9ae8a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee70c6c98e6648779459a3a395586170'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.073640 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1466/2922] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:54 2021] PUT /identity/v3/projects/84f220a6252a4356997445be8c77c335/users/b3f8e462094c4456b13e2c9da35a8a46/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:55.074577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969fd16-f8cb-431c-b04c-81f5ef5380be admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:55.083565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b969fd16-f8cb-431c-b04c-81f5ef5380be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:55.090777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c731d6ba-fd68-4156-81ae-8893d9ae8a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee70c6c98e6648779459a3a395586170'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.097713 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1457/2923] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:54 2021] DELETE /identity/v3/users/ee70c6c98e6648779459a3a395586170 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:55.099063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d464298-1536-4895-8e20-338467d1cff1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:55.099450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d464298-1536-4895-8e20-338467d1cff1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:55.099733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d464298-1536-4895-8e20-338467d1cff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:55.135762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3d464298-1536-4895-8e20-338467d1cff1 None None] MFA Rules not processed for user `b3f8e462094c4456b13e2c9da35a8a46`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:55.137793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3d464298-1536-4895-8e20-338467d1cff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:55.190554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969fd16-f8cb-431c-b04c-81f5ef5380be admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:55.288788 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1458/2924] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:55 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:55.298528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e46fa-c218-4089-a0a3-e997ed74bda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:55.299182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e46fa-c218-4089-a0a3-e997ed74bda7 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:55.299504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e46fa-c218-4089-a0a3-e997ed74bda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:55.299782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e46fa-c218-4089-a0a3-e997ed74bda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:55.301731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3a4e46fa-c218-4089-a0a3-e997ed74bda7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:55.310694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d464298-1536-4895-8e20-338467d1cff1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:55.312141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3d464298-1536-4895-8e20-338467d1cff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:55.403195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e46fa-c218-4089-a0a3-e997ed74bda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:55.404885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e46fa-c218-4089-a0a3-e997ed74bda7 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:55.417485 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1467/2925] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:55.459204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d464298-1536-4895-8e20-338467d1cff1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:55.465892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a6d15-1da1-48aa-877f-8a4ee77185f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:55.466653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6d15-1da1-48aa-877f-8a4ee77185f3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:55.467282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6d15-1da1-48aa-877f-8a4ee77185f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:55.467557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a6d15-1da1-48aa-877f-8a4ee77185f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:55.468339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a6d15-1da1-48aa-877f-8a4ee77185f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:55.471047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a6d15-1da1-48aa-877f-8a4ee77185f3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:55.506478 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1459/2926] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:55 2021] POST /identity/v3/projects => generated 393 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:55.510730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e46fa-c218-4089-a0a3-e997ed74bda7 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:55.522749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e46fa-c218-4089-a0a3-e997ed74bda7 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:55.588195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afaad9-2b57-4d6f-9b0c-bad0d0b50d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:55.588874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afaad9-2b57-4d6f-9b0c-bad0d0b50d60 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:55.589151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afaad9-2b57-4d6f-9b0c-bad0d0b50d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:55.589421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afaad9-2b57-4d6f-9b0c-bad0d0b50d60 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:55.590170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afaad9-2b57-4d6f-9b0c-bad0d0b50d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:55.592194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afaad9-2b57-4d6f-9b0c-bad0d0b50d60 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:55.595892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a6d15-1da1-48aa-877f-8a4ee77185f3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:55.598056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bd9a6d15-1da1-48aa-877f-8a4ee77185f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:55.620214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a6d15-1da1-48aa-877f-8a4ee77185f3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:55.627869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:55.628866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:55.629284 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1468/2927] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:55 2021] POST /identity/v3/users => generated 303 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:51:55.632063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:55.633364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] PATH_INFO: `/v3/projects/ba71d35c2a7b46fda183ec8b161dc3fa` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:55.633833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afaad9-2b57-4d6f-9b0c-bad0d0b50d60 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:55.635580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba71d35c2a7b46fda183ec8b161dc3fa)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:55.637496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:55.647191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afaad9-2b57-4d6f-9b0c-bad0d0b50d60 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:55.653495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be83345-127c-447a-ace4-a13fb04f379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:55.654158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be83345-127c-447a-ace4-a13fb04f379d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:55.654438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be83345-127c-447a-ace4-a13fb04f379d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:55.654710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be83345-127c-447a-ace4-a13fb04f379d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:55.655549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be83345-127c-447a-ace4-a13fb04f379d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:55.657470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be83345-127c-447a-ace4-a13fb04f379d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:55.668814 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1469/2928] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:55 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:55.673303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be83345-127c-447a-ace4-a13fb04f379d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:55.692408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be83345-127c-447a-ace4-a13fb04f379d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:55.697725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2ac5-97c3-4310-9812-0626d28e94a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:55.699241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2ac5-97c3-4310-9812-0626d28e94a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:55.699588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2ac5-97c3-4310-9812-0626d28e94a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:55.699992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2ac5-97c3-4310-9812-0626d28e94a0 admin admin] PATH_INFO: `/v3/projects/e6bb5854187640d785aa0b4b4ad15c7a/users/956f1cc34e30445db857c2b0683b17bc/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:55.726342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff2ac5-97c3-4310-9812-0626d28e94a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bb5854187640d785aa0b4b4ad15c7a, user_id=956f1cc34e30445db857c2b0683b17bc, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:55.729128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff2ac5-97c3-4310-9812-0626d28e94a0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:55.740118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba71d35c2a7b46fda183ec8b161dc3fa', 'request_id': 'req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.742147 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1470/2929] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:55 2021] PUT /identity/v3/projects/e6bb5854187640d785aa0b4b4ad15c7a/users/956f1cc34e30445db857c2b0683b17bc/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:55.744578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2ac5-97c3-4310-9812-0626d28e94a0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:55.746552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-57ff2ac5-97c3-4310-9812-0626d28e94a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:55.748294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba71d35c2a7b46fda183ec8b161dc3fa', 'request_id': 'req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.756605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba71d35c2a7b46fda183ec8b161dc3fa', 'request_id': 'req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.767123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] The token cache is being invalidate because project ba71d35c2a7b46fda183ec8b161dc3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:55.767445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.768103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.769634 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1460/2930] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:55 2021] DELETE /identity/v3/projects/ba71d35c2a7b46fda183ec8b161dc3fa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:51:55.770562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:55.775805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:55.813830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2ac5-97c3-4310-9812-0626d28e94a0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:55.819324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:55.820181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:55.820468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:55.820744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] PATH_INFO: `/v3/projects/04a17517c2104eeba56ce3a7cd915fb0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:55.821950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a17517c2104eeba56ce3a7cd915fb0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:55.824235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:55.863133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde6315-c3ad-4506-b5f3-1238c07b9f4c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:55.868939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b2ab4-a9fc-4f34-b75a-08ced468195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:55.872504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2ab4-a9fc-4f34-b75a-08ced468195a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:55.874395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2ab4-a9fc-4f34-b75a-08ced468195a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:55.874687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2ab4-a9fc-4f34-b75a-08ced468195a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:55.875519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b2ab4-a9fc-4f34-b75a-08ced468195a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:55.879194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b2ab4-a9fc-4f34-b75a-08ced468195a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:55.899810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a17517c2104eeba56ce3a7cd915fb0', 'request_id': 'req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.900384 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1461/2931] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:55 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:55.901819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675b54b-bc17-4933-b4ff-407fe6c7b53f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:55.902112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675b54b-bc17-4933-b4ff-407fe6c7b53f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:55.902389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675b54b-bc17-4933-b4ff-407fe6c7b53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:55.907486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a17517c2104eeba56ce3a7cd915fb0', 'request_id': 'req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.916410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a17517c2104eeba56ce3a7cd915fb0', 'request_id': 'req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.928817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] The token cache is being invalidate because project 04a17517c2104eeba56ce3a7cd915fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:55.929110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.929916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:55.931864 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1471/2932] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:55 2021] DELETE /identity/v3/projects/04a17517c2104eeba56ce3a7cd915fb0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:55.933045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:55.934040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:55.974701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d675b54b-bc17-4933-b4ff-407fe6c7b53f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:55.975940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d675b54b-bc17-4933-b4ff-407fe6c7b53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:56.032275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e2a23-3f82-4e37-b3e8-b043cdcc1b9f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:56.039371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018fda4-c971-41e2-9047-230f7a492080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:56.040737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018fda4-c971-41e2-9047-230f7a492080 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:56.041176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018fda4-c971-41e2-9047-230f7a492080 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:56.041918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018fda4-c971-41e2-9047-230f7a492080 admin admin] PATH_INFO: `/v3/projects/e6bb5854187640d785aa0b4b4ad15c7a/users/956f1cc34e30445db857c2b0683b17bc/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:56.045357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018fda4-c971-41e2-9047-230f7a492080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bb5854187640d785aa0b4b4ad15c7a, user_id=956f1cc34e30445db857c2b0683b17bc, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:56.051849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018fda4-c971-41e2-9047-230f7a492080 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:56.068616 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1472/2933] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:55 2021] PUT /identity/v3/projects/e6bb5854187640d785aa0b4b4ad15c7a/users/956f1cc34e30445db857c2b0683b17bc/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:56.068857 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1462/2934] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:56.069521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018fda4-c971-41e2-9047-230f7a492080 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:56.078235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c84176-907c-4544-a158-328e09c8d459 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:56.078523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c84176-907c-4544-a158-328e09c8d459 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:56.078844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c84176-907c-4544-a158-328e09c8d459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:56.079823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1018fda4-c971-41e2-9047-230f7a492080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:56.098489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-89c84176-907c-4544-a158-328e09c8d459 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:56.098712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-89c84176-907c-4544-a158-328e09c8d459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:56.173321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018fda4-c971-41e2-9047-230f7a492080 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:56.178223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:56.179469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:56.179469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:56.179679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] PATH_INFO: `/v3/users/1b2ee0ab190e4d4d9005d8d9f432f414` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:56.180847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2ee0ab190e4d4d9005d8d9f432f414)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:56.182871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:56.221149 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1463/2935] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:51:56.224655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d63c65-7f09-4de5-a044-f2a7b2547a7e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:56.224941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d63c65-7f09-4de5-a044-f2a7b2547a7e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:56.225208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d63c65-7f09-4de5-a044-f2a7b2547a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:56.266566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2ee0ab190e4d4d9005d8d9f432f414'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:56.267246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2ee0ab190e4d4d9005d8d9f432f414'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:56.275547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-25d63c65-7f09-4de5-a044-f2a7b2547a7e None None] MFA Rules not processed for user `956f1cc34e30445db857c2b0683b17bc`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:56.277172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-25d63c65-7f09-4de5-a044-f2a7b2547a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:56.277924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2ee0ab190e4d4d9005d8d9f432f414'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:56.278999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2ee0ab190e4d4d9005d8d9f432f414'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:56.293715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2ee0ab190e4d4d9005d8d9f432f414'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:56.325460 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1473/2936] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:56 2021] DELETE /identity/v3/users/1b2ee0ab190e4d4d9005d8d9f432f414 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:56.326531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:56.327965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:56.365436 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1464/2937] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:56 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:56.371617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d7e2-0aa2-4342-abb9-b3a0fce86386 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:56.371903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d7e2-0aa2-4342-abb9-b3a0fce86386 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:56.372221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d7e2-0aa2-4342-abb9-b3a0fce86386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:56.391448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7735d7e2-0aa2-4342-abb9-b3a0fce86386 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:56.392657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7735d7e2-0aa2-4342-abb9-b3a0fce86386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:56.430605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57932d-1b69-456e-b8e1-c1390738119b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:56.439409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb7a99-09f7-4a4e-9e4d-dcb5e85a2d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:56.440729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb7a99-09f7-4a4e-9e4d-dcb5e85a2d0e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:56.447224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb7a99-09f7-4a4e-9e4d-dcb5e85a2d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:56.447224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb7a99-09f7-4a4e-9e4d-dcb5e85a2d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:56.447224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb7a99-09f7-4a4e-9e4d-dcb5e85a2d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:51:56.447224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb7a99-09f7-4a4e-9e4d-dcb5e85a2d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:56.447224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb7a99-09f7-4a4e-9e4d-dcb5e85a2d0e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:56.463067 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1474/2938] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:51:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:56.464742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb7a99-09f7-4a4e-9e4d-dcb5e85a2d0e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:56.467068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f8cb7a99-09f7-4a4e-9e4d-dcb5e85a2d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:56.481330 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1465/2939] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:51:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:56.482529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735d7e2-0aa2-4342-abb9-b3a0fce86386 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:56.496801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735d7e2-0aa2-4342-abb9-b3a0fce86386 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:56.505785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40400f46-e785-4c64-b60b-966e11b5ded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:56.506773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40400f46-e785-4c64-b60b-966e11b5ded8 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:56.507183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40400f46-e785-4c64-b60b-966e11b5ded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:56.507645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40400f46-e785-4c64-b60b-966e11b5ded8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:56.508589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40400f46-e785-4c64-b60b-966e11b5ded8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:56.510931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40400f46-e785-4c64-b60b-966e11b5ded8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:56.553962 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1466/2940] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:56 2021] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:56.563055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40400f46-e785-4c64-b60b-966e11b5ded8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:56.563883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb7a99-09f7-4a4e-9e4d-dcb5e85a2d0e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:56.565716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-40400f46-e785-4c64-b60b-966e11b5ded8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:56.642409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d932b9-2e35-4fed-8a5d-6cd2385e5ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:56.643114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d932b9-2e35-4fed-8a5d-6cd2385e5ab6 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:56.643597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d932b9-2e35-4fed-8a5d-6cd2385e5ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:56.643970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d932b9-2e35-4fed-8a5d-6cd2385e5ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:56.651164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40400f46-e785-4c64-b60b-966e11b5ded8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:56.657651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8ebbe-6fd9-489f-bbf5-bc6c88d8c3e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:56.658295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8ebbe-6fd9-489f-bbf5-bc6c88d8c3e0 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:56.658821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8ebbe-6fd9-489f-bbf5-bc6c88d8c3e0 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:56.659285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8ebbe-6fd9-489f-bbf5-bc6c88d8c3e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:56.712948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d932b9-2e35-4fed-8a5d-6cd2385e5ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:56.714986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d932b9-2e35-4fed-8a5d-6cd2385e5ab6 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:56.720963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8ebbe-6fd9-489f-bbf5-bc6c88d8c3e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:56.722650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8ebbe-6fd9-489f-bbf5-bc6c88d8c3e0 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:56.726830 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1475/2941] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:56 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:56.728304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d932b9-2e35-4fed-8a5d-6cd2385e5ab6 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:56.732115 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1467/2942] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:51:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:51:56.732991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8ebbe-6fd9-489f-bbf5-bc6c88d8c3e0 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:56.735400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-85e8ebbe-6fd9-489f-bbf5-bc6c88d8c3e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:56.827696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8ebbe-6fd9-489f-bbf5-bc6c88d8c3e0 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:56.834544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:56.835932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:56.836282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:56.836628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] PATH_INFO: `/v3/projects/c59ee766273440ad9e1b4b17af7c1c2d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:56.838010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c59ee766273440ad9e1b4b17af7c1c2d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:56.840774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:56.861279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d932b9-2e35-4fed-8a5d-6cd2385e5ab6 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:56.873366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d72bd2-36f0-4900-b72f-10f41b16d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:56.874115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d72bd2-36f0-4900-b72f-10f41b16d483 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:56.874459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d72bd2-36f0-4900-b72f-10f41b16d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:56.874818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d72bd2-36f0-4900-b72f-10f41b16d483 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:56.876165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d72bd2-36f0-4900-b72f-10f41b16d483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:56.877870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d72bd2-36f0-4900-b72f-10f41b16d483 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:56.916607 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1476/2943] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:56 2021] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:56.917539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d72bd2-36f0-4900-b72f-10f41b16d483 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:56.923536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59ee766273440ad9e1b4b17af7c1c2d', 'request_id': 'req-391665d1-a6ca-468e-b0bc-16daf7a13d2f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:56.935577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59ee766273440ad9e1b4b17af7c1c2d', 'request_id': 'req-391665d1-a6ca-468e-b0bc-16daf7a13d2f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:56.938628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d72bd2-36f0-4900-b72f-10f41b16d483 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:56.946380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59ee766273440ad9e1b4b17af7c1c2d', 'request_id': 'req-391665d1-a6ca-468e-b0bc-16daf7a13d2f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:56.959758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] The token cache is being invalidate because project c59ee766273440ad9e1b4b17af7c1c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:56.960422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:56.960952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:56.962738 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1468/2944] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:56 2021] DELETE /identity/v3/projects/c59ee766273440ad9e1b4b17af7c1c2d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:56.963894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:56.968020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:57.112177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfa96e-d85e-4e95-bf43-28e4d90db566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:57.112648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfa96e-d85e-4e95-bf43-28e4d90db566 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.112935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfa96e-d85e-4e95-bf43-28e4d90db566 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.113216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfa96e-d85e-4e95-bf43-28e4d90db566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.118555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fadfa96e-d85e-4e95-bf43-28e4d90db566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:57.135373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391665d1-a6ca-468e-b0bc-16daf7a13d2f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:57.148226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f0b7d-547f-40e0-b2a1-8a5b5e23ce29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:57.149709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f0b7d-547f-40e0-b2a1-8a5b5e23ce29 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.150000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f0b7d-547f-40e0-b2a1-8a5b5e23ce29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.150278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f0b7d-547f-40e0-b2a1-8a5b5e23ce29 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.151916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f0b7d-547f-40e0-b2a1-8a5b5e23ce29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:57.155859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f0b7d-547f-40e0-b2a1-8a5b5e23ce29 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:57.183553 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1469/2945] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:56 2021] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:57.186441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf4c8f-2d55-43cf-b33d-86615422681a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.186750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf4c8f-2d55-43cf-b33d-86615422681a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.187030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf4c8f-2d55-43cf-b33d-86615422681a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.224098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2ecf4c8f-2d55-43cf-b33d-86615422681a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:57.227188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2ecf4c8f-2d55-43cf-b33d-86615422681a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:57.250235 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1470/2946] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:57.251821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf4c8f-2d55-43cf-b33d-86615422681a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:57.253083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfa96e-d85e-4e95-bf43-28e4d90db566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:57.254696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfa96e-d85e-4e95-bf43-28e4d90db566 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:57.273331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf4c8f-2d55-43cf-b33d-86615422681a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:57.279519 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1477/2947] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:56 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:57.281168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838e8f-4562-44f9-9cb9-4b55e38cbfff None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.281442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838e8f-4562-44f9-9cb9-4b55e38cbfff None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.281723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838e8f-4562-44f9-9cb9-4b55e38cbfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.287452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad368-014f-4a9a-9f92-c6fea852bb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:57.288631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad368-014f-4a9a-9f92-c6fea852bb56 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.288631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad368-014f-4a9a-9f92-c6fea852bb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.288631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad368-014f-4a9a-9f92-c6fea852bb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.289334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ad368-014f-4a9a-9f92-c6fea852bb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:57.292238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ad368-014f-4a9a-9f92-c6fea852bb56 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:57.319183 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1471/2948] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:57 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:57.320134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad368-014f-4a9a-9f92-c6fea852bb56 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:57.322302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ab838e8f-4562-44f9-9cb9-4b55e38cbfff None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:57.324418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ab838e8f-4562-44f9-9cb9-4b55e38cbfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:57.325528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4c2ad368-014f-4a9a-9f92-c6fea852bb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:57.359158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad368-014f-4a9a-9f92-c6fea852bb56 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:57.361399 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1478/2949] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:57.362986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab838e8f-4562-44f9-9cb9-4b55e38cbfff None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:57.374774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291210c-0fa6-4228-9923-5d7a6dcf0362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:57.377111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291210c-0fa6-4228-9923-5d7a6dcf0362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.377645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291210c-0fa6-4228-9923-5d7a6dcf0362 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.378066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291210c-0fa6-4228-9923-5d7a6dcf0362 admin admin] PATH_INFO: `/v3/users/b3f8e462094c4456b13e2c9da35a8a46` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.379642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291210c-0fa6-4228-9923-5d7a6dcf0362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f8e462094c4456b13e2c9da35a8a46)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:57.383601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8291210c-0fa6-4228-9923-5d7a6dcf0362 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:57.386668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab838e8f-4562-44f9-9cb9-4b55e38cbfff None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:57.403467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51216b1-211a-4fd5-ab5e-3df5688b3ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:57.404369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51216b1-211a-4fd5-ab5e-3df5688b3ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.404857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51216b1-211a-4fd5-ab5e-3df5688b3ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.405296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51216b1-211a-4fd5-ab5e-3df5688b3ce3 admin admin] PATH_INFO: `/v3/projects/a82619851df34e21b4179bd27466ccc7/users/bd59bfbd18e94dbebb2d3a6965c741d3/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.445040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51216b1-211a-4fd5-ab5e-3df5688b3ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82619851df34e21b4179bd27466ccc7, user_id=bd59bfbd18e94dbebb2d3a6965c741d3, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:57.453202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51216b1-211a-4fd5-ab5e-3df5688b3ce3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:57.475452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8291210c-0fa6-4228-9923-5d7a6dcf0362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f8e462094c4456b13e2c9da35a8a46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:57.491846 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1479/2950] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:57 2021] PUT /identity/v3/projects/a82619851df34e21b4179bd27466ccc7/users/bd59bfbd18e94dbebb2d3a6965c741d3/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:57.492985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51216b1-211a-4fd5-ab5e-3df5688b3ce3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:57.512906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8291210c-0fa6-4228-9923-5d7a6dcf0362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f8e462094c4456b13e2c9da35a8a46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:57.513644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8291210c-0fa6-4228-9923-5d7a6dcf0362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f8e462094c4456b13e2c9da35a8a46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:57.525527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8291210c-0fa6-4228-9923-5d7a6dcf0362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f8e462094c4456b13e2c9da35a8a46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:57.555738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8291210c-0fa6-4228-9923-5d7a6dcf0362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f8e462094c4456b13e2c9da35a8a46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:57.570298 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1472/2951] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:57 2021] DELETE /identity/v3/users/b3f8e462094c4456b13e2c9da35a8a46 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:57.572070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a0f7-71f2-4402-853d-e814f1ded9b9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.572515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a0f7-71f2-4402-853d-e814f1ded9b9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.573049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35a0f7-71f2-4402-853d-e814f1ded9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.608580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2e35a0f7-71f2-4402-853d-e814f1ded9b9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:57.610488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51216b1-211a-4fd5-ab5e-3df5688b3ce3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:57.612744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2e35a0f7-71f2-4402-853d-e814f1ded9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:57.696824 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1473/2952] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:57.698703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b5315-36e9-4f75-94ba-946ac71e8381 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.698880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b5315-36e9-4f75-94ba-946ac71e8381 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.701288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b5315-36e9-4f75-94ba-946ac71e8381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.734031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ea9b5315-36e9-4f75-94ba-946ac71e8381 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:57.737219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ea9b5315-36e9-4f75-94ba-946ac71e8381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:57.738551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a192de-c7ef-4d55-b8f9-eba0f34abbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:57.739335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a192de-c7ef-4d55-b8f9-eba0f34abbad admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.739671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a192de-c7ef-4d55-b8f9-eba0f34abbad admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.740005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a192de-c7ef-4d55-b8f9-eba0f34abbad admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.740815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a192de-c7ef-4d55-b8f9-eba0f34abbad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:51:57.741184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a192de-c7ef-4d55-b8f9-eba0f34abbad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:57.745521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a192de-c7ef-4d55-b8f9-eba0f34abbad admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:57.761162 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1474/2953] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:57.762215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b5315-36e9-4f75-94ba-946ac71e8381 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:57.767219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ea9b5315-36e9-4f75-94ba-946ac71e8381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:57.775023 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1480/2954] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:51:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:51:57.776354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a192de-c7ef-4d55-b8f9-eba0f34abbad admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:57.780071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-61a192de-c7ef-4d55-b8f9-eba0f34abbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:57.858516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a192de-c7ef-4d55-b8f9-eba0f34abbad admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:57.863138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b5315-36e9-4f75-94ba-946ac71e8381 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:57.864056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15cd65-786f-46ec-860a-4c638f7a2b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:57.866271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15cd65-786f-46ec-860a-4c638f7a2b1c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.866688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15cd65-786f-46ec-860a-4c638f7a2b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.867072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15cd65-786f-46ec-860a-4c638f7a2b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.868921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea32d5-bdb5-4987-a58b-0b8962542f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:57.869549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea32d5-bdb5-4987-a58b-0b8962542f97 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.869968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea32d5-bdb5-4987-a58b-0b8962542f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.870261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea32d5-bdb5-4987-a58b-0b8962542f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.880763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15cd65-786f-46ec-860a-4c638f7a2b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:57.882333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15cd65-786f-46ec-860a-4c638f7a2b1c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:57.884153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea32d5-bdb5-4987-a58b-0b8962542f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:57.885803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea32d5-bdb5-4987-a58b-0b8962542f97 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:57.899665 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1481/2955] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:57.899665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15cd65-786f-46ec-860a-4c638f7a2b1c service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:57.899665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6e15cd65-786f-46ec-860a-4c638f7a2b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:57.905371 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1475/2956] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:51:57.914365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15cd65-786f-46ec-860a-4c638f7a2b1c service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:57.929499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ab6f3-8222-47c4-b632-adaf3c30fa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:57.930342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ab6f3-8222-47c4-b632-adaf3c30fa3a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:57.930731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ab6f3-8222-47c4-b632-adaf3c30fa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:57.931111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ab6f3-8222-47c4-b632-adaf3c30fa3a admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:57.932658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ab6f3-8222-47c4-b632-adaf3c30fa3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:57.934892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ab6f3-8222-47c4-b632-adaf3c30fa3a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:57.986267 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1482/2957] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:57 2021] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:57.990194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea32d5-bdb5-4987-a58b-0b8962542f97 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:58.008464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea32d5-bdb5-4987-a58b-0b8962542f97 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:58.096827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e5379-22c4-4aba-ab4b-d218a80cdbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:58.098228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5379-22c4-4aba-ab4b-d218a80cdbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:58.098712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5379-22c4-4aba-ab4b-d218a80cdbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:58.099195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5379-22c4-4aba-ab4b-d218a80cdbe5 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:58.100176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e5379-22c4-4aba-ab4b-d218a80cdbe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:58.102302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e5379-22c4-4aba-ab4b-d218a80cdbe5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:58.150218 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1476/2958] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:57 2021] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:58.152721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ab6f3-8222-47c4-b632-adaf3c30fa3a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:58.170470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ab6f3-8222-47c4-b632-adaf3c30fa3a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:58.181972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b8dd7-8c21-4c08-ade3-cb580831466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:58.182656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8dd7-8c21-4c08-ade3-cb580831466f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:58.182937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8dd7-8c21-4c08-ade3-cb580831466f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:58.184490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b8dd7-8c21-4c08-ade3-cb580831466f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:58.203689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b8dd7-8c21-4c08-ade3-cb580831466f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:58.206104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b8dd7-8c21-4c08-ade3-cb580831466f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:58.220749 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1483/2959] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:58 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:58.224911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e5379-22c4-4aba-ab4b-d218a80cdbe5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:58.236635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e5379-22c4-4aba-ab4b-d218a80cdbe5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:58.245191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966617fc-0b2b-40c2-87ca-42e2fd3cec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:58.246089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966617fc-0b2b-40c2-87ca-42e2fd3cec6b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:58.246470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966617fc-0b2b-40c2-87ca-42e2fd3cec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:58.246835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966617fc-0b2b-40c2-87ca-42e2fd3cec6b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:58.247938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966617fc-0b2b-40c2-87ca-42e2fd3cec6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:58.250055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966617fc-0b2b-40c2-87ca-42e2fd3cec6b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:58.261047 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1477/2960] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:58 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:51:58.265070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b8dd7-8c21-4c08-ade3-cb580831466f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:58.276140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b8dd7-8c21-4c08-ade3-cb580831466f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:58.281682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9c56-64ba-47cf-8ef7-a61521ea6519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:58.283291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9c56-64ba-47cf-8ef7-a61521ea6519 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:58.283673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9c56-64ba-47cf-8ef7-a61521ea6519 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:58.284736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9c56-64ba-47cf-8ef7-a61521ea6519 admin admin] PATH_INFO: `/v3/projects/e5c51658b4fb4f19b2c15cc64c7564bb/users/dabaafd84dcf4d008b4e9cfabb508cc6/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:58.316680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe9c56-64ba-47cf-8ef7-a61521ea6519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c51658b4fb4f19b2c15cc64c7564bb, user_id=dabaafd84dcf4d008b4e9cfabb508cc6, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:58.321633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe9c56-64ba-47cf-8ef7-a61521ea6519 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:58.351978 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1484/2961] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:58 2021] PUT /identity/v3/projects/e5c51658b4fb4f19b2c15cc64c7564bb/users/dabaafd84dcf4d008b4e9cfabb508cc6/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:58.359597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093b0c0-f3c0-40f3-af65-d605afa124fc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:58.359906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093b0c0-f3c0-40f3-af65-d605afa124fc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:58.361281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093b0c0-f3c0-40f3-af65-d605afa124fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:58.403147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a093b0c0-f3c0-40f3-af65-d605afa124fc None None] MFA Rules not processed for user `dabaafd84dcf4d008b4e9cfabb508cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:58.404633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a093b0c0-f3c0-40f3-af65-d605afa124fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:58.505744 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1478/2962] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:58 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:58.511981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9c56-64ba-47cf-8ef7-a61521ea6519 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:58.689696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9c56-64ba-47cf-8ef7-a61521ea6519 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:58.698277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976808b8-7aa4-4448-ae16-c40072dad2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:58.699185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976808b8-7aa4-4448-ae16-c40072dad2ab admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:58.699559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976808b8-7aa4-4448-ae16-c40072dad2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:58.699949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976808b8-7aa4-4448-ae16-c40072dad2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:58.700761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976808b8-7aa4-4448-ae16-c40072dad2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:58.710297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976808b8-7aa4-4448-ae16-c40072dad2ab admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:58.757272 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1485/2963] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:51:58 2021] POST /identity/v3/projects => generated 387 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:58.758038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093b0c0-f3c0-40f3-af65-d605afa124fc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:58.771638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093b0c0-f3c0-40f3-af65-d605afa124fc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:58.837211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976808b8-7aa4-4448-ae16-c40072dad2ab admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:58.838971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-976808b8-7aa4-4448-ae16-c40072dad2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:58.858107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f5fbf-6da0-4c5a-a650-e346404ab388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:58.859157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f5fbf-6da0-4c5a-a650-e346404ab388 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:58.859521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f5fbf-6da0-4c5a-a650-e346404ab388 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:58.859811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f5fbf-6da0-4c5a-a650-e346404ab388 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:58.860889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f5fbf-6da0-4c5a-a650-e346404ab388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:58.863236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f5fbf-6da0-4c5a-a650-e346404ab388 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:58.890388 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1479/2964] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:51:58 2021] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:51:58.894613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f5fbf-6da0-4c5a-a650-e346404ab388 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:58.911982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f5fbf-6da0-4c5a-a650-e346404ab388 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:58.919062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24fbcb-06af-4967-bdfc-8ffaa42b1aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:58.920817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24fbcb-06af-4967-bdfc-8ffaa42b1aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:58.921177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24fbcb-06af-4967-bdfc-8ffaa42b1aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:58.921715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24fbcb-06af-4967-bdfc-8ffaa42b1aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:58.923719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24fbcb-06af-4967-bdfc-8ffaa42b1aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:58.927901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24fbcb-06af-4967-bdfc-8ffaa42b1aa3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:58.939875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976808b8-7aa4-4448-ae16-c40072dad2ab admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:58.945694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:58.946913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:58.947596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:58.948069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] PATH_INFO: `/v3/projects/84f220a6252a4356997445be8c77c335` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:58.948322 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1480/2965] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:58 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:58.949251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24fbcb-06af-4967-bdfc-8ffaa42b1aa3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:58.950044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f220a6252a4356997445be8c77c335)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:58.952567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:58.964289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24fbcb-06af-4967-bdfc-8ffaa42b1aa3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:58.969932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e71de-892c-42da-a0a7-afeea80dd0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:58.970893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e71de-892c-42da-a0a7-afeea80dd0df admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:58.971416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e71de-892c-42da-a0a7-afeea80dd0df admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:58.971840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e71de-892c-42da-a0a7-afeea80dd0df admin admin] PATH_INFO: `/v3/projects/683156220cc246a3a433248708e41329/users/7d594027327e4aaa83a4333c97335ce2/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:59.005399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e71de-892c-42da-a0a7-afeea80dd0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=683156220cc246a3a433248708e41329, user_id=7d594027327e4aaa83a4333c97335ce2, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:59.008106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e71de-892c-42da-a0a7-afeea80dd0df admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:59.021396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f220a6252a4356997445be8c77c335', 'request_id': 'req-50d26007-3262-467e-8b9b-7b74ce277b2d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:59.023657 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1481/2966] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:58 2021] PUT /identity/v3/projects/683156220cc246a3a433248708e41329/users/7d594027327e4aaa83a4333c97335ce2/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:59.027144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e71de-892c-42da-a0a7-afeea80dd0df admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:59.028378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f220a6252a4356997445be8c77c335', 'request_id': 'req-50d26007-3262-467e-8b9b-7b74ce277b2d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:59.039806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f220a6252a4356997445be8c77c335', 'request_id': 'req-50d26007-3262-467e-8b9b-7b74ce277b2d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:59.052510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] The token cache is being invalidate because project 84f220a6252a4356997445be8c77c335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:51:59.052795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:59.053455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:59.056308 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1486/2967] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:51:58 2021] DELETE /identity/v3/projects/84f220a6252a4356997445be8c77c335 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:51:59.060473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:59.062987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:59.098015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e71de-892c-42da-a0a7-afeea80dd0df admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:59.104751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec745d-3ac8-4e36-bcf3-463189750c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:59.105767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec745d-3ac8-4e36-bcf3-463189750c45 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:59.106473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec745d-3ac8-4e36-bcf3-463189750c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:59.106759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec745d-3ac8-4e36-bcf3-463189750c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:59.107576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec745d-3ac8-4e36-bcf3-463189750c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:59.111105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec745d-3ac8-4e36-bcf3-463189750c45 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:59.121675 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1482/2968] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:51:59 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:51:59.125747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec745d-3ac8-4e36-bcf3-463189750c45 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:59.128223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-81ec745d-3ac8-4e36-bcf3-463189750c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:59.138315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d26007-3262-467e-8b9b-7b74ce277b2d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:59.144078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:59.144950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:59.145234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:59.145639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] PATH_INFO: `/v3/users/956f1cc34e30445db857c2b0683b17bc` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:59.146877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] RBAC: Authorizing `identity:delete_user(user_id=956f1cc34e30445db857c2b0683b17bc)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:59.149014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:59.160842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec745d-3ac8-4e36-bcf3-463189750c45 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:59.167068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9108d-0e14-4bb6-8d73-93d9b7d2860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:59.168426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9108d-0e14-4bb6-8d73-93d9b7d2860e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:59.168940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9108d-0e14-4bb6-8d73-93d9b7d2860e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:59.169194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9108d-0e14-4bb6-8d73-93d9b7d2860e admin admin] PATH_INFO: `/v3/projects/683156220cc246a3a433248708e41329/users/7d594027327e4aaa83a4333c97335ce2/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:59.171667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9108d-0e14-4bb6-8d73-93d9b7d2860e admin admin] RBAC: Authorizing `identity:create_grant(project_id=683156220cc246a3a433248708e41329, user_id=7d594027327e4aaa83a4333c97335ce2, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:59.174971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9108d-0e14-4bb6-8d73-93d9b7d2860e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:59.202310 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1483/2969] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:51:59 2021] PUT /identity/v3/projects/683156220cc246a3a433248708e41329/users/7d594027327e4aaa83a4333c97335ce2/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:51:59.204176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640134fa-77fa-4f2e-9089-6202d279e3a7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:59.204480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640134fa-77fa-4f2e-9089-6202d279e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:59.204935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640134fa-77fa-4f2e-9089-6202d279e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:59.230119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956f1cc34e30445db857c2b0683b17bc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:59.230940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956f1cc34e30445db857c2b0683b17bc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:59.257805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956f1cc34e30445db857c2b0683b17bc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:59.258515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956f1cc34e30445db857c2b0683b17bc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:59.270958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956f1cc34e30445db857c2b0683b17bc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:51:59.279294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-640134fa-77fa-4f2e-9089-6202d279e3a7 None None] MFA Rules not processed for user `7d594027327e4aaa83a4333c97335ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:51:59.280963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-640134fa-77fa-4f2e-9089-6202d279e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:59.312370 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1487/2970] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:51:59 2021] DELETE /identity/v3/users/956f1cc34e30445db857c2b0683b17bc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:51:59.435493 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1484/2971] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:51:59 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:51:59.489742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:51:59.491231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:51:59.606582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68049a0-e7e9-4835-82c9-f012facb789b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:51:59.612792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6267e2e-2dce-4f9a-8926-b633f7a569eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:51:59.613444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6267e2e-2dce-4f9a-8926-b633f7a569eb service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:51:59.613722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6267e2e-2dce-4f9a-8926-b633f7a569eb service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:51:59.613991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6267e2e-2dce-4f9a-8926-b633f7a569eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:51:59.687083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6267e2e-2dce-4f9a-8926-b633f7a569eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:51:59.688843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6267e2e-2dce-4f9a-8926-b633f7a569eb service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:51:59.701837 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1488/2972] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:51:59 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:00.101385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640134fa-77fa-4f2e-9089-6202d279e3a7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:00.102973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-640134fa-77fa-4f2e-9089-6202d279e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:00.282435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640134fa-77fa-4f2e-9089-6202d279e3a7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:00.401339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:00.402842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:00.403336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:00.404079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] PATH_INFO: `/v3/projects/e6bb5854187640d785aa0b4b4ad15c7a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:00.406844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bb5854187640d785aa0b4b4ad15c7a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:00.411876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:00.552340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bb5854187640d785aa0b4b4ad15c7a', 'request_id': 'req-faf2dbb5-002e-4f21-9adb-98b9054851b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:00.578856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6267e2e-2dce-4f9a-8926-b633f7a569eb service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:00.582245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e6267e2e-2dce-4f9a-8926-b633f7a569eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:00.596067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bb5854187640d785aa0b4b4ad15c7a', 'request_id': 'req-faf2dbb5-002e-4f21-9adb-98b9054851b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:00.601379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6267e2e-2dce-4f9a-8926-b633f7a569eb service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:00.630153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bb5854187640d785aa0b4b4ad15c7a', 'request_id': 'req-faf2dbb5-002e-4f21-9adb-98b9054851b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:00.682211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] The token cache is being invalidate because project e6bb5854187640d785aa0b4b4ad15c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:00.690369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:00.690904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c6aa-b3f7-43a3-8bc1-88b6783d53d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:00.692374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c6aa-b3f7-43a3-8bc1-88b6783d53d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:00.692913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c6aa-b3f7-43a3-8bc1-88b6783d53d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:00.693549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c6aa-b3f7-43a3-8bc1-88b6783d53d9 admin admin] PATH_INFO: `/v3/users/dabaafd84dcf4d008b4e9cfabb508cc6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:00.695920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9c6aa-b3f7-43a3-8bc1-88b6783d53d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabaafd84dcf4d008b4e9cfabb508cc6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:00.698936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9c6aa-b3f7-43a3-8bc1-88b6783d53d9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:00.699893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-faf2dbb5-002e-4f21-9adb-98b9054851b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:00.702963 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1485/2973] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:00 2021] DELETE /identity/v3/projects/e6bb5854187640d785aa0b4b4ad15c7a => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:00.714588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ee67-3fbd-4b62-93e5-7009089489fa None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:00.715063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ee67-3fbd-4b62-93e5-7009089489fa None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:00.719797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ee67-3fbd-4b62-93e5-7009089489fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:00.804072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-10c2ee67-3fbd-4b62-93e5-7009089489fa None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:00.806231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-10c2ee67-3fbd-4b62-93e5-7009089489fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:00.812230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01f9c6aa-b3f7-43a3-8bc1-88b6783d53d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabaafd84dcf4d008b4e9cfabb508cc6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:00.812482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01f9c6aa-b3f7-43a3-8bc1-88b6783d53d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabaafd84dcf4d008b4e9cfabb508cc6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:00.830979 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1486/2974] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:00.832530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01f9c6aa-b3f7-43a3-8bc1-88b6783d53d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabaafd84dcf4d008b4e9cfabb508cc6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:00.833363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01f9c6aa-b3f7-43a3-8bc1-88b6783d53d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabaafd84dcf4d008b4e9cfabb508cc6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:00.840171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a585a6-f572-491e-9ff2-3b0758fc2085 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:00.840455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a585a6-f572-491e-9ff2-3b0758fc2085 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:00.840731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a585a6-f572-491e-9ff2-3b0758fc2085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:00.853718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01f9c6aa-b3f7-43a3-8bc1-88b6783d53d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabaafd84dcf4d008b4e9cfabb508cc6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:00.876198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-68a585a6-f572-491e-9ff2-3b0758fc2085 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:00.877267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-68a585a6-f572-491e-9ff2-3b0758fc2085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:00.900738 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1487/2975] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:00.902680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a585a6-f572-491e-9ff2-3b0758fc2085 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:00.909382 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1489/2976] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:00 2021] DELETE /identity/v3/users/dabaafd84dcf4d008b4e9cfabb508cc6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:52:00.915064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317688-165a-42ba-98ad-2d84d10b2609 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:00.916944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317688-165a-42ba-98ad-2d84d10b2609 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:00.917336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317688-165a-42ba-98ad-2d84d10b2609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:00.933157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a585a6-f572-491e-9ff2-3b0758fc2085 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:01.005654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ac317688-165a-42ba-98ad-2d84d10b2609 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:01.008899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ac317688-165a-42ba-98ad-2d84d10b2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:01.011375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d22d6-0928-4fb6-88ee-520709ea1698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:01.013819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d22d6-0928-4fb6-88ee-520709ea1698 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:01.014223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d22d6-0928-4fb6-88ee-520709ea1698 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:01.014585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d22d6-0928-4fb6-88ee-520709ea1698 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:01.015999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d22d6-0928-4fb6-88ee-520709ea1698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:01.016893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d22d6-0928-4fb6-88ee-520709ea1698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:01.019979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d22d6-0928-4fb6-88ee-520709ea1698 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:01.030720 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1490/2977] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:01.054986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac317688-165a-42ba-98ad-2d84d10b2609 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:01.056934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ac317688-165a-42ba-98ad-2d84d10b2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:01.060147 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1488/2978] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:01.061035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d22d6-0928-4fb6-88ee-520709ea1698 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:01.083932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d22d6-0928-4fb6-88ee-520709ea1698 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:01.106879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49073ed-57e6-415f-aa53-a24ff42b5cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:01.107632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49073ed-57e6-415f-aa53-a24ff42b5cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:01.107750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49073ed-57e6-415f-aa53-a24ff42b5cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:01.107926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49073ed-57e6-415f-aa53-a24ff42b5cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:01.108637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49073ed-57e6-415f-aa53-a24ff42b5cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:01.111151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49073ed-57e6-415f-aa53-a24ff42b5cf6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:01.162026 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1489/2979] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:01 2021] POST /identity/v3/projects => generated 397 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:01.166268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49073ed-57e6-415f-aa53-a24ff42b5cf6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:01.201893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac317688-165a-42ba-98ad-2d84d10b2609 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:01.294584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49073ed-57e6-415f-aa53-a24ff42b5cf6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:01.303973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c24c85-5af8-4ddb-8821-adde12cd4d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:01.304653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c24c85-5af8-4ddb-8821-adde12cd4d68 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:01.304933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c24c85-5af8-4ddb-8821-adde12cd4d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:01.305267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c24c85-5af8-4ddb-8821-adde12cd4d68 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:01.305915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c24c85-5af8-4ddb-8821-adde12cd4d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:01.307905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c24c85-5af8-4ddb-8821-adde12cd4d68 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:01.323543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77597c-fab6-4587-b0f2-a2f521e8fbb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:01.325699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77597c-fab6-4587-b0f2-a2f521e8fbb1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:01.325699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77597c-fab6-4587-b0f2-a2f521e8fbb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:01.325699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77597c-fab6-4587-b0f2-a2f521e8fbb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:01.341752 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1490/2980] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:01 2021] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:52:01.341752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c24c85-5af8-4ddb-8821-adde12cd4d68 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:01.347831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-19c24c85-5af8-4ddb-8821-adde12cd4d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:01.350212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77597c-fab6-4587-b0f2-a2f521e8fbb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:01.352719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77597c-fab6-4587-b0f2-a2f521e8fbb1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:01.374473 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1491/2981] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:01.375402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77597c-fab6-4587-b0f2-a2f521e8fbb1 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:01.395441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77597c-fab6-4587-b0f2-a2f521e8fbb1 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:01.409792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33734af0-89c9-4445-b2e1-e5a92969182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:01.410491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33734af0-89c9-4445-b2e1-e5a92969182b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:01.410770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33734af0-89c9-4445-b2e1-e5a92969182b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:01.411061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33734af0-89c9-4445-b2e1-e5a92969182b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:01.412186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33734af0-89c9-4445-b2e1-e5a92969182b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:01.413915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33734af0-89c9-4445-b2e1-e5a92969182b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:01.437525 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1492/2982] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:01 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:01.441640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33734af0-89c9-4445-b2e1-e5a92969182b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:01.459061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33734af0-89c9-4445-b2e1-e5a92969182b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:01.465010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb980f-0da3-453f-accc-96d614dbcac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:01.471880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb980f-0da3-453f-accc-96d614dbcac0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:01.472210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb980f-0da3-453f-accc-96d614dbcac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:01.473859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb980f-0da3-453f-accc-96d614dbcac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:01.474818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb980f-0da3-453f-accc-96d614dbcac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:01.476747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb980f-0da3-453f-accc-96d614dbcac0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:01.489912 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1493/2983] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:01 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:52:01.493847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb980f-0da3-453f-accc-96d614dbcac0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:01.525323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb980f-0da3-453f-accc-96d614dbcac0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:01.533943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c24c85-5af8-4ddb-8821-adde12cd4d68 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:01.552008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05f66d-fcc8-4fe2-9e1b-bf02efb0bcc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:01.553014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05f66d-fcc8-4fe2-9e1b-bf02efb0bcc2 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:01.553739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05f66d-fcc8-4fe2-9e1b-bf02efb0bcc2 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:01.554214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05f66d-fcc8-4fe2-9e1b-bf02efb0bcc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:01.554863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218ffa9-f8d6-480d-bbad-cc015cb5441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:01.556081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218ffa9-f8d6-480d-bbad-cc015cb5441e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:01.556311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218ffa9-f8d6-480d-bbad-cc015cb5441e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:01.556593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218ffa9-f8d6-480d-bbad-cc015cb5441e admin admin] PATH_INFO: `/v3/projects/860926b451904e06b26ebd91e82b35a0/users/11e5c87df0bb404c92ef60c16f856474/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:01.557218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9c05f66d-fcc8-4fe2-9e1b-bf02efb0bcc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:01.594252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218ffa9-f8d6-480d-bbad-cc015cb5441e admin admin] RBAC: Authorizing `identity:create_grant(project_id=860926b451904e06b26ebd91e82b35a0, user_id=11e5c87df0bb404c92ef60c16f856474, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:01.604848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218ffa9-f8d6-480d-bbad-cc015cb5441e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:01.646727 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1494/2984] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:01 2021] PUT /identity/v3/projects/860926b451904e06b26ebd91e82b35a0/users/11e5c87df0bb404c92ef60c16f856474/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:01.658522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceab677-9ca8-46d2-9ada-3e51979969f3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:01.658867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceab677-9ca8-46d2-9ada-3e51979969f3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:01.659084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceab677-9ca8-46d2-9ada-3e51979969f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:01.679933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05f66d-fcc8-4fe2-9e1b-bf02efb0bcc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:01.681797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05f66d-fcc8-4fe2-9e1b-bf02efb0bcc2 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:01.721213 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1491/2985] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:01 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:01.737327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-eceab677-9ca8-46d2-9ada-3e51979969f3 None None] MFA Rules not processed for user `11e5c87df0bb404c92ef60c16f856474`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:01.738851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eceab677-9ca8-46d2-9ada-3e51979969f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:01.870138 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1495/2986] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:01 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:01.878148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05f66d-fcc8-4fe2-9e1b-bf02efb0bcc2 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:01.879594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9c05f66d-fcc8-4fe2-9e1b-bf02efb0bcc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:01.898654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05f66d-fcc8-4fe2-9e1b-bf02efb0bcc2 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:02.048208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db093b51-7d5d-4bd0-82b0-50c0e75c4f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:02.048879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db093b51-7d5d-4bd0-82b0-50c0e75c4f27 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:02.049216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db093b51-7d5d-4bd0-82b0-50c0e75c4f27 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:02.049497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db093b51-7d5d-4bd0-82b0-50c0e75c4f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:02.059573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db093b51-7d5d-4bd0-82b0-50c0e75c4f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:02.062133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db093b51-7d5d-4bd0-82b0-50c0e75c4f27 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:02.075779 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1492/2987] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:52:02.136368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceab677-9ca8-46d2-9ada-3e51979969f3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:02.138179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eceab677-9ca8-46d2-9ada-3e51979969f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:02.306168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceab677-9ca8-46d2-9ada-3e51979969f3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:02.312522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:02.314189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:02.314655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:02.315488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] PATH_INFO: `/v3/projects/e5c51658b4fb4f19b2c15cc64c7564bb` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:02.317626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c51658b4fb4f19b2c15cc64c7564bb)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:02.319818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:02.473532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c51658b4fb4f19b2c15cc64c7564bb', 'request_id': 'req-221708b1-7c0c-4bc4-8582-77b583c0c45d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.495286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c51658b4fb4f19b2c15cc64c7564bb', 'request_id': 'req-221708b1-7c0c-4bc4-8582-77b583c0c45d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.509472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c51658b4fb4f19b2c15cc64c7564bb', 'request_id': 'req-221708b1-7c0c-4bc4-8582-77b583c0c45d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.538559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] The token cache is being invalidate because project e5c51658b4fb4f19b2c15cc64c7564bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:02.539961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.545287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.550072 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1496/2988] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:02 2021] DELETE /identity/v3/projects/e5c51658b4fb4f19b2c15cc64c7564bb => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:02.551370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db093b51-7d5d-4bd0-82b0-50c0e75c4f27 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:02.565140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db093b51-7d5d-4bd0-82b0-50c0e75c4f27 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:02.644826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:02.646261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:02.723304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:02.724507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:02.724967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:02.725416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] PATH_INFO: `/v3/users/7d594027327e4aaa83a4333c97335ce2` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:02.727746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d594027327e4aaa83a4333c97335ce2)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:02.730054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:02.744856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221708b1-7c0c-4bc4-8582-77b583c0c45d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:02.754245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e74ae7-1f14-49f6-a6a5-bc9f915b4c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:02.755158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74ae7-1f14-49f6-a6a5-bc9f915b4c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:02.755479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74ae7-1f14-49f6-a6a5-bc9f915b4c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:02.755753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74ae7-1f14-49f6-a6a5-bc9f915b4c68 admin admin] PATH_INFO: `/v3/users/11e5c87df0bb404c92ef60c16f856474` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:02.758018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e74ae7-1f14-49f6-a6a5-bc9f915b4c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e5c87df0bb404c92ef60c16f856474)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:02.760065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e74ae7-1f14-49f6-a6a5-bc9f915b4c68 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:02.819672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d594027327e4aaa83a4333c97335ce2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.833483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d594027327e4aaa83a4333c97335ce2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.835555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d594027327e4aaa83a4333c97335ce2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.840537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83e74ae7-1f14-49f6-a6a5-bc9f915b4c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e5c87df0bb404c92ef60c16f856474'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.840537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83e74ae7-1f14-49f6-a6a5-bc9f915b4c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e5c87df0bb404c92ef60c16f856474'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.851423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83e74ae7-1f14-49f6-a6a5-bc9f915b4c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e5c87df0bb404c92ef60c16f856474'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.852863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83e74ae7-1f14-49f6-a6a5-bc9f915b4c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e5c87df0bb404c92ef60c16f856474'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.856629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d594027327e4aaa83a4333c97335ce2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.869289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83e74ae7-1f14-49f6-a6a5-bc9f915b4c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e5c87df0bb404c92ef60c16f856474'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.883962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d594027327e4aaa83a4333c97335ce2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:02.892488 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1497/2989] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:02 2021] DELETE /identity/v3/users/11e5c87df0bb404c92ef60c16f856474 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:02.898839 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1493/2990] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:02 2021] DELETE /identity/v3/users/7d594027327e4aaa83a4333c97335ce2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:02.901016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b669b4c-00a3-48c4-8e48-954aace9dfa4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:02.901537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b669b4c-00a3-48c4-8e48-954aace9dfa4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:02.902418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b669b4c-00a3-48c4-8e48-954aace9dfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:02.928940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4b669b4c-00a3-48c4-8e48-954aace9dfa4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:02.930197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4b669b4c-00a3-48c4-8e48-954aace9dfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:03.027438 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1498/2991] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:03.039015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:03.041276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:03.130981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e84640-3639-47db-abd9-8e938d47a9e1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:03.138850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969816db-87a7-48f5-b99d-d9b6afc4a7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:03.139924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969816db-87a7-48f5-b99d-d9b6afc4a7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:03.140678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969816db-87a7-48f5-b99d-d9b6afc4a7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:03.140678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969816db-87a7-48f5-b99d-d9b6afc4a7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:03.157743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969816db-87a7-48f5-b99d-d9b6afc4a7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:03.159580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969816db-87a7-48f5-b99d-d9b6afc4a7d6 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:03.172563 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1494/2992] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:03.409967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b669b4c-00a3-48c4-8e48-954aace9dfa4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:03.412718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4b669b4c-00a3-48c4-8e48-954aace9dfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:03.440150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b669b4c-00a3-48c4-8e48-954aace9dfa4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:03.463686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46b678-6640-432e-ade6-9ecad9154ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:03.464808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46b678-6640-432e-ade6-9ecad9154ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:03.465104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46b678-6640-432e-ade6-9ecad9154ead admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:03.465441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46b678-6640-432e-ade6-9ecad9154ead admin admin] PATH_INFO: `/v3/users/7e10693bd4a2442cb7c75cc61ccccc16` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:03.466923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46b678-6640-432e-ade6-9ecad9154ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e10693bd4a2442cb7c75cc61ccccc16)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:03.482728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46b678-6640-432e-ade6-9ecad9154ead admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:03.573114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6f46b678-6640-432e-ade6-9ecad9154ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e10693bd4a2442cb7c75cc61ccccc16'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:03.574377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6f46b678-6640-432e-ade6-9ecad9154ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e10693bd4a2442cb7c75cc61ccccc16'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:03.586446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6f46b678-6640-432e-ade6-9ecad9154ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e10693bd4a2442cb7c75cc61ccccc16'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:03.587227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6f46b678-6640-432e-ade6-9ecad9154ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e10693bd4a2442cb7c75cc61ccccc16'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:03.596473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6f46b678-6640-432e-ade6-9ecad9154ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e10693bd4a2442cb7c75cc61ccccc16'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:03.612456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969816db-87a7-48f5-b99d-d9b6afc4a7d6 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:03.618412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-969816db-87a7-48f5-b99d-d9b6afc4a7d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:03.631794 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1499/2993] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:03 2021] DELETE /identity/v3/users/7e10693bd4a2442cb7c75cc61ccccc16 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:03.640762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee8880-72af-4c2b-80a0-bddbabbc463d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:03.641045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee8880-72af-4c2b-80a0-bddbabbc463d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:03.641872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee8880-72af-4c2b-80a0-bddbabbc463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:03.649249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969816db-87a7-48f5-b99d-d9b6afc4a7d6 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:03.677360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-55ee8880-72af-4c2b-80a0-bddbabbc463d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:03.678604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-55ee8880-72af-4c2b-80a0-bddbabbc463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:03.770547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:03.770547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:03.770547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:03.770547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] PATH_INFO: `/v3/projects/683156220cc246a3a433248708e41329` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:03.772474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=683156220cc246a3a433248708e41329)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:03.774402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:03.843617 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1500/2994] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:03.854764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee8880-72af-4c2b-80a0-bddbabbc463d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:03.856664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-55ee8880-72af-4c2b-80a0-bddbabbc463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:03.928134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683156220cc246a3a433248708e41329', 'request_id': 'req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:03.953257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683156220cc246a3a433248708e41329', 'request_id': 'req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:03.982055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683156220cc246a3a433248708e41329', 'request_id': 'req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.001861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] The token cache is being invalidate because project 683156220cc246a3a433248708e41329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:04.002513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.003480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c677958e-7cde-4edc-81c0-e3a8f3d02e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.006701 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1495/2995] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:03 2021] DELETE /identity/v3/projects/683156220cc246a3a433248708e41329 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:04.013849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf393b-1ac2-45e0-ac05-c990a33c0151 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.014763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf393b-1ac2-45e0-ac05-c990a33c0151 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.015581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf393b-1ac2-45e0-ac05-c990a33c0151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.051536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee8880-72af-4c2b-80a0-bddbabbc463d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:04.083906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0daf393b-1ac2-45e0-ac05-c990a33c0151 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:04.086252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0daf393b-1ac2-45e0-ac05-c990a33c0151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.157191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3f349-a8eb-4167-bb12-b82bdab0b75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:04.157861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3f349-a8eb-4167-bb12-b82bdab0b75d service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.158147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3f349-a8eb-4167-bb12-b82bdab0b75d service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.158490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3f349-a8eb-4167-bb12-b82bdab0b75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.162809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7fe3f349-a8eb-4167-bb12-b82bdab0b75d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.209720 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1496/2996] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:04.210719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf393b-1ac2-45e0-ac05-c990a33c0151 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:04.212222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0daf393b-1ac2-45e0-ac05-c990a33c0151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.225793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf393b-1ac2-45e0-ac05-c990a33c0151 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:04.231809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:04.232679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.232965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.233243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] PATH_INFO: `/v3/projects/860926b451904e06b26ebd91e82b35a0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.234492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=860926b451904e06b26ebd91e82b35a0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:04.237126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:04.257797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3f349-a8eb-4167-bb12-b82bdab0b75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:04.271059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3f349-a8eb-4167-bb12-b82bdab0b75d service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:04.289648 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1501/2997] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:04.292203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a178-565c-4ad3-83ec-635f4b296ac1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.292507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a178-565c-4ad3-83ec-635f4b296ac1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.292777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a178-565c-4ad3-83ec-635f4b296ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.312106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-bea8a178-565c-4ad3-83ec-635f4b296ac1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:04.313948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bea8a178-565c-4ad3-83ec-635f4b296ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.322798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860926b451904e06b26ebd91e82b35a0', 'request_id': 'req-2a10ce73-d95a-4513-93f0-68d1ea720970'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.335189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860926b451904e06b26ebd91e82b35a0', 'request_id': 'req-2a10ce73-d95a-4513-93f0-68d1ea720970'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.345249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860926b451904e06b26ebd91e82b35a0', 'request_id': 'req-2a10ce73-d95a-4513-93f0-68d1ea720970'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.374436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] The token cache is being invalidate because project 860926b451904e06b26ebd91e82b35a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:04.375296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.376959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2a10ce73-d95a-4513-93f0-68d1ea720970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.384392 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1497/2998] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:04 2021] DELETE /identity/v3/projects/860926b451904e06b26ebd91e82b35a0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:04.386604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11033828-900c-4052-9932-e4b3a99afbd4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.387066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11033828-900c-4052-9932-e4b3a99afbd4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.387522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11033828-900c-4052-9932-e4b3a99afbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.411624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-11033828-900c-4052-9932-e4b3a99afbd4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:04.413126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-11033828-900c-4052-9932-e4b3a99afbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.456692 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1502/2999] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:04.457980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8a178-565c-4ad3-83ec-635f4b296ac1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:04.481791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8a178-565c-4ad3-83ec-635f4b296ac1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:04.492354 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1498/3000] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:04.496087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11033828-900c-4052-9932-e4b3a99afbd4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:04.499220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-11033828-900c-4052-9932-e4b3a99afbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.500116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f62dcd-4f3f-4115-a0b0-9e11e6099be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:04.501606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f62dcd-4f3f-4115-a0b0-9e11e6099be8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.502090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f62dcd-4f3f-4115-a0b0-9e11e6099be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.502557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f62dcd-4f3f-4115-a0b0-9e11e6099be8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.503516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f62dcd-4f3f-4115-a0b0-9e11e6099be8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:04.504163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f62dcd-4f3f-4115-a0b0-9e11e6099be8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:04.507015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f62dcd-4f3f-4115-a0b0-9e11e6099be8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:04.514277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11033828-900c-4052-9932-e4b3a99afbd4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:04.521419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:04.522669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.523136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.523475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] PATH_INFO: `/v3/users/ce7415c3ef574fde8b4e378d3f787cbc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.524975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7415c3ef574fde8b4e378d3f787cbc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:04.526760 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1503/3001] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:04.527203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:04.528754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bf154-f3c2-41f8-987e-803b4aec0e22 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.530819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bf154-f3c2-41f8-987e-803b4aec0e22 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.534628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bf154-f3c2-41f8-987e-803b4aec0e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.562109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ab4bf154-f3c2-41f8-987e-803b4aec0e22 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:04.564862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ab4bf154-f3c2-41f8-987e-803b4aec0e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.581444 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1504/3002] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:04.581444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bf154-f3c2-41f8-987e-803b4aec0e22 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:04.594780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bf154-f3c2-41f8-987e-803b4aec0e22 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:04.601570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ca02d-1c75-42c7-aed1-dec23db3f32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:04.602332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca02d-1c75-42c7-aed1-dec23db3f32e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.602663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7415c3ef574fde8b4e378d3f787cbc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.602814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca02d-1c75-42c7-aed1-dec23db3f32e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.603094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca02d-1c75-42c7-aed1-dec23db3f32e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.604750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ca02d-1c75-42c7-aed1-dec23db3f32e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:04.607924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ca02d-1c75-42c7-aed1-dec23db3f32e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:04.622351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7415c3ef574fde8b4e378d3f787cbc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.631298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7415c3ef574fde8b4e378d3f787cbc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.644884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7415c3ef574fde8b4e378d3f787cbc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.652078 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1505/3003] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:04 2021] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:04.653003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ca02d-1c75-42c7-aed1-dec23db3f32e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:04.655150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c93ca02d-1c75-42c7-aed1-dec23db3f32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.660537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7415c3ef574fde8b4e378d3f787cbc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.668175 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1499/3004] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:04 2021] DELETE /identity/v3/users/ce7415c3ef574fde8b4e378d3f787cbc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:04.669714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:04.671621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.734418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ca02d-1c75-42c7-aed1-dec23db3f32e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:04.737875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002afe6-3b53-4304-850d-6cc50cc26feb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:04.740354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bd18c-bf1e-4a97-bad1-d1ce3472aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:04.741097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bd18c-bf1e-4a97-bad1-d1ce3472aa46 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.741459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bd18c-bf1e-4a97-bad1-d1ce3472aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.741812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bd18c-bf1e-4a97-bad1-d1ce3472aa46 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.743946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bd18c-bf1e-4a97-bad1-d1ce3472aa46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:04.744076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:04.744618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bd18c-bf1e-4a97-bad1-d1ce3472aa46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:04.744886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.745170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.745446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] PATH_INFO: `/v3/projects/eb7f37181c464b6fbd15d9f235d94086` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.746646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7f37181c464b6fbd15d9f235d94086)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:04.747455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bd18c-bf1e-4a97-bad1-d1ce3472aa46 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:04.748555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:04.762920 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1506/3005] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:04.764350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bd18c-bf1e-4a97-bad1-d1ce3472aa46 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:04.768024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4f9bd18c-bf1e-4a97-bad1-d1ce3472aa46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.785029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bd18c-bf1e-4a97-bad1-d1ce3472aa46 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:04.791764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81b78a-90b0-48e9-8d3f-5162b7640933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:04.792716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b78a-90b0-48e9-8d3f-5162b7640933 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.793216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b78a-90b0-48e9-8d3f-5162b7640933 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.793611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b78a-90b0-48e9-8d3f-5162b7640933 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.794386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81b78a-90b0-48e9-8d3f-5162b7640933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:04.796588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81b78a-90b0-48e9-8d3f-5162b7640933 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:04.808871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7f37181c464b6fbd15d9f235d94086', 'request_id': 'req-577a557b-0666-4e9a-a251-cd4ed0e4d790'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.820634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7f37181c464b6fbd15d9f235d94086', 'request_id': 'req-577a557b-0666-4e9a-a251-cd4ed0e4d790'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.831633 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1507/3006] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:04 2021] POST /identity/v3/users => generated 291 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:04.834037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9586e-0a97-46aa-b57e-e659f7a20650 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.834037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9586e-0a97-46aa-b57e-e659f7a20650 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.834893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9586e-0a97-46aa-b57e-e659f7a20650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.841077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7f37181c464b6fbd15d9f235d94086', 'request_id': 'req-577a557b-0666-4e9a-a251-cd4ed0e4d790'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.857358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] The token cache is being invalidate because project eb7f37181c464b6fbd15d9f235d94086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:04.857692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.858396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-eba9586e-0a97-46aa-b57e-e659f7a20650 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:04.858885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:04.859791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eba9586e-0a97-46aa-b57e-e659f7a20650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.860861 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1500/3007] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:04 2021] DELETE /identity/v3/projects/eb7f37181c464b6fbd15d9f235d94086 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:04.861642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:04.862998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.942405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a557b-0666-4e9a-a251-cd4ed0e4d790 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:04.949732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32965173-62bf-43f6-9ae6-ee1f8c975109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:04.949955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32965173-62bf-43f6-9ae6-ee1f8c975109 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.950160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32965173-62bf-43f6-9ae6-ee1f8c975109 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.950440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32965173-62bf-43f6-9ae6-ee1f8c975109 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.951395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32965173-62bf-43f6-9ae6-ee1f8c975109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:04.953100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32965173-62bf-43f6-9ae6-ee1f8c975109 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:04.956391 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1508/3008] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:04.957436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9586e-0a97-46aa-b57e-e659f7a20650 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:04.959115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eba9586e-0a97-46aa-b57e-e659f7a20650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:04.976220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9586e-0a97-46aa-b57e-e659f7a20650 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:04.982448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f6cd0-bbc9-4e21-89fa-b30ce0903a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:04.983038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f6cd0-bbc9-4e21-89fa-b30ce0903a93 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:04.983948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f6cd0-bbc9-4e21-89fa-b30ce0903a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:04.984281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f6cd0-bbc9-4e21-89fa-b30ce0903a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:04.985052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f6cd0-bbc9-4e21-89fa-b30ce0903a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:04.986723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f6cd0-bbc9-4e21-89fa-b30ce0903a93 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:05.000562 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1509/3009] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:04 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:05.000562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5680-74a9-4962-a39b-9a4317bb14f8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.000562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5680-74a9-4962-a39b-9a4317bb14f8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.000562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea5680-74a9-4962-a39b-9a4317bb14f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.001398 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1501/3010] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:04 2021] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:05.002181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32965173-62bf-43f6-9ae6-ee1f8c975109 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.005426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-32965173-62bf-43f6-9ae6-ee1f8c975109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:05.024186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-eeea5680-74a9-4962-a39b-9a4317bb14f8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:05.025453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eeea5680-74a9-4962-a39b-9a4317bb14f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:05.111628 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1510/3011] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:05.121335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5680-74a9-4962-a39b-9a4317bb14f8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.127217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32965173-62bf-43f6-9ae6-ee1f8c975109 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:05.132049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876fc14-c570-4ee4-ab21-bf87ff7c1bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:05.132734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876fc14-c570-4ee4-ab21-bf87ff7c1bdf service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.133009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876fc14-c570-4ee4-ab21-bf87ff7c1bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.133636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876fc14-c570-4ee4-ab21-bf87ff7c1bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.144136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea5680-74a9-4962-a39b-9a4317bb14f8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:05.159639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876fc14-c570-4ee4-ab21-bf87ff7c1bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:05.161285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876fc14-c570-4ee4-ab21-bf87ff7c1bdf service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:05.163434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10ea07-61c1-4952-9c62-ab40b407a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:05.167737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10ea07-61c1-4952-9c62-ab40b407a777 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.168133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10ea07-61c1-4952-9c62-ab40b407a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.168439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10ea07-61c1-4952-9c62-ab40b407a777 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.169441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10ea07-61c1-4952-9c62-ab40b407a777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:05.171334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10ea07-61c1-4952-9c62-ab40b407a777 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:05.181450 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1502/3012] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:05.192032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876fc14-c570-4ee4-ab21-bf87ff7c1bdf service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.212379 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1511/3013] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:05 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:05.214466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876fc14-c570-4ee4-ab21-bf87ff7c1bdf service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:05.215909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd96a-8787-4140-9c58-b98d35a34f77 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.217980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd96a-8787-4140-9c58-b98d35a34f77 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.218273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dd96a-8787-4140-9c58-b98d35a34f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.229411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358c8a6-8e00-433d-9bbe-b7847c5ff9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:05.230087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358c8a6-8e00-433d-9bbe-b7847c5ff9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.230366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358c8a6-8e00-433d-9bbe-b7847c5ff9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.230637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358c8a6-8e00-433d-9bbe-b7847c5ff9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.231366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358c8a6-8e00-433d-9bbe-b7847c5ff9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:05.233277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358c8a6-8e00-433d-9bbe-b7847c5ff9f1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:05.259557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b04dd96a-8787-4140-9c58-b98d35a34f77 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:05.260870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b04dd96a-8787-4140-9c58-b98d35a34f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:05.276292 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1503/3014] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:05 2021] POST /identity/v3/users => generated 287 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:05.278458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358c8a6-8e00-433d-9bbe-b7847c5ff9f1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.284561 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1512/3015] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:05.286602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dd96a-8787-4140-9c58-b98d35a34f77 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.299214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358c8a6-8e00-433d-9bbe-b7847c5ff9f1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:05.310818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c144ac9-7a5f-4ba3-8261-15bd439c0d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:05.314705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dd96a-8787-4140-9c58-b98d35a34f77 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:05.316131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c144ac9-7a5f-4ba3-8261-15bd439c0d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.318612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c144ac9-7a5f-4ba3-8261-15bd439c0d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.318901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c144ac9-7a5f-4ba3-8261-15bd439c0d5e admin admin] PATH_INFO: `/v3/projects/742998b08aec4df0844e1fbf2ecb4479/users/577c5d661d1a43a38e41deeca0c88aa7/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.332149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e336473-1f2a-4001-9acf-111648f97651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:05.333524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336473-1f2a-4001-9acf-111648f97651 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.333807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336473-1f2a-4001-9acf-111648f97651 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.334079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e336473-1f2a-4001-9acf-111648f97651 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.334909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e336473-1f2a-4001-9acf-111648f97651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:05.340780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e336473-1f2a-4001-9acf-111648f97651 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:05.371759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c144ac9-7a5f-4ba3-8261-15bd439c0d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=742998b08aec4df0844e1fbf2ecb4479, user_id=577c5d661d1a43a38e41deeca0c88aa7, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:05.372039 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1513/3016] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:05 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:05.373328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e336473-1f2a-4001-9acf-111648f97651 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.374302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c144ac9-7a5f-4ba3-8261-15bd439c0d5e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:05.392918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e336473-1f2a-4001-9acf-111648f97651 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:05.400280 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1504/3017] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:05 2021] PUT /identity/v3/projects/742998b08aec4df0844e1fbf2ecb4479/users/577c5d661d1a43a38e41deeca0c88aa7/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:05.401037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c144ac9-7a5f-4ba3-8261-15bd439c0d5e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.480549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21593a-d1f5-4b62-a022-92afae8e9ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:05.481945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21593a-d1f5-4b62-a022-92afae8e9ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.482452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21593a-d1f5-4b62-a022-92afae8e9ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.482801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21593a-d1f5-4b62-a022-92afae8e9ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.483673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21593a-d1f5-4b62-a022-92afae8e9ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:05.484275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21593a-d1f5-4b62-a022-92afae8e9ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:05.486736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21593a-d1f5-4b62-a022-92afae8e9ef1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:05.506537 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1514/3018] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:05.508364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42715025-f848-4ff4-9c21-a19c28a15fe5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.509544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42715025-f848-4ff4-9c21-a19c28a15fe5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.510497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42715025-f848-4ff4-9c21-a19c28a15fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.550333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-42715025-f848-4ff4-9c21-a19c28a15fe5 None None] MFA Rules not processed for user `577c5d661d1a43a38e41deeca0c88aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:05.552460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-42715025-f848-4ff4-9c21-a19c28a15fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:05.556916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c144ac9-7a5f-4ba3-8261-15bd439c0d5e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:05.569754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d548eb-1bc8-46d7-8dbf-985d4c2cdce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:05.570441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d548eb-1bc8-46d7-8dbf-985d4c2cdce4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.570843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d548eb-1bc8-46d7-8dbf-985d4c2cdce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.570979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d548eb-1bc8-46d7-8dbf-985d4c2cdce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.574706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d548eb-1bc8-46d7-8dbf-985d4c2cdce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:05.576705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d548eb-1bc8-46d7-8dbf-985d4c2cdce4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:05.601203 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1505/3019] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:05 2021] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:05.602076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d548eb-1bc8-46d7-8dbf-985d4c2cdce4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.631633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d548eb-1bc8-46d7-8dbf-985d4c2cdce4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:05.645252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af16572-ad83-48c8-ab49-7fb13655f5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:05.645930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af16572-ad83-48c8-ab49-7fb13655f5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.646218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af16572-ad83-48c8-ab49-7fb13655f5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.646827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af16572-ad83-48c8-ab49-7fb13655f5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.647601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af16572-ad83-48c8-ab49-7fb13655f5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:05.649698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af16572-ad83-48c8-ab49-7fb13655f5b9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:05.690431 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1515/3020] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:05 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:05.691004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42715025-f848-4ff4-9c21-a19c28a15fe5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.698233 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1506/3021] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:05 2021] POST /identity/v3/projects => generated 399 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:05.700424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af16572-ad83-48c8-ab49-7fb13655f5b9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.725409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42715025-f848-4ff4-9c21-a19c28a15fe5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:05.820015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2426ee2-1a7c-499a-9442-1387c0d46e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:05.820015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2426ee2-1a7c-499a-9442-1387c0d46e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.820015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2426ee2-1a7c-499a-9442-1387c0d46e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.820567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2426ee2-1a7c-499a-9442-1387c0d46e08 admin admin] PATH_INFO: `/v3/projects/c20895c1ea684b139e4b6802d7a80ba1/users/641fe530de494a4fb1fefcd7688fb725/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.824060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af16572-ad83-48c8-ab49-7fb13655f5b9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:05.830500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d23197-a9ae-4e7a-8f1b-cd9500a7da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:05.830982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d23197-a9ae-4e7a-8f1b-cd9500a7da31 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:05.831279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d23197-a9ae-4e7a-8f1b-cd9500a7da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:05.831606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d23197-a9ae-4e7a-8f1b-cd9500a7da31 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:05.832308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d23197-a9ae-4e7a-8f1b-cd9500a7da31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:05.834227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d23197-a9ae-4e7a-8f1b-cd9500a7da31 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:05.838970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2426ee2-1a7c-499a-9442-1387c0d46e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20895c1ea684b139e4b6802d7a80ba1, user_id=641fe530de494a4fb1fefcd7688fb725, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:05.842698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2426ee2-1a7c-499a-9442-1387c0d46e08 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:05.869084 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1507/3022] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:05 2021] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:05.870853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d23197-a9ae-4e7a-8f1b-cd9500a7da31 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.878902 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1516/3023] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:05 2021] PUT /identity/v3/projects/c20895c1ea684b139e4b6802d7a80ba1/users/641fe530de494a4fb1fefcd7688fb725/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:05.893004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2426ee2-1a7c-499a-9442-1387c0d46e08 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:05.927106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d2426ee2-1a7c-499a-9442-1387c0d46e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:06.006961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d23197-a9ae-4e7a-8f1b-cd9500a7da31 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:06.020494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d9dc0-0828-4af1-874c-9f9186ebd4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:06.021303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d9dc0-0828-4af1-874c-9f9186ebd4df admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.021588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d9dc0-0828-4af1-874c-9f9186ebd4df admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.021859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d9dc0-0828-4af1-874c-9f9186ebd4df admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.022705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d9dc0-0828-4af1-874c-9f9186ebd4df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:06.034015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d9dc0-0828-4af1-874c-9f9186ebd4df admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:06.045824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2426ee2-1a7c-499a-9442-1387c0d46e08 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:06.053085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:06.054484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.054825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.055105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] PATH_INFO: `/v3/projects/49bcc58fc8444ca188eb8b273931ea09` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.057210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=49bcc58fc8444ca188eb8b273931ea09)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:06.059913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:06.070531 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1508/3024] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:05 2021] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:06.071734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d9dc0-0828-4af1-874c-9f9186ebd4df admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:06.087400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d9dc0-0828-4af1-874c-9f9186ebd4df admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:06.097645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a9561-3f43-4730-8b89-f0da4abe21fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:06.098499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9561-3f43-4730-8b89-f0da4abe21fc admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.098919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9561-3f43-4730-8b89-f0da4abe21fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.099039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a9561-3f43-4730-8b89-f0da4abe21fc admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.099986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a9561-3f43-4730-8b89-f0da4abe21fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:06.102417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a9561-3f43-4730-8b89-f0da4abe21fc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:06.128155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bcc58fc8444ca188eb8b273931ea09', 'request_id': 'req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:06.136310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bcc58fc8444ca188eb8b273931ea09', 'request_id': 'req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:06.138010 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1509/3025] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:06 2021] POST /identity/v3/users => generated 297 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:06.142896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8aca9-f9c2-42f5-ae2a-05f25c84ae86 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.143092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8aca9-f9c2-42f5-ae2a-05f25c84ae86 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.143460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8aca9-f9c2-42f5-ae2a-05f25c84ae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.157701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bcc58fc8444ca188eb8b273931ea09', 'request_id': 'req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:06.172783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] The token cache is being invalidate because project 49bcc58fc8444ca188eb8b273931ea09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:06.173110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:06.173967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:06.177614 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1517/3026] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:05 2021] DELETE /identity/v3/projects/49bcc58fc8444ca188eb8b273931ea09 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:06.178448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:06.179988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:06.205035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-20e8aca9-f9c2-42f5-ae2a-05f25c84ae86 None None] MFA Rules not processed for user `641fe530de494a4fb1fefcd7688fb725`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:06.206560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-20e8aca9-f9c2-42f5-ae2a-05f25c84ae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:06.274235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f1f79-d50f-4de2-9943-a67ca6e98eaa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:06.279513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae6be1-ff3b-4106-8dd1-226cdc639665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:06.280314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae6be1-ff3b-4106-8dd1-226cdc639665 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.280661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae6be1-ff3b-4106-8dd1-226cdc639665 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.281178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae6be1-ff3b-4106-8dd1-226cdc639665 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.282033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae6be1-ff3b-4106-8dd1-226cdc639665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:06.283905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae6be1-ff3b-4106-8dd1-226cdc639665 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:06.295105 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1518/3027] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:06 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:06.296116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae6be1-ff3b-4106-8dd1-226cdc639665 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:06.298232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-18ae6be1-ff3b-4106-8dd1-226cdc639665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:06.303061 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1510/3028] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:06 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:06.310253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cd409-3f17-4a54-9902-743a8231f241 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.310777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cd409-3f17-4a54-9902-743a8231f241 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.311442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cd409-3f17-4a54-9902-743a8231f241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.315502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae6be1-ff3b-4106-8dd1-226cdc639665 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:06.321199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1754bb-025e-4230-a580-3840c985dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:06.321867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1754bb-025e-4230-a580-3840c985dfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.322149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1754bb-025e-4230-a580-3840c985dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.322738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1754bb-025e-4230-a580-3840c985dfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.323206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1754bb-025e-4230-a580-3840c985dfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:06.324936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1754bb-025e-4230-a580-3840c985dfa2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:06.337389 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1519/3029] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:06 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:06.338392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1754bb-025e-4230-a580-3840c985dfa2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:06.349750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1754bb-025e-4230-a580-3840c985dfa2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:06.354699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e978fc4-02d6-46e7-8e09-77ac3ffd4dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:06.355393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e978fc4-02d6-46e7-8e09-77ac3ffd4dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.355674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e978fc4-02d6-46e7-8e09-77ac3ffd4dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.355939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e978fc4-02d6-46e7-8e09-77ac3ffd4dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.356664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e978fc4-02d6-46e7-8e09-77ac3ffd4dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:06.357437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ae1cd409-3f17-4a54-9902-743a8231f241 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:06.358686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e978fc4-02d6-46e7-8e09-77ac3ffd4dd0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:06.359539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ae1cd409-3f17-4a54-9902-743a8231f241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:06.370629 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1520/3030] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:06.379834 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1511/3031] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:06.380442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cd409-3f17-4a54-9902-743a8231f241 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:06.382937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e978fc4-02d6-46e7-8e09-77ac3ffd4dd0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:06.387211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4e978fc4-02d6-46e7-8e09-77ac3ffd4dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:06.402100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cd409-3f17-4a54-9902-743a8231f241 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:06.408448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce43e48-6eab-4332-8c4c-0d76f46b4499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:06.409343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce43e48-6eab-4332-8c4c-0d76f46b4499 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.409632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce43e48-6eab-4332-8c4c-0d76f46b4499 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.409896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce43e48-6eab-4332-8c4c-0d76f46b4499 admin admin] PATH_INFO: `/v3/projects/3607774190ce41318c3f197c912e9025/users/56dc6814eb4a422eac4b14b330905321/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.458901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce43e48-6eab-4332-8c4c-0d76f46b4499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3607774190ce41318c3f197c912e9025, user_id=56dc6814eb4a422eac4b14b330905321, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:06.465346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce43e48-6eab-4332-8c4c-0d76f46b4499 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:06.518217 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1512/3032] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:06 2021] PUT /identity/v3/projects/3607774190ce41318c3f197c912e9025/users/56dc6814eb4a422eac4b14b330905321/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:06.520308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce43e48-6eab-4332-8c4c-0d76f46b4499 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:06.580812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e978fc4-02d6-46e7-8e09-77ac3ffd4dd0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:06.666263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce43e48-6eab-4332-8c4c-0d76f46b4499 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:06.691837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f764a7-b6e3-47a3-9663-ed12bcd8acc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:06.692525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f764a7-b6e3-47a3-9663-ed12bcd8acc0 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.692934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f764a7-b6e3-47a3-9663-ed12bcd8acc0 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.693076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fcceb-918f-49ac-bf1c-ece23081c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:06.693548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f764a7-b6e3-47a3-9663-ed12bcd8acc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.694097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fcceb-918f-49ac-bf1c-ece23081c513 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.694468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fcceb-918f-49ac-bf1c-ece23081c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.694801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fcceb-918f-49ac-bf1c-ece23081c513 admin admin] PATH_INFO: `/v3/projects/483860ef169447208569ca7510affe41/users/4143c311f90d4b6bbae7b8eddcbef26f/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.726775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fcceb-918f-49ac-bf1c-ece23081c513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=483860ef169447208569ca7510affe41, user_id=4143c311f90d4b6bbae7b8eddcbef26f, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:06.729475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fcceb-918f-49ac-bf1c-ece23081c513 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:06.759131 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1513/3033] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:06 2021] PUT /identity/v3/projects/483860ef169447208569ca7510affe41/users/4143c311f90d4b6bbae7b8eddcbef26f/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:06.764078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f64f10-a578-4cb0-a941-3bed51e31898 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.764470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f64f10-a578-4cb0-a941-3bed51e31898 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.764904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f64f10-a578-4cb0-a941-3bed51e31898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.792057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f764a7-b6e3-47a3-9663-ed12bcd8acc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:06.794913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f764a7-b6e3-47a3-9663-ed12bcd8acc0 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:06.802091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-79f64f10-a578-4cb0-a941-3bed51e31898 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:06.803786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-79f64f10-a578-4cb0-a941-3bed51e31898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:06.811917 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1521/3034] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:06 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:06.812506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f764a7-b6e3-47a3-9663-ed12bcd8acc0 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:06.831398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f764a7-b6e3-47a3-9663-ed12bcd8acc0 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:06.943408 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1514/3035] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:06.945081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fc092-60cc-430d-9de9-2a3b79fb2b08 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.947826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fc092-60cc-430d-9de9-2a3b79fb2b08 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.950633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fc092-60cc-430d-9de9-2a3b79fb2b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.961019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc61418-5cb2-48a4-9bd3-fec0c033badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:06.961775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc61418-5cb2-48a4-9bd3-fec0c033badf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.961986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc61418-5cb2-48a4-9bd3-fec0c033badf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.962244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc61418-5cb2-48a4-9bd3-fec0c033badf admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.962972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc61418-5cb2-48a4-9bd3-fec0c033badf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:06.964610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc61418-5cb2-48a4-9bd3-fec0c033badf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:06.973542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-af8fc092-60cc-430d-9de9-2a3b79fb2b08 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:06.974770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-af8fc092-60cc-430d-9de9-2a3b79fb2b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:06.979374 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1522/3036] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:06 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:06.980096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d52ea-dc9d-49bd-bcff-2b5d520306f6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:06.980394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d52ea-dc9d-49bd-bcff-2b5d520306f6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:06.980673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d52ea-dc9d-49bd-bcff-2b5d520306f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:06.987074 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1515/3037] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:06.988230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fc092-60cc-430d-9de9-2a3b79fb2b08 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:07.012104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fc092-60cc-430d-9de9-2a3b79fb2b08 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:07.021060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d99f9c-d13c-4d6a-be52-398533cb5ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:07.021932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99f9c-d13c-4d6a-be52-398533cb5ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.022442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99f9c-d13c-4d6a-be52-398533cb5ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.022918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99f9c-d13c-4d6a-be52-398533cb5ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.023778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a07d52ea-dc9d-49bd-bcff-2b5d520306f6 None None] MFA Rules not processed for user `bd59bfbd18e94dbebb2d3a6965c741d3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:07.024169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d99f9c-d13c-4d6a-be52-398533cb5ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:07.024630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d99f9c-d13c-4d6a-be52-398533cb5ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:07.025597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a07d52ea-dc9d-49bd-bcff-2b5d520306f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:07.026589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d99f9c-d13c-4d6a-be52-398533cb5ce2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:07.040660 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1516/3038] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:07.041943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d99f9c-d13c-4d6a-be52-398533cb5ce2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:07.057346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d99f9c-d13c-4d6a-be52-398533cb5ce2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:07.065898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3f27-b822-4e70-bd41-979816642e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:07.067611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3f27-b822-4e70-bd41-979816642e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.068881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3f27-b822-4e70-bd41-979816642e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.069562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f3f27-b822-4e70-bd41-979816642e71 admin admin] PATH_INFO: `/v3/projects/3607774190ce41318c3f197c912e9025/users/56dc6814eb4a422eac4b14b330905321/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.072174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f3f27-b822-4e70-bd41-979816642e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3607774190ce41318c3f197c912e9025, user_id=56dc6814eb4a422eac4b14b330905321, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:07.075319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f3f27-b822-4e70-bd41-979816642e71 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:07.095424 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1517/3039] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:07 2021] PUT /identity/v3/projects/3607774190ce41318c3f197c912e9025/users/56dc6814eb4a422eac4b14b330905321/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:07.095424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3f27-b822-4e70-bd41-979816642e71 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:07.097970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ab1f3f27-b822-4e70-bd41-979816642e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:07.129321 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1523/3040] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:06 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:07.130665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d52ea-dc9d-49bd-bcff-2b5d520306f6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:07.145513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d52ea-dc9d-49bd-bcff-2b5d520306f6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:07.177935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f3f27-b822-4e70-bd41-979816642e71 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:07.183914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c957203-ccf3-4176-8ca8-c08c416a191d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:07.184668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c957203-ccf3-4176-8ca8-c08c416a191d service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.184959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c957203-ccf3-4176-8ca8-c08c416a191d service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.185241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c957203-ccf3-4176-8ca8-c08c416a191d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.242764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a21ad-da49-44f2-855d-2a24fec13f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:07.243728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a21ad-da49-44f2-855d-2a24fec13f03 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.244011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a21ad-da49-44f2-855d-2a24fec13f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.244622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a21ad-da49-44f2-855d-2a24fec13f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.245049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a21ad-da49-44f2-855d-2a24fec13f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:07.246983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a21ad-da49-44f2-855d-2a24fec13f03 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:07.260603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c957203-ccf3-4176-8ca8-c08c416a191d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:07.262225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c957203-ccf3-4176-8ca8-c08c416a191d service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:07.275592 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1518/3041] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:07.276983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a845e9-d4bd-42b4-945b-983af1c1124f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.277306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a845e9-d4bd-42b4-945b-983af1c1124f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.277553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a845e9-d4bd-42b4-945b-983af1c1124f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.281430 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1524/3042] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:07 2021] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:07.281430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a21ad-da49-44f2-855d-2a24fec13f03 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:07.281430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4a8a21ad-da49-44f2-855d-2a24fec13f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:07.315924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-33a845e9-d4bd-42b4-945b-983af1c1124f None None] MFA Rules not processed for user `56dc6814eb4a422eac4b14b330905321`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:07.318896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-33a845e9-d4bd-42b4-945b-983af1c1124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:07.374023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a21ad-da49-44f2-855d-2a24fec13f03 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:07.388419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fb641-b804-4e35-be1c-bb423652d81d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:07.389417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fb641-b804-4e35-be1c-bb423652d81d service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.390737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fb641-b804-4e35-be1c-bb423652d81d service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.391627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fb641-b804-4e35-be1c-bb423652d81d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.425610 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1519/3043] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:07 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:07.425610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a845e9-d4bd-42b4-945b-983af1c1124f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:07.471342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fb641-b804-4e35-be1c-bb423652d81d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:07.475474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fb641-b804-4e35-be1c-bb423652d81d service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:07.491175 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1525/3044] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:07 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:07.506250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a845e9-d4bd-42b4-945b-983af1c1124f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:07.511483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c7012-00a4-4dda-b817-7b07830a89aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:07.512164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7012-00a4-4dda-b817-7b07830a89aa admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.512444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7012-00a4-4dda-b817-7b07830a89aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.512722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c7012-00a4-4dda-b817-7b07830a89aa admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.513428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c7012-00a4-4dda-b817-7b07830a89aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:07.515880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c7012-00a4-4dda-b817-7b07830a89aa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:07.541901 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1520/3045] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:07 2021] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:07.546072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fb641-b804-4e35-be1c-bb423652d81d service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:07.557662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fb641-b804-4e35-be1c-bb423652d81d service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:07.562371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4b8e-e7f5-44f6-a01a-c52aaaf82e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:07.563668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4b8e-e7f5-44f6-a01a-c52aaaf82e40 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.564050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4b8e-e7f5-44f6-a01a-c52aaaf82e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.564397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b4b8e-e7f5-44f6-a01a-c52aaaf82e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.565448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b4b8e-e7f5-44f6-a01a-c52aaaf82e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:07.566984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b4b8e-e7f5-44f6-a01a-c52aaaf82e40 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:07.578481 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1526/3046] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:52:07.583048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c7012-00a4-4dda-b817-7b07830a89aa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:07.595847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c7012-00a4-4dda-b817-7b07830a89aa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:07.602056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8fa97-185f-4092-b8ab-b63d5293725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:07.602948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8fa97-185f-4092-b8ab-b63d5293725d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.603399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8fa97-185f-4092-b8ab-b63d5293725d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.603683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8fa97-185f-4092-b8ab-b63d5293725d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.604434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8fa97-185f-4092-b8ab-b63d5293725d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:07.606068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8fa97-185f-4092-b8ab-b63d5293725d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:07.631005 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1521/3047] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:07 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:07.635456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4b8e-e7f5-44f6-a01a-c52aaaf82e40 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:07.648197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b4b8e-e7f5-44f6-a01a-c52aaaf82e40 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:07.653740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff9d00-6c91-408e-a7a7-0343b1fed64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:07.660600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff9d00-6c91-408e-a7a7-0343b1fed64f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.660964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff9d00-6c91-408e-a7a7-0343b1fed64f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.661249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff9d00-6c91-408e-a7a7-0343b1fed64f admin admin] PATH_INFO: `/v3/projects/4dad5146bddc4e1384ddf1f394d83eb9/users/739206ebdd594104a61116b3d6e1febb/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.677638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff9d00-6c91-408e-a7a7-0343b1fed64f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dad5146bddc4e1384ddf1f394d83eb9, user_id=739206ebdd594104a61116b3d6e1febb, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:07.680740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff9d00-6c91-408e-a7a7-0343b1fed64f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:07.707519 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1527/3048] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:07 2021] PUT /identity/v3/projects/4dad5146bddc4e1384ddf1f394d83eb9/users/739206ebdd594104a61116b3d6e1febb/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:07.708885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364958-f876-40e0-9bd3-9c3f63f14aa6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.709333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364958-f876-40e0-9bd3-9c3f63f14aa6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.709438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364958-f876-40e0-9bd3-9c3f63f14aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.732142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a9364958-f876-40e0-9bd3-9c3f63f14aa6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:07.733980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a9364958-f876-40e0-9bd3-9c3f63f14aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:07.823706 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1522/3049] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:07.842745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff9d00-6c91-408e-a7a7-0343b1fed64f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:07.935121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff9d00-6c91-408e-a7a7-0343b1fed64f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:07.939808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537359ad-7cb9-46c0-a1dd-3289d98b705c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:07.940507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537359ad-7cb9-46c0-a1dd-3289d98b705c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:07.940869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537359ad-7cb9-46c0-a1dd-3289d98b705c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:07.941291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537359ad-7cb9-46c0-a1dd-3289d98b705c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:07.963446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537359ad-7cb9-46c0-a1dd-3289d98b705c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:07.965773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537359ad-7cb9-46c0-a1dd-3289d98b705c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:07.981758 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1528/3050] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:08.070968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d9686-86d7-45d0-950f-9ee5fbbde5bb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:08.071290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d9686-86d7-45d0-950f-9ee5fbbde5bb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:08.071503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d9686-86d7-45d0-950f-9ee5fbbde5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:08.128110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-509d9686-86d7-45d0-950f-9ee5fbbde5bb None None] MFA Rules not processed for user `4143c311f90d4b6bbae7b8eddcbef26f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:08.129735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-509d9686-86d7-45d0-950f-9ee5fbbde5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:08.252347 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1523/3051] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:08 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:08.262037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a46e87-27d5-45b4-90aa-864c7252a75b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:08.262343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a46e87-27d5-45b4-90aa-864c7252a75b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:08.262596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a46e87-27d5-45b4-90aa-864c7252a75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:08.294844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b5a46e87-27d5-45b4-90aa-864c7252a75b None None] MFA Rules not processed for user `4143c311f90d4b6bbae7b8eddcbef26f`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:08.296083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b5a46e87-27d5-45b4-90aa-864c7252a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:08.314814 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1529/3052] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:08 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:08.458165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d9686-86d7-45d0-950f-9ee5fbbde5bb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:08.583914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d9686-86d7-45d0-950f-9ee5fbbde5bb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:08.602081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978f99c-43d0-4adf-be13-0912ccf56c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:08.602758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f99c-43d0-4adf-be13-0912ccf56c35 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:08.603042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f99c-43d0-4adf-be13-0912ccf56c35 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:08.603343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978f99c-43d0-4adf-be13-0912ccf56c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:08.685809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978f99c-43d0-4adf-be13-0912ccf56c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:08.687425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978f99c-43d0-4adf-be13-0912ccf56c35 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:08.697926 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1524/3053] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:08 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:08.714627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fedeeb-f4cd-4bb6-9778-c7f8375db11e None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:08.715433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fedeeb-f4cd-4bb6-9778-c7f8375db11e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:08.715970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fedeeb-f4cd-4bb6-9778-c7f8375db11e None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:08.718417 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1530/3054] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:52:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:52:08.725385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978f99c-43d0-4adf-be13-0912ccf56c35 service nova] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:52:08.736998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978f99c-43d0-4adf-be13-0912ccf56c35 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:08.746514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978f99c-43d0-4adf-be13-0912ccf56c35 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:08.752126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6c242-27cc-402b-9113-a92bd6980945 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc6814eb4a422eac4b14b330905321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3607774190ce41318c3f197c912e9025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:08.752995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6c242-27cc-402b-9113-a92bd6980945 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:08.753279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6c242-27cc-402b-9113-a92bd6980945 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:08.753552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6c242-27cc-402b-9113-a92bd6980945 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] PATH_INFO: `/v3/projects/742998b08aec4df0844e1fbf2ecb4479` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:08.754974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6c242-27cc-402b-9113-a92bd6980945 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorizing `identity:get_project(project_id=742998b08aec4df0844e1fbf2ecb4479)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:08.757180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6c242-27cc-402b-9113-a92bd6980945 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:08.759700 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1525/3055] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:52:08 2021] GET /identity/v3/projects/742998b08aec4df0844e1fbf2ecb4479 => generated 381 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:09.208953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fedeeb-f4cd-4bb6-9778-c7f8375db11e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:09.239882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fedeeb-f4cd-4bb6-9778-c7f8375db11e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:09.261758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea9933-f706-4572-a15d-107577db0460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:09.262800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9933-f706-4572-a15d-107577db0460 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:09.265033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9933-f706-4572-a15d-107577db0460 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:09.265760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9933-f706-4572-a15d-107577db0460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:09.280834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea9933-f706-4572-a15d-107577db0460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:09.284328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea9933-f706-4572-a15d-107577db0460 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:09.297532 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1531/3056] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:09 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:09.581093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411706-02cd-47bb-bf33-8f6260b32e4e None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:09.582171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411706-02cd-47bb-bf33-8f6260b32e4e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:09.582731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411706-02cd-47bb-bf33-8f6260b32e4e None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:09.589341 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1526/3057] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:52:09 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:52:09.596504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea9933-f706-4572-a15d-107577db0460 service nova] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:52:09.616046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea9933-f706-4572-a15d-107577db0460 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:09.629930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea9933-f706-4572-a15d-107577db0460 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:09.636109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab5c76-818d-49bc-ada6-cca3acfad8fe tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc6814eb4a422eac4b14b330905321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3607774190ce41318c3f197c912e9025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:09.637485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5c76-818d-49bc-ada6-cca3acfad8fe tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:09.637784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5c76-818d-49bc-ada6-cca3acfad8fe tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:09.638149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5c76-818d-49bc-ada6-cca3acfad8fe tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] PATH_INFO: `/v3/projects/742998b08aec4df0844e1fbf2ecb4479` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:09.640915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab5c76-818d-49bc-ada6-cca3acfad8fe tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorizing `identity:get_project(project_id=742998b08aec4df0844e1fbf2ecb4479)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:09.644495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab5c76-818d-49bc-ada6-cca3acfad8fe tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:09.651944 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1532/3058] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:52:09 2021] GET /identity/v3/projects/742998b08aec4df0844e1fbf2ecb4479 => generated 381 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:52:09.704295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b411706-02cd-47bb-bf33-8f6260b32e4e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:09.707172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0b411706-02cd-47bb-bf33-8f6260b32e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:09.738637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b411706-02cd-47bb-bf33-8f6260b32e4e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:09.753793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae45c4-8bd9-48a1-bf28-ab6fe75639b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:09.754499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae45c4-8bd9-48a1-bf28-ab6fe75639b7 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:09.754754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae45c4-8bd9-48a1-bf28-ab6fe75639b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:09.755029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae45c4-8bd9-48a1-bf28-ab6fe75639b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:09.767299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-41ae45c4-8bd9-48a1-bf28-ab6fe75639b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:09.786098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793634-f782-4067-b230-64c29cdf97fc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:09.786803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793634-f782-4067-b230-64c29cdf97fc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:09.787246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20793634-f782-4067-b230-64c29cdf97fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:09.808355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae45c4-8bd9-48a1-bf28-ab6fe75639b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:09.809809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae45c4-8bd9-48a1-bf28-ab6fe75639b7 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:09.824085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-20793634-f782-4067-b230-64c29cdf97fc None None] MFA Rules not processed for user `577c5d661d1a43a38e41deeca0c88aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:09.827618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-20793634-f782-4067-b230-64c29cdf97fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:09.838419 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1527/3059] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:09 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:09.839852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7240-91a4-4699-9bf7-84000325b43a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:09.845731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7240-91a4-4699-9bf7-84000325b43a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:09.846539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7240-91a4-4699-9bf7-84000325b43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:09.940418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9f3c7240-91a4-4699-9bf7-84000325b43a None None] MFA Rules not processed for user `739206ebdd594104a61116b3d6e1febb`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:09.941751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9f3c7240-91a4-4699-9bf7-84000325b43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:09.989558 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1533/3060] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:09 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:10.145440 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1528/3061] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:09 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:10.486405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20793634-f782-4067-b230-64c29cdf97fc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:10.506260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20793634-f782-4067-b230-64c29cdf97fc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:10.527703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeaecb-5bf8-48df-ab6f-17631d401907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:10.528493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeaecb-5bf8-48df-ab6f-17631d401907 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:10.528967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeaecb-5bf8-48df-ab6f-17631d401907 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:10.529579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeaecb-5bf8-48df-ab6f-17631d401907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:10.531386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5eaeaecb-5bf8-48df-ab6f-17631d401907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:10.562282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeaecb-5bf8-48df-ab6f-17631d401907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:10.564234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeaecb-5bf8-48df-ab6f-17631d401907 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:10.590045 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1534/3062] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:10 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:11.607443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858e45-6be4-4e3a-bc40-513803b95815 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:11.608210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858e45-6be4-4e3a-bc40-513803b95815 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:11.608210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858e45-6be4-4e3a-bc40-513803b95815 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:11.609785 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1529/3063] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:52:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:52:11.623960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeaecb-5bf8-48df-ab6f-17631d401907 service nova] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:52:11.630355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06858e45-6be4-4e3a-bc40-513803b95815 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:11.655830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeaecb-5bf8-48df-ab6f-17631d401907 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:11.662063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06858e45-6be4-4e3a-bc40-513803b95815 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:11.678136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeaecb-5bf8-48df-ab6f-17631d401907 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:11.686832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:11.687763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:11.689600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f799718-bbbc-4c0c-a242-6828a6fd8e67 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc6814eb4a422eac4b14b330905321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3607774190ce41318c3f197c912e9025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:11.690743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799718-bbbc-4c0c-a242-6828a6fd8e67 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:11.691299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799718-bbbc-4c0c-a242-6828a6fd8e67 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:11.691836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799718-bbbc-4c0c-a242-6828a6fd8e67 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] PATH_INFO: `/v3/projects/742998b08aec4df0844e1fbf2ecb4479` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:11.692020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:11.692534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] PATH_INFO: `/v3/users/739206ebdd594104a61116b3d6e1febb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:11.694306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f799718-bbbc-4c0c-a242-6828a6fd8e67 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorizing `identity:get_project(project_id=742998b08aec4df0844e1fbf2ecb4479)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:11.695855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=739206ebdd594104a61116b3d6e1febb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:11.696776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f799718-bbbc-4c0c-a242-6828a6fd8e67 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:11.699038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:11.699443 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1535/3064] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:52:11 2021] GET /identity/v3/projects/742998b08aec4df0844e1fbf2ecb4479 => generated 381 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:11.783916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '739206ebdd594104a61116b3d6e1febb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:11.797787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '739206ebdd594104a61116b3d6e1febb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:11.798778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '739206ebdd594104a61116b3d6e1febb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:11.809778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '739206ebdd594104a61116b3d6e1febb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:11.829760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '739206ebdd594104a61116b3d6e1febb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:11.839188 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1530/3065] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:11 2021] DELETE /identity/v3/users/739206ebdd594104a61116b3d6e1febb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:12.246964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804ef08-0f83-4bb4-9917-641099a840ae None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:12.247246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804ef08-0f83-4bb4-9917-641099a840ae None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:12.247725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804ef08-0f83-4bb4-9917-641099a840ae None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:12.249971 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1536/3066] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:52:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:52:12.262454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:52:12.264618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:12.377950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:12.379307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:12.446359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804ef08-0f83-4bb4-9917-641099a840ae None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:12.452500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b804ef08-0f83-4bb4-9917-641099a840ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:12.480339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6ffb9-fdc6-410b-aa3a-27524ff82230 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:12.485447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ba8d6-f3af-49d9-8112-ad89a0fd5505 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc6814eb4a422eac4b14b330905321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3607774190ce41318c3f197c912e9025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:12.486535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ba8d6-f3af-49d9-8112-ad89a0fd5505 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:12.486852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ba8d6-f3af-49d9-8112-ad89a0fd5505 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:12.487233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ba8d6-f3af-49d9-8112-ad89a0fd5505 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] PATH_INFO: `/v3/projects/742998b08aec4df0844e1fbf2ecb4479` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:12.488596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ba8d6-f3af-49d9-8112-ad89a0fd5505 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorizing `identity:get_project(project_id=742998b08aec4df0844e1fbf2ecb4479)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:12.490683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ba8d6-f3af-49d9-8112-ad89a0fd5505 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:12.492824 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1531/3067] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:52:12 2021] GET /identity/v3/projects/742998b08aec4df0844e1fbf2ecb4479 => generated 381 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:12.587717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804ef08-0f83-4bb4-9917-641099a840ae None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:12.597661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:12.598877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:12.599526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:12.600197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] PATH_INFO: `/v3/projects/4dad5146bddc4e1384ddf1f394d83eb9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:12.602033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dad5146bddc4e1384ddf1f394d83eb9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:12.605466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:12.668492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dad5146bddc4e1384ddf1f394d83eb9', 'request_id': 'req-6ff8437c-ae3f-4cd6-8383-9eed221bb869'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:12.676665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dad5146bddc4e1384ddf1f394d83eb9', 'request_id': 'req-6ff8437c-ae3f-4cd6-8383-9eed221bb869'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:12.688902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dad5146bddc4e1384ddf1f394d83eb9', 'request_id': 'req-6ff8437c-ae3f-4cd6-8383-9eed221bb869'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:12.701803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] The token cache is being invalidate because project 4dad5146bddc4e1384ddf1f394d83eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:12.704144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:12.704900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6ff8437c-ae3f-4cd6-8383-9eed221bb869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:12.706583 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1537/3068] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:12 2021] DELETE /identity/v3/projects/4dad5146bddc4e1384ddf1f394d83eb9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:12.713326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59782b-bfe9-4032-8b91-77790c29d96c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:12.713869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59782b-bfe9-4032-8b91-77790c29d96c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:12.713869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59782b-bfe9-4032-8b91-77790c29d96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:12.734901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7a59782b-bfe9-4032-8b91-77790c29d96c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:12.736768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7a59782b-bfe9-4032-8b91-77790c29d96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:12.805971 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1532/3069] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:12.816019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5ff7-4f0d-411d-863e-892c05bb4481 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:12.816856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5ff7-4f0d-411d-863e-892c05bb4481 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:12.817348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5ff7-4f0d-411d-863e-892c05bb4481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:12.840413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cdab5ff7-4f0d-411d-863e-892c05bb4481 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:12.841937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cdab5ff7-4f0d-411d-863e-892c05bb4481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:12.850883 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1538/3070] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:12.855637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59782b-bfe9-4032-8b91-77790c29d96c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:12.866204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59782b-bfe9-4032-8b91-77790c29d96c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:12.871898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece86c30-2fc9-440f-b0fd-d1d3e392d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:12.872933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece86c30-2fc9-440f-b0fd-d1d3e392d542 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:12.873398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece86c30-2fc9-440f-b0fd-d1d3e392d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:12.873835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece86c30-2fc9-440f-b0fd-d1d3e392d542 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:12.875019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece86c30-2fc9-440f-b0fd-d1d3e392d542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:12.876038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece86c30-2fc9-440f-b0fd-d1d3e392d542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:12.878316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece86c30-2fc9-440f-b0fd-d1d3e392d542 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:12.892411 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1533/3071] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:52:12.902713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5ff7-4f0d-411d-863e-892c05bb4481 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:12.913108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab5ff7-4f0d-411d-863e-892c05bb4481 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:12.919017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94262f0f-daa0-4113-8607-63240dff7ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:12.921107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94262f0f-daa0-4113-8607-63240dff7ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:12.921398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94262f0f-daa0-4113-8607-63240dff7ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:12.921669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94262f0f-daa0-4113-8607-63240dff7ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:12.922589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94262f0f-daa0-4113-8607-63240dff7ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:12.924801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94262f0f-daa0-4113-8607-63240dff7ec5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:12.928573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec689-436c-4bed-af3e-d784581092f7 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:12.928864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec689-436c-4bed-af3e-d784581092f7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:12.929171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ec689-436c-4bed-af3e-d784581092f7 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:12.930923 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1534/3072] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:52:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 20:52:12.938806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec689-436c-4bed-af3e-d784581092f7 None None] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:52:12.941416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6c3ec689-436c-4bed-af3e-d784581092f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:12.961020 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1539/3073] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:12 2021] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:12.965739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94262f0f-daa0-4113-8607-63240dff7ec5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:13.037279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec689-436c-4bed-af3e-d784581092f7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:13.040666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6c3ec689-436c-4bed-af3e-d784581092f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:13.057256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94262f0f-daa0-4113-8607-63240dff7ec5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:13.074706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051970c8-84d8-4b0c-9b84-1f6d31319f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:13.075411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051970c8-84d8-4b0c-9b84-1f6d31319f65 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:13.075695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051970c8-84d8-4b0c-9b84-1f6d31319f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:13.075972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051970c8-84d8-4b0c-9b84-1f6d31319f65 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:13.076690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051970c8-84d8-4b0c-9b84-1f6d31319f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:13.079228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051970c8-84d8-4b0c-9b84-1f6d31319f65 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:13.100789 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1540/3074] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:12 2021] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:13.105362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051970c8-84d8-4b0c-9b84-1f6d31319f65 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:13.117553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051970c8-84d8-4b0c-9b84-1f6d31319f65 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:13.117807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ec689-436c-4bed-af3e-d784581092f7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:13.124003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc78eb-63be-4694-b8b4-82822733e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:13.125226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc78eb-63be-4694-b8b4-82822733e174 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:13.126573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc78eb-63be-4694-b8b4-82822733e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:13.127610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc78eb-63be-4694-b8b4-82822733e174 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:13.128875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc78eb-63be-4694-b8b4-82822733e174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:13.131747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc78eb-63be-4694-b8b4-82822733e174 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:13.147362 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1541/3075] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:13 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:13.150938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc78eb-63be-4694-b8b4-82822733e174 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:13.165487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc78eb-63be-4694-b8b4-82822733e174 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:13.174393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfdd58-dae5-4d53-8776-7733df52eb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:13.175379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfdd58-dae5-4d53-8776-7733df52eb8f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:13.175769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfdd58-dae5-4d53-8776-7733df52eb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:13.176401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfdd58-dae5-4d53-8776-7733df52eb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:13.177631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfdd58-dae5-4d53-8776-7733df52eb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:13.179464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfdd58-dae5-4d53-8776-7733df52eb8f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:13.189237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518a349-595d-4b33-a6ee-63d399c88fef tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc6814eb4a422eac4b14b330905321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3607774190ce41318c3f197c912e9025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:13.190096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518a349-595d-4b33-a6ee-63d399c88fef tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:13.190386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518a349-595d-4b33-a6ee-63d399c88fef tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:13.190714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518a349-595d-4b33-a6ee-63d399c88fef tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] PATH_INFO: `/v3/projects/742998b08aec4df0844e1fbf2ecb4479` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:13.192380 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1542/3076] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:13 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:13.195530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518a349-595d-4b33-a6ee-63d399c88fef tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorizing `identity:get_project(project_id=742998b08aec4df0844e1fbf2ecb4479)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:13.197285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfdd58-dae5-4d53-8776-7733df52eb8f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:13.206902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518a349-595d-4b33-a6ee-63d399c88fef tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:13.207714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfdd58-dae5-4d53-8776-7733df52eb8f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:13.212833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbb49c-5a0a-493f-9acd-9ef34088fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:13.213794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbb49c-5a0a-493f-9acd-9ef34088fb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:13.214279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbb49c-5a0a-493f-9acd-9ef34088fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:13.214646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbb49c-5a0a-493f-9acd-9ef34088fb1d admin admin] PATH_INFO: `/v3/projects/b564202c29bd4ce29a4010a855afd299/users/bfbbded1a9224e9f8471dbf962db109c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:13.219419 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1535/3077] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:52:12 2021] GET /identity/v3/projects/742998b08aec4df0844e1fbf2ecb4479 => generated 381 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:13.234655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbb49c-5a0a-493f-9acd-9ef34088fb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b564202c29bd4ce29a4010a855afd299, user_id=bfbbded1a9224e9f8471dbf962db109c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:13.239850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbb49c-5a0a-493f-9acd-9ef34088fb1d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:13.259431 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1543/3078] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:13 2021] PUT /identity/v3/projects/b564202c29bd4ce29a4010a855afd299/users/bfbbded1a9224e9f8471dbf962db109c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:13.264695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bf80c-3395-4351-a75c-7e96c4731be1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:13.265275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bf80c-3395-4351-a75c-7e96c4731be1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:13.265627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bf80c-3395-4351-a75c-7e96c4731be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:13.299174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9f6bf80c-3395-4351-a75c-7e96c4731be1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:13.303544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9f6bf80c-3395-4351-a75c-7e96c4731be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:13.318580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868af549-4a95-4c1e-baec-94b83bd0d701 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:13.319628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868af549-4a95-4c1e-baec-94b83bd0d701 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:13.319628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868af549-4a95-4c1e-baec-94b83bd0d701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:13.345436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-868af549-4a95-4c1e-baec-94b83bd0d701 None None] MFA Rules not processed for user `577c5d661d1a43a38e41deeca0c88aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:13.346859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-868af549-4a95-4c1e-baec-94b83bd0d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:13.401056 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1536/3079] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:13.412370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bf80c-3395-4351-a75c-7e96c4731be1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:13.413852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9f6bf80c-3395-4351-a75c-7e96c4731be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:13.473579 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1544/3080] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:13 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:13.498717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bf80c-3395-4351-a75c-7e96c4731be1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:13.503403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25fd71-1a16-4d07-9e87-c8022b1d3270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:13.504169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25fd71-1a16-4d07-9e87-c8022b1d3270 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:13.504532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25fd71-1a16-4d07-9e87-c8022b1d3270 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:13.504855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25fd71-1a16-4d07-9e87-c8022b1d3270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:13.516541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25fd71-1a16-4d07-9e87-c8022b1d3270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:13.518221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25fd71-1a16-4d07-9e87-c8022b1d3270 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:13.530807 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1537/3081] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:52:14.388271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1c04d-d929-4020-be30-836684da776d None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:14.388705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1c04d-d929-4020-be30-836684da776d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:14.388838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1c04d-d929-4020-be30-836684da776d None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:14.390639 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1545/3082] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:52:14 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:52:14.398629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25fd71-1a16-4d07-9e87-c8022b1d3270 service neutron] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:52:14.401202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9a25fd71-1a16-4d07-9e87-c8022b1d3270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:14.406148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cba0f8-e698-4fb5-b170-95680137a2e4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:14.408416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cba0f8-e698-4fb5-b170-95680137a2e4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:14.408416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cba0f8-e698-4fb5-b170-95680137a2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:14.448891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f6cba0f8-e698-4fb5-b170-95680137a2e4 None None] MFA Rules not processed for user `bfbbded1a9224e9f8471dbf962db109c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:14.450726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f6cba0f8-e698-4fb5-b170-95680137a2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:14.512693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25fd71-1a16-4d07-9e87-c8022b1d3270 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:14.571892 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1546/3083] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:14 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:14.579321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8071-4f2a-4234-8035-1c0b1829b4ef None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:14.579655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8071-4f2a-4234-8035-1c0b1829b4ef None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:14.580232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c8071-4f2a-4234-8035-1c0b1829b4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:14.608719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e30c8071-4f2a-4234-8035-1c0b1829b4ef None None] MFA Rules not processed for user `bfbbded1a9224e9f8471dbf962db109c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:14.610679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25fd71-1a16-4d07-9e87-c8022b1d3270 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:14.610904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e30c8071-4f2a-4234-8035-1c0b1829b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:14.615831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aec709-7508-4512-b470-46def2c2d366 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc6814eb4a422eac4b14b330905321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3607774190ce41318c3f197c912e9025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:14.616688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aec709-7508-4512-b470-46def2c2d366 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:14.616973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aec709-7508-4512-b470-46def2c2d366 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:14.617249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aec709-7508-4512-b470-46def2c2d366 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] PATH_INFO: `/v3/projects/742998b08aec4df0844e1fbf2ecb4479` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:14.618894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aec709-7508-4512-b470-46def2c2d366 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorizing `identity:get_project(project_id=742998b08aec4df0844e1fbf2ecb4479)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:14.623799 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1547/3084] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:14 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:14.623986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aec709-7508-4512-b470-46def2c2d366 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:14.623986 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1538/3085] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:52:14 2021] GET /identity/v3/projects/742998b08aec4df0844e1fbf2ecb4479 => generated 381 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:15.279541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c8071-4f2a-4234-8035-1c0b1829b4ef None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:15.292972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c8071-4f2a-4234-8035-1c0b1829b4ef None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:15.298713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cc964-bc6d-41bc-9a9a-406d536d3c9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:15.299394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cc964-bc6d-41bc-9a9a-406d536d3c9f service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:15.299682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cc964-bc6d-41bc-9a9a-406d536d3c9f service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:15.299967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cc964-bc6d-41bc-9a9a-406d536d3c9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:15.308282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cc964-bc6d-41bc-9a9a-406d536d3c9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:15.309973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cc964-bc6d-41bc-9a9a-406d536d3c9f service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:15.320456 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1548/3086] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:15 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:15.550583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133f772-197c-498a-afd5-c94618ae2869 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:15.551126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133f772-197c-498a-afd5-c94618ae2869 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:15.551240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133f772-197c-498a-afd5-c94618ae2869 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:15.552996 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1539/3087] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:52:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:52:15.558766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cc964-bc6d-41bc-9a9a-406d536d3c9f service nova] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:52:15.571773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cc964-bc6d-41bc-9a9a-406d536d3c9f service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:15.585534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cc964-bc6d-41bc-9a9a-406d536d3c9f service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:15.590680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8200da-8249-4b8f-9aaa-d2128e86f4b0 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc6814eb4a422eac4b14b330905321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3607774190ce41318c3f197c912e9025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:15.591565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8200da-8249-4b8f-9aaa-d2128e86f4b0 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:15.591854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8200da-8249-4b8f-9aaa-d2128e86f4b0 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:15.592132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8200da-8249-4b8f-9aaa-d2128e86f4b0 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] PATH_INFO: `/v3/projects/742998b08aec4df0844e1fbf2ecb4479` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:15.593385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8200da-8249-4b8f-9aaa-d2128e86f4b0 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorizing `identity:get_project(project_id=742998b08aec4df0844e1fbf2ecb4479)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:15.595532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8200da-8249-4b8f-9aaa-d2128e86f4b0 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:15.597409 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1549/3088] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:52:15 2021] GET /identity/v3/projects/742998b08aec4df0844e1fbf2ecb4479 => generated 381 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:15.951845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263913dd-3fbe-488f-9692-c12dcbd8401e None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:15.952134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263913dd-3fbe-488f-9692-c12dcbd8401e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:15.952455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263913dd-3fbe-488f-9692-c12dcbd8401e None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:15.954556 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1540/3089] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:52:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:52:15.989276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8200da-8249-4b8f-9aaa-d2128e86f4b0 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:52:16.013610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8200da-8249-4b8f-9aaa-d2128e86f4b0 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:16.038012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8200da-8249-4b8f-9aaa-d2128e86f4b0 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:16.052487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cee5cc-7dea-4851-8eb3-dc209a1f6461 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc6814eb4a422eac4b14b330905321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3607774190ce41318c3f197c912e9025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:16.054558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee5cc-7dea-4851-8eb3-dc209a1f6461 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:16.055236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee5cc-7dea-4851-8eb3-dc209a1f6461 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:16.055236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cee5cc-7dea-4851-8eb3-dc209a1f6461 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] PATH_INFO: `/v3/projects/742998b08aec4df0844e1fbf2ecb4479` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:16.057388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cee5cc-7dea-4851-8eb3-dc209a1f6461 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorizing `identity:get_project(project_id=742998b08aec4df0844e1fbf2ecb4479)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:16.059493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cee5cc-7dea-4851-8eb3-dc209a1f6461 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:16.083440 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1550/3090] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:52:15 2021] GET /identity/v3/projects/742998b08aec4df0844e1fbf2ecb4479 => generated 381 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:16.189784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb798e7f-3838-4f99-8939-b3b073bfe18d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:16.191443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb798e7f-3838-4f99-8939-b3b073bfe18d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:16.192007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb798e7f-3838-4f99-8939-b3b073bfe18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:16.214658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fb798e7f-3838-4f99-8939-b3b073bfe18d None None] MFA Rules not processed for user `577c5d661d1a43a38e41deeca0c88aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:16.216311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fb798e7f-3838-4f99-8939-b3b073bfe18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:16.229797 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1541/3091] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:16 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:16.471585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cee5cc-7dea-4851-8eb3-dc209a1f6461 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:16.487450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cee5cc-7dea-4851-8eb3-dc209a1f6461 tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:16.494089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:16.495604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:16.495972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:16.496350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] PATH_INFO: `/v3/users/bfbbded1a9224e9f8471dbf962db109c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:16.498123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbbded1a9224e9f8471dbf962db109c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:16.501087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:16.569172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbbded1a9224e9f8471dbf962db109c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:16.570002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbbded1a9224e9f8471dbf962db109c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:16.582499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbbded1a9224e9f8471dbf962db109c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:16.584561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbbded1a9224e9f8471dbf962db109c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:16.594107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbbded1a9224e9f8471dbf962db109c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:16.625862 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1551/3092] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:16 2021] DELETE /identity/v3/users/bfbbded1a9224e9f8471dbf962db109c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:17.002858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d80ccb-30f8-46f5-b64a-86b5d8d938b5 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.003448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d80ccb-30f8-46f5-b64a-86b5d8d938b5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.003609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d80ccb-30f8-46f5-b64a-86b5d8d938b5 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.005615 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1542/3093] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:52:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:52:17.010623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:52:17.012080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:17.085706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:17.086951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:17.135793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d80ccb-30f8-46f5-b64a-86b5d8d938b5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:17.137641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-74d80ccb-30f8-46f5-b64a-86b5d8d938b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:17.155245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eb875-5217-48df-9ea0-5ec969ea5697 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:17.161371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c4954-b0c8-4fed-80be-cee82aa6e86b tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc6814eb4a422eac4b14b330905321', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3607774190ce41318c3f197c912e9025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:17.162253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c4954-b0c8-4fed-80be-cee82aa6e86b tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.162519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c4954-b0c8-4fed-80be-cee82aa6e86b tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.162900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c4954-b0c8-4fed-80be-cee82aa6e86b tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] PATH_INFO: `/v3/projects/742998b08aec4df0844e1fbf2ecb4479` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.164283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c4954-b0c8-4fed-80be-cee82aa6e86b tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorizing `identity:get_project(project_id=742998b08aec4df0844e1fbf2ecb4479)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:17.166513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c4954-b0c8-4fed-80be-cee82aa6e86b tempest-QuotasAdminNegativeTest-389333749 tempest-QuotasAdminNegativeTest-389333749-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:17.168862 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1552/3094] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:52:17 2021] GET /identity/v3/projects/742998b08aec4df0844e1fbf2ecb4479 => generated 381 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:17.239413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d80ccb-30f8-46f5-b64a-86b5d8d938b5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:17.246260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:17.248204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.248204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.248204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] PATH_INFO: `/v3/projects/b564202c29bd4ce29a4010a855afd299` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.249675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b564202c29bd4ce29a4010a855afd299)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:17.252304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:17.313575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b564202c29bd4ce29a4010a855afd299', 'request_id': 'req-a1016117-0133-41ad-bd2c-6ca9a78d5c59'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:17.322808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b564202c29bd4ce29a4010a855afd299', 'request_id': 'req-a1016117-0133-41ad-bd2c-6ca9a78d5c59'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:17.331196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b564202c29bd4ce29a4010a855afd299', 'request_id': 'req-a1016117-0133-41ad-bd2c-6ca9a78d5c59'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:17.343380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] The token cache is being invalidate because project b564202c29bd4ce29a4010a855afd299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:17.343922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:17.345731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a1016117-0133-41ad-bd2c-6ca9a78d5c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:17.348191 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1543/3095] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:17 2021] DELETE /identity/v3/projects/b564202c29bd4ce29a4010a855afd299 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:17.353710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26eed6-42e8-4131-a5ce-7ee8f6352549 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.354004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26eed6-42e8-4131-a5ce-7ee8f6352549 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.354286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26eed6-42e8-4131-a5ce-7ee8f6352549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.376297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2a26eed6-42e8-4131-a5ce-7ee8f6352549 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:17.378564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2a26eed6-42e8-4131-a5ce-7ee8f6352549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:17.493369 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1553/3096] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:17.501938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f980dcc-0b0c-49ba-ac12-019d21562d29 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.503380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f980dcc-0b0c-49ba-ac12-019d21562d29 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.503380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f980dcc-0b0c-49ba-ac12-019d21562d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.522659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6f980dcc-0b0c-49ba-ac12-019d21562d29 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:17.524181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6f980dcc-0b0c-49ba-ac12-019d21562d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:17.536403 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1544/3097] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:17.537509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26eed6-42e8-4131-a5ce-7ee8f6352549 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:17.548556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26eed6-42e8-4131-a5ce-7ee8f6352549 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:17.553412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1afe28-6645-4c27-aa1b-1ab702f18a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:17.554067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1afe28-6645-4c27-aa1b-1ab702f18a2a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.554475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1afe28-6645-4c27-aa1b-1ab702f18a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.555057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1afe28-6645-4c27-aa1b-1ab702f18a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.555526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1afe28-6645-4c27-aa1b-1ab702f18a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:17.555934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1afe28-6645-4c27-aa1b-1ab702f18a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:17.557752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1afe28-6645-4c27-aa1b-1ab702f18a2a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:17.572649 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1554/3098] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:52:17.576735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f980dcc-0b0c-49ba-ac12-019d21562d29 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:17.590976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f980dcc-0b0c-49ba-ac12-019d21562d29 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:17.601496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d7328-f9a8-42f1-aeb1-b94324f6f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:17.602161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d7328-f9a8-42f1-aeb1-b94324f6f3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.602509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d7328-f9a8-42f1-aeb1-b94324f6f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.602821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d7328-f9a8-42f1-aeb1-b94324f6f3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.603613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d7328-f9a8-42f1-aeb1-b94324f6f3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:17.605592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d7328-f9a8-42f1-aeb1-b94324f6f3a3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:17.635902 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1545/3099] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:17 2021] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:17.640263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1afe28-6645-4c27-aa1b-1ab702f18a2a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:17.650805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d7328-f9a8-42f1-aeb1-b94324f6f3a3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:17.652464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1afe28-6645-4c27-aa1b-1ab702f18a2a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:17.655355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-689d7328-f9a8-42f1-aeb1-b94324f6f3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:17.737466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc34fb5-22bb-4c5b-8d0f-b619650df24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:17.738376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc34fb5-22bb-4c5b-8d0f-b619650df24b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.738760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc34fb5-22bb-4c5b-8d0f-b619650df24b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.739188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc34fb5-22bb-4c5b-8d0f-b619650df24b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.740177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc34fb5-22bb-4c5b-8d0f-b619650df24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:17.742227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc34fb5-22bb-4c5b-8d0f-b619650df24b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:17.762927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d7328-f9a8-42f1-aeb1-b94324f6f3a3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:17.767498 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1555/3100] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:17 2021] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:17.771112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc34fb5-22bb-4c5b-8d0f-b619650df24b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:17.773978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7981247-5d54-4a8b-8a0b-3a3abd86bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:17.774869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981247-5d54-4a8b-8a0b-3a3abd86bf7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.775147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981247-5d54-4a8b-8a0b-3a3abd86bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.775459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981247-5d54-4a8b-8a0b-3a3abd86bf7f admin admin] PATH_INFO: `/v3/users/577c5d661d1a43a38e41deeca0c88aa7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.776907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7981247-5d54-4a8b-8a0b-3a3abd86bf7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=577c5d661d1a43a38e41deeca0c88aa7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:17.778943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7981247-5d54-4a8b-8a0b-3a3abd86bf7f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:17.784567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc34fb5-22bb-4c5b-8d0f-b619650df24b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:17.792402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dd618-4aff-4cd9-90d3-1280222b5f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:17.793322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dd618-4aff-4cd9-90d3-1280222b5f60 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.793607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dd618-4aff-4cd9-90d3-1280222b5f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.793888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dd618-4aff-4cd9-90d3-1280222b5f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.794626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dd618-4aff-4cd9-90d3-1280222b5f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:17.796638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dd618-4aff-4cd9-90d3-1280222b5f60 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:17.810100 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1556/3101] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:17 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:52:17.813834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dd618-4aff-4cd9-90d3-1280222b5f60 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:17.840478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dd618-4aff-4cd9-90d3-1280222b5f60 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:17.849376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9d5c6-5c11-44c9-a1c5-2daf1e6d9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:17.851407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9d5c6-5c11-44c9-a1c5-2daf1e6d9ade admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.851701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9d5c6-5c11-44c9-a1c5-2daf1e6d9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.852186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9d5c6-5c11-44c9-a1c5-2daf1e6d9ade admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.853688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9d5c6-5c11-44c9-a1c5-2daf1e6d9ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:17.857835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9d5c6-5c11-44c9-a1c5-2daf1e6d9ade admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:17.875989 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1557/3102] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:17 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:17.884882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e7981247-5d54-4a8b-8a0b-3a3abd86bf7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577c5d661d1a43a38e41deeca0c88aa7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:17.885571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9d5c6-5c11-44c9-a1c5-2daf1e6d9ade admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:17.896880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e7981247-5d54-4a8b-8a0b-3a3abd86bf7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577c5d661d1a43a38e41deeca0c88aa7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:17.897753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e7981247-5d54-4a8b-8a0b-3a3abd86bf7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577c5d661d1a43a38e41deeca0c88aa7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:17.901925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9d5c6-5c11-44c9-a1c5-2daf1e6d9ade admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:17.908555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e7981247-5d54-4a8b-8a0b-3a3abd86bf7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577c5d661d1a43a38e41deeca0c88aa7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:17.919371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66c3fb-b6d7-47c4-a024-df64bc11519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:17.921095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66c3fb-b6d7-47c4-a024-df64bc11519a admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.921459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66c3fb-b6d7-47c4-a024-df64bc11519a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.921822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66c3fb-b6d7-47c4-a024-df64bc11519a admin admin] PATH_INFO: `/v3/projects/79226c480677428e924a69a8e4c01ae9/users/6f940822793e422c8436036be6a116a0/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.927013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e7981247-5d54-4a8b-8a0b-3a3abd86bf7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577c5d661d1a43a38e41deeca0c88aa7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:17.935305 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1546/3103] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:17 2021] DELETE /identity/v3/users/577c5d661d1a43a38e41deeca0c88aa7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:17.940672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e078c4-8a4f-46d4-87c2-fa886fc71ad8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.940967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e078c4-8a4f-46d4-87c2-fa886fc71ad8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.941234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e078c4-8a4f-46d4-87c2-fa886fc71ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:17.955555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66c3fb-b6d7-47c4-a024-df64bc11519a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79226c480677428e924a69a8e4c01ae9, user_id=6f940822793e422c8436036be6a116a0, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:17.958850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66c3fb-b6d7-47c4-a024-df64bc11519a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:17.977808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-97e078c4-8a4f-46d4-87c2-fa886fc71ad8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:17.979023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-97e078c4-8a4f-46d4-87c2-fa886fc71ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:17.984171 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1558/3104] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:17 2021] PUT /identity/v3/projects/79226c480677428e924a69a8e4c01ae9/users/6f940822793e422c8436036be6a116a0/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:17.989695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7da364-44bd-441f-b271-85d0ee070999 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:17.990513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7da364-44bd-441f-b271-85d0ee070999 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:17.991180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7da364-44bd-441f-b271-85d0ee070999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:18.012731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ab7da364-44bd-441f-b271-85d0ee070999 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:18.021447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ab7da364-44bd-441f-b271-85d0ee070999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:18.053154 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1547/3105] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:18.064232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e078c4-8a4f-46d4-87c2-fa886fc71ad8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:18.064889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-97e078c4-8a4f-46d4-87c2-fa886fc71ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:18.103412 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1559/3106] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:18.112944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7da364-44bd-441f-b271-85d0ee070999 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:18.115561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ab7da364-44bd-441f-b271-85d0ee070999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:18.160736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e078c4-8a4f-46d4-87c2-fa886fc71ad8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:18.166451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b5df9-f15d-4e46-83a8-fa1b9219fc96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:18.171223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b5df9-f15d-4e46-83a8-fa1b9219fc96 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:18.171828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b5df9-f15d-4e46-83a8-fa1b9219fc96 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:18.172953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b5df9-f15d-4e46-83a8-fa1b9219fc96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:18.189711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b5df9-f15d-4e46-83a8-fa1b9219fc96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:18.192591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b5df9-f15d-4e46-83a8-fa1b9219fc96 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:18.203512 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1548/3107] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:18.207184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7da364-44bd-441f-b271-85d0ee070999 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:18.215082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a53f80-973c-4b34-a278-15246c9c0128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:18.215784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a53f80-973c-4b34-a278-15246c9c0128 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:18.216069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a53f80-973c-4b34-a278-15246c9c0128 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:18.216351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a53f80-973c-4b34-a278-15246c9c0128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:18.227798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a53f80-973c-4b34-a278-15246c9c0128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:18.229542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a53f80-973c-4b34-a278-15246c9c0128 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:18.248688 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1560/3108] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:52:18.509985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b5df9-f15d-4e46-83a8-fa1b9219fc96 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:18.511668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-306b5df9-f15d-4e46-83a8-fa1b9219fc96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:18.536423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b5df9-f15d-4e46-83a8-fa1b9219fc96 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:18.554983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:18.555990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:18.556341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:18.556690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] PATH_INFO: `/v3/projects/742998b08aec4df0844e1fbf2ecb4479` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:18.559197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=742998b08aec4df0844e1fbf2ecb4479)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:18.562535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:18.633057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '742998b08aec4df0844e1fbf2ecb4479', 'request_id': 'req-f5fbef55-2e35-4363-83fa-e573067149b5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.641891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '742998b08aec4df0844e1fbf2ecb4479', 'request_id': 'req-f5fbef55-2e35-4363-83fa-e573067149b5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.653351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '742998b08aec4df0844e1fbf2ecb4479', 'request_id': 'req-f5fbef55-2e35-4363-83fa-e573067149b5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.654212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a53f80-973c-4b34-a278-15246c9c0128 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:18.655887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-67a53f80-973c-4b34-a278-15246c9c0128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:18.667726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] The token cache is being invalidate because project 742998b08aec4df0844e1fbf2ecb4479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:18.668172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.668849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.674592 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1549/3109] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:18 2021] DELETE /identity/v3/projects/742998b08aec4df0844e1fbf2ecb4479 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:18.676157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:18.677894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:18.681159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a53f80-973c-4b34-a278-15246c9c0128 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:18.745577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77531cb-7b5e-4581-8e45-4a253e599dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:18.746473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77531cb-7b5e-4581-8e45-4a253e599dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:18.746758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77531cb-7b5e-4581-8e45-4a253e599dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:18.747182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77531cb-7b5e-4581-8e45-4a253e599dbe admin admin] PATH_INFO: `/v3/users/641fe530de494a4fb1fefcd7688fb725` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:18.748468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77531cb-7b5e-4581-8e45-4a253e599dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=641fe530de494a4fb1fefcd7688fb725)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:18.751072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77531cb-7b5e-4581-8e45-4a253e599dbe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:18.753701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbef55-2e35-4363-83fa-e573067149b5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:18.765263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:18.766462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:18.766985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:18.767275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] PATH_INFO: `/v3/users/56dc6814eb4a422eac4b14b330905321` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:18.768641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dc6814eb4a422eac4b14b330905321)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:18.770666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:18.807370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a77531cb-7b5e-4581-8e45-4a253e599dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641fe530de494a4fb1fefcd7688fb725'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.808005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a77531cb-7b5e-4581-8e45-4a253e599dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641fe530de494a4fb1fefcd7688fb725'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.816819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a77531cb-7b5e-4581-8e45-4a253e599dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641fe530de494a4fb1fefcd7688fb725'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.817573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a77531cb-7b5e-4581-8e45-4a253e599dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641fe530de494a4fb1fefcd7688fb725'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.825249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a77531cb-7b5e-4581-8e45-4a253e599dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641fe530de494a4fb1fefcd7688fb725'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.826644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dc6814eb4a422eac4b14b330905321'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.834315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dc6814eb4a422eac4b14b330905321'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.835094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dc6814eb4a422eac4b14b330905321'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.842714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dc6814eb4a422eac4b14b330905321'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.843828 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1561/3110] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:18 2021] DELETE /identity/v3/users/641fe530de494a4fb1fefcd7688fb725 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:52:18.854174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becc4c3-1a1c-479e-aa84-f32012a55e34 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:18.854472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becc4c3-1a1c-479e-aa84-f32012a55e34 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:18.854795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becc4c3-1a1c-479e-aa84-f32012a55e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:18.870037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dc6814eb4a422eac4b14b330905321'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:18.877429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6becc4c3-1a1c-479e-aa84-f32012a55e34 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:18.878640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6becc4c3-1a1c-479e-aa84-f32012a55e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:18.881300 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1550/3111] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:18 2021] DELETE /identity/v3/users/56dc6814eb4a422eac4b14b330905321 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:52:18.959339 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1562/3112] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:19.024298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:19.027065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:19.111720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ebb90-e97c-4d88-ae74-7f233d602360 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:19.130512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747b11c-b509-4651-8bd4-99751ea73213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:19.131579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747b11c-b509-4651-8bd4-99751ea73213 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:19.132165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747b11c-b509-4651-8bd4-99751ea73213 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:19.132792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747b11c-b509-4651-8bd4-99751ea73213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:19.148250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747b11c-b509-4651-8bd4-99751ea73213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:19.152152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747b11c-b509-4651-8bd4-99751ea73213 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:19.170388 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1551/3113] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:19.621179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401657b-e45c-4cd6-ba0c-a048bc053639 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:19.621499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401657b-e45c-4cd6-ba0c-a048bc053639 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:19.621804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401657b-e45c-4cd6-ba0c-a048bc053639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:19.643218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747b11c-b509-4651-8bd4-99751ea73213 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:19.644995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8747b11c-b509-4651-8bd4-99751ea73213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:19.667496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747b11c-b509-4651-8bd4-99751ea73213 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:19.675697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e401657b-e45c-4cd6-ba0c-a048bc053639 None None] MFA Rules not processed for user `6f940822793e422c8436036be6a116a0`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:19.680772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e401657b-e45c-4cd6-ba0c-a048bc053639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:19.682173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:19.685704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:19.686823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:19.688555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] PATH_INFO: `/v3/projects/3607774190ce41318c3f197c912e9025` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:19.691357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3607774190ce41318c3f197c912e9025)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:19.693399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:19.820743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3607774190ce41318c3f197c912e9025', 'request_id': 'req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:19.834188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3607774190ce41318c3f197c912e9025', 'request_id': 'req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:19.849646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3607774190ce41318c3f197c912e9025', 'request_id': 'req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:19.865424 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1563/3114] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:19 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:19.865756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] The token cache is being invalidate because project 3607774190ce41318c3f197c912e9025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:19.866111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:19.866993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401657b-e45c-4cd6-ba0c-a048bc053639 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:19.869025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e401657b-e45c-4cd6-ba0c-a048bc053639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:19.875715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a85c0cdb-c594-4ce1-999a-19f8b4d38e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:19.878770 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1552/3115] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:19 2021] DELETE /identity/v3/projects/3607774190ce41318c3f197c912e9025 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:52:19.881875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a0f07-15a9-446d-a1e0-ccef0df41271 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:19.882177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a0f07-15a9-446d-a1e0-ccef0df41271 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:19.882537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a0f07-15a9-446d-a1e0-ccef0df41271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:19.902790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401657b-e45c-4cd6-ba0c-a048bc053639 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:19.934467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-256a0f07-15a9-446d-a1e0-ccef0df41271 None None] MFA Rules not processed for user `6f940822793e422c8436036be6a116a0`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:19.937132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-256a0f07-15a9-446d-a1e0-ccef0df41271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:19.985263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:19.986243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:19.986603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:19.986953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] PATH_INFO: `/v3/projects/c20895c1ea684b139e4b6802d7a80ba1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:19.989702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20895c1ea684b139e4b6802d7a80ba1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:19.993063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.010425 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1553/3116] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:19 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:20.011787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e357ea-4a23-4feb-8399-66ba64575c4c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.012070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e357ea-4a23-4feb-8399-66ba64575c4c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.012342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e357ea-4a23-4feb-8399-66ba64575c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.035099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-19e357ea-4a23-4feb-8399-66ba64575c4c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:20.036395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-19e357ea-4a23-4feb-8399-66ba64575c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:20.049521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20895c1ea684b139e4b6802d7a80ba1', 'request_id': 'req-dc917635-fdd0-4144-ae78-f1579eaef079'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:20.057302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20895c1ea684b139e4b6802d7a80ba1', 'request_id': 'req-dc917635-fdd0-4144-ae78-f1579eaef079'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:20.069977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20895c1ea684b139e4b6802d7a80ba1', 'request_id': 'req-dc917635-fdd0-4144-ae78-f1579eaef079'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:20.084372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] The token cache is being invalidate because project c20895c1ea684b139e4b6802d7a80ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:20.084689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:20.085401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:20.087743 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1564/3117] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:19 2021] DELETE /identity/v3/projects/c20895c1ea684b139e4b6802d7a80ba1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:20.088838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.094550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:20.116698 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1554/3118] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:20.129029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f776-aae3-4be8-b207-3c251f6ad526 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.129324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f776-aae3-4be8-b207-3c251f6ad526 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.129620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5f776-aae3-4be8-b207-3c251f6ad526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.177953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c8f5f776-aae3-4be8-b207-3c251f6ad526 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:20.183509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c8f5f776-aae3-4be8-b207-3c251f6ad526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:20.200823 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1555/3119] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:20.202694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adf6a4-8058-40d6-9259-3a2ffcffeba0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.203205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adf6a4-8058-40d6-9259-3a2ffcffeba0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.203751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adf6a4-8058-40d6-9259-3a2ffcffeba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.206917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc917635-fdd0-4144-ae78-f1579eaef079 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.217983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b43286-a479-4453-abf1-d581272a01ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.219061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b43286-a479-4453-abf1-d581272a01ca service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.219978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b43286-a479-4453-abf1-d581272a01ca service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.220664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b43286-a479-4453-abf1-d581272a01ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.223043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-66b43286-a479-4453-abf1-d581272a01ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:20.231532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-27adf6a4-8058-40d6-9259-3a2ffcffeba0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:20.232758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-27adf6a4-8058-40d6-9259-3a2ffcffeba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:20.244148 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1556/3120] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:20.249267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17805f-68e6-4b1c-a7a7-109397529034 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.249533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17805f-68e6-4b1c-a7a7-109397529034 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.249947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17805f-68e6-4b1c-a7a7-109397529034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.271070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bc17805f-68e6-4b1c-a7a7-109397529034 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:20.272679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bc17805f-68e6-4b1c-a7a7-109397529034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:20.283114 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1557/3121] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:20.286513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17805f-68e6-4b1c-a7a7-109397529034 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.294448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17805f-68e6-4b1c-a7a7-109397529034 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.296815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b43286-a479-4453-abf1-d581272a01ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.298997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b43286-a479-4453-abf1-d581272a01ca service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.300127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e55eb-302b-4ce1-8235-9d11168c6cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.301315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e55eb-302b-4ce1-8235-9d11168c6cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.301889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e55eb-302b-4ce1-8235-9d11168c6cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.302191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e55eb-302b-4ce1-8235-9d11168c6cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.303165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e55eb-302b-4ce1-8235-9d11168c6cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:20.303510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e55eb-302b-4ce1-8235-9d11168c6cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.305653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e55eb-302b-4ce1-8235-9d11168c6cd9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.312748 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1565/3122] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:20 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:20.313797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b43286-a479-4453-abf1-d581272a01ca service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.327412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b43286-a479-4453-abf1-d581272a01ca service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.332888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a221d-e593-40b2-9411-30b5eb489595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.333556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a221d-e593-40b2-9411-30b5eb489595 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.333927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a221d-e593-40b2-9411-30b5eb489595 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.334219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a221d-e593-40b2-9411-30b5eb489595 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.335076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a221d-e593-40b2-9411-30b5eb489595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:20.335724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a221d-e593-40b2-9411-30b5eb489595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.337471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a221d-e593-40b2-9411-30b5eb489595 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.340247 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1558/3123] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:20.342698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e55eb-302b-4ce1-8235-9d11168c6cd9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.364949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e55eb-302b-4ce1-8235-9d11168c6cd9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.365503 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1566/3124] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:20.366601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a221d-e593-40b2-9411-30b5eb489595 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.373994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31655d-822b-41b1-ada6-40ff1ff46ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.375796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31655d-822b-41b1-ada6-40ff1ff46ffa admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.376259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31655d-822b-41b1-ada6-40ff1ff46ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.376730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31655d-822b-41b1-ada6-40ff1ff46ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.377626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31655d-822b-41b1-ada6-40ff1ff46ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.380349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31655d-822b-41b1-ada6-40ff1ff46ffa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.390000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a221d-e593-40b2-9411-30b5eb489595 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.401865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf04fa-f6b8-49ac-bcee-a263f5206efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.402467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf04fa-f6b8-49ac-bcee-a263f5206efa admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.402879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf04fa-f6b8-49ac-bcee-a263f5206efa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.403105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf04fa-f6b8-49ac-bcee-a263f5206efa admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.403843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf04fa-f6b8-49ac-bcee-a263f5206efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.405739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf04fa-f6b8-49ac-bcee-a263f5206efa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.436690 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1559/3125] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:20 2021] POST /identity/v3/projects => generated 405 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:20.439481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31655d-822b-41b1-ada6-40ff1ff46ffa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.452883 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1567/3126] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:20 2021] POST /identity/v3/projects => generated 361 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:20.454910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf04fa-f6b8-49ac-bcee-a263f5206efa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.524111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf04fa-f6b8-49ac-bcee-a263f5206efa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.533887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a57ea-69d0-48a5-82f2-a27d0fd05a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.534599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a57ea-69d0-48a5-82f2-a27d0fd05a22 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.534990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a57ea-69d0-48a5-82f2-a27d0fd05a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.535378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a57ea-69d0-48a5-82f2-a27d0fd05a22 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.536004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a57ea-69d0-48a5-82f2-a27d0fd05a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.537962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a57ea-69d0-48a5-82f2-a27d0fd05a22 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.552514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31655d-822b-41b1-ada6-40ff1ff46ffa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.553373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f69a-0cf8-4846-9fd5-540bff455c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.554165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f69a-0cf8-4846-9fd5-540bff455c91 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.554504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f69a-0cf8-4846-9fd5-540bff455c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.554796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206f69a-0cf8-4846-9fd5-540bff455c91 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.555916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206f69a-0cf8-4846-9fd5-540bff455c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.558059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206f69a-0cf8-4846-9fd5-540bff455c91 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.562811 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1568/3127] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:20 2021] POST /identity/v3/users => generated 281 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:52:20.566943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a57ea-69d0-48a5-82f2-a27d0fd05a22 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.581324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a57ea-69d0-48a5-82f2-a27d0fd05a22 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.588377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ffe5d-f853-435c-b59e-8473c94af40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.589111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ffe5d-f853-435c-b59e-8473c94af40a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.589513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ffe5d-f853-435c-b59e-8473c94af40a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.589704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ffe5d-f853-435c-b59e-8473c94af40a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.590495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ffe5d-f853-435c-b59e-8473c94af40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.593231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ffe5d-f853-435c-b59e-8473c94af40a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.595564 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1560/3128] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:20 2021] POST /identity/v3/users => generated 303 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:20.597879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f69a-0cf8-4846-9fd5-540bff455c91 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.609453 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1569/3129] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:20 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:20.611108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ffe5d-f853-435c-b59e-8473c94af40a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.611551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206f69a-0cf8-4846-9fd5-540bff455c91 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.617367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15e52-f8f9-481c-a0c0-e83974099234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.618091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15e52-f8f9-481c-a0c0-e83974099234 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.619465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15e52-f8f9-481c-a0c0-e83974099234 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.619782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15e52-f8f9-481c-a0c0-e83974099234 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.621042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15e52-f8f9-481c-a0c0-e83974099234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.622509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ffe5d-f853-435c-b59e-8473c94af40a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.622760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15e52-f8f9-481c-a0c0-e83974099234 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.628837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eedda-90c5-46e2-a0d3-2235f34669b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.629608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eedda-90c5-46e2-a0d3-2235f34669b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.629964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eedda-90c5-46e2-a0d3-2235f34669b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.630308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eedda-90c5-46e2-a0d3-2235f34669b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.631506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eedda-90c5-46e2-a0d3-2235f34669b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.633277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eedda-90c5-46e2-a0d3-2235f34669b6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.639455 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1561/3130] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:20 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:20.643840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15e52-f8f9-481c-a0c0-e83974099234 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.653618 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1570/3131] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:20 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:20.658598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eedda-90c5-46e2-a0d3-2235f34669b6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.675513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eedda-90c5-46e2-a0d3-2235f34669b6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.678800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15e52-f8f9-481c-a0c0-e83974099234 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.686954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a80d5-baa1-42df-8b41-f676033fdfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.687500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251454e8-7dcf-4286-9584-feb70bc5752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.687765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251454e8-7dcf-4286-9584-feb70bc5752b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.688046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251454e8-7dcf-4286-9584-feb70bc5752b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.688325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251454e8-7dcf-4286-9584-feb70bc5752b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.688528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a80d5-baa1-42df-8b41-f676033fdfce admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.688766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a80d5-baa1-42df-8b41-f676033fdfce admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.689063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a80d5-baa1-42df-8b41-f676033fdfce admin admin] PATH_INFO: `/v3/projects/0fd6e504c34543628792a1ad7ca91443/users/a65e7d173a7141789e3a04f345b83557/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.689185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251454e8-7dcf-4286-9584-feb70bc5752b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.690657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251454e8-7dcf-4286-9584-feb70bc5752b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.705059 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1562/3132] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:20 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:52:20.711545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251454e8-7dcf-4286-9584-feb70bc5752b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.727850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a80d5-baa1-42df-8b41-f676033fdfce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd6e504c34543628792a1ad7ca91443, user_id=a65e7d173a7141789e3a04f345b83557, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.732836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a80d5-baa1-42df-8b41-f676033fdfce admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.736377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251454e8-7dcf-4286-9584-feb70bc5752b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:20.745726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4928a-f544-485c-8ddb-5b7164a915a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:20.747036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4928a-f544-485c-8ddb-5b7164a915a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.747934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4928a-f544-485c-8ddb-5b7164a915a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.748272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4928a-f544-485c-8ddb-5b7164a915a9 admin admin] PATH_INFO: `/v3/projects/28aa8029c25b4611abafcabbbeea52c2/users/6940612cf7ec4514bf972947801551f6/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.759890 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1571/3133] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:20 2021] PUT /identity/v3/projects/0fd6e504c34543628792a1ad7ca91443/users/a65e7d173a7141789e3a04f345b83557/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:52:20.769605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4928a-f544-485c-8ddb-5b7164a915a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28aa8029c25b4611abafcabbbeea52c2, user_id=6940612cf7ec4514bf972947801551f6, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:20.772175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baa668-0ee5-4918-8fa3-801c6b8812d3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.772766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baa668-0ee5-4918-8fa3-801c6b8812d3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.774538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4928a-f544-485c-8ddb-5b7164a915a9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:20.774839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baa668-0ee5-4918-8fa3-801c6b8812d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.803342 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1563/3134] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:20 2021] PUT /identity/v3/projects/28aa8029c25b4611abafcabbbeea52c2/users/6940612cf7ec4514bf972947801551f6/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:20.813558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf22c-db90-4a29-8b3d-14c828b4b108 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:20.814181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf22c-db90-4a29-8b3d-14c828b4b108 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:20.814670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf22c-db90-4a29-8b3d-14c828b4b108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:20.833357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-63baa668-0ee5-4918-8fa3-801c6b8812d3 None None] MFA Rules not processed for user `a65e7d173a7141789e3a04f345b83557`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:20.834744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-63baa668-0ee5-4918-8fa3-801c6b8812d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:20.879423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e0acf22c-db90-4a29-8b3d-14c828b4b108 None None] MFA Rules not processed for user `6940612cf7ec4514bf972947801551f6`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:20.880925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e0acf22c-db90-4a29-8b3d-14c828b4b108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:20.946194 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1572/3135] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:20 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:20.960490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baa668-0ee5-4918-8fa3-801c6b8812d3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:20.964895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-63baa668-0ee5-4918-8fa3-801c6b8812d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:21.002369 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1564/3136] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:20 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:21.007149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acf22c-db90-4a29-8b3d-14c828b4b108 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:21.098898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acf22c-db90-4a29-8b3d-14c828b4b108 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:21.100796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baa668-0ee5-4918-8fa3-801c6b8812d3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:21.104462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8747074-faea-4b9a-8f9a-0d56a7b4e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:21.105734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8747074-faea-4b9a-8f9a-0d56a7b4e7bf admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.106786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8747074-faea-4b9a-8f9a-0d56a7b4e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.106786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8747074-faea-4b9a-8f9a-0d56a7b4e7bf admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:21.107845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8747074-faea-4b9a-8f9a-0d56a7b4e7bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:21.109556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8d96a-e375-46b9-8410-34f4afe754ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:21.110458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8d96a-e375-46b9-8410-34f4afe754ef service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.110856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8d96a-e375-46b9-8410-34f4afe754ef service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.111282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8d96a-e375-46b9-8410-34f4afe754ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:21.111714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8747074-faea-4b9a-8f9a-0d56a7b4e7bf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:21.144745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8d96a-e375-46b9-8410-34f4afe754ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:21.146596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8d96a-e375-46b9-8410-34f4afe754ef service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:21.152415 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1565/3137] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:21 2021] POST /identity/v3/projects => generated 407 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:21.154731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8747074-faea-4b9a-8f9a-0d56a7b4e7bf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:21.157027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b8747074-faea-4b9a-8f9a-0d56a7b4e7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:21.161715 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1573/3138] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:20 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:52:21.163178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8d96a-e375-46b9-8410-34f4afe754ef service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:21.178857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8d96a-e375-46b9-8410-34f4afe754ef service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:21.239283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8747074-faea-4b9a-8f9a-0d56a7b4e7bf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:21.244394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ac844-363a-4608-a568-68d3fc46a48e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:21.245623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac844-363a-4608-a568-68d3fc46a48e service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.246387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac844-363a-4608-a568-68d3fc46a48e service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.246767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac844-363a-4608-a568-68d3fc46a48e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:21.249283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4e0ac844-363a-4608-a568-68d3fc46a48e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:21.264488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ac844-363a-4608-a568-68d3fc46a48e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:21.266935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ac844-363a-4608-a568-68d3fc46a48e service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:21.276753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf8bfe-fd45-4c93-bed0-70322dca9ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:21.277427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf8bfe-fd45-4c93-bed0-70322dca9ebd admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.277788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf8bfe-fd45-4c93-bed0-70322dca9ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.278075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf8bfe-fd45-4c93-bed0-70322dca9ebd admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:21.278929 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1566/3139] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:21 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:21.279073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf8bfe-fd45-4c93-bed0-70322dca9ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:21.280166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ac844-363a-4608-a568-68d3fc46a48e service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:21.284328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf8bfe-fd45-4c93-bed0-70322dca9ebd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:21.293707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ac844-363a-4608-a568-68d3fc46a48e service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:21.305272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccbd83-63fc-46eb-a7a8-7c24c309ec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:21.308733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccbd83-63fc-46eb-a7a8-7c24c309ec54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.309299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccbd83-63fc-46eb-a7a8-7c24c309ec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.309772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccbd83-63fc-46eb-a7a8-7c24c309ec54 admin admin] PATH_INFO: `/v3/users/a65e7d173a7141789e3a04f345b83557` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:21.312391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccbd83-63fc-46eb-a7a8-7c24c309ec54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65e7d173a7141789e3a04f345b83557)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:21.315106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fccbd83-63fc-46eb-a7a8-7c24c309ec54 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:21.321014 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1574/3140] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:21 2021] POST /identity/v3/users => generated 310 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:21.325366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf8bfe-fd45-4c93-bed0-70322dca9ebd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:21.339777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf8bfe-fd45-4c93-bed0-70322dca9ebd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:21.345010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e292a4c-3616-4b7d-a2e2-5c063e9872fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:21.345682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e292a4c-3616-4b7d-a2e2-5c063e9872fd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.346304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e292a4c-3616-4b7d-a2e2-5c063e9872fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.346585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e292a4c-3616-4b7d-a2e2-5c063e9872fd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:21.347345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e292a4c-3616-4b7d-a2e2-5c063e9872fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:21.348965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e292a4c-3616-4b7d-a2e2-5c063e9872fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:21.371782 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1575/3141] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:21 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:21.374995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e292a4c-3616-4b7d-a2e2-5c063e9872fd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:21.394951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e292a4c-3616-4b7d-a2e2-5c063e9872fd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:21.402787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1fccbd83-63fc-46eb-a7a8-7c24c309ec54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65e7d173a7141789e3a04f345b83557'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:21.408634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b1cbc-1ab0-41ca-84af-c7b3ffbf1658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:21.410044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b1cbc-1ab0-41ca-84af-c7b3ffbf1658 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.410227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b1cbc-1ab0-41ca-84af-c7b3ffbf1658 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.410493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b1cbc-1ab0-41ca-84af-c7b3ffbf1658 admin admin] PATH_INFO: `/v3/projects/9a6e0a498bc14a758926403c70d29107/users/4f36477b3b0e445c95f5d37cf24242ea/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:21.414194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1fccbd83-63fc-46eb-a7a8-7c24c309ec54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65e7d173a7141789e3a04f345b83557'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:21.416557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1fccbd83-63fc-46eb-a7a8-7c24c309ec54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65e7d173a7141789e3a04f345b83557'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:21.430124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b1cbc-1ab0-41ca-84af-c7b3ffbf1658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6e0a498bc14a758926403c70d29107, user_id=4f36477b3b0e445c95f5d37cf24242ea, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:21.433042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b1cbc-1ab0-41ca-84af-c7b3ffbf1658 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:21.451921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1fccbd83-63fc-46eb-a7a8-7c24c309ec54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65e7d173a7141789e3a04f345b83557'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:21.460588 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1576/3142] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:21 2021] PUT /identity/v3/projects/9a6e0a498bc14a758926403c70d29107/users/4f36477b3b0e445c95f5d37cf24242ea/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:21.465173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b1cbc-1ab0-41ca-84af-c7b3ffbf1658 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:21.468326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1b0b1cbc-1ab0-41ca-84af-c7b3ffbf1658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:21.474759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1fccbd83-63fc-46eb-a7a8-7c24c309ec54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65e7d173a7141789e3a04f345b83557'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:21.489691 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1567/3143] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:21 2021] DELETE /identity/v3/users/a65e7d173a7141789e3a04f345b83557 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:21.494771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83add39-540c-4d54-9ad3-553444237f43 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.495061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83add39-540c-4d54-9ad3-553444237f43 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.495365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83add39-540c-4d54-9ad3-553444237f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:21.531443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c83add39-540c-4d54-9ad3-553444237f43 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:21.532690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c83add39-540c-4d54-9ad3-553444237f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:21.645099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b1cbc-1ab0-41ca-84af-c7b3ffbf1658 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:21.675428 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1568/3144] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:21.686865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83add39-540c-4d54-9ad3-553444237f43 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:21.691149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c83add39-540c-4d54-9ad3-553444237f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:21.834510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea51537-2c48-4296-b8ee-7feed0c06396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:21.835396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea51537-2c48-4296-b8ee-7feed0c06396 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.835786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea51537-2c48-4296-b8ee-7feed0c06396 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.836468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea51537-2c48-4296-b8ee-7feed0c06396 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:21.840250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea51537-2c48-4296-b8ee-7feed0c06396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:21.842679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea51537-2c48-4296-b8ee-7feed0c06396 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:21.849618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83add39-540c-4d54-9ad3-553444237f43 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:21.861710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f57ef-78e5-49f0-a16d-2ae84bfcc7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:21.862513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f57ef-78e5-49f0-a16d-2ae84bfcc7fe service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.862948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f57ef-78e5-49f0-a16d-2ae84bfcc7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.863486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f57ef-78e5-49f0-a16d-2ae84bfcc7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:21.866138 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1577/3145] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:21 2021] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:21.871806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea51537-2c48-4296-b8ee-7feed0c06396 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:21.887066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f57ef-78e5-49f0-a16d-2ae84bfcc7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:21.889630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f57ef-78e5-49f0-a16d-2ae84bfcc7fe service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:21.913773 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1569/3146] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:21.916087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea51537-2c48-4296-b8ee-7feed0c06396 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:21.935485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353483f2-cdbc-4f62-a076-0d547187d2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:21.940516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353483f2-cdbc-4f62-a076-0d547187d2db admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.940816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353483f2-cdbc-4f62-a076-0d547187d2db admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.941100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353483f2-cdbc-4f62-a076-0d547187d2db admin admin] PATH_INFO: `/v3/projects/9a6e0a498bc14a758926403c70d29107/users/4f36477b3b0e445c95f5d37cf24242ea/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:21.949126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353483f2-cdbc-4f62-a076-0d547187d2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6e0a498bc14a758926403c70d29107, user_id=4f36477b3b0e445c95f5d37cf24242ea, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:21.952941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353483f2-cdbc-4f62-a076-0d547187d2db admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:21.980817 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1578/3147] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:21 2021] PUT /identity/v3/projects/9a6e0a498bc14a758926403c70d29107/users/4f36477b3b0e445c95f5d37cf24242ea/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:21.992534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e3a5c-d3ab-4e79-997a-70f5adde239a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:21.993988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e3a5c-d3ab-4e79-997a-70f5adde239a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:21.994301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e3a5c-d3ab-4e79-997a-70f5adde239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:22.094659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e43e3a5c-d3ab-4e79-997a-70f5adde239a None None] MFA Rules not processed for user `4f36477b3b0e445c95f5d37cf24242ea`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:22.097026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e43e3a5c-d3ab-4e79-997a-70f5adde239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:22.237255 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1570/3148] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:21 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:22.250630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353483f2-cdbc-4f62-a076-0d547187d2db admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:22.389931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353483f2-cdbc-4f62-a076-0d547187d2db admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:22.397228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:22.398283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:22.398576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:22.398856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] PATH_INFO: `/v3/users/6940612cf7ec4514bf972947801551f6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:22.400603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6940612cf7ec4514bf972947801551f6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:22.402573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:22.516926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6940612cf7ec4514bf972947801551f6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:22.517690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6940612cf7ec4514bf972947801551f6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:22.541590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6940612cf7ec4514bf972947801551f6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:22.542240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6940612cf7ec4514bf972947801551f6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:22.563205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6940612cf7ec4514bf972947801551f6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:22.623473 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1579/3149] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:22 2021] DELETE /identity/v3/users/6940612cf7ec4514bf972947801551f6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:22.630847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e02de-08fb-4ce8-95bc-6463c82e1dc4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:22.631593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e02de-08fb-4ce8-95bc-6463c82e1dc4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:22.632191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e02de-08fb-4ce8-95bc-6463c82e1dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:22.674124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-250e02de-08fb-4ce8-95bc-6463c82e1dc4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:22.677899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-250e02de-08fb-4ce8-95bc-6463c82e1dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:22.796713 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1571/3150] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:22.806827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:22.808414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:22.900672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ff38b-9ec9-47c2-b2c3-457452efe15b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:22.905522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149547c0-c579-4fd3-b83d-821b078f52de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:22.906499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149547c0-c579-4fd3-b83d-821b078f52de service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:22.907052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149547c0-c579-4fd3-b83d-821b078f52de service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:22.907582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149547c0-c579-4fd3-b83d-821b078f52de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:22.926827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149547c0-c579-4fd3-b83d-821b078f52de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:22.928993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149547c0-c579-4fd3-b83d-821b078f52de service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:22.944801 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1580/3151] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:23.070205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e02de-08fb-4ce8-95bc-6463c82e1dc4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:23.071818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-250e02de-08fb-4ce8-95bc-6463c82e1dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:23.093043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e02de-08fb-4ce8-95bc-6463c82e1dc4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:23.121869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:23.122904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:23.123077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:23.123338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] PATH_INFO: `/v3/projects/0fd6e504c34543628792a1ad7ca91443` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:23.127751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd6e504c34543628792a1ad7ca91443)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:23.130404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:23.256228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd6e504c34543628792a1ad7ca91443', 'request_id': 'req-06faabc8-189c-44a8-9d4e-c37eaf278b4b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:23.270336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd6e504c34543628792a1ad7ca91443', 'request_id': 'req-06faabc8-189c-44a8-9d4e-c37eaf278b4b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:23.277788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd6e504c34543628792a1ad7ca91443', 'request_id': 'req-06faabc8-189c-44a8-9d4e-c37eaf278b4b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:23.291682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] The token cache is being invalidate because project 0fd6e504c34543628792a1ad7ca91443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:23.291982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:23.292809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-06faabc8-189c-44a8-9d4e-c37eaf278b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:23.299893 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1572/3152] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:23 2021] DELETE /identity/v3/projects/0fd6e504c34543628792a1ad7ca91443 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:23.301949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a54cb-99d5-4eae-89d2-c7f2647535a6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:23.302540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a54cb-99d5-4eae-89d2-c7f2647535a6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:23.303155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a54cb-99d5-4eae-89d2-c7f2647535a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:23.337282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ce8a54cb-99d5-4eae-89d2-c7f2647535a6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:23.339241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ce8a54cb-99d5-4eae-89d2-c7f2647535a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:23.423902 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1581/3153] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:23.426670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a257a-3868-4f65-b7a6-a52fd93a8c2b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:23.427024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a257a-3868-4f65-b7a6-a52fd93a8c2b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:23.427340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a257a-3868-4f65-b7a6-a52fd93a8c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:23.456289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f95a257a-3868-4f65-b7a6-a52fd93a8c2b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:23.460641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f95a257a-3868-4f65-b7a6-a52fd93a8c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:23.488341 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1573/3154] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:23.492640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a54cb-99d5-4eae-89d2-c7f2647535a6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:23.505322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a54cb-99d5-4eae-89d2-c7f2647535a6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:23.517619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f90555-31e7-4a69-a88a-7835bb2bb5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:23.518233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f90555-31e7-4a69-a88a-7835bb2bb5cc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:23.518693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f90555-31e7-4a69-a88a-7835bb2bb5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:23.518973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f90555-31e7-4a69-a88a-7835bb2bb5cc admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:23.519905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f90555-31e7-4a69-a88a-7835bb2bb5cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:23.520213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f90555-31e7-4a69-a88a-7835bb2bb5cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:23.521822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f90555-31e7-4a69-a88a-7835bb2bb5cc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:23.566293 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1582/3155] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:23.567886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a257a-3868-4f65-b7a6-a52fd93a8c2b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:23.582724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a257a-3868-4f65-b7a6-a52fd93a8c2b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:23.602610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c52a1-a160-416d-82bb-8b331a4d4bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:23.602610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c52a1-a160-416d-82bb-8b331a4d4bda admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:23.602950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c52a1-a160-416d-82bb-8b331a4d4bda admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:23.603443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c52a1-a160-416d-82bb-8b331a4d4bda admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:23.605536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c52a1-a160-416d-82bb-8b331a4d4bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:23.616597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c52a1-a160-416d-82bb-8b331a4d4bda admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:23.644306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f90555-31e7-4a69-a88a-7835bb2bb5cc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:23.647193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-59f90555-31e7-4a69-a88a-7835bb2bb5cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:23.668062 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1574/3156] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:23 2021] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:23.669467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c52a1-a160-416d-82bb-8b331a4d4bda admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:23.672869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f90555-31e7-4a69-a88a-7835bb2bb5cc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:23.749298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c52a1-a160-416d-82bb-8b331a4d4bda admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:23.755001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63d672-25df-474a-9c43-1702a84f429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:23.755943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63d672-25df-474a-9c43-1702a84f429a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:23.756377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63d672-25df-474a-9c43-1702a84f429a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:23.756808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63d672-25df-474a-9c43-1702a84f429a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:23.757845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63d672-25df-474a-9c43-1702a84f429a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:23.760066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63d672-25df-474a-9c43-1702a84f429a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:23.792042 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1575/3157] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:23 2021] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:23.793285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63d672-25df-474a-9c43-1702a84f429a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:23.804981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63d672-25df-474a-9c43-1702a84f429a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:23.810313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:23.810943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0b218-d956-49d0-ba79-4b48ceac84a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:23.811554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:23.811882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0b218-d956-49d0-ba79-4b48ceac84a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:23.812006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:23.812198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] PATH_INFO: `/v3/projects/28aa8029c25b4611abafcabbbeea52c2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:23.812418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0b218-d956-49d0-ba79-4b48ceac84a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:23.813101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0b218-d956-49d0-ba79-4b48ceac84a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:23.813998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0b218-d956-49d0-ba79-4b48ceac84a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:23.815832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0b218-d956-49d0-ba79-4b48ceac84a2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:23.823339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28aa8029c25b4611abafcabbbeea52c2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:23.826525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:23.841299 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1576/3158] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:23 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:23.843221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0b218-d956-49d0-ba79-4b48ceac84a2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:23.869172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0b218-d956-49d0-ba79-4b48ceac84a2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:23.883150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b7c9b-f179-4fd8-aee8-e7e84fda42fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:23.883866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b7c9b-f179-4fd8-aee8-e7e84fda42fa admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:23.884182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b7c9b-f179-4fd8-aee8-e7e84fda42fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:23.884470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b7c9b-f179-4fd8-aee8-e7e84fda42fa admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:23.885195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b7c9b-f179-4fd8-aee8-e7e84fda42fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:23.887325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b7c9b-f179-4fd8-aee8-e7e84fda42fa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:23.913867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28aa8029c25b4611abafcabbbeea52c2', 'request_id': 'req-d03edec9-aad6-46f5-b162-7ba405c98866'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:23.914426 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1577/3159] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:23 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:23.918147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b7c9b-f179-4fd8-aee8-e7e84fda42fa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:23.922733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28aa8029c25b4611abafcabbbeea52c2', 'request_id': 'req-d03edec9-aad6-46f5-b162-7ba405c98866'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:23.931092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b7c9b-f179-4fd8-aee8-e7e84fda42fa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:23.932702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28aa8029c25b4611abafcabbbeea52c2', 'request_id': 'req-d03edec9-aad6-46f5-b162-7ba405c98866'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:23.945185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] The token cache is being invalidate because project 28aa8029c25b4611abafcabbbeea52c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:23.945842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:23.947007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:23.949288 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1583/3160] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:23 2021] DELETE /identity/v3/projects/28aa8029c25b4611abafcabbbeea52c2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:23.952912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:23.955228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:24.018830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecec76-5840-45b4-bbad-1869642608ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:24.019813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecec76-5840-45b4-bbad-1869642608ea admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:24.020077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecec76-5840-45b4-bbad-1869642608ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:24.020347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecec76-5840-45b4-bbad-1869642608ea admin admin] PATH_INFO: `/v3/projects/99a5eb3bc93349828958b7879707829a/users/745d99de8bd24185aacbbcf7b2c404c2/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:24.041489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecec76-5840-45b4-bbad-1869642608ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a5eb3bc93349828958b7879707829a, user_id=745d99de8bd24185aacbbcf7b2c404c2, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:24.044646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecec76-5840-45b4-bbad-1869642608ea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:24.054566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03edec9-aad6-46f5-b162-7ba405c98866 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:24.064057 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1578/3161] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:23 2021] PUT /identity/v3/projects/99a5eb3bc93349828958b7879707829a/users/745d99de8bd24185aacbbcf7b2c404c2/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:52:24.069994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863df1c-c1b6-457e-a253-dd242c524295 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:24.070411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863df1c-c1b6-457e-a253-dd242c524295 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:24.070775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863df1c-c1b6-457e-a253-dd242c524295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:24.095911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1863df1c-c1b6-457e-a253-dd242c524295 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:24.097520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1863df1c-c1b6-457e-a253-dd242c524295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:24.204091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:24.205204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:24.206050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:24.206533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] PATH_INFO: `/v3/users/4f36477b3b0e445c95f5d37cf24242ea` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:24.210164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f36477b3b0e445c95f5d37cf24242ea)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:24.222154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:24.247724 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1579/3162] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:24.282816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863df1c-c1b6-457e-a253-dd242c524295 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:24.286873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1863df1c-c1b6-457e-a253-dd242c524295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:24.349201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f36477b3b0e445c95f5d37cf24242ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:24.349903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f36477b3b0e445c95f5d37cf24242ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:24.364840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f36477b3b0e445c95f5d37cf24242ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:24.365501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f36477b3b0e445c95f5d37cf24242ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:24.374945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f36477b3b0e445c95f5d37cf24242ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:24.411116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863df1c-c1b6-457e-a253-dd242c524295 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:24.413724 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1584/3163] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:23 2021] DELETE /identity/v3/users/4f36477b3b0e445c95f5d37cf24242ea => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:52:24.487913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ac321-c2a1-47f9-b9ea-1bcbe1159fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:24.488689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac321-c2a1-47f9-b9ea-1bcbe1159fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:24.489283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac321-c2a1-47f9-b9ea-1bcbe1159fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:24.489425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac321-c2a1-47f9-b9ea-1bcbe1159fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:24.491389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e65ac321-c2a1-47f9-b9ea-1bcbe1159fa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:24.579236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ac321-c2a1-47f9-b9ea-1bcbe1159fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:24.581542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ac321-c2a1-47f9-b9ea-1bcbe1159fa7 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:24.594572 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1580/3164] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:25.518080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:25.520162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:25.572544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01de7f7-181e-4b17-8f9c-ca8ebde366f8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:25.583422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:25.585031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:25.585550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:25.586047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] PATH_INFO: `/v3/projects/9a6e0a498bc14a758926403c70d29107` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:25.587853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6e0a498bc14a758926403c70d29107)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:25.591936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:25.677898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6e0a498bc14a758926403c70d29107', 'request_id': 'req-da06cb23-446b-4dc4-86b8-3dc38c6224f5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:25.693589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6e0a498bc14a758926403c70d29107', 'request_id': 'req-da06cb23-446b-4dc4-86b8-3dc38c6224f5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:25.709632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6e0a498bc14a758926403c70d29107', 'request_id': 'req-da06cb23-446b-4dc4-86b8-3dc38c6224f5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:25.783331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] The token cache is being invalidate because project 9a6e0a498bc14a758926403c70d29107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:25.783695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:25.784453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da06cb23-446b-4dc4-86b8-3dc38c6224f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:25.786537 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1585/3165] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:25 2021] DELETE /identity/v3/projects/9a6e0a498bc14a758926403c70d29107 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:25.794233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072eda1-4f44-49c1-98c1-9a899200f319 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:25.794784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072eda1-4f44-49c1-98c1-9a899200f319 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:25.794784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072eda1-4f44-49c1-98c1-9a899200f319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:25.830133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4072eda1-4f44-49c1-98c1-9a899200f319 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:25.831384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4072eda1-4f44-49c1-98c1-9a899200f319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:25.984838 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1581/3166] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:25.994401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8154f-1822-4152-ad2b-a7de1690438d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:25.994996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8154f-1822-4152-ad2b-a7de1690438d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:25.995678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8154f-1822-4152-ad2b-a7de1690438d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:26.051628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-43e8154f-1822-4152-ad2b-a7de1690438d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:26.053486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-43e8154f-1822-4152-ad2b-a7de1690438d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:26.077432 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1586/3167] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:26.081728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072eda1-4f44-49c1-98c1-9a899200f319 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:26.104187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072eda1-4f44-49c1-98c1-9a899200f319 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:26.128361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96f2b1-0c9a-44f4-9551-1304b0db4994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:26.130490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96f2b1-0c9a-44f4-9551-1304b0db4994 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:26.130877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96f2b1-0c9a-44f4-9551-1304b0db4994 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:26.131532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96f2b1-0c9a-44f4-9551-1304b0db4994 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:26.132544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96f2b1-0c9a-44f4-9551-1304b0db4994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:26.133093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96f2b1-0c9a-44f4-9551-1304b0db4994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:26.138935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96f2b1-0c9a-44f4-9551-1304b0db4994 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:26.171581 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1582/3168] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:26.177041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8154f-1822-4152-ad2b-a7de1690438d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:26.226440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8154f-1822-4152-ad2b-a7de1690438d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:26.247315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88d2ac-2eb7-4380-8e19-53defc2aabba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:26.248109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88d2ac-2eb7-4380-8e19-53defc2aabba admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:26.248281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88d2ac-2eb7-4380-8e19-53defc2aabba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:26.248557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88d2ac-2eb7-4380-8e19-53defc2aabba admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:26.249295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88d2ac-2eb7-4380-8e19-53defc2aabba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:26.272540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88d2ac-2eb7-4380-8e19-53defc2aabba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:26.333523 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1587/3169] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:26 2021] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:26.338633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96f2b1-0c9a-44f4-9551-1304b0db4994 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:26.364082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96f2b1-0c9a-44f4-9551-1304b0db4994 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:26.514650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91935314-e51e-4c9a-99f9-8a34eb68fd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:26.515588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91935314-e51e-4c9a-99f9-8a34eb68fd22 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:26.515798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91935314-e51e-4c9a-99f9-8a34eb68fd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:26.516543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91935314-e51e-4c9a-99f9-8a34eb68fd22 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:26.517262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91935314-e51e-4c9a-99f9-8a34eb68fd22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:26.519227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91935314-e51e-4c9a-99f9-8a34eb68fd22 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:26.565296 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1583/3170] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:26 2021] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:26.567083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88d2ac-2eb7-4380-8e19-53defc2aabba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:26.581353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88d2ac-2eb7-4380-8e19-53defc2aabba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:26.599191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c89012-8b16-4de4-9383-c2dfab62974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:26.607043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c89012-8b16-4de4-9383-c2dfab62974c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:26.607378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c89012-8b16-4de4-9383-c2dfab62974c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:26.607661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c89012-8b16-4de4-9383-c2dfab62974c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:26.608444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c89012-8b16-4de4-9383-c2dfab62974c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:26.616464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c89012-8b16-4de4-9383-c2dfab62974c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:26.642092 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1588/3171] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:26 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:26.645790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91935314-e51e-4c9a-99f9-8a34eb68fd22 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:26.664278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91935314-e51e-4c9a-99f9-8a34eb68fd22 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:26.682731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf06749-b93b-40f0-b2c6-e6f905d54bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:26.683762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf06749-b93b-40f0-b2c6-e6f905d54bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:26.684209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf06749-b93b-40f0-b2c6-e6f905d54bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:26.684811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf06749-b93b-40f0-b2c6-e6f905d54bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:26.685728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf06749-b93b-40f0-b2c6-e6f905d54bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:26.687590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf06749-b93b-40f0-b2c6-e6f905d54bc1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:26.715016 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1584/3172] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:26 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:26.719184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c89012-8b16-4de4-9383-c2dfab62974c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:26.734376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c89012-8b16-4de4-9383-c2dfab62974c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:26.743306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db039ef2-7b0d-46a8-b8a5-d9b435ee9b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:26.747320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db039ef2-7b0d-46a8-b8a5-d9b435ee9b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:26.747566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db039ef2-7b0d-46a8-b8a5-d9b435ee9b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:26.747851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db039ef2-7b0d-46a8-b8a5-d9b435ee9b5e admin admin] PATH_INFO: `/v3/projects/4e810170844649a697aa3093382f2fc8/users/756abf1517214100998d596267807ab1/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:26.776431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db039ef2-7b0d-46a8-b8a5-d9b435ee9b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e810170844649a697aa3093382f2fc8, user_id=756abf1517214100998d596267807ab1, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:26.779553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db039ef2-7b0d-46a8-b8a5-d9b435ee9b5e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:26.802577 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1589/3173] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:26 2021] PUT /identity/v3/projects/4e810170844649a697aa3093382f2fc8/users/756abf1517214100998d596267807ab1/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:26.814247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e88de-1814-4597-8335-28c1f2319c8d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:26.815140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e88de-1814-4597-8335-28c1f2319c8d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:26.815634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e88de-1814-4597-8335-28c1f2319c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:26.856870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-de0e88de-1814-4597-8335-28c1f2319c8d None None] MFA Rules not processed for user `756abf1517214100998d596267807ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:26.858708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-de0e88de-1814-4597-8335-28c1f2319c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:27.009480 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1585/3174] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:26 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:27.028767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db039ef2-7b0d-46a8-b8a5-d9b435ee9b5e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:27.031199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-db039ef2-7b0d-46a8-b8a5-d9b435ee9b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:27.214969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db039ef2-7b0d-46a8-b8a5-d9b435ee9b5e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:27.240348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79b8c0-4d70-4070-8e87-c9cda55005a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:27.241537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79b8c0-4d70-4070-8e87-c9cda55005a5 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:27.242100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79b8c0-4d70-4070-8e87-c9cda55005a5 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:27.242604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79b8c0-4d70-4070-8e87-c9cda55005a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:27.260455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79b8c0-4d70-4070-8e87-c9cda55005a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:27.262499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79b8c0-4d70-4070-8e87-c9cda55005a5 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:27.289631 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1590/3175] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:27 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:27.307897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611551d5-6132-44a3-bfba-30e067ab5637 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:27.308369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611551d5-6132-44a3-bfba-30e067ab5637 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:27.308717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611551d5-6132-44a3-bfba-30e067ab5637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:27.351002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-611551d5-6132-44a3-bfba-30e067ab5637 None None] MFA Rules not processed for user `745d99de8bd24185aacbbcf7b2c404c2`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:27.352865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-611551d5-6132-44a3-bfba-30e067ab5637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:27.504721 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1586/3176] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:27 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:27.519012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097cfb4-3e66-495b-ab06-4ff0bb71e5e2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:27.519482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097cfb4-3e66-495b-ab06-4ff0bb71e5e2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:27.519830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097cfb4-3e66-495b-ab06-4ff0bb71e5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:27.572314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9097cfb4-3e66-495b-ab06-4ff0bb71e5e2 None None] MFA Rules not processed for user `745d99de8bd24185aacbbcf7b2c404c2`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:27.573623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9097cfb4-3e66-495b-ab06-4ff0bb71e5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:27.598256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200b05-953e-4d72-89b4-2083211ce631 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:27.598748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200b05-953e-4d72-89b4-2083211ce631 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:27.599320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200b05-953e-4d72-89b4-2083211ce631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:27.613007 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1591/3177] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:27 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:27.615054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097cfb4-3e66-495b-ab06-4ff0bb71e5e2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:27.632848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9097cfb4-3e66-495b-ab06-4ff0bb71e5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:27.655807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6a200b05-953e-4d72-89b4-2083211ce631 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:27.657324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6a200b05-953e-4d72-89b4-2083211ce631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:27.673434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097cfb4-3e66-495b-ab06-4ff0bb71e5e2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:27.691392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f176a8-8562-4ded-885f-9a86dc3deffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:27.693885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f176a8-8562-4ded-885f-9a86dc3deffb service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:27.694296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f176a8-8562-4ded-885f-9a86dc3deffb service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:27.694777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f176a8-8562-4ded-885f-9a86dc3deffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:27.715342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f176a8-8562-4ded-885f-9a86dc3deffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:27.717745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f176a8-8562-4ded-885f-9a86dc3deffb service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:27.737667 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1592/3178] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:27 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:27.772410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f176a8-8562-4ded-885f-9a86dc3deffb service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:27.774360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-39f176a8-8562-4ded-885f-9a86dc3deffb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:27.799411 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1587/3179] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:52:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:27.841001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200b05-953e-4d72-89b4-2083211ce631 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:27.843408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6a200b05-953e-4d72-89b4-2083211ce631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:27.952295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f176a8-8562-4ded-885f-9a86dc3deffb service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:27.965089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:27.967524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:27.968636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:27.969637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] PATH_INFO: `/v3/users/bd59bfbd18e94dbebb2d3a6965c741d3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:27.973441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd59bfbd18e94dbebb2d3a6965c741d3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:27.978854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:27.981748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200b05-953e-4d72-89b4-2083211ce631 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:27.993312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed39759-f013-4fd8-ad4f-4e9204307453 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:27.994522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39759-f013-4fd8-ad4f-4e9204307453 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:27.994894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39759-f013-4fd8-ad4f-4e9204307453 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:27.995290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed39759-f013-4fd8-ad4f-4e9204307453 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:28.039339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed39759-f013-4fd8-ad4f-4e9204307453 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:28.041230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed39759-f013-4fd8-ad4f-4e9204307453 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:28.070051 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1588/3180] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:52:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:52:28.094357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd59bfbd18e94dbebb2d3a6965c741d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:28.095183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd59bfbd18e94dbebb2d3a6965c741d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:28.123189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd59bfbd18e94dbebb2d3a6965c741d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:28.124112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd59bfbd18e94dbebb2d3a6965c741d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:28.139781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd59bfbd18e94dbebb2d3a6965c741d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:28.223357 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1593/3181] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:27 2021] DELETE /identity/v3/users/bd59bfbd18e94dbebb2d3a6965c741d3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:28.256293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5699e-d07f-48b5-8d5c-832305f315f0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:28.256576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5699e-d07f-48b5-8d5c-832305f315f0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:28.256856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5699e-d07f-48b5-8d5c-832305f315f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:28.292056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-84d5699e-d07f-48b5-8d5c-832305f315f0 None None] MFA Rules not processed for user `756abf1517214100998d596267807ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:28.293474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-84d5699e-d07f-48b5-8d5c-832305f315f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:28.426219 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1589/3182] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:28 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:28.800956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:28.803161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:28.952927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd60e49-7e62-45d4-95da-b9ae87ae2a14 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:28.961957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:28.963059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:28.963648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:28.963780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] PATH_INFO: `/v3/projects/a82619851df34e21b4179bd27466ccc7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:28.965603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a82619851df34e21b4179bd27466ccc7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:28.967640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:29.078809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a82619851df34e21b4179bd27466ccc7', 'request_id': 'req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:29.088145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a82619851df34e21b4179bd27466ccc7', 'request_id': 'req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:29.099846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a82619851df34e21b4179bd27466ccc7', 'request_id': 'req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:29.123803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] The token cache is being invalidate because project a82619851df34e21b4179bd27466ccc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:29.124577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:29.125950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-62c9f08f-ae0e-4d26-b560-c4523f17b4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:29.128521 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1594/3183] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:28 2021] DELETE /identity/v3/projects/a82619851df34e21b4179bd27466ccc7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:29.135287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2c90-d2b7-4fc1-b4ca-22db8d0799bf None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:29.135978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2c90-d2b7-4fc1-b4ca-22db8d0799bf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:29.136366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f2c90-d2b7-4fc1-b4ca-22db8d0799bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:29.167490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-606f2c90-d2b7-4fc1-b4ca-22db8d0799bf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:29.169086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-606f2c90-d2b7-4fc1-b4ca-22db8d0799bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:29.245019 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1590/3184] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:29.253764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2959-f50f-4a70-91e6-8bba22a2b082 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:29.254210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2959-f50f-4a70-91e6-8bba22a2b082 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:29.255570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2959-f50f-4a70-91e6-8bba22a2b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:29.318489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec0b5-7906-4844-a82e-5fca477acb91 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:29.318964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec0b5-7906-4844-a82e-5fca477acb91 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:29.319466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ec0b5-7906-4844-a82e-5fca477acb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:29.324524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-921e2959-f50f-4a70-91e6-8bba22a2b082 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:29.329170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-921e2959-f50f-4a70-91e6-8bba22a2b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:29.353054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-820ec0b5-7906-4844-a82e-5fca477acb91 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:29.354377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-820ec0b5-7906-4844-a82e-5fca477acb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:29.357055 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1595/3185] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:29.363126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e2959-f50f-4a70-91e6-8bba22a2b082 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:29.392030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e2959-f50f-4a70-91e6-8bba22a2b082 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:29.397644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8578882-bce8-4362-b6a6-653c5d4ae4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:29.398832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578882-bce8-4362-b6a6-653c5d4ae4ed admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:29.399169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578882-bce8-4362-b6a6-653c5d4ae4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:29.399686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578882-bce8-4362-b6a6-653c5d4ae4ed admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:29.400531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8578882-bce8-4362-b6a6-653c5d4ae4ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:29.400917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8578882-bce8-4362-b6a6-653c5d4ae4ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:29.402757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8578882-bce8-4362-b6a6-653c5d4ae4ed admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:29.417280 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1596/3186] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:29.421300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8578882-bce8-4362-b6a6-653c5d4ae4ed admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:29.438273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8578882-bce8-4362-b6a6-653c5d4ae4ed admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:29.451458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60fc2b-ae95-4c58-a9a3-90ad3f71a9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:29.452387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60fc2b-ae95-4c58-a9a3-90ad3f71a9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:29.453775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60fc2b-ae95-4c58-a9a3-90ad3f71a9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:29.453775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60fc2b-ae95-4c58-a9a3-90ad3f71a9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:29.464518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60fc2b-ae95-4c58-a9a3-90ad3f71a9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:29.467213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60fc2b-ae95-4c58-a9a3-90ad3f71a9f3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:29.477958 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1591/3187] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:52:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 27 20:52:29.500887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ec0b5-7906-4844-a82e-5fca477acb91 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:29.502343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-820ec0b5-7906-4844-a82e-5fca477acb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:29.522490 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1597/3188] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:29 2021] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:29.526744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60fc2b-ae95-4c58-a9a3-90ad3f71a9f3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:29.650582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ec0b5-7906-4844-a82e-5fca477acb91 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:29.655355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60fc2b-ae95-4c58-a9a3-90ad3f71a9f3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:29.661218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4e493-2a18-4ebd-86da-27d37bc95883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:29.661970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4e493-2a18-4ebd-86da-27d37bc95883 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:29.662325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4e493-2a18-4ebd-86da-27d37bc95883 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:29.662681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4e493-2a18-4ebd-86da-27d37bc95883 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:29.663497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4e493-2a18-4ebd-86da-27d37bc95883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:29.666236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4e493-2a18-4ebd-86da-27d37bc95883 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:29.708436 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1598/3189] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:29 2021] POST /identity/v3/users => generated 302 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:29.712703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4e493-2a18-4ebd-86da-27d37bc95883 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:29.730978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4e493-2a18-4ebd-86da-27d37bc95883 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:29.737492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4fe4-6e64-463f-b889-25befa6d1aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:29.738650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4fe4-6e64-463f-b889-25befa6d1aaa admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:29.739427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4fe4-6e64-463f-b889-25befa6d1aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:29.739810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa4fe4-6e64-463f-b889-25befa6d1aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:29.740655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa4fe4-6e64-463f-b889-25befa6d1aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:29.742401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa4fe4-6e64-463f-b889-25befa6d1aaa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:29.767913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216c3f4-c38d-4614-ab82-fbd4abe6d0b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:29.768879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216c3f4-c38d-4614-ab82-fbd4abe6d0b6 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:29.770000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216c3f4-c38d-4614-ab82-fbd4abe6d0b6 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:29.770477 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1599/3190] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:29 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:29.770669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216c3f4-c38d-4614-ab82-fbd4abe6d0b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:29.773705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4fe4-6e64-463f-b889-25befa6d1aaa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:29.788101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa4fe4-6e64-463f-b889-25befa6d1aaa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:29.796379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf8eb8-ad5f-4db6-bd08-bd8c52ed0f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:29.798593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf8eb8-ad5f-4db6-bd08-bd8c52ed0f44 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:29.799124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf8eb8-ad5f-4db6-bd08-bd8c52ed0f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:29.800230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf8eb8-ad5f-4db6-bd08-bd8c52ed0f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:29.801359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf8eb8-ad5f-4db6-bd08-bd8c52ed0f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:29.803657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf8eb8-ad5f-4db6-bd08-bd8c52ed0f44 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:29.816985 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1600/3191] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:29 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:29.821090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf8eb8-ad5f-4db6-bd08-bd8c52ed0f44 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:29.832523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf8eb8-ad5f-4db6-bd08-bd8c52ed0f44 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:29.838642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa8847-e587-423e-b0ba-009f41c47d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:29.840129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8847-e587-423e-b0ba-009f41c47d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:29.840617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8847-e587-423e-b0ba-009f41c47d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:29.841106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa8847-e587-423e-b0ba-009f41c47d31 admin admin] PATH_INFO: `/v3/projects/7204b8a6d33246dd9fb6a9eb3eada494/users/d075653c35c1411f933002488ba17a53/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:29.849809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216c3f4-c38d-4614-ab82-fbd4abe6d0b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:29.851655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216c3f4-c38d-4614-ab82-fbd4abe6d0b6 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:29.862278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa8847-e587-423e-b0ba-009f41c47d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7204b8a6d33246dd9fb6a9eb3eada494, user_id=d075653c35c1411f933002488ba17a53, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:29.863213 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1592/3192] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:52:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:52:29.873613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa8847-e587-423e-b0ba-009f41c47d31 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:29.902253 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1601/3193] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:29 2021] PUT /identity/v3/projects/7204b8a6d33246dd9fb6a9eb3eada494/users/d075653c35c1411f933002488ba17a53/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:52:29.907024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913808-05b8-4fa5-8ce1-b27ba6de215d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:29.907351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913808-05b8-4fa5-8ce1-b27ba6de215d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:29.907632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913808-05b8-4fa5-8ce1-b27ba6de215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:29.929612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c7913808-05b8-4fa5-8ce1-b27ba6de215d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:29.930742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c7913808-05b8-4fa5-8ce1-b27ba6de215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:29.992857 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1593/3194] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:29.994188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa8847-e587-423e-b0ba-009f41c47d31 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:29.996186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bcaa8847-e587-423e-b0ba-009f41c47d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:30.004204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7913808-05b8-4fa5-8ce1-b27ba6de215d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:30.005589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c7913808-05b8-4fa5-8ce1-b27ba6de215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:30.010199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa8847-e587-423e-b0ba-009f41c47d31 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:30.014868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:30.015805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:30.016086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:30.016359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] PATH_INFO: `/v3/users/756abf1517214100998d596267807ab1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:30.017689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=756abf1517214100998d596267807ab1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:30.019675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:30.064272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7913808-05b8-4fa5-8ce1-b27ba6de215d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:30.066793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756abf1517214100998d596267807ab1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:30.067499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756abf1517214100998d596267807ab1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:30.067945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d4533-e774-4386-bfae-5a07b9a35f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:30.068584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4533-e774-4386-bfae-5a07b9a35f93 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:30.068862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4533-e774-4386-bfae-5a07b9a35f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:30.069136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4533-e774-4386-bfae-5a07b9a35f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:30.070994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a41d4533-e774-4386-bfae-5a07b9a35f93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:30.074762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756abf1517214100998d596267807ab1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:30.075490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756abf1517214100998d596267807ab1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:30.082598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756abf1517214100998d596267807ab1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:30.083541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d4533-e774-4386-bfae-5a07b9a35f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:30.085298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d4533-e774-4386-bfae-5a07b9a35f93 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:30.097486 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1594/3195] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:52:30.100987 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1602/3196] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:29 2021] DELETE /identity/v3/users/756abf1517214100998d596267807ab1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:52:30.105465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1607be-2e8b-44a9-b05f-36c12f3414e9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:30.105750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1607be-2e8b-44a9-b05f-36c12f3414e9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:30.106043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1607be-2e8b-44a9-b05f-36c12f3414e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:30.127407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-af1607be-2e8b-44a9-b05f-36c12f3414e9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:30.128613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-af1607be-2e8b-44a9-b05f-36c12f3414e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:30.207121 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1595/3197] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:30.252946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:30.254400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:30.392163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03231-343b-4e95-bb49-733636b47ccb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:30.398254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fadd3-46c8-4d57-ae92-c24f13965975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:30.398948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fadd3-46c8-4d57-ae92-c24f13965975 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:30.399230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fadd3-46c8-4d57-ae92-c24f13965975 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:30.399539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fadd3-46c8-4d57-ae92-c24f13965975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:30.410768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fadd3-46c8-4d57-ae92-c24f13965975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:30.412292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fadd3-46c8-4d57-ae92-c24f13965975 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:30.423211 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1603/3198] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:31.593491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1607be-2e8b-44a9-b05f-36c12f3414e9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:31.595641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-af1607be-2e8b-44a9-b05f-36c12f3414e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:31.620577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1607be-2e8b-44a9-b05f-36c12f3414e9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:31.632011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:31.634337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:31.634639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:31.635148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] PATH_INFO: `/v3/projects/4e810170844649a697aa3093382f2fc8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:31.638837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e810170844649a697aa3093382f2fc8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:31.647026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:31.760831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e810170844649a697aa3093382f2fc8', 'request_id': 'req-80ab8504-4b23-468c-81b7-2c11c892eea3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:31.772952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e810170844649a697aa3093382f2fc8', 'request_id': 'req-80ab8504-4b23-468c-81b7-2c11c892eea3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:31.785054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e810170844649a697aa3093382f2fc8', 'request_id': 'req-80ab8504-4b23-468c-81b7-2c11c892eea3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:31.802208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] The token cache is being invalidate because project 4e810170844649a697aa3093382f2fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:31.802495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:31.807362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80ab8504-4b23-468c-81b7-2c11c892eea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:31.809840 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1596/3199] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:31 2021] DELETE /identity/v3/projects/4e810170844649a697aa3093382f2fc8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:31.815472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c26f-e0a4-44ab-beb4-cf4b182386eb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:31.815978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c26f-e0a4-44ab-beb4-cf4b182386eb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:31.816099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c26f-e0a4-44ab-beb4-cf4b182386eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:31.840402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8188c26f-e0a4-44ab-beb4-cf4b182386eb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:31.841918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8188c26f-e0a4-44ab-beb4-cf4b182386eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:31.926997 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1604/3200] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:31.934454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2e52-0510-40ad-a133-8a8c38b61de7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:31.934778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2e52-0510-40ad-a133-8a8c38b61de7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:31.935017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2e52-0510-40ad-a133-8a8c38b61de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:31.958710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-551e2e52-0510-40ad-a133-8a8c38b61de7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:31.961782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-551e2e52-0510-40ad-a133-8a8c38b61de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:31.976152 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1597/3201] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:31.982432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188c26f-e0a4-44ab-beb4-cf4b182386eb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:31.996339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188c26f-e0a4-44ab-beb4-cf4b182386eb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:32.006656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe29625-f254-4885-8602-1a7b53cfa1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:32.007887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29625-f254-4885-8602-1a7b53cfa1dd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:32.008746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29625-f254-4885-8602-1a7b53cfa1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:32.009511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29625-f254-4885-8602-1a7b53cfa1dd admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:32.011136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe29625-f254-4885-8602-1a7b53cfa1dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:32.011768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe29625-f254-4885-8602-1a7b53cfa1dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:32.013935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe29625-f254-4885-8602-1a7b53cfa1dd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:32.037234 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1605/3202] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:32.042032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e2e52-0510-40ad-a133-8a8c38b61de7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:32.053246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e2e52-0510-40ad-a133-8a8c38b61de7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:32.058712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849e17-6f71-43a7-8f0f-9a551d4c3a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:32.059889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849e17-6f71-43a7-8f0f-9a551d4c3a81 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:32.060248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849e17-6f71-43a7-8f0f-9a551d4c3a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:32.060800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30849e17-6f71-43a7-8f0f-9a551d4c3a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:32.061592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30849e17-6f71-43a7-8f0f-9a551d4c3a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:32.064764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30849e17-6f71-43a7-8f0f-9a551d4c3a81 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:32.104470 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1598/3203] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:32 2021] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:32.104619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe29625-f254-4885-8602-1a7b53cfa1dd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:32.128638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe29625-f254-4885-8602-1a7b53cfa1dd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:32.266579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd689a2-941f-4b12-8adf-03bba4ed4da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:32.272185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd689a2-941f-4b12-8adf-03bba4ed4da4 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:32.273666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd689a2-941f-4b12-8adf-03bba4ed4da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:32.274239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd689a2-941f-4b12-8adf-03bba4ed4da4 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:32.288317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd689a2-941f-4b12-8adf-03bba4ed4da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:32.296225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd689a2-941f-4b12-8adf-03bba4ed4da4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:32.359970 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1606/3204] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:32 2021] POST /identity/v3/users => generated 282 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:52:32.364627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849e17-6f71-43a7-8f0f-9a551d4c3a81 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:32.379909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30849e17-6f71-43a7-8f0f-9a551d4c3a81 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:32.387119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14712503-de86-40ab-8471-7a5bf6102aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:32.387960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14712503-de86-40ab-8471-7a5bf6102aae admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:32.388249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14712503-de86-40ab-8471-7a5bf6102aae admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:32.388527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14712503-de86-40ab-8471-7a5bf6102aae admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:32.389447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14712503-de86-40ab-8471-7a5bf6102aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:32.392125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14712503-de86-40ab-8471-7a5bf6102aae admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:32.417867 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1599/3205] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:32 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:32.419182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd689a2-941f-4b12-8adf-03bba4ed4da4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:32.439704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd689a2-941f-4b12-8adf-03bba4ed4da4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:32.454619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d29fdc-12f8-4879-9abb-f78fa9528342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:32.456719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29fdc-12f8-4879-9abb-f78fa9528342 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:32.457147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29fdc-12f8-4879-9abb-f78fa9528342 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:32.457454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d29fdc-12f8-4879-9abb-f78fa9528342 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:32.459951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d29fdc-12f8-4879-9abb-f78fa9528342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:32.472598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d29fdc-12f8-4879-9abb-f78fa9528342 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:32.499303 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1607/3206] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:32 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:32.502559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14712503-de86-40ab-8471-7a5bf6102aae admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:32.519113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14712503-de86-40ab-8471-7a5bf6102aae admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:32.524343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45908de2-631f-48d0-a4a9-604a03a7a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:32.525232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45908de2-631f-48d0-a4a9-604a03a7a030 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:32.526199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45908de2-631f-48d0-a4a9-604a03a7a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:32.526746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45908de2-631f-48d0-a4a9-604a03a7a030 admin admin] PATH_INFO: `/v3/projects/fe84ac649b6b4faea051ddfd2d4b6185/users/b8a8aa467b0a42459f18f6bd4ee623e4/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:32.578657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45908de2-631f-48d0-a4a9-604a03a7a030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe84ac649b6b4faea051ddfd2d4b6185, user_id=b8a8aa467b0a42459f18f6bd4ee623e4, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:32.591516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45908de2-631f-48d0-a4a9-604a03a7a030 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:32.635047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5c707-6b13-4d3a-9a40-cf46c7d41f3c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:32.635047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5c707-6b13-4d3a-9a40-cf46c7d41f3c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:32.635422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5c707-6b13-4d3a-9a40-cf46c7d41f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:32.637595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1600/3207] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:32 2021] PUT /identity/v3/projects/fe84ac649b6b4faea051ddfd2d4b6185/users/b8a8aa467b0a42459f18f6bd4ee623e4/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:32.682986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3cf5c707-6b13-4d3a-9a40-cf46c7d41f3c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:32.685909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3cf5c707-6b13-4d3a-9a40-cf46c7d41f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:32.917028 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1608/3208] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:32.950901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45908de2-631f-48d0-a4a9-604a03a7a030 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:32.953852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-45908de2-631f-48d0-a4a9-604a03a7a030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:33.103818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45908de2-631f-48d0-a4a9-604a03a7a030 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:33.128225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ea883-80c6-48d7-be18-ff69cc1ef0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:33.130776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ea883-80c6-48d7-be18-ff69cc1ef0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:33.131202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ea883-80c6-48d7-be18-ff69cc1ef0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:33.131699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ea883-80c6-48d7-be18-ff69cc1ef0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:33.157050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ea883-80c6-48d7-be18-ff69cc1ef0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:33.158831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ea883-80c6-48d7-be18-ff69cc1ef0f3 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:33.194992 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1601/3209] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:34.730047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7f428-14a8-4c95-ac77-b60d154c7cf0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:34.730660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7f428-14a8-4c95-ac77-b60d154c7cf0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:34.730764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7f428-14a8-4c95-ac77-b60d154c7cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:34.791375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-73e7f428-14a8-4c95-ac77-b60d154c7cf0 None None] MFA Rules not processed for user `b8a8aa467b0a42459f18f6bd4ee623e4`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:34.792606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-73e7f428-14a8-4c95-ac77-b60d154c7cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:34.900990 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1609/3210] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:34 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:34.912413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502de0-b135-4333-8be2-e463fa40e50c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:34.912947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502de0-b135-4333-8be2-e463fa40e50c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:34.912947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502de0-b135-4333-8be2-e463fa40e50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:34.938929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-22502de0-b135-4333-8be2-e463fa40e50c None None] MFA Rules not processed for user `b8a8aa467b0a42459f18f6bd4ee623e4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:34.941864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-22502de0-b135-4333-8be2-e463fa40e50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:34.973632 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1602/3211] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:34 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:35.319153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7f428-14a8-4c95-ac77-b60d154c7cf0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:35.321148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-73e7f428-14a8-4c95-ac77-b60d154c7cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:35.444996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7f428-14a8-4c95-ac77-b60d154c7cf0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:35.459600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d146b-ac42-418b-83f0-fc85e5330f6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:35.460882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d146b-ac42-418b-83f0-fc85e5330f6c service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:35.461175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d146b-ac42-418b-83f0-fc85e5330f6c service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:35.461453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d146b-ac42-418b-83f0-fc85e5330f6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:35.471836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d146b-ac42-418b-83f0-fc85e5330f6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:35.474117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d146b-ac42-418b-83f0-fc85e5330f6c service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:35.485319 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1610/3212] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:35 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:38.797914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22502de0-b135-4333-8be2-e463fa40e50c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:38.799496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-22502de0-b135-4333-8be2-e463fa40e50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:38.820523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22502de0-b135-4333-8be2-e463fa40e50c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:38.834104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dd79c-daa0-4411-93cd-c1a09452dc18 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:38.834612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dd79c-daa0-4411-93cd-c1a09452dc18 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:38.836407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dd79c-daa0-4411-93cd-c1a09452dc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:38.845832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187d9ab-8d6e-41f9-a6ec-999828e21a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:38.846613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187d9ab-8d6e-41f9-a6ec-999828e21a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:38.848048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187d9ab-8d6e-41f9-a6ec-999828e21a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:38.850701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187d9ab-8d6e-41f9-a6ec-999828e21a51 admin admin] PATH_INFO: `/v3/users/4561f04227544d2ca76bce3dc5618c7f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:38.854287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187d9ab-8d6e-41f9-a6ec-999828e21a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4561f04227544d2ca76bce3dc5618c7f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:38.857336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187d9ab-8d6e-41f9-a6ec-999828e21a51 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:38.929667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-503dd79c-daa0-4411-93cd-c1a09452dc18 None None] MFA Rules not processed for user `d075653c35c1411f933002488ba17a53`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:38.932318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-503dd79c-daa0-4411-93cd-c1a09452dc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:39.042929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7187d9ab-8d6e-41f9-a6ec-999828e21a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4561f04227544d2ca76bce3dc5618c7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:39.064768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7187d9ab-8d6e-41f9-a6ec-999828e21a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4561f04227544d2ca76bce3dc5618c7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:39.067759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7187d9ab-8d6e-41f9-a6ec-999828e21a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4561f04227544d2ca76bce3dc5618c7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:39.097525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7187d9ab-8d6e-41f9-a6ec-999828e21a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4561f04227544d2ca76bce3dc5618c7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:39.130850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7187d9ab-8d6e-41f9-a6ec-999828e21a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4561f04227544d2ca76bce3dc5618c7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:39.145596 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1603/3213] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:38 2021] DELETE /identity/v3/users/4561f04227544d2ca76bce3dc5618c7f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:39.156593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857c653-5130-4d6b-a73f-2e6cb0cff858 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:39.158303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857c653-5130-4d6b-a73f-2e6cb0cff858 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:39.159384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857c653-5130-4d6b-a73f-2e6cb0cff858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:39.162130 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1611/3214] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:38 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:39.173755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dd79c-daa0-4411-93cd-c1a09452dc18 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:39.176395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-503dd79c-daa0-4411-93cd-c1a09452dc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:39.217098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2857c653-5130-4d6b-a73f-2e6cb0cff858 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:39.218815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2857c653-5130-4d6b-a73f-2e6cb0cff858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:39.229088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dd79c-daa0-4411-93cd-c1a09452dc18 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:39.386861 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1604/3215] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:39.439694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857c653-5130-4d6b-a73f-2e6cb0cff858 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:39.444348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2857c653-5130-4d6b-a73f-2e6cb0cff858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:39.466427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd8683-a5ff-4fed-86d6-f050eddd97f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:39.467830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8683-a5ff-4fed-86d6-f050eddd97f9 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:39.468067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8683-a5ff-4fed-86d6-f050eddd97f9 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:39.468405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd8683-a5ff-4fed-86d6-f050eddd97f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:39.557648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd8683-a5ff-4fed-86d6-f050eddd97f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:39.560120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd8683-a5ff-4fed-86d6-f050eddd97f9 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:39.574169 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1612/3216] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:39 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:39.592481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857c653-5130-4d6b-a73f-2e6cb0cff858 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:39.597999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c260-3527-4b8d-a15f-f903c3129d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:39.598970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c260-3527-4b8d-a15f-f903c3129d59 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:39.599377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c260-3527-4b8d-a15f-f903c3129d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:39.599632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166c260-3527-4b8d-a15f-f903c3129d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:39.616291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c260-3527-4b8d-a15f-f903c3129d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:39.619211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166c260-3527-4b8d-a15f-f903c3129d59 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:39.637895 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1605/3217] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:40.351048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd8683-a5ff-4fed-86d6-f050eddd97f9 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:40.353192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-38cd8683-a5ff-4fed-86d6-f050eddd97f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:40.374576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd8683-a5ff-4fed-86d6-f050eddd97f9 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:40.389628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:40.391095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:40.391435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:40.391713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] PATH_INFO: `/v3/projects/c03fae8406904a0da2046c097555cf58` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:40.395037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03fae8406904a0da2046c097555cf58)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:40.397034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:40.474751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03fae8406904a0da2046c097555cf58', 'request_id': 'req-da56208a-e387-414b-a7a8-d0aa9e3b3efd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:40.482093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03fae8406904a0da2046c097555cf58', 'request_id': 'req-da56208a-e387-414b-a7a8-d0aa9e3b3efd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:40.494232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03fae8406904a0da2046c097555cf58', 'request_id': 'req-da56208a-e387-414b-a7a8-d0aa9e3b3efd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:40.507584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] The token cache is being invalidate because project c03fae8406904a0da2046c097555cf58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:40.507860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:40.508620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:40.510928 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1613/3218] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:40 2021] DELETE /identity/v3/projects/c03fae8406904a0da2046c097555cf58 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:40.520410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c260-3527-4b8d-a15f-f903c3129d59 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:40.537812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166c260-3527-4b8d-a15f-f903c3129d59 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:40.629883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa858dc-7d87-48f3-8164-b82a580a6d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:40.631393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa858dc-7d87-48f3-8164-b82a580a6d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:40.631990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa858dc-7d87-48f3-8164-b82a580a6d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:40.632469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa858dc-7d87-48f3-8164-b82a580a6d62 admin admin] PATH_INFO: `/v3/users/516331a90cf4475b84723f44ea82d77f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:40.634188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa858dc-7d87-48f3-8164-b82a580a6d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=516331a90cf4475b84723f44ea82d77f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:40.637352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa858dc-7d87-48f3-8164-b82a580a6d62 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:40.757210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfa858dc-7d87-48f3-8164-b82a580a6d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516331a90cf4475b84723f44ea82d77f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:40.785185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfa858dc-7d87-48f3-8164-b82a580a6d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516331a90cf4475b84723f44ea82d77f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:40.786083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfa858dc-7d87-48f3-8164-b82a580a6d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516331a90cf4475b84723f44ea82d77f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:40.801823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfa858dc-7d87-48f3-8164-b82a580a6d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516331a90cf4475b84723f44ea82d77f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:40.822908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfa858dc-7d87-48f3-8164-b82a580a6d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516331a90cf4475b84723f44ea82d77f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:40.835095 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1606/3219] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:40 2021] DELETE /identity/v3/users/516331a90cf4475b84723f44ea82d77f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:41.307480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:41.309699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:41.341044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56208a-e387-414b-a7a8-d0aa9e3b3efd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:41.500575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:41.501703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:41.502078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:41.502588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] PATH_INFO: `/v3/projects/6d0232d0e6ad4f948c0ebf33ef3bca81` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:41.504387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0232d0e6ad4f948c0ebf33ef3bca81)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:41.507121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:41.579743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0232d0e6ad4f948c0ebf33ef3bca81', 'request_id': 'req-206b2642-9a87-482a-a97e-ff9407d79363'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:41.588026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0232d0e6ad4f948c0ebf33ef3bca81', 'request_id': 'req-206b2642-9a87-482a-a97e-ff9407d79363'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:41.603030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0232d0e6ad4f948c0ebf33ef3bca81', 'request_id': 'req-206b2642-9a87-482a-a97e-ff9407d79363'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:41.627322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] The token cache is being invalidate because project 6d0232d0e6ad4f948c0ebf33ef3bca81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:41.627675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:41.629108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-206b2642-9a87-482a-a97e-ff9407d79363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:41.633279 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1614/3220] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:41 2021] DELETE /identity/v3/projects/6d0232d0e6ad4f948c0ebf33ef3bca81 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:41.640259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582d4e-0d60-4b8e-889a-ffa89485b55e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:41.640851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582d4e-0d60-4b8e-889a-ffa89485b55e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:41.641078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582d4e-0d60-4b8e-889a-ffa89485b55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:41.667901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e1582d4e-0d60-4b8e-889a-ffa89485b55e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:41.670194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e1582d4e-0d60-4b8e-889a-ffa89485b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:41.787055 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1607/3221] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:41.794701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa224d1-a648-4414-a454-e9ec953fd0e5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:41.795168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa224d1-a648-4414-a454-e9ec953fd0e5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:41.795781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa224d1-a648-4414-a454-e9ec953fd0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:41.824860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-aaa224d1-a648-4414-a454-e9ec953fd0e5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:41.827120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aaa224d1-a648-4414-a454-e9ec953fd0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:41.843363 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1615/3222] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:41.848453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1582d4e-0d60-4b8e-889a-ffa89485b55e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:41.860504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1582d4e-0d60-4b8e-889a-ffa89485b55e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:41.870067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b174479-542c-4e4c-82c9-4d5fc48b70f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:41.871109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b174479-542c-4e4c-82c9-4d5fc48b70f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:41.872557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b174479-542c-4e4c-82c9-4d5fc48b70f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:41.873167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b174479-542c-4e4c-82c9-4d5fc48b70f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:41.874661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b174479-542c-4e4c-82c9-4d5fc48b70f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:41.875280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b174479-542c-4e4c-82c9-4d5fc48b70f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:41.915476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b174479-542c-4e4c-82c9-4d5fc48b70f8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:41.972671 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1608/3223] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:52:41.975316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa224d1-a648-4414-a454-e9ec953fd0e5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:42.036774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa224d1-a648-4414-a454-e9ec953fd0e5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:42.056800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f90cbe-e556-4b35-95f5-800137888bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:42.058374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f90cbe-e556-4b35-95f5-800137888bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:42.059961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f90cbe-e556-4b35-95f5-800137888bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:42.060697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f90cbe-e556-4b35-95f5-800137888bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:42.063044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f90cbe-e556-4b35-95f5-800137888bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:42.068854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f90cbe-e556-4b35-95f5-800137888bd7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:42.148132 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1616/3224] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:41 2021] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:42.152778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b174479-542c-4e4c-82c9-4d5fc48b70f8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:42.168758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b174479-542c-4e4c-82c9-4d5fc48b70f8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:42.274587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a531bd4-00cd-4cd8-a465-001fbe135e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:42.275647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531bd4-00cd-4cd8-a465-001fbe135e87 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:42.276784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531bd4-00cd-4cd8-a465-001fbe135e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:42.278756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a531bd4-00cd-4cd8-a465-001fbe135e87 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:42.280197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a531bd4-00cd-4cd8-a465-001fbe135e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:42.283336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a531bd4-00cd-4cd8-a465-001fbe135e87 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:42.318757 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1609/3225] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:42 2021] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:42.322264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f90cbe-e556-4b35-95f5-800137888bd7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:42.338419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f90cbe-e556-4b35-95f5-800137888bd7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:42.344575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9ed3b-f510-4fdb-8c26-bac34aa31537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:42.345690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9ed3b-f510-4fdb-8c26-bac34aa31537 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:42.346289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9ed3b-f510-4fdb-8c26-bac34aa31537 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:42.346782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9ed3b-f510-4fdb-8c26-bac34aa31537 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:42.347796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9ed3b-f510-4fdb-8c26-bac34aa31537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:42.350721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9ed3b-f510-4fdb-8c26-bac34aa31537 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:42.367881 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1617/3226] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:42 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:42.372168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a531bd4-00cd-4cd8-a465-001fbe135e87 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:42.393310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a531bd4-00cd-4cd8-a465-001fbe135e87 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:42.412890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b89ca-cf74-4945-9073-875411e6750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:42.413568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b89ca-cf74-4945-9073-875411e6750e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:42.413849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b89ca-cf74-4945-9073-875411e6750e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:42.414123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b89ca-cf74-4945-9073-875411e6750e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:42.415029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b89ca-cf74-4945-9073-875411e6750e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:42.417410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b89ca-cf74-4945-9073-875411e6750e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:42.438570 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1610/3227] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:42 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:52:42.442540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9ed3b-f510-4fdb-8c26-bac34aa31537 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:42.457403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9ed3b-f510-4fdb-8c26-bac34aa31537 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:42.468127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0085960-8fc5-4fc2-976a-80beea7696e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:42.471018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0085960-8fc5-4fc2-976a-80beea7696e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:42.471492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0085960-8fc5-4fc2-976a-80beea7696e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:42.471776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0085960-8fc5-4fc2-976a-80beea7696e0 admin admin] PATH_INFO: `/v3/projects/9f57434a24104e95bcff0d4cabbd1419/users/9de6e0419e7843089302fa399e9e56aa/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:42.536699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0085960-8fc5-4fc2-976a-80beea7696e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f57434a24104e95bcff0d4cabbd1419, user_id=9de6e0419e7843089302fa399e9e56aa, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:42.550972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0085960-8fc5-4fc2-976a-80beea7696e0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:42.585548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3a5d6-5fe7-43a0-ae35-3a38e6629d28 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:42.585842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3a5d6-5fe7-43a0-ae35-3a38e6629d28 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:42.586119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3a5d6-5fe7-43a0-ae35-3a38e6629d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:42.618097 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1618/3228] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:42 2021] PUT /identity/v3/projects/9f57434a24104e95bcff0d4cabbd1419/users/9de6e0419e7843089302fa399e9e56aa/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:42.619874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea806d-eee1-4657-b014-bfe162348455 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:42.623921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea806d-eee1-4657-b014-bfe162348455 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:42.624360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea806d-eee1-4657-b014-bfe162348455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:42.641844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-30d3a5d6-5fe7-43a0-ae35-3a38e6629d28 None None] MFA Rules not processed for user `4143c311f90d4b6bbae7b8eddcbef26f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:42.645222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-30d3a5d6-5fe7-43a0-ae35-3a38e6629d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:42.674672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-78ea806d-eee1-4657-b014-bfe162348455 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:42.676252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-78ea806d-eee1-4657-b014-bfe162348455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:42.789351 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1611/3229] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:42 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:42.799856 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1619/3230] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:42.820827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3a5d6-5fe7-43a0-ae35-3a38e6629d28 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:42.822548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-30d3a5d6-5fe7-43a0-ae35-3a38e6629d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:42.994337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3a5d6-5fe7-43a0-ae35-3a38e6629d28 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:42.999589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c212104-a7c7-4b25-a95c-7ce8b9059c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:43.000696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c212104-a7c7-4b25-a95c-7ce8b9059c48 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:43.001149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c212104-a7c7-4b25-a95c-7ce8b9059c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:43.001756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c212104-a7c7-4b25-a95c-7ce8b9059c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:43.018988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c212104-a7c7-4b25-a95c-7ce8b9059c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:43.021635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c212104-a7c7-4b25-a95c-7ce8b9059c48 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:43.040033 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1612/3231] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:52:45.014549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0a69-3429-4feb-b9f0-7d4bb6d3e14b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:45.014970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0a69-3429-4feb-b9f0-7d4bb6d3e14b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:45.016498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b0a69-3429-4feb-b9f0-7d4bb6d3e14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:45.117599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c30b0a69-3429-4feb-b9f0-7d4bb6d3e14b None None] MFA Rules not processed for user `9de6e0419e7843089302fa399e9e56aa`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:45.119398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c30b0a69-3429-4feb-b9f0-7d4bb6d3e14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:45.280844 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1620/3232] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:45 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:45.285805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c212104-a7c7-4b25-a95c-7ce8b9059c48 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:45.304637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c212104-a7c7-4b25-a95c-7ce8b9059c48 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:45.313569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec34e8c-2e39-465d-8a6d-b93e213c35b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:45.314815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec34e8c-2e39-465d-8a6d-b93e213c35b9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:45.315444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec34e8c-2e39-465d-8a6d-b93e213c35b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:45.316244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec34e8c-2e39-465d-8a6d-b93e213c35b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:45.317367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec34e8c-2e39-465d-8a6d-b93e213c35b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:45.320671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec34e8c-2e39-465d-8a6d-b93e213c35b9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:45.357793 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1613/3233] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:45 2021] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:45.361712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b0a69-3429-4feb-b9f0-7d4bb6d3e14b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:45.377916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b0a69-3429-4feb-b9f0-7d4bb6d3e14b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:45.516279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620f81-ceaa-4e65-9e32-cc3bd3aba05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:45.517048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f81-ceaa-4e65-9e32-cc3bd3aba05d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:45.517609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f81-ceaa-4e65-9e32-cc3bd3aba05d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:45.518024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f81-ceaa-4e65-9e32-cc3bd3aba05d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:45.519349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28620f81-ceaa-4e65-9e32-cc3bd3aba05d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:45.523415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28620f81-ceaa-4e65-9e32-cc3bd3aba05d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:45.563899 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1621/3234] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:45 2021] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:45.564468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec34e8c-2e39-465d-8a6d-b93e213c35b9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:45.575800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec34e8c-2e39-465d-8a6d-b93e213c35b9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:45.591881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b05a0-501b-490b-aa68-8173b27b3359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:45.592977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b05a0-501b-490b-aa68-8173b27b3359 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:45.594009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b05a0-501b-490b-aa68-8173b27b3359 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:45.594857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b05a0-501b-490b-aa68-8173b27b3359 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:45.597481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b05a0-501b-490b-aa68-8173b27b3359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:45.600536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b05a0-501b-490b-aa68-8173b27b3359 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:45.622905 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1614/3235] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:45 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:52:45.626033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620f81-ceaa-4e65-9e32-cc3bd3aba05d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:45.662020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620f81-ceaa-4e65-9e32-cc3bd3aba05d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:45.678179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf163b8-db7f-485f-9b48-0aa4e36fac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:45.679621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf163b8-db7f-485f-9b48-0aa4e36fac34 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:45.680061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf163b8-db7f-485f-9b48-0aa4e36fac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:45.680700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf163b8-db7f-485f-9b48-0aa4e36fac34 admin admin] PATH_INFO: `/v3/projects/92df0c00386e474a93cd8d970b24248c/users/87179b8fb1994c77b2de2f420719fc05/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:45.706663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf163b8-db7f-485f-9b48-0aa4e36fac34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92df0c00386e474a93cd8d970b24248c, user_id=87179b8fb1994c77b2de2f420719fc05, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:45.709759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf163b8-db7f-485f-9b48-0aa4e36fac34 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:45.757991 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1622/3236] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:45 2021] PUT /identity/v3/projects/92df0c00386e474a93cd8d970b24248c/users/87179b8fb1994c77b2de2f420719fc05/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:45.761777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b05a0-501b-490b-aa68-8173b27b3359 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:45.794072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b05a0-501b-490b-aa68-8173b27b3359 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:45.880461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6830e4-f07c-49dc-9c31-6a3ba4647d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:45.883047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6830e4-f07c-49dc-9c31-6a3ba4647d83 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:45.883349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6830e4-f07c-49dc-9c31-6a3ba4647d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:45.883603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6830e4-f07c-49dc-9c31-6a3ba4647d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:45.884783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6830e4-f07c-49dc-9c31-6a3ba4647d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:45.886751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6830e4-f07c-49dc-9c31-6a3ba4647d83 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:45.900009 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1615/3237] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:45 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:45.904003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf163b8-db7f-485f-9b48-0aa4e36fac34 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:45.919326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf163b8-db7f-485f-9b48-0aa4e36fac34 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:45.936600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c1790-96ad-4d92-ad7c-f53eb412e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:45.937642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c1790-96ad-4d92-ad7c-f53eb412e9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:45.937983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c1790-96ad-4d92-ad7c-f53eb412e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:45.938203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c1790-96ad-4d92-ad7c-f53eb412e9d4 admin admin] PATH_INFO: `/v3/projects/92df0c00386e474a93cd8d970b24248c/users/87179b8fb1994c77b2de2f420719fc05/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:45.946010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c1790-96ad-4d92-ad7c-f53eb412e9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92df0c00386e474a93cd8d970b24248c, user_id=87179b8fb1994c77b2de2f420719fc05, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:45.948737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c1790-96ad-4d92-ad7c-f53eb412e9d4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:45.971039 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1623/3238] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:45 2021] PUT /identity/v3/projects/92df0c00386e474a93cd8d970b24248c/users/87179b8fb1994c77b2de2f420719fc05/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:46.386690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2101-706f-408e-a2d3-178ea3aa2b69 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:46.387545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2101-706f-408e-a2d3-178ea3aa2b69 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:46.388006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e2101-706f-408e-a2d3-178ea3aa2b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:46.407575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e57e2101-706f-408e-a2d3-178ea3aa2b69 None None] MFA Rules not processed for user `6f940822793e422c8436036be6a116a0`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:46.408771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e57e2101-706f-408e-a2d3-178ea3aa2b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:46.498137 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1616/3239] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:46 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:47.585292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b48db6-80a1-4320-b8e4-03caffad49c8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:47.585292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b48db6-80a1-4320-b8e4-03caffad49c8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:47.585292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b48db6-80a1-4320-b8e4-03caffad49c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:47.656517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-79b48db6-80a1-4320-b8e4-03caffad49c8 None None] MFA Rules not processed for user `87179b8fb1994c77b2de2f420719fc05`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:47.658365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-79b48db6-80a1-4320-b8e4-03caffad49c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:47.752064 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1624/3240] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:47 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:47.765443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33327b1-b8dd-4405-8972-fcb7e9cc94e5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:47.765937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33327b1-b8dd-4405-8972-fcb7e9cc94e5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:47.766199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33327b1-b8dd-4405-8972-fcb7e9cc94e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:47.804129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c33327b1-b8dd-4405-8972-fcb7e9cc94e5 None None] MFA Rules not processed for user `9de6e0419e7843089302fa399e9e56aa`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:47.809100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c33327b1-b8dd-4405-8972-fcb7e9cc94e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:47.976597 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1617/3241] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:47 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:48.020455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b48db6-80a1-4320-b8e4-03caffad49c8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:48.022523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-79b48db6-80a1-4320-b8e4-03caffad49c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:48.161246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b48db6-80a1-4320-b8e4-03caffad49c8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:48.177270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876fcbb-c7ce-4175-9c47-d8b52ec3ec44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:48.177997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876fcbb-c7ce-4175-9c47-d8b52ec3ec44 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:48.179491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876fcbb-c7ce-4175-9c47-d8b52ec3ec44 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:48.179800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876fcbb-c7ce-4175-9c47-d8b52ec3ec44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:48.192680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33327b1-b8dd-4405-8972-fcb7e9cc94e5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:48.194507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c33327b1-b8dd-4405-8972-fcb7e9cc94e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:48.204524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876fcbb-c7ce-4175-9c47-d8b52ec3ec44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:48.206873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876fcbb-c7ce-4175-9c47-d8b52ec3ec44 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:48.253160 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1625/3242] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:48 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:48.375747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33327b1-b8dd-4405-8972-fcb7e9cc94e5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:48.383119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d172d0-f8aa-4171-b8fc-b159d3eb38a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:48.384273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d172d0-f8aa-4171-b8fc-b159d3eb38a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:48.386196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d172d0-f8aa-4171-b8fc-b159d3eb38a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:48.392552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d172d0-f8aa-4171-b8fc-b159d3eb38a7 admin admin] PATH_INFO: `/v3/users/d075653c35c1411f933002488ba17a53` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:48.394286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d172d0-f8aa-4171-b8fc-b159d3eb38a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d075653c35c1411f933002488ba17a53)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:48.396785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d172d0-f8aa-4171-b8fc-b159d3eb38a7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:48.485522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-70d172d0-f8aa-4171-b8fc-b159d3eb38a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd075653c35c1411f933002488ba17a53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:48.496259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-70d172d0-f8aa-4171-b8fc-b159d3eb38a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd075653c35c1411f933002488ba17a53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:48.496448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-70d172d0-f8aa-4171-b8fc-b159d3eb38a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd075653c35c1411f933002488ba17a53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:48.515792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-70d172d0-f8aa-4171-b8fc-b159d3eb38a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd075653c35c1411f933002488ba17a53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:48.549356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-70d172d0-f8aa-4171-b8fc-b159d3eb38a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd075653c35c1411f933002488ba17a53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:48.562656 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1618/3243] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:48 2021] DELETE /identity/v3/users/d075653c35c1411f933002488ba17a53 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:48.984532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876fcbb-c7ce-4175-9c47-d8b52ec3ec44 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:49.036100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876fcbb-c7ce-4175-9c47-d8b52ec3ec44 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:49.174369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:49.175841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:49.177009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:49.177009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] PATH_INFO: `/v3/projects/7204b8a6d33246dd9fb6a9eb3eada494` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:49.178727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7204b8a6d33246dd9fb6a9eb3eada494)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:49.181431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:49.248577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7204b8a6d33246dd9fb6a9eb3eada494', 'request_id': 'req-ec226584-d137-4742-b8dc-7ed8dc1f479a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:49.257718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7204b8a6d33246dd9fb6a9eb3eada494', 'request_id': 'req-ec226584-d137-4742-b8dc-7ed8dc1f479a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:49.268161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7204b8a6d33246dd9fb6a9eb3eada494', 'request_id': 'req-ec226584-d137-4742-b8dc-7ed8dc1f479a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:49.281391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] The token cache is being invalidate because project 7204b8a6d33246dd9fb6a9eb3eada494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:49.281674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:49.282322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec226584-d137-4742-b8dc-7ed8dc1f479a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:49.284564 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1626/3244] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:48 2021] DELETE /identity/v3/projects/7204b8a6d33246dd9fb6a9eb3eada494 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:49.290190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d81f41-7894-4621-8c54-51ab42f9e51a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:49.290709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d81f41-7894-4621-8c54-51ab42f9e51a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:49.290826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d81f41-7894-4621-8c54-51ab42f9e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:49.313397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-63d81f41-7894-4621-8c54-51ab42f9e51a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:49.315055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-63d81f41-7894-4621-8c54-51ab42f9e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:49.388298 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1619/3245] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:49.405247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e81d03-7c98-4d9a-9632-37531aff4223 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:49.405540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e81d03-7c98-4d9a-9632-37531aff4223 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:49.405992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e81d03-7c98-4d9a-9632-37531aff4223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:49.440695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-39e81d03-7c98-4d9a-9632-37531aff4223 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:49.442576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-39e81d03-7c98-4d9a-9632-37531aff4223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:49.452323 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1627/3246] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:49.456936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d81f41-7894-4621-8c54-51ab42f9e51a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:49.470017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d81f41-7894-4621-8c54-51ab42f9e51a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:49.477560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419dfc7-b2f9-47dd-bd21-3e0d660e7d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:49.478366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419dfc7-b2f9-47dd-bd21-3e0d660e7d91 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:49.478799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419dfc7-b2f9-47dd-bd21-3e0d660e7d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:49.479191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419dfc7-b2f9-47dd-bd21-3e0d660e7d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:49.480066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419dfc7-b2f9-47dd-bd21-3e0d660e7d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:49.481412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419dfc7-b2f9-47dd-bd21-3e0d660e7d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:49.483245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419dfc7-b2f9-47dd-bd21-3e0d660e7d91 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:49.499473 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1620/3247] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:49.513376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e81d03-7c98-4d9a-9632-37531aff4223 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:49.527733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e81d03-7c98-4d9a-9632-37531aff4223 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:49.533908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b97a63-b68f-45c5-b953-7a8e2b1223e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:49.534579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b97a63-b68f-45c5-b953-7a8e2b1223e4 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:49.534864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b97a63-b68f-45c5-b953-7a8e2b1223e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:49.535142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b97a63-b68f-45c5-b953-7a8e2b1223e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:49.535959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b97a63-b68f-45c5-b953-7a8e2b1223e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:49.537879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b97a63-b68f-45c5-b953-7a8e2b1223e4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:49.569824 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1628/3248] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:49 2021] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:49.574110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419dfc7-b2f9-47dd-bd21-3e0d660e7d91 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:49.586054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419dfc7-b2f9-47dd-bd21-3e0d660e7d91 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:49.654462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8822857-276a-4dbb-8907-44743f1aee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:49.655589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8822857-276a-4dbb-8907-44743f1aee57 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:49.656854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8822857-276a-4dbb-8907-44743f1aee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:49.657296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8822857-276a-4dbb-8907-44743f1aee57 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:49.658157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8822857-276a-4dbb-8907-44743f1aee57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:49.660476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8822857-276a-4dbb-8907-44743f1aee57 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:49.684937 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1621/3249] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:49 2021] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:49.689093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b97a63-b68f-45c5-b953-7a8e2b1223e4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:49.700482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b97a63-b68f-45c5-b953-7a8e2b1223e4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:49.705919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaa01e-306a-429f-a66c-7de2dceaffac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:49.706614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaa01e-306a-429f-a66c-7de2dceaffac admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:49.706894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaa01e-306a-429f-a66c-7de2dceaffac admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:49.707163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaa01e-306a-429f-a66c-7de2dceaffac admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:49.707937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaa01e-306a-429f-a66c-7de2dceaffac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:49.709536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaa01e-306a-429f-a66c-7de2dceaffac admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:49.721333 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1629/3250] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:49 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:52:49.725407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8822857-276a-4dbb-8907-44743f1aee57 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:49.737656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8822857-276a-4dbb-8907-44743f1aee57 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:49.742460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2635ae0-07bc-47d8-b7f9-833faa949b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:49.743334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635ae0-07bc-47d8-b7f9-833faa949b01 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:49.743625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635ae0-07bc-47d8-b7f9-833faa949b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:49.743899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2635ae0-07bc-47d8-b7f9-833faa949b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:49.744890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2635ae0-07bc-47d8-b7f9-833faa949b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:49.746637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2635ae0-07bc-47d8-b7f9-833faa949b01 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:49.758535 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1622/3251] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:49 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:49.762826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaa01e-306a-429f-a66c-7de2dceaffac admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:49.775597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaa01e-306a-429f-a66c-7de2dceaffac admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:49.781868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9af050-5e9f-478f-ba65-5e770715de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:49.782922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9af050-5e9f-478f-ba65-5e770715de2d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:49.784442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9af050-5e9f-478f-ba65-5e770715de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:49.784715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9af050-5e9f-478f-ba65-5e770715de2d admin admin] PATH_INFO: `/v3/projects/a213fde35a8e491eb73cec5b5fd0243e/users/05367c70602d4a579bed97ecb23e49f8/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:49.804038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9af050-5e9f-478f-ba65-5e770715de2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a213fde35a8e491eb73cec5b5fd0243e, user_id=05367c70602d4a579bed97ecb23e49f8, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:49.806795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9af050-5e9f-478f-ba65-5e770715de2d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:49.822450 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1630/3252] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:49 2021] PUT /identity/v3/projects/a213fde35a8e491eb73cec5b5fd0243e/users/05367c70602d4a579bed97ecb23e49f8/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:52:49.833715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865b60f-45df-4324-b374-241e725e231f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:49.835436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865b60f-45df-4324-b374-241e725e231f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:49.836208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865b60f-45df-4324-b374-241e725e231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:49.871867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6865b60f-45df-4324-b374-241e725e231f None None] MFA Rules not processed for user `05367c70602d4a579bed97ecb23e49f8`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:49.873292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6865b60f-45df-4324-b374-241e725e231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:49.968081 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1623/3253] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:49 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:49.999979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9af050-5e9f-478f-ba65-5e770715de2d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:50.001880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ac9af050-5e9f-478f-ba65-5e770715de2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:50.084230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9af050-5e9f-478f-ba65-5e770715de2d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:50.095172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a8f10-d3af-4f7a-a986-ee0139b0d2c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:50.095958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a8f10-d3af-4f7a-a986-ee0139b0d2c1 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:50.096309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a8f10-d3af-4f7a-a986-ee0139b0d2c1 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:50.096590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a8f10-d3af-4f7a-a986-ee0139b0d2c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:50.105309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a8f10-d3af-4f7a-a986-ee0139b0d2c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:50.106928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a8f10-d3af-4f7a-a986-ee0139b0d2c1 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:50.116900 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1631/3254] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:49 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:50.153147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865b60f-45df-4324-b374-241e725e231f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:50.250928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865b60f-45df-4324-b374-241e725e231f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:50.264301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:50.266654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:50.267398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:50.267967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] PATH_INFO: `/v3/users/05367c70602d4a579bed97ecb23e49f8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:50.269745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05367c70602d4a579bed97ecb23e49f8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:50.272107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:50.354190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05367c70602d4a579bed97ecb23e49f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:50.370217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05367c70602d4a579bed97ecb23e49f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:50.370873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05367c70602d4a579bed97ecb23e49f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:50.380139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05367c70602d4a579bed97ecb23e49f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:50.398205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05367c70602d4a579bed97ecb23e49f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:50.407983 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1624/3255] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:50 2021] DELETE /identity/v3/users/05367c70602d4a579bed97ecb23e49f8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:50.412292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e441f6f-e6a2-4032-bb11-d7f930b41085 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:50.412765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e441f6f-e6a2-4032-bb11-d7f930b41085 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:50.413702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e441f6f-e6a2-4032-bb11-d7f930b41085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:50.439866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2e441f6f-e6a2-4032-bb11-d7f930b41085 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:50.442260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2e441f6f-e6a2-4032-bb11-d7f930b41085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:50.535003 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1632/3256] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:50.552799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:50.554344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:50.619330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871e2ba-e820-482a-b6c2-4f8f7f3592c1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:50.623989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9eb106-d552-4d21-98bc-70fed0e382ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:50.625012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb106-d552-4d21-98bc-70fed0e382ec service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:50.625293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb106-d552-4d21-98bc-70fed0e382ec service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:50.625571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb106-d552-4d21-98bc-70fed0e382ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:50.637964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9eb106-d552-4d21-98bc-70fed0e382ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:50.639456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9eb106-d552-4d21-98bc-70fed0e382ec service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:50.651389 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1625/3257] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:51.469491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e441f6f-e6a2-4032-bb11-d7f930b41085 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:51.471997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2e441f6f-e6a2-4032-bb11-d7f930b41085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:51.487720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e441f6f-e6a2-4032-bb11-d7f930b41085 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:51.494996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:51.496192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:51.496792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:51.497289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] PATH_INFO: `/v3/projects/a213fde35a8e491eb73cec5b5fd0243e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:51.499297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a213fde35a8e491eb73cec5b5fd0243e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:51.503495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:51.591376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a213fde35a8e491eb73cec5b5fd0243e', 'request_id': 'req-eb815f95-743a-41b9-a5ca-e585e6e73cc7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:51.601929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a213fde35a8e491eb73cec5b5fd0243e', 'request_id': 'req-eb815f95-743a-41b9-a5ca-e585e6e73cc7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:51.615827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a213fde35a8e491eb73cec5b5fd0243e', 'request_id': 'req-eb815f95-743a-41b9-a5ca-e585e6e73cc7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:51.636262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] The token cache is being invalidate because project a213fde35a8e491eb73cec5b5fd0243e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:51.636753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:51.638005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eb815f95-743a-41b9-a5ca-e585e6e73cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:51.640054 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1633/3258] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:51 2021] DELETE /identity/v3/projects/a213fde35a8e491eb73cec5b5fd0243e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:51.645778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af50566-4a08-47f6-88e8-58f0e509f3d9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:51.646655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af50566-4a08-47f6-88e8-58f0e509f3d9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:51.647118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af50566-4a08-47f6-88e8-58f0e509f3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:51.668857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1af50566-4a08-47f6-88e8-58f0e509f3d9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:51.672920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1af50566-4a08-47f6-88e8-58f0e509f3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:51.768962 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1626/3259] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:51.770378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574cb3c-774b-449c-a7d1-e9311dda9cad None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:51.770677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574cb3c-774b-449c-a7d1-e9311dda9cad None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:51.770976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574cb3c-774b-449c-a7d1-e9311dda9cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:51.807664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a574cb3c-774b-449c-a7d1-e9311dda9cad None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:51.808781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a574cb3c-774b-449c-a7d1-e9311dda9cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:51.825952 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1634/3260] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:51.830185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af50566-4a08-47f6-88e8-58f0e509f3d9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:51.847203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af50566-4a08-47f6-88e8-58f0e509f3d9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:51.852327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38009b1-2410-494c-902b-6a379c9f8f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:51.853883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38009b1-2410-494c-902b-6a379c9f8f7f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:51.854442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38009b1-2410-494c-902b-6a379c9f8f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:51.854884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38009b1-2410-494c-902b-6a379c9f8f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:51.855823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38009b1-2410-494c-902b-6a379c9f8f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:51.856304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38009b1-2410-494c-902b-6a379c9f8f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:51.858854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38009b1-2410-494c-902b-6a379c9f8f7f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:51.879882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574cb3c-774b-449c-a7d1-e9311dda9cad None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:51.899958 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1627/3261] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:51.900788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574cb3c-774b-449c-a7d1-e9311dda9cad None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:51.907048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1980cd-525d-4e7f-8a88-4a201fd84e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:51.907891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1980cd-525d-4e7f-8a88-4a201fd84e9f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:51.908348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1980cd-525d-4e7f-8a88-4a201fd84e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:51.908618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1980cd-525d-4e7f-8a88-4a201fd84e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:51.909321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1980cd-525d-4e7f-8a88-4a201fd84e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:51.911472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1980cd-525d-4e7f-8a88-4a201fd84e9f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:51.944056 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1635/3262] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:51 2021] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:51.948107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38009b1-2410-494c-902b-6a379c9f8f7f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:51.959848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38009b1-2410-494c-902b-6a379c9f8f7f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:52.039904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c573a-8667-48a6-ac31-ff6b6c3945bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:52.040800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c573a-8667-48a6-ac31-ff6b6c3945bb admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:52.041162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c573a-8667-48a6-ac31-ff6b6c3945bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:52.041511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c573a-8667-48a6-ac31-ff6b6c3945bb admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:52.043222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c573a-8667-48a6-ac31-ff6b6c3945bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:52.046226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c573a-8667-48a6-ac31-ff6b6c3945bb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:52.078016 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1628/3263] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:51 2021] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:52:52.081762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1980cd-525d-4e7f-8a88-4a201fd84e9f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:52.095553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1980cd-525d-4e7f-8a88-4a201fd84e9f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:52.100905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334e585-bb32-46c9-85b2-8c946f4df8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:52.101993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334e585-bb32-46c9-85b2-8c946f4df8bf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:52.102377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334e585-bb32-46c9-85b2-8c946f4df8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:52.102756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334e585-bb32-46c9-85b2-8c946f4df8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:52.105702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334e585-bb32-46c9-85b2-8c946f4df8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:52.107964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334e585-bb32-46c9-85b2-8c946f4df8bf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:52.128310 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1636/3264] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:52 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:52:52.132203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c573a-8667-48a6-ac31-ff6b6c3945bb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:52.144122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c573a-8667-48a6-ac31-ff6b6c3945bb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:52.150344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c8bff-d304-4ca7-8eab-f610d861a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:52.151372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c8bff-d304-4ca7-8eab-f610d861a72a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:52.152169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c8bff-d304-4ca7-8eab-f610d861a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:52.153106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c8bff-d304-4ca7-8eab-f610d861a72a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:52.154973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c8bff-d304-4ca7-8eab-f610d861a72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:52.157417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c8bff-d304-4ca7-8eab-f610d861a72a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:52.174437 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1629/3265] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:52 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:52.178342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334e585-bb32-46c9-85b2-8c946f4df8bf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:52.189510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334e585-bb32-46c9-85b2-8c946f4df8bf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:52.197590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124219b-018d-49ee-b97d-149f7981e08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:52.198600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124219b-018d-49ee-b97d-149f7981e08c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:52.198957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124219b-018d-49ee-b97d-149f7981e08c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:52.199334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124219b-018d-49ee-b97d-149f7981e08c admin admin] PATH_INFO: `/v3/projects/53203f1d94a3459dbf0b6983c723acdc/users/94d8138ca24341e191bc56ca4757c738/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:52.218315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124219b-018d-49ee-b97d-149f7981e08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53203f1d94a3459dbf0b6983c723acdc, user_id=94d8138ca24341e191bc56ca4757c738, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:52.222578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124219b-018d-49ee-b97d-149f7981e08c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:52.238198 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1637/3266] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:52 2021] PUT /identity/v3/projects/53203f1d94a3459dbf0b6983c723acdc/users/94d8138ca24341e191bc56ca4757c738/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:52.249427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6409f3-f131-4ed1-8114-bcdfc1f41246 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:52.249840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6409f3-f131-4ed1-8114-bcdfc1f41246 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:52.250280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6409f3-f131-4ed1-8114-bcdfc1f41246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:52.284127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0f6409f3-f131-4ed1-8114-bcdfc1f41246 None None] MFA Rules not processed for user `94d8138ca24341e191bc56ca4757c738`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:52.285554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0f6409f3-f131-4ed1-8114-bcdfc1f41246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:52.405024 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1630/3267] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:52 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:52.614664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124219b-018d-49ee-b97d-149f7981e08c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:52.616651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0124219b-018d-49ee-b97d-149f7981e08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:52.712096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124219b-018d-49ee-b97d-149f7981e08c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:52.717655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60af77-e1d8-4c7c-ba98-1ea5e326fc5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:52.720497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60af77-e1d8-4c7c-ba98-1ea5e326fc5a service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:52.720849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60af77-e1d8-4c7c-ba98-1ea5e326fc5a service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:52.721124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60af77-e1d8-4c7c-ba98-1ea5e326fc5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:52.729537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60af77-e1d8-4c7c-ba98-1ea5e326fc5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:52.731723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60af77-e1d8-4c7c-ba98-1ea5e326fc5a service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:52.741186 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1638/3268] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:52 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:53.192928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6409f3-f131-4ed1-8114-bcdfc1f41246 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:53.285657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6409f3-f131-4ed1-8114-bcdfc1f41246 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:53.291341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:53.292526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:53.293065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:53.293560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] PATH_INFO: `/v3/users/94d8138ca24341e191bc56ca4757c738` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:53.295951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d8138ca24341e191bc56ca4757c738)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:53.299241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:53.354624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d8138ca24341e191bc56ca4757c738'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:53.363911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d8138ca24341e191bc56ca4757c738'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:53.364804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d8138ca24341e191bc56ca4757c738'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:53.373455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d8138ca24341e191bc56ca4757c738'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:53.387668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d8138ca24341e191bc56ca4757c738'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:53.394006 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1631/3269] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:53 2021] DELETE /identity/v3/users/94d8138ca24341e191bc56ca4757c738 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:53.398884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a56d7-2d32-4766-ac91-68b2f0f2e20a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:53.399439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a56d7-2d32-4766-ac91-68b2f0f2e20a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:53.399720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a56d7-2d32-4766-ac91-68b2f0f2e20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:53.418083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-732a56d7-2d32-4766-ac91-68b2f0f2e20a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:53.419325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-732a56d7-2d32-4766-ac91-68b2f0f2e20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:53.514853 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1639/3270] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:53.527203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:53.528762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:53.599754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebce5ad-b457-4467-929e-0a79c14d76a5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:53.603819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8b28f-41d2-4439-853d-079e631d9426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:53.604507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b28f-41d2-4439-853d-079e631d9426 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:53.604794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b28f-41d2-4439-853d-079e631d9426 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:53.605063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b28f-41d2-4439-853d-079e631d9426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:53.617911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8b28f-41d2-4439-853d-079e631d9426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:53.620455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8b28f-41d2-4439-853d-079e631d9426 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:53.636080 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1632/3271] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:54.155293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a56d7-2d32-4766-ac91-68b2f0f2e20a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:54.162339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-732a56d7-2d32-4766-ac91-68b2f0f2e20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:54.182417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a56d7-2d32-4766-ac91-68b2f0f2e20a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:54.199564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:54.200744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:54.201639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:54.202117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] PATH_INFO: `/v3/projects/53203f1d94a3459dbf0b6983c723acdc` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:54.204224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] RBAC: Authorizing `identity:delete_project(project_id=53203f1d94a3459dbf0b6983c723acdc)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:54.207483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:54.268935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53203f1d94a3459dbf0b6983c723acdc', 'request_id': 'req-ef340d93-1af0-41ca-903f-8604bbde346b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:54.275302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53203f1d94a3459dbf0b6983c723acdc', 'request_id': 'req-ef340d93-1af0-41ca-903f-8604bbde346b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:54.283093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53203f1d94a3459dbf0b6983c723acdc', 'request_id': 'req-ef340d93-1af0-41ca-903f-8604bbde346b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:54.293429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] The token cache is being invalidate because project 53203f1d94a3459dbf0b6983c723acdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:52:54.293724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:54.294367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ef340d93-1af0-41ca-903f-8604bbde346b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:52:54.296006 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1640/3272] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:52:54 2021] DELETE /identity/v3/projects/53203f1d94a3459dbf0b6983c723acdc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:54.302072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa5c0-10a9-4651-95b5-a1b69d1aa778 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:54.302584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa5c0-10a9-4651-95b5-a1b69d1aa778 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:54.302775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa5c0-10a9-4651-95b5-a1b69d1aa778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:54.328730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-85caa5c0-10a9-4651-95b5-a1b69d1aa778 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:54.330031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-85caa5c0-10a9-4651-95b5-a1b69d1aa778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:54.402978 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1633/3273] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:52:54.410689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d864b-a46d-4c33-aa46-a4b1bc64e9e2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:54.410983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d864b-a46d-4c33-aa46-a4b1bc64e9e2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:54.411279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d864b-a46d-4c33-aa46-a4b1bc64e9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:54.429857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-862d864b-a46d-4c33-aa46-a4b1bc64e9e2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:54.431121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-862d864b-a46d-4c33-aa46-a4b1bc64e9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:54.439641 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1641/3274] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:54.447848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa5c0-10a9-4651-95b5-a1b69d1aa778 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:54.457483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa5c0-10a9-4651-95b5-a1b69d1aa778 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:54.462579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06033dc-68f5-4847-bb34-ed1c5edbb748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:54.463229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06033dc-68f5-4847-bb34-ed1c5edbb748 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:54.463620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06033dc-68f5-4847-bb34-ed1c5edbb748 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:54.463890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06033dc-68f5-4847-bb34-ed1c5edbb748 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:54.464620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06033dc-68f5-4847-bb34-ed1c5edbb748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:52:54.464946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06033dc-68f5-4847-bb34-ed1c5edbb748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:54.466514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06033dc-68f5-4847-bb34-ed1c5edbb748 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:54.478139 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1634/3275] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:52:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:52:54.482861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d864b-a46d-4c33-aa46-a4b1bc64e9e2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:54.492815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d864b-a46d-4c33-aa46-a4b1bc64e9e2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:54.498079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a598eb-cc22-430c-be83-3c68f2a29de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:54.498725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a598eb-cc22-430c-be83-3c68f2a29de3 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:54.499030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a598eb-cc22-430c-be83-3c68f2a29de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:54.499340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a598eb-cc22-430c-be83-3c68f2a29de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:54.500812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a598eb-cc22-430c-be83-3c68f2a29de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:54.502773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a598eb-cc22-430c-be83-3c68f2a29de3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:54.534381 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1642/3276] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:52:54 2021] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:52:54.535502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06033dc-68f5-4847-bb34-ed1c5edbb748 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:54.545716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06033dc-68f5-4847-bb34-ed1c5edbb748 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:54.600766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2895d2-f4ba-4855-88e0-e8b11c64d77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:54.601553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2895d2-f4ba-4855-88e0-e8b11c64d77b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:54.601834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2895d2-f4ba-4855-88e0-e8b11c64d77b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:54.602119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2895d2-f4ba-4855-88e0-e8b11c64d77b admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:54.602807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2895d2-f4ba-4855-88e0-e8b11c64d77b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:54.604720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2895d2-f4ba-4855-88e0-e8b11c64d77b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:54.625757 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1635/3277] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:52:54 2021] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:52:54.629649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a598eb-cc22-430c-be83-3c68f2a29de3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:54.639794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a598eb-cc22-430c-be83-3c68f2a29de3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:54.644364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05355df-626a-4bd0-8cae-fab96b0b3a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:54.645003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05355df-626a-4bd0-8cae-fab96b0b3a86 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:54.645281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05355df-626a-4bd0-8cae-fab96b0b3a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:54.645552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05355df-626a-4bd0-8cae-fab96b0b3a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:54.646283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05355df-626a-4bd0-8cae-fab96b0b3a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:54.647907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05355df-626a-4bd0-8cae-fab96b0b3a86 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:54.658448 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1643/3278] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:54.662226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2895d2-f4ba-4855-88e0-e8b11c64d77b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:54.672534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2895d2-f4ba-4855-88e0-e8b11c64d77b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:54.677193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317991a-13b6-4da1-9003-5dca4c659cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:54.677839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317991a-13b6-4da1-9003-5dca4c659cab admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:54.678125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317991a-13b6-4da1-9003-5dca4c659cab admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:54.678404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317991a-13b6-4da1-9003-5dca4c659cab admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:54.679134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317991a-13b6-4da1-9003-5dca4c659cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:54.680772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317991a-13b6-4da1-9003-5dca4c659cab admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:54.692291 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1636/3279] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:52:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:52:54.695346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05355df-626a-4bd0-8cae-fab96b0b3a86 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:54.705212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05355df-626a-4bd0-8cae-fab96b0b3a86 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:54.709816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8915f13-d841-4bdd-b504-38a1993b7e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:54.710677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8915f13-d841-4bdd-b504-38a1993b7e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:54.710959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8915f13-d841-4bdd-b504-38a1993b7e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:54.711236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8915f13-d841-4bdd-b504-38a1993b7e21 admin admin] PATH_INFO: `/v3/projects/a5a36051e23f49dba782368a1850ab70/users/2c4afddebd9e4655afb4172809417328/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:54.725401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8915f13-d841-4bdd-b504-38a1993b7e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a36051e23f49dba782368a1850ab70, user_id=2c4afddebd9e4655afb4172809417328, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:54.728090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8915f13-d841-4bdd-b504-38a1993b7e21 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:54.741269 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1644/3280] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:52:54 2021] PUT /identity/v3/projects/a5a36051e23f49dba782368a1850ab70/users/2c4afddebd9e4655afb4172809417328/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:52:54.746718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b21a-ffca-4a33-8103-52a28687b037 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:54.747031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b21a-ffca-4a33-8103-52a28687b037 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:54.747334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b21a-ffca-4a33-8103-52a28687b037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:54.765644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9085b21a-ffca-4a33-8103-52a28687b037 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:54.766879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9085b21a-ffca-4a33-8103-52a28687b037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:54.822889 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1637/3281] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:54.832663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8915f13-d841-4bdd-b504-38a1993b7e21 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:54.834369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e8915f13-d841-4bdd-b504-38a1993b7e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:54.889953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8915f13-d841-4bdd-b504-38a1993b7e21 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:54.893604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fdd4b-2db3-4c83-a73f-0481f5db4a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:54.894234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fdd4b-2db3-4c83-a73f-0481f5db4a4b service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:54.894524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fdd4b-2db3-4c83-a73f-0481f5db4a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:54.894795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fdd4b-2db3-4c83-a73f-0481f5db4a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:54.903677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fdd4b-2db3-4c83-a73f-0481f5db4a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:54.905546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fdd4b-2db3-4c83-a73f-0481f5db4a4b service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:54.915558 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1645/3282] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:52:55.780065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3895-24b2-4f20-9923-b5bf7b8cb57e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:55.780563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3895-24b2-4f20-9923-b5bf7b8cb57e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:55.780667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3895-24b2-4f20-9923-b5bf7b8cb57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:55.811587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-866d3895-24b2-4f20-9923-b5bf7b8cb57e None None] MFA Rules not processed for user `2c4afddebd9e4655afb4172809417328`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:52:55.813633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-866d3895-24b2-4f20-9923-b5bf7b8cb57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:55.917272 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1638/3283] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:52:55 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:52:55.929319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fdd4b-2db3-4c83-a73f-0481f5db4a4b service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:55.930963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8a4fdd4b-2db3-4c83-a73f-0481f5db4a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:52:56.057397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fdd4b-2db3-4c83-a73f-0481f5db4a4b service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:56.064046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7438de6-f4bd-44f7-84e1-812d5a4c8fba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:56.064744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7438de6-f4bd-44f7-84e1-812d5a4c8fba service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:56.065122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7438de6-f4bd-44f7-84e1-812d5a4c8fba service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:52:56.065570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7438de6-f4bd-44f7-84e1-812d5a4c8fba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:52:56.074449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7438de6-f4bd-44f7-84e1-812d5a4c8fba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:52:56.076398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7438de6-f4bd-44f7-84e1-812d5a4c8fba service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:52:56.087057 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1646/3284] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:52:55 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:52:59.967987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d3895-24b2-4f20-9923-b5bf7b8cb57e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:52:59.992525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d3895-24b2-4f20-9923-b5bf7b8cb57e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:52:59.998374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfb71f-6035-4120-9599-ab6a567ab097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:52:59.999199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb71f-6035-4120-9599-ab6a567ab097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:52:59.999553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb71f-6035-4120-9599-ab6a567ab097 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:00.000014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb71f-6035-4120-9599-ab6a567ab097 admin admin] PATH_INFO: `/v3/users/2c4afddebd9e4655afb4172809417328` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:00.001240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfb71f-6035-4120-9599-ab6a567ab097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4afddebd9e4655afb4172809417328)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:00.003139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfb71f-6035-4120-9599-ab6a567ab097 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:00.048932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c0cfb71f-6035-4120-9599-ab6a567ab097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4afddebd9e4655afb4172809417328'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:00.055576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c0cfb71f-6035-4120-9599-ab6a567ab097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4afddebd9e4655afb4172809417328'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:00.056240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c0cfb71f-6035-4120-9599-ab6a567ab097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4afddebd9e4655afb4172809417328'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:00.063618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c0cfb71f-6035-4120-9599-ab6a567ab097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4afddebd9e4655afb4172809417328'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:00.075439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c0cfb71f-6035-4120-9599-ab6a567ab097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4afddebd9e4655afb4172809417328'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:00.081759 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1639/3285] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:52:59 2021] DELETE /identity/v3/users/2c4afddebd9e4655afb4172809417328 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:00.250547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7438de6-f4bd-44f7-84e1-812d5a4c8fba service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:00.268354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7438de6-f4bd-44f7-84e1-812d5a4c8fba service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:00.324719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:00.325564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:00.325851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:00.326127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] PATH_INFO: `/v3/projects/a5a36051e23f49dba782368a1850ab70` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:00.327344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a36051e23f49dba782368a1850ab70)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:00.329913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:00.373932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a36051e23f49dba782368a1850ab70', 'request_id': 'req-1678cdba-50ce-490b-a152-6fb5703c9d91'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:00.380430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a36051e23f49dba782368a1850ab70', 'request_id': 'req-1678cdba-50ce-490b-a152-6fb5703c9d91'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:00.387238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a36051e23f49dba782368a1850ab70', 'request_id': 'req-1678cdba-50ce-490b-a152-6fb5703c9d91'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:00.398239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] The token cache is being invalidate because project a5a36051e23f49dba782368a1850ab70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:53:00.398523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:00.399154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1678cdba-50ce-490b-a152-6fb5703c9d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:00.400694 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1647/3286] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:00 2021] DELETE /identity/v3/projects/a5a36051e23f49dba782368a1850ab70 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:53:00.406519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07754ae-97b3-4c3a-b01a-f4df0b4942d4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:00.406804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07754ae-97b3-4c3a-b01a-f4df0b4942d4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:00.407075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07754ae-97b3-4c3a-b01a-f4df0b4942d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:00.425291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e07754ae-97b3-4c3a-b01a-f4df0b4942d4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:00.426416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e07754ae-97b3-4c3a-b01a-f4df0b4942d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:00.485016 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1640/3287] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:00.492844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851a313-0c35-4a89-b6e1-065ea69e6622 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:00.493135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851a313-0c35-4a89-b6e1-065ea69e6622 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:00.493410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851a313-0c35-4a89-b6e1-065ea69e6622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:00.512501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8851a313-0c35-4a89-b6e1-065ea69e6622 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:00.513693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8851a313-0c35-4a89-b6e1-065ea69e6622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:00.521958 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1648/3288] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:00.526042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07754ae-97b3-4c3a-b01a-f4df0b4942d4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:00.535641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07754ae-97b3-4c3a-b01a-f4df0b4942d4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:00.540242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290d566-2603-46e1-add6-79e48f171107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:00.540984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290d566-2603-46e1-add6-79e48f171107 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:00.541263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290d566-2603-46e1-add6-79e48f171107 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:00.541532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290d566-2603-46e1-add6-79e48f171107 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:00.542258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290d566-2603-46e1-add6-79e48f171107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:53:00.542557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290d566-2603-46e1-add6-79e48f171107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:00.544173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290d566-2603-46e1-add6-79e48f171107 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:00.555868 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1641/3289] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:53:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:53:00.560198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851a313-0c35-4a89-b6e1-065ea69e6622 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:00.570300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851a313-0c35-4a89-b6e1-065ea69e6622 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:00.575105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8f0e9-eac1-47b0-897e-e8306b10d272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:00.575796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f0e9-eac1-47b0-897e-e8306b10d272 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:00.576077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f0e9-eac1-47b0-897e-e8306b10d272 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:00.576348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8f0e9-eac1-47b0-897e-e8306b10d272 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:00.577052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8f0e9-eac1-47b0-897e-e8306b10d272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:00.579014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8f0e9-eac1-47b0-897e-e8306b10d272 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:00.605797 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1649/3290] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:53:00 2021] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:53:00.610277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290d566-2603-46e1-add6-79e48f171107 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:00.621262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290d566-2603-46e1-add6-79e48f171107 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:00.690532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba10e36-f266-46da-ae11-a8c49748dcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:00.690969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba10e36-f266-46da-ae11-a8c49748dcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:00.695640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba10e36-f266-46da-ae11-a8c49748dcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:00.696040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba10e36-f266-46da-ae11-a8c49748dcd0 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:00.696850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba10e36-f266-46da-ae11-a8c49748dcd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:00.699013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba10e36-f266-46da-ae11-a8c49748dcd0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:00.723726 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1642/3291] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:53:00 2021] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:53:00.727492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8f0e9-eac1-47b0-897e-e8306b10d272 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:00.745351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8f0e9-eac1-47b0-897e-e8306b10d272 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:00.751015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379a9d8-6133-4b9e-a50e-a0ec54b32f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:00.751714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a9d8-6133-4b9e-a50e-a0ec54b32f02 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:00.752004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a9d8-6133-4b9e-a50e-a0ec54b32f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:00.752265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a9d8-6133-4b9e-a50e-a0ec54b32f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:00.753001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379a9d8-6133-4b9e-a50e-a0ec54b32f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:00.754605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379a9d8-6133-4b9e-a50e-a0ec54b32f02 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:00.765684 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1650/3292] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:00 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:00.769803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba10e36-f266-46da-ae11-a8c49748dcd0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:00.781487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba10e36-f266-46da-ae11-a8c49748dcd0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:00.786765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882db30-9384-43c9-aabd-b354c51a32a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:00.787448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882db30-9384-43c9-aabd-b354c51a32a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:00.787734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882db30-9384-43c9-aabd-b354c51a32a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:00.788008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882db30-9384-43c9-aabd-b354c51a32a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:00.788736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882db30-9384-43c9-aabd-b354c51a32a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:00.790301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882db30-9384-43c9-aabd-b354c51a32a9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:00.801044 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1643/3293] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:53:00.805375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379a9d8-6133-4b9e-a50e-a0ec54b32f02 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:00.817856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379a9d8-6133-4b9e-a50e-a0ec54b32f02 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:00.822808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd87d83-043e-47a0-97c0-6c70c72506e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:00.823864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87d83-043e-47a0-97c0-6c70c72506e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:00.824270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87d83-043e-47a0-97c0-6c70c72506e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:00.824466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87d83-043e-47a0-97c0-6c70c72506e2 admin admin] PATH_INFO: `/v3/projects/4ce320b0fdb0466692b28dc520686425/users/434669fb63034fa0b91c67050a6b7d28/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:00.841004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd87d83-043e-47a0-97c0-6c70c72506e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce320b0fdb0466692b28dc520686425, user_id=434669fb63034fa0b91c67050a6b7d28, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:00.844367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd87d83-043e-47a0-97c0-6c70c72506e2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:00.861241 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1651/3294] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:53:00 2021] PUT /identity/v3/projects/4ce320b0fdb0466692b28dc520686425/users/434669fb63034fa0b91c67050a6b7d28/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:00.866687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6518753-0b1b-4706-85cc-cfd7cc24d1f2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:00.867023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6518753-0b1b-4706-85cc-cfd7cc24d1f2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:00.867372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6518753-0b1b-4706-85cc-cfd7cc24d1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:00.888617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d6518753-0b1b-4706-85cc-cfd7cc24d1f2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:00.890459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d6518753-0b1b-4706-85cc-cfd7cc24d1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:00.980877 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1644/3295] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:53:00.989186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd87d83-043e-47a0-97c0-6c70c72506e2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:00.991703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0bd87d83-043e-47a0-97c0-6c70c72506e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:01.148883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd87d83-043e-47a0-97c0-6c70c72506e2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:01.162302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbcbd6-cac9-41b3-a0ff-dc47fd26d752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:01.163533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbcbd6-cac9-41b3-a0ff-dc47fd26d752 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:01.164059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbcbd6-cac9-41b3-a0ff-dc47fd26d752 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:01.164505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbcbd6-cac9-41b3-a0ff-dc47fd26d752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:01.184513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbcbd6-cac9-41b3-a0ff-dc47fd26d752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:01.186822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbcbd6-cac9-41b3-a0ff-dc47fd26d752 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:01.211124 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1652/3296] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:02.102748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a788f97-85bb-4e7f-a9e6-2715ba6760d4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:02.103321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a788f97-85bb-4e7f-a9e6-2715ba6760d4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:02.103321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a788f97-85bb-4e7f-a9e6-2715ba6760d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:02.131452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6a788f97-85bb-4e7f-a9e6-2715ba6760d4 None None] MFA Rules not processed for user `434669fb63034fa0b91c67050a6b7d28`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:02.132653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6a788f97-85bb-4e7f-a9e6-2715ba6760d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:02.221848 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1645/3297] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:02 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:53:02.235507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbcbd6-cac9-41b3-a0ff-dc47fd26d752 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:02.239163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-70dbcbd6-cac9-41b3-a0ff-dc47fd26d752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:02.319141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbcbd6-cac9-41b3-a0ff-dc47fd26d752 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:02.325386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c0c5c-cdc4-4969-bbf1-0972edb098bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:02.326033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c0c5c-cdc4-4969-bbf1-0972edb098bb service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:02.326315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c0c5c-cdc4-4969-bbf1-0972edb098bb service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:02.326860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c0c5c-cdc4-4969-bbf1-0972edb098bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:02.336674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c0c5c-cdc4-4969-bbf1-0972edb098bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:02.338300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c0c5c-cdc4-4969-bbf1-0972edb098bb service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:02.348186 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1653/3298] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:02 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:02.811671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c174d2-a693-4e0a-b403-74b7c7628172 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:02.812722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c174d2-a693-4e0a-b403-74b7c7628172 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:02.813280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c174d2-a693-4e0a-b403-74b7c7628172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:02.834505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e3c174d2-a693-4e0a-b403-74b7c7628172 None None] MFA Rules not processed for user `434669fb63034fa0b91c67050a6b7d28`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:02.835755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e3c174d2-a693-4e0a-b403-74b7c7628172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:02.843923 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1646/3299] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:02 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:03.342226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ac5b-e0cb-4f6f-ab82-8f8bdcfcaf43 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:03.344261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ac5b-e0cb-4f6f-ab82-8f8bdcfcaf43 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:03.344713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72ac5b-e0cb-4f6f-ab82-8f8bdcfcaf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:03.368476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5c72ac5b-e0cb-4f6f-ab82-8f8bdcfcaf43 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:03.370647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5c72ac5b-e0cb-4f6f-ab82-8f8bdcfcaf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:03.470251 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1654/3300] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:53:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:03.486225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c174d2-a693-4e0a-b403-74b7c7628172 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:03.487834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e3c174d2-a693-4e0a-b403-74b7c7628172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:03.672701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c174d2-a693-4e0a-b403-74b7c7628172 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:03.688571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0f006-4202-4fa4-bc23-00c78139e1dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:03.689366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0f006-4202-4fa4-bc23-00c78139e1dd service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:03.689714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0f006-4202-4fa4-bc23-00c78139e1dd service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:03.690062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0f006-4202-4fa4-bc23-00c78139e1dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:03.700912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0f006-4202-4fa4-bc23-00c78139e1dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:03.703332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0f006-4202-4fa4-bc23-00c78139e1dd service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:03.714077 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1647/3301] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:53:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:05.409908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18af62-1247-476d-bd67-ef4ca6afe85f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:05.410414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18af62-1247-476d-bd67-ef4ca6afe85f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:05.410706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18af62-1247-476d-bd67-ef4ca6afe85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:05.436236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fa18af62-1247-476d-bd67-ef4ca6afe85f None None] MFA Rules not processed for user `4143c311f90d4b6bbae7b8eddcbef26f`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:05.437900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fa18af62-1247-476d-bd67-ef4ca6afe85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:05.517722 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1655/3302] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:05 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:05.911093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0f006-4202-4fa4-bc23-00c78139e1dd service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:05.928446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0f006-4202-4fa4-bc23-00c78139e1dd service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:05.943958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b784d7-b082-4405-9c00-6ddb96208553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:05.944619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b784d7-b082-4405-9c00-6ddb96208553 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:05.944906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b784d7-b082-4405-9c00-6ddb96208553 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:05.945176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b784d7-b082-4405-9c00-6ddb96208553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:05.949086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d1b784d7-b082-4405-9c00-6ddb96208553 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:06.059011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b784d7-b082-4405-9c00-6ddb96208553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:06.061178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b784d7-b082-4405-9c00-6ddb96208553 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:06.086213 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1648/3303] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:05 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:06.623347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290d6b3-cda0-49a5-8d1c-c6d6a3f8e9f2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:06.624161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290d6b3-cda0-49a5-8d1c-c6d6a3f8e9f2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:06.625156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290d6b3-cda0-49a5-8d1c-c6d6a3f8e9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:06.652053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4290d6b3-cda0-49a5-8d1c-c6d6a3f8e9f2 None None] MFA Rules not processed for user `6f940822793e422c8436036be6a116a0`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:06.654071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4290d6b3-cda0-49a5-8d1c-c6d6a3f8e9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:06.772091 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1656/3304] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:06 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:13.453601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b784d7-b082-4405-9c00-6ddb96208553 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:13.455617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d1b784d7-b082-4405-9c00-6ddb96208553 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:13.482031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b784d7-b082-4405-9c00-6ddb96208553 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:13.496426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e08d6c-0def-4ebc-8cc4-e8d80da5fdee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:13.497081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e08d6c-0def-4ebc-8cc4-e8d80da5fdee service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:13.497582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e08d6c-0def-4ebc-8cc4-e8d80da5fdee service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:13.498111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e08d6c-0def-4ebc-8cc4-e8d80da5fdee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:13.501399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e1e08d6c-0def-4ebc-8cc4-e8d80da5fdee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:13.663012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e08d6c-0def-4ebc-8cc4-e8d80da5fdee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:13.667676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e08d6c-0def-4ebc-8cc4-e8d80da5fdee service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:13.694771 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1649/3305] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:13 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:15.942386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290d6b3-cda0-49a5-8d1c-c6d6a3f8e9f2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:15.943951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4290d6b3-cda0-49a5-8d1c-c6d6a3f8e9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:15.960725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290d6b3-cda0-49a5-8d1c-c6d6a3f8e9f2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:15.966272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53844771-24ee-4ccb-9eb7-a1fc69f9bbba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:15.967038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844771-24ee-4ccb-9eb7-a1fc69f9bbba service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:15.967467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844771-24ee-4ccb-9eb7-a1fc69f9bbba service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:15.967839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844771-24ee-4ccb-9eb7-a1fc69f9bbba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:15.970588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-53844771-24ee-4ccb-9eb7-a1fc69f9bbba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:15.989358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53844771-24ee-4ccb-9eb7-a1fc69f9bbba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:15.991350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53844771-24ee-4ccb-9eb7-a1fc69f9bbba service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:16.007956 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1657/3306] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:20.555558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e08d6c-0def-4ebc-8cc4-e8d80da5fdee service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:20.557685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e1e08d6c-0def-4ebc-8cc4-e8d80da5fdee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:20.579625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e08d6c-0def-4ebc-8cc4-e8d80da5fdee service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:20.585090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:20.586423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:20.587185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:20.587720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] PATH_INFO: `/v3/users/9de6e0419e7843089302fa399e9e56aa` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:20.590850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de6e0419e7843089302fa399e9e56aa)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:20.595001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:20.728811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de6e0419e7843089302fa399e9e56aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:20.751542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de6e0419e7843089302fa399e9e56aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:20.752569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de6e0419e7843089302fa399e9e56aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:20.761995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de6e0419e7843089302fa399e9e56aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:20.790366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de6e0419e7843089302fa399e9e56aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:20.804853 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1650/3307] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:53:20 2021] DELETE /identity/v3/users/9de6e0419e7843089302fa399e9e56aa => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:21.886906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53844771-24ee-4ccb-9eb7-a1fc69f9bbba service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:21.908256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53844771-24ee-4ccb-9eb7-a1fc69f9bbba service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:22.062857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:22.086376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:22.086977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:22.087488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] PATH_INFO: `/v3/projects/9f57434a24104e95bcff0d4cabbd1419` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:22.091955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f57434a24104e95bcff0d4cabbd1419)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:22.099021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:22.275521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f57434a24104e95bcff0d4cabbd1419', 'request_id': 'req-5fe49417-21b2-4b1d-89a6-cd0d9465d735'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:22.290845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f57434a24104e95bcff0d4cabbd1419', 'request_id': 'req-5fe49417-21b2-4b1d-89a6-cd0d9465d735'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:22.313014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f57434a24104e95bcff0d4cabbd1419', 'request_id': 'req-5fe49417-21b2-4b1d-89a6-cd0d9465d735'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:22.341281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] The token cache is being invalidate because project 9f57434a24104e95bcff0d4cabbd1419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:53:22.341778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:22.344514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fe49417-21b2-4b1d-89a6-cd0d9465d735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:22.346727 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1658/3308] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:21 2021] DELETE /identity/v3/projects/9f57434a24104e95bcff0d4cabbd1419 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:22.350983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:22.353194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:22.374952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa0706-ef60-439e-8658-cd10fbc3e7ff admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:22.549384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:22.552270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:22.553158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:22.553657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] PATH_INFO: `/v3/users/87179b8fb1994c77b2de2f420719fc05` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:22.556628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87179b8fb1994c77b2de2f420719fc05)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:22.563199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:22.657201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87179b8fb1994c77b2de2f420719fc05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:22.675569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87179b8fb1994c77b2de2f420719fc05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:22.676523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87179b8fb1994c77b2de2f420719fc05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:22.703921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87179b8fb1994c77b2de2f420719fc05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:22.738884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87179b8fb1994c77b2de2f420719fc05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:22.755206 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1651/3309] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:53:22 2021] DELETE /identity/v3/users/87179b8fb1994c77b2de2f420719fc05 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:23.267147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb530e63-ba5d-4023-addb-53abf47dec40 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:23.267682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb530e63-ba5d-4023-addb-53abf47dec40 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:23.267778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb530e63-ba5d-4023-addb-53abf47dec40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:23.289872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fb530e63-ba5d-4023-addb-53abf47dec40 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:23.291782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fb530e63-ba5d-4023-addb-53abf47dec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:23.385849 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1659/3310] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:53:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:23.403564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:23.406625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:23.604758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b65b9-8fb9-4935-ab2d-50c9881039b1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:23.618850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f80056-b4c6-43bc-b2e1-874f1fadc041 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:23.620946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80056-b4c6-43bc-b2e1-874f1fadc041 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:23.623445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80056-b4c6-43bc-b2e1-874f1fadc041 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:23.624659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80056-b4c6-43bc-b2e1-874f1fadc041 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:23.656583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f80056-b4c6-43bc-b2e1-874f1fadc041 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:23.658218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f80056-b4c6-43bc-b2e1-874f1fadc041 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:23.700053 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1652/3311] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:53:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:24.086521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb530e63-ba5d-4023-addb-53abf47dec40 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:24.088160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fb530e63-ba5d-4023-addb-53abf47dec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:24.239119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb530e63-ba5d-4023-addb-53abf47dec40 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:24.256065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:24.256933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:24.257212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:24.257484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] PATH_INFO: `/v3/projects/92df0c00386e474a93cd8d970b24248c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:24.258799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92df0c00386e474a93cd8d970b24248c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:24.260745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:24.357312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92df0c00386e474a93cd8d970b24248c', 'request_id': 'req-5afd263e-af68-46df-b4f4-7b4ce602a397'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:24.367942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92df0c00386e474a93cd8d970b24248c', 'request_id': 'req-5afd263e-af68-46df-b4f4-7b4ce602a397'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:24.379315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92df0c00386e474a93cd8d970b24248c', 'request_id': 'req-5afd263e-af68-46df-b4f4-7b4ce602a397'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:24.395855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] The token cache is being invalidate because project 92df0c00386e474a93cd8d970b24248c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:53:24.396147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:24.396811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afd263e-af68-46df-b4f4-7b4ce602a397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:24.398472 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1660/3312] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:24 2021] DELETE /identity/v3/projects/92df0c00386e474a93cd8d970b24248c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:24.406839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a7603-4e71-4b08-a811-801608842fe3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:24.407418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a7603-4e71-4b08-a811-801608842fe3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:24.407418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a7603-4e71-4b08-a811-801608842fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:24.444622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6f7a7603-4e71-4b08-a811-801608842fe3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:24.446805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6f7a7603-4e71-4b08-a811-801608842fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:24.541389 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1653/3313] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:24.596154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5a7eb-e683-481c-bf0d-8f8fdcc8ddce None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:24.596445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5a7eb-e683-481c-bf0d-8f8fdcc8ddce None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:24.596744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5a7eb-e683-481c-bf0d-8f8fdcc8ddce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:24.625730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0cd5a7eb-e683-481c-bf0d-8f8fdcc8ddce None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:24.627460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0cd5a7eb-e683-481c-bf0d-8f8fdcc8ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:24.638696 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1661/3314] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:24.643483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a7603-4e71-4b08-a811-801608842fe3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:24.655889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a7603-4e71-4b08-a811-801608842fe3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:24.662169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78341b42-fb53-4638-a932-f06c9b9ff6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:24.663465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78341b42-fb53-4638-a932-f06c9b9ff6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:24.663915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78341b42-fb53-4638-a932-f06c9b9ff6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:24.664356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78341b42-fb53-4638-a932-f06c9b9ff6e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:24.665275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78341b42-fb53-4638-a932-f06c9b9ff6e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:53:24.665750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78341b42-fb53-4638-a932-f06c9b9ff6e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:24.667666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78341b42-fb53-4638-a932-f06c9b9ff6e2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:24.686199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5a7eb-e683-481c-bf0d-8f8fdcc8ddce None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:24.692266 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1654/3315] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:53:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:53:24.696051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5a7eb-e683-481c-bf0d-8f8fdcc8ddce None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:24.704536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77677a2-c8a1-44c6-aa0c-132f0e4b36fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:24.705527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77677a2-c8a1-44c6-aa0c-132f0e4b36fa admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:24.705819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77677a2-c8a1-44c6-aa0c-132f0e4b36fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:24.706099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77677a2-c8a1-44c6-aa0c-132f0e4b36fa admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:24.706825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77677a2-c8a1-44c6-aa0c-132f0e4b36fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:24.708762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77677a2-c8a1-44c6-aa0c-132f0e4b36fa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:24.758893 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1662/3316] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:53:24 2021] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:53:24.763706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78341b42-fb53-4638-a932-f06c9b9ff6e2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:24.779002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78341b42-fb53-4638-a932-f06c9b9ff6e2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:24.876238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7d2f1-8a72-4ab7-9850-d44aa09e9b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:24.877100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7d2f1-8a72-4ab7-9850-d44aa09e9b80 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:24.877390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7d2f1-8a72-4ab7-9850-d44aa09e9b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:24.877667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7d2f1-8a72-4ab7-9850-d44aa09e9b80 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:24.878512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7d2f1-8a72-4ab7-9850-d44aa09e9b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:24.892926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7d2f1-8a72-4ab7-9850-d44aa09e9b80 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:24.927423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77677a2-c8a1-44c6-aa0c-132f0e4b36fa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:24.929704 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1655/3317] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:53:24 2021] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:24.939620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0d2d6-c3bb-4e9b-b2dc-26cd93c93ad9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:24.939914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0d2d6-c3bb-4e9b-b2dc-26cd93c93ad9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:24.940191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0d2d6-c3bb-4e9b-b2dc-26cd93c93ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:24.941618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77677a2-c8a1-44c6-aa0c-132f0e4b36fa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:24.957374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985a6e8-c331-4bb3-a24b-ac1801df5ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:24.958013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985a6e8-c331-4bb3-a24b-ac1801df5ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:24.958290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985a6e8-c331-4bb3-a24b-ac1801df5ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:24.958765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985a6e8-c331-4bb3-a24b-ac1801df5ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:24.959892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985a6e8-c331-4bb3-a24b-ac1801df5ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:24.961995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985a6e8-c331-4bb3-a24b-ac1801df5ee7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:24.983383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b6c0d2d6-c3bb-4e9b-b2dc-26cd93c93ad9 None None] MFA Rules not processed for user `b8a8aa467b0a42459f18f6bd4ee623e4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:24.984832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b6c0d2d6-c3bb-4e9b-b2dc-26cd93c93ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:24.985698 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1663/3318] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:24 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:24.989504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985a6e8-c331-4bb3-a24b-ac1801df5ee7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:25.013218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985a6e8-c331-4bb3-a24b-ac1801df5ee7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:25.029840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbfb7b-bc49-4021-b999-2bfcd09d7303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:25.030241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbfb7b-bc49-4021-b999-2bfcd09d7303 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:25.030526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbfb7b-bc49-4021-b999-2bfcd09d7303 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:25.030804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbfb7b-bc49-4021-b999-2bfcd09d7303 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:25.031574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbfb7b-bc49-4021-b999-2bfcd09d7303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:25.033179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbfb7b-bc49-4021-b999-2bfcd09d7303 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:25.066505 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1664/3319] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:24 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:25.072901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbfb7b-bc49-4021-b999-2bfcd09d7303 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:25.109847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbfb7b-bc49-4021-b999-2bfcd09d7303 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:25.120453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62951-e7b5-4a05-823f-698bfda3eab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:25.121863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62951-e7b5-4a05-823f-698bfda3eab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:25.122155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62951-e7b5-4a05-823f-698bfda3eab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:25.122429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e62951-e7b5-4a05-823f-698bfda3eab0 admin admin] PATH_INFO: `/v3/projects/65a608f2c265434999aa734f1841b2a3/users/5206ef55b9694b4faa3ef71d001d94d4/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:25.145964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e62951-e7b5-4a05-823f-698bfda3eab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a608f2c265434999aa734f1841b2a3, user_id=5206ef55b9694b4faa3ef71d001d94d4, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:25.149049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e62951-e7b5-4a05-823f-698bfda3eab0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:25.177577 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1656/3320] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:24 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:25.181453 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1665/3321] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:53:25 2021] PUT /identity/v3/projects/65a608f2c265434999aa734f1841b2a3/users/5206ef55b9694b4faa3ef71d001d94d4/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:25.196539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723e51-3642-4eac-bf9a-6cec3271702b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:25.196839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723e51-3642-4eac-bf9a-6cec3271702b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:25.197120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723e51-3642-4eac-bf9a-6cec3271702b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:25.246342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f7723e51-3642-4eac-bf9a-6cec3271702b None None] MFA Rules not processed for user `5206ef55b9694b4faa3ef71d001d94d4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:25.248436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f7723e51-3642-4eac-bf9a-6cec3271702b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:25.436107 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1657/3322] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:25 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:25.457789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62951-e7b5-4a05-823f-698bfda3eab0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:25.459442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f1e62951-e7b5-4a05-823f-698bfda3eab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:25.557736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e62951-e7b5-4a05-823f-698bfda3eab0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:25.561421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883f000-dffe-4e00-b6d4-c859cf5e647b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:25.562067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f000-dffe-4e00-b6d4-c859cf5e647b service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:25.562489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f000-dffe-4e00-b6d4-c859cf5e647b service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:25.562778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f000-dffe-4e00-b6d4-c859cf5e647b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:25.573512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883f000-dffe-4e00-b6d4-c859cf5e647b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:25.575357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883f000-dffe-4e00-b6d4-c859cf5e647b service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:25.598116 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1666/3323] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:25 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:53:26.800799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ef325-f86e-4cb8-9f33-3b90d86b5953 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:26.801639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ef325-f86e-4cb8-9f33-3b90d86b5953 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:26.801639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ef325-f86e-4cb8-9f33-3b90d86b5953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:26.866278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-677ef325-f86e-4cb8-9f33-3b90d86b5953 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:26.867673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-677ef325-f86e-4cb8-9f33-3b90d86b5953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:27.009568 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1658/3324] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:53:26 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:27.010373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883f000-dffe-4e00-b6d4-c859cf5e647b service glance] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:27.011894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4883f000-dffe-4e00-b6d4-c859cf5e647b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:27.147886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883f000-dffe-4e00-b6d4-c859cf5e647b service glance] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:27.158447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b62d2-c8e1-4e9a-a15b-1e20e62fce33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:27.159378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b62d2-c8e1-4e9a-a15b-1e20e62fce33 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:27.160631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b62d2-c8e1-4e9a-a15b-1e20e62fce33 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:27.161286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b62d2-c8e1-4e9a-a15b-1e20e62fce33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:27.174229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b62d2-c8e1-4e9a-a15b-1e20e62fce33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:27.178189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b62d2-c8e1-4e9a-a15b-1e20e62fce33 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:27.205056 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1667/3325] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:53:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:29.352599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f954f-3431-4545-b43c-5c4fa2c21d85 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:29.353212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f954f-3431-4545-b43c-5c4fa2c21d85 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:29.353212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f954f-3431-4545-b43c-5c4fa2c21d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:29.396334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-731f954f-3431-4545-b43c-5c4fa2c21d85 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:29.397583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-731f954f-3431-4545-b43c-5c4fa2c21d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:29.439130 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1659/3326] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:53:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:53:29.466872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b62d2-c8e1-4e9a-a15b-1e20e62fce33 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:29.489885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f954f-3431-4545-b43c-5c4fa2c21d85 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:29.492058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-731f954f-3431-4545-b43c-5c4fa2c21d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:29.494834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b62d2-c8e1-4e9a-a15b-1e20e62fce33 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:29.514096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f7569-a900-4be9-abcb-af4e375911a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:29.515645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f7569-a900-4be9-abcb-af4e375911a5 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:29.516785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f7569-a900-4be9-abcb-af4e375911a5 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:29.518381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f7569-a900-4be9-abcb-af4e375911a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:29.546522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f7569-a900-4be9-abcb-af4e375911a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:29.548489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f7569-a900-4be9-abcb-af4e375911a5 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:29.573404 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1668/3327] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:53:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:29.624010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f954f-3431-4545-b43c-5c4fa2c21d85 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:29.633585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a4c87-d8f5-44ae-8cfb-6730aa675cd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:29.634674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4c87-d8f5-44ae-8cfb-6730aa675cd7 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:29.636137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4c87-d8f5-44ae-8cfb-6730aa675cd7 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:29.636835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4c87-d8f5-44ae-8cfb-6730aa675cd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:29.641753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3e8a4c87-d8f5-44ae-8cfb-6730aa675cd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:29.669416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a4c87-d8f5-44ae-8cfb-6730aa675cd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:29.672195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a4c87-d8f5-44ae-8cfb-6730aa675cd7 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:29.688294 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1660/3328] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:29 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:31.324761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dcd39-a9b1-4073-b187-adcf76195649 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:31.325258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dcd39-a9b1-4073-b187-adcf76195649 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:31.325381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dcd39-a9b1-4073-b187-adcf76195649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:31.380547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b36dcd39-a9b1-4073-b187-adcf76195649 None None] MFA Rules not processed for user `745d99de8bd24185aacbbcf7b2c404c2`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:31.381949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b36dcd39-a9b1-4073-b187-adcf76195649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:31.517737 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1669/3329] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:31 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:32.101476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a5427-b980-4008-ac50-16edffd1ae44 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:32.102655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a5427-b980-4008-ac50-16edffd1ae44 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:32.102914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a5427-b980-4008-ac50-16edffd1ae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:32.126211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-054a5427-b980-4008-ac50-16edffd1ae44 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:32.127940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-054a5427-b980-4008-ac50-16edffd1ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:32.136054 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1661/3330] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:53:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:32.153325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dcd39-a9b1-4073-b187-adcf76195649 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:32.191458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a5427-b980-4008-ac50-16edffd1ae44 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:32.197648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-054a5427-b980-4008-ac50-16edffd1ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:32.200874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dcd39-a9b1-4073-b187-adcf76195649 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:32.216646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234119-2575-4158-8635-9412ef484795 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:32.217307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234119-2575-4158-8635-9412ef484795 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:32.218164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234119-2575-4158-8635-9412ef484795 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:32.218442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234119-2575-4158-8635-9412ef484795 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:32.246591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25234119-2575-4158-8635-9412ef484795 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:32.248478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25234119-2575-4158-8635-9412ef484795 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:32.267421 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1670/3331] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:53:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:53:32.342236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a5427-b980-4008-ac50-16edffd1ae44 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:32.358890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:32.360388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:32.360913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:32.362424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] PATH_INFO: `/v3/users/5af01920574741f381a5dfefd9282bfc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:32.367159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af01920574741f381a5dfefd9282bfc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:32.371083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:32.461292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af01920574741f381a5dfefd9282bfc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:32.474959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af01920574741f381a5dfefd9282bfc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:32.477421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af01920574741f381a5dfefd9282bfc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:32.491006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af01920574741f381a5dfefd9282bfc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:32.510742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af01920574741f381a5dfefd9282bfc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:32.522111 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1662/3332] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:53:32 2021] DELETE /identity/v3/users/5af01920574741f381a5dfefd9282bfc => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:32.867480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234119-2575-4158-8635-9412ef484795 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:32.883773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234119-2575-4158-8635-9412ef484795 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:32.982057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:32.984631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:32.985701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:32.986916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] PATH_INFO: `/v3/projects/68857c7effec496aa99ff78b76521109` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:32.989760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68857c7effec496aa99ff78b76521109)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:32.992492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:33.078552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68857c7effec496aa99ff78b76521109', 'request_id': 'req-60292026-e44a-4a24-ac8d-1d5bc4a00933'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:33.086773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68857c7effec496aa99ff78b76521109', 'request_id': 'req-60292026-e44a-4a24-ac8d-1d5bc4a00933'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:33.102374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68857c7effec496aa99ff78b76521109', 'request_id': 'req-60292026-e44a-4a24-ac8d-1d5bc4a00933'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:33.127641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] The token cache is being invalidate because project 68857c7effec496aa99ff78b76521109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:53:33.128253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:33.129167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60292026-e44a-4a24-ac8d-1d5bc4a00933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:33.134770 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1671/3333] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:32 2021] DELETE /identity/v3/projects/68857c7effec496aa99ff78b76521109 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:33.135849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:33.139013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:33.160238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c8c8-76d2-4211-aecc-4e022f7f6fba admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:33.339471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b8f9c-b52d-48f0-a831-cc5ceaff5ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:33.340762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b8f9c-b52d-48f0-a831-cc5ceaff5ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:33.341364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b8f9c-b52d-48f0-a831-cc5ceaff5ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:33.341800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b8f9c-b52d-48f0-a831-cc5ceaff5ae1 admin admin] PATH_INFO: `/v3/users/63bc0e675c9044e3bda2cd5dadd4fb15` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:33.348670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b8f9c-b52d-48f0-a831-cc5ceaff5ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bc0e675c9044e3bda2cd5dadd4fb15)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:33.350904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b8f9c-b52d-48f0-a831-cc5ceaff5ae1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:33.478265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e47b8f9c-b52d-48f0-a831-cc5ceaff5ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bc0e675c9044e3bda2cd5dadd4fb15'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:33.508750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e47b8f9c-b52d-48f0-a831-cc5ceaff5ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bc0e675c9044e3bda2cd5dadd4fb15'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:33.509452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e47b8f9c-b52d-48f0-a831-cc5ceaff5ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bc0e675c9044e3bda2cd5dadd4fb15'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:33.529780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989513ae-ea5b-4b96-82c7-f0895c4c889e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:33.531044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989513ae-ea5b-4b96-82c7-f0895c4c889e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:33.531373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e47b8f9c-b52d-48f0-a831-cc5ceaff5ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bc0e675c9044e3bda2cd5dadd4fb15'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:33.531930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989513ae-ea5b-4b96-82c7-f0895c4c889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:33.546718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e47b8f9c-b52d-48f0-a831-cc5ceaff5ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bc0e675c9044e3bda2cd5dadd4fb15'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:33.555977 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1663/3334] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:53:33 2021] DELETE /identity/v3/users/63bc0e675c9044e3bda2cd5dadd4fb15 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:33.566706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-989513ae-ea5b-4b96-82c7-f0895c4c889e None None] MFA Rules not processed for user `5206ef55b9694b4faa3ef71d001d94d4`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:33.568154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-989513ae-ea5b-4b96-82c7-f0895c4c889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:33.648747 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1672/3335] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:33 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:53:34.526648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf90c5-ea7d-4a7d-8b53-f504c5faa413 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:34.527640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf90c5-ea7d-4a7d-8b53-f504c5faa413 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:34.527926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf90c5-ea7d-4a7d-8b53-f504c5faa413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:34.572694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4edf90c5-ea7d-4a7d-8b53-f504c5faa413 None None] MFA Rules not processed for user `5206ef55b9694b4faa3ef71d001d94d4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:34.581489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4edf90c5-ea7d-4a7d-8b53-f504c5faa413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:34.606833 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1664/3336] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:34 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:34.729281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989513ae-ea5b-4b96-82c7-f0895c4c889e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:34.731270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-989513ae-ea5b-4b96-82c7-f0895c4c889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:34.834822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989513ae-ea5b-4b96-82c7-f0895c4c889e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:34.849280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:34.851651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:34.852191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:34.852700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] PATH_INFO: `/v3/projects/67445244452542a2862ec7dc1cf17784` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:34.858760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67445244452542a2862ec7dc1cf17784)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:34.860994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:34.980360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67445244452542a2862ec7dc1cf17784', 'request_id': 'req-54c2fa17-750c-472b-b5b5-51151ac0cd9d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:34.996157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67445244452542a2862ec7dc1cf17784', 'request_id': 'req-54c2fa17-750c-472b-b5b5-51151ac0cd9d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:35.006832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67445244452542a2862ec7dc1cf17784', 'request_id': 'req-54c2fa17-750c-472b-b5b5-51151ac0cd9d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:35.032535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] The token cache is being invalidate because project 67445244452542a2862ec7dc1cf17784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:53:35.032800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:35.034003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-54c2fa17-750c-472b-b5b5-51151ac0cd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:35.038106 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1673/3337] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:34 2021] DELETE /identity/v3/projects/67445244452542a2862ec7dc1cf17784 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:35.043660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316fd4e-839d-452e-a465-2e50165a4d7d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:35.043953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316fd4e-839d-452e-a465-2e50165a4d7d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:35.044308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316fd4e-839d-452e-a465-2e50165a4d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:35.074458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0316fd4e-839d-452e-a465-2e50165a4d7d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:35.076140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0316fd4e-839d-452e-a465-2e50165a4d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:35.199762 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1665/3338] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:53:35.221254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac774-27e8-45cd-ac6d-cca0e982ea5f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:35.222748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac774-27e8-45cd-ac6d-cca0e982ea5f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:35.223106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac774-27e8-45cd-ac6d-cca0e982ea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:35.247835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-97eac774-27e8-45cd-ac6d-cca0e982ea5f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:35.249220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-97eac774-27e8-45cd-ac6d-cca0e982ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:35.259614 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1674/3339] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:35.263532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316fd4e-839d-452e-a465-2e50165a4d7d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:35.278733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316fd4e-839d-452e-a465-2e50165a4d7d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:35.291089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f98aa5-dae4-4d6e-8f89-090d4d60d01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:35.291846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f98aa5-dae4-4d6e-8f89-090d4d60d01d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:35.292456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f98aa5-dae4-4d6e-8f89-090d4d60d01d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:35.292456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f98aa5-dae4-4d6e-8f89-090d4d60d01d admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:35.294074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f98aa5-dae4-4d6e-8f89-090d4d60d01d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:53:35.295424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f98aa5-dae4-4d6e-8f89-090d4d60d01d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:35.300171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f98aa5-dae4-4d6e-8f89-090d4d60d01d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:35.318215 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1666/3340] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:53:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:53:35.323107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eac774-27e8-45cd-ac6d-cca0e982ea5f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:35.336069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eac774-27e8-45cd-ac6d-cca0e982ea5f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:35.341367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b282ec1-4a15-440c-8776-4760d51350aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:35.342278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b282ec1-4a15-440c-8776-4760d51350aa admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:35.342806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b282ec1-4a15-440c-8776-4760d51350aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:35.342806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b282ec1-4a15-440c-8776-4760d51350aa admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:35.343693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b282ec1-4a15-440c-8776-4760d51350aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:35.345743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b282ec1-4a15-440c-8776-4760d51350aa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:35.403298 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1675/3341] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:53:35 2021] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:53:35.407824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f98aa5-dae4-4d6e-8f89-090d4d60d01d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:35.436852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f98aa5-dae4-4d6e-8f89-090d4d60d01d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:35.545704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0f2e3-fa59-4104-8299-78f276baeec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:35.547420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0f2e3-fa59-4104-8299-78f276baeec3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:35.547890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0f2e3-fa59-4104-8299-78f276baeec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:35.548777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0f2e3-fa59-4104-8299-78f276baeec3 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:35.550171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0f2e3-fa59-4104-8299-78f276baeec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:35.553569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0f2e3-fa59-4104-8299-78f276baeec3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:35.591503 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1667/3342] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:53:35 2021] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:35.596091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b282ec1-4a15-440c-8776-4760d51350aa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:35.616766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b282ec1-4a15-440c-8776-4760d51350aa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:35.635515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8182108-6fef-4c55-869f-280c4226475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:35.636257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8182108-6fef-4c55-869f-280c4226475b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:35.636662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8182108-6fef-4c55-869f-280c4226475b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:35.637048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8182108-6fef-4c55-869f-280c4226475b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:35.637991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8182108-6fef-4c55-869f-280c4226475b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:35.657606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8182108-6fef-4c55-869f-280c4226475b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:35.684208 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1676/3343] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:35 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:53:35.689077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0f2e3-fa59-4104-8299-78f276baeec3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:35.701598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0f2e3-fa59-4104-8299-78f276baeec3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:35.725461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062912b-a58b-4faf-b79d-e8d4a8200451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:35.726397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062912b-a58b-4faf-b79d-e8d4a8200451 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:35.726868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062912b-a58b-4faf-b79d-e8d4a8200451 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:35.727337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062912b-a58b-4faf-b79d-e8d4a8200451 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:35.728248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062912b-a58b-4faf-b79d-e8d4a8200451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:35.731107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062912b-a58b-4faf-b79d-e8d4a8200451 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:35.767967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8182108-6fef-4c55-869f-280c4226475b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:35.773567 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1668/3344] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:35 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:35.782950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8182108-6fef-4c55-869f-280c4226475b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:35.802533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dee97e-3d92-45fe-8815-b4e45dff6611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:35.805446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee97e-3d92-45fe-8815-b4e45dff6611 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:35.807341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee97e-3d92-45fe-8815-b4e45dff6611 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:35.808654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dee97e-3d92-45fe-8815-b4e45dff6611 admin admin] PATH_INFO: `/v3/projects/dccff361431c4b6ba5e99c6dfdb83842/users/a8af8ab17ec442feb6207f558d9d2ecc/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:35.853781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dee97e-3d92-45fe-8815-b4e45dff6611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccff361431c4b6ba5e99c6dfdb83842, user_id=a8af8ab17ec442feb6207f558d9d2ecc, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:35.862468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dee97e-3d92-45fe-8815-b4e45dff6611 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:35.894838 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1677/3345] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:53:35 2021] PUT /identity/v3/projects/dccff361431c4b6ba5e99c6dfdb83842/users/a8af8ab17ec442feb6207f558d9d2ecc/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:53:35.908023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da73c2-dae6-4435-bbd4-d7481ce46d81 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:35.908023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da73c2-dae6-4435-bbd4-d7481ce46d81 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:35.908023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da73c2-dae6-4435-bbd4-d7481ce46d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:35.959523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-80da73c2-dae6-4435-bbd4-d7481ce46d81 None None] MFA Rules not processed for user `a8af8ab17ec442feb6207f558d9d2ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:35.960856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-80da73c2-dae6-4435-bbd4-d7481ce46d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:36.083155 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1669/3346] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:35 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:36.084348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dee97e-3d92-45fe-8815-b4e45dff6611 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:36.214132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dee97e-3d92-45fe-8815-b4e45dff6611 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:36.226250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e37cb-5f30-4a20-834e-47ed17d9aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:36.226927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e37cb-5f30-4a20-834e-47ed17d9aa0e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:36.227381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e37cb-5f30-4a20-834e-47ed17d9aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:36.227663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e37cb-5f30-4a20-834e-47ed17d9aa0e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:36.228388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e37cb-5f30-4a20-834e-47ed17d9aa0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:36.230457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e37cb-5f30-4a20-834e-47ed17d9aa0e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:36.289567 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1678/3347] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:53:36 2021] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:36.293828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da73c2-dae6-4435-bbd4-d7481ce46d81 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:36.308177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da73c2-dae6-4435-bbd4-d7481ce46d81 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:36.498534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bce572-0430-4343-af5e-2a4ff031a0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:36.499480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bce572-0430-4343-af5e-2a4ff031a0ac admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:36.499773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bce572-0430-4343-af5e-2a4ff031a0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:36.500187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bce572-0430-4343-af5e-2a4ff031a0ac admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:36.500902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bce572-0430-4343-af5e-2a4ff031a0ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:36.504759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bce572-0430-4343-af5e-2a4ff031a0ac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:36.573901 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1670/3348] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:53:36 2021] POST /identity/v3/users => generated 296 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:36.579324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e37cb-5f30-4a20-834e-47ed17d9aa0e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:36.596868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e37cb-5f30-4a20-834e-47ed17d9aa0e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:36.609254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b17130-bb7c-4a6e-a424-a83f1af83944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:36.610126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b17130-bb7c-4a6e-a424-a83f1af83944 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:36.610576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b17130-bb7c-4a6e-a424-a83f1af83944 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:36.611009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b17130-bb7c-4a6e-a424-a83f1af83944 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:36.612034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b17130-bb7c-4a6e-a424-a83f1af83944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:36.613813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b17130-bb7c-4a6e-a424-a83f1af83944 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:36.639916 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1679/3349] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:36 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:36.644105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bce572-0430-4343-af5e-2a4ff031a0ac admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:36.658693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bce572-0430-4343-af5e-2a4ff031a0ac admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:36.672521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed330e8a-29c7-45c7-a981-78ca42484832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:36.677000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed330e8a-29c7-45c7-a981-78ca42484832 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:36.677679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed330e8a-29c7-45c7-a981-78ca42484832 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:36.678233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed330e8a-29c7-45c7-a981-78ca42484832 admin admin] PATH_INFO: `/v3/projects/f937cd782d5a46b295dee143abe9fce0/users/e605f50a9f374c88b6e9480c9ae1bea1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:36.726829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed330e8a-29c7-45c7-a981-78ca42484832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f937cd782d5a46b295dee143abe9fce0, user_id=e605f50a9f374c88b6e9480c9ae1bea1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:36.745772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed330e8a-29c7-45c7-a981-78ca42484832 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:36.781851 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1671/3350] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:53:36 2021] PUT /identity/v3/projects/f937cd782d5a46b295dee143abe9fce0/users/e605f50a9f374c88b6e9480c9ae1bea1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:36.785590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b17130-bb7c-4a6e-a424-a83f1af83944 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:36.795862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b17130-bb7c-4a6e-a424-a83f1af83944 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:36.859411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0b762-6050-48d9-9356-5a7fbaa66813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:36.860397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0b762-6050-48d9-9356-5a7fbaa66813 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:36.860835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0b762-6050-48d9-9356-5a7fbaa66813 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:36.861260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0b762-6050-48d9-9356-5a7fbaa66813 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:36.863070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0b762-6050-48d9-9356-5a7fbaa66813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:36.864885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0b762-6050-48d9-9356-5a7fbaa66813 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:36.876409 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1680/3351] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:36 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:36.881600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed330e8a-29c7-45c7-a981-78ca42484832 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:36.894110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed330e8a-29c7-45c7-a981-78ca42484832 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:36.901496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf60658-ac48-498d-95e8-e867b046e686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:36.902892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf60658-ac48-498d-95e8-e867b046e686 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:36.903450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf60658-ac48-498d-95e8-e867b046e686 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:36.903907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf60658-ac48-498d-95e8-e867b046e686 admin admin] PATH_INFO: `/v3/projects/f937cd782d5a46b295dee143abe9fce0/users/e605f50a9f374c88b6e9480c9ae1bea1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:36.906514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf60658-ac48-498d-95e8-e867b046e686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f937cd782d5a46b295dee143abe9fce0, user_id=e605f50a9f374c88b6e9480c9ae1bea1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:36.909597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf60658-ac48-498d-95e8-e867b046e686 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:36.927900 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1672/3352] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:53:36 2021] PUT /identity/v3/projects/f937cd782d5a46b295dee143abe9fce0/users/e605f50a9f374c88b6e9480c9ae1bea1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:36.941481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91e69b-ea71-479a-9592-5f1d46ba7679 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:36.941765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91e69b-ea71-479a-9592-5f1d46ba7679 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:36.942128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91e69b-ea71-479a-9592-5f1d46ba7679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:36.988040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ad91e69b-ea71-479a-9592-5f1d46ba7679 None None] MFA Rules not processed for user `e605f50a9f374c88b6e9480c9ae1bea1`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:36.989736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ad91e69b-ea71-479a-9592-5f1d46ba7679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:37.068380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf60658-ac48-498d-95e8-e867b046e686 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:37.070108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7cf60658-ac48-498d-95e8-e867b046e686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:37.079292 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1681/3353] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:36 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:37.159500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf60658-ac48-498d-95e8-e867b046e686 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:37.169886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b029b-0b85-42e3-9647-b6ea38856fe9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:37.170106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b029b-0b85-42e3-9647-b6ea38856fe9 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:37.170286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b029b-0b85-42e3-9647-b6ea38856fe9 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:37.171230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b029b-0b85-42e3-9647-b6ea38856fe9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:37.195488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6e3b029b-0b85-42e3-9647-b6ea38856fe9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:37.209618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b029b-0b85-42e3-9647-b6ea38856fe9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:37.211294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b029b-0b85-42e3-9647-b6ea38856fe9 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:37.241253 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1673/3354] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:53:37.417130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91e69b-ea71-479a-9592-5f1d46ba7679 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:37.418575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ad91e69b-ea71-479a-9592-5f1d46ba7679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:37.527038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91e69b-ea71-479a-9592-5f1d46ba7679 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:37.533960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e861fff-aa5a-42b2-99da-b5518e62f27f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:37.534858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861fff-aa5a-42b2-99da-b5518e62f27f service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:37.535345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861fff-aa5a-42b2-99da-b5518e62f27f service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:37.535780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861fff-aa5a-42b2-99da-b5518e62f27f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:37.550020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861fff-aa5a-42b2-99da-b5518e62f27f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:37.552207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861fff-aa5a-42b2-99da-b5518e62f27f service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:37.566172 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1682/3355] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:37 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:37.706540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa04d7-481c-43ef-b781-a2c1f639e387 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:37.707043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa04d7-481c-43ef-b781-a2c1f639e387 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:37.707150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa04d7-481c-43ef-b781-a2c1f639e387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:37.749119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f9aa04d7-481c-43ef-b781-a2c1f639e387 None None] MFA Rules not processed for user `6f940822793e422c8436036be6a116a0`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:37.750678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f9aa04d7-481c-43ef-b781-a2c1f639e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:37.835307 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1674/3356] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:37 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:37.974654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048dc10-bbb8-4122-8617-4c637a985410 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:37.975226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048dc10-bbb8-4122-8617-4c637a985410 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:37.975226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048dc10-bbb8-4122-8617-4c637a985410 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:37.977485 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1683/3357] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:53:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:53:37.990016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa04d7-481c-43ef-b781-a2c1f639e387 None None] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:53:37.991811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f9aa04d7-481c-43ef-b781-a2c1f639e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:38.077028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048dc10-bbb8-4122-8617-4c637a985410 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:38.084157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0048dc10-bbb8-4122-8617-4c637a985410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:38.127081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa04d7-481c-43ef-b781-a2c1f639e387 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:38.146655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa04d7-481c-43ef-b781-a2c1f639e387 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:38.160552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505b528-2c7d-4d97-ae0b-3224eedc6c83 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e605f50a9f374c88b6e9480c9ae1bea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f937cd782d5a46b295dee143abe9fce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:38.163165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505b528-2c7d-4d97-ae0b-3224eedc6c83 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:38.163914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505b528-2c7d-4d97-ae0b-3224eedc6c83 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:38.165148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505b528-2c7d-4d97-ae0b-3224eedc6c83 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] PATH_INFO: `/v3/projects/dccff361431c4b6ba5e99c6dfdb83842` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:38.173083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505b528-2c7d-4d97-ae0b-3224eedc6c83 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] RBAC: Authorizing `identity:get_project(project_id=dccff361431c4b6ba5e99c6dfdb83842)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:38.188514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505b528-2c7d-4d97-ae0b-3224eedc6c83 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:38.195651 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1675/3358] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:53:37 2021] GET /identity/v3/projects/dccff361431c4b6ba5e99c6dfdb83842 => generated 377 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:53:38.303200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048dc10-bbb8-4122-8617-4c637a985410 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:38.311169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:38.312078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:38.312362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:38.312633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] PATH_INFO: `/v3/users/4143c311f90d4b6bbae7b8eddcbef26f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:38.316360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4143c311f90d4b6bbae7b8eddcbef26f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:38.318793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:38.415668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4143c311f90d4b6bbae7b8eddcbef26f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:38.416419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4143c311f90d4b6bbae7b8eddcbef26f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:38.432580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4143c311f90d4b6bbae7b8eddcbef26f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:38.433444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4143c311f90d4b6bbae7b8eddcbef26f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:38.451675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4143c311f90d4b6bbae7b8eddcbef26f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:38.479752 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1684/3359] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:53:38 2021] DELETE /identity/v3/users/4143c311f90d4b6bbae7b8eddcbef26f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:53:38.562979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505b528-2c7d-4d97-ae0b-3224eedc6c83 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:38.564963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8505b528-2c7d-4d97-ae0b-3224eedc6c83 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:38.579544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505b528-2c7d-4d97-ae0b-3224eedc6c83 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:38.654116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:38.655935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:38.656424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:38.656936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] PATH_INFO: `/v3/users/dd54936ebf874a45800b444b942c6e76` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:38.659503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd54936ebf874a45800b444b942c6e76)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:38.662096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:38.718982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd54936ebf874a45800b444b942c6e76'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:38.728470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd54936ebf874a45800b444b942c6e76'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:38.729463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd54936ebf874a45800b444b942c6e76'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:38.738185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd54936ebf874a45800b444b942c6e76'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:38.753460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd54936ebf874a45800b444b942c6e76'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:38.763323 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1676/3360] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:53:38 2021] DELETE /identity/v3/users/dd54936ebf874a45800b444b942c6e76 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:38.769059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:38.771047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:38.861012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e98116-797d-4cdc-8827-8e8f9a013974 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:38.957928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3250d-187a-4d5d-bf86-ef0b627e9f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:38.958595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3250d-187a-4d5d-bf86-ef0b627e9f05 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:38.959078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3250d-187a-4d5d-bf86-ef0b627e9f05 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:38.959520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3250d-187a-4d5d-bf86-ef0b627e9f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:38.961993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-24c3250d-187a-4d5d-bf86-ef0b627e9f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:39.065949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3250d-187a-4d5d-bf86-ef0b627e9f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:39.068073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3250d-187a-4d5d-bf86-ef0b627e9f05 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:39.093702 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1685/3361] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:38 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:39.186592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:39.189076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:39.202880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3250d-187a-4d5d-bf86-ef0b627e9f05 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:39.204980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-24c3250d-187a-4d5d-bf86-ef0b627e9f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:39.346878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3250d-187a-4d5d-bf86-ef0b627e9f05 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:39.353884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:39.355346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:39.355638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:39.356350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] PATH_INFO: `/v3/projects/483860ef169447208569ca7510affe41` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:39.359210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=483860ef169447208569ca7510affe41)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:39.361193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6e995-4d9e-47d4-a118-719a96b6dd1b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:39.362054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:39.374502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:39.375398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:39.375863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:39.376312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] PATH_INFO: `/v3/projects/3452ada55fe043918a4bf028d75b070d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:39.378803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3452ada55fe043918a4bf028d75b070d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:39.381591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:39.482787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483860ef169447208569ca7510affe41', 'request_id': 'req-87a370ec-68bb-41f3-9517-8db2cfbab176'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:39.501849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3452ada55fe043918a4bf028d75b070d', 'request_id': 'req-a3b875e1-08df-484b-843e-3b9ec08e191c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:39.502621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483860ef169447208569ca7510affe41', 'request_id': 'req-87a370ec-68bb-41f3-9517-8db2cfbab176'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:39.514522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3452ada55fe043918a4bf028d75b070d', 'request_id': 'req-a3b875e1-08df-484b-843e-3b9ec08e191c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:39.519065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483860ef169447208569ca7510affe41', 'request_id': 'req-87a370ec-68bb-41f3-9517-8db2cfbab176'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:39.530554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3452ada55fe043918a4bf028d75b070d', 'request_id': 'req-a3b875e1-08df-484b-843e-3b9ec08e191c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:39.542834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] The token cache is being invalidate because project 3452ada55fe043918a4bf028d75b070d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:53:39.544657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] The token cache is being invalidate because project 483860ef169447208569ca7510affe41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:53:39.544985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:39.545954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:39.546884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-87a370ec-68bb-41f3-9517-8db2cfbab176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:39.547939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3b875e1-08df-484b-843e-3b9ec08e191c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:39.550017 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1686/3362] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:39 2021] DELETE /identity/v3/projects/483860ef169447208569ca7510affe41 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:39.553358 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1677/3363] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:39 2021] DELETE /identity/v3/projects/3452ada55fe043918a4bf028d75b070d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:39.559512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c0b1d-426f-4902-8b70-c7b6ed318387 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:39.559840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c0b1d-426f-4902-8b70-c7b6ed318387 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:39.560075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c0b1d-426f-4902-8b70-c7b6ed318387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:39.568709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe994fc-a4e6-4262-b134-d282ae462c58 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:39.569308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe994fc-a4e6-4262-b134-d282ae462c58 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:39.569893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe994fc-a4e6-4262-b134-d282ae462c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:39.611561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5c0c0b1d-426f-4902-8b70-c7b6ed318387 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:39.612807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5c0c0b1d-426f-4902-8b70-c7b6ed318387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:39.622907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3fe994fc-a4e6-4262-b134-d282ae462c58 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:39.625873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3fe994fc-a4e6-4262-b134-d282ae462c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:39.739320 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1687/3364] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:39.744107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f3170-b4ca-4905-827e-8d57a3d67f8b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:39.744622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f3170-b4ca-4905-827e-8d57a3d67f8b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:39.750019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f3170-b4ca-4905-827e-8d57a3d67f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:39.803019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-528f3170-b4ca-4905-827e-8d57a3d67f8b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:39.804225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-528f3170-b4ca-4905-827e-8d57a3d67f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:39.833375 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1688/3365] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:39.836042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f3170-b4ca-4905-827e-8d57a3d67f8b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:39.837584 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1678/3366] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:39.846791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e262-b7c5-4577-a3fe-ab329f43b8d7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:39.847453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e262-b7c5-4577-a3fe-ab329f43b8d7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:39.847971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e262-b7c5-4577-a3fe-ab329f43b8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:39.851567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f3170-b4ca-4905-827e-8d57a3d67f8b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:39.874426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:39.878294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7db2e262-b7c5-4577-a3fe-ab329f43b8d7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:39.879189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:39.879736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7db2e262-b7c5-4577-a3fe-ab329f43b8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:39.879998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:39.880283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:39.881033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:53:39.881458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:39.883017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:39.890760 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1679/3367] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:53:39.894865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcef693-6a15-415a-a146-68148afde778 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:39.896935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcef693-6a15-415a-a146-68148afde778 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:39.897553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcef693-6a15-415a-a146-68148afde778 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:39.903190 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1680/3368] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:53:39 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:53:39.905776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcef693-6a15-415a-a146-68148afde778 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:39.952241 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1689/3369] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:53:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:53:39.963455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 20:53:39.975698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcef693-6a15-415a-a146-68148afde778 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:39.975901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:40.002853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0780a8-535f-4c39-b8de-5798cbb8248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.005527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0780a8-535f-4c39-b8de-5798cbb8248e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.009600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0780a8-535f-4c39-b8de-5798cbb8248e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.011460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0780a8-535f-4c39-b8de-5798cbb8248e admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.016678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0780a8-535f-4c39-b8de-5798cbb8248e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:53:40.017007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0780a8-535f-4c39-b8de-5798cbb8248e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.018660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0780a8-535f-4c39-b8de-5798cbb8248e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.074675 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1681/3370] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:53:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:53:40.075622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0780a8-535f-4c39-b8de-5798cbb8248e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.092881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0780a8-535f-4c39-b8de-5798cbb8248e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:40.093133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.096828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:40.111934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336e5fa-7493-4dab-b66a-2329399d2298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.112830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e5fa-7493-4dab-b66a-2329399d2298 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.113977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e5fa-7493-4dab-b66a-2329399d2298 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.114436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e5fa-7493-4dab-b66a-2329399d2298 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.115944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336e5fa-7493-4dab-b66a-2329399d2298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.123012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336e5fa-7493-4dab-b66a-2329399d2298 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.197362 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1682/3371] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:53:40 2021] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:40.198905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336e5fa-7493-4dab-b66a-2329399d2298 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.260961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec5bbf-8c70-4b92-a557-361d862697bf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:40.281953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336e5fa-7493-4dab-b66a-2329399d2298 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:40.287820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d40b43-aec2-4266-8b78-e66a955e0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.289007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d40b43-aec2-4266-8b78-e66a955e0b7a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.289409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d40b43-aec2-4266-8b78-e66a955e0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.289759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d40b43-aec2-4266-8b78-e66a955e0b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.290720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d40b43-aec2-4266-8b78-e66a955e0b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.292909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d40b43-aec2-4266-8b78-e66a955e0b7a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.348835 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1683/3372] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:53:40 2021] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:40.349507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72b40c-3fc2-4c23-9d42-77b3ef665ff8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e605f50a9f374c88b6e9480c9ae1bea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f937cd782d5a46b295dee143abe9fce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.350358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d40b43-aec2-4266-8b78-e66a955e0b7a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.350599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72b40c-3fc2-4c23-9d42-77b3ef665ff8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.350897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72b40c-3fc2-4c23-9d42-77b3ef665ff8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.351444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72b40c-3fc2-4c23-9d42-77b3ef665ff8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] PATH_INFO: `/v3/projects/dccff361431c4b6ba5e99c6dfdb83842` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.352890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72b40c-3fc2-4c23-9d42-77b3ef665ff8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] RBAC: Authorizing `identity:get_project(project_id=dccff361431c4b6ba5e99c6dfdb83842)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.356295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72b40c-3fc2-4c23-9d42-77b3ef665ff8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.359926 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1690/3373] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 20:53:39 2021] GET /identity/v3/projects/dccff361431c4b6ba5e99c6dfdb83842 => generated 377 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:53:40.362925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72b40c-3fc2-4c23-9d42-77b3ef665ff8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.380483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72b40c-3fc2-4c23-9d42-77b3ef665ff8 tempest-FlavorsAccessTestJSON-1473441362 tempest-FlavorsAccessTestJSON-1473441362-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:40.455919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ac10d-7dda-4692-a366-6b44702ab5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.456753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac10d-7dda-4692-a366-6b44702ab5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.457108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac10d-7dda-4692-a366-6b44702ab5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.457476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac10d-7dda-4692-a366-6b44702ab5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.458401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ac10d-7dda-4692-a366-6b44702ab5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.460664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ac10d-7dda-4692-a366-6b44702ab5d2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.469122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d40b43-aec2-4266-8b78-e66a955e0b7a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:40.475313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e1b4-a931-45fb-a541-11dc9312b930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.476507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e1b4-a931-45fb-a541-11dc9312b930 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.477367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e1b4-a931-45fb-a541-11dc9312b930 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.477948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e1b4-a931-45fb-a541-11dc9312b930 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.478873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046e1b4-a931-45fb-a541-11dc9312b930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.481440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046e1b4-a931-45fb-a541-11dc9312b930 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.485604 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1691/3374] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:53:40 2021] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:40.489572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ac10d-7dda-4692-a366-6b44702ab5d2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.505982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ac10d-7dda-4692-a366-6b44702ab5d2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:40.511980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa570bf0-e9d5-441d-826b-f95709a45cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.512756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570bf0-e9d5-441d-826b-f95709a45cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.512895 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1684/3375] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:53:40 2021] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:40.513100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570bf0-e9d5-441d-826b-f95709a45cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.513366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570bf0-e9d5-441d-826b-f95709a45cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.514200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa570bf0-e9d5-441d-826b-f95709a45cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.514691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e1b4-a931-45fb-a541-11dc9312b930 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.516169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa570bf0-e9d5-441d-826b-f95709a45cb3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.530582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e1b4-a931-45fb-a541-11dc9312b930 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:40.534718 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1692/3376] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:40.538825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa570bf0-e9d5-441d-826b-f95709a45cb3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.547446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff24a2c-25c7-4b77-8625-acd06e263113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.547903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24a2c-25c7-4b77-8625-acd06e263113 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.548186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24a2c-25c7-4b77-8625-acd06e263113 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.548460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24a2c-25c7-4b77-8625-acd06e263113 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.549277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff24a2c-25c7-4b77-8625-acd06e263113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.551821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff24a2c-25c7-4b77-8625-acd06e263113 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.553453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa570bf0-e9d5-441d-826b-f95709a45cb3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:40.561644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f57b5-b5ca-4018-b794-65a853bad3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.564851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f57b5-b5ca-4018-b794-65a853bad3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.565362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f57b5-b5ca-4018-b794-65a853bad3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.566015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f57b5-b5ca-4018-b794-65a853bad3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.567839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f57b5-b5ca-4018-b794-65a853bad3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.573348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f57b5-b5ca-4018-b794-65a853bad3c7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.579115 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1685/3377] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:40.583311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff24a2c-25c7-4b77-8625-acd06e263113 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.600327 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1693/3378] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:53:40.604402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff24a2c-25c7-4b77-8625-acd06e263113 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:40.606055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f57b5-b5ca-4018-b794-65a853bad3c7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.619331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84613f30-67d4-4ca5-ad35-25821b6038e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.620592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84613f30-67d4-4ca5-ad35-25821b6038e6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.620877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84613f30-67d4-4ca5-ad35-25821b6038e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.621153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84613f30-67d4-4ca5-ad35-25821b6038e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.622242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84613f30-67d4-4ca5-ad35-25821b6038e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.625632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f57b5-b5ca-4018-b794-65a853bad3c7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:40.627301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84613f30-67d4-4ca5-ad35-25821b6038e6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.637601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f29583-c898-490a-93ef-c2daad3eb6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.638495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29583-c898-490a-93ef-c2daad3eb6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.638774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29583-c898-490a-93ef-c2daad3eb6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.639045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29583-c898-490a-93ef-c2daad3eb6c1 admin admin] PATH_INFO: `/v3/projects/659003b54d7c4726bc5197bfd351d3c1/users/7c837598a18f439d93cfce37b86aa235/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.653661 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1686/3379] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:40 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:40.654412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84613f30-67d4-4ca5-ad35-25821b6038e6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.674316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f29583-c898-490a-93ef-c2daad3eb6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659003b54d7c4726bc5197bfd351d3c1, user_id=7c837598a18f439d93cfce37b86aa235, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.678582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84613f30-67d4-4ca5-ad35-25821b6038e6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:40.679783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f29583-c898-490a-93ef-c2daad3eb6c1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.689104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ab6e4-15e3-47e4-b778-6db78bb8e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:40.690224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab6e4-15e3-47e4-b778-6db78bb8e9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.690506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab6e4-15e3-47e4-b778-6db78bb8e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.690832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab6e4-15e3-47e4-b778-6db78bb8e9fd admin admin] PATH_INFO: `/v3/projects/949d330b01384fb091f743a127f26402/users/3cc24888898d4d20bcfdc3d7c8cde8bf/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.707386 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1694/3380] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:53:40 2021] PUT /identity/v3/projects/659003b54d7c4726bc5197bfd351d3c1/users/7c837598a18f439d93cfce37b86aa235/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:40.712384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144e94b-9c05-4155-85f5-81df91bfcecd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.712666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144e94b-9c05-4155-85f5-81df91bfcecd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.712946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144e94b-9c05-4155-85f5-81df91bfcecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.728194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ab6e4-15e3-47e4-b778-6db78bb8e9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=949d330b01384fb091f743a127f26402, user_id=3cc24888898d4d20bcfdc3d7c8cde8bf, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:40.735496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ab6e4-15e3-47e4-b778-6db78bb8e9fd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:40.745707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3144e94b-9c05-4155-85f5-81df91bfcecd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:40.747643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3144e94b-9c05-4155-85f5-81df91bfcecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:40.757775 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1687/3381] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:53:40 2021] PUT /identity/v3/projects/949d330b01384fb091f743a127f26402/users/3cc24888898d4d20bcfdc3d7c8cde8bf/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:40.766288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725998e-2290-42e6-962d-fc01b1791f62 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:40.766566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725998e-2290-42e6-962d-fc01b1791f62 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:40.766845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725998e-2290-42e6-962d-fc01b1791f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:40.799763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0725998e-2290-42e6-962d-fc01b1791f62 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:40.802009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0725998e-2290-42e6-962d-fc01b1791f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:40.856783 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1695/3382] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:53:40.870637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144e94b-9c05-4155-85f5-81df91bfcecd None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.872933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3144e94b-9c05-4155-85f5-81df91bfcecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:40.881893 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1688/3383] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:40.908376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725998e-2290-42e6-962d-fc01b1791f62 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:40.910053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0725998e-2290-42e6-962d-fc01b1791f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:41.030386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725998e-2290-42e6-962d-fc01b1791f62 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:41.034124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afe692-91f3-43e2-9062-f4572775aad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:41.034920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afe692-91f3-43e2-9062-f4572775aad9 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:41.035420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afe692-91f3-43e2-9062-f4572775aad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:41.035698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afe692-91f3-43e2-9062-f4572775aad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:41.040334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144e94b-9c05-4155-85f5-81df91bfcecd None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:41.048706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afe692-91f3-43e2-9062-f4572775aad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:41.050167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afe692-91f3-43e2-9062-f4572775aad9 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:41.052714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a45ac-cef2-449b-ad72-a7ada5ba6774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:41.053547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a45ac-cef2-449b-ad72-a7ada5ba6774 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:41.053831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a45ac-cef2-449b-ad72-a7ada5ba6774 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:41.054102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a45ac-cef2-449b-ad72-a7ada5ba6774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:41.076245 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1689/3384] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:41.079387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a45ac-cef2-449b-ad72-a7ada5ba6774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:41.084483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a45ac-cef2-449b-ad72-a7ada5ba6774 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:41.111036 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1696/3385] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:53:42.212207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954e2f-3174-42a2-9d7f-1aeae1355ed1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:42.212683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954e2f-3174-42a2-9d7f-1aeae1355ed1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:42.212958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954e2f-3174-42a2-9d7f-1aeae1355ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:42.254800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9e954e2f-3174-42a2-9d7f-1aeae1355ed1 None None] MFA Rules not processed for user `434669fb63034fa0b91c67050a6b7d28`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:42.256257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e954e2f-3174-42a2-9d7f-1aeae1355ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:42.395713 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1690/3386] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:42 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:43.831515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a45ac-cef2-449b-ad72-a7ada5ba6774 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:43.833566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c32a45ac-cef2-449b-ad72-a7ada5ba6774 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:43.867149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a45ac-cef2-449b-ad72-a7ada5ba6774 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:43.877635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:43.883766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:43.885236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:43.886324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] PATH_INFO: `/v3/users/a8af8ab17ec442feb6207f558d9d2ecc` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:43.889860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8af8ab17ec442feb6207f558d9d2ecc)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:43.892007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:43.974754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8af8ab17ec442feb6207f558d9d2ecc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:43.975653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8af8ab17ec442feb6207f558d9d2ecc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:43.990823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8af8ab17ec442feb6207f558d9d2ecc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:43.991830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8af8ab17ec442feb6207f558d9d2ecc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:44.009384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8af8ab17ec442feb6207f558d9d2ecc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:44.054056 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1697/3387] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:53:43 2021] DELETE /identity/v3/users/a8af8ab17ec442feb6207f558d9d2ecc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:44.059377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81cd36-77b1-4afd-b125-684bddc5cdcc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:44.061099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81cd36-77b1-4afd-b125-684bddc5cdcc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:44.061461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81cd36-77b1-4afd-b125-684bddc5cdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:44.089601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8a81cd36-77b1-4afd-b125-684bddc5cdcc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:44.093571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8a81cd36-77b1-4afd-b125-684bddc5cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:44.283689 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1691/3388] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:44.346761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:44.357953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:44.518756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87db02-4280-47f0-b050-395b2284188b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:44.537279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12e476-2924-40c3-999f-3b08ad9d5ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:44.537961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12e476-2924-40c3-999f-3b08ad9d5ada service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:44.538619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12e476-2924-40c3-999f-3b08ad9d5ada service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:44.538900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12e476-2924-40c3-999f-3b08ad9d5ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:44.579749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12e476-2924-40c3-999f-3b08ad9d5ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:44.582068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12e476-2924-40c3-999f-3b08ad9d5ada service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:44.609375 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1698/3389] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:46.741296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81cd36-77b1-4afd-b125-684bddc5cdcc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:46.749429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8a81cd36-77b1-4afd-b125-684bddc5cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:46.777714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81cd36-77b1-4afd-b125-684bddc5cdcc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:46.792975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:46.795708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:46.796250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:46.797516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] PATH_INFO: `/v3/projects/dccff361431c4b6ba5e99c6dfdb83842` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:46.799771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dccff361431c4b6ba5e99c6dfdb83842)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:46.802893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:46.948226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dccff361431c4b6ba5e99c6dfdb83842', 'request_id': 'req-fba6ea58-7ea4-4576-881d-8599ca426829'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:46.983806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dccff361431c4b6ba5e99c6dfdb83842', 'request_id': 'req-fba6ea58-7ea4-4576-881d-8599ca426829'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:46.994238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dccff361431c4b6ba5e99c6dfdb83842', 'request_id': 'req-fba6ea58-7ea4-4576-881d-8599ca426829'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:47.006873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] The token cache is being invalidate because project dccff361431c4b6ba5e99c6dfdb83842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:53:47.007466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:47.008150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:47.012882 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1692/3390] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:46 2021] DELETE /identity/v3/projects/dccff361431c4b6ba5e99c6dfdb83842 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:47.014488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12e476-2924-40c3-999f-3b08ad9d5ada service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:47.035789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12e476-2924-40c3-999f-3b08ad9d5ada service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:47.189647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09335d68-777e-4731-bee8-42f57569d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:47.190995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09335d68-777e-4731-bee8-42f57569d14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:47.191608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09335d68-777e-4731-bee8-42f57569d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:47.192155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09335d68-777e-4731-bee8-42f57569d14d admin admin] PATH_INFO: `/v3/users/e605f50a9f374c88b6e9480c9ae1bea1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:47.193695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09335d68-777e-4731-bee8-42f57569d14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e605f50a9f374c88b6e9480c9ae1bea1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:47.196049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09335d68-777e-4731-bee8-42f57569d14d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:47.256411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09335d68-777e-4731-bee8-42f57569d14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e605f50a9f374c88b6e9480c9ae1bea1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:47.257371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09335d68-777e-4731-bee8-42f57569d14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e605f50a9f374c88b6e9480c9ae1bea1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:47.269531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09335d68-777e-4731-bee8-42f57569d14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e605f50a9f374c88b6e9480c9ae1bea1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:47.270539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09335d68-777e-4731-bee8-42f57569d14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e605f50a9f374c88b6e9480c9ae1bea1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:47.281965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09335d68-777e-4731-bee8-42f57569d14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e605f50a9f374c88b6e9480c9ae1bea1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:47.330509 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1699/3391] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:53:47 2021] DELETE /identity/v3/users/e605f50a9f374c88b6e9480c9ae1bea1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:48.583053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:48.588163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:48.614884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ea58-7ea4-4576-881d-8599ca426829 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:48.741298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:48.742183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:48.742463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:48.742740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] PATH_INFO: `/v3/projects/f937cd782d5a46b295dee143abe9fce0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:48.744003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f937cd782d5a46b295dee143abe9fce0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:48.746186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:48.858865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f937cd782d5a46b295dee143abe9fce0', 'request_id': 'req-dbcecfda-6216-402a-b1c4-89d78be44f1f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:48.875538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f937cd782d5a46b295dee143abe9fce0', 'request_id': 'req-dbcecfda-6216-402a-b1c4-89d78be44f1f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:48.885090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f937cd782d5a46b295dee143abe9fce0', 'request_id': 'req-dbcecfda-6216-402a-b1c4-89d78be44f1f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:48.902590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] The token cache is being invalidate because project f937cd782d5a46b295dee143abe9fce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:53:48.903155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:48.904248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dbcecfda-6216-402a-b1c4-89d78be44f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:53:48.910801 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1693/3392] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:53:48 2021] DELETE /identity/v3/projects/f937cd782d5a46b295dee143abe9fce0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:48.918501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f78b17-8853-4d53-9a04-f56d37d941d9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:48.919141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f78b17-8853-4d53-9a04-f56d37d941d9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:48.919141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f78b17-8853-4d53-9a04-f56d37d941d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:48.949608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-15f78b17-8853-4d53-9a04-f56d37d941d9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:48.951425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-15f78b17-8853-4d53-9a04-f56d37d941d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:49.028549 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1700/3393] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:49.039650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea87aba-ac0a-450b-b355-6474460cd8df None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:49.040331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea87aba-ac0a-450b-b355-6474460cd8df None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:49.040812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea87aba-ac0a-450b-b355-6474460cd8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:49.067478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4ea87aba-ac0a-450b-b355-6474460cd8df None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:49.069864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4ea87aba-ac0a-450b-b355-6474460cd8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:49.084622 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1694/3394] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:49.088732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f78b17-8853-4d53-9a04-f56d37d941d9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:49.104839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f78b17-8853-4d53-9a04-f56d37d941d9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:49.110665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8215ba-5e9f-49b2-9484-b08b310d070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:49.111707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8215ba-5e9f-49b2-9484-b08b310d070f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:49.112220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8215ba-5e9f-49b2-9484-b08b310d070f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:49.112701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8215ba-5e9f-49b2-9484-b08b310d070f admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:49.114177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8215ba-5e9f-49b2-9484-b08b310d070f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:53:49.114691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8215ba-5e9f-49b2-9484-b08b310d070f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:49.118527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8215ba-5e9f-49b2-9484-b08b310d070f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:49.136866 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1701/3395] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:53:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:53:49.140916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea87aba-ac0a-450b-b355-6474460cd8df None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:49.161901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea87aba-ac0a-450b-b355-6474460cd8df None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:49.185261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde5eb4-d2fc-4ed4-972c-b08f6e6c2504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:49.187878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5eb4-d2fc-4ed4-972c-b08f6e6c2504 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:49.188544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5eb4-d2fc-4ed4-972c-b08f6e6c2504 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:49.189038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde5eb4-d2fc-4ed4-972c-b08f6e6c2504 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:49.190825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde5eb4-d2fc-4ed4-972c-b08f6e6c2504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:49.193166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde5eb4-d2fc-4ed4-972c-b08f6e6c2504 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:49.245102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8215ba-5e9f-49b2-9484-b08b310d070f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:49.253548 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1695/3396] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:53:49 2021] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:49.259238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8215ba-5e9f-49b2-9484-b08b310d070f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:49.342882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b755791-6d8f-47a6-a9f4-1e827d452c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:49.343333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755791-6d8f-47a6-a9f4-1e827d452c4d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:49.343595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755791-6d8f-47a6-a9f4-1e827d452c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:49.343851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755791-6d8f-47a6-a9f4-1e827d452c4d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:49.344573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b755791-6d8f-47a6-a9f4-1e827d452c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:49.346503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b755791-6d8f-47a6-a9f4-1e827d452c4d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:49.405736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde5eb4-d2fc-4ed4-972c-b08f6e6c2504 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:49.420836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde5eb4-d2fc-4ed4-972c-b08f6e6c2504 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:49.421079 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1702/3397] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:53:49 2021] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:49.442511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6adfbe-ad22-4ff8-9321-5203d450ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:49.442949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6adfbe-ad22-4ff8-9321-5203d450ba12 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:49.443238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6adfbe-ad22-4ff8-9321-5203d450ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:49.446876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6adfbe-ad22-4ff8-9321-5203d450ba12 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:49.447690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6adfbe-ad22-4ff8-9321-5203d450ba12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:49.449480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6adfbe-ad22-4ff8-9321-5203d450ba12 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:49.491049 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1696/3398] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:49 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:53:49.495684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b755791-6d8f-47a6-a9f4-1e827d452c4d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:49.511961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b755791-6d8f-47a6-a9f4-1e827d452c4d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:49.533816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bff9f9-1ce8-4dfb-ad7b-bf2546acf004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:49.534501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bff9f9-1ce8-4dfb-ad7b-bf2546acf004 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:49.534787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bff9f9-1ce8-4dfb-ad7b-bf2546acf004 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:49.535064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bff9f9-1ce8-4dfb-ad7b-bf2546acf004 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:49.535843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bff9f9-1ce8-4dfb-ad7b-bf2546acf004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:49.537664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bff9f9-1ce8-4dfb-ad7b-bf2546acf004 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:49.561387 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1703/3399] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:49 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:49.562705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6adfbe-ad22-4ff8-9321-5203d450ba12 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:49.580996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6adfbe-ad22-4ff8-9321-5203d450ba12 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:49.602369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853b9e9-a34b-4916-b7a7-f61b2aa3eaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:49.603177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853b9e9-a34b-4916-b7a7-f61b2aa3eaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:49.604088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853b9e9-a34b-4916-b7a7-f61b2aa3eaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:49.604379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853b9e9-a34b-4916-b7a7-f61b2aa3eaa4 admin admin] PATH_INFO: `/v3/projects/812b97d174d84cdbb78bd4064909234f/users/8d611499f56e463ab23fc7c1ee2b382e/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:49.633086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853b9e9-a34b-4916-b7a7-f61b2aa3eaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=812b97d174d84cdbb78bd4064909234f, user_id=8d611499f56e463ab23fc7c1ee2b382e, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:49.637410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853b9e9-a34b-4916-b7a7-f61b2aa3eaa4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:49.657094 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1697/3400] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:53:49 2021] PUT /identity/v3/projects/812b97d174d84cdbb78bd4064909234f/users/8d611499f56e463ab23fc7c1ee2b382e/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:53:49.670187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa31ed-0f06-47a3-9034-929be4b21f95 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:49.670834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa31ed-0f06-47a3-9034-929be4b21f95 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:49.671345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa31ed-0f06-47a3-9034-929be4b21f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:49.717416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-39aa31ed-0f06-47a3-9034-929be4b21f95 None None] MFA Rules not processed for user `8d611499f56e463ab23fc7c1ee2b382e`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:49.719209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-39aa31ed-0f06-47a3-9034-929be4b21f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:49.839821 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1704/3401] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:49 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:49.844227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853b9e9-a34b-4916-b7a7-f61b2aa3eaa4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:50.005939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853b9e9-a34b-4916-b7a7-f61b2aa3eaa4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:50.011361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8830b-f1d6-442b-9fcd-f1f61ac77a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:50.012031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8830b-f1d6-442b-9fcd-f1f61ac77a3e admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:50.012510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8830b-f1d6-442b-9fcd-f1f61ac77a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:50.012980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8830b-f1d6-442b-9fcd-f1f61ac77a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:50.013915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8830b-f1d6-442b-9fcd-f1f61ac77a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:50.016045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8830b-f1d6-442b-9fcd-f1f61ac77a3e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:50.075532 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1698/3402] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:53:49 2021] POST /identity/v3/projects => generated 391 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:50.079409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa31ed-0f06-47a3-9034-929be4b21f95 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:50.104344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa31ed-0f06-47a3-9034-929be4b21f95 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:50.177356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b44bf-7e1a-4a4c-8f29-692fc43c1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:50.178340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b44bf-7e1a-4a4c-8f29-692fc43c1c69 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:50.178966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b44bf-7e1a-4a4c-8f29-692fc43c1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:50.179569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b44bf-7e1a-4a4c-8f29-692fc43c1c69 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:50.180793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b44bf-7e1a-4a4c-8f29-692fc43c1c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:50.183883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b44bf-7e1a-4a4c-8f29-692fc43c1c69 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:50.214391 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1705/3403] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:53:50 2021] POST /identity/v3/users => generated 302 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:53:50.219065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8830b-f1d6-442b-9fcd-f1f61ac77a3e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:50.235604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8830b-f1d6-442b-9fcd-f1f61ac77a3e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:50.244151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ac18-f497-485c-a314-10aa14c09d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:50.246258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ac18-f497-485c-a314-10aa14c09d9c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:50.246676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ac18-f497-485c-a314-10aa14c09d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:50.247307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82ac18-f497-485c-a314-10aa14c09d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:50.248378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82ac18-f497-485c-a314-10aa14c09d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:50.251315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82ac18-f497-485c-a314-10aa14c09d9c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:50.267825 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1699/3404] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:50 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:50.271506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b44bf-7e1a-4a4c-8f29-692fc43c1c69 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:50.283161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b44bf-7e1a-4a4c-8f29-692fc43c1c69 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:50.289055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4d701-6839-45fd-8611-d8bccfc55283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:50.290176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4d701-6839-45fd-8611-d8bccfc55283 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:50.290614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4d701-6839-45fd-8611-d8bccfc55283 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:50.291050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4d701-6839-45fd-8611-d8bccfc55283 admin admin] PATH_INFO: `/v3/projects/5ca13477af5b42bb80d0dde5919da309/users/682a2105fe2f4d96b5ad4cd8ed43de6f/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:50.322424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4d701-6839-45fd-8611-d8bccfc55283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca13477af5b42bb80d0dde5919da309, user_id=682a2105fe2f4d96b5ad4cd8ed43de6f, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:50.325285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4d701-6839-45fd-8611-d8bccfc55283 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:50.346253 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1706/3405] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:53:50 2021] PUT /identity/v3/projects/5ca13477af5b42bb80d0dde5919da309/users/682a2105fe2f4d96b5ad4cd8ed43de6f/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:53:50.350018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ac18-f497-485c-a314-10aa14c09d9c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:50.366504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82ac18-f497-485c-a314-10aa14c09d9c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:50.493563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80640a49-ee54-4588-96a5-b8f9f86de36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:50.494649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640a49-ee54-4588-96a5-b8f9f86de36e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:50.495525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640a49-ee54-4588-96a5-b8f9f86de36e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:50.496355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640a49-ee54-4588-96a5-b8f9f86de36e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:50.497413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80640a49-ee54-4588-96a5-b8f9f86de36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:50.499814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80640a49-ee54-4588-96a5-b8f9f86de36e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:50.515222 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1700/3406] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:53:50 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:53:50.519138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4d701-6839-45fd-8611-d8bccfc55283 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:50.531468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4d701-6839-45fd-8611-d8bccfc55283 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:50.537375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc8b81-a2ca-4db4-a80e-a78a202cd595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:50.538504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8b81-a2ca-4db4-a80e-a78a202cd595 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:50.538879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8b81-a2ca-4db4-a80e-a78a202cd595 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:50.539269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc8b81-a2ca-4db4-a80e-a78a202cd595 admin admin] PATH_INFO: `/v3/projects/5ca13477af5b42bb80d0dde5919da309/users/682a2105fe2f4d96b5ad4cd8ed43de6f/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:50.541718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc8b81-a2ca-4db4-a80e-a78a202cd595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca13477af5b42bb80d0dde5919da309, user_id=682a2105fe2f4d96b5ad4cd8ed43de6f, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:50.544596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc8b81-a2ca-4db4-a80e-a78a202cd595 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:50.571299 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1707/3407] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:53:50 2021] PUT /identity/v3/projects/5ca13477af5b42bb80d0dde5919da309/users/682a2105fe2f4d96b5ad4cd8ed43de6f/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:53:50.574247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa80b-f854-47e4-a32f-f20ad5f10e79 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:50.574653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa80b-f854-47e4-a32f-f20ad5f10e79 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:50.575034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fa80b-f854-47e4-a32f-f20ad5f10e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:50.616101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ad7fa80b-f854-47e4-a32f-f20ad5f10e79 None None] MFA Rules not processed for user `682a2105fe2f4d96b5ad4cd8ed43de6f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:50.617504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ad7fa80b-f854-47e4-a32f-f20ad5f10e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:50.732497 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1701/3408] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:50 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:50.737855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f2190-b2c6-4d72-a4bd-3f18b9f4507c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:50.738249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f2190-b2c6-4d72-a4bd-3f18b9f4507c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:50.738720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f2190-b2c6-4d72-a4bd-3f18b9f4507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:50.766742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-729f2190-b2c6-4d72-a4bd-3f18b9f4507c None None] MFA Rules not processed for user `8d611499f56e463ab23fc7c1ee2b382e`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:50.768607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-729f2190-b2c6-4d72-a4bd-3f18b9f4507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:50.879034 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1708/3409] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:50 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:51.340374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa80b-f854-47e4-a32f-f20ad5f10e79 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:51.342106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ad7fa80b-f854-47e4-a32f-f20ad5f10e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:51.499466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fa80b-f854-47e4-a32f-f20ad5f10e79 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:51.505433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bf02b-d21c-4f4b-9b54-b8b992049035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:51.506202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bf02b-d21c-4f4b-9b54-b8b992049035 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:51.506564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bf02b-d21c-4f4b-9b54-b8b992049035 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:51.506919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bf02b-d21c-4f4b-9b54-b8b992049035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:51.516504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bf02b-d21c-4f4b-9b54-b8b992049035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:51.518204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bf02b-d21c-4f4b-9b54-b8b992049035 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:51.533049 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1702/3410] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:51 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:55.553558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e5c21-5fe4-4c5f-a85e-d3c7c2e877a0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:55.554033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e5c21-5fe4-4c5f-a85e-d3c7c2e877a0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:55.554136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e5c21-5fe4-4c5f-a85e-d3c7c2e877a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:55.624039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-915e5c21-5fe4-4c5f-a85e-d3c7c2e877a0 None None] MFA Rules not processed for user `7c837598a18f439d93cfce37b86aa235`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:55.625307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-915e5c21-5fe4-4c5f-a85e-d3c7c2e877a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:55.781935 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1709/3411] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:55 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:55.786900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bf02b-d21c-4f4b-9b54-b8b992049035 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:55.801867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bf02b-d21c-4f4b-9b54-b8b992049035 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:55.815566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b03bc-bf34-48da-9866-92f31d6f9f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:55.816704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b03bc-bf34-48da-9866-92f31d6f9f71 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:55.817184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b03bc-bf34-48da-9866-92f31d6f9f71 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:55.817969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b03bc-bf34-48da-9866-92f31d6f9f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:55.832680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b03bc-bf34-48da-9866-92f31d6f9f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:55.835157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b03bc-bf34-48da-9866-92f31d6f9f71 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:55.851932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1703/3412] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:55 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:53:56.053360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100e8ce-f4a1-49f2-8365-0fb85572083d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:56.054405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100e8ce-f4a1-49f2-8365-0fb85572083d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:56.054901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100e8ce-f4a1-49f2-8365-0fb85572083d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:56.131685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1100e8ce-f4a1-49f2-8365-0fb85572083d None None] MFA Rules not processed for user `3cc24888898d4d20bcfdc3d7c8cde8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:53:56.138220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1100e8ce-f4a1-49f2-8365-0fb85572083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:53:56.281775 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1710/3413] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:53:56 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:53:56.581089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b03bc-bf34-48da-9866-92f31d6f9f71 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:53:56.598006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b03bc-bf34-48da-9866-92f31d6f9f71 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:53:56.608121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c6a48-23e6-4d94-996a-706fc99d2932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:53:56.608830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6a48-23e6-4d94-996a-706fc99d2932 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:53:56.609114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6a48-23e6-4d94-996a-706fc99d2932 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:53:56.609416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6a48-23e6-4d94-996a-706fc99d2932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:53:56.624907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c6a48-23e6-4d94-996a-706fc99d2932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:53:56.626635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c6a48-23e6-4d94-996a-706fc99d2932 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:53:56.656232 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1704/3414] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:53:56 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:54:01.198063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366a5f-5614-4124-8a1a-7434b4a3d36d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:01.198893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366a5f-5614-4124-8a1a-7434b4a3d36d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:01.199056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04366a5f-5614-4124-8a1a-7434b4a3d36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:01.233671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-04366a5f-5614-4124-8a1a-7434b4a3d36d None None] MFA Rules not processed for user `7c837598a18f439d93cfce37b86aa235`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:01.235558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-04366a5f-5614-4124-8a1a-7434b4a3d36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:01.246013 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1711/3415] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:01 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:02.915466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a78ac9-92dd-4de8-b2a5-809bf26c2af0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:02.917220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a78ac9-92dd-4de8-b2a5-809bf26c2af0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:02.917661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a78ac9-92dd-4de8-b2a5-809bf26c2af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:02.972511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-90a78ac9-92dd-4de8-b2a5-809bf26c2af0 None None] MFA Rules not processed for user `3cc24888898d4d20bcfdc3d7c8cde8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:02.974070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-90a78ac9-92dd-4de8-b2a5-809bf26c2af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:02.991127 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1705/3416] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:02 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:03.288976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872b6d-cd0e-4614-987a-b0568195a993 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:03.290135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872b6d-cd0e-4614-987a-b0568195a993 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:03.290674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88872b6d-cd0e-4614-987a-b0568195a993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:03.312793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-88872b6d-cd0e-4614-987a-b0568195a993 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:03.314761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-88872b6d-cd0e-4614-987a-b0568195a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:03.411548 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1712/3417] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:54:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:03.420766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a78ac9-92dd-4de8-b2a5-809bf26c2af0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:03.422842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-90a78ac9-92dd-4de8-b2a5-809bf26c2af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:03.572698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a78ac9-92dd-4de8-b2a5-809bf26c2af0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:03.579570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a1667-7396-4161-89d1-d24576d20c4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:03.580550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1667-7396-4161-89d1-d24576d20c4b service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:03.581192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1667-7396-4161-89d1-d24576d20c4b service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:03.583125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a1667-7396-4161-89d1-d24576d20c4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:03.596619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a1667-7396-4161-89d1-d24576d20c4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:03.598930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a1667-7396-4161-89d1-d24576d20c4b service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:03.610613 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1706/3418] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:54:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:12.446503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872b6d-cd0e-4614-987a-b0568195a993 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:12.447977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-88872b6d-cd0e-4614-987a-b0568195a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:12.469963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88872b6d-cd0e-4614-987a-b0568195a993 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:12.480213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b200455-7bbb-4f45-acd9-12886f2d23f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:12.481241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b200455-7bbb-4f45-acd9-12886f2d23f7 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:12.481977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b200455-7bbb-4f45-acd9-12886f2d23f7 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:12.482979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b200455-7bbb-4f45-acd9-12886f2d23f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:12.493365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b200455-7bbb-4f45-acd9-12886f2d23f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:12.496018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b200455-7bbb-4f45-acd9-12886f2d23f7 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:12.507918 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1713/3419] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:54:12 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:54:12.533469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dc68a-4aed-4280-b698-a7c964ab70c1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:12.534171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dc68a-4aed-4280-b698-a7c964ab70c1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:12.534171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dc68a-4aed-4280-b698-a7c964ab70c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:12.556813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6d3dc68a-4aed-4280-b698-a7c964ab70c1 None None] MFA Rules not processed for user `8d611499f56e463ab23fc7c1ee2b382e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:12.557986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6d3dc68a-4aed-4280-b698-a7c964ab70c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:12.568401 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1707/3420] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:12 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:54:28.958811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acfb7b-bfcb-484b-9776-2c92e0e707e9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:28.959401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acfb7b-bfcb-484b-9776-2c92e0e707e9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:28.959520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acfb7b-bfcb-484b-9776-2c92e0e707e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:28.978958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e6acfb7b-bfcb-484b-9776-2c92e0e707e9 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:28.980194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e6acfb7b-bfcb-484b-9776-2c92e0e707e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:28.988287 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1714/3421] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:54:28 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:29.014860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dc68a-4aed-4280-b698-a7c964ab70c1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:29.026977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dc68a-4aed-4280-b698-a7c964ab70c1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:29.032721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37365f36-a8fb-4bcc-9b42-4842a801c437 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:29.033350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365f36-a8fb-4bcc-9b42-4842a801c437 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:29.033650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365f36-a8fb-4bcc-9b42-4842a801c437 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:29.034011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365f36-a8fb-4bcc-9b42-4842a801c437 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:29.042877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37365f36-a8fb-4bcc-9b42-4842a801c437 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:29.044538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37365f36-a8fb-4bcc-9b42-4842a801c437 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:29.056731 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1708/3422] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:54:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:31.254633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acfb7b-bfcb-484b-9776-2c92e0e707e9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:31.256323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e6acfb7b-bfcb-484b-9776-2c92e0e707e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:31.438279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acfb7b-bfcb-484b-9776-2c92e0e707e9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:31.446672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23512c-c6cf-4bfd-a304-cfdfef166f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:31.447878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23512c-c6cf-4bfd-a304-cfdfef166f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:31.448356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23512c-c6cf-4bfd-a304-cfdfef166f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:31.449429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23512c-c6cf-4bfd-a304-cfdfef166f94 admin admin] PATH_INFO: `/v3/users/434669fb63034fa0b91c67050a6b7d28` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:31.452796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23512c-c6cf-4bfd-a304-cfdfef166f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434669fb63034fa0b91c67050a6b7d28)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:31.457367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23512c-c6cf-4bfd-a304-cfdfef166f94 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:31.548814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fc23512c-c6cf-4bfd-a304-cfdfef166f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434669fb63034fa0b91c67050a6b7d28'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:31.550100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fc23512c-c6cf-4bfd-a304-cfdfef166f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434669fb63034fa0b91c67050a6b7d28'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:31.567010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fc23512c-c6cf-4bfd-a304-cfdfef166f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434669fb63034fa0b91c67050a6b7d28'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:31.568040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fc23512c-c6cf-4bfd-a304-cfdfef166f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434669fb63034fa0b91c67050a6b7d28'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:31.578378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fc23512c-c6cf-4bfd-a304-cfdfef166f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434669fb63034fa0b91c67050a6b7d28'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:31.613565 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1715/3423] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:31 2021] DELETE /identity/v3/users/434669fb63034fa0b91c67050a6b7d28 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:31.849536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37365f36-a8fb-4bcc-9b42-4842a801c437 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:31.862741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37365f36-a8fb-4bcc-9b42-4842a801c437 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:31.962283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:31.963357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:31.963865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:31.964145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] PATH_INFO: `/v3/projects/4ce320b0fdb0466692b28dc520686425` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:31.965388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce320b0fdb0466692b28dc520686425)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:31.967692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:32.032464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce320b0fdb0466692b28dc520686425', 'request_id': 'req-4fd72b63-b9bb-4341-ad99-221efddf6d1a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:32.041695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce320b0fdb0466692b28dc520686425', 'request_id': 'req-4fd72b63-b9bb-4341-ad99-221efddf6d1a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:32.050012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce320b0fdb0466692b28dc520686425', 'request_id': 'req-4fd72b63-b9bb-4341-ad99-221efddf6d1a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:32.061930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] The token cache is being invalidate because project 4ce320b0fdb0466692b28dc520686425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:54:32.062156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:32.062748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4fd72b63-b9bb-4341-ad99-221efddf6d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:32.064880 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1709/3424] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:31 2021] DELETE /identity/v3/projects/4ce320b0fdb0466692b28dc520686425 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:32.071085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ccd37-04d7-4c9f-9bb0-93a166a89f5e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:32.071692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ccd37-04d7-4c9f-9bb0-93a166a89f5e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:32.073210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ccd37-04d7-4c9f-9bb0-93a166a89f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:32.105634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c06ccd37-04d7-4c9f-9bb0-93a166a89f5e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:32.107729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c06ccd37-04d7-4c9f-9bb0-93a166a89f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:32.219382 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1716/3425] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:32.287457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1afa08-61bb-4b24-894e-7ab45d1e0982 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:32.287807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1afa08-61bb-4b24-894e-7ab45d1e0982 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:32.288007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1afa08-61bb-4b24-894e-7ab45d1e0982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:32.316751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0e1afa08-61bb-4b24-894e-7ab45d1e0982 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:32.337194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0e1afa08-61bb-4b24-894e-7ab45d1e0982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:32.352681 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1710/3426] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:32.353957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ccd37-04d7-4c9f-9bb0-93a166a89f5e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:32.368478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ccd37-04d7-4c9f-9bb0-93a166a89f5e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:32.386073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1decab-e15a-4b1e-88e3-2d79d8687cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:32.386965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1decab-e15a-4b1e-88e3-2d79d8687cdc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:32.387556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1decab-e15a-4b1e-88e3-2d79d8687cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:32.388090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1decab-e15a-4b1e-88e3-2d79d8687cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:32.389720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1decab-e15a-4b1e-88e3-2d79d8687cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:54:32.392538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1decab-e15a-4b1e-88e3-2d79d8687cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:32.393958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1decab-e15a-4b1e-88e3-2d79d8687cdc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:32.417746 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1717/3427] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:54:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:54:32.422400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1afa08-61bb-4b24-894e-7ab45d1e0982 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:32.438878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1afa08-61bb-4b24-894e-7ab45d1e0982 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:32.443894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d7469-0677-46ee-98e2-cb2e792b7c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:32.444676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d7469-0677-46ee-98e2-cb2e792b7c1f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:32.446759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d7469-0677-46ee-98e2-cb2e792b7c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:32.446759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d7469-0677-46ee-98e2-cb2e792b7c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:32.446759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d7469-0677-46ee-98e2-cb2e792b7c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:32.448192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d7469-0677-46ee-98e2-cb2e792b7c1f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:32.497120 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1711/3428] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:54:32 2021] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:32.502169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1decab-e15a-4b1e-88e3-2d79d8687cdc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:32.524873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1decab-e15a-4b1e-88e3-2d79d8687cdc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:32.670813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec19df-4db1-43ed-9ae4-65392d8d3a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:32.671705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec19df-4db1-43ed-9ae4-65392d8d3a07 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:32.671870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec19df-4db1-43ed-9ae4-65392d8d3a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:32.672353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec19df-4db1-43ed-9ae4-65392d8d3a07 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:32.673283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec19df-4db1-43ed-9ae4-65392d8d3a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:32.675823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec19df-4db1-43ed-9ae4-65392d8d3a07 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:32.722814 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1718/3429] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:32 2021] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:32.723427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d7469-0677-46ee-98e2-cb2e792b7c1f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:32.739958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d7469-0677-46ee-98e2-cb2e792b7c1f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:32.749107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddde09-fd9b-4011-833e-72a4aa5a48dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:32.749936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddde09-fd9b-4011-833e-72a4aa5a48dd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:32.750357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddde09-fd9b-4011-833e-72a4aa5a48dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:32.750750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddde09-fd9b-4011-833e-72a4aa5a48dd admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:32.751664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddde09-fd9b-4011-833e-72a4aa5a48dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:32.753655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddde09-fd9b-4011-833e-72a4aa5a48dd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:32.787603 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1712/3430] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:32 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:54:32.788806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec19df-4db1-43ed-9ae4-65392d8d3a07 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:32.810354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec19df-4db1-43ed-9ae4-65392d8d3a07 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:32.822165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f07497-2ffe-43cc-b8c8-9d68ee261dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:32.822843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f07497-2ffe-43cc-b8c8-9d68ee261dcf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:32.823123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f07497-2ffe-43cc-b8c8-9d68ee261dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:32.823423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f07497-2ffe-43cc-b8c8-9d68ee261dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:32.824167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f07497-2ffe-43cc-b8c8-9d68ee261dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:32.826351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f07497-2ffe-43cc-b8c8-9d68ee261dcf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:32.858532 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1719/3431] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:32 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:32.864433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddde09-fd9b-4011-833e-72a4aa5a48dd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:32.889020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddde09-fd9b-4011-833e-72a4aa5a48dd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:32.906316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b5989-3838-49c1-be0f-c4addb89a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:32.907223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5989-3838-49c1-be0f-c4addb89a6d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:32.907527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5989-3838-49c1-be0f-c4addb89a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:32.907798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5989-3838-49c1-be0f-c4addb89a6d9 admin admin] PATH_INFO: `/v3/projects/76f19e09c6b04ac1a559d52d9cad1c77/users/05f09b6a534240fc82a45ce979040e3e/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:32.939497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b5989-3838-49c1-be0f-c4addb89a6d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f19e09c6b04ac1a559d52d9cad1c77, user_id=05f09b6a534240fc82a45ce979040e3e, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:32.943786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b5989-3838-49c1-be0f-c4addb89a6d9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:32.967380 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1713/3432] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:32 2021] PUT /identity/v3/projects/76f19e09c6b04ac1a559d52d9cad1c77/users/05f09b6a534240fc82a45ce979040e3e/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:32.973687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e76b9-a704-47dd-956c-435e6f892a07 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:32.973687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e76b9-a704-47dd-956c-435e6f892a07 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:32.973966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e76b9-a704-47dd-956c-435e6f892a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:33.010506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c49e76b9-a704-47dd-956c-435e6f892a07 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:33.015808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c49e76b9-a704-47dd-956c-435e6f892a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:33.132918 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1720/3433] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:54:33.149754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b5989-3838-49c1-be0f-c4addb89a6d9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:33.152861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f5b5989-3838-49c1-be0f-c4addb89a6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:33.273752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e76b9-a704-47dd-956c-435e6f892a07 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:33.276563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c49e76b9-a704-47dd-956c-435e6f892a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:33.309587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e76b9-a704-47dd-956c-435e6f892a07 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:33.311937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b5989-3838-49c1-be0f-c4addb89a6d9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:33.322834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870c435-775a-46b1-87a7-25a23e9ce166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:33.323767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c435-775a-46b1-87a7-25a23e9ce166 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:33.324216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c435-775a-46b1-87a7-25a23e9ce166 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:33.324760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870c435-775a-46b1-87a7-25a23e9ce166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:33.329821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a001e1-392e-4fdd-8e73-944cda573b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:33.330876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a001e1-392e-4fdd-8e73-944cda573b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:33.332332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a001e1-392e-4fdd-8e73-944cda573b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:33.333031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a001e1-392e-4fdd-8e73-944cda573b7a admin admin] PATH_INFO: `/v3/users/6f940822793e422c8436036be6a116a0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:33.339589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a001e1-392e-4fdd-8e73-944cda573b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f940822793e422c8436036be6a116a0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:33.342436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a001e1-392e-4fdd-8e73-944cda573b7a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:33.346123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870c435-775a-46b1-87a7-25a23e9ce166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:33.348203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870c435-775a-46b1-87a7-25a23e9ce166 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:33.371567 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1714/3434] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:54:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:54:33.468407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56a001e1-392e-4fdd-8e73-944cda573b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f940822793e422c8436036be6a116a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:33.469714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56a001e1-392e-4fdd-8e73-944cda573b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f940822793e422c8436036be6a116a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:33.484386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56a001e1-392e-4fdd-8e73-944cda573b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f940822793e422c8436036be6a116a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:33.485459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56a001e1-392e-4fdd-8e73-944cda573b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f940822793e422c8436036be6a116a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:33.532436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56a001e1-392e-4fdd-8e73-944cda573b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f940822793e422c8436036be6a116a0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:33.631127 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1721/3435] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:33 2021] DELETE /identity/v3/users/6f940822793e422c8436036be6a116a0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:34.638603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870c435-775a-46b1-87a7-25a23e9ce166 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:34.669111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870c435-775a-46b1-87a7-25a23e9ce166 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:34.792681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:34.795155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:34.795636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:34.796111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] PATH_INFO: `/v3/projects/79226c480677428e924a69a8e4c01ae9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:34.797606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79226c480677428e924a69a8e4c01ae9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:34.801548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:34.874402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79226c480677428e924a69a8e4c01ae9', 'request_id': 'req-bb8d3e03-7537-45d4-83f5-8d928fabb060'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:34.882853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79226c480677428e924a69a8e4c01ae9', 'request_id': 'req-bb8d3e03-7537-45d4-83f5-8d928fabb060'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:34.892385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79226c480677428e924a69a8e4c01ae9', 'request_id': 'req-bb8d3e03-7537-45d4-83f5-8d928fabb060'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:34.904302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] The token cache is being invalidate because project 79226c480677428e924a69a8e4c01ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:54:34.904865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:34.905783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb8d3e03-7537-45d4-83f5-8d928fabb060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:34.917647 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1715/3436] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:34 2021] DELETE /identity/v3/projects/79226c480677428e924a69a8e4c01ae9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:34.918873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5209c2-b182-4d81-9e07-1e1c61b9aeac None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:34.919603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5209c2-b182-4d81-9e07-1e1c61b9aeac None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:34.919603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5209c2-b182-4d81-9e07-1e1c61b9aeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:34.944542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-af5209c2-b182-4d81-9e07-1e1c61b9aeac None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:34.945981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-af5209c2-b182-4d81-9e07-1e1c61b9aeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:35.126976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812541cc-410e-4e24-b145-8d8dd95d3b78 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:35.128349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812541cc-410e-4e24-b145-8d8dd95d3b78 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:35.128747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812541cc-410e-4e24-b145-8d8dd95d3b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:35.131510 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1722/3437] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:35.160008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-812541cc-410e-4e24-b145-8d8dd95d3b78 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:35.161432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-812541cc-410e-4e24-b145-8d8dd95d3b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:35.178151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5209c2-b182-4d81-9e07-1e1c61b9aeac None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:35.190498 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1716/3438] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:35.198677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5209c2-b182-4d81-9e07-1e1c61b9aeac None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:35.204679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d53241-b725-40f6-bac0-a9ba64dabce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:35.205390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53241-b725-40f6-bac0-a9ba64dabce6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:35.205668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53241-b725-40f6-bac0-a9ba64dabce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:35.206131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53241-b725-40f6-bac0-a9ba64dabce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:35.207031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d53241-b725-40f6-bac0-a9ba64dabce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:54:35.207558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d53241-b725-40f6-bac0-a9ba64dabce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:35.210171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d53241-b725-40f6-bac0-a9ba64dabce6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:35.235890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812541cc-410e-4e24-b145-8d8dd95d3b78 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:35.242144 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1723/3439] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:54:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:54:35.246192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812541cc-410e-4e24-b145-8d8dd95d3b78 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:35.256940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e175845-cd66-4703-9d8b-f06367997af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:35.257855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e175845-cd66-4703-9d8b-f06367997af4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:35.258303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e175845-cd66-4703-9d8b-f06367997af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:35.267035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e175845-cd66-4703-9d8b-f06367997af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:35.267938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e175845-cd66-4703-9d8b-f06367997af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:35.271360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e175845-cd66-4703-9d8b-f06367997af4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:35.324363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d53241-b725-40f6-bac0-a9ba64dabce6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:35.331852 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1717/3440] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:54:35 2021] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:35.337920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d53241-b725-40f6-bac0-a9ba64dabce6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:35.439695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e442e-3995-4d65-8eb5-a059e581271b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:35.440392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e442e-3995-4d65-8eb5-a059e581271b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:35.440677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e442e-3995-4d65-8eb5-a059e581271b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:35.440947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e442e-3995-4d65-8eb5-a059e581271b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:35.441652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e442e-3995-4d65-8eb5-a059e581271b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:35.444878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e442e-3995-4d65-8eb5-a059e581271b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:35.492349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e175845-cd66-4703-9d8b-f06367997af4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:35.503027 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1724/3441] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:35 2021] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:35.505519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e175845-cd66-4703-9d8b-f06367997af4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:35.510677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678f020-5865-4b6f-8160-282f8444c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:35.511861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f020-5865-4b6f-8160-282f8444c91f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:35.514219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f020-5865-4b6f-8160-282f8444c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:35.514512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678f020-5865-4b6f-8160-282f8444c91f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:35.515281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678f020-5865-4b6f-8160-282f8444c91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:35.517226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678f020-5865-4b6f-8160-282f8444c91f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:35.538359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e442e-3995-4d65-8eb5-a059e581271b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:35.545861 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1718/3442] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:35 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:35.551940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e442e-3995-4d65-8eb5-a059e581271b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:35.560178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e73551-fd19-4d4c-a5d5-863e395cebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:35.560910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73551-fd19-4d4c-a5d5-863e395cebb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:35.561134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73551-fd19-4d4c-a5d5-863e395cebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:35.561414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73551-fd19-4d4c-a5d5-863e395cebb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:35.562254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e73551-fd19-4d4c-a5d5-863e395cebb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:35.564655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e73551-fd19-4d4c-a5d5-863e395cebb2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:35.587887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678f020-5865-4b6f-8160-282f8444c91f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:35.602432 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1725/3443] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:35 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:35.604102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678f020-5865-4b6f-8160-282f8444c91f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:35.613937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444749de-c820-4852-8b93-ab68e91f262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:35.614873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444749de-c820-4852-8b93-ab68e91f262d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:35.615118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444749de-c820-4852-8b93-ab68e91f262d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:35.621219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444749de-c820-4852-8b93-ab68e91f262d admin admin] PATH_INFO: `/v3/projects/a58a4f8b21b140df8cdbd07d62968638/users/756ec01193f049e3bac669a9806720ca/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:35.642057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444749de-c820-4852-8b93-ab68e91f262d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58a4f8b21b140df8cdbd07d62968638, user_id=756ec01193f049e3bac669a9806720ca, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:35.645277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444749de-c820-4852-8b93-ab68e91f262d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:35.688084 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1719/3444] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:35 2021] PUT /identity/v3/projects/a58a4f8b21b140df8cdbd07d62968638/users/756ec01193f049e3bac669a9806720ca/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:35.696426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0a56c-f039-488a-affa-df1ebba725d1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:35.698266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0a56c-f039-488a-affa-df1ebba725d1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:35.698866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0a56c-f039-488a-affa-df1ebba725d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:35.745794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-95f0a56c-f039-488a-affa-df1ebba725d1 None None] MFA Rules not processed for user `756ec01193f049e3bac669a9806720ca`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:35.752103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-95f0a56c-f039-488a-affa-df1ebba725d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:35.861428 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1726/3445] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:35 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:35.862564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444749de-c820-4852-8b93-ab68e91f262d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:35.992021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444749de-c820-4852-8b93-ab68e91f262d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:36.002054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b25b7f-37fd-4cb1-89fe-c4f5d00b879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:36.002786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b25b7f-37fd-4cb1-89fe-c4f5d00b879d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:36.003139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b25b7f-37fd-4cb1-89fe-c4f5d00b879d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:36.003528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b25b7f-37fd-4cb1-89fe-c4f5d00b879d admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:36.004370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b25b7f-37fd-4cb1-89fe-c4f5d00b879d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:36.006900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b25b7f-37fd-4cb1-89fe-c4f5d00b879d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:36.072653 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1720/3446] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:54:35 2021] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:54:36.076558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0a56c-f039-488a-affa-df1ebba725d1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:36.114016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0a56c-f039-488a-affa-df1ebba725d1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:36.281852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264a58-c2c1-4ec5-ad5f-58dfeaec93d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:36.282553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264a58-c2c1-4ec5-ad5f-58dfeaec93d0 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:36.282840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264a58-c2c1-4ec5-ad5f-58dfeaec93d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:36.283114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264a58-c2c1-4ec5-ad5f-58dfeaec93d0 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:36.284156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46264a58-c2c1-4ec5-ad5f-58dfeaec93d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:36.287834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46264a58-c2c1-4ec5-ad5f-58dfeaec93d0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:36.322280 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1727/3447] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:36 2021] POST /identity/v3/users => generated 294 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:36.326486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b25b7f-37fd-4cb1-89fe-c4f5d00b879d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:36.345287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b25b7f-37fd-4cb1-89fe-c4f5d00b879d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:36.354144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49b3f-9a05-4a8e-9c4b-794b59b9fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:36.354851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49b3f-9a05-4a8e-9c4b-794b59b9fe8e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:36.355141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49b3f-9a05-4a8e-9c4b-794b59b9fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:36.355458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49b3f-9a05-4a8e-9c4b-794b59b9fe8e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:36.359181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a49b3f-9a05-4a8e-9c4b-794b59b9fe8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:36.364160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a49b3f-9a05-4a8e-9c4b-794b59b9fe8e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:36.409849 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1721/3448] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:36 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:36.414471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264a58-c2c1-4ec5-ad5f-58dfeaec93d0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:36.442547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264a58-c2c1-4ec5-ad5f-58dfeaec93d0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:36.467000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802fce5-9902-4940-a607-5aeaaae28a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:36.467985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fce5-9902-4940-a607-5aeaaae28a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:36.468282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fce5-9902-4940-a607-5aeaaae28a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:36.468549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fce5-9902-4940-a607-5aeaaae28a2a admin admin] PATH_INFO: `/v3/projects/02a153a1f98c4485a95cc1dcdbf0e9a6/users/4e6ee1ead7f847188e986f468c2fd515/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:36.506758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802fce5-9902-4940-a607-5aeaaae28a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a153a1f98c4485a95cc1dcdbf0e9a6, user_id=4e6ee1ead7f847188e986f468c2fd515, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:36.509479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802fce5-9902-4940-a607-5aeaaae28a2a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:36.532090 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1728/3449] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:36 2021] PUT /identity/v3/projects/02a153a1f98c4485a95cc1dcdbf0e9a6/users/4e6ee1ead7f847188e986f468c2fd515/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:54:36.535822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49b3f-9a05-4a8e-9c4b-794b59b9fe8e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:36.550662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49b3f-9a05-4a8e-9c4b-794b59b9fe8e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:36.667624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d1175-60a6-4bd8-bd9b-e2e436497f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:36.673713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1175-60a6-4bd8-bd9b-e2e436497f3f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:36.674502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1175-60a6-4bd8-bd9b-e2e436497f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:36.675237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1175-60a6-4bd8-bd9b-e2e436497f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:36.677104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d1175-60a6-4bd8-bd9b-e2e436497f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:36.681987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d1175-60a6-4bd8-bd9b-e2e436497f3f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:36.699869 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1722/3450] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:36 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:36.700576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802fce5-9902-4940-a607-5aeaaae28a2a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:36.726380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802fce5-9902-4940-a607-5aeaaae28a2a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:36.739146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e9b56-4bea-427e-9fa5-f41c1b4676e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:36.740243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e9b56-4bea-427e-9fa5-f41c1b4676e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:36.740532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e9b56-4bea-427e-9fa5-f41c1b4676e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:36.740812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e9b56-4bea-427e-9fa5-f41c1b4676e4 admin admin] PATH_INFO: `/v3/projects/02a153a1f98c4485a95cc1dcdbf0e9a6/users/4e6ee1ead7f847188e986f468c2fd515/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:36.742810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e9b56-4bea-427e-9fa5-f41c1b4676e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a153a1f98c4485a95cc1dcdbf0e9a6, user_id=4e6ee1ead7f847188e986f468c2fd515, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:36.746050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e9b56-4bea-427e-9fa5-f41c1b4676e4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:36.761828 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1729/3451] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:36 2021] PUT /identity/v3/projects/02a153a1f98c4485a95cc1dcdbf0e9a6/users/4e6ee1ead7f847188e986f468c2fd515/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:54:36.773184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913c561-11d6-4678-90e7-1830e107242e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:36.773567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913c561-11d6-4678-90e7-1830e107242e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:36.773933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913c561-11d6-4678-90e7-1830e107242e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:36.820612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2913c561-11d6-4678-90e7-1830e107242e None None] MFA Rules not processed for user `4e6ee1ead7f847188e986f468c2fd515`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:36.822152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2913c561-11d6-4678-90e7-1830e107242e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:36.914376 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1723/3452] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:36 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:36.918486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e9b56-4bea-427e-9fa5-f41c1b4676e4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:36.932288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e9b56-4bea-427e-9fa5-f41c1b4676e4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:36.950014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04902a7-3752-435e-84d0-03eac2f6a7b6 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:36.950731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04902a7-3752-435e-84d0-03eac2f6a7b6 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:36.951012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04902a7-3752-435e-84d0-03eac2f6a7b6 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:36.952870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04902a7-3752-435e-84d0-03eac2f6a7b6 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:36.952870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04902a7-3752-435e-84d0-03eac2f6a7b6 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:36.953954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04902a7-3752-435e-84d0-03eac2f6a7b6 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.011725 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1730/3453] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:54:36 2021] POST /identity/v3/projects => generated 350 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:37.013045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913c561-11d6-4678-90e7-1830e107242e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:37.022567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913c561-11d6-4678-90e7-1830e107242e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:37.137198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b4d2b-a724-4447-9aa4-2c9e050c6480 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:37.138434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b4d2b-a724-4447-9aa4-2c9e050c6480 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:37.139112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b4d2b-a724-4447-9aa4-2c9e050c6480 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:37.139642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b4d2b-a724-4447-9aa4-2c9e050c6480 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:37.140565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b4d2b-a724-4447-9aa4-2c9e050c6480 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.142639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b4d2b-a724-4447-9aa4-2c9e050c6480 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.145010 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.common [None req-458b4d2b-a724-4447-9aa4-2c9e050c6480 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 27 20:54:37.179658 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1724/3454] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 20:54:37 2021] POST /identity/v3/projects => generated 349 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:37.184841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04902a7-3752-435e-84d0-03eac2f6a7b6 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:37.218726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04902a7-3752-435e-84d0-03eac2f6a7b6 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:37.331114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8316e2-a0db-4d8d-afb6-2d6b5fb16710 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:37.332035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8316e2-a0db-4d8d-afb6-2d6b5fb16710 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:37.332322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8316e2-a0db-4d8d-afb6-2d6b5fb16710 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:37.332597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8316e2-a0db-4d8d-afb6-2d6b5fb16710 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/users/756ec01193f049e3bac669a9806720ca` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:37.333994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8316e2-a0db-4d8d-afb6-2d6b5fb16710 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:get_user(user_id=756ec01193f049e3bac669a9806720ca)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.336515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8316e2-a0db-4d8d-afb6-2d6b5fb16710 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.338544 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1731/3455] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:54:37 2021] GET /identity/v3/users/756ec01193f049e3bac669a9806720ca => generated 287 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:54:37.343853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b4d2b-a724-4447-9aa4-2c9e050c6480 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:37.359204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b4d2b-a724-4447-9aa4-2c9e050c6480 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:37.368834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fef58-9378-4d36-b5ce-6a3123656386 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:37.383128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fef58-9378-4d36-b5ce-6a3123656386 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:37.383655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fef58-9378-4d36-b5ce-6a3123656386 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:37.384137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fef58-9378-4d36-b5ce-6a3123656386 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/credentials` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:37.386600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fef58-9378-4d36-b5ce-6a3123656386 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.390576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fef58-9378-4d36-b5ce-6a3123656386 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.450745 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1725/3456] 10.222.0.21 () {60 vars in 1161 bytes} [Sat Nov 27 20:54:37 2021] POST /identity/v3/credentials => generated 430 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:54:37.457589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8316e2-a0db-4d8d-afb6-2d6b5fb16710 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:37.484685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8316e2-a0db-4d8d-afb6-2d6b5fb16710 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:37.495094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7340321-fb39-4ace-bc85-d69467275b68 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:37.496371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340321-fb39-4ace-bc85-d69467275b68 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:37.496697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340321-fb39-4ace-bc85-d69467275b68 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:37.496974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340321-fb39-4ace-bc85-d69467275b68 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/credentials/fe4e7874dfab56d0f409f04da55ef254cbf858b4be99c26dbf1732d9260629cc` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:37.499930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7340321-fb39-4ace-bc85-d69467275b68 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=fe4e7874dfab56d0f409f04da55ef254cbf858b4be99c26dbf1732d9260629cc)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.501733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7340321-fb39-4ace-bc85-d69467275b68 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.503826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7340321-fb39-4ace-bc85-d69467275b68 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=fe4e7874dfab56d0f409f04da55ef254cbf858b4be99c26dbf1732d9260629cc)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.506043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7340321-fb39-4ace-bc85-d69467275b68 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.535049 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1732/3457] 10.222.0.21 () {60 vars in 1357 bytes} [Sat Nov 27 20:54:37 2021] PATCH /identity/v3/credentials/fe4e7874dfab56d0f409f04da55ef254cbf858b4be99c26dbf1732d9260629cc => generated 436 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:54:37.536698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fef58-9378-4d36-b5ce-6a3123656386 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:37.550808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fef58-9378-4d36-b5ce-6a3123656386 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:37.567561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcc4f5-0cb0-432b-a9fe-3f9fd398d093 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:37.569093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc4f5-0cb0-432b-a9fe-3f9fd398d093 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:37.569755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc4f5-0cb0-432b-a9fe-3f9fd398d093 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:37.570263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcc4f5-0cb0-432b-a9fe-3f9fd398d093 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/credentials/fe4e7874dfab56d0f409f04da55ef254cbf858b4be99c26dbf1732d9260629cc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:37.572771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcc4f5-0cb0-432b-a9fe-3f9fd398d093 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=fe4e7874dfab56d0f409f04da55ef254cbf858b4be99c26dbf1732d9260629cc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.578658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fcc4f5-0cb0-432b-a9fe-3f9fd398d093 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.581750 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1726/3458] 10.222.0.21 () {58 vars in 1334 bytes} [Sat Nov 27 20:54:37 2021] GET /identity/v3/credentials/fe4e7874dfab56d0f409f04da55ef254cbf858b4be99c26dbf1732d9260629cc => generated 436 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:54:37.586050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7340321-fb39-4ace-bc85-d69467275b68 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:37.599995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7340321-fb39-4ace-bc85-d69467275b68 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:37.610218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acd61a-aee6-48ab-9d9b-046eeb721808 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:37.611352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd61a-aee6-48ab-9d9b-046eeb721808 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:37.611643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd61a-aee6-48ab-9d9b-046eeb721808 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:37.612162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acd61a-aee6-48ab-9d9b-046eeb721808 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/credentials/fe4e7874dfab56d0f409f04da55ef254cbf858b4be99c26dbf1732d9260629cc` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:37.614315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acd61a-aee6-48ab-9d9b-046eeb721808 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=fe4e7874dfab56d0f409f04da55ef254cbf858b4be99c26dbf1732d9260629cc)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.617059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acd61a-aee6-48ab-9d9b-046eeb721808 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.668009 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1733/3459] 10.222.0.21 () {58 vars in 1337 bytes} [Sat Nov 27 20:54:37 2021] DELETE /identity/v3/credentials/fe4e7874dfab56d0f409f04da55ef254cbf858b4be99c26dbf1732d9260629cc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:54:37.674054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcc4f5-0cb0-432b-a9fe-3f9fd398d093 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:37.702331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcc4f5-0cb0-432b-a9fe-3f9fd398d093 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:37.721299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13c43b-2684-4091-8308-68a4edf5b840 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:37.722349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c43b-2684-4091-8308-68a4edf5b840 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:37.722849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c43b-2684-4091-8308-68a4edf5b840 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:37.723377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c43b-2684-4091-8308-68a4edf5b840 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/credentials` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:37.724312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13c43b-2684-4091-8308-68a4edf5b840 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.728049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13c43b-2684-4091-8308-68a4edf5b840 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.767063 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1727/3460] 10.222.0.21 () {60 vars in 1161 bytes} [Sat Nov 27 20:54:37 2021] POST /identity/v3/credentials => generated 431 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:37.769408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acd61a-aee6-48ab-9d9b-046eeb721808 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:37.799426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acd61a-aee6-48ab-9d9b-046eeb721808 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:37.810612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef1ab1-0e22-4647-b1ce-5bcabdc17b00 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:37.811281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1ab1-0e22-4647-b1ce-5bcabdc17b00 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:37.811812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1ab1-0e22-4647-b1ce-5bcabdc17b00 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:37.812170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef1ab1-0e22-4647-b1ce-5bcabdc17b00 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/credentials` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:37.813147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef1ab1-0e22-4647-b1ce-5bcabdc17b00 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.815057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef1ab1-0e22-4647-b1ce-5bcabdc17b00 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.875827 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1734/3461] 10.222.0.21 () {60 vars in 1161 bytes} [Sat Nov 27 20:54:37 2021] POST /identity/v3/credentials => generated 431 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:37.878586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13c43b-2684-4091-8308-68a4edf5b840 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:37.894935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13c43b-2684-4091-8308-68a4edf5b840 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:37.910644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:37.911799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:37.914844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:37.915384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/credentials` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:37.918445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.923344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.946237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.957412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.961233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:37.970633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:37.978545 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1728/3462] 10.222.0.21 () {58 vars in 1139 bytes} [Sat Nov 27 20:54:37 2021] GET /identity/v3/credentials => generated 947 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:54:37.979354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef1ab1-0e22-4647-b1ce-5bcabdc17b00 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:38.021502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef1ab1-0e22-4647-b1ce-5bcabdc17b00 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:38.038111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd5995-097f-48b9-82a5-8f1aca1c5f0c tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:38.039464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5995-097f-48b9-82a5-8f1aca1c5f0c tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:38.040005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5995-097f-48b9-82a5-8f1aca1c5f0c tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:38.040538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5995-097f-48b9-82a5-8f1aca1c5f0c tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/credentials/bb29b7d075260849813d8be79ba5863845275077548c71817c0a4662504868f9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:38.044285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd5995-097f-48b9-82a5-8f1aca1c5f0c tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=bb29b7d075260849813d8be79ba5863845275077548c71817c0a4662504868f9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:38.049802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd5995-097f-48b9-82a5-8f1aca1c5f0c tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:38.084744 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1735/3463] 10.222.0.21 () {58 vars in 1337 bytes} [Sat Nov 27 20:54:37 2021] DELETE /identity/v3/credentials/bb29b7d075260849813d8be79ba5863845275077548c71817c0a4662504868f9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:54:38.089233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:38.113192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551a084-5c0c-407a-b3fe-832fba20fe57 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:38.127592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492f70a-4991-45d7-a25f-a2ca5638a9b9 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:38.129726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492f70a-4991-45d7-a25f-a2ca5638a9b9 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:38.130014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492f70a-4991-45d7-a25f-a2ca5638a9b9 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:38.131496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492f70a-4991-45d7-a25f-a2ca5638a9b9 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/credentials/72bd056e37b7020067e0b7d2e453218f501270267cb1a0d83fde269d33b81ebe` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:38.150334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492f70a-4991-45d7-a25f-a2ca5638a9b9 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=72bd056e37b7020067e0b7d2e453218f501270267cb1a0d83fde269d33b81ebe)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:38.161953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492f70a-4991-45d7-a25f-a2ca5638a9b9 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:38.205391 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1729/3464] 10.222.0.21 () {58 vars in 1337 bytes} [Sat Nov 27 20:54:38 2021] DELETE /identity/v3/credentials/72bd056e37b7020067e0b7d2e453218f501270267cb1a0d83fde269d33b81ebe => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:38.213058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd5995-097f-48b9-82a5-8f1aca1c5f0c tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:38.265821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd5995-097f-48b9-82a5-8f1aca1c5f0c tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:38.288568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:38.292278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:38.296299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:38.296914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/projects/ee9258ad847540d095f94bdd574b6e1f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:38.301038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee9258ad847540d095f94bdd574b6e1f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:38.303425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:38.538224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9258ad847540d095f94bdd574b6e1f', 'request_id': 'req-4a4908a4-2ca1-4675-b4f3-aeca16471526'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:38.582434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9258ad847540d095f94bdd574b6e1f', 'request_id': 'req-4a4908a4-2ca1-4675-b4f3-aeca16471526'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:38.610371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9258ad847540d095f94bdd574b6e1f', 'request_id': 'req-4a4908a4-2ca1-4675-b4f3-aeca16471526'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:38.661981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] The token cache is being invalidate because project ee9258ad847540d095f94bdd574b6e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:54:38.666006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:38.680364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:38.688038 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1736/3465] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:38 2021] DELETE /identity/v3/projects/ee9258ad847540d095f94bdd574b6e1f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:38.693757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492f70a-4991-45d7-a25f-a2ca5638a9b9 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:38.695781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1492f70a-4991-45d7-a25f-a2ca5638a9b9 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:38.721257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492f70a-4991-45d7-a25f-a2ca5638a9b9 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:38.916935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e6ee1ead7f847188e986f468c2fd515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:38.918635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:38.919650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:38.921237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] PATH_INFO: `/v3/projects/6c8a2dc6f14c4f94975f8a078dcd9bfc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:38.935396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6c8a2dc6f14c4f94975f8a078dcd9bfc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:38.935396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:39.072660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8a2dc6f14c4f94975f8a078dcd9bfc', 'request_id': 'req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:39.094570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8a2dc6f14c4f94975f8a078dcd9bfc', 'request_id': 'req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:39.125218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8a2dc6f14c4f94975f8a078dcd9bfc', 'request_id': 'req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:39.160107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] The token cache is being invalidate because project 6c8a2dc6f14c4f94975f8a078dcd9bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:54:39.160394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:39.165762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef200f12-81df-4c8a-be00-ce5a7c3a7a3d tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:39.171134 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1730/3466] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:38 2021] DELETE /identity/v3/projects/6c8a2dc6f14c4f94975f8a078dcd9bfc => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:39.175356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:39.177545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:39.291034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecce478-a7e1-4bd1-99f9-78d42cf719f3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:39.291860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecce478-a7e1-4bd1-99f9-78d42cf719f3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:39.291860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecce478-a7e1-4bd1-99f9-78d42cf719f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:39.361669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-aecce478-a7e1-4bd1-99f9-78d42cf719f3 None None] MFA Rules not processed for user `745d99de8bd24185aacbbcf7b2c404c2`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:39.368962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-aecce478-a7e1-4bd1-99f9-78d42cf719f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:39.451824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4908a4-2ca1-4675-b4f3-aeca16471526 tempest-CredentialsTestJSON-1609386819 tempest-CredentialsTestJSON-1609386819-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:39.593973 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1731/3467] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:39 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:39.595713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577948-16ec-445f-abfa-11175a23103f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:39.596967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577948-16ec-445f-abfa-11175a23103f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:39.596967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da577948-16ec-445f-abfa-11175a23103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:39.647180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-da577948-16ec-445f-abfa-11175a23103f None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:39.649328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-da577948-16ec-445f-abfa-11175a23103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:39.650404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7d917-5ceb-4356-bbfa-a850ea06aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:39.651365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7d917-5ceb-4356-bbfa-a850ea06aeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:39.651926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7d917-5ceb-4356-bbfa-a850ea06aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:39.652366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7d917-5ceb-4356-bbfa-a850ea06aeb2 admin admin] PATH_INFO: `/v3/users/756ec01193f049e3bac669a9806720ca` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:39.653988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7d917-5ceb-4356-bbfa-a850ea06aeb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756ec01193f049e3bac669a9806720ca)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:39.656166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7d917-5ceb-4356-bbfa-a850ea06aeb2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:39.758224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6c7d917-5ceb-4356-bbfa-a850ea06aeb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756ec01193f049e3bac669a9806720ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:39.759692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6c7d917-5ceb-4356-bbfa-a850ea06aeb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756ec01193f049e3bac669a9806720ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:39.780126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6c7d917-5ceb-4356-bbfa-a850ea06aeb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756ec01193f049e3bac669a9806720ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:39.780445 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1732/3468] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:54:39 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:39.781342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6c7d917-5ceb-4356-bbfa-a850ea06aeb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756ec01193f049e3bac669a9806720ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:39.790715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6c7d917-5ceb-4356-bbfa-a850ea06aeb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756ec01193f049e3bac669a9806720ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:39.796374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da577948-16ec-445f-abfa-11175a23103f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:39.797996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-da577948-16ec-445f-abfa-11175a23103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:39.839498 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1737/3469] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:39 2021] DELETE /identity/v3/users/756ec01193f049e3bac669a9806720ca => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:39.843966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152643cd-df28-4f00-ae9a-4310570e73b3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:39.844591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152643cd-df28-4f00-ae9a-4310570e73b3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:39.845029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152643cd-df28-4f00-ae9a-4310570e73b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:39.897111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-152643cd-df28-4f00-ae9a-4310570e73b3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:39.900507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-152643cd-df28-4f00-ae9a-4310570e73b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:39.962253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da577948-16ec-445f-abfa-11175a23103f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:40.108202 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1738/3470] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:40.108202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152643cd-df28-4f00-ae9a-4310570e73b3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:40.119627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-152643cd-df28-4f00-ae9a-4310570e73b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:40.182526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ccd65-b8b6-4e9f-8a1e-ee7b9a756df2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:40.182526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ccd65-b8b6-4e9f-8a1e-ee7b9a756df2 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:40.182526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ccd65-b8b6-4e9f-8a1e-ee7b9a756df2 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:40.182526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ccd65-b8b6-4e9f-8a1e-ee7b9a756df2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:40.355303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152643cd-df28-4f00-ae9a-4310570e73b3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:40.364542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcda8d8-a1c8-4dc9-84f1-5ee9e58289d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:40.364711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ccd65-b8b6-4e9f-8a1e-ee7b9a756df2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:40.365197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda8d8-a1c8-4dc9-84f1-5ee9e58289d3 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:40.365483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda8d8-a1c8-4dc9-84f1-5ee9e58289d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:40.365783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda8d8-a1c8-4dc9-84f1-5ee9e58289d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:40.370722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ccd65-b8b6-4e9f-8a1e-ee7b9a756df2 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:40.400337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcda8d8-a1c8-4dc9-84f1-5ee9e58289d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:40.402072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcda8d8-a1c8-4dc9-84f1-5ee9e58289d3 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:40.415316 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1733/3471] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:54:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:40.445197 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1739/3472] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:54:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:54:42.171848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ccd65-b8b6-4e9f-8a1e-ee7b9a756df2 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:42.173494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0b5ccd65-b8b6-4e9f-8a1e-ee7b9a756df2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:42.196089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ccd65-b8b6-4e9f-8a1e-ee7b9a756df2 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:42.207947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:42.208867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:42.209148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:42.209543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] PATH_INFO: `/v3/projects/a58a4f8b21b140df8cdbd07d62968638` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:42.214244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58a4f8b21b140df8cdbd07d62968638)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:42.216767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:42.264956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fc6a7-f14f-4834-ae8c-fe5dbb30586a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:42.267635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fc6a7-f14f-4834-ae8c-fe5dbb30586a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:42.268359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fc6a7-f14f-4834-ae8c-fe5dbb30586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:42.329915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d84fc6a7-f14f-4834-ae8c-fe5dbb30586a None None] MFA Rules not processed for user `05f09b6a534240fc82a45ce979040e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:42.331162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d84fc6a7-f14f-4834-ae8c-fe5dbb30586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:42.355186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58a4f8b21b140df8cdbd07d62968638', 'request_id': 'req-568a995f-ddfb-4102-9841-1a17ad7102f3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:42.373188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58a4f8b21b140df8cdbd07d62968638', 'request_id': 'req-568a995f-ddfb-4102-9841-1a17ad7102f3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:42.389477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58a4f8b21b140df8cdbd07d62968638', 'request_id': 'req-568a995f-ddfb-4102-9841-1a17ad7102f3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:42.437024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] The token cache is being invalidate because project a58a4f8b21b140df8cdbd07d62968638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:54:42.437370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:42.454507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:42.459243 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1734/3473] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:42 2021] DELETE /identity/v3/projects/a58a4f8b21b140df8cdbd07d62968638 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:42.461436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:42.462951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:42.507309 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1740/3474] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:42 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:42.514202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fc6a7-f14f-4834-ae8c-fe5dbb30586a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:42.516054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d84fc6a7-f14f-4834-ae8c-fe5dbb30586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:42.685139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a995f-ddfb-4102-9841-1a17ad7102f3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:42.685995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fc6a7-f14f-4834-ae8c-fe5dbb30586a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:42.702207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:42.703106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:42.703421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:42.703689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] PATH_INFO: `/v3/users/4e6ee1ead7f847188e986f468c2fd515` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:42.710731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6ee1ead7f847188e986f468c2fd515)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:42.716895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72e76e-dc5a-4ee0-87c6-c133cbf6f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:42.718228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:42.718846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72e76e-dc5a-4ee0-87c6-c133cbf6f0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:42.719667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72e76e-dc5a-4ee0-87c6-c133cbf6f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:42.720924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72e76e-dc5a-4ee0-87c6-c133cbf6f0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:42.721876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72e76e-dc5a-4ee0-87c6-c133cbf6f0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:42.725136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72e76e-dc5a-4ee0-87c6-c133cbf6f0d8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:42.780767 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1741/3475] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:54:42 2021] POST /identity/v3/projects => generated 389 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:42.781787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72e76e-dc5a-4ee0-87c6-c133cbf6f0d8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:42.824354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6ee1ead7f847188e986f468c2fd515'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:42.842798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6ee1ead7f847188e986f468c2fd515'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:42.843689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6ee1ead7f847188e986f468c2fd515'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:42.861257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6ee1ead7f847188e986f468c2fd515'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:42.894726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6ee1ead7f847188e986f468c2fd515'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:42.905118 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1735/3476] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:42 2021] DELETE /identity/v3/users/4e6ee1ead7f847188e986f468c2fd515 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:42.919375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72e76e-dc5a-4ee0-87c6-c133cbf6f0d8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:42.981452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5bcbb-1f86-489c-be3f-aa98221d51ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:42.982670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5bcbb-1f86-489c-be3f-aa98221d51ef admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:42.983201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5bcbb-1f86-489c-be3f-aa98221d51ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:42.983753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5bcbb-1f86-489c-be3f-aa98221d51ef admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:42.984721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5bcbb-1f86-489c-be3f-aa98221d51ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:42.986918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5bcbb-1f86-489c-be3f-aa98221d51ef admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:43.017347 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1742/3477] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:42 2021] POST /identity/v3/users => generated 301 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:43.022201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:43.024020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:43.055173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cf354-c52e-49b4-9912-36ddb1db02d4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:43.068393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41cc0-abe8-47cb-80f4-2e0e50690284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:43.069330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41cc0-abe8-47cb-80f4-2e0e50690284 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:43.069878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41cc0-abe8-47cb-80f4-2e0e50690284 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:43.070372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41cc0-abe8-47cb-80f4-2e0e50690284 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:43.071713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41cc0-abe8-47cb-80f4-2e0e50690284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:43.077014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41cc0-abe8-47cb-80f4-2e0e50690284 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:43.107296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5bcbb-1f86-489c-be3f-aa98221d51ef admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:43.118862 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1736/3478] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:43 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:43.130915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5bcbb-1f86-489c-be3f-aa98221d51ef admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:43.145512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442487-3074-4660-9fb9-343dd4773119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:43.146366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442487-3074-4660-9fb9-343dd4773119 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:43.146652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442487-3074-4660-9fb9-343dd4773119 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:43.147025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442487-3074-4660-9fb9-343dd4773119 admin admin] PATH_INFO: `/v3/projects/a85cfc14a75e4c43a682f2856111aaf2/users/098b638877f34c648d92b8c10a0fef12/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:43.188051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442487-3074-4660-9fb9-343dd4773119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85cfc14a75e4c43a682f2856111aaf2, user_id=098b638877f34c648d92b8c10a0fef12, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:43.204667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442487-3074-4660-9fb9-343dd4773119 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:43.243869 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1743/3479] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:43 2021] PUT /identity/v3/projects/a85cfc14a75e4c43a682f2856111aaf2/users/098b638877f34c648d92b8c10a0fef12/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:43.245100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41cc0-abe8-47cb-80f4-2e0e50690284 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:43.255884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41cc0-abe8-47cb-80f4-2e0e50690284 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:43.337427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec1b4-5458-425d-8944-a1b30599946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:43.338554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec1b4-5458-425d-8944-a1b30599946b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:43.339087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec1b4-5458-425d-8944-a1b30599946b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:43.339666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec1b4-5458-425d-8944-a1b30599946b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:43.341364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ec1b4-5458-425d-8944-a1b30599946b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:43.343285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ec1b4-5458-425d-8944-a1b30599946b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:43.362030 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1737/3480] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:43 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:43.364704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442487-3074-4660-9fb9-343dd4773119 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:43.385255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442487-3074-4660-9fb9-343dd4773119 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:43.396043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117edf8-357e-40cf-9c55-7a03b81e6138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:43.397066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117edf8-357e-40cf-9c55-7a03b81e6138 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:43.397584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117edf8-357e-40cf-9c55-7a03b81e6138 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:43.398117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117edf8-357e-40cf-9c55-7a03b81e6138 admin admin] PATH_INFO: `/v3/projects/a85cfc14a75e4c43a682f2856111aaf2/users/098b638877f34c648d92b8c10a0fef12/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:43.402842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117edf8-357e-40cf-9c55-7a03b81e6138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85cfc14a75e4c43a682f2856111aaf2, user_id=098b638877f34c648d92b8c10a0fef12, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:43.408227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117edf8-357e-40cf-9c55-7a03b81e6138 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:43.438314 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1744/3481] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:43 2021] PUT /identity/v3/projects/a85cfc14a75e4c43a682f2856111aaf2/users/098b638877f34c648d92b8c10a0fef12/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:43.716965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec1b4-5458-425d-8944-a1b30599946b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:43.723208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-623ec1b4-5458-425d-8944-a1b30599946b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:43.791917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec1b4-5458-425d-8944-a1b30599946b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:44.009350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:44.010775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:44.011349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:44.011876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] PATH_INFO: `/v3/projects/02a153a1f98c4485a95cc1dcdbf0e9a6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:44.013439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a153a1f98c4485a95cc1dcdbf0e9a6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:44.018062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:44.117038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'request_id': 'req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:44.135934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'request_id': 'req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:44.152242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a153a1f98c4485a95cc1dcdbf0e9a6', 'request_id': 'req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:44.176777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] The token cache is being invalidate because project 02a153a1f98c4485a95cc1dcdbf0e9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:54:44.177076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:44.177793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-daf3ff97-e1da-4e1e-b956-7ee4bf109ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:44.180100 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1738/3482] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:43 2021] DELETE /identity/v3/projects/02a153a1f98c4485a95cc1dcdbf0e9a6 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:44.186722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126ede2-364a-4072-9844-71f5aaeb6495 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:44.187037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126ede2-364a-4072-9844-71f5aaeb6495 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:44.187333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126ede2-364a-4072-9844-71f5aaeb6495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:44.227847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3126ede2-364a-4072-9844-71f5aaeb6495 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:44.229389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3126ede2-364a-4072-9844-71f5aaeb6495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:44.381284 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1745/3483] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:44.390312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710eb0d-2db9-4141-9899-3082378fe1bd None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:44.391328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710eb0d-2db9-4141-9899-3082378fe1bd None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:44.391328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710eb0d-2db9-4141-9899-3082378fe1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:44.432907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1710eb0d-2db9-4141-9899-3082378fe1bd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:44.436676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1710eb0d-2db9-4141-9899-3082378fe1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:44.458966 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1739/3484] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:44.459979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126ede2-364a-4072-9844-71f5aaeb6495 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:44.474027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126ede2-364a-4072-9844-71f5aaeb6495 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:44.492778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f27be-d125-44fd-a825-f49ec484906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:44.493717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f27be-d125-44fd-a825-f49ec484906a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:44.494175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f27be-d125-44fd-a825-f49ec484906a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:44.494632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f27be-d125-44fd-a825-f49ec484906a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:44.495847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f27be-d125-44fd-a825-f49ec484906a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:54:44.498941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f27be-d125-44fd-a825-f49ec484906a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:44.501209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f27be-d125-44fd-a825-f49ec484906a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:44.560655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710eb0d-2db9-4141-9899-3082378fe1bd None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:44.566875 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1746/3485] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:54:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:54:44.573413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710eb0d-2db9-4141-9899-3082378fe1bd None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:44.605630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0e36-8af3-4229-a0f8-26a7791707ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:44.606531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0e36-8af3-4229-a0f8-26a7791707ee admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:44.606887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0e36-8af3-4229-a0f8-26a7791707ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:44.607234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f0e36-8af3-4229-a0f8-26a7791707ee admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:44.608093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f0e36-8af3-4229-a0f8-26a7791707ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:44.613279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f0e36-8af3-4229-a0f8-26a7791707ee admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:44.681036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f27be-d125-44fd-a825-f49ec484906a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:44.682574 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1740/3486] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:54:44 2021] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:44.700350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f27be-d125-44fd-a825-f49ec484906a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:44.865325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5392a65-e857-452d-9d31-5de287ad1d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:44.866456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392a65-e857-452d-9d31-5de287ad1d12 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:44.866978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392a65-e857-452d-9d31-5de287ad1d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:44.867511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392a65-e857-452d-9d31-5de287ad1d12 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:44.868473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5392a65-e857-452d-9d31-5de287ad1d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:44.870925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5392a65-e857-452d-9d31-5de287ad1d12 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:44.918422 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1747/3487] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:44 2021] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:54:44.923489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0e36-8af3-4229-a0f8-26a7791707ee admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:44.947819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f0e36-8af3-4229-a0f8-26a7791707ee admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:44.962587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142abdfb-0d49-4f44-bd67-a8bbd2159096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:44.963774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142abdfb-0d49-4f44-bd67-a8bbd2159096 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:44.964322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142abdfb-0d49-4f44-bd67-a8bbd2159096 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:44.964900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142abdfb-0d49-4f44-bd67-a8bbd2159096 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:44.966164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142abdfb-0d49-4f44-bd67-a8bbd2159096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:44.968365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142abdfb-0d49-4f44-bd67-a8bbd2159096 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:45.010294 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1741/3488] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:44 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:45.013662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5392a65-e857-452d-9d31-5de287ad1d12 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:45.027741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5392a65-e857-452d-9d31-5de287ad1d12 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:45.046699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186136f7-2108-4d4a-a4e8-671c402ebc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:45.048001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186136f7-2108-4d4a-a4e8-671c402ebc13 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:45.048535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186136f7-2108-4d4a-a4e8-671c402ebc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:45.049042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186136f7-2108-4d4a-a4e8-671c402ebc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:45.050281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186136f7-2108-4d4a-a4e8-671c402ebc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:45.052716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186136f7-2108-4d4a-a4e8-671c402ebc13 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:45.079066 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1748/3489] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:45 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:45.082905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142abdfb-0d49-4f44-bd67-a8bbd2159096 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:45.100959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142abdfb-0d49-4f44-bd67-a8bbd2159096 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:45.116292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8bb59-5dae-4e9d-8558-00974a377644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:45.117639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8bb59-5dae-4e9d-8558-00974a377644 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:45.118024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8bb59-5dae-4e9d-8558-00974a377644 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:45.118574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8bb59-5dae-4e9d-8558-00974a377644 admin admin] PATH_INFO: `/v3/projects/a9322e3d42b849ffba3baf70a3e95bef/users/aeb2a65b1d2a4ed8ac0e00de0f9acc19/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:45.152637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8bb59-5dae-4e9d-8558-00974a377644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9322e3d42b849ffba3baf70a3e95bef, user_id=aeb2a65b1d2a4ed8ac0e00de0f9acc19, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:45.155986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8bb59-5dae-4e9d-8558-00974a377644 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:45.188152 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1742/3490] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:45 2021] PUT /identity/v3/projects/a9322e3d42b849ffba3baf70a3e95bef/users/aeb2a65b1d2a4ed8ac0e00de0f9acc19/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:54:45.199175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dde39-15f2-4903-94cd-2ab0c19d7d80 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:45.199634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dde39-15f2-4903-94cd-2ab0c19d7d80 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:45.200142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dde39-15f2-4903-94cd-2ab0c19d7d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:45.260166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-381dde39-15f2-4903-94cd-2ab0c19d7d80 None None] MFA Rules not processed for user `aeb2a65b1d2a4ed8ac0e00de0f9acc19`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:45.264061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-381dde39-15f2-4903-94cd-2ab0c19d7d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:45.386008 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1749/3491] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:45 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:45.391467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8bb59-5dae-4e9d-8558-00974a377644 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:45.513366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8bb59-5dae-4e9d-8558-00974a377644 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:45.531434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e645cb-047d-45c2-ae5c-d4f878d2636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:45.532571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e645cb-047d-45c2-ae5c-d4f878d2636a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:45.533484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e645cb-047d-45c2-ae5c-d4f878d2636a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:45.534005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e645cb-047d-45c2-ae5c-d4f878d2636a admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:45.534993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e645cb-047d-45c2-ae5c-d4f878d2636a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:45.539065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e645cb-047d-45c2-ae5c-d4f878d2636a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:45.603053 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1743/3492] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:54:45 2021] POST /identity/v3/projects => generated 367 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:45.604181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dde39-15f2-4903-94cd-2ab0c19d7d80 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:45.623074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dde39-15f2-4903-94cd-2ab0c19d7d80 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:45.769140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e465d-ee03-4dd2-a8e1-54ba1cd70d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:45.770858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e465d-ee03-4dd2-a8e1-54ba1cd70d6d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:45.771575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e465d-ee03-4dd2-a8e1-54ba1cd70d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:45.772220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e465d-ee03-4dd2-a8e1-54ba1cd70d6d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:45.773156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e465d-ee03-4dd2-a8e1-54ba1cd70d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:45.775370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e465d-ee03-4dd2-a8e1-54ba1cd70d6d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:45.817921 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1750/3493] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:45 2021] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:45.824566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e645cb-047d-45c2-ae5c-d4f878d2636a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:45.857078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e645cb-047d-45c2-ae5c-d4f878d2636a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:45.866693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148c2cd-2eba-4f70-899b-0e793ad4735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:45.870264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148c2cd-2eba-4f70-899b-0e793ad4735f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:45.871020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148c2cd-2eba-4f70-899b-0e793ad4735f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:45.874485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148c2cd-2eba-4f70-899b-0e793ad4735f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:45.875577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148c2cd-2eba-4f70-899b-0e793ad4735f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:45.878034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148c2cd-2eba-4f70-899b-0e793ad4735f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:45.909866 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1744/3494] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:45 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:45.911132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e465d-ee03-4dd2-a8e1-54ba1cd70d6d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:45.930550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e465d-ee03-4dd2-a8e1-54ba1cd70d6d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:45.954303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4de61-87d6-4450-b3f6-f84a9b489f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:45.956644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4de61-87d6-4450-b3f6-f84a9b489f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:45.957459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4de61-87d6-4450-b3f6-f84a9b489f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:45.957978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4de61-87d6-4450-b3f6-f84a9b489f74 admin admin] PATH_INFO: `/v3/projects/863bd12a0bd843ff93d98775ee6f780f/users/987bde8a900848779a25a9aeb8976134/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:45.992880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4de61-87d6-4450-b3f6-f84a9b489f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863bd12a0bd843ff93d98775ee6f780f, user_id=987bde8a900848779a25a9aeb8976134, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:46.001375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4de61-87d6-4450-b3f6-f84a9b489f74 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:46.044371 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1751/3495] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:45 2021] PUT /identity/v3/projects/863bd12a0bd843ff93d98775ee6f780f/users/987bde8a900848779a25a9aeb8976134/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:46.048112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148c2cd-2eba-4f70-899b-0e793ad4735f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:46.063226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148c2cd-2eba-4f70-899b-0e793ad4735f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:46.195714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8debaa9-2191-42ac-8855-83a788092fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:46.196380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8debaa9-2191-42ac-8855-83a788092fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:46.196906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8debaa9-2191-42ac-8855-83a788092fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:46.197194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8debaa9-2191-42ac-8855-83a788092fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:46.198150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8debaa9-2191-42ac-8855-83a788092fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:46.199777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8debaa9-2191-42ac-8855-83a788092fc7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:46.227418 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1745/3496] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:46 2021] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:46.228584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4de61-87d6-4450-b3f6-f84a9b489f74 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:46.245128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4de61-87d6-4450-b3f6-f84a9b489f74 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:46.268453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805be0-5e4e-474d-9392-1c143ba4dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:46.269460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805be0-5e4e-474d-9392-1c143ba4dde8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:46.269742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805be0-5e4e-474d-9392-1c143ba4dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:46.270056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6805be0-5e4e-474d-9392-1c143ba4dde8 admin admin] PATH_INFO: `/v3/projects/863bd12a0bd843ff93d98775ee6f780f/users/987bde8a900848779a25a9aeb8976134/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:46.274304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6805be0-5e4e-474d-9392-1c143ba4dde8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863bd12a0bd843ff93d98775ee6f780f, user_id=987bde8a900848779a25a9aeb8976134, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:46.280946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6805be0-5e4e-474d-9392-1c143ba4dde8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:46.319543 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1752/3497] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:46 2021] PUT /identity/v3/projects/863bd12a0bd843ff93d98775ee6f780f/users/987bde8a900848779a25a9aeb8976134/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:54:46.333246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478abaf-50ca-4819-a504-300212f1ce5f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:46.333604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478abaf-50ca-4819-a504-300212f1ce5f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:46.333841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478abaf-50ca-4819-a504-300212f1ce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:46.394862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7478abaf-50ca-4819-a504-300212f1ce5f None None] MFA Rules not processed for user `987bde8a900848779a25a9aeb8976134`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:46.396172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7478abaf-50ca-4819-a504-300212f1ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:46.605500 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1746/3498] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:46 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:46.608592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805be0-5e4e-474d-9392-1c143ba4dde8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:46.625068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6805be0-5e4e-474d-9392-1c143ba4dde8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:46.655504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e1bfc-3171-4892-a2e3-5e10f63aef68 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:46.656380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e1bfc-3171-4892-a2e3-5e10f63aef68 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:46.656671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e1bfc-3171-4892-a2e3-5e10f63aef68 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:46.659422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e1bfc-3171-4892-a2e3-5e10f63aef68 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:46.660239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e1bfc-3171-4892-a2e3-5e10f63aef68 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:46.661282 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-357e1bfc-3171-4892-a2e3-5e10f63aef68 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:46.661282 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:54:46.661282 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:54:46.675636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e1bfc-3171-4892-a2e3-5e10f63aef68 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:46.723142 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1753/3499] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:54:46 2021] POST /identity/v3/domains => generated 276 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:46.728018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478abaf-50ca-4819-a504-300212f1ce5f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:46.746627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478abaf-50ca-4819-a504-300212f1ce5f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:46.946942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc9cf3-625c-4cc6-b009-0468c951ba7e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:46.948574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc9cf3-625c-4cc6-b009-0468c951ba7e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:46.949610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc9cf3-625c-4cc6-b009-0468c951ba7e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:46.949998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc9cf3-625c-4cc6-b009-0468c951ba7e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:46.954430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc9cf3-625c-4cc6-b009-0468c951ba7e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:46.956995 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-44fc9cf3-625c-4cc6-b009-0468c951ba7e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:46.956995 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:54:46.956995 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:54:46.958656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc9cf3-625c-4cc6-b009-0468c951ba7e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:47.005364 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1747/3500] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:46 2021] POST /identity/v3/groups => generated 280 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:54:47.010579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e1bfc-3171-4892-a2e3-5e10f63aef68 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:47.036616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e1bfc-3171-4892-a2e3-5e10f63aef68 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:47.051555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c920f7-3db3-4cb5-a116-3227d1108288 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:47.052581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c920f7-3db3-4cb5-a116-3227d1108288 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:47.052969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c920f7-3db3-4cb5-a116-3227d1108288 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:47.054946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c920f7-3db3-4cb5-a116-3227d1108288 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/df390545d13644dea0fa0e2d8381b7bf` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:47.074279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c920f7-3db3-4cb5-a116-3227d1108288 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:update_group(group_id=df390545d13644dea0fa0e2d8381b7bf)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:47.084446 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-72c920f7-3db3-4cb5-a116-3227d1108288 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:47.084446 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:54:47.084446 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:54:47.085695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c920f7-3db3-4cb5-a116-3227d1108288 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:47.120024 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1754/3501] 10.222.0.21 () {60 vars in 1246 bytes} [Sat Nov 27 20:54:47 2021] PATCH /identity/v3/groups/df390545d13644dea0fa0e2d8381b7bf => generated 293 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:54:47.124797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc9cf3-625c-4cc6-b009-0468c951ba7e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:47.144396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc9cf3-625c-4cc6-b009-0468c951ba7e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:47.157433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a6a40-bf01-498a-abd3-0e591a0aa6c4 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:47.159626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6a40-bf01-498a-abd3-0e591a0aa6c4 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:47.159626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6a40-bf01-498a-abd3-0e591a0aa6c4 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:47.159626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6a40-bf01-498a-abd3-0e591a0aa6c4 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/df390545d13644dea0fa0e2d8381b7bf` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:47.175505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a6a40-bf01-498a-abd3-0e591a0aa6c4 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:get_group(group_id=df390545d13644dea0fa0e2d8381b7bf)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:47.175505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a6a40-bf01-498a-abd3-0e591a0aa6c4 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:47.183231 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1748/3502] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:47 2021] GET /identity/v3/groups/df390545d13644dea0fa0e2d8381b7bf => generated 293 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:54:47.183415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c920f7-3db3-4cb5-a116-3227d1108288 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:47.203958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c920f7-3db3-4cb5-a116-3227d1108288 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:47.219986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d559d1-6257-469b-b37b-6104621f5470 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:47.221400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d559d1-6257-469b-b37b-6104621f5470 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:47.221940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d559d1-6257-469b-b37b-6104621f5470 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:47.222432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d559d1-6257-469b-b37b-6104621f5470 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/df390545d13644dea0fa0e2d8381b7bf` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:47.227348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d559d1-6257-469b-b37b-6104621f5470 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:update_group(group_id=df390545d13644dea0fa0e2d8381b7bf)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:47.229998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d559d1-6257-469b-b37b-6104621f5470 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:47.277018 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1755/3503] 10.222.0.21 () {60 vars in 1245 bytes} [Sat Nov 27 20:54:47 2021] PATCH /identity/v3/groups/df390545d13644dea0fa0e2d8381b7bf => generated 309 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:54:47.278811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a6a40-bf01-498a-abd3-0e591a0aa6c4 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:47.299554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a6a40-bf01-498a-abd3-0e591a0aa6c4 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:47.316616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2f88-9f16-430b-b482-826db46d2eaf tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:47.320950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2f88-9f16-430b-b482-826db46d2eaf tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:47.322630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2f88-9f16-430b-b482-826db46d2eaf tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:47.325132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2f88-9f16-430b-b482-826db46d2eaf tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/df390545d13644dea0fa0e2d8381b7bf` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:47.360774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e2f88-9f16-430b-b482-826db46d2eaf tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_group(group_id=df390545d13644dea0fa0e2d8381b7bf)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:47.361816 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-215e2f88-9f16-430b-b482-826db46d2eaf tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:47.361816 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:54:47.361816 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:54:47.363357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e2f88-9f16-430b-b482-826db46d2eaf tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:47.570216 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1749/3504] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:54:47 2021] DELETE /identity/v3/groups/df390545d13644dea0fa0e2d8381b7bf => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:47.574841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d559d1-6257-469b-b37b-6104621f5470 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:47.594164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d559d1-6257-469b-b37b-6104621f5470 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:47.708904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2f88-9f16-430b-b482-826db46d2eaf tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:47.710902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-215e2f88-9f16-430b-b482-826db46d2eaf tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:47.763676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e6c68-d8fa-42a7-80a9-5f662d0ce31e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:47.769387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e6c68-d8fa-42a7-80a9-5f662d0ce31e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:47.769961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e6c68-d8fa-42a7-80a9-5f662d0ce31e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:47.770428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e6c68-d8fa-42a7-80a9-5f662d0ce31e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:47.771394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e6c68-d8fa-42a7-80a9-5f662d0ce31e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:47.773547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e6c68-d8fa-42a7-80a9-5f662d0ce31e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:47.803084 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1756/3505] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:47 2021] POST /identity/v3/groups => generated 326 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:47.808187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e6c68-d8fa-42a7-80a9-5f662d0ce31e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:47.838918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e6c68-d8fa-42a7-80a9-5f662d0ce31e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:47.856539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eaba7-9f83-46ff-ae06-c64faeb27181 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:47.857232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eaba7-9f83-46ff-ae06-c64faeb27181 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:47.857518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eaba7-9f83-46ff-ae06-c64faeb27181 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:47.857804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eaba7-9f83-46ff-ae06-c64faeb27181 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:47.865651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eaba7-9f83-46ff-ae06-c64faeb27181 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:47.867725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eaba7-9f83-46ff-ae06-c64faeb27181 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:47.897887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2f88-9f16-430b-b482-826db46d2eaf tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:47.913486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b84ec-644a-42d9-ae21-7d76077ae34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:47.914492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b84ec-644a-42d9-ae21-7d76077ae34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:47.914883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b84ec-644a-42d9-ae21-7d76077ae34d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:47.915287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b84ec-644a-42d9-ae21-7d76077ae34d admin admin] PATH_INFO: `/v3/users/8d611499f56e463ab23fc7c1ee2b382e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:47.921106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b84ec-644a-42d9-ae21-7d76077ae34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d611499f56e463ab23fc7c1ee2b382e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:47.923242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b84ec-644a-42d9-ae21-7d76077ae34d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:48.011771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d0b84ec-644a-42d9-ae21-7d76077ae34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d611499f56e463ab23fc7c1ee2b382e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:48.017841 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1757/3506] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:47 2021] POST /identity/v3/users => generated 321 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:54:48.022777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eaba7-9f83-46ff-ae06-c64faeb27181 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:48.030964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d0b84ec-644a-42d9-ae21-7d76077ae34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d611499f56e463ab23fc7c1ee2b382e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:48.031697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d0b84ec-644a-42d9-ae21-7d76077ae34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d611499f56e463ab23fc7c1ee2b382e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:48.044469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d0b84ec-644a-42d9-ae21-7d76077ae34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d611499f56e463ab23fc7c1ee2b382e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:48.068144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eaba7-9f83-46ff-ae06-c64faeb27181 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:48.075574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d0b84ec-644a-42d9-ae21-7d76077ae34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d611499f56e463ab23fc7c1ee2b382e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:48.085981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1245bd1-d28e-4647-8a49-78824ec92079 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:48.088971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245bd1-d28e-4647-8a49-78824ec92079 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:48.090664 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1750/3507] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:47 2021] DELETE /identity/v3/users/8d611499f56e463ab23fc7c1ee2b382e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:48.091215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245bd1-d28e-4647-8a49-78824ec92079 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:48.091785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1245bd1-d28e-4647-8a49-78824ec92079 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/2ad0f0ce7fb1468eaf1e43098db5c0f9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:48.094936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf210a31-92af-4f31-b1b3-319e0a13da16 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:48.095233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf210a31-92af-4f31-b1b3-319e0a13da16 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:48.095547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf210a31-92af-4f31-b1b3-319e0a13da16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:48.137060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bf210a31-92af-4f31-b1b3-319e0a13da16 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:48.138895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bf210a31-92af-4f31-b1b3-319e0a13da16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:48.149174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1245bd1-d28e-4647-8a49-78824ec92079 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8d318518aab94356ad0ccb5c29562a11, user_id=2ad0f0ce7fb1468eaf1e43098db5c0f9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:48.150471 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-d1245bd1-d28e-4647-8a49-78824ec92079 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:add_user_to_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:48.150471 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:54:48.150471 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:54:48.152096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1245bd1-d28e-4647-8a49-78824ec92079 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:48.215793 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1758/3508] 10.222.0.21 () {60 vars in 1359 bytes} [Sat Nov 27 20:54:48 2021] PUT /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/2ad0f0ce7fb1468eaf1e43098db5c0f9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:48.218562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c5ad-607e-4e75-86c6-e0d90130354f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:48.219054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c5ad-607e-4e75-86c6-e0d90130354f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:48.219526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c5ad-607e-4e75-86c6-e0d90130354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:48.246562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9bf5c5ad-607e-4e75-86c6-e0d90130354f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:48.250752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9bf5c5ad-607e-4e75-86c6-e0d90130354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:48.270356 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1751/3509] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:54:48 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:48.271301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf210a31-92af-4f31-b1b3-319e0a13da16 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:48.278293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bf210a31-92af-4f31-b1b3-319e0a13da16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:48.360939 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1759/3510] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:48.370334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c5ad-607e-4e75-86c6-e0d90130354f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:48.377028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9bf5c5ad-607e-4e75-86c6-e0d90130354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:48.483978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c5ad-607e-4e75-86c6-e0d90130354f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:48.491219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157c465-fbe0-43dd-a7c8-c2e317eaa9c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:48.492313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157c465-fbe0-43dd-a7c8-c2e317eaa9c8 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:48.492783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157c465-fbe0-43dd-a7c8-c2e317eaa9c8 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:48.493252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157c465-fbe0-43dd-a7c8-c2e317eaa9c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:48.511731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf210a31-92af-4f31-b1b3-319e0a13da16 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:48.581900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157c465-fbe0-43dd-a7c8-c2e317eaa9c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:48.583500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157c465-fbe0-43dd-a7c8-c2e317eaa9c8 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:48.595605 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1760/3511] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:54:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:54:48.596556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157c465-fbe0-43dd-a7c8-c2e317eaa9c8 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:48.597970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f157c465-fbe0-43dd-a7c8-c2e317eaa9c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:48.715169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d56e7c-7be5-44fd-823f-fe529e0b1ce8 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:48.715939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d56e7c-7be5-44fd-823f-fe529e0b1ce8 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:48.716225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d56e7c-7be5-44fd-823f-fe529e0b1ce8 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:48.716504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d56e7c-7be5-44fd-823f-fe529e0b1ce8 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:48.721543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d56e7c-7be5-44fd-823f-fe529e0b1ce8 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:48.728914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d56e7c-7be5-44fd-823f-fe529e0b1ce8 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:48.735751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157c465-fbe0-43dd-a7c8-c2e317eaa9c8 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:48.751288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f874bf-2a45-49bc-b2b5-01907e619d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:48.751879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f874bf-2a45-49bc-b2b5-01907e619d9b service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:48.752067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f874bf-2a45-49bc-b2b5-01907e619d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:48.752774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f874bf-2a45-49bc-b2b5-01907e619d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:48.774290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f874bf-2a45-49bc-b2b5-01907e619d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:48.775977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f874bf-2a45-49bc-b2b5-01907e619d9b service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:48.799439 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1761/3512] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:54:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:54:48.831978 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1752/3513] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:48 2021] POST /identity/v3/users => generated 321 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:48.832949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f874bf-2a45-49bc-b2b5-01907e619d9b service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:48.880099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f874bf-2a45-49bc-b2b5-01907e619d9b service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:48.898729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0c4a7-b5d1-4c82-a138-0a9c41c01a3c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:48.902609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0c4a7-b5d1-4c82-a138-0a9c41c01a3c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:48.902940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0c4a7-b5d1-4c82-a138-0a9c41c01a3c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:48.903786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0c4a7-b5d1-4c82-a138-0a9c41c01a3c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/858ba9a5dc7d4393a6932a09a9682861` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:48.958820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0c4a7-b5d1-4c82-a138-0a9c41c01a3c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8d318518aab94356ad0ccb5c29562a11, user_id=858ba9a5dc7d4393a6932a09a9682861)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:48.962145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0c4a7-b5d1-4c82-a138-0a9c41c01a3c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:49.040231 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1762/3514] 10.222.0.21 () {60 vars in 1359 bytes} [Sat Nov 27 20:54:48 2021] PUT /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/858ba9a5dc7d4393a6932a09a9682861 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:49.044988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d56e7c-7be5-44fd-823f-fe529e0b1ce8 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:49.066895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d56e7c-7be5-44fd-823f-fe529e0b1ce8 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:49.303489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26bae-280e-4a05-8926-c5341c4e3041 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:49.318282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26bae-280e-4a05-8926-c5341c4e3041 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:49.318777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26bae-280e-4a05-8926-c5341c4e3041 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:49.319173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26bae-280e-4a05-8926-c5341c4e3041 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:49.320351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c26bae-280e-4a05-8926-c5341c4e3041 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:49.322992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c26bae-280e-4a05-8926-c5341c4e3041 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:49.330633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0c4a7-b5d1-4c82-a138-0a9c41c01a3c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:49.331975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c8f0c4a7-b5d1-4c82-a138-0a9c41c01a3c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:49.424946 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1753/3515] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:49 2021] POST /identity/v3/users => generated 321 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:49.436356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26bae-280e-4a05-8926-c5341c4e3041 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:49.468168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26bae-280e-4a05-8926-c5341c4e3041 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:49.494704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb90d4-0fc3-43be-95ff-3472f90d2c2b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:49.496229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb90d4-0fc3-43be-95ff-3472f90d2c2b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:49.496747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb90d4-0fc3-43be-95ff-3472f90d2c2b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:49.499488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb90d4-0fc3-43be-95ff-3472f90d2c2b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/0c256e7ec190466aaa46ff26e27efc13` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:49.581727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb90d4-0fc3-43be-95ff-3472f90d2c2b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8d318518aab94356ad0ccb5c29562a11, user_id=0c256e7ec190466aaa46ff26e27efc13)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:49.588935 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-7dfb90d4-0fc3-43be-95ff-3472f90d2c2b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:add_user_to_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:49.588935 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:54:49.588935 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:54:49.590665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb90d4-0fc3-43be-95ff-3472f90d2c2b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:49.597626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0c4a7-b5d1-4c82-a138-0a9c41c01a3c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:49.646257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:49.648352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:49.651526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:49.653253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] PATH_INFO: `/v3/projects/812b97d174d84cdbb78bd4064909234f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:49.656711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=812b97d174d84cdbb78bd4064909234f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:49.667275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:49.680006 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1754/3516] 10.222.0.21 () {60 vars in 1359 bytes} [Sat Nov 27 20:54:49 2021] PUT /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/0c256e7ec190466aaa46ff26e27efc13 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:49.681683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb90d4-0fc3-43be-95ff-3472f90d2c2b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:49.875289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812b97d174d84cdbb78bd4064909234f', 'request_id': 'req-1fdd674a-afd6-46dc-9dfc-7952adf4c806'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:49.894526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb90d4-0fc3-43be-95ff-3472f90d2c2b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:49.907756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812b97d174d84cdbb78bd4064909234f', 'request_id': 'req-1fdd674a-afd6-46dc-9dfc-7952adf4c806'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:49.918172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812b97d174d84cdbb78bd4064909234f', 'request_id': 'req-1fdd674a-afd6-46dc-9dfc-7952adf4c806'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:49.944469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] The token cache is being invalidate because project 812b97d174d84cdbb78bd4064909234f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:54:49.946288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:49.947652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:49.953389 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1763/3517] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:49 2021] DELETE /identity/v3/projects/812b97d174d84cdbb78bd4064909234f => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:49.958838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:49.975520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:50.010344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae8124-b0f2-465b-bec5-d82235fff165 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:50.012870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8124-b0f2-465b-bec5-d82235fff165 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:50.015371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8124-b0f2-465b-bec5-d82235fff165 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:50.019193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae8124-b0f2-465b-bec5-d82235fff165 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:50.021133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae8124-b0f2-465b-bec5-d82235fff165 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=8d318518aab94356ad0ccb5c29562a11)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:50.022373 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-13ae8124-b0f2-465b-bec5-d82235fff165 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users_in_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:50.022373 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:54:50.022373 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:54:50.026267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae8124-b0f2-465b-bec5-d82235fff165 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:50.103504 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1755/3518] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 20:54:49 2021] GET /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11/users => generated 1079 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:50.105115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf30be-39d8-40d8-a501-466bcd4156be None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:50.105394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf30be-39d8-40d8-a501-466bcd4156be None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:50.105680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf30be-39d8-40d8-a501-466bcd4156be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:50.148337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-24cf30be-39d8-40d8-a501-466bcd4156be None None] MFA Rules not processed for user `b8a8aa467b0a42459f18f6bd4ee623e4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:50.149900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-24cf30be-39d8-40d8-a501-466bcd4156be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:50.191680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd674a-afd6-46dc-9dfc-7952adf4c806 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:50.214665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:50.216592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:50.219279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:50.221949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] PATH_INFO: `/v3/users/682a2105fe2f4d96b5ad4cd8ed43de6f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:50.228114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=682a2105fe2f4d96b5ad4cd8ed43de6f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:50.230482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:50.290528 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1756/3519] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:50 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:50.293994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf30be-39d8-40d8-a501-466bcd4156be None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:50.304383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-24cf30be-39d8-40d8-a501-466bcd4156be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:50.336662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf30be-39d8-40d8-a501-466bcd4156be None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:50.367911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ac0e5-9a30-4293-8a6b-ac9d2aed8cc6 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:50.374266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ac0e5-9a30-4293-8a6b-ac9d2aed8cc6 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:50.374853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ac0e5-9a30-4293-8a6b-ac9d2aed8cc6 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:50.375367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ac0e5-9a30-4293-8a6b-ac9d2aed8cc6 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/2ad0f0ce7fb1468eaf1e43098db5c0f9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:50.379089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ac0e5-9a30-4293-8a6b-ac9d2aed8cc6 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=8d318518aab94356ad0ccb5c29562a11, user_id=2ad0f0ce7fb1468eaf1e43098db5c0f9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:50.381341 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-fa9ac0e5-9a30-4293-8a6b-ac9d2aed8cc6 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_user_in_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:50.381341 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:54:50.381341 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:54:50.384888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ac0e5-9a30-4293-8a6b-ac9d2aed8cc6 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:50.430485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682a2105fe2f4d96b5ad4cd8ed43de6f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:50.431798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682a2105fe2f4d96b5ad4cd8ed43de6f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:50.446761 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1757/3520] 10.222.0.21 () {58 vars in 1341 bytes} [Sat Nov 27 20:54:50 2021] HEAD /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/2ad0f0ce7fb1468eaf1e43098db5c0f9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:50.449323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ac0e5-9a30-4293-8a6b-ac9d2aed8cc6 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:50.452118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682a2105fe2f4d96b5ad4cd8ed43de6f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:50.453232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682a2105fe2f4d96b5ad4cd8ed43de6f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:50.457674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fa9ac0e5-9a30-4293-8a6b-ac9d2aed8cc6 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:50.507576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682a2105fe2f4d96b5ad4cd8ed43de6f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:50.549177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ac0e5-9a30-4293-8a6b-ac9d2aed8cc6 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:50.578661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55884c-1b92-4e82-8183-ce0aba84521d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:50.579616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55884c-1b92-4e82-8183-ce0aba84521d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:50.579903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55884c-1b92-4e82-8183-ce0aba84521d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:50.580181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55884c-1b92-4e82-8183-ce0aba84521d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/2ad0f0ce7fb1468eaf1e43098db5c0f9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:50.590135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55884c-1b92-4e82-8183-ce0aba84521d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8d318518aab94356ad0ccb5c29562a11, user_id=2ad0f0ce7fb1468eaf1e43098db5c0f9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:50.591213 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-4f55884c-1b92-4e82-8183-ce0aba84521d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:remove_user_from_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:50.591213 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:54:50.591213 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:54:50.595051 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1764/3521] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:49 2021] DELETE /identity/v3/users/682a2105fe2f4d96b5ad4cd8ed43de6f => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:50.601003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55884c-1b92-4e82-8183-ce0aba84521d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:50.669557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4f55884c-1b92-4e82-8183-ce0aba84521d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2ad0f0ce7fb1468eaf1e43098db5c0f9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:50.709947 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1758/3522] 10.222.0.21 () {58 vars in 1343 bytes} [Sat Nov 27 20:54:50 2021] DELETE /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/2ad0f0ce7fb1468eaf1e43098db5c0f9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:50.713717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:51.026831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362ad3c-4fce-4ce9-9ad9-e46fcb4f4bf5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:51.226040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461fdee-af92-4654-a5c5-84ee3105887e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:51.227925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461fdee-af92-4654-a5c5-84ee3105887e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:51.232216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461fdee-af92-4654-a5c5-84ee3105887e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:51.232598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461fdee-af92-4654-a5c5-84ee3105887e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/858ba9a5dc7d4393a6932a09a9682861` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:51.235745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461fdee-af92-4654-a5c5-84ee3105887e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=8d318518aab94356ad0ccb5c29562a11, user_id=858ba9a5dc7d4393a6932a09a9682861)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:51.239694 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-6461fdee-af92-4654-a5c5-84ee3105887e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_user_in_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:51.239694 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:54:51.239694 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:54:51.241048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461fdee-af92-4654-a5c5-84ee3105887e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:51.297727 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1765/3523] 10.222.0.21 () {58 vars in 1341 bytes} [Sat Nov 27 20:54:50 2021] HEAD /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/858ba9a5dc7d4393a6932a09a9682861 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:51.301489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55884c-1b92-4e82-8183-ce0aba84521d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:51.317261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55884c-1b92-4e82-8183-ce0aba84521d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:51.332959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ddf91-2c5e-47dc-b647-573e47bfe062 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:51.333871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ddf91-2c5e-47dc-b647-573e47bfe062 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:51.334162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ddf91-2c5e-47dc-b647-573e47bfe062 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:51.334438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ddf91-2c5e-47dc-b647-573e47bfe062 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/858ba9a5dc7d4393a6932a09a9682861` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:51.336261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ddf91-2c5e-47dc-b647-573e47bfe062 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8d318518aab94356ad0ccb5c29562a11, user_id=858ba9a5dc7d4393a6932a09a9682861)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:51.338262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ddf91-2c5e-47dc-b647-573e47bfe062 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:51.364571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c89ddf91-2c5e-47dc-b647-573e47bfe062 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '858ba9a5dc7d4393a6932a09a9682861'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:51.388819 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1759/3524] 10.222.0.21 () {58 vars in 1343 bytes} [Sat Nov 27 20:54:51 2021] DELETE /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/858ba9a5dc7d4393a6932a09a9682861 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:51.392672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461fdee-af92-4654-a5c5-84ee3105887e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:51.403228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461fdee-af92-4654-a5c5-84ee3105887e tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:51.570282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be396076-b50e-46b2-9f26-65fae76b368b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:51.571297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be396076-b50e-46b2-9f26-65fae76b368b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:51.571659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be396076-b50e-46b2-9f26-65fae76b368b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:51.572009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be396076-b50e-46b2-9f26-65fae76b368b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/0c256e7ec190466aaa46ff26e27efc13` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:51.582336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be396076-b50e-46b2-9f26-65fae76b368b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=8d318518aab94356ad0ccb5c29562a11, user_id=0c256e7ec190466aaa46ff26e27efc13)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:51.584558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be396076-b50e-46b2-9f26-65fae76b368b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:51.640422 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1766/3525] 10.222.0.21 () {58 vars in 1341 bytes} [Sat Nov 27 20:54:51 2021] HEAD /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/0c256e7ec190466aaa46ff26e27efc13 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:51.641594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ddf91-2c5e-47dc-b647-573e47bfe062 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:51.660630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ddf91-2c5e-47dc-b647-573e47bfe062 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:51.675428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c942f03-11a8-4e25-8f07-829cc61054c2 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:51.676572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c942f03-11a8-4e25-8f07-829cc61054c2 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:51.676967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c942f03-11a8-4e25-8f07-829cc61054c2 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:51.679745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c942f03-11a8-4e25-8f07-829cc61054c2 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/0c256e7ec190466aaa46ff26e27efc13` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:51.696925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c942f03-11a8-4e25-8f07-829cc61054c2 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8d318518aab94356ad0ccb5c29562a11, user_id=0c256e7ec190466aaa46ff26e27efc13)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:51.699054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c942f03-11a8-4e25-8f07-829cc61054c2 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:51.721955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2c942f03-11a8-4e25-8f07-829cc61054c2 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0c256e7ec190466aaa46ff26e27efc13'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:51.769171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be396076-b50e-46b2-9f26-65fae76b368b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:51.769715 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1760/3526] 10.222.0.21 () {58 vars in 1343 bytes} [Sat Nov 27 20:54:51 2021] DELETE /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11/users/0c256e7ec190466aaa46ff26e27efc13 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:54:51.783614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be396076-b50e-46b2-9f26-65fae76b368b tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:52.068617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e2960-d0bd-485f-b76a-77f4229172a1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:52.070241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e2960-d0bd-485f-b76a-77f4229172a1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:52.070717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e2960-d0bd-485f-b76a-77f4229172a1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:52.071164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e2960-d0bd-485f-b76a-77f4229172a1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:52.080313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e2960-d0bd-485f-b76a-77f4229172a1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=8d318518aab94356ad0ccb5c29562a11)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:52.081686 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-672e2960-d0bd-485f-b76a-77f4229172a1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users_in_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:52.081686 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:54:52.081686 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:54:52.084269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e2960-d0bd-485f-b76a-77f4229172a1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:52.146406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1767/3527] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 20:54:51 2021] GET /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11/users => generated 145 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:54:52.148142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c942f03-11a8-4e25-8f07-829cc61054c2 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:52.156452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e2960-d0bd-485f-b76a-77f4229172a1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:52.163179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-672e2960-d0bd-485f-b76a-77f4229172a1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:52.177872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c942f03-11a8-4e25-8f07-829cc61054c2 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:52.200448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:52.201311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:52.211610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:52.211902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/users/0c256e7ec190466aaa46ff26e27efc13` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:52.220349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0c256e7ec190466aaa46ff26e27efc13)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:52.222518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:52.387142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c256e7ec190466aaa46ff26e27efc13'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:52.406054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e2960-d0bd-485f-b76a-77f4229172a1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:52.416353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c256e7ec190466aaa46ff26e27efc13'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:52.417263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c256e7ec190466aaa46ff26e27efc13'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:52.438989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:52.454482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:52.458753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:52.459269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] PATH_INFO: `/v3/projects/5ca13477af5b42bb80d0dde5919da309` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:52.460932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c256e7ec190466aaa46ff26e27efc13'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:52.461841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca13477af5b42bb80d0dde5919da309)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:52.494289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:52.538071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c256e7ec190466aaa46ff26e27efc13'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:52.571758 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1761/3528] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:52 2021] DELETE /identity/v3/users/0c256e7ec190466aaa46ff26e27efc13 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:52.576432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:52.592892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:52.779662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca13477af5b42bb80d0dde5919da309', 'request_id': 'req-ac087be8-2cae-4855-9f09-e80187731ab4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:52.824303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca13477af5b42bb80d0dde5919da309', 'request_id': 'req-ac087be8-2cae-4855-9f09-e80187731ab4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:52.845606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca13477af5b42bb80d0dde5919da309', 'request_id': 'req-ac087be8-2cae-4855-9f09-e80187731ab4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:52.859025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f7b1-44fc-4569-9f61-681d12094448 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:52.901117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] The token cache is being invalidate because project 5ca13477af5b42bb80d0dde5919da309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:54:52.902501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:52.906618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ac087be8-2cae-4855-9f09-e80187731ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:52.914951 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1768/3529] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:52 2021] DELETE /identity/v3/projects/5ca13477af5b42bb80d0dde5919da309 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:52.925103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06540c12-d1cf-4e54-8175-d184a2f9576e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:52.926099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06540c12-d1cf-4e54-8175-d184a2f9576e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:52.939784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06540c12-d1cf-4e54-8175-d184a2f9576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:53.018804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-06540c12-d1cf-4e54-8175-d184a2f9576e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:53.029907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-06540c12-d1cf-4e54-8175-d184a2f9576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:53.157788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:53.158313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:53.158754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:53.158903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/users/858ba9a5dc7d4393a6932a09a9682861` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:53.165133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_user(user_id=858ba9a5dc7d4393a6932a09a9682861)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:53.180055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:53.281881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858ba9a5dc7d4393a6932a09a9682861'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:53.298587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858ba9a5dc7d4393a6932a09a9682861'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:53.299455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858ba9a5dc7d4393a6932a09a9682861'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:53.311349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858ba9a5dc7d4393a6932a09a9682861'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:53.353842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858ba9a5dc7d4393a6932a09a9682861'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:53.365510 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1769/3530] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:53.373097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e63a8b-d75a-4977-99c0-bd3851fe12d3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:53.376447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e63a8b-d75a-4977-99c0-bd3851fe12d3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:53.377809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e63a8b-d75a-4977-99c0-bd3851fe12d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:53.421258 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1762/3531] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:52 2021] DELETE /identity/v3/users/858ba9a5dc7d4393a6932a09a9682861 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:53.430867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:53.435639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:53.488321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-41e63a8b-d75a-4977-99c0-bd3851fe12d3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:53.496431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-41e63a8b-d75a-4977-99c0-bd3851fe12d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:53.538159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242128b-ebbb-4e3e-8e0b-79bf954017b0 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:53.544174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:53.545335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:53.545803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:53.546245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/users/2ad0f0ce7fb1468eaf1e43098db5c0f9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:53.547742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2ad0f0ce7fb1468eaf1e43098db5c0f9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:53.550050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:53.610867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad0f0ce7fb1468eaf1e43098db5c0f9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:53.625673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad0f0ce7fb1468eaf1e43098db5c0f9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:53.626331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad0f0ce7fb1468eaf1e43098db5c0f9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:53.656130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad0f0ce7fb1468eaf1e43098db5c0f9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:53.711369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad0f0ce7fb1468eaf1e43098db5c0f9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:53.713709 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1770/3532] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:53.715044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e63a8b-d75a-4977-99c0-bd3851fe12d3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:53.727215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e63a8b-d75a-4977-99c0-bd3851fe12d3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:53.737773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19d0c0-11b9-47f2-af31-f16698615055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:53.738829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d0c0-11b9-47f2-af31-f16698615055 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:53.748647 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1763/3533] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:53 2021] DELETE /identity/v3/users/2ad0f0ce7fb1468eaf1e43098db5c0f9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:53.748830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d0c0-11b9-47f2-af31-f16698615055 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:53.748985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d0c0-11b9-47f2-af31-f16698615055 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:53.750049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19d0c0-11b9-47f2-af31-f16698615055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:54:53.750520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19d0c0-11b9-47f2-af31-f16698615055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:53.752666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19d0c0-11b9-47f2-af31-f16698615055 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:53.755341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:53.764409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:53.778481 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1771/3534] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:54:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:54:53.780732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19d0c0-11b9-47f2-af31-f16698615055 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:53.795021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19d0c0-11b9-47f2-af31-f16698615055 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:53.867176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22c086-c3c9-48cc-b1c9-9952f67cb9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:53.868290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22c086-c3c9-48cc-b1c9-9952f67cb9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:53.868738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22c086-c3c9-48cc-b1c9-9952f67cb9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:53.869305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22c086-c3c9-48cc-b1c9-9952f67cb9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:53.870201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22c086-c3c9-48cc-b1c9-9952f67cb9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:53.872951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22c086-c3c9-48cc-b1c9-9952f67cb9b3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:53.915435 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1772/3535] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:54:53 2021] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:53.916760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22c086-c3c9-48cc-b1c9-9952f67cb9b3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:53.960191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d39d6a-f32b-4cd3-b0f0-4d56fd9c3513 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:54.022975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22c086-c3c9-48cc-b1c9-9952f67cb9b3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:54.048927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ec1eb-1175-4c0a-9f5e-2daf005e0d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:54.050212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ec1eb-1175-4c0a-9f5e-2daf005e0d73 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:54.051014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ec1eb-1175-4c0a-9f5e-2daf005e0d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:54.051488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ec1eb-1175-4c0a-9f5e-2daf005e0d73 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:54.052883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ec1eb-1175-4c0a-9f5e-2daf005e0d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:54.055482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ec1eb-1175-4c0a-9f5e-2daf005e0d73 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:54.126259 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1773/3536] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:53 2021] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:54.127881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ec1eb-1175-4c0a-9f5e-2daf005e0d73 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:54.140734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b149e70-f9d1-4be0-aafc-25d6dd754277 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:54.142308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b149e70-f9d1-4be0-aafc-25d6dd754277 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:54.144548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b149e70-f9d1-4be0-aafc-25d6dd754277 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:54.145121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b149e70-f9d1-4be0-aafc-25d6dd754277 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8d318518aab94356ad0ccb5c29562a11` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:54.147633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b149e70-f9d1-4be0-aafc-25d6dd754277 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8d318518aab94356ad0ccb5c29562a11)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:54.147803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ec1eb-1175-4c0a-9f5e-2daf005e0d73 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:54.152792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b149e70-f9d1-4be0-aafc-25d6dd754277 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:54.174709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf53f7-3a9c-4112-a9af-6ec3071eeab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:54.190987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf53f7-3a9c-4112-a9af-6ec3071eeab1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:54.191689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf53f7-3a9c-4112-a9af-6ec3071eeab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:54.192177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf53f7-3a9c-4112-a9af-6ec3071eeab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:54.195819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf53f7-3a9c-4112-a9af-6ec3071eeab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:54.209650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf53f7-3a9c-4112-a9af-6ec3071eeab1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:54.229601 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1764/3537] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:54:53 2021] DELETE /identity/v3/groups/8d318518aab94356ad0ccb5c29562a11 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:54.231819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b149e70-f9d1-4be0-aafc-25d6dd754277 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:54.270279 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1774/3538] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:54 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:54.274517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf53f7-3a9c-4112-a9af-6ec3071eeab1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:54.312257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf53f7-3a9c-4112-a9af-6ec3071eeab1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:54.386185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b149e70-f9d1-4be0-aafc-25d6dd754277 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:54.398617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441a993-c5f9-40b9-bef0-b07b23c1391c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:54.401758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441a993-c5f9-40b9-bef0-b07b23c1391c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:54.402245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441a993-c5f9-40b9-bef0-b07b23c1391c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:54.402723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441a993-c5f9-40b9-bef0-b07b23c1391c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:54.403750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441a993-c5f9-40b9-bef0-b07b23c1391c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:54.420570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441a993-c5f9-40b9-bef0-b07b23c1391c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:54.469869 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1765/3539] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:54 2021] POST /identity/v3/groups => generated 324 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:54.471950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441a993-c5f9-40b9-bef0-b07b23c1391c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:54.521667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441a993-c5f9-40b9-bef0-b07b23c1391c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:54.545628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99002968-8b28-4a59-a060-7717bdae7980 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:54.546367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99002968-8b28-4a59-a060-7717bdae7980 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:54.549458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99002968-8b28-4a59-a060-7717bdae7980 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:54.549873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99002968-8b28-4a59-a060-7717bdae7980 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:54.550677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99002968-8b28-4a59-a060-7717bdae7980 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:54.557038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99002968-8b28-4a59-a060-7717bdae7980 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:54.637657 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1766/3540] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:54 2021] POST /identity/v3/groups => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:54.654360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99002968-8b28-4a59-a060-7717bdae7980 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:54.696678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99002968-8b28-4a59-a060-7717bdae7980 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:54.718521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81eba5d-93c4-4f8b-ae8c-0be4d9ac9667 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:54.719198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eba5d-93c4-4f8b-ae8c-0be4d9ac9667 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:54.719873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1ad85-e40d-4538-951c-8aa3205b1ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:54.720564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1ad85-e40d-4538-951c-8aa3205b1ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:54.720845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1ad85-e40d-4538-951c-8aa3205b1ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:54.723768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1ad85-e40d-4538-951c-8aa3205b1ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:54.724917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eba5d-93c4-4f8b-ae8c-0be4d9ac9667 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:54.725720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eba5d-93c4-4f8b-ae8c-0be4d9ac9667 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:54.728145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81eba5d-93c4-4f8b-ae8c-0be4d9ac9667 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:54.730074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81eba5d-93c4-4f8b-ae8c-0be4d9ac9667 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:54.732349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1ad85-e40d-4538-951c-8aa3205b1ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:54.741684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1ad85-e40d-4538-951c-8aa3205b1ca0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:54.773141 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1767/3541] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:54 2021] POST /identity/v3/groups => generated 327 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:54.774391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81eba5d-93c4-4f8b-ae8c-0be4d9ac9667 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:54.783359 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1775/3542] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:54 2021] GET /identity/v3/roles => generated 1420 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:54.787891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1ad85-e40d-4538-951c-8aa3205b1ca0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:54.792016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81eba5d-93c4-4f8b-ae8c-0be4d9ac9667 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:54.810538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1ad85-e40d-4538-951c-8aa3205b1ca0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:54.817981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df5eb1-64b1-4352-8782-bf1f2a00754c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:54.819361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df5eb1-64b1-4352-8782-bf1f2a00754c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:54.820261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df5eb1-64b1-4352-8782-bf1f2a00754c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:54.821031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df5eb1-64b1-4352-8782-bf1f2a00754c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:54.821358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8f9bd-c2c7-4dec-aa75-4195cf557952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:54.822255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df5eb1-64b1-4352-8782-bf1f2a00754c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:54.823480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f9bd-c2c7-4dec-aa75-4195cf557952 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:54.824015 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-67df5eb1-64b1-4352-8782-bf1f2a00754c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_groups failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:54.824015 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:54:54.824015 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:54:54.824977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f9bd-c2c7-4dec-aa75-4195cf557952 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:54.825561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f9bd-c2c7-4dec-aa75-4195cf557952 admin admin] PATH_INFO: `/v3/projects/b004661fe53a4c8da572ed169ed680eb/users/bd9bcf170bb8459ea73daf563a8870af/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:54.827852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df5eb1-64b1-4352-8782-bf1f2a00754c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:54.847048 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1768/3543] 10.222.0.21 () {58 vars in 1124 bytes} [Sat Nov 27 20:54:54 2021] GET /identity/v3/groups => generated 1488 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:54.852179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df5eb1-64b1-4352-8782-bf1f2a00754c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:54.865107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df5eb1-64b1-4352-8782-bf1f2a00754c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:54.872753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e6c0d-1447-41ce-8f34-3607f1d3222f tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:54.874111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6c0d-1447-41ce-8f34-3607f1d3222f tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:54.874624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6c0d-1447-41ce-8f34-3607f1d3222f tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:54.875075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6c0d-1447-41ce-8f34-3607f1d3222f tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/8e5fcda4ad6a47b09086332f94d5462e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:54.882812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e6c0d-1447-41ce-8f34-3607f1d3222f tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8e5fcda4ad6a47b09086332f94d5462e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:54.885584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e6c0d-1447-41ce-8f34-3607f1d3222f tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:54.897684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8f9bd-c2c7-4dec-aa75-4195cf557952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b004661fe53a4c8da572ed169ed680eb, user_id=bd9bcf170bb8459ea73daf563a8870af, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:54.913881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8f9bd-c2c7-4dec-aa75-4195cf557952 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:54.944542 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1776/3544] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:54 2021] PUT /identity/v3/projects/b004661fe53a4c8da572ed169ed680eb/users/bd9bcf170bb8459ea73daf563a8870af/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:54:54.958238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e78328-bab0-400a-8241-398bed903275 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:54.959160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e78328-bab0-400a-8241-398bed903275 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:54.962922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e78328-bab0-400a-8241-398bed903275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:55.009064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f4e78328-bab0-400a-8241-398bed903275 None None] MFA Rules not processed for user `bd9bcf170bb8459ea73daf563a8870af`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:55.010613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f4e78328-bab0-400a-8241-398bed903275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:55.026109 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1769/3545] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:54:54 2021] DELETE /identity/v3/groups/8e5fcda4ad6a47b09086332f94d5462e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:55.029679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e6c0d-1447-41ce-8f34-3607f1d3222f tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:55.106991 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1777/3546] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:54 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:55.113653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e78328-bab0-400a-8241-398bed903275 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:55.159732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e6c0d-1447-41ce-8f34-3607f1d3222f tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:55.172186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83990dd-31f0-449b-9ad4-fb7c04b7d43d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:55.173078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83990dd-31f0-449b-9ad4-fb7c04b7d43d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:55.173353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83990dd-31f0-449b-9ad4-fb7c04b7d43d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:55.173737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83990dd-31f0-449b-9ad4-fb7c04b7d43d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/92ec98c8d4c44e34a14517a53d13d16e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:55.179453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83990dd-31f0-449b-9ad4-fb7c04b7d43d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_group(group_id=92ec98c8d4c44e34a14517a53d13d16e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:55.186453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83990dd-31f0-449b-9ad4-fb7c04b7d43d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:55.234480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e78328-bab0-400a-8241-398bed903275 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:55.305074 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1770/3547] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:54:55 2021] DELETE /identity/v3/groups/92ec98c8d4c44e34a14517a53d13d16e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:55.309027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83990dd-31f0-449b-9ad4-fb7c04b7d43d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:55.425385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb3527-2469-4bd4-b7a8-99acd0e09208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:55.426534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb3527-2469-4bd4-b7a8-99acd0e09208 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:55.429658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb3527-2469-4bd4-b7a8-99acd0e09208 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:55.430240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb3527-2469-4bd4-b7a8-99acd0e09208 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:55.431624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb3527-2469-4bd4-b7a8-99acd0e09208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:55.433359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb3527-2469-4bd4-b7a8-99acd0e09208 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:55.475634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83990dd-31f0-449b-9ad4-fb7c04b7d43d tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:55.496138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c30909-c6b5-44a8-bbb6-11d40098ff21 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:55.497329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c30909-c6b5-44a8-bbb6-11d40098ff21 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:55.497626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c30909-c6b5-44a8-bbb6-11d40098ff21 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:55.497902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c30909-c6b5-44a8-bbb6-11d40098ff21 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/506272265d3c4ebca7c32b299458a1a6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:55.518538 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1778/3548] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:54:55 2021] POST /identity/v3/projects => generated 377 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:55.524264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb3527-2469-4bd4-b7a8-99acd0e09208 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:55.525090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c30909-c6b5-44a8-bbb6-11d40098ff21 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_group(group_id=506272265d3c4ebca7c32b299458a1a6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:55.529747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c30909-c6b5-44a8-bbb6-11d40098ff21 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:55.657914 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1771/3549] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:54:55 2021] DELETE /identity/v3/groups/506272265d3c4ebca7c32b299458a1a6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:55.665432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c30909-c6b5-44a8-bbb6-11d40098ff21 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:55.699682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb3527-2469-4bd4-b7a8-99acd0e09208 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:55.808088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c30909-c6b5-44a8-bbb6-11d40098ff21 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:55.822451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5823a8e-0024-4e9f-bfd8-66e0eca4478c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:55.823405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823a8e-0024-4e9f-bfd8-66e0eca4478c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:55.823805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823a8e-0024-4e9f-bfd8-66e0eca4478c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:55.824197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5823a8e-0024-4e9f-bfd8-66e0eca4478c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:55.825625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5823a8e-0024-4e9f-bfd8-66e0eca4478c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:55.836422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5823a8e-0024-4e9f-bfd8-66e0eca4478c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:55.839594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f84301-dfcd-4db9-9a91-08c188d94bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:55.840909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f84301-dfcd-4db9-9a91-08c188d94bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:55.841364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f84301-dfcd-4db9-9a91-08c188d94bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:55.841814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f84301-dfcd-4db9-9a91-08c188d94bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:55.842700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f84301-dfcd-4db9-9a91-08c188d94bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:55.848742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f84301-dfcd-4db9-9a91-08c188d94bd4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:55.901350 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1779/3550] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:55 2021] POST /identity/v3/users => generated 295 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:55.906141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f84301-dfcd-4db9-9a91-08c188d94bd4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:55.918193 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1772/3551] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:54:55 2021] POST /identity/v3/users => generated 323 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:55.923152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5823a8e-0024-4e9f-bfd8-66e0eca4478c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:55.933105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f84301-dfcd-4db9-9a91-08c188d94bd4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:55.944668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5823a8e-0024-4e9f-bfd8-66e0eca4478c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:55.948244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d234cc-e1dd-436c-95ba-00db63a0d343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:55.949305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d234cc-e1dd-436c-95ba-00db63a0d343 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:55.949986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d234cc-e1dd-436c-95ba-00db63a0d343 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:55.950450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d234cc-e1dd-436c-95ba-00db63a0d343 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:55.951375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d234cc-e1dd-436c-95ba-00db63a0d343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:55.954246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d234cc-e1dd-436c-95ba-00db63a0d343 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:55.959507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647f97a-dc68-4c09-81b5-cafbb8934ea7 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:55.965426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647f97a-dc68-4c09-81b5-cafbb8934ea7 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:55.966174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647f97a-dc68-4c09-81b5-cafbb8934ea7 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:55.966665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647f97a-dc68-4c09-81b5-cafbb8934ea7 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:55.967737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647f97a-dc68-4c09-81b5-cafbb8934ea7 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:55.971191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647f97a-dc68-4c09-81b5-cafbb8934ea7 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:55.982364 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1780/3552] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:55 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:55.987853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d234cc-e1dd-436c-95ba-00db63a0d343 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:56.010749 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1773/3553] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:55 2021] POST /identity/v3/groups => generated 326 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:56.012269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647f97a-dc68-4c09-81b5-cafbb8934ea7 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:56.012991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d234cc-e1dd-436c-95ba-00db63a0d343 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:56.019169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d40b4-528c-4c6e-884b-0e4acb4054ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:56.020614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d40b4-528c-4c6e-884b-0e4acb4054ce admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:56.022362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d40b4-528c-4c6e-884b-0e4acb4054ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:56.023163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d40b4-528c-4c6e-884b-0e4acb4054ce admin admin] PATH_INFO: `/v3/projects/4605569e49de486c8928307f6fbaf66f/users/e5fa9a1c2b104537998cb5541d7ae98b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:56.025683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647f97a-dc68-4c09-81b5-cafbb8934ea7 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:56.032218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be038-37da-490b-996c-fb177bdead60 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:56.033380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be038-37da-490b-996c-fb177bdead60 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:56.033870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be038-37da-490b-996c-fb177bdead60 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:56.034331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be038-37da-490b-996c-fb177bdead60 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/fbe717028f3a4d1a9ffd61c9e84ed390/users/bfd3397fcafe478b83a6aef4febe4dd3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:56.042248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d40b4-528c-4c6e-884b-0e4acb4054ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4605569e49de486c8928307f6fbaf66f, user_id=e5fa9a1c2b104537998cb5541d7ae98b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:56.046785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d40b4-528c-4c6e-884b-0e4acb4054ce admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:56.073239 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1781/3554] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:55 2021] PUT /identity/v3/projects/4605569e49de486c8928307f6fbaf66f/users/e5fa9a1c2b104537998cb5541d7ae98b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:54:56.073501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6be038-37da-490b-996c-fb177bdead60 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=fbe717028f3a4d1a9ffd61c9e84ed390, user_id=bfd3397fcafe478b83a6aef4febe4dd3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:56.074549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6be038-37da-490b-996c-fb177bdead60 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:56.076225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d40b4-528c-4c6e-884b-0e4acb4054ce admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:56.135220 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1774/3555] 10.222.0.21 () {60 vars in 1359 bytes} [Sat Nov 27 20:54:56 2021] PUT /identity/v3/groups/fbe717028f3a4d1a9ffd61c9e84ed390/users/bfd3397fcafe478b83a6aef4febe4dd3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:56.140100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be038-37da-490b-996c-fb177bdead60 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:56.239612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d40b4-528c-4c6e-884b-0e4acb4054ce admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:56.285872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be038-37da-490b-996c-fb177bdead60 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:56.301770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f014e33-e25f-45a3-883e-f9929b012b06 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:56.302686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014e33-e25f-45a3-883e-f9929b012b06 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:56.303150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014e33-e25f-45a3-883e-f9929b012b06 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:56.303636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f014e33-e25f-45a3-883e-f9929b012b06 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:56.304529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f014e33-e25f-45a3-883e-f9929b012b06 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:56.307315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f014e33-e25f-45a3-883e-f9929b012b06 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:56.336800 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1775/3556] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:54:56 2021] POST /identity/v3/groups => generated 326 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:54:56.342040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f014e33-e25f-45a3-883e-f9929b012b06 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:56.345648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34507209-846f-49bf-8356-10214a0f7166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:56.346494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34507209-846f-49bf-8356-10214a0f7166 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:56.347018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34507209-846f-49bf-8356-10214a0f7166 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:56.347444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34507209-846f-49bf-8356-10214a0f7166 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:56.349450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34507209-846f-49bf-8356-10214a0f7166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:56.352211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34507209-846f-49bf-8356-10214a0f7166 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:56.359410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f014e33-e25f-45a3-883e-f9929b012b06 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:56.366116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60892-2844-459d-a331-3365ff2f1947 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:56.369326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60892-2844-459d-a331-3365ff2f1947 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:56.369781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60892-2844-459d-a331-3365ff2f1947 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:56.370243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60892-2844-459d-a331-3365ff2f1947 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/6e4272a013884bbf90f3a0873bb3f92a/users/bfd3397fcafe478b83a6aef4febe4dd3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:56.381516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff60892-2844-459d-a331-3365ff2f1947 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6e4272a013884bbf90f3a0873bb3f92a, user_id=bfd3397fcafe478b83a6aef4febe4dd3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:56.382417 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1782/3557] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:54:56 2021] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:54:56.384235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff60892-2844-459d-a331-3365ff2f1947 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:56.389667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34507209-846f-49bf-8356-10214a0f7166 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:56.405930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34507209-846f-49bf-8356-10214a0f7166 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:56.413624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa928f-ae86-4b40-a0f7-ea9af2cdd1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:56.415455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa928f-ae86-4b40-a0f7-ea9af2cdd1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:56.416047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa928f-ae86-4b40-a0f7-ea9af2cdd1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:56.416412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa928f-ae86-4b40-a0f7-ea9af2cdd1a1 admin admin] PATH_INFO: `/v3/projects/4605569e49de486c8928307f6fbaf66f/users/e5fa9a1c2b104537998cb5541d7ae98b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:56.420778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa928f-ae86-4b40-a0f7-ea9af2cdd1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4605569e49de486c8928307f6fbaf66f, user_id=e5fa9a1c2b104537998cb5541d7ae98b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:56.427314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa928f-ae86-4b40-a0f7-ea9af2cdd1a1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:56.441811 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1776/3558] 10.222.0.21 () {60 vars in 1359 bytes} [Sat Nov 27 20:54:56 2021] PUT /identity/v3/groups/6e4272a013884bbf90f3a0873bb3f92a/users/bfd3397fcafe478b83a6aef4febe4dd3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:56.445269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60892-2844-459d-a331-3365ff2f1947 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:56.511374 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1783/3559] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:54:56 2021] PUT /identity/v3/projects/4605569e49de486c8928307f6fbaf66f/users/e5fa9a1c2b104537998cb5541d7ae98b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:56.515174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece6493-9db6-401c-a069-2ad897494e72 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:56.515813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece6493-9db6-401c-a069-2ad897494e72 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:56.516232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece6493-9db6-401c-a069-2ad897494e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:56.601834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-dece6493-9db6-401c-a069-2ad897494e72 None None] MFA Rules not processed for user `e5fa9a1c2b104537998cb5541d7ae98b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:56.608897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dece6493-9db6-401c-a069-2ad897494e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:56.693593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60892-2844-459d-a331-3365ff2f1947 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:56.710348 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1784/3560] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:56 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:54:56.733013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece6493-9db6-401c-a069-2ad897494e72 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:56.734926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dece6493-9db6-401c-a069-2ad897494e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:56.794486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36ea04-e436-4034-9285-d79d018d0d77 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:56.800163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36ea04-e436-4034-9285-d79d018d0d77 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:56.800771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36ea04-e436-4034-9285-d79d018d0d77 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:56.801305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36ea04-e436-4034-9285-d79d018d0d77 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/users/bfd3397fcafe478b83a6aef4febe4dd3/groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:56.803828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36ea04-e436-4034-9285-d79d018d0d77 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=bfd3397fcafe478b83a6aef4febe4dd3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:56.806729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36ea04-e436-4034-9285-d79d018d0d77 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:56.838804 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1777/3561] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 20:54:56 2021] GET /identity/v3/users/bfd3397fcafe478b83a6aef4febe4dd3/groups => generated 838 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:54:56.840303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36ea04-e436-4034-9285-d79d018d0d77 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:56.857839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece6493-9db6-401c-a069-2ad897494e72 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:56.859915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36ea04-e436-4034-9285-d79d018d0d77 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:56.868151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f334ec1-b284-42f9-88b2-3df5f6e286e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:56.875432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f334ec1-b284-42f9-88b2-3df5f6e286e6 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:56.875900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f334ec1-b284-42f9-88b2-3df5f6e286e6 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:56.880579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68259a3-c133-43e8-ae8e-bbefd8262d53 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:56.880755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f334ec1-b284-42f9-88b2-3df5f6e286e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:56.880873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68259a3-c133-43e8-ae8e-bbefd8262d53 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:56.880966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68259a3-c133-43e8-ae8e-bbefd8262d53 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:56.881666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68259a3-c133-43e8-ae8e-bbefd8262d53 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/6e4272a013884bbf90f3a0873bb3f92a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:56.883081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68259a3-c133-43e8-ae8e-bbefd8262d53 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6e4272a013884bbf90f3a0873bb3f92a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:56.885615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68259a3-c133-43e8-ae8e-bbefd8262d53 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:56.897799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f334ec1-b284-42f9-88b2-3df5f6e286e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:56.901165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f334ec1-b284-42f9-88b2-3df5f6e286e6 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:56.931900 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1785/3562] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:54:56 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:54:56.983568 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1778/3563] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:54:56 2021] DELETE /identity/v3/groups/6e4272a013884bbf90f3a0873bb3f92a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:56.987969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f334ec1-b284-42f9-88b2-3df5f6e286e6 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:57.024526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f334ec1-b284-42f9-88b2-3df5f6e286e6 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:57.179593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90185c0-d23d-4e4c-a5ed-95c7daad64bc tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:57.180993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90185c0-d23d-4e4c-a5ed-95c7daad64bc tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:57.181531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90185c0-d23d-4e4c-a5ed-95c7daad64bc tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:57.182017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90185c0-d23d-4e4c-a5ed-95c7daad64bc tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/groups/fbe717028f3a4d1a9ffd61c9e84ed390` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:57.184888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90185c0-d23d-4e4c-a5ed-95c7daad64bc tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fbe717028f3a4d1a9ffd61c9e84ed390)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:57.187088 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-e90185c0-d23d-4e4c-a5ed-95c7daad64bc tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:57.187088 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:54:57.187088 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:54:57.188766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90185c0-d23d-4e4c-a5ed-95c7daad64bc tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:57.302219 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1786/3564] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:54:56 2021] DELETE /identity/v3/groups/fbe717028f3a4d1a9ffd61c9e84ed390 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:57.313929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68259a3-c133-43e8-ae8e-bbefd8262d53 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:57.316783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90185c0-d23d-4e4c-a5ed-95c7daad64bc tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:57.333577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68259a3-c133-43e8-ae8e-bbefd8262d53 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:57.409575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90185c0-d23d-4e4c-a5ed-95c7daad64bc tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:57.418171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bf8b8-ffad-4264-8a61-6e6302b6e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:57.419938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bf8b8-ffad-4264-8a61-6e6302b6e304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:57.420325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bf8b8-ffad-4264-8a61-6e6302b6e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:57.420704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bf8b8-ffad-4264-8a61-6e6302b6e304 admin admin] PATH_INFO: `/v3/users/bd9bcf170bb8459ea73daf563a8870af` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:57.422056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bf8b8-ffad-4264-8a61-6e6302b6e304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9bcf170bb8459ea73daf563a8870af)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:57.424154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bf8b8-ffad-4264-8a61-6e6302b6e304 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:57.478075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:57.480265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:57.480566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:57.482969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/users/bfd3397fcafe478b83a6aef4febe4dd3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:57.484639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bfd3397fcafe478b83a6aef4febe4dd3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:57.489922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca5bf8b8-ffad-4264-8a61-6e6302b6e304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9bcf170bb8459ea73daf563a8870af'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.490988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca5bf8b8-ffad-4264-8a61-6e6302b6e304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9bcf170bb8459ea73daf563a8870af'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.492166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:57.504985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca5bf8b8-ffad-4264-8a61-6e6302b6e304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9bcf170bb8459ea73daf563a8870af'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.506260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca5bf8b8-ffad-4264-8a61-6e6302b6e304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9bcf170bb8459ea73daf563a8870af'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.516376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca5bf8b8-ffad-4264-8a61-6e6302b6e304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9bcf170bb8459ea73daf563a8870af'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.557307 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1787/3565] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:57 2021] DELETE /identity/v3/users/bd9bcf170bb8459ea73daf563a8870af => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:57.559612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206b0fb-8cb5-4a4d-98b9-e9d3393214a1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:57.560108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206b0fb-8cb5-4a4d-98b9-e9d3393214a1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:57.561366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206b0fb-8cb5-4a4d-98b9-e9d3393214a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:57.621123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd3397fcafe478b83a6aef4febe4dd3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.640183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd3397fcafe478b83a6aef4febe4dd3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.641942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd3397fcafe478b83a6aef4febe4dd3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.643218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3206b0fb-8cb5-4a4d-98b9-e9d3393214a1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:57.648263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3206b0fb-8cb5-4a4d-98b9-e9d3393214a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:57.663044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd3397fcafe478b83a6aef4febe4dd3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.699893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd3397fcafe478b83a6aef4febe4dd3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.721701 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1779/3566] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:57 2021] DELETE /identity/v3/users/bfd3397fcafe478b83a6aef4febe4dd3 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:57.723121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:57.725312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:57.736160 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1788/3567] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:57.748759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206b0fb-8cb5-4a4d-98b9-e9d3393214a1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:57.750759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3206b0fb-8cb5-4a4d-98b9-e9d3393214a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:57.823112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4456f-5f29-467b-8cfb-66430cc07bf1 tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:57.836497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:57.842612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:57.842914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:57.844127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/domains/0c97fc35501f4109a16796f2408aee0b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:57.854312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0c97fc35501f4109a16796f2408aee0b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:57.856292 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:57.856292 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:54:57.856292 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:54:57.858232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:57.863637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206b0fb-8cb5-4a4d-98b9-e9d3393214a1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:57.917676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0c97fc35501f4109a16796f2408aee0b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.920067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0c97fc35501f4109a16796f2408aee0b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.978205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0c97fc35501f4109a16796f2408aee0b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.979277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0c97fc35501f4109a16796f2408aee0b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:57.983664 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1780/3568] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:54:57 2021] PATCH /identity/v3/domains/0c97fc35501f4109a16796f2408aee0b => generated 277 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:54:57.987206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:57.989561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09069dc2-8417-4396-b3a5-1551b8810614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:57.990076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:57.990971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09069dc2-8417-4396-b3a5-1551b8810614 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:57.991406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09069dc2-8417-4396-b3a5-1551b8810614 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:57.991787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09069dc2-8417-4396-b3a5-1551b8810614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:57.994270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-09069dc2-8417-4396-b3a5-1551b8810614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:58.108392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858a0d9-33de-44d2-8be7-73a2b1df81df tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:58.118422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '987bde8a900848779a25a9aeb8976134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '863bd12a0bd843ff93d98775ee6f780f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:58.120546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:58.120546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:58.126452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] PATH_INFO: `/v3/domains/0c97fc35501f4109a16796f2408aee0b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:58.147562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0c97fc35501f4109a16796f2408aee0b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:58.148461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09069dc2-8417-4396-b3a5-1551b8810614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:58.148595 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:54:58.148595 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:54:58.148595 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:54:58.149474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:58.151116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09069dc2-8417-4396-b3a5-1551b8810614 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:58.193582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0c97fc35501f4109a16796f2408aee0b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.217401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0c97fc35501f4109a16796f2408aee0b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.221922 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1789/3569] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:54:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:54:58.285131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c97fc35501f4109a16796f2408aee0b', 'request_id': 'req-631e0296-8572-4358-b1d8-ad483bd4852c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.295378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c97fc35501f4109a16796f2408aee0b', 'request_id': 'req-631e0296-8572-4358-b1d8-ad483bd4852c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.317955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c97fc35501f4109a16796f2408aee0b', 'request_id': 'req-631e0296-8572-4358-b1d8-ad483bd4852c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.333266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] The token cache is being invalidate because project 0c97fc35501f4109a16796f2408aee0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:54:58.333266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.333637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.356262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0c97fc35501f4109a16796f2408aee0b', 'request_id': 'req-631e0296-8572-4358-b1d8-ad483bd4852c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.357034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0c97fc35501f4109a16796f2408aee0b', 'request_id': 'req-631e0296-8572-4358-b1d8-ad483bd4852c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.357777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0c97fc35501f4109a16796f2408aee0b', 'request_id': 'req-631e0296-8572-4358-b1d8-ad483bd4852c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.389523 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1781/3570] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:54:57 2021] DELETE /identity/v3/domains/0c97fc35501f4109a16796f2408aee0b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:54:58.391218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09069dc2-8417-4396-b3a5-1551b8810614 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:58.395246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-09069dc2-8417-4396-b3a5-1551b8810614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:58.420895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09069dc2-8417-4396-b3a5-1551b8810614 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:58.585993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518961e-2e4b-4837-a5df-fd1a39868f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:58.587126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518961e-2e4b-4837-a5df-fd1a39868f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:58.587782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518961e-2e4b-4837-a5df-fd1a39868f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:58.588070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518961e-2e4b-4837-a5df-fd1a39868f07 admin admin] PATH_INFO: `/v3/users/aeb2a65b1d2a4ed8ac0e00de0f9acc19` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:58.597989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518961e-2e4b-4837-a5df-fd1a39868f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb2a65b1d2a4ed8ac0e00de0f9acc19)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:58.608228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518961e-2e4b-4837-a5df-fd1a39868f07 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:58.786658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9518961e-2e4b-4837-a5df-fd1a39868f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb2a65b1d2a4ed8ac0e00de0f9acc19'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.794117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9518961e-2e4b-4837-a5df-fd1a39868f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb2a65b1d2a4ed8ac0e00de0f9acc19'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.822059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9518961e-2e4b-4837-a5df-fd1a39868f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb2a65b1d2a4ed8ac0e00de0f9acc19'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.822687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9518961e-2e4b-4837-a5df-fd1a39868f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb2a65b1d2a4ed8ac0e00de0f9acc19'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.834757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9518961e-2e4b-4837-a5df-fd1a39868f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb2a65b1d2a4ed8ac0e00de0f9acc19'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:58.876110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:58.879025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:58.910044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e0296-8572-4358-b1d8-ad483bd4852c tempest-GroupsV3TestJSON-381905663 tempest-GroupsV3TestJSON-381905663-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:58.915865 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1790/3571] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:58 2021] DELETE /identity/v3/users/aeb2a65b1d2a4ed8ac0e00de0f9acc19 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:58.917340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0451a4d-e18f-44bd-a3a7-716354347cd6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:58.917629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0451a4d-e18f-44bd-a3a7-716354347cd6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:58.917901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0451a4d-e18f-44bd-a3a7-716354347cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:58.986702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a0451a4d-e18f-44bd-a3a7-716354347cd6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:54:58.999508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a0451a4d-e18f-44bd-a3a7-716354347cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:59.079473 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1791/3572] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:54:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:54:59.140707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:59.142121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:59.142647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:59.143274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] PATH_INFO: `/v3/projects/b004661fe53a4c8da572ed169ed680eb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:59.144940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b004661fe53a4c8da572ed169ed680eb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:59.149715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0451a4d-e18f-44bd-a3a7-716354347cd6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:59.151288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a0451a4d-e18f-44bd-a3a7-716354347cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:59.158699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:59.267657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0451a4d-e18f-44bd-a3a7-716354347cd6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:59.279372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b004661fe53a4c8da572ed169ed680eb', 'request_id': 'req-a26da770-96ee-441a-9ee6-628e1cbb9d6d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:59.302719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b004661fe53a4c8da572ed169ed680eb', 'request_id': 'req-a26da770-96ee-441a-9ee6-628e1cbb9d6d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:59.315904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b004661fe53a4c8da572ed169ed680eb', 'request_id': 'req-a26da770-96ee-441a-9ee6-628e1cbb9d6d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:59.329054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] The token cache is being invalidate because project b004661fe53a4c8da572ed169ed680eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:54:59.329792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:59.332306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:59.337402 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1782/3573] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:54:58 2021] DELETE /identity/v3/projects/b004661fe53a4c8da572ed169ed680eb => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:54:59.341973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:54:59.344540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:59.367327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f67456-f521-4b51-9a79-db1b3b5aab7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:59.368467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f67456-f521-4b51-9a79-db1b3b5aab7e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:59.369044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f67456-f521-4b51-9a79-db1b3b5aab7e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:59.378178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f67456-f521-4b51-9a79-db1b3b5aab7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:59.384495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-71f67456-f521-4b51-9a79-db1b3b5aab7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:54:59.510945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26da770-96ee-441a-9ee6-628e1cbb9d6d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:54:59.523121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:54:59.524177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:54:59.524780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:54:59.525181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] PATH_INFO: `/v3/users/e5fa9a1c2b104537998cb5541d7ae98b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:54:59.528142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5fa9a1c2b104537998cb5541d7ae98b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:59.530059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f67456-f521-4b51-9a79-db1b3b5aab7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:54:59.531627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:59.532088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f67456-f521-4b51-9a79-db1b3b5aab7e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:54:59.563222 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1792/3574] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:54:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:54:59.619310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5fa9a1c2b104537998cb5541d7ae98b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:59.634650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5fa9a1c2b104537998cb5541d7ae98b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:59.635542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5fa9a1c2b104537998cb5541d7ae98b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:59.645991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5fa9a1c2b104537998cb5541d7ae98b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:59.663613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5fa9a1c2b104537998cb5541d7ae98b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:54:59.672019 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1783/3575] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:54:59 2021] DELETE /identity/v3/users/e5fa9a1c2b104537998cb5541d7ae98b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:00.078408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f67456-f521-4b51-9a79-db1b3b5aab7e service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:00.079894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-71f67456-f521-4b51-9a79-db1b3b5aab7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:00.096344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f67456-f521-4b51-9a79-db1b3b5aab7e service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:00.248318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:00.251437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:00.252660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:00.253470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:00.253859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] PATH_INFO: `/v3/projects/a9322e3d42b849ffba3baf70a3e95bef` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:00.255243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:00.258781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9322e3d42b849ffba3baf70a3e95bef)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:00.266472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:00.278038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397457f-1c8f-430d-9420-e03826c802ef admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:00.294114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:00.295119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:00.295429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:00.295764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] PATH_INFO: `/v3/projects/4605569e49de486c8928307f6fbaf66f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:00.296978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4605569e49de486c8928307f6fbaf66f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:00.299614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:00.370422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9322e3d42b849ffba3baf70a3e95bef', 'request_id': 'req-fe8674ff-4243-4a7e-89ab-f05422292084'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.390792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9322e3d42b849ffba3baf70a3e95bef', 'request_id': 'req-fe8674ff-4243-4a7e-89ab-f05422292084'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.402278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4605569e49de486c8928307f6fbaf66f', 'request_id': 'req-469ea6c8-ad3e-43d2-9848-fe5d96f74031'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.408353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9322e3d42b849ffba3baf70a3e95bef', 'request_id': 'req-fe8674ff-4243-4a7e-89ab-f05422292084'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.428726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4605569e49de486c8928307f6fbaf66f', 'request_id': 'req-469ea6c8-ad3e-43d2-9848-fe5d96f74031'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.447484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] The token cache is being invalidate because project a9322e3d42b849ffba3baf70a3e95bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:00.447484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.447788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4605569e49de486c8928307f6fbaf66f', 'request_id': 'req-469ea6c8-ad3e-43d2-9848-fe5d96f74031'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.447911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.452189 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1793/3576] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:00 2021] DELETE /identity/v3/projects/a9322e3d42b849ffba3baf70a3e95bef => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:00.453550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:00.455374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:00.467754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] The token cache is being invalidate because project 4605569e49de486c8928307f6fbaf66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:00.468059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.469809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-469ea6c8-ad3e-43d2-9848-fe5d96f74031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.474637 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1784/3577] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:00 2021] DELETE /identity/v3/projects/4605569e49de486c8928307f6fbaf66f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:00.480624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbff255-295e-43bd-bbba-ef1ce44af3b4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:00.480978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbff255-295e-43bd-bbba-ef1ce44af3b4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:00.481216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbff255-295e-43bd-bbba-ef1ce44af3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:00.556778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5fbff255-295e-43bd-bbba-ef1ce44af3b4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:00.557122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8674ff-4243-4a7e-89ab-f05422292084 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:00.558030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5fbff255-295e-43bd-bbba-ef1ce44af3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:00.628927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed02a2-80d4-4443-9b7d-b8fafe51be47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:00.629943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed02a2-80d4-4443-9b7d-b8fafe51be47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:00.630291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed02a2-80d4-4443-9b7d-b8fafe51be47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:00.630637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed02a2-80d4-4443-9b7d-b8fafe51be47 admin admin] PATH_INFO: `/v3/users/987bde8a900848779a25a9aeb8976134` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:00.632044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed02a2-80d4-4443-9b7d-b8fafe51be47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987bde8a900848779a25a9aeb8976134)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:00.634743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed02a2-80d4-4443-9b7d-b8fafe51be47 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:00.728207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5eed02a2-80d4-4443-9b7d-b8fafe51be47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987bde8a900848779a25a9aeb8976134'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.729404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5eed02a2-80d4-4443-9b7d-b8fafe51be47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987bde8a900848779a25a9aeb8976134'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.748495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5eed02a2-80d4-4443-9b7d-b8fafe51be47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987bde8a900848779a25a9aeb8976134'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.750904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5eed02a2-80d4-4443-9b7d-b8fafe51be47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987bde8a900848779a25a9aeb8976134'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.768947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5eed02a2-80d4-4443-9b7d-b8fafe51be47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987bde8a900848779a25a9aeb8976134'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:00.795298 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1785/3578] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:00.797964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c2ba-90ea-44cc-940c-9b3936f70845 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:00.799397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c2ba-90ea-44cc-940c-9b3936f70845 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:00.800174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c2ba-90ea-44cc-940c-9b3936f70845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:00.816250 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1794/3579] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:00 2021] DELETE /identity/v3/users/987bde8a900848779a25a9aeb8976134 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:00.820234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2137de7-e248-4f78-a36b-b2ed3f9bfb52 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:00.820602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2137de7-e248-4f78-a36b-b2ed3f9bfb52 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:00.821186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2137de7-e248-4f78-a36b-b2ed3f9bfb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:00.867593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f2137de7-e248-4f78-a36b-b2ed3f9bfb52 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:00.872641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1728c2ba-90ea-44cc-940c-9b3936f70845 None None] MFA Rules not processed for user `098b638877f34c648d92b8c10a0fef12`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:00.873952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1728c2ba-90ea-44cc-940c-9b3936f70845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:00.874206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f2137de7-e248-4f78-a36b-b2ed3f9bfb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:00.959458 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1795/3580] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:00.969238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2137de7-e248-4f78-a36b-b2ed3f9bfb52 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:00.982691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2137de7-e248-4f78-a36b-b2ed3f9bfb52 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:00.993543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65dbb8-5d44-43e7-8eb1-1ebde04b359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:00.994422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65dbb8-5d44-43e7-8eb1-1ebde04b359e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:00.995302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65dbb8-5d44-43e7-8eb1-1ebde04b359e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:00.995589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65dbb8-5d44-43e7-8eb1-1ebde04b359e admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:00.996728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65dbb8-5d44-43e7-8eb1-1ebde04b359e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:00.997496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65dbb8-5d44-43e7-8eb1-1ebde04b359e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:00.999888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65dbb8-5d44-43e7-8eb1-1ebde04b359e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:01.014071 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1796/3581] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:01.031454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65dbb8-5d44-43e7-8eb1-1ebde04b359e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:01.075914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65dbb8-5d44-43e7-8eb1-1ebde04b359e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:01.095121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f41324-a3d5-4d64-b407-a0aea86b9e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:01.096246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f41324-a3d5-4d64-b407-a0aea86b9e3e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:01.096246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f41324-a3d5-4d64-b407-a0aea86b9e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:01.096533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f41324-a3d5-4d64-b407-a0aea86b9e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:01.097045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f41324-a3d5-4d64-b407-a0aea86b9e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:01.107214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f41324-a3d5-4d64-b407-a0aea86b9e3e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:01.179212 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1786/3582] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:00 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:01.193859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728c2ba-90ea-44cc-940c-9b3936f70845 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:01.197316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1728c2ba-90ea-44cc-940c-9b3936f70845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:01.215293 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1797/3583] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:01 2021] POST /identity/v3/projects => generated 403 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:01.217257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f41324-a3d5-4d64-b407-a0aea86b9e3e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:01.371793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728c2ba-90ea-44cc-940c-9b3936f70845 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:01.411136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f41324-a3d5-4d64-b407-a0aea86b9e3e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:01.429460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decf35a-cdf7-4b59-b287-d74d8e4861ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:01.434578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf35a-cdf7-4b59-b287-d74d8e4861ae admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:01.434908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf35a-cdf7-4b59-b287-d74d8e4861ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:01.435238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decf35a-cdf7-4b59-b287-d74d8e4861ae admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:01.436005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decf35a-cdf7-4b59-b287-d74d8e4861ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:01.443641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decf35a-cdf7-4b59-b287-d74d8e4861ae admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:01.536288 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1798/3584] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:01 2021] POST /identity/v3/users => generated 302 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:01.544308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decf35a-cdf7-4b59-b287-d74d8e4861ae admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:01.546167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0419be7-c730-41e7-8f81-0ffe0a808475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:01.546878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0419be7-c730-41e7-8f81-0ffe0a808475 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:01.547461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0419be7-c730-41e7-8f81-0ffe0a808475 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:01.547734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0419be7-c730-41e7-8f81-0ffe0a808475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:01.553954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b0419be7-c730-41e7-8f81-0ffe0a808475 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:01.556678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decf35a-cdf7-4b59-b287-d74d8e4861ae admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:01.572809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2367f-166f-48c1-9c95-55831bda4009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:01.573607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2367f-166f-48c1-9c95-55831bda4009 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:01.575153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2367f-166f-48c1-9c95-55831bda4009 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:01.575578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2367f-166f-48c1-9c95-55831bda4009 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:01.578282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2367f-166f-48c1-9c95-55831bda4009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:01.578282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2367f-166f-48c1-9c95-55831bda4009 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:01.610538 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1799/3585] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:01 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:01.614253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2367f-166f-48c1-9c95-55831bda4009 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:01.628984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2367f-166f-48c1-9c95-55831bda4009 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:01.651830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf5813-3e1d-47f6-937a-791d3810b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:01.653902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf5813-3e1d-47f6-937a-791d3810b8bc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:01.654417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf5813-3e1d-47f6-937a-791d3810b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:01.654906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf5813-3e1d-47f6-937a-791d3810b8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:01.656878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf5813-3e1d-47f6-937a-791d3810b8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:01.660519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf5813-3e1d-47f6-937a-791d3810b8bc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:01.677664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0419be7-c730-41e7-8f81-0ffe0a808475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:01.679156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0419be7-c730-41e7-8f81-0ffe0a808475 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:01.687930 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1800/3586] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:01 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:01.692169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf5813-3e1d-47f6-937a-791d3810b8bc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:01.698291 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1787/3587] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:01 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:01.714423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf5813-3e1d-47f6-937a-791d3810b8bc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:01.749038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4aa3f1-bacd-4370-a473-4515ce63482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:01.750567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aa3f1-bacd-4370-a473-4515ce63482f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:01.750856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aa3f1-bacd-4370-a473-4515ce63482f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:01.751136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4aa3f1-bacd-4370-a473-4515ce63482f admin admin] PATH_INFO: `/v3/projects/e3ba31f5d83b4626b1c8b2c665e09383/users/4610eaaf223f4389bb8c63ed8669e5d6/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:01.805956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aa3f1-bacd-4370-a473-4515ce63482f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ba31f5d83b4626b1c8b2c665e09383, user_id=4610eaaf223f4389bb8c63ed8669e5d6, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:01.813416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4aa3f1-bacd-4370-a473-4515ce63482f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:01.838214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0419be7-c730-41e7-8f81-0ffe0a808475 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:01.840066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b0419be7-c730-41e7-8f81-0ffe0a808475 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:01.854173 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1801/3588] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:01 2021] PUT /identity/v3/projects/e3ba31f5d83b4626b1c8b2c665e09383/users/4610eaaf223f4389bb8c63ed8669e5d6/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:01.864488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bf0ca-b308-4d0b-b033-16a16506683f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:01.865725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bf0ca-b308-4d0b-b033-16a16506683f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:01.866015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bf0ca-b308-4d0b-b033-16a16506683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:01.877816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0419be7-c730-41e7-8f81-0ffe0a808475 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:01.949109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ef7bf0ca-b308-4d0b-b033-16a16506683f None None] MFA Rules not processed for user `4610eaaf223f4389bb8c63ed8669e5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:01.955766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ef7bf0ca-b308-4d0b-b033-16a16506683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:02.080262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:02.082356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:02.082658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:02.083606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] PATH_INFO: `/v3/projects/863bd12a0bd843ff93d98775ee6f780f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:02.084991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863bd12a0bd843ff93d98775ee6f780f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:02.087178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:02.126833 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1802/3589] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:01 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:02.128679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bf0ca-b308-4d0b-b033-16a16506683f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:02.141937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bf0ca-b308-4d0b-b033-16a16506683f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:02.149066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e535b-a1f4-404f-be39-f313e2c17855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:02.149930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e535b-a1f4-404f-be39-f313e2c17855 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:02.150730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e535b-a1f4-404f-be39-f313e2c17855 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:02.151156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e535b-a1f4-404f-be39-f313e2c17855 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:02.151981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e535b-a1f4-404f-be39-f313e2c17855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:02.153910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e535b-a1f4-404f-be39-f313e2c17855 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:02.207678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863bd12a0bd843ff93d98775ee6f780f', 'request_id': 'req-3d4e8b25-08e2-430e-8ff0-02146d16a957'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:02.221035 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1803/3590] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:02 2021] POST /identity/v3/projects => generated 401 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:02.227757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863bd12a0bd843ff93d98775ee6f780f', 'request_id': 'req-3d4e8b25-08e2-430e-8ff0-02146d16a957'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:02.229092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e535b-a1f4-404f-be39-f313e2c17855 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:02.246042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863bd12a0bd843ff93d98775ee6f780f', 'request_id': 'req-3d4e8b25-08e2-430e-8ff0-02146d16a957'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:02.273425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] The token cache is being invalidate because project 863bd12a0bd843ff93d98775ee6f780f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:02.273723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:02.275143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d4e8b25-08e2-430e-8ff0-02146d16a957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:02.288302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1788/3591] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:01 2021] DELETE /identity/v3/projects/863bd12a0bd843ff93d98775ee6f780f => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:02.290285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9805a28-b4c4-412b-8fa8-c1c1eadbff17 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:02.290584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9805a28-b4c4-412b-8fa8-c1c1eadbff17 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:02.290862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9805a28-b4c4-412b-8fa8-c1c1eadbff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:02.337892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b9805a28-b4c4-412b-8fa8-c1c1eadbff17 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:02.339124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b9805a28-b4c4-412b-8fa8-c1c1eadbff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:02.382401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e535b-a1f4-404f-be39-f313e2c17855 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:02.395884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611c14e-f7e6-48d8-b8f6-d33cb9492abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:02.396598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611c14e-f7e6-48d8-b8f6-d33cb9492abe admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:02.396850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611c14e-f7e6-48d8-b8f6-d33cb9492abe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:02.397124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611c14e-f7e6-48d8-b8f6-d33cb9492abe admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:02.397834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611c14e-f7e6-48d8-b8f6-d33cb9492abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:02.399939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611c14e-f7e6-48d8-b8f6-d33cb9492abe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:02.457754 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1804/3592] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:02 2021] POST /identity/v3/users => generated 307 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:02.461842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611c14e-f7e6-48d8-b8f6-d33cb9492abe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:02.471071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6611c14e-f7e6-48d8-b8f6-d33cb9492abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:02.531171 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1789/3593] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:02.531893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611c14e-f7e6-48d8-b8f6-d33cb9492abe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:02.535707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007df0-6981-40e9-93c8-cf0650056765 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:02.538190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007df0-6981-40e9-93c8-cf0650056765 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:02.538514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7007df0-6981-40e9-93c8-cf0650056765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:02.547012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478df1-56b6-4775-963e-6d1030428402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:02.547720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478df1-56b6-4775-963e-6d1030428402 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:02.548002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478df1-56b6-4775-963e-6d1030428402 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:02.548304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478df1-56b6-4775-963e-6d1030428402 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:02.549051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09478df1-56b6-4775-963e-6d1030428402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:02.566997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09478df1-56b6-4775-963e-6d1030428402 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:02.606571 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1805/3594] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:02 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:02.610588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e7007df0-6981-40e9-93c8-cf0650056765 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:02.611306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478df1-56b6-4775-963e-6d1030428402 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:02.613173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e7007df0-6981-40e9-93c8-cf0650056765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:02.642921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478df1-56b6-4775-963e-6d1030428402 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:02.656925 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1790/3595] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:02.656925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7007df0-6981-40e9-93c8-cf0650056765 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:02.680207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb05316-fb37-42fa-82b1-9f346cfe11de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:02.680207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb05316-fb37-42fa-82b1-9f346cfe11de admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:02.681426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb05316-fb37-42fa-82b1-9f346cfe11de admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:02.681950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb05316-fb37-42fa-82b1-9f346cfe11de admin admin] PATH_INFO: `/v3/projects/bde0107b70f54fe698bf3cfe128ce021/users/2f47924de2614a2d89ae8b57f7c13f53/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:02.684667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7007df0-6981-40e9-93c8-cf0650056765 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:02.697352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b913-878e-40bd-b6a9-fb694cdce8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:02.698037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b913-878e-40bd-b6a9-fb694cdce8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:02.699122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b913-878e-40bd-b6a9-fb694cdce8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:02.699122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b913-878e-40bd-b6a9-fb694cdce8c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:02.699442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76b913-878e-40bd-b6a9-fb694cdce8c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:02.699744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76b913-878e-40bd-b6a9-fb694cdce8c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:02.701383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76b913-878e-40bd-b6a9-fb694cdce8c9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:02.711050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb05316-fb37-42fa-82b1-9f346cfe11de admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde0107b70f54fe698bf3cfe128ce021, user_id=2f47924de2614a2d89ae8b57f7c13f53, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:02.714677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb05316-fb37-42fa-82b1-9f346cfe11de admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:02.746167 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1791/3596] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:02.752497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b913-878e-40bd-b6a9-fb694cdce8c9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:02.755008 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1806/3597] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:02 2021] PUT /identity/v3/projects/bde0107b70f54fe698bf3cfe128ce021/users/2f47924de2614a2d89ae8b57f7c13f53/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:02.763883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb05316-fb37-42fa-82b1-9f346cfe11de admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:02.780851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b913-878e-40bd-b6a9-fb694cdce8c9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:02.923851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb05316-fb37-42fa-82b1-9f346cfe11de admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:02.933503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f1373-a84b-42b4-9bf3-0867ca3ff04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:02.936373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f1373-a84b-42b4-9bf3-0867ca3ff04b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:02.938445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f1373-a84b-42b4-9bf3-0867ca3ff04b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:02.938853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f1373-a84b-42b4-9bf3-0867ca3ff04b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:02.939779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f1373-a84b-42b4-9bf3-0867ca3ff04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:02.946338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f1373-a84b-42b4-9bf3-0867ca3ff04b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:02.947474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7123b94-f256-4793-aa29-6757354eff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:02.948314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7123b94-f256-4793-aa29-6757354eff07 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:02.948720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7123b94-f256-4793-aa29-6757354eff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:02.948856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7123b94-f256-4793-aa29-6757354eff07 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:02.949640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7123b94-f256-4793-aa29-6757354eff07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:02.954858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7123b94-f256-4793-aa29-6757354eff07 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:03.013469 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1807/3598] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:02 2021] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:03.016274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f1373-a84b-42b4-9bf3-0867ca3ff04b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:03.051617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f1373-a84b-42b4-9bf3-0867ca3ff04b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:03.057469 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1792/3599] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:02 2021] POST /identity/v3/projects => generated 377 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:03.065602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7123b94-f256-4793-aa29-6757354eff07 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:03.070834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4de52-8080-4a3c-8f8a-2e91b345fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:03.072889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4de52-8080-4a3c-8f8a-2e91b345fe74 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:03.075470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4de52-8080-4a3c-8f8a-2e91b345fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:03.075702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4de52-8080-4a3c-8f8a-2e91b345fe74 admin admin] PATH_INFO: `/v3/projects/bde0107b70f54fe698bf3cfe128ce021/users/2f47924de2614a2d89ae8b57f7c13f53/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:03.078821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4de52-8080-4a3c-8f8a-2e91b345fe74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde0107b70f54fe698bf3cfe128ce021, user_id=2f47924de2614a2d89ae8b57f7c13f53, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:03.088361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4de52-8080-4a3c-8f8a-2e91b345fe74 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:03.138774 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1808/3600] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:03 2021] PUT /identity/v3/projects/bde0107b70f54fe698bf3cfe128ce021/users/2f47924de2614a2d89ae8b57f7c13f53/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:03.154694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899854e-7026-4894-ad9e-310ceef5cbab None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:03.156999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899854e-7026-4894-ad9e-310ceef5cbab None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:03.157592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899854e-7026-4894-ad9e-310ceef5cbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:03.237789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d899854e-7026-4894-ad9e-310ceef5cbab None None] MFA Rules not processed for user `2f47924de2614a2d89ae8b57f7c13f53`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:03.242922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d899854e-7026-4894-ad9e-310ceef5cbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:03.315876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7123b94-f256-4793-aa29-6757354eff07 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:03.449274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7f76f-f0fa-4b77-88e9-8585d62f3e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:03.450060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7f76f-f0fa-4b77-88e9-8585d62f3e30 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:03.450320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7f76f-f0fa-4b77-88e9-8585d62f3e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:03.450595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7f76f-f0fa-4b77-88e9-8585d62f3e30 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:03.451349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7f76f-f0fa-4b77-88e9-8585d62f3e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:03.453286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7f76f-f0fa-4b77-88e9-8585d62f3e30 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:03.473779 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1809/3601] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:03 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:03.515592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899854e-7026-4894-ad9e-310ceef5cbab None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:03.517518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d899854e-7026-4894-ad9e-310ceef5cbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:03.533285 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1793/3602] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:03 2021] POST /identity/v3/users => generated 289 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:55:03.536862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7f76f-f0fa-4b77-88e9-8585d62f3e30 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:03.548342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7f76f-f0fa-4b77-88e9-8585d62f3e30 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:03.563541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a48635-a6c7-433a-8fc1-4904c9bf3c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:03.564432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a48635-a6c7-433a-8fc1-4904c9bf3c81 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:03.564822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a48635-a6c7-433a-8fc1-4904c9bf3c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:03.565109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a48635-a6c7-433a-8fc1-4904c9bf3c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:03.566206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a48635-a6c7-433a-8fc1-4904c9bf3c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:03.568402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a48635-a6c7-433a-8fc1-4904c9bf3c81 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:03.581372 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1794/3603] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:03 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:03.585908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a48635-a6c7-433a-8fc1-4904c9bf3c81 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:03.598480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a48635-a6c7-433a-8fc1-4904c9bf3c81 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:03.606326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1e8d4-0022-46b7-bc22-8823a79ca869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:03.607127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1e8d4-0022-46b7-bc22-8823a79ca869 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:03.607558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1e8d4-0022-46b7-bc22-8823a79ca869 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:03.607936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1e8d4-0022-46b7-bc22-8823a79ca869 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:03.609082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1e8d4-0022-46b7-bc22-8823a79ca869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:03.613515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1e8d4-0022-46b7-bc22-8823a79ca869 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:03.628179 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1795/3604] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:03 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:03.632286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1e8d4-0022-46b7-bc22-8823a79ca869 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:03.649114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1e8d4-0022-46b7-bc22-8823a79ca869 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:03.665168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899854e-7026-4894-ad9e-310ceef5cbab None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:03.674166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d2273-6ee1-4aac-9364-ee865bbc1b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:03.675983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2273-6ee1-4aac-9364-ee865bbc1b07 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:03.675983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2273-6ee1-4aac-9364-ee865bbc1b07 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:03.675983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d2273-6ee1-4aac-9364-ee865bbc1b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:03.679102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9d2ee-e31d-4bc8-9b04-b6e6b8748c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:03.684086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9d2ee-e31d-4bc8-9b04-b6e6b8748c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:03.684387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9d2ee-e31d-4bc8-9b04-b6e6b8748c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:03.684678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9d2ee-e31d-4bc8-9b04-b6e6b8748c23 admin admin] PATH_INFO: `/v3/projects/96dc92c435744aec970bf10ba2d33ae0/users/9a5d892d53534c7c8655c972a3865683/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:03.686563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d2273-6ee1-4aac-9364-ee865bbc1b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:03.689372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d2273-6ee1-4aac-9364-ee865bbc1b07 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:03.710598 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1810/3605] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:03 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:03.729156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9d2ee-e31d-4bc8-9b04-b6e6b8748c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96dc92c435744aec970bf10ba2d33ae0, user_id=9a5d892d53534c7c8655c972a3865683, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:03.733182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9d2ee-e31d-4bc8-9b04-b6e6b8748c23 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:03.752685 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1796/3606] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:03 2021] PUT /identity/v3/projects/96dc92c435744aec970bf10ba2d33ae0/users/9a5d892d53534c7c8655c972a3865683/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:03.770863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2b3d-62d0-4de0-879d-bb0a16aa3a68 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:03.771198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2b3d-62d0-4de0-879d-bb0a16aa3a68 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:03.771929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d2b3d-62d0-4de0-879d-bb0a16aa3a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:03.809651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5c0d2b3d-62d0-4de0-879d-bb0a16aa3a68 None None] MFA Rules not processed for user `9a5d892d53534c7c8655c972a3865683`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:03.811178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5c0d2b3d-62d0-4de0-879d-bb0a16aa3a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:03.899227 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1811/3607] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:03 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:03.905388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9d2ee-e31d-4bc8-9b04-b6e6b8748c23 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:04.006731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9d2ee-e31d-4bc8-9b04-b6e6b8748c23 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:04.021214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2433d-41b6-4d47-9e9f-1f2716b12a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:04.022385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2433d-41b6-4d47-9e9f-1f2716b12a0a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:04.022543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2433d-41b6-4d47-9e9f-1f2716b12a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:04.022819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2433d-41b6-4d47-9e9f-1f2716b12a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:04.023579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2433d-41b6-4d47-9e9f-1f2716b12a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:04.028554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2433d-41b6-4d47-9e9f-1f2716b12a0a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:04.085577 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1797/3608] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:03 2021] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:04.089613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d2b3d-62d0-4de0-879d-bb0a16aa3a68 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:04.107174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d2b3d-62d0-4de0-879d-bb0a16aa3a68 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:04.214250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f900cea-bd1f-4f5a-b1cd-572ed265acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:04.216360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f900cea-bd1f-4f5a-b1cd-572ed265acf2 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:04.217194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f900cea-bd1f-4f5a-b1cd-572ed265acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:04.217669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f900cea-bd1f-4f5a-b1cd-572ed265acf2 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:04.218886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f900cea-bd1f-4f5a-b1cd-572ed265acf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:04.228880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f900cea-bd1f-4f5a-b1cd-572ed265acf2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:04.300140 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1812/3609] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:04 2021] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:04.307941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2433d-41b6-4d47-9e9f-1f2716b12a0a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:04.330062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2433d-41b6-4d47-9e9f-1f2716b12a0a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:04.338399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecb9d4-38c1-4d01-af12-b134ecc763a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:04.339955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecb9d4-38c1-4d01-af12-b134ecc763a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:04.341054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecb9d4-38c1-4d01-af12-b134ecc763a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:04.341688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeecb9d4-38c1-4d01-af12-b134ecc763a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:04.342567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecb9d4-38c1-4d01-af12-b134ecc763a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:04.345137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeecb9d4-38c1-4d01-af12-b134ecc763a2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:04.380455 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1798/3610] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:04 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:04.385650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f900cea-bd1f-4f5a-b1cd-572ed265acf2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:04.399195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f900cea-bd1f-4f5a-b1cd-572ed265acf2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:04.440578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d063d-7d3f-4981-b574-145aba371d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:04.446654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d063d-7d3f-4981-b574-145aba371d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:04.447018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d063d-7d3f-4981-b574-145aba371d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:04.449167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d063d-7d3f-4981-b574-145aba371d9b admin admin] PATH_INFO: `/v3/projects/4d78fbd92b384e1993e88af69c85c6cf/users/e7ce19edad6d4f739ccdb14e3b92efb6/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:04.503322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d063d-7d3f-4981-b574-145aba371d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d78fbd92b384e1993e88af69c85c6cf, user_id=e7ce19edad6d4f739ccdb14e3b92efb6, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:04.506271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d063d-7d3f-4981-b574-145aba371d9b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:04.565353 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1813/3611] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:04 2021] PUT /identity/v3/projects/4d78fbd92b384e1993e88af69c85c6cf/users/e7ce19edad6d4f739ccdb14e3b92efb6/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:04.568855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecb9d4-38c1-4d01-af12-b134ecc763a2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:04.587549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeecb9d4-38c1-4d01-af12-b134ecc763a2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:04.684548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d063d-7d3f-4981-b574-145aba371d9b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:04.688449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-773d063d-7d3f-4981-b574-145aba371d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:04.745170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a03c2-8622-499b-b22b-a24d876fe617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:04.745170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a03c2-8622-499b-b22b-a24d876fe617 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:04.745170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a03c2-8622-499b-b22b-a24d876fe617 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:04.746927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a03c2-8622-499b-b22b-a24d876fe617 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:04.751589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a03c2-8622-499b-b22b-a24d876fe617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:04.757367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a03c2-8622-499b-b22b-a24d876fe617 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:04.783091 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1799/3612] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:04 2021] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:04.785630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a03c2-8622-499b-b22b-a24d876fe617 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:04.835358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a03c2-8622-499b-b22b-a24d876fe617 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:04.863873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39378911-60b2-4d4e-804f-9b320efe9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:04.863873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39378911-60b2-4d4e-804f-9b320efe9e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:04.863873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39378911-60b2-4d4e-804f-9b320efe9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:04.863873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39378911-60b2-4d4e-804f-9b320efe9e8c admin admin] PATH_INFO: `/v3/projects/4d78fbd92b384e1993e88af69c85c6cf/users/e7ce19edad6d4f739ccdb14e3b92efb6/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:04.875020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39378911-60b2-4d4e-804f-9b320efe9e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d78fbd92b384e1993e88af69c85c6cf, user_id=e7ce19edad6d4f739ccdb14e3b92efb6, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:04.880357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39378911-60b2-4d4e-804f-9b320efe9e8c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:04.905450 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1800/3613] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:04 2021] PUT /identity/v3/projects/4d78fbd92b384e1993e88af69c85c6cf/users/e7ce19edad6d4f739ccdb14e3b92efb6/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:04.917135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43139-dfe0-4ce5-ab76-c0a0300bc422 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:04.917634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43139-dfe0-4ce5-ab76-c0a0300bc422 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:04.918086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43139-dfe0-4ce5-ab76-c0a0300bc422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:04.967560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d063d-7d3f-4981-b574-145aba371d9b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:04.981180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-84b43139-dfe0-4ce5-ab76-c0a0300bc422 None None] MFA Rules not processed for user `e7ce19edad6d4f739ccdb14e3b92efb6`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:04.983631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-84b43139-dfe0-4ce5-ab76-c0a0300bc422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:05.117288 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1801/3614] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:04 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:05.122751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b43139-dfe0-4ce5-ab76-c0a0300bc422 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:05.135009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6981c56-992d-4928-90be-05ac6e5787f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:05.137352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6981c56-992d-4928-90be-05ac6e5787f2 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:05.137657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6981c56-992d-4928-90be-05ac6e5787f2 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:05.138961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6981c56-992d-4928-90be-05ac6e5787f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:05.139206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b43139-dfe0-4ce5-ab76-c0a0300bc422 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:05.144095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b6981c56-992d-4928-90be-05ac6e5787f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:05.147019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102dafe-f87f-4241-8055-67f664a5f477 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ce19edad6d4f739ccdb14e3b92efb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d78fbd92b384e1993e88af69c85c6cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:05.148022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102dafe-f87f-4241-8055-67f664a5f477 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:05.148913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102dafe-f87f-4241-8055-67f664a5f477 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:05.148913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102dafe-f87f-4241-8055-67f664a5f477 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:05.149590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102dafe-f87f-4241-8055-67f664a5f477 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:05.152222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102dafe-f87f-4241-8055-67f664a5f477 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:05.206018 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1802/3615] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:05 2021] POST /identity/v3/projects => generated 334 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:05.210391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102dafe-f87f-4241-8055-67f664a5f477 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:05.313102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6981c56-992d-4928-90be-05ac6e5787f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:05.314878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6981c56-992d-4928-90be-05ac6e5787f2 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:05.321771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102dafe-f87f-4241-8055-67f664a5f477 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:05.327486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae65a-6b59-4e2f-a504-ba6e070d26ba tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ce19edad6d4f739ccdb14e3b92efb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d78fbd92b384e1993e88af69c85c6cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:05.328147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae65a-6b59-4e2f-a504-ba6e070d26ba tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:05.328431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae65a-6b59-4e2f-a504-ba6e070d26ba tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:05.328712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae65a-6b59-4e2f-a504-ba6e070d26ba tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:05.329418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ae65a-6b59-4e2f-a504-ba6e070d26ba tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:05.331752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ae65a-6b59-4e2f-a504-ba6e070d26ba tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:05.335146 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1814/3616] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:04 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:55:05.354311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6981c56-992d-4928-90be-05ac6e5787f2 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:05.389975 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1803/3617] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 20:55:05 2021] POST /identity/v3/projects => generated 332 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:05.391750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae65a-6b59-4e2f-a504-ba6e070d26ba tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:05.491053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae65a-6b59-4e2f-a504-ba6e070d26ba tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:05.518099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e274e1-9b63-407d-b6cc-a6ef12ef458d tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ce19edad6d4f739ccdb14e3b92efb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d78fbd92b384e1993e88af69c85c6cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:05.518785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e274e1-9b63-407d-b6cc-a6ef12ef458d tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:05.519154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e274e1-9b63-407d-b6cc-a6ef12ef458d tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:05.519379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e274e1-9b63-407d-b6cc-a6ef12ef458d tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:05.520097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e274e1-9b63-407d-b6cc-a6ef12ef458d tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:05.522140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6981c56-992d-4928-90be-05ac6e5787f2 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:05.522450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e274e1-9b63-407d-b6cc-a6ef12ef458d tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:05.604737 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1804/3618] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:05 2021] POST /identity/v3/projects => generated 357 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:05.611735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e274e1-9b63-407d-b6cc-a6ef12ef458d tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:05.648116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984e615-8235-4706-9ca2-107485dc640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:05.648925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984e615-8235-4706-9ca2-107485dc640a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:05.653635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984e615-8235-4706-9ca2-107485dc640a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:05.653942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984e615-8235-4706-9ca2-107485dc640a admin admin] PATH_INFO: `/v3/users/4610eaaf223f4389bb8c63ed8669e5d6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:05.655829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984e615-8235-4706-9ca2-107485dc640a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4610eaaf223f4389bb8c63ed8669e5d6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:05.657802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984e615-8235-4706-9ca2-107485dc640a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:05.781488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e274e1-9b63-407d-b6cc-a6ef12ef458d tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:05.783378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1984e615-8235-4706-9ca2-107485dc640a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4610eaaf223f4389bb8c63ed8669e5d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:05.785511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1984e615-8235-4706-9ca2-107485dc640a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4610eaaf223f4389bb8c63ed8669e5d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:05.801449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8c3dd-3037-49ea-b1b2-98c7f7e5c119 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ce19edad6d4f739ccdb14e3b92efb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d78fbd92b384e1993e88af69c85c6cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:05.802647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8c3dd-3037-49ea-b1b2-98c7f7e5c119 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:05.803187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8c3dd-3037-49ea-b1b2-98c7f7e5c119 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:05.804042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8c3dd-3037-49ea-b1b2-98c7f7e5c119 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:05.806798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8c3dd-3037-49ea-b1b2-98c7f7e5c119 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:05.809644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1984e615-8235-4706-9ca2-107485dc640a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4610eaaf223f4389bb8c63ed8669e5d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:05.810775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1984e615-8235-4706-9ca2-107485dc640a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4610eaaf223f4389bb8c63ed8669e5d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:05.821181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8c3dd-3037-49ea-b1b2-98c7f7e5c119 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:05.839753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1984e615-8235-4706-9ca2-107485dc640a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4610eaaf223f4389bb8c63ed8669e5d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:05.881863 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1805/3619] 10.222.0.21 () {58 vars in 1130 bytes} [Sat Nov 27 20:55:05 2021] GET /identity/v3/projects => generated 7631 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:55:05.882963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8c3dd-3037-49ea-b1b2-98c7f7e5c119 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:05.885421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7fb8c3dd-3037-49ea-b1b2-98c7f7e5c119 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:05.894631 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1815/3620] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:05 2021] DELETE /identity/v3/users/4610eaaf223f4389bb8c63ed8669e5d6 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:05.896470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0b0e7-81f6-4af6-9d6f-054162a08a1c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:05.896990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0b0e7-81f6-4af6-9d6f-054162a08a1c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:05.897393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0b0e7-81f6-4af6-9d6f-054162a08a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:05.923090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8c3dd-3037-49ea-b1b2-98c7f7e5c119 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:05.936094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f7c0b0e7-81f6-4af6-9d6f-054162a08a1c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:05.937334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f7c0b0e7-81f6-4af6-9d6f-054162a08a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:06.034565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb08c0-a5b9-49e3-8518-c224ad0c5b6c tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ce19edad6d4f739ccdb14e3b92efb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d78fbd92b384e1993e88af69c85c6cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:06.035240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb08c0-a5b9-49e3-8518-c224ad0c5b6c tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:06.035830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb08c0-a5b9-49e3-8518-c224ad0c5b6c tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:06.035961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb08c0-a5b9-49e3-8518-c224ad0c5b6c tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:06.036647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb08c0-a5b9-49e3-8518-c224ad0c5b6c tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:06.036955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb08c0-a5b9-49e3-8518-c224ad0c5b6c tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:06.038840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb08c0-a5b9-49e3-8518-c224ad0c5b6c tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:06.056859 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1816/3621] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:06.057639 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1806/3622] 10.222.0.21 () {58 vars in 1157 bytes} [Sat Nov 27 20:55:05 2021] GET /identity/v3/projects?enabled=False => generated 445 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:55:06.067300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0b0e7-81f6-4af6-9d6f-054162a08a1c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:06.067479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb08c0-a5b9-49e3-8518-c224ad0c5b6c tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:06.070159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-49fb08c0-a5b9-49e3-8518-c224ad0c5b6c tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:06.079121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0b0e7-81f6-4af6-9d6f-054162a08a1c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:06.084782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d489556-bc90-420c-ae0a-0cbf291c4cb4 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ce19edad6d4f739ccdb14e3b92efb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d78fbd92b384e1993e88af69c85c6cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:06.085440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d489556-bc90-420c-ae0a-0cbf291c4cb4 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:06.085725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d489556-bc90-420c-ae0a-0cbf291c4cb4 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:06.086003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d489556-bc90-420c-ae0a-0cbf291c4cb4 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:06.086803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d489556-bc90-420c-ae0a-0cbf291c4cb4 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Adding query filter params (parent_id=0f25eab40beb46ceaeed048e77a33e31) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:06.087111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d489556-bc90-420c-ae0a-0cbf291c4cb4 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:06.089289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d489556-bc90-420c-ae0a-0cbf291c4cb4 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:06.132785 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1817/3623] 10.222.0.21 () {58 vars in 1215 bytes} [Sat Nov 27 20:55:06 2021] GET /identity/v3/projects?parent_id=0f25eab40beb46ceaeed048e77a33e31 => generated 497 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:06.138925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d489556-bc90-420c-ae0a-0cbf291c4cb4 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:06.148556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb08c0-a5b9-49e3-8518-c224ad0c5b6c tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:06.149787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d489556-bc90-420c-ae0a-0cbf291c4cb4 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:06.162549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c16746-e501-45dd-a6db-05a803ec4a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:06.163330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c16746-e501-45dd-a6db-05a803ec4a83 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:06.163964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c16746-e501-45dd-a6db-05a803ec4a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:06.163964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c16746-e501-45dd-a6db-05a803ec4a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:06.173870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ce19edad6d4f739ccdb14e3b92efb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d78fbd92b384e1993e88af69c85c6cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:06.174746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:06.175223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:06.175698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] PATH_INFO: `/v3/projects/7227235124a646309df7b9b54dad8544` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:06.177145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7227235124a646309df7b9b54dad8544)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:06.177847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c16746-e501-45dd-a6db-05a803ec4a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:06.179597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:06.179755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c16746-e501-45dd-a6db-05a803ec4a83 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:06.191298 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1807/3624] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:06.290021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7227235124a646309df7b9b54dad8544', 'request_id': 'req-459d0b95-ae0a-405b-afb2-8ec6796bb164'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.306151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7227235124a646309df7b9b54dad8544', 'request_id': 'req-459d0b95-ae0a-405b-afb2-8ec6796bb164'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.321757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7227235124a646309df7b9b54dad8544', 'request_id': 'req-459d0b95-ae0a-405b-afb2-8ec6796bb164'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.349894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] The token cache is being invalidate because project 7227235124a646309df7b9b54dad8544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:06.351072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.353951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.361854 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1818/3625] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:06 2021] DELETE /identity/v3/projects/7227235124a646309df7b9b54dad8544 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:06.362806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c16746-e501-45dd-a6db-05a803ec4a83 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:06.378510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c16746-e501-45dd-a6db-05a803ec4a83 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:06.498178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ce19edad6d4f739ccdb14e3b92efb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d78fbd92b384e1993e88af69c85c6cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:06.499517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:06.500104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:06.501172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] PATH_INFO: `/v3/projects/0f25eab40beb46ceaeed048e77a33e31` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:06.502634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f25eab40beb46ceaeed048e77a33e31)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:06.504932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:06.571753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f25eab40beb46ceaeed048e77a33e31', 'request_id': 'req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.582773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f25eab40beb46ceaeed048e77a33e31', 'request_id': 'req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.590976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f25eab40beb46ceaeed048e77a33e31', 'request_id': 'req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.606143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] The token cache is being invalidate because project 0f25eab40beb46ceaeed048e77a33e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:06.606834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.607679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.612350 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1808/3626] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:06 2021] DELETE /identity/v3/projects/0f25eab40beb46ceaeed048e77a33e31 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:06.616216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:06.617671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:06.630328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:06.633741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:06.648152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0b95-ae0a-405b-afb2-8ec6796bb164 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:06.754352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fab4ca-a764-4e50-9fd7-eb23f221f19f tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:06.759949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:06.762464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ce19edad6d4f739ccdb14e3b92efb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d78fbd92b384e1993e88af69c85c6cf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:06.763765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:06.763907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:06.764133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:06.764329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:06.764453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] PATH_INFO: `/v3/projects/e3ba31f5d83b4626b1c8b2c665e09383` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:06.764786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] PATH_INFO: `/v3/projects/4378784a4250436d8e9131ec0063a5a9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:06.766395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4378784a4250436d8e9131ec0063a5a9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:06.769121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ba31f5d83b4626b1c8b2c665e09383)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:06.769478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:06.771036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:06.833755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4378784a4250436d8e9131ec0063a5a9', 'request_id': 'req-60ecd23f-adca-4f76-b143-367884d90c38'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.842001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4378784a4250436d8e9131ec0063a5a9', 'request_id': 'req-60ecd23f-adca-4f76-b143-367884d90c38'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.853349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4378784a4250436d8e9131ec0063a5a9', 'request_id': 'req-60ecd23f-adca-4f76-b143-367884d90c38'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.873165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] The token cache is being invalidate because project 4378784a4250436d8e9131ec0063a5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:06.873710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.874842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.877158 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1819/3627] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:06 2021] DELETE /identity/v3/projects/4378784a4250436d8e9131ec0063a5a9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:06.877649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ba31f5d83b4626b1c8b2c665e09383', 'request_id': 'req-0617ec11-8e12-452b-a8a4-471ed1364ac7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.881529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:06.886650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:06.892976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ba31f5d83b4626b1c8b2c665e09383', 'request_id': 'req-0617ec11-8e12-452b-a8a4-471ed1364ac7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.904212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ba31f5d83b4626b1c8b2c665e09383', 'request_id': 'req-0617ec11-8e12-452b-a8a4-471ed1364ac7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.923850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] The token cache is being invalidate because project e3ba31f5d83b4626b1c8b2c665e09383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:06.924318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.925098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:06.927079 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1809/3628] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:06 2021] DELETE /identity/v3/projects/e3ba31f5d83b4626b1c8b2c665e09383 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:06.931183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:06.932908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:06.986128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecd23f-adca-4f76-b143-367884d90c38 tempest-ListProjectsTestJSON-939740901 tempest-ListProjectsTestJSON-939740901-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:07.037246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617ec11-8e12-452b-a8a4-471ed1364ac7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:07.051914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d8ac7-2d18-4913-b276-9965887b5d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:07.052839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d8ac7-2d18-4913-b276-9965887b5d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:07.053020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d8ac7-2d18-4913-b276-9965887b5d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:07.053300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d8ac7-2d18-4913-b276-9965887b5d1b admin admin] PATH_INFO: `/v3/users/2f47924de2614a2d89ae8b57f7c13f53` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:07.063702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d8ac7-2d18-4913-b276-9965887b5d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f47924de2614a2d89ae8b57f7c13f53)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:07.065715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d8ac7-2d18-4913-b276-9965887b5d1b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:07.086699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:07.087812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:07.088138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:07.088511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] PATH_INFO: `/v3/users/9a5d892d53534c7c8655c972a3865683` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:07.090796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a5d892d53534c7c8655c972a3865683)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:07.099245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:07.153228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-355d8ac7-2d18-4913-b276-9965887b5d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f47924de2614a2d89ae8b57f7c13f53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.164515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a5d892d53534c7c8655c972a3865683'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.166014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a5d892d53534c7c8655c972a3865683'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.166308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-355d8ac7-2d18-4913-b276-9965887b5d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f47924de2614a2d89ae8b57f7c13f53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.167165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-355d8ac7-2d18-4913-b276-9965887b5d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f47924de2614a2d89ae8b57f7c13f53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.175694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a5d892d53534c7c8655c972a3865683'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.175882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-355d8ac7-2d18-4913-b276-9965887b5d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f47924de2614a2d89ae8b57f7c13f53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.176413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a5d892d53534c7c8655c972a3865683'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.183692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a5d892d53534c7c8655c972a3865683'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.189778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-355d8ac7-2d18-4913-b276-9965887b5d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f47924de2614a2d89ae8b57f7c13f53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.196580 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1810/3629] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:06 2021] DELETE /identity/v3/users/2f47924de2614a2d89ae8b57f7c13f53 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:07.204543 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1820/3630] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:06 2021] DELETE /identity/v3/users/9a5d892d53534c7c8655c972a3865683 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:07.209349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c00233-888b-4a2c-a81c-e9bd5c4585c9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:07.210002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c00233-888b-4a2c-a81c-e9bd5c4585c9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:07.210002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c00233-888b-4a2c-a81c-e9bd5c4585c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:07.228612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-06c00233-888b-4a2c-a81c-e9bd5c4585c9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:07.229823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-06c00233-888b-4a2c-a81c-e9bd5c4585c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:07.295598 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1811/3631] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:07.307486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:07.309119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:07.384273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b4124-88b8-4fc2-a01a-26070ce9101e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:07.388581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f792e-97dc-45c7-b57b-15663e397955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:07.389293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f792e-97dc-45c7-b57b-15663e397955 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:07.389653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f792e-97dc-45c7-b57b-15663e397955 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:07.389931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f792e-97dc-45c7-b57b-15663e397955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:07.400431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f792e-97dc-45c7-b57b-15663e397955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:07.401986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f792e-97dc-45c7-b57b-15663e397955 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:07.412838 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1821/3632] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:07.493784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c00233-888b-4a2c-a81c-e9bd5c4585c9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:07.496211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-06c00233-888b-4a2c-a81c-e9bd5c4585c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:07.525947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c00233-888b-4a2c-a81c-e9bd5c4585c9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:07.532158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:07.535665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:07.536034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:07.536318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] PATH_INFO: `/v3/projects/bde0107b70f54fe698bf3cfe128ce021` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:07.537753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde0107b70f54fe698bf3cfe128ce021)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:07.539846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:07.597148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde0107b70f54fe698bf3cfe128ce021', 'request_id': 'req-0b713388-c231-436f-bb98-944b2fd41f57'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.609304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde0107b70f54fe698bf3cfe128ce021', 'request_id': 'req-0b713388-c231-436f-bb98-944b2fd41f57'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.617795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde0107b70f54fe698bf3cfe128ce021', 'request_id': 'req-0b713388-c231-436f-bb98-944b2fd41f57'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.631964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] The token cache is being invalidate because project bde0107b70f54fe698bf3cfe128ce021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:07.632377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.633210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0b713388-c231-436f-bb98-944b2fd41f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.640238 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1812/3633] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:07 2021] DELETE /identity/v3/projects/bde0107b70f54fe698bf3cfe128ce021 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:07.641936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97991def-0ab6-4f9e-ad0a-c8239ab12f16 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:07.642317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97991def-0ab6-4f9e-ad0a-c8239ab12f16 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:07.642580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97991def-0ab6-4f9e-ad0a-c8239ab12f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:07.661646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-97991def-0ab6-4f9e-ad0a-c8239ab12f16 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:07.662918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-97991def-0ab6-4f9e-ad0a-c8239ab12f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:07.753753 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1822/3634] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:07.763008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef796784-7481-435b-bfbf-c27a6c443b4c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:07.763334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef796784-7481-435b-bfbf-c27a6c443b4c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:07.763640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef796784-7481-435b-bfbf-c27a6c443b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:07.777190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97991def-0ab6-4f9e-ad0a-c8239ab12f16 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:07.778773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-97991def-0ab6-4f9e-ad0a-c8239ab12f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:07.800240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97991def-0ab6-4f9e-ad0a-c8239ab12f16 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:07.814742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:07.815659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:07.816086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:07.816472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] PATH_INFO: `/v3/projects/96dc92c435744aec970bf10ba2d33ae0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:07.817135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ef796784-7481-435b-bfbf-c27a6c443b4c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:07.817611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] RBAC: Authorizing `identity:delete_project(project_id=96dc92c435744aec970bf10ba2d33ae0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:07.818507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ef796784-7481-435b-bfbf-c27a6c443b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:07.820278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:07.832490 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1813/3635] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:07.833966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef796784-7481-435b-bfbf-c27a6c443b4c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:07.845151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef796784-7481-435b-bfbf-c27a6c443b4c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:07.856879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67126a4-64f4-4fbd-85ee-05cf75f61b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:07.857560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67126a4-64f4-4fbd-85ee-05cf75f61b59 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:07.857846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67126a4-64f4-4fbd-85ee-05cf75f61b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:07.858137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67126a4-64f4-4fbd-85ee-05cf75f61b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:07.858888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67126a4-64f4-4fbd-85ee-05cf75f61b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:07.859184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67126a4-64f4-4fbd-85ee-05cf75f61b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:07.861197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67126a4-64f4-4fbd-85ee-05cf75f61b59 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:07.878568 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1814/3636] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:07.878732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96dc92c435744aec970bf10ba2d33ae0', 'request_id': 'req-dcfa46b6-a600-447b-8e94-bf3bc514709f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.879519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67126a4-64f4-4fbd-85ee-05cf75f61b59 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:07.883407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96dc92c435744aec970bf10ba2d33ae0', 'request_id': 'req-dcfa46b6-a600-447b-8e94-bf3bc514709f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.891895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67126a4-64f4-4fbd-85ee-05cf75f61b59 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:07.894224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96dc92c435744aec970bf10ba2d33ae0', 'request_id': 'req-dcfa46b6-a600-447b-8e94-bf3bc514709f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.907957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] The token cache is being invalidate because project 96dc92c435744aec970bf10ba2d33ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:07.908338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.909078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:07.910936 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1823/3637] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:07 2021] DELETE /identity/v3/projects/96dc92c435744aec970bf10ba2d33ae0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:55:07.914530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:07.915924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:07.955457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a4ba-78b4-45c8-bc2b-685044ce20e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:07.956182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a4ba-78b4-45c8-bc2b-685044ce20e6 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:07.956472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a4ba-78b4-45c8-bc2b-685044ce20e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:07.957175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a4ba-78b4-45c8-bc2b-685044ce20e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:07.959852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962a4ba-78b4-45c8-bc2b-685044ce20e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:07.962548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962a4ba-78b4-45c8-bc2b-685044ce20e6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:07.998060 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1815/3638] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:07 2021] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:55:08.002540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a4ba-78b4-45c8-bc2b-685044ce20e6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:08.005998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d962a4ba-78b4-45c8-bc2b-685044ce20e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:08.014713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa46b6-a600-447b-8e94-bf3bc514709f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:08.082960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:08.084007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.084163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.084432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] PATH_INFO: `/v3/users/e7ce19edad6d4f739ccdb14e3b92efb6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.085802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ce19edad6d4f739ccdb14e3b92efb6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:08.087756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:08.101533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a4ba-78b4-45c8-bc2b-685044ce20e6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:08.107154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306fef1-1702-4f9d-ae0a-b3d0b235a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:08.107631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306fef1-1702-4f9d-ae0a-b3d0b235a380 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.107987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306fef1-1702-4f9d-ae0a-b3d0b235a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.108364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306fef1-1702-4f9d-ae0a-b3d0b235a380 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.109081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306fef1-1702-4f9d-ae0a-b3d0b235a380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:08.110978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306fef1-1702-4f9d-ae0a-b3d0b235a380 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:08.138724 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1816/3639] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:08 2021] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:55:08.142854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306fef1-1702-4f9d-ae0a-b3d0b235a380 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:08.156275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ce19edad6d4f739ccdb14e3b92efb6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:08.157267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ce19edad6d4f739ccdb14e3b92efb6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:08.161153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306fef1-1702-4f9d-ae0a-b3d0b235a380 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:08.167781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a99b7-ae40-4356-ab3b-fbd6979ed279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:08.170162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ce19edad6d4f739ccdb14e3b92efb6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:08.171019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ce19edad6d4f739ccdb14e3b92efb6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:08.176148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a99b7-ae40-4356-ab3b-fbd6979ed279 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.176556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a99b7-ae40-4356-ab3b-fbd6979ed279 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.176840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a99b7-ae40-4356-ab3b-fbd6979ed279 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.177631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a99b7-ae40-4356-ab3b-fbd6979ed279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:08.180366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a99b7-ae40-4356-ab3b-fbd6979ed279 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:08.189236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ce19edad6d4f739ccdb14e3b92efb6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:08.198316 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1817/3640] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:08 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:08.199937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a99b7-ae40-4356-ab3b-fbd6979ed279 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:08.203378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-417a99b7-ae40-4356-ab3b-fbd6979ed279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:08.212828 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1824/3641] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:07 2021] DELETE /identity/v3/users/e7ce19edad6d4f739ccdb14e3b92efb6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:55:08.242562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a99b7-ae40-4356-ab3b-fbd6979ed279 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:08.318321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073bef1-56c1-4542-9433-d8b337b820df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:08.319112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073bef1-56c1-4542-9433-d8b337b820df admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.319500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073bef1-56c1-4542-9433-d8b337b820df admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.319846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073bef1-56c1-4542-9433-d8b337b820df admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.320677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073bef1-56c1-4542-9433-d8b337b820df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:08.322323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073bef1-56c1-4542-9433-d8b337b820df admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:08.333493 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1818/3642] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:08 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:08.337486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:08.348800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cff3f-c361-4453-9e65-d6ad148275e3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:08.354102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb188944-74fc-4fff-82f3-efc7761727c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:08.355003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb188944-74fc-4fff-82f3-efc7761727c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.355329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb188944-74fc-4fff-82f3-efc7761727c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.356230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb188944-74fc-4fff-82f3-efc7761727c0 admin admin] PATH_INFO: `/v3/projects/50b227cd822e4eaea7803ae94baee3fe/users/c5205eebafe64393923d02220666e7b8/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.376545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb188944-74fc-4fff-82f3-efc7761727c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b227cd822e4eaea7803ae94baee3fe, user_id=c5205eebafe64393923d02220666e7b8, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:08.379948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb188944-74fc-4fff-82f3-efc7761727c0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:08.397989 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1825/3643] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:08 2021] PUT /identity/v3/projects/50b227cd822e4eaea7803ae94baee3fe/users/c5205eebafe64393923d02220666e7b8/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:08.408652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfa222-1a2b-443f-bf3c-05ba1bee9cbe None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.408938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfa222-1a2b-443f-bf3c-05ba1bee9cbe None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.409216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfa222-1a2b-443f-bf3c-05ba1bee9cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.444544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-03dfa222-1a2b-443f-bf3c-05ba1bee9cbe None None] MFA Rules not processed for user `c5205eebafe64393923d02220666e7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:08.446179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-03dfa222-1a2b-443f-bf3c-05ba1bee9cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:08.546564 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1819/3644] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:08 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:08.559066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb188944-74fc-4fff-82f3-efc7761727c0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:08.561093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bb188944-74fc-4fff-82f3-efc7761727c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:08.623982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfa222-1a2b-443f-bf3c-05ba1bee9cbe None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:08.626055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-03dfa222-1a2b-443f-bf3c-05ba1bee9cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:08.643096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb188944-74fc-4fff-82f3-efc7761727c0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:08.647455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ca375-6c91-4f3b-a4a7-ff4e0a87e195 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:08.648280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ca375-6c91-4f3b-a4a7-ff4e0a87e195 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.648594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ca375-6c91-4f3b-a4a7-ff4e0a87e195 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.648832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ca375-6c91-4f3b-a4a7-ff4e0a87e195 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.658158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ca375-6c91-4f3b-a4a7-ff4e0a87e195 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:08.659652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ca375-6c91-4f3b-a4a7-ff4e0a87e195 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:08.669183 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1826/3645] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:08 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:08.700344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfa222-1a2b-443f-bf3c-05ba1bee9cbe None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:08.706554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:08.707279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.707672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.707822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] PATH_INFO: `/v3/projects/4d78fbd92b384e1993e88af69c85c6cf` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.709046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d78fbd92b384e1993e88af69c85c6cf)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:08.710961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:08.757771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d78fbd92b384e1993e88af69c85c6cf', 'request_id': 'req-6974522a-f813-49fe-ae02-987e12e30f5c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:08.766039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f25bd-ad83-4366-bbb1-79c249699684 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.766227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d78fbd92b384e1993e88af69c85c6cf', 'request_id': 'req-6974522a-f813-49fe-ae02-987e12e30f5c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:08.766340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f25bd-ad83-4366-bbb1-79c249699684 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.766600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f25bd-ad83-4366-bbb1-79c249699684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.772522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d78fbd92b384e1993e88af69c85c6cf', 'request_id': 'req-6974522a-f813-49fe-ae02-987e12e30f5c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:08.783508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] The token cache is being invalidate because project 4d78fbd92b384e1993e88af69c85c6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:08.783797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:08.784447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6974522a-f813-49fe-ae02-987e12e30f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:08.784576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ea7f25bd-ad83-4366-bbb1-79c249699684 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:08.785739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ea7f25bd-ad83-4366-bbb1-79c249699684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:08.786616 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1820/3646] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:08 2021] DELETE /identity/v3/projects/4d78fbd92b384e1993e88af69c85c6cf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:55:08.791797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226c71f-48cf-44f9-87dc-3747f7e343fc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.792081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226c71f-48cf-44f9-87dc-3747f7e343fc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.792353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226c71f-48cf-44f9-87dc-3747f7e343fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.810612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e226c71f-48cf-44f9-87dc-3747f7e343fc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:08.811854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e226c71f-48cf-44f9-87dc-3747f7e343fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:08.867470 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1827/3647] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:55:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:08.880374 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1821/3648] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:08.889870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0799ee-7ffa-485c-8a52-503738c9d6e2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.890212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0799ee-7ffa-485c-8a52-503738c9d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.890491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0799ee-7ffa-485c-8a52-503738c9d6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.892183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f25bd-ad83-4366-bbb1-79c249699684 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:08.893970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ea7f25bd-ad83-4366-bbb1-79c249699684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:08.923601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9e0799ee-7ffa-485c-8a52-503738c9d6e2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:08.926123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e0799ee-7ffa-485c-8a52-503738c9d6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:08.941877 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1822/3649] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:08.944117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0799ee-7ffa-485c-8a52-503738c9d6e2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:08.954218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0799ee-7ffa-485c-8a52-503738c9d6e2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:08.960113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebcb19-7c80-4282-8048-837f3d750304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:08.961357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebcb19-7c80-4282-8048-837f3d750304 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.961685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebcb19-7c80-4282-8048-837f3d750304 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.961914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebcb19-7c80-4282-8048-837f3d750304 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.962681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebcb19-7c80-4282-8048-837f3d750304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:08.963044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebcb19-7c80-4282-8048-837f3d750304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:08.964706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebcb19-7c80-4282-8048-837f3d750304 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:08.980390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f25bd-ad83-4366-bbb1-79c249699684 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:08.987305 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1823/3650] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:08.988351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ccd22-8b59-4a33-afa8-fdaf3c302c30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:08.989020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ccd22-8b59-4a33-afa8-fdaf3c302c30 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:08.989319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ccd22-8b59-4a33-afa8-fdaf3c302c30 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:08.989591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ccd22-8b59-4a33-afa8-fdaf3c302c30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:08.992095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebcb19-7c80-4282-8048-837f3d750304 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:09.001298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ccd22-8b59-4a33-afa8-fdaf3c302c30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:09.005185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ccd22-8b59-4a33-afa8-fdaf3c302c30 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:09.014854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebcb19-7c80-4282-8048-837f3d750304 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:09.021446 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1828/3651] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:55:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:09.034517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c695e6-e193-4ad6-a307-a6664c57a09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:09.035539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c695e6-e193-4ad6-a307-a6664c57a09c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:09.035829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c695e6-e193-4ad6-a307-a6664c57a09c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:09.036105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c695e6-e193-4ad6-a307-a6664c57a09c admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:09.036815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c695e6-e193-4ad6-a307-a6664c57a09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:09.038945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c695e6-e193-4ad6-a307-a6664c57a09c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:09.087658 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1824/3652] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:08 2021] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:09.092003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ccd22-8b59-4a33-afa8-fdaf3c302c30 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:09.105664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ccd22-8b59-4a33-afa8-fdaf3c302c30 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:09.188598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d46214-a54d-4ec9-ac91-698d7d6c5686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:09.189285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46214-a54d-4ec9-ac91-698d7d6c5686 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:09.189575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46214-a54d-4ec9-ac91-698d7d6c5686 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:09.189859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46214-a54d-4ec9-ac91-698d7d6c5686 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:09.190572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d46214-a54d-4ec9-ac91-698d7d6c5686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:09.193271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d46214-a54d-4ec9-ac91-698d7d6c5686 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:09.220936 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1829/3653] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:09 2021] POST /identity/v3/users => generated 284 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:09.225164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c695e6-e193-4ad6-a307-a6664c57a09c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:09.250981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c695e6-e193-4ad6-a307-a6664c57a09c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:09.257084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199057c8-46c6-4a1c-9bae-64f9fa5526e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:09.259348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199057c8-46c6-4a1c-9bae-64f9fa5526e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:09.260325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199057c8-46c6-4a1c-9bae-64f9fa5526e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:09.260983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199057c8-46c6-4a1c-9bae-64f9fa5526e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:09.261951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199057c8-46c6-4a1c-9bae-64f9fa5526e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:09.264057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199057c8-46c6-4a1c-9bae-64f9fa5526e5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:09.276170 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1825/3654] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:09 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:55:09.280303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d46214-a54d-4ec9-ac91-698d7d6c5686 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:09.310449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d46214-a54d-4ec9-ac91-698d7d6c5686 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:09.317167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584be26-6da1-4724-82d5-6061e93821c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:09.317963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584be26-6da1-4724-82d5-6061e93821c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:09.318321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584be26-6da1-4724-82d5-6061e93821c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:09.318673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584be26-6da1-4724-82d5-6061e93821c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:09.320130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584be26-6da1-4724-82d5-6061e93821c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:09.322209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584be26-6da1-4724-82d5-6061e93821c3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:09.335446 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1830/3655] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:09 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:55:09.338703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199057c8-46c6-4a1c-9bae-64f9fa5526e5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:09.351704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199057c8-46c6-4a1c-9bae-64f9fa5526e5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:09.359542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa2b23-48dd-4ee5-83e3-43e57e7cd8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:09.360504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa2b23-48dd-4ee5-83e3-43e57e7cd8c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:09.360856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa2b23-48dd-4ee5-83e3-43e57e7cd8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:09.361256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa2b23-48dd-4ee5-83e3-43e57e7cd8c0 admin admin] PATH_INFO: `/v3/projects/32a71281c9e04a7d81b28667f50d510d/users/5b22dcec915b47e4b436eb6ed5f6cfc1/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:09.381965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa2b23-48dd-4ee5-83e3-43e57e7cd8c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a71281c9e04a7d81b28667f50d510d, user_id=5b22dcec915b47e4b436eb6ed5f6cfc1, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:09.385701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa2b23-48dd-4ee5-83e3-43e57e7cd8c0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:09.404837 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1826/3656] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:09 2021] PUT /identity/v3/projects/32a71281c9e04a7d81b28667f50d510d/users/5b22dcec915b47e4b436eb6ed5f6cfc1/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:55:09.415811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35507691-d6fc-402a-8964-9f027043e90d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:09.417207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35507691-d6fc-402a-8964-9f027043e90d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:09.419059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35507691-d6fc-402a-8964-9f027043e90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:09.476923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-35507691-d6fc-402a-8964-9f027043e90d None None] MFA Rules not processed for user `5b22dcec915b47e4b436eb6ed5f6cfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:09.478505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-35507691-d6fc-402a-8964-9f027043e90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:09.577248 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1831/3657] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:09 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:09.577952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa2b23-48dd-4ee5-83e3-43e57e7cd8c0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:09.727665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa2b23-48dd-4ee5-83e3-43e57e7cd8c0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:09.734562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d1617-8f29-44e4-b977-427a880de347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:09.735238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d1617-8f29-44e4-b977-427a880de347 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:09.735579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d1617-8f29-44e4-b977-427a880de347 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:09.735862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d1617-8f29-44e4-b977-427a880de347 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:09.739818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d1617-8f29-44e4-b977-427a880de347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:09.742073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d1617-8f29-44e4-b977-427a880de347 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:09.777012 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1827/3658] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:09 2021] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:09.780808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35507691-d6fc-402a-8964-9f027043e90d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:09.798451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35507691-d6fc-402a-8964-9f027043e90d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:09.900610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb050336-a196-438e-abca-1dee6f34f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:09.901288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050336-a196-438e-abca-1dee6f34f69b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:09.901591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050336-a196-438e-abca-1dee6f34f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:09.901984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050336-a196-438e-abca-1dee6f34f69b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:09.903102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb050336-a196-438e-abca-1dee6f34f69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:09.911738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb050336-a196-438e-abca-1dee6f34f69b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:09.934610 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1832/3659] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:09 2021] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:09.938569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d1617-8f29-44e4-b977-427a880de347 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:09.954456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d1617-8f29-44e4-b977-427a880de347 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:09.961917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e42685-4d6f-4d87-90d8-46a2039531d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:09.962634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e42685-4d6f-4d87-90d8-46a2039531d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:09.962924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e42685-4d6f-4d87-90d8-46a2039531d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:09.963267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e42685-4d6f-4d87-90d8-46a2039531d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:09.964473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e42685-4d6f-4d87-90d8-46a2039531d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:09.966796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e42685-4d6f-4d87-90d8-46a2039531d2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:09.986739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb050336-a196-438e-abca-1dee6f34f69b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:09.988014 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1828/3660] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:09 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:10.004569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb050336-a196-438e-abca-1dee6f34f69b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:10.012264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714a9db-b165-43c9-a72c-f3dd626184fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:10.020152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714a9db-b165-43c9-a72c-f3dd626184fc admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:10.020455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714a9db-b165-43c9-a72c-f3dd626184fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:10.020697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714a9db-b165-43c9-a72c-f3dd626184fc admin admin] PATH_INFO: `/v3/projects/9f13a51e86724c959675dc345fa31e3c/users/ad08509d4f6e4da283db11fb65ae18ce/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:10.057230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714a9db-b165-43c9-a72c-f3dd626184fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f13a51e86724c959675dc345fa31e3c, user_id=ad08509d4f6e4da283db11fb65ae18ce, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:10.060002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714a9db-b165-43c9-a72c-f3dd626184fc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:10.087111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e42685-4d6f-4d87-90d8-46a2039531d2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:10.087649 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1833/3661] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:09 2021] PUT /identity/v3/projects/9f13a51e86724c959675dc345fa31e3c/users/ad08509d4f6e4da283db11fb65ae18ce/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:10.098601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e42685-4d6f-4d87-90d8-46a2039531d2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:10.103399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60907-6798-4c2f-8141-335d20106bd4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:10.103780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60907-6798-4c2f-8141-335d20106bd4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:10.104112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60907-6798-4c2f-8141-335d20106bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:10.151282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-92d60907-6798-4c2f-8141-335d20106bd4 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:10.153450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-92d60907-6798-4c2f-8141-335d20106bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:10.245676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf86f4f-18c7-4490-b57c-e9cf29622411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:10.247031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf86f4f-18c7-4490-b57c-e9cf29622411 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:10.247573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf86f4f-18c7-4490-b57c-e9cf29622411 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:10.248099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf86f4f-18c7-4490-b57c-e9cf29622411 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:10.249099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf86f4f-18c7-4490-b57c-e9cf29622411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:10.255076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf86f4f-18c7-4490-b57c-e9cf29622411 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:10.260305 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1834/3662] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:55:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:10.279373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d60907-6798-4c2f-8141-335d20106bd4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:10.289882 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1829/3663] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:10 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:10.294223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf86f4f-18c7-4490-b57c-e9cf29622411 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:10.318636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf86f4f-18c7-4490-b57c-e9cf29622411 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:10.332971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb89de-9b4d-4ad2-828e-3cb32fefefa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:10.334548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb89de-9b4d-4ad2-828e-3cb32fefefa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:10.334548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb89de-9b4d-4ad2-828e-3cb32fefefa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:10.334548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb89de-9b4d-4ad2-828e-3cb32fefefa6 admin admin] PATH_INFO: `/v3/projects/9f13a51e86724c959675dc345fa31e3c/users/ad08509d4f6e4da283db11fb65ae18ce/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:10.338552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb89de-9b4d-4ad2-828e-3cb32fefefa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f13a51e86724c959675dc345fa31e3c, user_id=ad08509d4f6e4da283db11fb65ae18ce, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:10.343746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb89de-9b4d-4ad2-828e-3cb32fefefa6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:10.390087 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1830/3664] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:10 2021] PUT /identity/v3/projects/9f13a51e86724c959675dc345fa31e3c/users/ad08509d4f6e4da283db11fb65ae18ce/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:10.401138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80650-c0b8-49d5-806a-0979db67a6e1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:10.401496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80650-c0b8-49d5-806a-0979db67a6e1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:10.401859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80650-c0b8-49d5-806a-0979db67a6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:10.503160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d60907-6798-4c2f-8141-335d20106bd4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:10.505991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-56b80650-c0b8-49d5-806a-0979db67a6e1 None None] MFA Rules not processed for user `ad08509d4f6e4da283db11fb65ae18ce`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:10.509150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-56b80650-c0b8-49d5-806a-0979db67a6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:10.670846 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1831/3665] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:10 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:10.676608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b80650-c0b8-49d5-806a-0979db67a6e1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:10.683295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590498c8-da7d-4438-8368-51713c891739 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:10.683978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590498c8-da7d-4438-8368-51713c891739 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:10.684265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590498c8-da7d-4438-8368-51713c891739 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:10.684540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590498c8-da7d-4438-8368-51713c891739 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:10.688829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b80650-c0b8-49d5-806a-0979db67a6e1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:10.700368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8a05-4d38-4ca2-8bc0-0d273583ed74 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:10.701292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8a05-4d38-4ca2-8bc0-0d273583ed74 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:10.701727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8a05-4d38-4ca2-8bc0-0d273583ed74 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:10.702053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8a05-4d38-4ca2-8bc0-0d273583ed74 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:10.703099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db8a05-4d38-4ca2-8bc0-0d273583ed74 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:10.705561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db8a05-4d38-4ca2-8bc0-0d273583ed74 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:10.764222 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1832/3666] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:10 2021] POST /identity/v3/projects => generated 359 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:10.765777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8a05-4d38-4ca2-8bc0-0d273583ed74 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:10.804279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590498c8-da7d-4438-8368-51713c891739 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:10.806739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590498c8-da7d-4438-8368-51713c891739 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:10.817308 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1835/3667] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:55:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:10.884625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8a05-4d38-4ca2-8bc0-0d273583ed74 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:10.891145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2307c-e606-4ca2-b381-f721c1d0e2a0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:10.896428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2307c-e606-4ca2-b381-f721c1d0e2a0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:10.896794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2307c-e606-4ca2-b381-f721c1d0e2a0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:10.897945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2307c-e606-4ca2-b381-f721c1d0e2a0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:10.900306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2307c-e606-4ca2-b381-f721c1d0e2a0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:10.910904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2307c-e606-4ca2-b381-f721c1d0e2a0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:10.984277 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1833/3668] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:10 2021] POST /identity/v3/users => generated 369 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:10.985680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590498c8-da7d-4438-8368-51713c891739 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:11.003547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590498c8-da7d-4438-8368-51713c891739 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:11.017871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230acec7-c84d-4fa0-aa27-6751f8a0bee9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:11.020788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230acec7-c84d-4fa0-aa27-6751f8a0bee9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:11.020982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230acec7-c84d-4fa0-aa27-6751f8a0bee9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:11.029398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230acec7-c84d-4fa0-aa27-6751f8a0bee9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/3362fe93cbd344e49c99dfa2e23a39fd` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:11.080567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230acec7-c84d-4fa0-aa27-6751f8a0bee9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:get_user(user_id=3362fe93cbd344e49c99dfa2e23a39fd)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:11.082970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230acec7-c84d-4fa0-aa27-6751f8a0bee9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:11.087267 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1836/3669] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:55:10 2021] GET /identity/v3/users/3362fe93cbd344e49c99dfa2e23a39fd => generated 369 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:11.092196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2307c-e606-4ca2-b381-f721c1d0e2a0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:11.113327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2307c-e606-4ca2-b381-f721c1d0e2a0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:11.135970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:11.142176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:11.142472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:11.142762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/3362fe93cbd344e49c99dfa2e23a39fd` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:11.148222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3362fe93cbd344e49c99dfa2e23a39fd)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:11.151267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:11.257571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3362fe93cbd344e49c99dfa2e23a39fd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:11.273998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3362fe93cbd344e49c99dfa2e23a39fd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:11.276084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3362fe93cbd344e49c99dfa2e23a39fd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:11.293759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3362fe93cbd344e49c99dfa2e23a39fd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:11.308441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3362fe93cbd344e49c99dfa2e23a39fd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:11.319766 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1834/3670] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:11 2021] DELETE /identity/v3/users/3362fe93cbd344e49c99dfa2e23a39fd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:11.321135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230acec7-c84d-4fa0-aa27-6751f8a0bee9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:11.323792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-230acec7-c84d-4fa0-aa27-6751f8a0bee9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:11.341708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230acec7-c84d-4fa0-aa27-6751f8a0bee9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:11.454942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:11.455475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:11.455928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:11.456214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects/d4c6ea048eca47d788d0d3585c9a569b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:11.459340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4c6ea048eca47d788d0d3585c9a569b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:11.463454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:11.611906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c6ea048eca47d788d0d3585c9a569b', 'request_id': 'req-6c4c8374-60d9-449d-adeb-49c6a626690a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:11.640183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c6ea048eca47d788d0d3585c9a569b', 'request_id': 'req-6c4c8374-60d9-449d-adeb-49c6a626690a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:11.658465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c6ea048eca47d788d0d3585c9a569b', 'request_id': 'req-6c4c8374-60d9-449d-adeb-49c6a626690a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:11.699166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] The token cache is being invalidate because project d4c6ea048eca47d788d0d3585c9a569b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:11.700832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:11.703635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:11.714030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:11.726881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affdd55-3bbc-4e2c-bc40-41bf49e061f9 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:11.727105 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1837/3671] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:11 2021] DELETE /identity/v3/projects/d4c6ea048eca47d788d0d3585c9a569b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:11.895788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92001-9273-4cfd-a270-3b16d3ef1dd3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:11.896660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92001-9273-4cfd-a270-3b16d3ef1dd3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:11.896956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92001-9273-4cfd-a270-3b16d3ef1dd3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:11.897237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c92001-9273-4cfd-a270-3b16d3ef1dd3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:11.897952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c92001-9273-4cfd-a270-3b16d3ef1dd3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:11.900331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c92001-9273-4cfd-a270-3b16d3ef1dd3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:11.953670 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1835/3672] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:11 2021] POST /identity/v3/projects => generated 360 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:11.959393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:11.961329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:11.983861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c8374-60d9-449d-adeb-49c6a626690a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:12.129408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a623e5-fd77-4ffd-8edf-88f2127e2fec tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:12.130127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a623e5-fd77-4ffd-8edf-88f2127e2fec tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:12.130414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a623e5-fd77-4ffd-8edf-88f2127e2fec tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:12.130690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a623e5-fd77-4ffd-8edf-88f2127e2fec tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:12.131441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a623e5-fd77-4ffd-8edf-88f2127e2fec tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:12.133302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a623e5-fd77-4ffd-8edf-88f2127e2fec tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:12.185874 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1838/3673] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:11 2021] POST /identity/v3/users => generated 414 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:12.187188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92001-9273-4cfd-a270-3b16d3ef1dd3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:12.204816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c92001-9273-4cfd-a270-3b16d3ef1dd3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:12.212953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707039f-9589-463d-aea9-dcfd7026f621 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:12.216437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707039f-9589-463d-aea9-dcfd7026f621 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:12.216993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707039f-9589-463d-aea9-dcfd7026f621 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:12.218629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707039f-9589-463d-aea9-dcfd7026f621 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:12.219610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707039f-9589-463d-aea9-dcfd7026f621 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:12.227701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707039f-9589-463d-aea9-dcfd7026f621 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:12.260896 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1836/3674] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:55:12 2021] POST /identity/v3/roles => generated 240 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:55:12.262533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a623e5-fd77-4ffd-8edf-88f2127e2fec tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:12.291856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a623e5-fd77-4ffd-8edf-88f2127e2fec tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:12.306573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d201cda-f788-41f7-b641-932f1b36c1ad tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:12.307548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201cda-f788-41f7-b641-932f1b36c1ad tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:12.307870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201cda-f788-41f7-b641-932f1b36c1ad tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:12.308143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201cda-f788-41f7-b641-932f1b36c1ad tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/b3f6993d158e4bddbf51917683e7f21f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:12.350641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d201cda-f788-41f7-b641-932f1b36c1ad tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:get_user(user_id=b3f6993d158e4bddbf51917683e7f21f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:12.363936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d201cda-f788-41f7-b641-932f1b36c1ad tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:12.368672 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1839/3675] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:55:12 2021] GET /identity/v3/users/b3f6993d158e4bddbf51917683e7f21f => generated 414 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:55:12.370698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707039f-9589-463d-aea9-dcfd7026f621 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:12.384691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707039f-9589-463d-aea9-dcfd7026f621 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:12.405448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb55a64-c9ea-4f5a-aac8-1f4736a1069c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:12.406753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55a64-c9ea-4f5a-aac8-1f4736a1069c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:12.407325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55a64-c9ea-4f5a-aac8-1f4736a1069c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:12.407851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb55a64-c9ea-4f5a-aac8-1f4736a1069c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/roles/82104f1ea56a4c67aa8c570c2ee53378` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:12.409654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb55a64-c9ea-4f5a-aac8-1f4736a1069c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:get_role(role_id=82104f1ea56a4c67aa8c570c2ee53378)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:12.411810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb55a64-c9ea-4f5a-aac8-1f4736a1069c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:12.416999 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1837/3676] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:55:12 2021] GET /identity/v3/roles/82104f1ea56a4c67aa8c570c2ee53378 => generated 240 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:12.417742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d201cda-f788-41f7-b641-932f1b36c1ad tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:12.428871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d201cda-f788-41f7-b641-932f1b36c1ad tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:12.456194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1298b3-b455-4b09-9737-5c7c79f37755 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:12.456992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1298b3-b455-4b09-9737-5c7c79f37755 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:12.457436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1298b3-b455-4b09-9737-5c7c79f37755 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:12.457723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1298b3-b455-4b09-9737-5c7c79f37755 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:12.458466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1298b3-b455-4b09-9737-5c7c79f37755 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:12.460430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1298b3-b455-4b09-9737-5c7c79f37755 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:12.552090 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1840/3677] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:12 2021] POST /identity/v3/projects => generated 359 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:55:12.558618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb55a64-c9ea-4f5a-aac8-1f4736a1069c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:12.578412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb55a64-c9ea-4f5a-aac8-1f4736a1069c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:12.717049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2878d4-eca3-47d2-b85e-963fd6f82a92 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:12.718102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2878d4-eca3-47d2-b85e-963fd6f82a92 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:12.718391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2878d4-eca3-47d2-b85e-963fd6f82a92 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:12.718672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2878d4-eca3-47d2-b85e-963fd6f82a92 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects/bb7411f1da50470b8a6197299b1d0b8f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:12.722098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2878d4-eca3-47d2-b85e-963fd6f82a92 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:get_project(project_id=bb7411f1da50470b8a6197299b1d0b8f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:12.727193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2878d4-eca3-47d2-b85e-963fd6f82a92 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:12.734084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1298b3-b455-4b09-9737-5c7c79f37755 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:12.734637 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1838/3678] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:55:12 2021] GET /identity/v3/projects/bb7411f1da50470b8a6197299b1d0b8f => generated 359 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:12.746488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1298b3-b455-4b09-9737-5c7c79f37755 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:12.762611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f69377-0ed8-446d-9567-cb927657ef17 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:12.763732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69377-0ed8-446d-9567-cb927657ef17 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:12.764034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69377-0ed8-446d-9567-cb927657ef17 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:12.765671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69377-0ed8-446d-9567-cb927657ef17 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects/bb7411f1da50470b8a6197299b1d0b8f/users/b3f6993d158e4bddbf51917683e7f21f/roles/82104f1ea56a4c67aa8c570c2ee53378` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:12.772226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f69377-0ed8-446d-9567-cb927657ef17 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bb7411f1da50470b8a6197299b1d0b8f, user_id=b3f6993d158e4bddbf51917683e7f21f, role_id=82104f1ea56a4c67aa8c570c2ee53378)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:12.779757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f69377-0ed8-446d-9567-cb927657ef17 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:12.828783 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1841/3679] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:12 2021] PUT /identity/v3/projects/bb7411f1da50470b8a6197299b1d0b8f/users/b3f6993d158e4bddbf51917683e7f21f/roles/82104f1ea56a4c67aa8c570c2ee53378 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:55:12.830051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2878d4-eca3-47d2-b85e-963fd6f82a92 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:12.841399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2878d4-eca3-47d2-b85e-963fd6f82a92 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:12.970874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43620c-e533-45da-b00b-9149d738463f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:12.971516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43620c-e533-45da-b00b-9149d738463f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:12.971762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43620c-e533-45da-b00b-9149d738463f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:12.972707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43620c-e533-45da-b00b-9149d738463f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:12.974490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43620c-e533-45da-b00b-9149d738463f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:12.977113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43620c-e533-45da-b00b-9149d738463f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:13.043433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f69377-0ed8-446d-9567-cb927657ef17 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:13.043777 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1839/3680] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:12 2021] POST /identity/v3/projects => generated 360 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:13.066614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f69377-0ed8-446d-9567-cb927657ef17 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:13.252720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74d7b8-ddc1-4ff3-8fb1-2abc9ac8d108 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:13.256670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74d7b8-ddc1-4ff3-8fb1-2abc9ac8d108 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:13.257189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74d7b8-ddc1-4ff3-8fb1-2abc9ac8d108 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:13.257844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74d7b8-ddc1-4ff3-8fb1-2abc9ac8d108 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects/d11faeec008a43f396fdf0d29f5513e0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:13.259911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74d7b8-ddc1-4ff3-8fb1-2abc9ac8d108 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:get_project(project_id=d11faeec008a43f396fdf0d29f5513e0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:13.263490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74d7b8-ddc1-4ff3-8fb1-2abc9ac8d108 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:13.271784 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1842/3681] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:55:13 2021] GET /identity/v3/projects/d11faeec008a43f396fdf0d29f5513e0 => generated 360 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:13.273241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43620c-e533-45da-b00b-9149d738463f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:13.292044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43620c-e533-45da-b00b-9149d738463f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:13.321464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d5fcd-b7fc-48c1-a6ef-e93707ab857d tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:13.322339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5fcd-b7fc-48c1-a6ef-e93707ab857d tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:13.324054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5fcd-b7fc-48c1-a6ef-e93707ab857d tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:13.324938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5fcd-b7fc-48c1-a6ef-e93707ab857d tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects/d11faeec008a43f396fdf0d29f5513e0/users/b3f6993d158e4bddbf51917683e7f21f/roles/82104f1ea56a4c67aa8c570c2ee53378` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:13.345968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d5fcd-b7fc-48c1-a6ef-e93707ab857d tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d11faeec008a43f396fdf0d29f5513e0, user_id=b3f6993d158e4bddbf51917683e7f21f, role_id=82104f1ea56a4c67aa8c570c2ee53378)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:13.359745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d5fcd-b7fc-48c1-a6ef-e93707ab857d tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:13.392594 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1840/3682] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:13 2021] PUT /identity/v3/projects/d11faeec008a43f396fdf0d29f5513e0/users/b3f6993d158e4bddbf51917683e7f21f/roles/82104f1ea56a4c67aa8c570c2ee53378 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:55:13.397722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74d7b8-ddc1-4ff3-8fb1-2abc9ac8d108 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:13.464041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74d7b8-ddc1-4ff3-8fb1-2abc9ac8d108 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:13.673708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779f7d2-2518-401f-abd5-ff7bc8f1add8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:13.676700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779f7d2-2518-401f-abd5-ff7bc8f1add8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:13.677643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779f7d2-2518-401f-abd5-ff7bc8f1add8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:13.678576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779f7d2-2518-401f-abd5-ff7bc8f1add8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/b3f6993d158e4bddbf51917683e7f21f/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:13.681595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779f7d2-2518-401f-abd5-ff7bc8f1add8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=b3f6993d158e4bddbf51917683e7f21f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:13.686819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779f7d2-2518-401f-abd5-ff7bc8f1add8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:13.782460 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1843/3683] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 20:55:13 2021] GET /identity/v3/users/b3f6993d158e4bddbf51917683e7f21f/projects => generated 843 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:13.788594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d5fcd-b7fc-48c1-a6ef-e93707ab857d tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:13.808840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d5fcd-b7fc-48c1-a6ef-e93707ab857d tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:13.833192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:13.836410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:13.837158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:13.837449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects/d11faeec008a43f396fdf0d29f5513e0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:13.842018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d11faeec008a43f396fdf0d29f5513e0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:13.843978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:13.979002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11faeec008a43f396fdf0d29f5513e0', 'request_id': 'req-6888e745-047a-4e51-bc0a-2b85943689f3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:13.992552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11faeec008a43f396fdf0d29f5513e0', 'request_id': 'req-6888e745-047a-4e51-bc0a-2b85943689f3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:14.020319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11faeec008a43f396fdf0d29f5513e0', 'request_id': 'req-6888e745-047a-4e51-bc0a-2b85943689f3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:14.055928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] The token cache is being invalidate because project d11faeec008a43f396fdf0d29f5513e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:14.056418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:14.059546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:14.063129 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1841/3684] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:13 2021] DELETE /identity/v3/projects/d11faeec008a43f396fdf0d29f5513e0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:55:14.070303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779f7d2-2518-401f-abd5-ff7bc8f1add8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:14.075747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c779f7d2-2518-401f-abd5-ff7bc8f1add8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:14.118248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779f7d2-2518-401f-abd5-ff7bc8f1add8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:14.203963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:14.204842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:14.205409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:14.205728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects/bb7411f1da50470b8a6197299b1d0b8f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:14.206928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bb7411f1da50470b8a6197299b1d0b8f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:14.209446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:14.375923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7411f1da50470b8a6197299b1d0b8f', 'request_id': 'req-40e5aa38-9da5-4ab9-b552-c617c852d899'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:14.394517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7411f1da50470b8a6197299b1d0b8f', 'request_id': 'req-40e5aa38-9da5-4ab9-b552-c617c852d899'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:14.421684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7411f1da50470b8a6197299b1d0b8f', 'request_id': 'req-40e5aa38-9da5-4ab9-b552-c617c852d899'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:14.464599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] The token cache is being invalidate because project bb7411f1da50470b8a6197299b1d0b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:14.465510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:14.475686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:14.485786 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1844/3685] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:14 2021] DELETE /identity/v3/projects/bb7411f1da50470b8a6197299b1d0b8f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:14.490064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:14.522579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888e745-047a-4e51-bc0a-2b85943689f3 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:14.749459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:14.750362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:14.750638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:14.750919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/roles/82104f1ea56a4c67aa8c570c2ee53378` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:14.756815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:delete_role(role_id=82104f1ea56a4c67aa8c570c2ee53378)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:14.757885 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:14.757885 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:55:14.757885 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:55:14.770200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:14.877307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invalidating the token cache because role 82104f1ea56a4c67aa8c570c2ee53378 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:14.877673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:14.878599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:14.881169 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1842/3686] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:14 2021] DELETE /identity/v3/roles/82104f1ea56a4c67aa8c570c2ee53378 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:14.885354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:14.888083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:14.913577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5aa38-9da5-4ab9-b552-c617c852d899 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:15.002734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:15.004182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:15.004756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:15.005234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/b3f6993d158e4bddbf51917683e7f21f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:15.006786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b3f6993d158e4bddbf51917683e7f21f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:15.008985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:15.081544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f6993d158e4bddbf51917683e7f21f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.082290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f6993d158e4bddbf51917683e7f21f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.092282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f6993d158e4bddbf51917683e7f21f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.093091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f6993d158e4bddbf51917683e7f21f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.103957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f6993d158e4bddbf51917683e7f21f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.131298 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1845/3687] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:14 2021] DELETE /identity/v3/users/b3f6993d158e4bddbf51917683e7f21f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:15.134417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:15.137271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:15.175899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb4527-2910-4065-8eea-0d847519d888 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:15.370628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:15.374956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:15.374956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:15.374956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects/1f6ba2e0b5c14c74a0928ffa73d8eaf4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:15.377040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1f6ba2e0b5c14c74a0928ffa73d8eaf4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:15.380468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:15.479807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6ba2e0b5c14c74a0928ffa73d8eaf4', 'request_id': 'req-af77056a-5e46-46fb-9f90-948877bc6b85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.513950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6ba2e0b5c14c74a0928ffa73d8eaf4', 'request_id': 'req-af77056a-5e46-46fb-9f90-948877bc6b85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.534294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6ba2e0b5c14c74a0928ffa73d8eaf4', 'request_id': 'req-af77056a-5e46-46fb-9f90-948877bc6b85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.566155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] The token cache is being invalidate because project 1f6ba2e0b5c14c74a0928ffa73d8eaf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:15.567025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.569233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-af77056a-5e46-46fb-9f90-948877bc6b85 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.579023 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1843/3688] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:15 2021] DELETE /identity/v3/projects/1f6ba2e0b5c14c74a0928ffa73d8eaf4 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:15.579749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:15.582516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:15.615767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f3afb-b238-4439-9774-e0251bec51a2 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:15.773562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:15.774603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:15.775086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:15.775491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/5b22dcec915b47e4b436eb6ed5f6cfc1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:15.779125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:update_user(user_id=5b22dcec915b47e4b436eb6ed5f6cfc1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:15.783160 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:15.783160 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:55:15.783160 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:55:15.784904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:15.848454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5b22dcec915b47e4b436eb6ed5f6cfc1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.875662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invalidating the token cache because user 5b22dcec915b47e4b436eb6ed5f6cfc1 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:15.877422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.879407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:15.884997 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1846/3689] 10.222.0.21 () {60 vars in 1242 bytes} [Sat Nov 27 20:55:15 2021] PATCH /identity/v3/users/5b22dcec915b47e4b436eb6ed5f6cfc1 => generated 297 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:55:15.889495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc077c-5923-4255-a8e3-a4339b102097 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:15.890259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc077c-5923-4255-a8e3-a4339b102097 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:15.890781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc077c-5923-4255-a8e3-a4339b102097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:15.961643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b4fc077c-5923-4255-a8e3-a4339b102097 None None] MFA Rules not processed for user `5b22dcec915b47e4b436eb6ed5f6cfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:15.962917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b4fc077c-5923-4255-a8e3-a4339b102097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:15.973808 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1844/3690] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:15 2021] POST /identity/v3/auth/tokens => generated 349 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:15.978107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:15.980744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:16.011308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640944c1-ae3c-4e68-a5fc-157d02b2a853 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:16.031212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00da76c-dff3-42c5-ba6d-75ce30e897be tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:16.033242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da76c-dff3-42c5-ba6d-75ce30e897be tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:16.034873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da76c-dff3-42c5-ba6d-75ce30e897be tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:16.035895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00da76c-dff3-42c5-ba6d-75ce30e897be tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/5b22dcec915b47e4b436eb6ed5f6cfc1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:16.046970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00da76c-dff3-42c5-ba6d-75ce30e897be tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:update_user(user_id=5b22dcec915b47e4b436eb6ed5f6cfc1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:16.051281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00da76c-dff3-42c5-ba6d-75ce30e897be tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:16.120691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a00da76c-dff3-42c5-ba6d-75ce30e897be tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5b22dcec915b47e4b436eb6ed5f6cfc1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:16.134298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a00da76c-dff3-42c5-ba6d-75ce30e897be tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invalidating the token cache because user 5b22dcec915b47e4b436eb6ed5f6cfc1 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:16.135069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a00da76c-dff3-42c5-ba6d-75ce30e897be tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:16.137388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a00da76c-dff3-42c5-ba6d-75ce30e897be tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:16.141636 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1847/3691] 10.222.0.21 () {60 vars in 1242 bytes} [Sat Nov 27 20:55:15 2021] PATCH /identity/v3/users/5b22dcec915b47e4b436eb6ed5f6cfc1 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:16.146186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc077c-5923-4255-a8e3-a4339b102097 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:16.170781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc077c-5923-4255-a8e3-a4339b102097 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:16.180258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:16.184419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:16.185063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:16.185802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/5b22dcec915b47e4b436eb6ed5f6cfc1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:16.222281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:update_user(user_id=5b22dcec915b47e4b436eb6ed5f6cfc1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:16.224479 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:55:16.224479 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:55:16.224479 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:55:16.229282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:16.330837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5b22dcec915b47e4b436eb6ed5f6cfc1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:16.361026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invalidating the token cache because user 5b22dcec915b47e4b436eb6ed5f6cfc1 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:16.361670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:16.364080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:16.368388 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1845/3692] 10.222.0.21 () {60 vars in 1242 bytes} [Sat Nov 27 20:55:16 2021] PATCH /identity/v3/users/5b22dcec915b47e4b436eb6ed5f6cfc1 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:16.373557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c08dd-fa82-439b-bd8b-4ed1b7c056a1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:16.373914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c08dd-fa82-439b-bd8b-4ed1b7c056a1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:16.374263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c08dd-fa82-439b-bd8b-4ed1b7c056a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:16.446098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ec6c08dd-fa82-439b-bd8b-4ed1b7c056a1 None None] MFA Rules not processed for user `5b22dcec915b47e4b436eb6ed5f6cfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:16.449949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec6c08dd-fa82-439b-bd8b-4ed1b7c056a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:16.459105 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1848/3693] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:16 2021] POST /identity/v3/auth/tokens => generated 349 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:55:16.463383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:16.465644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:16.485319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1841b-c86d-437a-89b0-5e9681e15e2f tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:16.490516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:16.491529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:16.492410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:16.492648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/5b22dcec915b47e4b436eb6ed5f6cfc1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:16.497110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:update_user(user_id=5b22dcec915b47e4b436eb6ed5f6cfc1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:16.499641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:16.555293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5b22dcec915b47e4b436eb6ed5f6cfc1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:16.574330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invalidating the token cache because user 5b22dcec915b47e4b436eb6ed5f6cfc1 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:16.574756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:16.575437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:16.577860 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1846/3694] 10.222.0.21 () {60 vars in 1242 bytes} [Sat Nov 27 20:55:16 2021] PATCH /identity/v3/users/5b22dcec915b47e4b436eb6ed5f6cfc1 => generated 297 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:16.583216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c08dd-fa82-439b-bd8b-4ed1b7c056a1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:16.605197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c08dd-fa82-439b-bd8b-4ed1b7c056a1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:16.619096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b63470-7736-4a84-9b4b-9bddf3d72f69 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:16.619803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b63470-7736-4a84-9b4b-9bddf3d72f69 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:16.620503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b63470-7736-4a84-9b4b-9bddf3d72f69 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:16.624981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b63470-7736-4a84-9b4b-9bddf3d72f69 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:16.625817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b63470-7736-4a84-9b4b-9bddf3d72f69 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:16.628787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b63470-7736-4a84-9b4b-9bddf3d72f69 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:16.683933 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1849/3695] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:55:16 2021] POST /identity/v3/users => generated 265 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:55:16.688953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:16.698990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:16.736412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33d02c-e1b0-46aa-b6ee-cbc6ce404637 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:16.756163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800e232-94ef-4178-a8bd-5c0675f1026a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:16.759480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800e232-94ef-4178-a8bd-5c0675f1026a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:16.762061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800e232-94ef-4178-a8bd-5c0675f1026a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:16.762444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800e232-94ef-4178-a8bd-5c0675f1026a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/77b6c0f2f37f4319ac5e81b052e5fb91/password` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:16.948469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1800e232-94ef-4178-a8bd-5c0675f1026a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '77b6c0f2f37f4319ac5e81b052e5fb91'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:16.963704 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1847/3696] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:55:16 2021] POST /identity/v3/users/77b6c0f2f37f4319ac5e81b052e5fb91/password => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:17.969917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41ef0-2741-4943-8746-5ce90465b98b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:17.970867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41ef0-2741-4943-8746-5ce90465b98b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:17.970867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41ef0-2741-4943-8746-5ce90465b98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:18.029005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9cd41ef0-2741-4943-8746-5ce90465b98b None None] MFA Rules not processed for user `77b6c0f2f37f4319ac5e81b052e5fb91`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:18.030578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9cd41ef0-2741-4943-8746-5ce90465b98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:18.047831 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1850/3697] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:17 2021] POST /identity/v3/auth/tokens => generated 330 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 27 20:55:18.049601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800e232-94ef-4178-a8bd-5c0675f1026a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:18.067059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800e232-94ef-4178-a8bd-5c0675f1026a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:18.080627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd5881-e9a7-4172-944b-afda0b51d81b tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:18.081883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd5881-e9a7-4172-944b-afda0b51d81b tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:18.092266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd5881-e9a7-4172-944b-afda0b51d81b tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:18.092664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd5881-e9a7-4172-944b-afda0b51d81b tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:18.104232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd5881-e9a7-4172-944b-afda0b51d81b tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:18.109867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd5881-e9a7-4172-944b-afda0b51d81b tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:18.124610 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1848/3698] 10.222.0.21 () {56 vars in 1262 bytes} [Sat Nov 27 20:55:18 2021] GET /identity/v3/auth/tokens => generated 330 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 27 20:55:18.128834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41ef0-2741-4943-8746-5ce90465b98b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:18.151451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41ef0-2741-4943-8746-5ce90465b98b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:18.167694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd71e4-8686-415e-9fda-c5af15c0277a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:18.171241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd71e4-8686-415e-9fda-c5af15c0277a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:18.172077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd71e4-8686-415e-9fda-c5af15c0277a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:18.173344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd71e4-8686-415e-9fda-c5af15c0277a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/77b6c0f2f37f4319ac5e81b052e5fb91` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:18.176426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd71e4-8686-415e-9fda-c5af15c0277a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:delete_user(user_id=77b6c0f2f37f4319ac5e81b052e5fb91)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:18.179306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd71e4-8686-415e-9fda-c5af15c0277a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:18.242077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-59dd71e4-8686-415e-9fda-c5af15c0277a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b6c0f2f37f4319ac5e81b052e5fb91'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:18.243186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-59dd71e4-8686-415e-9fda-c5af15c0277a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b6c0f2f37f4319ac5e81b052e5fb91'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:18.260630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-59dd71e4-8686-415e-9fda-c5af15c0277a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b6c0f2f37f4319ac5e81b052e5fb91'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:18.262118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-59dd71e4-8686-415e-9fda-c5af15c0277a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b6c0f2f37f4319ac5e81b052e5fb91'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:18.274159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-59dd71e4-8686-415e-9fda-c5af15c0277a tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b6c0f2f37f4319ac5e81b052e5fb91'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:18.302009 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1851/3699] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:18 2021] DELETE /identity/v3/users/77b6c0f2f37f4319ac5e81b052e5fb91 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:18.306835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd5881-e9a7-4172-944b-afda0b51d81b tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:18.337233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd5881-e9a7-4172-944b-afda0b51d81b tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:18.526650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786e88e-2735-44f7-9856-d809c0611d9c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:18.527560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786e88e-2735-44f7-9856-d809c0611d9c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:18.527937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786e88e-2735-44f7-9856-d809c0611d9c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:18.528271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786e88e-2735-44f7-9856-d809c0611d9c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:18.528998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786e88e-2735-44f7-9856-d809c0611d9c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:18.530991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786e88e-2735-44f7-9856-d809c0611d9c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:18.564966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817cbd1-0658-4353-932a-657350ece383 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:18.565672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817cbd1-0658-4353-932a-657350ece383 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:18.566388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817cbd1-0658-4353-932a-657350ece383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:18.593595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1849/3700] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:18 2021] POST /identity/v3/users => generated 364 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:18.594726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786e88e-2735-44f7-9856-d809c0611d9c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:18.601343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4817cbd1-0658-4353-932a-657350ece383 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:18.602912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0786e88e-2735-44f7-9856-d809c0611d9c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:18.603301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4817cbd1-0658-4353-932a-657350ece383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:18.633787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786e88e-2735-44f7-9856-d809c0611d9c tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:18.647204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04935-d0d3-462e-be02-7d9901d9bfe8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:18.647911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04935-d0d3-462e-be02-7d9901d9bfe8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:18.648198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04935-d0d3-462e-be02-7d9901d9bfe8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:18.648980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04935-d0d3-462e-be02-7d9901d9bfe8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:18.649696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04935-d0d3-462e-be02-7d9901d9bfe8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:18.651806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04935-d0d3-462e-be02-7d9901d9bfe8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:18.697872 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1852/3701] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:55:18 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:18.726029 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1850/3702] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:18 2021] POST /identity/v3/projects => generated 360 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:18.727846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817cbd1-0658-4353-932a-657350ece383 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:18.729491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04935-d0d3-462e-be02-7d9901d9bfe8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:18.733672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-efd04935-d0d3-462e-be02-7d9901d9bfe8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:18.743541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817cbd1-0658-4353-932a-657350ece383 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:18.856654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87853ccb-5fb8-4835-8faf-e7ba7fb36dc0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:18.857649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87853ccb-5fb8-4835-8faf-e7ba7fb36dc0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:18.858051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87853ccb-5fb8-4835-8faf-e7ba7fb36dc0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:18.858482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87853ccb-5fb8-4835-8faf-e7ba7fb36dc0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/8dbcd2c692314cc1b559c5fb4ebcd0df` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:18.873382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04935-d0d3-462e-be02-7d9901d9bfe8 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:18.875694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87853ccb-5fb8-4835-8faf-e7ba7fb36dc0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:update_user(user_id=8dbcd2c692314cc1b559c5fb4ebcd0df)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:18.878005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87853ccb-5fb8-4835-8faf-e7ba7fb36dc0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:18.879636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e198ee-feab-48ba-8ec0-e2816f72934d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:18.880478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e198ee-feab-48ba-8ec0-e2816f72934d service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:18.880866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e198ee-feab-48ba-8ec0-e2816f72934d service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:18.881444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e198ee-feab-48ba-8ec0-e2816f72934d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:18.924718 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1853/3703] 10.222.0.21 () {60 vars in 1243 bytes} [Sat Nov 27 20:55:18 2021] PATCH /identity/v3/users/8dbcd2c692314cc1b559c5fb4ebcd0df => generated 521 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:18.928782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87853ccb-5fb8-4835-8faf-e7ba7fb36dc0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:18.950153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87853ccb-5fb8-4835-8faf-e7ba7fb36dc0 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:18.965294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eecfc1-3d64-46cf-ba0b-be58ff361ecf tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:18.966255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eecfc1-3d64-46cf-ba0b-be58ff361ecf tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:18.966659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eecfc1-3d64-46cf-ba0b-be58ff361ecf tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:18.967478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eecfc1-3d64-46cf-ba0b-be58ff361ecf tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/8dbcd2c692314cc1b559c5fb4ebcd0df` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:19.000090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eecfc1-3d64-46cf-ba0b-be58ff361ecf tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:get_user(user_id=8dbcd2c692314cc1b559c5fb4ebcd0df)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:19.004244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eecfc1-3d64-46cf-ba0b-be58ff361ecf tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:19.007037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e198ee-feab-48ba-8ec0-e2816f72934d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:19.009188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e198ee-feab-48ba-8ec0-e2816f72934d service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:19.013034 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1854/3704] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:55:18 2021] GET /identity/v3/users/8dbcd2c692314cc1b559c5fb4ebcd0df => generated 388 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:19.014073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eecfc1-3d64-46cf-ba0b-be58ff361ecf tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:19.022301 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1851/3705] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:55:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:19.031615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eecfc1-3d64-46cf-ba0b-be58ff361ecf tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:19.040770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:19.044698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:19.045266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:19.045861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/projects/6cd823d014b84b85ab51a2d3515648fa` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:19.049796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6cd823d014b84b85ab51a2d3515648fa)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:19.053985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:19.078374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689724-7dd6-4d3f-af93-5ba4fd8b0ad6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:19.078966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689724-7dd6-4d3f-af93-5ba4fd8b0ad6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:19.078966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689724-7dd6-4d3f-af93-5ba4fd8b0ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:19.113829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b4689724-7dd6-4d3f-af93-5ba4fd8b0ad6 None None] MFA Rules not processed for user `05f09b6a534240fc82a45ce979040e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:19.115430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b4689724-7dd6-4d3f-af93-5ba4fd8b0ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:19.128534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd823d014b84b85ab51a2d3515648fa', 'request_id': 'req-22337b8d-cba3-498e-83a0-db2217b71873'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.135948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd823d014b84b85ab51a2d3515648fa', 'request_id': 'req-22337b8d-cba3-498e-83a0-db2217b71873'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.154539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd823d014b84b85ab51a2d3515648fa', 'request_id': 'req-22337b8d-cba3-498e-83a0-db2217b71873'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.175381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] The token cache is being invalidate because project 6cd823d014b84b85ab51a2d3515648fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:19.176940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.179481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.185345 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1855/3706] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:19 2021] DELETE /identity/v3/projects/6cd823d014b84b85ab51a2d3515648fa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:19.190526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:19.193602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:19.233165 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1852/3707] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:19 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:19.242270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1bd4d-165a-4045-b541-41ec35d74d31 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:19.243047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1bd4d-165a-4045-b541-41ec35d74d31 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:19.245273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1bd4d-165a-4045-b541-41ec35d74d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:19.286791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-04d1bd4d-165a-4045-b541-41ec35d74d31 None None] MFA Rules not processed for user `05f09b6a534240fc82a45ce979040e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:19.291738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-04d1bd4d-165a-4045-b541-41ec35d74d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:19.312618 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1853/3708] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:19 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:19.315683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22337b8d-cba3-498e-83a0-db2217b71873 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:19.322786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4f4b9-bc0d-4752-8044-549bdf8e48b1 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad08509d4f6e4da283db11fb65ae18ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f13a51e86724c959675dc345fa31e3c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:19.323971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f4b9-bc0d-4752-8044-549bdf8e48b1 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:19.324927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f4b9-bc0d-4752-8044-549bdf8e48b1 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:19.325209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4f4b9-bc0d-4752-8044-549bdf8e48b1 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] PATH_INFO: `/v3/users/8dbcd2c692314cc1b559c5fb4ebcd0df` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:19.326567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4f4b9-bc0d-4752-8044-549bdf8e48b1 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8dbcd2c692314cc1b559c5fb4ebcd0df)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:19.328865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4f4b9-bc0d-4752-8044-549bdf8e48b1 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:19.416924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78c4f4b9-bc0d-4752-8044-549bdf8e48b1 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbcd2c692314cc1b559c5fb4ebcd0df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.417663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78c4f4b9-bc0d-4752-8044-549bdf8e48b1 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbcd2c692314cc1b559c5fb4ebcd0df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.455173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78c4f4b9-bc0d-4752-8044-549bdf8e48b1 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbcd2c692314cc1b559c5fb4ebcd0df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.463629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78c4f4b9-bc0d-4752-8044-549bdf8e48b1 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbcd2c692314cc1b559c5fb4ebcd0df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.476690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78c4f4b9-bc0d-4752-8044-549bdf8e48b1 tempest-UsersV3TestJSON-412761817 tempest-UsersV3TestJSON-412761817-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbcd2c692314cc1b559c5fb4ebcd0df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.503623 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1856/3709] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:19 2021] DELETE /identity/v3/users/8dbcd2c692314cc1b559c5fb4ebcd0df => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:19.521347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1bd4d-165a-4045-b541-41ec35d74d31 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:19.523199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-04d1bd4d-165a-4045-b541-41ec35d74d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:19.724799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1bd4d-165a-4045-b541-41ec35d74d31 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:19.830627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:19.831614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:19.831977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:19.832750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] PATH_INFO: `/v3/users/5b22dcec915b47e4b436eb6ed5f6cfc1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:19.851635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b22dcec915b47e4b436eb6ed5f6cfc1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:19.854598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:19.927096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b22dcec915b47e4b436eb6ed5f6cfc1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.938380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b22dcec915b47e4b436eb6ed5f6cfc1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.941478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b22dcec915b47e4b436eb6ed5f6cfc1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.951111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b22dcec915b47e4b436eb6ed5f6cfc1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.966092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b22dcec915b47e4b436eb6ed5f6cfc1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:19.976921 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1854/3710] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:19 2021] DELETE /identity/v3/users/5b22dcec915b47e4b436eb6ed5f6cfc1 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:19.978700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1351f-76dc-48f8-9b82-1675b1d4a3d5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:19.978995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1351f-76dc-48f8-9b82-1675b1d4a3d5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:19.979562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1351f-76dc-48f8-9b82-1675b1d4a3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:20.014003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-50d1351f-76dc-48f8-9b82-1675b1d4a3d5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:20.017673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-50d1351f-76dc-48f8-9b82-1675b1d4a3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:20.137155 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1857/3711] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:20.147941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:20.150111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:20.316110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa04dd8-14ed-4825-b98c-daaa84dc74f6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:20.326529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d815b-046b-41f1-9d49-12a3bb8ef3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:20.327524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d815b-046b-41f1-9d49-12a3bb8ef3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:20.328495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d815b-046b-41f1-9d49-12a3bb8ef3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:20.328950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d815b-046b-41f1-9d49-12a3bb8ef3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:20.341710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d815b-046b-41f1-9d49-12a3bb8ef3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:20.343527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d815b-046b-41f1-9d49-12a3bb8ef3a2 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:20.356260 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1855/3712] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:20.835427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1351f-76dc-48f8-9b82-1675b1d4a3d5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:20.837029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-50d1351f-76dc-48f8-9b82-1675b1d4a3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:20.861994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1351f-76dc-48f8-9b82-1675b1d4a3d5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:20.878168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:20.879108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:20.879426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:20.879752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] PATH_INFO: `/v3/projects/32a71281c9e04a7d81b28667f50d510d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:20.882577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a71281c9e04a7d81b28667f50d510d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:20.892254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:21.016576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a71281c9e04a7d81b28667f50d510d', 'request_id': 'req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:21.030939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a71281c9e04a7d81b28667f50d510d', 'request_id': 'req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:21.057020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a71281c9e04a7d81b28667f50d510d', 'request_id': 'req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:21.081498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] The token cache is being invalidate because project 32a71281c9e04a7d81b28667f50d510d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:21.081754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:21.082788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:21.084487 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1858/3713] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:20 2021] DELETE /identity/v3/projects/32a71281c9e04a7d81b28667f50d510d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:21.088537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d815b-046b-41f1-9d49-12a3bb8ef3a2 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:21.100841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d815b-046b-41f1-9d49-12a3bb8ef3a2 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:21.174950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f8769-1be9-4ef5-b4ac-5a7e3877654f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:21.176111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f8769-1be9-4ef5-b4ac-5a7e3877654f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:21.176371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f8769-1be9-4ef5-b4ac-5a7e3877654f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:21.176645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f8769-1be9-4ef5-b4ac-5a7e3877654f admin admin] PATH_INFO: `/v3/users/ad08509d4f6e4da283db11fb65ae18ce` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:21.177881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f8769-1be9-4ef5-b4ac-5a7e3877654f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad08509d4f6e4da283db11fb65ae18ce)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:21.182786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f8769-1be9-4ef5-b4ac-5a7e3877654f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:21.282468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-422f8769-1be9-4ef5-b4ac-5a7e3877654f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad08509d4f6e4da283db11fb65ae18ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:21.295234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-422f8769-1be9-4ef5-b4ac-5a7e3877654f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad08509d4f6e4da283db11fb65ae18ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:21.296536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-422f8769-1be9-4ef5-b4ac-5a7e3877654f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad08509d4f6e4da283db11fb65ae18ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:21.316137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-422f8769-1be9-4ef5-b4ac-5a7e3877654f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad08509d4f6e4da283db11fb65ae18ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:21.351078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-422f8769-1be9-4ef5-b4ac-5a7e3877654f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad08509d4f6e4da283db11fb65ae18ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:21.376292 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1856/3714] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:21 2021] DELETE /identity/v3/users/ad08509d4f6e4da283db11fb65ae18ce => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:21.814809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:21.820855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:21.837476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bf9f4-1b15-416b-aaab-416d8e9d2c3d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:21.975240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:21.976127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:21.976408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:21.976768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] PATH_INFO: `/v3/projects/9f13a51e86724c959675dc345fa31e3c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:21.977978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f13a51e86724c959675dc345fa31e3c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:21.979993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:22.063201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f13a51e86724c959675dc345fa31e3c', 'request_id': 'req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:22.082637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f13a51e86724c959675dc345fa31e3c', 'request_id': 'req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:22.100859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f13a51e86724c959675dc345fa31e3c', 'request_id': 'req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:22.120013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] The token cache is being invalidate because project 9f13a51e86724c959675dc345fa31e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:22.120258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:22.121309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-94d8caa1-224b-4f38-b093-ffdb7a26b1c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:22.127403 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1859/3715] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:21 2021] DELETE /identity/v3/projects/9f13a51e86724c959675dc345fa31e3c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:22.137432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fec5d-4080-43c0-90cf-efc3ac3915a8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:22.138072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fec5d-4080-43c0-90cf-efc3ac3915a8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:22.138449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fec5d-4080-43c0-90cf-efc3ac3915a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:22.180358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c08fec5d-4080-43c0-90cf-efc3ac3915a8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:22.182285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c08fec5d-4080-43c0-90cf-efc3ac3915a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:22.311601 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1857/3716] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:22.319556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85a968-814e-464e-8d3b-51066613900c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:22.320262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85a968-814e-464e-8d3b-51066613900c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:22.320636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85a968-814e-464e-8d3b-51066613900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:22.358876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1c85a968-814e-464e-8d3b-51066613900c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:22.358876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1c85a968-814e-464e-8d3b-51066613900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:22.441450 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1860/3717] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:22.441568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fec5d-4080-43c0-90cf-efc3ac3915a8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:22.441568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fec5d-4080-43c0-90cf-efc3ac3915a8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:22.441568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ff038-6490-497e-83d3-3e660d932998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:22.441568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff038-6490-497e-83d3-3e660d932998 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:22.441944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff038-6490-497e-83d3-3e660d932998 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:22.441944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff038-6490-497e-83d3-3e660d932998 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:22.441944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ff038-6490-497e-83d3-3e660d932998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:22.441944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ff038-6490-497e-83d3-3e660d932998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:22.441944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ff038-6490-497e-83d3-3e660d932998 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:22.455529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85a968-814e-464e-8d3b-51066613900c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:22.463175 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1858/3718] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:22.488382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85a968-814e-464e-8d3b-51066613900c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:22.506891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258e84-c5d8-43e5-a8c4-0d0842efcede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:22.507641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258e84-c5d8-43e5-a8c4-0d0842efcede admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:22.507922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258e84-c5d8-43e5-a8c4-0d0842efcede admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:22.508195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258e84-c5d8-43e5-a8c4-0d0842efcede admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:22.508926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32258e84-c5d8-43e5-a8c4-0d0842efcede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:22.512092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32258e84-c5d8-43e5-a8c4-0d0842efcede admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:22.554691 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1861/3719] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:22 2021] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:55:22.568597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ff038-6490-497e-83d3-3e660d932998 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:22.590382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ff038-6490-497e-83d3-3e660d932998 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:22.694645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8c38-1fdc-433b-92a4-c7fb3de7be4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:22.695226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8c38-1fdc-433b-92a4-c7fb3de7be4f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:22.695550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8c38-1fdc-433b-92a4-c7fb3de7be4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:22.695833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8c38-1fdc-433b-92a4-c7fb3de7be4f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:22.696639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef8c38-1fdc-433b-92a4-c7fb3de7be4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:22.698474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef8c38-1fdc-433b-92a4-c7fb3de7be4f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:22.735405 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1859/3720] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:22 2021] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:22.736679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258e84-c5d8-43e5-a8c4-0d0842efcede admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:22.750103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258e84-c5d8-43e5-a8c4-0d0842efcede admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:22.756242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df12f2-aa67-4e37-8a57-f12e0d5a361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:22.758856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df12f2-aa67-4e37-8a57-f12e0d5a361c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:22.758856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df12f2-aa67-4e37-8a57-f12e0d5a361c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:22.758856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df12f2-aa67-4e37-8a57-f12e0d5a361c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:22.758856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df12f2-aa67-4e37-8a57-f12e0d5a361c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:22.762690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df12f2-aa67-4e37-8a57-f12e0d5a361c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:22.778449 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1862/3721] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:22.779725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8c38-1fdc-433b-92a4-c7fb3de7be4f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:22.793361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8c38-1fdc-433b-92a4-c7fb3de7be4f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:22.798486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b495c8-8a43-48b6-bb64-fa17e63ca7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:22.799578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b495c8-8a43-48b6-bb64-fa17e63ca7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:22.800104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b495c8-8a43-48b6-bb64-fa17e63ca7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:22.800457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b495c8-8a43-48b6-bb64-fa17e63ca7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:22.801376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b495c8-8a43-48b6-bb64-fa17e63ca7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:22.803849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b495c8-8a43-48b6-bb64-fa17e63ca7d6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:22.820978 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1860/3722] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:22.822120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df12f2-aa67-4e37-8a57-f12e0d5a361c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:22.839063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df12f2-aa67-4e37-8a57-f12e0d5a361c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:22.854976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00323a37-8001-4877-b0d6-172930cb1ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:22.856582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00323a37-8001-4877-b0d6-172930cb1ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:22.856869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00323a37-8001-4877-b0d6-172930cb1ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:22.857142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00323a37-8001-4877-b0d6-172930cb1ae7 admin admin] PATH_INFO: `/v3/projects/4a972bdf9e8e4d4fa74d3ba0e246bb95/users/3d81b5b6e256408e97cdeb5d772d6f1c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:22.874696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00323a37-8001-4877-b0d6-172930cb1ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a972bdf9e8e4d4fa74d3ba0e246bb95, user_id=3d81b5b6e256408e97cdeb5d772d6f1c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:22.880065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00323a37-8001-4877-b0d6-172930cb1ae7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:22.899320 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1863/3723] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:22 2021] PUT /identity/v3/projects/4a972bdf9e8e4d4fa74d3ba0e246bb95/users/3d81b5b6e256408e97cdeb5d772d6f1c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:55:22.910088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061f584-82ec-4071-80d5-afdca5e0a79b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:22.910366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061f584-82ec-4071-80d5-afdca5e0a79b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:22.910490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061f584-82ec-4071-80d5-afdca5e0a79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:22.949205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e061f584-82ec-4071-80d5-afdca5e0a79b None None] MFA Rules not processed for user `3d81b5b6e256408e97cdeb5d772d6f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:22.950327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e061f584-82ec-4071-80d5-afdca5e0a79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:23.085110 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1861/3724] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:22 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:23.159419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00323a37-8001-4877-b0d6-172930cb1ae7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:23.170820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00323a37-8001-4877-b0d6-172930cb1ae7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:23.175417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2261f-9f57-45f6-b959-fa79da93edca tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d81b5b6e256408e97cdeb5d772d6f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a972bdf9e8e4d4fa74d3ba0e246bb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:23.176043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2261f-9f57-45f6-b959-fa79da93edca tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:23.176259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2261f-9f57-45f6-b959-fa79da93edca tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:23.176370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2261f-9f57-45f6-b959-fa79da93edca tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] PATH_INFO: `/v3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:23.183418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061f584-82ec-4071-80d5-afdca5e0a79b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:23.185176 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1864/3725] 10.222.0.21 () {58 vars in 1103 bytes} [Sat Nov 27 20:55:23 2021] GET /identity/v3 => generated 255 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:23.193221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061f584-82ec-4071-80d5-afdca5e0a79b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:23.200691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89db87-f846-4d8a-869e-45004ced967e tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d81b5b6e256408e97cdeb5d772d6f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a972bdf9e8e4d4fa74d3ba0e246bb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:23.201424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89db87-f846-4d8a-869e-45004ced967e tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:23.201870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89db87-f846-4d8a-869e-45004ced967e tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:23.202617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89db87-f846-4d8a-869e-45004ced967e tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] PATH_INFO: `/v3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:23.208282 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1862/3726] 10.222.0.21 () {58 vars in 1103 bytes} [Sat Nov 27 20:55:23 2021] GET /identity/v3 => generated 255 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:23.209658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2261f-9f57-45f6-b959-fa79da93edca tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:23.222043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2261f-9f57-45f6-b959-fa79da93edca tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:23.227802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486c0d5-7327-41c1-9ccc-e5ab369c1a53 tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d81b5b6e256408e97cdeb5d772d6f1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a972bdf9e8e4d4fa74d3ba0e246bb95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:23.228569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c0d5-7327-41c1-9ccc-e5ab369c1a53 tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:23.228974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c0d5-7327-41c1-9ccc-e5ab369c1a53 tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:23.229355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c0d5-7327-41c1-9ccc-e5ab369c1a53 tempest-TestApiDiscovery-1739077127 tempest-TestApiDiscovery-1739077127-project] PATH_INFO: `/v3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:23.235267 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1865/3727] 10.222.0.21 () {58 vars in 1103 bytes} [Sat Nov 27 20:55:23 2021] GET /identity/v3 => generated 255 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:23.237547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6be99-82e6-4ed2-a129-de93cf915220 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:23.237832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6be99-82e6-4ed2-a129-de93cf915220 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:23.238104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6be99-82e6-4ed2-a129-de93cf915220 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:23.240184 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1863/3728] 10.222.0.21 () {56 vars in 894 bytes} [Sat Nov 27 20:55:23 2021] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:55:23.248148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b5bf1-f363-470c-bc53-e7232990a2a8 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:23.249734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b5bf1-f363-470c-bc53-e7232990a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:23.250271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b5bf1-f363-470c-bc53-e7232990a2a8 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:23.255084 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1866/3729] 10.222.0.21 () {56 vars in 894 bytes} [Sat Nov 27 20:55:23 2021] GET /identity/ => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:55:23.259587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6be99-82e6-4ed2-a129-de93cf915220 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:23.437768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6be99-82e6-4ed2-a129-de93cf915220 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:23.447190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:23.450535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:23.450955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:23.451191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] PATH_INFO: `/v3/users/3d81b5b6e256408e97cdeb5d772d6f1c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:23.455340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d81b5b6e256408e97cdeb5d772d6f1c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:23.459004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:23.545272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d81b5b6e256408e97cdeb5d772d6f1c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:23.565174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d81b5b6e256408e97cdeb5d772d6f1c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:23.566337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d81b5b6e256408e97cdeb5d772d6f1c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:23.579985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d81b5b6e256408e97cdeb5d772d6f1c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:23.612164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d81b5b6e256408e97cdeb5d772d6f1c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:23.624697 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1864/3730] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:23 2021] DELETE /identity/v3/users/3d81b5b6e256408e97cdeb5d772d6f1c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:23.629342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375ed08-0a7e-41a2-b1e5-c345958df48b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:23.629633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375ed08-0a7e-41a2-b1e5-c345958df48b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:23.629914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375ed08-0a7e-41a2-b1e5-c345958df48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:23.663645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d375ed08-0a7e-41a2-b1e5-c345958df48b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:23.664871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d375ed08-0a7e-41a2-b1e5-c345958df48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:23.775071 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1867/3731] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:23.786544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:23.790767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:23.878783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587f278-c647-4dc5-8f73-92d093f10ab9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:23.883090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cfba5-c3d3-482a-ab28-32be01e19fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:23.883883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cfba5-c3d3-482a-ab28-32be01e19fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:23.884270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cfba5-c3d3-482a-ab28-32be01e19fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:23.884770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cfba5-c3d3-482a-ab28-32be01e19fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:23.899590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cfba5-c3d3-482a-ab28-32be01e19fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:23.903059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cfba5-c3d3-482a-ab28-32be01e19fd1 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:23.915681 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1865/3732] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:24.513971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375ed08-0a7e-41a2-b1e5-c345958df48b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:24.516561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d375ed08-0a7e-41a2-b1e5-c345958df48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:24.539109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375ed08-0a7e-41a2-b1e5-c345958df48b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:24.553181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:24.554432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:24.554898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:24.555620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] PATH_INFO: `/v3/projects/4a972bdf9e8e4d4fa74d3ba0e246bb95` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:24.558186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a972bdf9e8e4d4fa74d3ba0e246bb95)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:24.561988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:24.678876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a972bdf9e8e4d4fa74d3ba0e246bb95', 'request_id': 'req-e253e643-7fc0-4772-881b-7031f8d74c7c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:24.697452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a972bdf9e8e4d4fa74d3ba0e246bb95', 'request_id': 'req-e253e643-7fc0-4772-881b-7031f8d74c7c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:24.710019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a972bdf9e8e4d4fa74d3ba0e246bb95', 'request_id': 'req-e253e643-7fc0-4772-881b-7031f8d74c7c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:24.732870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] The token cache is being invalidate because project 4a972bdf9e8e4d4fa74d3ba0e246bb95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:24.733160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:24.734484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e253e643-7fc0-4772-881b-7031f8d74c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:24.736091 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1868/3733] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:24 2021] DELETE /identity/v3/projects/4a972bdf9e8e4d4fa74d3ba0e246bb95 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:24.742017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9db9-4339-4e56-9a70-4e44c842101d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:24.742596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9db9-4339-4e56-9a70-4e44c842101d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:24.742805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9db9-4339-4e56-9a70-4e44c842101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:24.785310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-32cd9db9-4339-4e56-9a70-4e44c842101d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:24.788279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-32cd9db9-4339-4e56-9a70-4e44c842101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:24.905194 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1866/3734] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:24.912709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acfd7-6cc1-43d3-a48a-14f8f2c9cef1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:24.912981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acfd7-6cc1-43d3-a48a-14f8f2c9cef1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:24.913258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acfd7-6cc1-43d3-a48a-14f8f2c9cef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:24.953566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-153acfd7-6cc1-43d3-a48a-14f8f2c9cef1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:24.954802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-153acfd7-6cc1-43d3-a48a-14f8f2c9cef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:24.977401 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1869/3735] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:24.978375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd9db9-4339-4e56-9a70-4e44c842101d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:24.990836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd9db9-4339-4e56-9a70-4e44c842101d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:25.007061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d58102-9411-4e08-a966-007e25f826d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:25.012268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d58102-9411-4e08-a966-007e25f826d6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:25.019697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d58102-9411-4e08-a966-007e25f826d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:25.020595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d58102-9411-4e08-a966-007e25f826d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:25.022960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d58102-9411-4e08-a966-007e25f826d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:25.031892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d58102-9411-4e08-a966-007e25f826d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:25.033814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d58102-9411-4e08-a966-007e25f826d6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:25.060130 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1867/3736] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:55:25.065017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153acfd7-6cc1-43d3-a48a-14f8f2c9cef1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:25.080013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153acfd7-6cc1-43d3-a48a-14f8f2c9cef1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:25.092228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dcd05-6fe9-423c-8f72-90b3e5458052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:25.092907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dcd05-6fe9-423c-8f72-90b3e5458052 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:25.093297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dcd05-6fe9-423c-8f72-90b3e5458052 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:25.093592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dcd05-6fe9-423c-8f72-90b3e5458052 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:25.094353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dcd05-6fe9-423c-8f72-90b3e5458052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:25.096511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dcd05-6fe9-423c-8f72-90b3e5458052 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:25.170066 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1870/3737] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:25 2021] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:25.170415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d58102-9411-4e08-a966-007e25f826d6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:25.185357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d58102-9411-4e08-a966-007e25f826d6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:25.314557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b00c4-ed3a-4b2f-8585-46fa837ffe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:25.315670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b00c4-ed3a-4b2f-8585-46fa837ffe1b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:25.316176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b00c4-ed3a-4b2f-8585-46fa837ffe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:25.316635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b00c4-ed3a-4b2f-8585-46fa837ffe1b admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:25.317552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b00c4-ed3a-4b2f-8585-46fa837ffe1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:25.320405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b00c4-ed3a-4b2f-8585-46fa837ffe1b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:25.351558 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1868/3738] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:25 2021] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:55:25.356186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dcd05-6fe9-423c-8f72-90b3e5458052 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:25.375773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dcd05-6fe9-423c-8f72-90b3e5458052 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:25.383382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff112fa-c77e-4217-ae88-a7b1e42b1cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:25.383382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff112fa-c77e-4217-ae88-a7b1e42b1cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:25.383382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff112fa-c77e-4217-ae88-a7b1e42b1cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:25.383382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff112fa-c77e-4217-ae88-a7b1e42b1cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:25.384390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff112fa-c77e-4217-ae88-a7b1e42b1cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:25.384390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff112fa-c77e-4217-ae88-a7b1e42b1cb8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:25.409564 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1871/3739] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:25 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:25.410288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b00c4-ed3a-4b2f-8585-46fa837ffe1b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:25.422007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b00c4-ed3a-4b2f-8585-46fa837ffe1b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:25.440707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16627-fec5-424b-9445-f73ad27171cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:25.447297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16627-fec5-424b-9445-f73ad27171cc admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:25.447297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16627-fec5-424b-9445-f73ad27171cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:25.447297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a16627-fec5-424b-9445-f73ad27171cc admin admin] PATH_INFO: `/v3/projects/4d75cb36e6ed443ea8cc884c8f5a02e1/users/169f6e78b682407b98922c7ac260068c/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:25.471654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a16627-fec5-424b-9445-f73ad27171cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d75cb36e6ed443ea8cc884c8f5a02e1, user_id=169f6e78b682407b98922c7ac260068c, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:25.474261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a16627-fec5-424b-9445-f73ad27171cc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:25.495137 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1869/3740] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:25 2021] PUT /identity/v3/projects/4d75cb36e6ed443ea8cc884c8f5a02e1/users/169f6e78b682407b98922c7ac260068c/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:25.497051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff112fa-c77e-4217-ae88-a7b1e42b1cb8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:25.524597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff112fa-c77e-4217-ae88-a7b1e42b1cb8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:25.612645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483d8fc-990f-4892-9d27-cd81f8df5659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:25.613479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d8fc-990f-4892-9d27-cd81f8df5659 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:25.613881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d8fc-990f-4892-9d27-cd81f8df5659 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:25.614261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483d8fc-990f-4892-9d27-cd81f8df5659 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:25.615457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483d8fc-990f-4892-9d27-cd81f8df5659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:25.617830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483d8fc-990f-4892-9d27-cd81f8df5659 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:25.634783 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1872/3741] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:25 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:25.636439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16627-fec5-424b-9445-f73ad27171cc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:25.650338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a16627-fec5-424b-9445-f73ad27171cc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:25.663536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09551592-56fd-4a38-aed3-0fe07a9ffff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:25.664744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09551592-56fd-4a38-aed3-0fe07a9ffff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:25.665210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09551592-56fd-4a38-aed3-0fe07a9ffff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:25.665664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09551592-56fd-4a38-aed3-0fe07a9ffff1 admin admin] PATH_INFO: `/v3/projects/4d75cb36e6ed443ea8cc884c8f5a02e1/users/169f6e78b682407b98922c7ac260068c/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:25.672170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09551592-56fd-4a38-aed3-0fe07a9ffff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d75cb36e6ed443ea8cc884c8f5a02e1, user_id=169f6e78b682407b98922c7ac260068c, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:25.677654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09551592-56fd-4a38-aed3-0fe07a9ffff1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:25.703122 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1870/3742] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:25 2021] PUT /identity/v3/projects/4d75cb36e6ed443ea8cc884c8f5a02e1/users/169f6e78b682407b98922c7ac260068c/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:25.704352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b998105-6ecf-448d-8a95-78f6962d1e12 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:25.704783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b998105-6ecf-448d-8a95-78f6962d1e12 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:25.705165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b998105-6ecf-448d-8a95-78f6962d1e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:25.771000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1b998105-6ecf-448d-8a95-78f6962d1e12 None None] MFA Rules not processed for user `169f6e78b682407b98922c7ac260068c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:25.772513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1b998105-6ecf-448d-8a95-78f6962d1e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:25.895911 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1873/3743] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:25 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:25.897599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09551592-56fd-4a38-aed3-0fe07a9ffff1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:26.043276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09551592-56fd-4a38-aed3-0fe07a9ffff1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:26.064824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0c403-fa06-4da0-a220-1cc1558d7070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:26.065811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0c403-fa06-4da0-a220-1cc1558d7070 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:26.066289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0c403-fa06-4da0-a220-1cc1558d7070 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:26.066740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0c403-fa06-4da0-a220-1cc1558d7070 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:26.088554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0c403-fa06-4da0-a220-1cc1558d7070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:26.100891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0c403-fa06-4da0-a220-1cc1558d7070 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:26.193627 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1871/3744] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:25 2021] POST /identity/v3/projects => generated 393 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:26.195269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b998105-6ecf-448d-8a95-78f6962d1e12 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:26.224538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b998105-6ecf-448d-8a95-78f6962d1e12 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:26.321969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92698350-8750-4ead-832d-40ed7f0ec646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:26.322591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92698350-8750-4ead-832d-40ed7f0ec646 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:26.322868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92698350-8750-4ead-832d-40ed7f0ec646 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:26.323164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92698350-8750-4ead-832d-40ed7f0ec646 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:26.324488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92698350-8750-4ead-832d-40ed7f0ec646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:26.326430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92698350-8750-4ead-832d-40ed7f0ec646 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:26.353209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0c403-fa06-4da0-a220-1cc1558d7070 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:26.353739 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1874/3745] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:26 2021] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:26.365377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0c403-fa06-4da0-a220-1cc1558d7070 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:26.372611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bbcf4-47a4-4df1-a0a1-660535d5eaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:26.373175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bbcf4-47a4-4df1-a0a1-660535d5eaeb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:26.382481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bbcf4-47a4-4df1-a0a1-660535d5eaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:26.382481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bbcf4-47a4-4df1-a0a1-660535d5eaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:26.382481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bbcf4-47a4-4df1-a0a1-660535d5eaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:26.382481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952bbcf4-47a4-4df1-a0a1-660535d5eaeb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:26.395197 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1872/3746] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:26 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:26.396610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92698350-8750-4ead-832d-40ed7f0ec646 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:26.419580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92698350-8750-4ead-832d-40ed7f0ec646 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:26.436049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b6d95-26c3-4336-9942-0c063d25a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:26.447895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b6d95-26c3-4336-9942-0c063d25a397 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:26.448321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b6d95-26c3-4336-9942-0c063d25a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:26.448669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b6d95-26c3-4336-9942-0c063d25a397 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:26.450130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b6d95-26c3-4336-9942-0c063d25a397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:26.452269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b6d95-26c3-4336-9942-0c063d25a397 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:26.473752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bbcf4-47a4-4df1-a0a1-660535d5eaeb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:26.481795 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1875/3747] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:26 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:55:26.492718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bbcf4-47a4-4df1-a0a1-660535d5eaeb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:26.507080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c84aa-74d0-43dd-8f3e-0d7dadab7478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:26.508865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c84aa-74d0-43dd-8f3e-0d7dadab7478 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:26.509372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c84aa-74d0-43dd-8f3e-0d7dadab7478 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:26.509869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c84aa-74d0-43dd-8f3e-0d7dadab7478 admin admin] PATH_INFO: `/v3/projects/ab69590a5a74483187d535a37a2bc6ba/users/f092e5f52ee94fe1bd2dc069862d11b7/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:26.555075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c84aa-74d0-43dd-8f3e-0d7dadab7478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab69590a5a74483187d535a37a2bc6ba, user_id=f092e5f52ee94fe1bd2dc069862d11b7, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:26.559355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c84aa-74d0-43dd-8f3e-0d7dadab7478 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:26.595884 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1873/3748] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:26 2021] PUT /identity/v3/projects/ab69590a5a74483187d535a37a2bc6ba/users/f092e5f52ee94fe1bd2dc069862d11b7/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:26.597598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93c63-daf5-475f-9fbd-7a3f995afec5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:26.598127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93c63-daf5-475f-9fbd-7a3f995afec5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:26.598255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93c63-daf5-475f-9fbd-7a3f995afec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:26.651825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-bbe93c63-daf5-475f-9fbd-7a3f995afec5 None None] MFA Rules not processed for user `f092e5f52ee94fe1bd2dc069862d11b7`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:26.653116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bbe93c63-daf5-475f-9fbd-7a3f995afec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:26.753575 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1876/3749] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:26 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:27.992166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c84aa-74d0-43dd-8f3e-0d7dadab7478 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:27.994064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-125c84aa-74d0-43dd-8f3e-0d7dadab7478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:28.062100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c84aa-74d0-43dd-8f3e-0d7dadab7478 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:28.070008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae5416-589d-45d9-9331-93701e14fafa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:28.070684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae5416-589d-45d9-9331-93701e14fafa service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:28.071039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae5416-589d-45d9-9331-93701e14fafa service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:28.071450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae5416-589d-45d9-9331-93701e14fafa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:28.142647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae5416-589d-45d9-9331-93701e14fafa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:28.144118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae5416-589d-45d9-9331-93701e14fafa service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:28.155334 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1874/3750] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:27 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:29.260546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe93c63-daf5-475f-9fbd-7a3f995afec5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:29.275517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe93c63-daf5-475f-9fbd-7a3f995afec5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:29.280323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc182b5f-f776-40a9-9f58-d4b875f7b522 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:29.281288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182b5f-f776-40a9-9f58-d4b875f7b522 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:29.281717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182b5f-f776-40a9-9f58-d4b875f7b522 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:29.282080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc182b5f-f776-40a9-9f58-d4b875f7b522 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:29.284510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fc182b5f-f776-40a9-9f58-d4b875f7b522 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:29.367597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc182b5f-f776-40a9-9f58-d4b875f7b522 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:29.369141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc182b5f-f776-40a9-9f58-d4b875f7b522 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:29.384801 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1877/3751] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:29.436094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae5416-589d-45d9-9331-93701e14fafa service glance] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:29.568414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae5416-589d-45d9-9331-93701e14fafa service glance] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:29.596881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:29.598095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:29.598572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:29.599093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] PATH_INFO: `/v3/users/169f6e78b682407b98922c7ac260068c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:29.600610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=169f6e78b682407b98922c7ac260068c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:29.602753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:29.725457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169f6e78b682407b98922c7ac260068c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:29.776369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169f6e78b682407b98922c7ac260068c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:29.777859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169f6e78b682407b98922c7ac260068c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:29.787080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169f6e78b682407b98922c7ac260068c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:29.802866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169f6e78b682407b98922c7ac260068c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:29.813142 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1875/3752] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:29 2021] DELETE /identity/v3/users/169f6e78b682407b98922c7ac260068c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:29.819120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324cb2-16b1-4ef4-8313-6d8580b37110 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:29.819483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324cb2-16b1-4ef4-8313-6d8580b37110 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:29.820179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff324cb2-16b1-4ef4-8313-6d8580b37110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:29.841167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ff324cb2-16b1-4ef4-8313-6d8580b37110 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:29.844045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ff324cb2-16b1-4ef4-8313-6d8580b37110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:29.991375 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1878/3753] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:30.004853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:30.006534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:30.132256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a699a86-606a-4a71-b8b9-bd9a60bebfcb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:30.143427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa74de-8ad3-4636-aa69-6a77cefa4bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:30.144008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa74de-8ad3-4636-aa69-6a77cefa4bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:30.144286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa74de-8ad3-4636-aa69-6a77cefa4bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:30.144559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa74de-8ad3-4636-aa69-6a77cefa4bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:30.158373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa74de-8ad3-4636-aa69-6a77cefa4bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:30.159895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa74de-8ad3-4636-aa69-6a77cefa4bf0 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:30.173884 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1876/3754] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:30.345240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffad48-107c-4468-b34c-f2f377b3fe18 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:30.346381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffad48-107c-4468-b34c-f2f377b3fe18 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:30.346926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffad48-107c-4468-b34c-f2f377b3fe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:30.379602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-daffad48-107c-4468-b34c-f2f377b3fe18 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:30.384490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-daffad48-107c-4468-b34c-f2f377b3fe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:30.486717 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1879/3755] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:55:30 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:30.504655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa74de-8ad3-4636-aa69-6a77cefa4bf0 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:30.506118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-70fa74de-8ad3-4636-aa69-6a77cefa4bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:30.624746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa74de-8ad3-4636-aa69-6a77cefa4bf0 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:30.634768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43306687-7cbe-44e9-a0df-e1a9d954e6a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:30.635621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43306687-7cbe-44e9-a0df-e1a9d954e6a2 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:30.635900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43306687-7cbe-44e9-a0df-e1a9d954e6a2 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:30.636834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43306687-7cbe-44e9-a0df-e1a9d954e6a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:30.647105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43306687-7cbe-44e9-a0df-e1a9d954e6a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:30.649271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43306687-7cbe-44e9-a0df-e1a9d954e6a2 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:30.663712 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1877/3756] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:55:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:30.759537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffad48-107c-4468-b34c-f2f377b3fe18 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:30.761893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-daffad48-107c-4468-b34c-f2f377b3fe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:30.799536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffad48-107c-4468-b34c-f2f377b3fe18 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:30.809576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:30.810616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:30.811570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:30.816090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] PATH_INFO: `/v3/projects/4d75cb36e6ed443ea8cc884c8f5a02e1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:30.817716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d75cb36e6ed443ea8cc884c8f5a02e1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:30.819858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:30.832514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43306687-7cbe-44e9-a0df-e1a9d954e6a2 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:30.834031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-43306687-7cbe-44e9-a0df-e1a9d954e6a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:30.853878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43306687-7cbe-44e9-a0df-e1a9d954e6a2 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:30.860700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035a991-8950-402a-a595-49e9104c2fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:30.861764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a991-8950-402a-a595-49e9104c2fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:30.862370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a991-8950-402a-a595-49e9104c2fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:30.862716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a991-8950-402a-a595-49e9104c2fd1 admin admin] PATH_INFO: `/v3/users/c5205eebafe64393923d02220666e7b8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:30.864226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035a991-8950-402a-a595-49e9104c2fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5205eebafe64393923d02220666e7b8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:30.866202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035a991-8950-402a-a595-49e9104c2fd1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:30.928260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d75cb36e6ed443ea8cc884c8f5a02e1', 'request_id': 'req-f213808b-92fa-4cd9-bcea-0327f0f85d3f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:30.939829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d75cb36e6ed443ea8cc884c8f5a02e1', 'request_id': 'req-f213808b-92fa-4cd9-bcea-0327f0f85d3f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:30.951127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d75cb36e6ed443ea8cc884c8f5a02e1', 'request_id': 'req-f213808b-92fa-4cd9-bcea-0327f0f85d3f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:30.958197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8035a991-8950-402a-a595-49e9104c2fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5205eebafe64393923d02220666e7b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:30.966544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] The token cache is being invalidate because project 4d75cb36e6ed443ea8cc884c8f5a02e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:30.966967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:30.967897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:30.968129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8035a991-8950-402a-a595-49e9104c2fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5205eebafe64393923d02220666e7b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:30.968889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8035a991-8950-402a-a595-49e9104c2fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5205eebafe64393923d02220666e7b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:30.970129 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1880/3757] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:30 2021] DELETE /identity/v3/projects/4d75cb36e6ed443ea8cc884c8f5a02e1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:30.974222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:30.978202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:30.979859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8035a991-8950-402a-a595-49e9104c2fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5205eebafe64393923d02220666e7b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.003706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8035a991-8950-402a-a595-49e9104c2fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5205eebafe64393923d02220666e7b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.011039 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1878/3758] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:30 2021] DELETE /identity/v3/users/c5205eebafe64393923d02220666e7b8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:31.015214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44db335-240a-4ead-a804-dd77d2cb937d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:31.015786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44db335-240a-4ead-a804-dd77d2cb937d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:31.016433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44db335-240a-4ead-a804-dd77d2cb937d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:31.048199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f44db335-240a-4ead-a804-dd77d2cb937d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:31.050595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f44db335-240a-4ead-a804-dd77d2cb937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:31.092406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213808b-92fa-4cd9-bcea-0327f0f85d3f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:31.147059 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1879/3759] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:31.161025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44db335-240a-4ead-a804-dd77d2cb937d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:31.164327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f44db335-240a-4ead-a804-dd77d2cb937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:31.169160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75e3aa-7d23-4d16-abe2-ef3a81780ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:31.170251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75e3aa-7d23-4d16-abe2-ef3a81780ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:31.170737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75e3aa-7d23-4d16-abe2-ef3a81780ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:31.171804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75e3aa-7d23-4d16-abe2-ef3a81780ff1 admin admin] PATH_INFO: `/v3/users/f092e5f52ee94fe1bd2dc069862d11b7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:31.173384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75e3aa-7d23-4d16-abe2-ef3a81780ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f092e5f52ee94fe1bd2dc069862d11b7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:31.176881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75e3aa-7d23-4d16-abe2-ef3a81780ff1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:31.242517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2b75e3aa-7d23-4d16-abe2-ef3a81780ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f092e5f52ee94fe1bd2dc069862d11b7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.243935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2b75e3aa-7d23-4d16-abe2-ef3a81780ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f092e5f52ee94fe1bd2dc069862d11b7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.258688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2b75e3aa-7d23-4d16-abe2-ef3a81780ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f092e5f52ee94fe1bd2dc069862d11b7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.259596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2b75e3aa-7d23-4d16-abe2-ef3a81780ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f092e5f52ee94fe1bd2dc069862d11b7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.270948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2b75e3aa-7d23-4d16-abe2-ef3a81780ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f092e5f52ee94fe1bd2dc069862d11b7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.276110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44db335-240a-4ead-a804-dd77d2cb937d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:31.282082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1f4e6-1678-470b-a8a1-9578d69e64a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:31.283599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f4e6-1678-470b-a8a1-9578d69e64a9 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:31.284249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f4e6-1678-470b-a8a1-9578d69e64a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:31.284626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f4e6-1678-470b-a8a1-9578d69e64a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:31.286649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-76d1f4e6-1678-470b-a8a1-9578d69e64a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:31.292256 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1881/3760] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:30 2021] DELETE /identity/v3/users/f092e5f52ee94fe1bd2dc069862d11b7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:55:31.315618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1f4e6-1678-470b-a8a1-9578d69e64a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:31.317691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1f4e6-1678-470b-a8a1-9578d69e64a9 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:31.331961 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1880/3761] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:31.487639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760a304-b167-4a13-854b-c3077f637a03 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:31.488519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760a304-b167-4a13-854b-c3077f637a03 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:31.492050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760a304-b167-4a13-854b-c3077f637a03 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:31.496651 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1882/3762] 10.222.0.21 () {54 vars in 963 bytes} [Sat Nov 27 20:55:31 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:55:31.502420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e25af1-6b2b-423d-b5c0-31a8a4cd750c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:31.502683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e25af1-6b2b-423d-b5c0-31a8a4cd750c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:31.502972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e25af1-6b2b-423d-b5c0-31a8a4cd750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:31.575049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-57e25af1-6b2b-423d-b5c0-31a8a4cd750c None None] MFA Rules not processed for user `198c9372013440ec942a0192a73a231d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:31.576363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-57e25af1-6b2b-423d-b5c0-31a8a4cd750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:31.637229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760a304-b167-4a13-854b-c3077f637a03 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:31.639047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3760a304-b167-4a13-854b-c3077f637a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:31.687014 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1881/3763] 10.222.0.21 () {58 vars in 1060 bytes} [Sat Nov 27 20:55:31 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:31.688367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efae7a-e109-4692-897a-352a7c66f06f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:31.689306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efae7a-e109-4692-897a-352a7c66f06f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:31.689652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efae7a-e109-4692-897a-352a7c66f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:31.714091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a3efae7a-e109-4692-897a-352a7c66f06f None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:31.716715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a3efae7a-e109-4692-897a-352a7c66f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:31.760339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760a304-b167-4a13-854b-c3077f637a03 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:31.766634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:31.768861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:31.769174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:31.769456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] PATH_INFO: `/v3/users/745d99de8bd24185aacbbcf7b2c404c2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:31.771112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=745d99de8bd24185aacbbcf7b2c404c2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:31.774455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:31.798188 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1882/3764] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:55:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:31.799451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efae7a-e109-4692-897a-352a7c66f06f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:31.809605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efae7a-e109-4692-897a-352a7c66f06f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:31.814519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91477c-2ae5-4cb5-88d0-4afacd086526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:31.815498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91477c-2ae5-4cb5-88d0-4afacd086526 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:31.816005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91477c-2ae5-4cb5-88d0-4afacd086526 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:31.816614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91477c-2ae5-4cb5-88d0-4afacd086526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:31.820072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6e91477c-2ae5-4cb5-88d0-4afacd086526 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:31.860525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '745d99de8bd24185aacbbcf7b2c404c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.862441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '745d99de8bd24185aacbbcf7b2c404c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.876541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '745d99de8bd24185aacbbcf7b2c404c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.878092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '745d99de8bd24185aacbbcf7b2c404c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.896990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '745d99de8bd24185aacbbcf7b2c404c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:31.928388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91477c-2ae5-4cb5-88d0-4afacd086526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:31.929963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91477c-2ae5-4cb5-88d0-4afacd086526 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:31.942541 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1883/3765] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:31 2021] DELETE /identity/v3/users/745d99de8bd24185aacbbcf7b2c404c2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:31.942541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:31.942883 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1883/3766] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:31.943024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:31.947897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91477c-2ae5-4cb5-88d0-4afacd086526 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:31.950728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6e91477c-2ae5-4cb5-88d0-4afacd086526 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:31.974661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91477c-2ae5-4cb5-88d0-4afacd086526 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:32.075701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:32.076686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.077379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.077379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] PATH_INFO: `/v3/projects/ab69590a5a74483187d535a37a2bc6ba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.079302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab69590a5a74483187d535a37a2bc6ba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:32.081126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:32.102440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e5d1b-ea59-4e5f-ac80-e498c2609c1e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:32.110658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d52c9-7e33-41a9-8abf-a3198f0702d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:32.112228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d52c9-7e33-41a9-8abf-a3198f0702d2 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.112516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d52c9-7e33-41a9-8abf-a3198f0702d2 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.112796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d52c9-7e33-41a9-8abf-a3198f0702d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.116541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-de4d52c9-7e33-41a9-8abf-a3198f0702d2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:32.207712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab69590a5a74483187d535a37a2bc6ba', 'request_id': 'req-59b57631-11a2-42ad-af8a-eec9cde9cc07'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.218473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d52c9-7e33-41a9-8abf-a3198f0702d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:32.220247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d52c9-7e33-41a9-8abf-a3198f0702d2 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:32.231646 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1884/3767] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:55:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:32.232695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d52c9-7e33-41a9-8abf-a3198f0702d2 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:32.233534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab69590a5a74483187d535a37a2bc6ba', 'request_id': 'req-59b57631-11a2-42ad-af8a-eec9cde9cc07'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.234222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-de4d52c9-7e33-41a9-8abf-a3198f0702d2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:32.244912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab69590a5a74483187d535a37a2bc6ba', 'request_id': 'req-59b57631-11a2-42ad-af8a-eec9cde9cc07'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.248964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d52c9-7e33-41a9-8abf-a3198f0702d2 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:32.264842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] The token cache is being invalidate because project ab69590a5a74483187d535a37a2bc6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:32.265433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.267046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-59b57631-11a2-42ad-af8a-eec9cde9cc07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.280966 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1884/3768] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:31 2021] DELETE /identity/v3/projects/ab69590a5a74483187d535a37a2bc6ba => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:32.282648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a17081-ff60-4f37-8cdf-b71a181f16ee None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.283122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a17081-ff60-4f37-8cdf-b71a181f16ee None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.283533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a17081-ff60-4f37-8cdf-b71a181f16ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.316877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-69a17081-ff60-4f37-8cdf-b71a181f16ee None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:32.318125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-69a17081-ff60-4f37-8cdf-b71a181f16ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:32.419092 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1885/3769] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:32.428954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:32.428954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.428954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.428954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] PATH_INFO: `/v3/projects/99a5eb3bc93349828958b7879707829a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.431326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a5eb3bc93349828958b7879707829a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:32.432282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df111aa7-9053-44b7-be5c-75aa8581a561 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.434514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:32.436029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df111aa7-9053-44b7-be5c-75aa8581a561 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.436430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df111aa7-9053-44b7-be5c-75aa8581a561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.467064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-df111aa7-9053-44b7-be5c-75aa8581a561 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:32.468377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-df111aa7-9053-44b7-be5c-75aa8581a561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:32.481958 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1886/3770] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:32.484187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df111aa7-9053-44b7-be5c-75aa8581a561 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:32.485829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-df111aa7-9053-44b7-be5c-75aa8581a561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:32.502543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df111aa7-9053-44b7-be5c-75aa8581a561 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:32.521018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a5eb3bc93349828958b7879707829a', 'request_id': 'req-7fccedd3-d234-47d1-a038-fc5be5f39671'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.541119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a5eb3bc93349828958b7879707829a', 'request_id': 'req-7fccedd3-d234-47d1-a038-fc5be5f39671'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.566410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a5eb3bc93349828958b7879707829a', 'request_id': 'req-7fccedd3-d234-47d1-a038-fc5be5f39671'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.594926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] The token cache is being invalidate because project 99a5eb3bc93349828958b7879707829a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:32.595492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.597913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:32.598474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.600674 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1885/3771] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:32 2021] DELETE /identity/v3/projects/99a5eb3bc93349828958b7879707829a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:32.604954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.604954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.604954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] PATH_INFO: `/v3/projects/50b227cd822e4eaea7803ae94baee3fe` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.606537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b227cd822e4eaea7803ae94baee3fe)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:32.608359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:32.608917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:32.611145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:32.635076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccedd3-d234-47d1-a038-fc5be5f39671 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:32.642032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81979730-9a63-4d72-9028-28887eb44abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:32.643311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979730-9a63-4d72-9028-28887eb44abf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.643500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979730-9a63-4d72-9028-28887eb44abf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.643835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979730-9a63-4d72-9028-28887eb44abf admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.644658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81979730-9a63-4d72-9028-28887eb44abf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:32.645371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81979730-9a63-4d72-9028-28887eb44abf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:32.647369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81979730-9a63-4d72-9028-28887eb44abf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:32.662684 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1886/3772] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:32.666089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dac93-2d7b-4e5c-99e7-a013d6062d25 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.666391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dac93-2d7b-4e5c-99e7-a013d6062d25 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.666668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222dac93-2d7b-4e5c-99e7-a013d6062d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.689381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-222dac93-2d7b-4e5c-99e7-a013d6062d25 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:32.690644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-222dac93-2d7b-4e5c-99e7-a013d6062d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:32.697199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b227cd822e4eaea7803ae94baee3fe', 'request_id': 'req-edf39627-f83e-448f-8b7f-52a35c329545'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.714889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b227cd822e4eaea7803ae94baee3fe', 'request_id': 'req-edf39627-f83e-448f-8b7f-52a35c329545'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.723059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b227cd822e4eaea7803ae94baee3fe', 'request_id': 'req-edf39627-f83e-448f-8b7f-52a35c329545'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.747003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] The token cache is being invalidate because project 50b227cd822e4eaea7803ae94baee3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:32.747314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.748147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:32.750322 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1887/3773] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:32 2021] DELETE /identity/v3/projects/50b227cd822e4eaea7803ae94baee3fe => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:32.751373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:32.753354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:32.799863 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1887/3774] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:32.805399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dbd4b-7a85-423a-8e7e-790093fb11f2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.805875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dbd4b-7a85-423a-8e7e-790093fb11f2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.806319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dbd4b-7a85-423a-8e7e-790093fb11f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.844128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b94dbd4b-7a85-423a-8e7e-790093fb11f2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:32.845543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b94dbd4b-7a85-423a-8e7e-790093fb11f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:32.855673 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1888/3775] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:32.856988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6f1f7-dd00-426e-bc10-a754f4443475 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.857272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6f1f7-dd00-426e-bc10-a754f4443475 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.857546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6f1f7-dd00-426e-bc10-a754f4443475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.878881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6bc6f1f7-dd00-426e-bc10-a754f4443475 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:32.880228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6bc6f1f7-dd00-426e-bc10-a754f4443475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:32.923226 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1889/3776] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:32.927614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6f1f7-dd00-426e-bc10-a754f4443475 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:32.931839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf39627-f83e-448f-8b7f-52a35c329545 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:32.937907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ee80e-362b-4f17-ba58-83a09dfc42d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:32.938376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6f1f7-dd00-426e-bc10-a754f4443475 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:32.939120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ee80e-362b-4f17-ba58-83a09dfc42d5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.939445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ee80e-362b-4f17-ba58-83a09dfc42d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.939724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ee80e-362b-4f17-ba58-83a09dfc42d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.940435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ee80e-362b-4f17-ba58-83a09dfc42d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:32.942567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ee80e-362b-4f17-ba58-83a09dfc42d5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:32.944967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04042a-6e91-43fe-8ee1-4856292c15a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:32.945735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04042a-6e91-43fe-8ee1-4856292c15a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.946119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04042a-6e91-43fe-8ee1-4856292c15a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.946635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04042a-6e91-43fe-8ee1-4856292c15a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.947496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04042a-6e91-43fe-8ee1-4856292c15a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:32.947899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04042a-6e91-43fe-8ee1-4856292c15a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:32.950041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04042a-6e91-43fe-8ee1-4856292c15a6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:32.975689 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1888/3777] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:32 2021] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:32.980557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5dc23-93bb-4bb5-b8f0-894ed1602935 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:32.981041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5dc23-93bb-4bb5-b8f0-894ed1602935 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:32.981475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5dc23-93bb-4bb5-b8f0-894ed1602935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:32.981628 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1890/3778] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:55:32.982473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04042a-6e91-43fe-8ee1-4856292c15a6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.004197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04042a-6e91-43fe-8ee1-4856292c15a6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.037958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f6a5dc23-93bb-4bb5-b8f0-894ed1602935 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:33.039338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f6a5dc23-93bb-4bb5-b8f0-894ed1602935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:33.101774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510a144-2df2-43eb-bc91-40a47bb3d63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.103759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510a144-2df2-43eb-bc91-40a47bb3d63b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.103759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510a144-2df2-43eb-bc91-40a47bb3d63b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.104063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510a144-2df2-43eb-bc91-40a47bb3d63b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.104733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510a144-2df2-43eb-bc91-40a47bb3d63b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.111912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510a144-2df2-43eb-bc91-40a47bb3d63b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.144019 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1891/3779] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:32 2021] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:33.145107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510a144-2df2-43eb-bc91-40a47bb3d63b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.155099 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1889/3780] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:33.156682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5dc23-93bb-4bb5-b8f0-894ed1602935 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.163537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510a144-2df2-43eb-bc91-40a47bb3d63b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.172601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5dc23-93bb-4bb5-b8f0-894ed1602935 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.175047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8b07c-f0bd-44d0-a251-4c373f25ddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.175918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b07c-f0bd-44d0-a251-4c373f25ddd8 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.176203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b07c-f0bd-44d0-a251-4c373f25ddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.176485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8b07c-f0bd-44d0-a251-4c373f25ddd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.177391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8b07c-f0bd-44d0-a251-4c373f25ddd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.179640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8b07c-f0bd-44d0-a251-4c373f25ddd8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.180839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ca1a2-ea96-40a3-a20b-d1b9be530f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.182191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ca1a2-ea96-40a3-a20b-d1b9be530f80 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.182953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ca1a2-ea96-40a3-a20b-d1b9be530f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.186329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ca1a2-ea96-40a3-a20b-d1b9be530f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.187364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ca1a2-ea96-40a3-a20b-d1b9be530f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.189551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ca1a2-ea96-40a3-a20b-d1b9be530f80 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.210763 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1890/3781] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:33 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:33.210763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ca1a2-ea96-40a3-a20b-d1b9be530f80 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.214005 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1892/3782] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:33 2021] POST /identity/v3/projects => generated 399 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:33.216248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b238-82a4-48e4-a3f4-45b5cc5d4c26 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.216582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b238-82a4-48e4-a3f4-45b5cc5d4c26 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.217127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b238-82a4-48e4-a3f4-45b5cc5d4c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.227177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ca1a2-ea96-40a3-a20b-d1b9be530f80 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.253230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b751b238-82a4-48e4-a3f4-45b5cc5d4c26 None None] MFA Rules not processed for user `b8a8aa467b0a42459f18f6bd4ee623e4`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:33.258180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b751b238-82a4-48e4-a3f4-45b5cc5d4c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:33.323694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc88ff4-18a6-49e6-a4ff-638519398ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.323694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88ff4-18a6-49e6-a4ff-638519398ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.323694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88ff4-18a6-49e6-a4ff-638519398ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.323694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc88ff4-18a6-49e6-a4ff-638519398ae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.324419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc88ff4-18a6-49e6-a4ff-638519398ae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:33.324987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc88ff4-18a6-49e6-a4ff-638519398ae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.326464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc88ff4-18a6-49e6-a4ff-638519398ae7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.343711 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1891/3783] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:33.344821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc88ff4-18a6-49e6-a4ff-638519398ae7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.352876 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1893/3784] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:33 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:33.359515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b238-82a4-48e4-a3f4-45b5cc5d4c26 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.361219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc88ff4-18a6-49e6-a4ff-638519398ae7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.367102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ae3a-6c1d-452b-863a-e7cf84f5c0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.367751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ae3a-6c1d-452b-863a-e7cf84f5c0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.368025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ae3a-6c1d-452b-863a-e7cf84f5c0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.368304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1ae3a-6c1d-452b-863a-e7cf84f5c0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.369044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1ae3a-6c1d-452b-863a-e7cf84f5c0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.370845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be1ae3a-6c1d-452b-863a-e7cf84f5c0e7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.375697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b238-82a4-48e4-a3f4-45b5cc5d4c26 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.381768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37852830-e1d8-42e4-936d-3ea5f241847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.382503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37852830-e1d8-42e4-936d-3ea5f241847d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.383057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37852830-e1d8-42e4-936d-3ea5f241847d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.383413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37852830-e1d8-42e4-936d-3ea5f241847d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.386609 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1892/3785] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:33 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:33.386747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37852830-e1d8-42e4-936d-3ea5f241847d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.386851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ae3a-6c1d-452b-863a-e7cf84f5c0e7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.387130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37852830-e1d8-42e4-936d-3ea5f241847d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.397127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be1ae3a-6c1d-452b-863a-e7cf84f5c0e7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.410973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7fd74-33be-4099-a60b-fee105aa23cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.411691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7fd74-33be-4099-a60b-fee105aa23cd admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.411978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7fd74-33be-4099-a60b-fee105aa23cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.412352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7fd74-33be-4099-a60b-fee105aa23cd admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.413692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7fd74-33be-4099-a60b-fee105aa23cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.415237 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1894/3786] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:33 2021] POST /identity/v3/users => generated 300 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:33.416402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37852830-e1d8-42e4-936d-3ea5f241847d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.419747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7fd74-33be-4099-a60b-fee105aa23cd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.441184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37852830-e1d8-42e4-936d-3ea5f241847d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.454456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af847e3-bdb8-4653-a012-e73887603949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.455476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af847e3-bdb8-4653-a012-e73887603949 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.455794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af847e3-bdb8-4653-a012-e73887603949 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.456072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af847e3-bdb8-4653-a012-e73887603949 admin admin] PATH_INFO: `/v3/projects/3c7fffc05d14425e90b01b461b745760/users/ad2229c76ef54ed19a22582c6898006b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.519146 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1893/3787] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:33 2021] POST /identity/v3/projects => generated 397 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:33.519146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7fd74-33be-4099-a60b-fee105aa23cd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.519674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af847e3-bdb8-4653-a012-e73887603949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7fffc05d14425e90b01b461b745760, user_id=ad2229c76ef54ed19a22582c6898006b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.519674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af847e3-bdb8-4653-a012-e73887603949 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.541096 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1895/3788] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:33 2021] PUT /identity/v3/projects/3c7fffc05d14425e90b01b461b745760/users/ad2229c76ef54ed19a22582c6898006b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:33.541096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af847e3-bdb8-4653-a012-e73887603949 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.619229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af847e3-bdb8-4653-a012-e73887603949 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.629731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf268b9-d98a-40c1-91a8-7f2a7c4f7f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.630420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf268b9-d98a-40c1-91a8-7f2a7c4f7f14 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.630706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf268b9-d98a-40c1-91a8-7f2a7c4f7f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.630986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf268b9-d98a-40c1-91a8-7f2a7c4f7f14 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.631736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf268b9-d98a-40c1-91a8-7f2a7c4f7f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.633733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf268b9-d98a-40c1-91a8-7f2a7c4f7f14 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.653331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7fd74-33be-4099-a60b-fee105aa23cd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.661376 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1896/3789] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:33 2021] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:33.662864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea063-ceb3-4a9f-a2fa-bd2795ce6e40 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.663159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea063-ceb3-4a9f-a2fa-bd2795ce6e40 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.663467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea063-ceb3-4a9f-a2fa-bd2795ce6e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.666594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026f9b-727b-46b8-9ff9-f8185fceb6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.667368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026f9b-727b-46b8-9ff9-f8185fceb6ec admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.667729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026f9b-727b-46b8-9ff9-f8185fceb6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.668015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d026f9b-727b-46b8-9ff9-f8185fceb6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.668749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d026f9b-727b-46b8-9ff9-f8185fceb6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.670357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d026f9b-727b-46b8-9ff9-f8185fceb6ec admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.700429 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1894/3790] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:33 2021] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:33.701543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026f9b-727b-46b8-9ff9-f8185fceb6ec admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.711554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-991ea063-ceb3-4a9f-a2fa-bd2795ce6e40 None None] MFA Rules not processed for user `ad2229c76ef54ed19a22582c6898006b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:33.713551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-991ea063-ceb3-4a9f-a2fa-bd2795ce6e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:33.718371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d026f9b-727b-46b8-9ff9-f8185fceb6ec admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.732114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7e546-ba77-47ce-978f-6a2696a75e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.733066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7e546-ba77-47ce-978f-6a2696a75e12 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.734050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7e546-ba77-47ce-978f-6a2696a75e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.734443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7e546-ba77-47ce-978f-6a2696a75e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.735716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7e546-ba77-47ce-978f-6a2696a75e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.737559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7e546-ba77-47ce-978f-6a2696a75e12 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.752138 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1895/3791] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:33 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:33.752138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7e546-ba77-47ce-978f-6a2696a75e12 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.763146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7e546-ba77-47ce-978f-6a2696a75e12 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.770974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ce065-0508-4909-8e07-88d7bb89e22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.772581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ce065-0508-4909-8e07-88d7bb89e22a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.773104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ce065-0508-4909-8e07-88d7bb89e22a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.773521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ce065-0508-4909-8e07-88d7bb89e22a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.775497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ce065-0508-4909-8e07-88d7bb89e22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.779023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ce065-0508-4909-8e07-88d7bb89e22a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.791020 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1896/3792] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:33 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:33.792458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ce065-0508-4909-8e07-88d7bb89e22a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.805208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ce065-0508-4909-8e07-88d7bb89e22a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.812097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eadc04-5b66-4f15-b3cc-a3b434bb41c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.813216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eadc04-5b66-4f15-b3cc-a3b434bb41c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.813751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eadc04-5b66-4f15-b3cc-a3b434bb41c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.814221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eadc04-5b66-4f15-b3cc-a3b434bb41c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.815286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eadc04-5b66-4f15-b3cc-a3b434bb41c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.817161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eadc04-5b66-4f15-b3cc-a3b434bb41c8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.833688 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1897/3793] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:33.835835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eadc04-5b66-4f15-b3cc-a3b434bb41c8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.847054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eadc04-5b66-4f15-b3cc-a3b434bb41c8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:33.853460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4cee8-be6e-4198-b914-d6d84501f832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:33.854452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4cee8-be6e-4198-b914-d6d84501f832 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.854861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4cee8-be6e-4198-b914-d6d84501f832 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.855345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4cee8-be6e-4198-b914-d6d84501f832 admin admin] PATH_INFO: `/v3/projects/7895e84a65ed41808aae6e8f05780bca/users/a5e06f88a7a941909e40b105d2f30310/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.871990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4cee8-be6e-4198-b914-d6d84501f832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7895e84a65ed41808aae6e8f05780bca, user_id=a5e06f88a7a941909e40b105d2f30310, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:33.874814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4cee8-be6e-4198-b914-d6d84501f832 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:33.895928 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1897/3794] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:33 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:33.897089 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1898/3795] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:33 2021] PUT /identity/v3/projects/7895e84a65ed41808aae6e8f05780bca/users/a5e06f88a7a941909e40b105d2f30310/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:33.902524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f4a56-5445-49a5-bddb-dd3f55bc418a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:33.902829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f4a56-5445-49a5-bddb-dd3f55bc418a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:33.903107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f4a56-5445-49a5-bddb-dd3f55bc418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:33.910720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ea063-ceb3-4a9f-a2fa-bd2795ce6e40 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:33.924183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2d7f4a56-5445-49a5-bddb-dd3f55bc418a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:33.925467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2d7f4a56-5445-49a5-bddb-dd3f55bc418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:33.926226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ea063-ceb3-4a9f-a2fa-bd2795ce6e40 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:34.016317 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1899/3796] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:34.017919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f4a56-5445-49a5-bddb-dd3f55bc418a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:34.021237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2d7f4a56-5445-49a5-bddb-dd3f55bc418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:34.037065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5ec0d-bd60-41fe-b47b-3e2fa9703042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:34.038404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ec0d-bd60-41fe-b47b-3e2fa9703042 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:34.038724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ec0d-bd60-41fe-b47b-3e2fa9703042 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:34.039005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5ec0d-bd60-41fe-b47b-3e2fa9703042 admin admin] PATH_INFO: `/v3/projects/f60857db820e4d7eb13ec7edea9c8cf3/users/18f6851647fb4b7a851f5f94499a087c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:34.060685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5ec0d-bd60-41fe-b47b-3e2fa9703042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60857db820e4d7eb13ec7edea9c8cf3, user_id=18f6851647fb4b7a851f5f94499a087c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:34.063786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5ec0d-bd60-41fe-b47b-3e2fa9703042 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:34.079312 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1898/3797] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:33 2021] PUT /identity/v3/projects/f60857db820e4d7eb13ec7edea9c8cf3/users/18f6851647fb4b7a851f5f94499a087c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:34.080239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5ec0d-bd60-41fe-b47b-3e2fa9703042 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:34.081966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5eb5ec0d-bd60-41fe-b47b-3e2fa9703042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:34.110876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f4a56-5445-49a5-bddb-dd3f55bc418a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:34.185003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc69046-a2b2-4f1e-82fa-ad4b231fec65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:34.185916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69046-a2b2-4f1e-82fa-ad4b231fec65 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:34.186493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69046-a2b2-4f1e-82fa-ad4b231fec65 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:34.186955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69046-a2b2-4f1e-82fa-ad4b231fec65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:34.196442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5ec0d-bd60-41fe-b47b-3e2fa9703042 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:34.205631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db2c9d-222c-45c8-93b8-f8e2084bd4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:34.206448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2c9d-222c-45c8-93b8-f8e2084bd4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:34.206800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2c9d-222c-45c8-93b8-f8e2084bd4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:34.207232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db2c9d-222c-45c8-93b8-f8e2084bd4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:34.289540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc69046-a2b2-4f1e-82fa-ad4b231fec65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:34.291398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc69046-a2b2-4f1e-82fa-ad4b231fec65 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:34.303926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db2c9d-222c-45c8-93b8-f8e2084bd4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:34.303926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db2c9d-222c-45c8-93b8-f8e2084bd4f8 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:34.316489 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1900/3798] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:34 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:34.318230 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1899/3799] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:34.319225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283fbcb-d717-4a98-8b0c-7403b3ba64f1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:34.319588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283fbcb-d717-4a98-8b0c-7403b3ba64f1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:34.321528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283fbcb-d717-4a98-8b0c-7403b3ba64f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:34.398408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a283fbcb-d717-4a98-8b0c-7403b3ba64f1 None None] MFA Rules not processed for user `18f6851647fb4b7a851f5f94499a087c`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:34.402145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a283fbcb-d717-4a98-8b0c-7403b3ba64f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:34.473176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db2c9d-222c-45c8-93b8-f8e2084bd4f8 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:34.493293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db2c9d-222c-45c8-93b8-f8e2084bd4f8 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:34.500561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4186661-9e0b-418e-9f8a-15371887826a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:34.501740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4186661-9e0b-418e-9f8a-15371887826a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:34.502687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4186661-9e0b-418e-9f8a-15371887826a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:34.503412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4186661-9e0b-418e-9f8a-15371887826a admin admin] PATH_INFO: `/v3/users/ad2229c76ef54ed19a22582c6898006b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:34.505870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4186661-9e0b-418e-9f8a-15371887826a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2229c76ef54ed19a22582c6898006b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:34.508865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4186661-9e0b-418e-9f8a-15371887826a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:34.585176 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1901/3800] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:34 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:34.628253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a4186661-9e0b-418e-9f8a-15371887826a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2229c76ef54ed19a22582c6898006b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:34.628893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283fbcb-d717-4a98-8b0c-7403b3ba64f1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:34.630298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a283fbcb-d717-4a98-8b0c-7403b3ba64f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:34.630771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a4186661-9e0b-418e-9f8a-15371887826a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2229c76ef54ed19a22582c6898006b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:34.645931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a4186661-9e0b-418e-9f8a-15371887826a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2229c76ef54ed19a22582c6898006b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:34.649988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a4186661-9e0b-418e-9f8a-15371887826a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2229c76ef54ed19a22582c6898006b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:34.677433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a4186661-9e0b-418e-9f8a-15371887826a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2229c76ef54ed19a22582c6898006b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:34.718585 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1900/3801] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:34 2021] DELETE /identity/v3/users/ad2229c76ef54ed19a22582c6898006b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:34.726323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02527f-c2fc-4536-813d-30011c9d4690 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:34.726647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02527f-c2fc-4536-813d-30011c9d4690 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:34.728789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02527f-c2fc-4536-813d-30011c9d4690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:34.759900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283fbcb-d717-4a98-8b0c-7403b3ba64f1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:34.773564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8d02527f-c2fc-4536-813d-30011c9d4690 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:34.774931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8d02527f-c2fc-4536-813d-30011c9d4690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:34.889109 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1901/3802] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:34.900727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02527f-c2fc-4536-813d-30011c9d4690 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:34.903157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8d02527f-c2fc-4536-813d-30011c9d4690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:34.918067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4647d82-f55f-4b4a-817d-ec3e7b72781d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:34.919754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4647d82-f55f-4b4a-817d-ec3e7b72781d service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:34.920273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4647d82-f55f-4b4a-817d-ec3e7b72781d service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:34.920726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4647d82-f55f-4b4a-817d-ec3e7b72781d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:34.923568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a4647d82-f55f-4b4a-817d-ec3e7b72781d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:35.042217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4647d82-f55f-4b4a-817d-ec3e7b72781d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:35.044772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4647d82-f55f-4b4a-817d-ec3e7b72781d service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:35.049972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02527f-c2fc-4536-813d-30011c9d4690 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:35.055587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8267645-5f97-4f93-af10-404229de983a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:35.056233 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1902/3803] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:34 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:55:35.069227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8267645-5f97-4f93-af10-404229de983a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:35.070449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8267645-5f97-4f93-af10-404229de983a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:35.070640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8267645-5f97-4f93-af10-404229de983a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:35.092818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8267645-5f97-4f93-af10-404229de983a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:35.098803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8267645-5f97-4f93-af10-404229de983a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:35.130645 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1902/3804] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:55:35.138090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544ccc9-402e-47a8-95e8-426502732b87 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:35.138468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544ccc9-402e-47a8-95e8-426502732b87 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:35.138821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544ccc9-402e-47a8-95e8-426502732b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:35.162734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36e5d4-1869-44d9-8ab9-ccb93368b21d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:35.163017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36e5d4-1869-44d9-8ab9-ccb93368b21d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:35.163336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36e5d4-1869-44d9-8ab9-ccb93368b21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:35.177893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a544ccc9-402e-47a8-95e8-426502732b87 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:35.180947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a544ccc9-402e-47a8-95e8-426502732b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:35.195380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9c36e5d4-1869-44d9-8ab9-ccb93368b21d None None] MFA Rules not processed for user `18f6851647fb4b7a851f5f94499a087c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:35.196702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9c36e5d4-1869-44d9-8ab9-ccb93368b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:35.215791 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1903/3805] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:35 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:35.329840 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1903/3806] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:55:35 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:35.357792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36e5d4-1869-44d9-8ab9-ccb93368b21d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:35.360030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9c36e5d4-1869-44d9-8ab9-ccb93368b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:35.516874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36e5d4-1869-44d9-8ab9-ccb93368b21d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:35.525857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1b23f-dde6-494e-8493-ae3c616cf2c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:35.526530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b23f-dde6-494e-8493-ae3c616cf2c5 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:35.527452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b23f-dde6-494e-8493-ae3c616cf2c5 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:35.527703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1b23f-dde6-494e-8493-ae3c616cf2c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:35.542596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1b23f-dde6-494e-8493-ae3c616cf2c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:35.545279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1b23f-dde6-494e-8493-ae3c616cf2c5 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:35.558886 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1904/3807] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:55:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:35.976060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544ccc9-402e-47a8-95e8-426502732b87 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:35.979170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a544ccc9-402e-47a8-95e8-426502732b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:36.026538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544ccc9-402e-47a8-95e8-426502732b87 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:36.047949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe266e0-d0bc-41fd-8b4f-321f6588d130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:36.049334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe266e0-d0bc-41fd-8b4f-321f6588d130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:36.049631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe266e0-d0bc-41fd-8b4f-321f6588d130 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:36.049912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe266e0-d0bc-41fd-8b4f-321f6588d130 admin admin] PATH_INFO: `/v3/users/18f6851647fb4b7a851f5f94499a087c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:36.051424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe266e0-d0bc-41fd-8b4f-321f6588d130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f6851647fb4b7a851f5f94499a087c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:36.054758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe266e0-d0bc-41fd-8b4f-321f6588d130 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:36.213185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fe266e0-d0bc-41fd-8b4f-321f6588d130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f6851647fb4b7a851f5f94499a087c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:36.227893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fe266e0-d0bc-41fd-8b4f-321f6588d130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f6851647fb4b7a851f5f94499a087c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:36.232359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fe266e0-d0bc-41fd-8b4f-321f6588d130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f6851647fb4b7a851f5f94499a087c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:36.243286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fe266e0-d0bc-41fd-8b4f-321f6588d130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f6851647fb4b7a851f5f94499a087c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:36.262674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fe266e0-d0bc-41fd-8b4f-321f6588d130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f6851647fb4b7a851f5f94499a087c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:36.282467 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1904/3808] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:35 2021] DELETE /identity/v3/users/18f6851647fb4b7a851f5f94499a087c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:36.286995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef936-58d6-4812-b450-db86fb77764c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:36.287495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef936-58d6-4812-b450-db86fb77764c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:36.287855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef936-58d6-4812-b450-db86fb77764c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:36.332297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdd4ca-d524-48ea-abf6-da50bbd91931 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:36.333038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdd4ca-d524-48ea-abf6-da50bbd91931 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:36.333464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdd4ca-d524-48ea-abf6-da50bbd91931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:36.346365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6f9ef936-58d6-4812-b450-db86fb77764c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:36.347536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6f9ef936-58d6-4812-b450-db86fb77764c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:36.405692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c5fdd4ca-d524-48ea-abf6-da50bbd91931 None None] MFA Rules not processed for user `a5e06f88a7a941909e40b105d2f30310`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:36.406828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c5fdd4ca-d524-48ea-abf6-da50bbd91931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:36.556394 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1905/3809] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:36.560800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838440e-f801-4f87-b941-01694ffc0beb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:36.561358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838440e-f801-4f87-b941-01694ffc0beb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:36.561777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838440e-f801-4f87-b941-01694ffc0beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:36.583453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a838440e-f801-4f87-b941-01694ffc0beb None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:36.585158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a838440e-f801-4f87-b941-01694ffc0beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:36.614014 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1905/3810] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:36 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:36.615659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ca31-69d4-4e7c-95ed-e8a076c9f95c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:36.615954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ca31-69d4-4e7c-95ed-e8a076c9f95c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:36.616236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ca31-69d4-4e7c-95ed-e8a076c9f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:36.658135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4164ca31-69d4-4e7c-95ed-e8a076c9f95c None None] MFA Rules not processed for user `a5e06f88a7a941909e40b105d2f30310`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:36.664207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4164ca31-69d4-4e7c-95ed-e8a076c9f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:36.675390 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1906/3811] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:55:36 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:36.690686 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1906/3812] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:36 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:36.690686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ca31-69d4-4e7c-95ed-e8a076c9f95c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:36.690686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4164ca31-69d4-4e7c-95ed-e8a076c9f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:36.702155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838440e-f801-4f87-b941-01694ffc0beb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:36.704101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a838440e-f801-4f87-b941-01694ffc0beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:36.859934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ca31-69d4-4e7c-95ed-e8a076c9f95c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:36.863173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838440e-f801-4f87-b941-01694ffc0beb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:36.863915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc7f56-ca8a-45c8-90e1-58a5789fd24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:36.864821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc7f56-ca8a-45c8-90e1-58a5789fd24b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:36.865191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc7f56-ca8a-45c8-90e1-58a5789fd24b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:36.865670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc7f56-ca8a-45c8-90e1-58a5789fd24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:36.880062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f64bd8-2b41-49b3-956e-811b91645ce6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:36.881731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f64bd8-2b41-49b3-956e-811b91645ce6 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:36.882041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f64bd8-2b41-49b3-956e-811b91645ce6 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:36.882926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f64bd8-2b41-49b3-956e-811b91645ce6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:36.891653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc7f56-ca8a-45c8-90e1-58a5789fd24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:36.893321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc7f56-ca8a-45c8-90e1-58a5789fd24b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:36.904657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f64bd8-2b41-49b3-956e-811b91645ce6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:36.906514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f64bd8-2b41-49b3-956e-811b91645ce6 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:36.918669 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1907/3813] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:36.921850 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1907/3814] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:55:36 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:37.074028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc7f56-ca8a-45c8-90e1-58a5789fd24b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:37.076789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9edc7f56-ca8a-45c8-90e1-58a5789fd24b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:37.101269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc7f56-ca8a-45c8-90e1-58a5789fd24b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:37.113654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:37.114718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:37.115150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:37.115602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] PATH_INFO: `/v3/projects/3c7fffc05d14425e90b01b461b745760` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:37.117655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7fffc05d14425e90b01b461b745760)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:37.119746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:37.259616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7fffc05d14425e90b01b461b745760', 'request_id': 'req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:37.279689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7fffc05d14425e90b01b461b745760', 'request_id': 'req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:37.308036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7fffc05d14425e90b01b461b745760', 'request_id': 'req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:37.335947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] The token cache is being invalidate because project 3c7fffc05d14425e90b01b461b745760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:37.336459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:37.337366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:37.340186 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1908/3815] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:37 2021] DELETE /identity/v3/projects/3c7fffc05d14425e90b01b461b745760 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:37.346129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b346f-b818-436b-88ed-a512692bf6fc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:37.346985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b346f-b818-436b-88ed-a512692bf6fc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:37.347455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b346f-b818-436b-88ed-a512692bf6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:37.389441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ca1b346f-b818-436b-88ed-a512692bf6fc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:37.392826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ca1b346f-b818-436b-88ed-a512692bf6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:37.404115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:37.405780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:37.560658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfe38a-096d-4f3d-bb60-a0eb52145f2c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:37.579279 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1908/3816] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:37.582265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22e708-9942-4282-9802-fa5562ace86c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:37.582554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22e708-9942-4282-9802-fa5562ace86c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:37.582881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22e708-9942-4282-9802-fa5562ace86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:37.582984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684175fe-86b2-4358-b909-afee794ccb25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:37.583663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684175fe-86b2-4358-b909-afee794ccb25 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:37.583946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684175fe-86b2-4358-b909-afee794ccb25 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:37.584228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684175fe-86b2-4358-b909-afee794ccb25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:37.590997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-684175fe-86b2-4358-b909-afee794ccb25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:37.622133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8d22e708-9942-4282-9802-fa5562ace86c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:37.625130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8d22e708-9942-4282-9802-fa5562ace86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:37.642261 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1909/3817] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:37.646430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22e708-9942-4282-9802-fa5562ace86c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:37.656650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22e708-9942-4282-9802-fa5562ace86c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:37.686638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534c31-89e0-4c72-8834-2e63608838bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:37.687682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534c31-89e0-4c72-8834-2e63608838bf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:37.688449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534c31-89e0-4c72-8834-2e63608838bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:37.688899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534c31-89e0-4c72-8834-2e63608838bf admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:37.689958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534c31-89e0-4c72-8834-2e63608838bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:37.691169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534c31-89e0-4c72-8834-2e63608838bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:37.693300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534c31-89e0-4c72-8834-2e63608838bf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:37.736478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684175fe-86b2-4358-b909-afee794ccb25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:37.738191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684175fe-86b2-4358-b909-afee794ccb25 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:37.755847 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1910/3818] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:55:37.756831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534c31-89e0-4c72-8834-2e63608838bf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:37.781946 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1909/3819] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:37 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:55:37.823072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534c31-89e0-4c72-8834-2e63608838bf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:37.846482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e1d4b-1f3b-4174-b6db-83080d6671a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:37.847195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e1d4b-1f3b-4174-b6db-83080d6671a6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:37.848639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e1d4b-1f3b-4174-b6db-83080d6671a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:37.848939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e1d4b-1f3b-4174-b6db-83080d6671a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:37.851239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e1d4b-1f3b-4174-b6db-83080d6671a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:37.857738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e1d4b-1f3b-4174-b6db-83080d6671a6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:37.938348 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1911/3820] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:37 2021] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:37.942198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684175fe-86b2-4358-b909-afee794ccb25 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:37.954220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058af26-01f5-484a-87c8-7f90c93aa8ac None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:37.954541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058af26-01f5-484a-87c8-7f90c93aa8ac None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:37.954895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684175fe-86b2-4358-b909-afee794ccb25 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:37.954992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058af26-01f5-484a-87c8-7f90c93aa8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:37.979173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6058af26-01f5-484a-87c8-7f90c93aa8ac None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:37.982614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6058af26-01f5-484a-87c8-7f90c93aa8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:38.121804 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1912/3821] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:55:37 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:38.137559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058af26-01f5-484a-87c8-7f90c93aa8ac None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:38.142499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6058af26-01f5-484a-87c8-7f90c93aa8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:38.157180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1a19c-c355-4407-b8a7-8378bc6942ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:38.157865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1a19c-c355-4407-b8a7-8378bc6942ff admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:38.158146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1a19c-c355-4407-b8a7-8378bc6942ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:38.158414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1a19c-c355-4407-b8a7-8378bc6942ff admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:38.159121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1a19c-c355-4407-b8a7-8378bc6942ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:38.161090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1a19c-c355-4407-b8a7-8378bc6942ff admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:38.244299 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1910/3822] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:37 2021] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:38.247971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1a19c-c355-4407-b8a7-8378bc6942ff admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:38.251459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a7c1a19c-c355-4407-b8a7-8378bc6942ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:38.382888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058af26-01f5-484a-87c8-7f90c93aa8ac None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:38.393057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:38.394555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:38.394992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:38.395584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] PATH_INFO: `/v3/projects/f60857db820e4d7eb13ec7edea9c8cf3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:38.397585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60857db820e4d7eb13ec7edea9c8cf3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:38.400769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:38.449085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1a19c-c355-4407-b8a7-8378bc6942ff admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:38.458349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1b658-1db0-436c-86a9-155c34f304eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:38.459331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1b658-1db0-436c-86a9-155c34f304eb service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:38.459716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1b658-1db0-436c-86a9-155c34f304eb service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:38.460087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1b658-1db0-436c-86a9-155c34f304eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:38.480310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1b658-1db0-436c-86a9-155c34f304eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:38.489330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1b658-1db0-436c-86a9-155c34f304eb service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:38.518528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60857db820e4d7eb13ec7edea9c8cf3', 'request_id': 'req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:38.520950 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1911/3823] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:55:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:38.523058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1b658-1db0-436c-86a9-155c34f304eb service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:38.527232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60857db820e4d7eb13ec7edea9c8cf3', 'request_id': 'req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:38.539085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60857db820e4d7eb13ec7edea9c8cf3', 'request_id': 'req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:38.560048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1b658-1db0-436c-86a9-155c34f304eb service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:38.586011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] The token cache is being invalidate because project f60857db820e4d7eb13ec7edea9c8cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:38.591359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:38.594303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86405bcc-40d6-40c4-ae5a-bc8db4b8f096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:38.599093 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1913/3824] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:38 2021] DELETE /identity/v3/projects/f60857db820e4d7eb13ec7edea9c8cf3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:38.610241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d813be9-a5ac-4a7a-ac92-4cf2ee984b93 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:38.610804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d813be9-a5ac-4a7a-ac92-4cf2ee984b93 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:38.611652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d813be9-a5ac-4a7a-ac92-4cf2ee984b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:38.643237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30cd8e-7776-4995-89c9-f893da8f6267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:38.644049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cd8e-7776-4995-89c9-f893da8f6267 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:38.644337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cd8e-7776-4995-89c9-f893da8f6267 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:38.644614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30cd8e-7776-4995-89c9-f893da8f6267 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:38.645514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30cd8e-7776-4995-89c9-f893da8f6267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:38.648393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30cd8e-7776-4995-89c9-f893da8f6267 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:38.665067 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1912/3825] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:38 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:38.666825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30cd8e-7776-4995-89c9-f893da8f6267 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:38.671001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9d813be9-a5ac-4a7a-ac92-4cf2ee984b93 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:38.672062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1e30cd8e-7776-4995-89c9-f893da8f6267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:38.674792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9d813be9-a5ac-4a7a-ac92-4cf2ee984b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:38.694291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30cd8e-7776-4995-89c9-f893da8f6267 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:38.696849 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1914/3826] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:38.715102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09843df-2e9b-4f89-a118-d3ea008e8895 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:38.715439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09843df-2e9b-4f89-a118-d3ea008e8895 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:38.715779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09843df-2e9b-4f89-a118-d3ea008e8895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:38.716409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf659f18-4b6e-41fc-972a-e4b96ba48b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:38.717097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf659f18-4b6e-41fc-972a-e4b96ba48b0d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:38.717374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf659f18-4b6e-41fc-972a-e4b96ba48b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:38.717650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf659f18-4b6e-41fc-972a-e4b96ba48b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:38.719171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf659f18-4b6e-41fc-972a-e4b96ba48b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:38.721543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf659f18-4b6e-41fc-972a-e4b96ba48b0d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:38.739301 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1913/3827] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:38 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:38.742715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf659f18-4b6e-41fc-972a-e4b96ba48b0d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:38.751192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f09843df-2e9b-4f89-a118-d3ea008e8895 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:38.752577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f09843df-2e9b-4f89-a118-d3ea008e8895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:38.767734 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1915/3828] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:38.770794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf659f18-4b6e-41fc-972a-e4b96ba48b0d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:38.771525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09843df-2e9b-4f89-a118-d3ea008e8895 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:38.783051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb7506-edf7-4e6d-9191-5de8b43a8e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:38.784001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb7506-edf7-4e6d-9191-5de8b43a8e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:38.784290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb7506-edf7-4e6d-9191-5de8b43a8e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:38.784559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb7506-edf7-4e6d-9191-5de8b43a8e57 admin admin] PATH_INFO: `/v3/projects/eaf0a3c55d6947a7b6cb4b7cf26a2264/users/340e329dda9f4b75adb23c70ed7b8eb7/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:38.789061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09843df-2e9b-4f89-a118-d3ea008e8895 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:38.806809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692613b-2f4d-473e-992c-517d6f0a1019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:38.807827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692613b-2f4d-473e-992c-517d6f0a1019 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:38.808288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692613b-2f4d-473e-992c-517d6f0a1019 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:38.808577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692613b-2f4d-473e-992c-517d6f0a1019 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:38.810495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692613b-2f4d-473e-992c-517d6f0a1019 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:38.812661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692613b-2f4d-473e-992c-517d6f0a1019 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:38.816746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692613b-2f4d-473e-992c-517d6f0a1019 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:38.821622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb7506-edf7-4e6d-9191-5de8b43a8e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf0a3c55d6947a7b6cb4b7cf26a2264, user_id=340e329dda9f4b75adb23c70ed7b8eb7, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:38.826427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb7506-edf7-4e6d-9191-5de8b43a8e57 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:38.852962 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1916/3829] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:38.857177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692613b-2f4d-473e-992c-517d6f0a1019 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:38.869069 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1914/3830] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:38 2021] PUT /identity/v3/projects/eaf0a3c55d6947a7b6cb4b7cf26a2264/users/340e329dda9f4b75adb23c70ed7b8eb7/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:38.879358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f74615-1c70-4539-ab4c-4d9c803693ac None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:38.879572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f74615-1c70-4539-ab4c-4d9c803693ac None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:38.879853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f74615-1c70-4539-ab4c-4d9c803693ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:38.883766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692613b-2f4d-473e-992c-517d6f0a1019 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:38.935488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d4f74615-1c70-4539-ab4c-4d9c803693ac None None] MFA Rules not processed for user `340e329dda9f4b75adb23c70ed7b8eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:38.937147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d4f74615-1c70-4539-ab4c-4d9c803693ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:39.043359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ba954-5c5e-420b-aead-420d0d5e7753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:39.044053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ba954-5c5e-420b-aead-420d0d5e7753 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:39.044338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ba954-5c5e-420b-aead-420d0d5e7753 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:39.044616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ba954-5c5e-420b-aead-420d0d5e7753 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:39.045337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ba954-5c5e-420b-aead-420d0d5e7753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:39.047297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ba954-5c5e-420b-aead-420d0d5e7753 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:39.139082 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1917/3831] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:38 2021] POST /identity/v3/projects => generated 399 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:55:39.147684 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1915/3832] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:38 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:55:39.153095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f74615-1c70-4539-ab4c-4d9c803693ac None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:39.155298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ba954-5c5e-420b-aead-420d0d5e7753 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:39.181702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f74615-1c70-4539-ab4c-4d9c803693ac None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:39.295021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ba954-5c5e-420b-aead-420d0d5e7753 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:39.309591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c546863-fd43-4668-b426-b8ecdddce83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:39.314089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c546863-fd43-4668-b426-b8ecdddce83e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:39.314386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c546863-fd43-4668-b426-b8ecdddce83e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:39.315276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c546863-fd43-4668-b426-b8ecdddce83e admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:39.318636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87c776-5a35-44bd-b57b-c7db0ad4dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:39.319136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87c776-5a35-44bd-b57b-c7db0ad4dd55 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:39.319387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c546863-fd43-4668-b426-b8ecdddce83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:39.319495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87c776-5a35-44bd-b57b-c7db0ad4dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:39.319871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87c776-5a35-44bd-b57b-c7db0ad4dd55 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:39.320626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87c776-5a35-44bd-b57b-c7db0ad4dd55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:39.323724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87c776-5a35-44bd-b57b-c7db0ad4dd55 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:39.325028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c546863-fd43-4668-b426-b8ecdddce83e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:39.360997 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1916/3833] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:39 2021] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:39.366811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87c776-5a35-44bd-b57b-c7db0ad4dd55 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:39.376745 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1918/3834] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:39 2021] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:39.378405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c546863-fd43-4668-b426-b8ecdddce83e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:39.406638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c546863-fd43-4668-b426-b8ecdddce83e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:39.465895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87c776-5a35-44bd-b57b-c7db0ad4dd55 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:39.477388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56906d-29da-4195-a2dc-9e05bf72375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:39.478467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56906d-29da-4195-a2dc-9e05bf72375b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:39.479494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56906d-29da-4195-a2dc-9e05bf72375b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:39.480490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56906d-29da-4195-a2dc-9e05bf72375b admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:39.481661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56906d-29da-4195-a2dc-9e05bf72375b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:39.485795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56906d-29da-4195-a2dc-9e05bf72375b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:39.527779 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1917/3835] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:39 2021] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:39.531205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56906d-29da-4195-a2dc-9e05bf72375b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:39.560590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56906d-29da-4195-a2dc-9e05bf72375b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:39.575810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27639e-2031-45bc-80d6-677d90487745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:39.576486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27639e-2031-45bc-80d6-677d90487745 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:39.576890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27639e-2031-45bc-80d6-677d90487745 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:39.577179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27639e-2031-45bc-80d6-677d90487745 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:39.578568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27639e-2031-45bc-80d6-677d90487745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:39.583140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27639e-2031-45bc-80d6-677d90487745 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:39.588823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a2a9d-545a-4e5e-b1ca-71277fa00b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:39.589746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a2a9d-545a-4e5e-b1ca-71277fa00b80 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:39.590171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a2a9d-545a-4e5e-b1ca-71277fa00b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:39.590609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a2a9d-545a-4e5e-b1ca-71277fa00b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:39.591587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a2a9d-545a-4e5e-b1ca-71277fa00b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:39.594874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a2a9d-545a-4e5e-b1ca-71277fa00b80 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:39.612502 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1918/3836] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:39 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:39.615372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27639e-2031-45bc-80d6-677d90487745 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:39.624188 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1919/3837] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:39 2021] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:55:39.625140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a2a9d-545a-4e5e-b1ca-71277fa00b80 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:39.640440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27639e-2031-45bc-80d6-677d90487745 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:39.656354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a2a9d-545a-4e5e-b1ca-71277fa00b80 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:39.660143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade782f8-19ad-46ae-8fca-a25d678569f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:39.661246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade782f8-19ad-46ae-8fca-a25d678569f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:39.661679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade782f8-19ad-46ae-8fca-a25d678569f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:39.662101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade782f8-19ad-46ae-8fca-a25d678569f1 admin admin] PATH_INFO: `/v3/projects/c01921b9fc504c9fb9e4bc7c1c1ee7b0/users/fb283704372a4d519a6d83b216bbdbee/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:39.677856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530fe9a-2bfd-4ddb-abf0-43a873372a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:39.678797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530fe9a-2bfd-4ddb-abf0-43a873372a43 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:39.679232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530fe9a-2bfd-4ddb-abf0-43a873372a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:39.680227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530fe9a-2bfd-4ddb-abf0-43a873372a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:39.681165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530fe9a-2bfd-4ddb-abf0-43a873372a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:39.684970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530fe9a-2bfd-4ddb-abf0-43a873372a43 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:39.699432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade782f8-19ad-46ae-8fca-a25d678569f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01921b9fc504c9fb9e4bc7c1c1ee7b0, user_id=fb283704372a4d519a6d83b216bbdbee, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:39.702365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade782f8-19ad-46ae-8fca-a25d678569f1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:39.712587 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1920/3838] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:39 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:39.713516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530fe9a-2bfd-4ddb-abf0-43a873372a43 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:39.755957 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1919/3839] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:39 2021] PUT /identity/v3/projects/c01921b9fc504c9fb9e4bc7c1c1ee7b0/users/fb283704372a4d519a6d83b216bbdbee/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:39.757575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530fe9a-2bfd-4ddb-abf0-43a873372a43 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:39.759868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade782f8-19ad-46ae-8fca-a25d678569f1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:39.943117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d0f24-b1a6-4df8-a1de-9869ead23820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:39.947148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d0f24-b1a6-4df8-a1de-9869ead23820 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:39.947477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d0f24-b1a6-4df8-a1de-9869ead23820 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:39.947755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d0f24-b1a6-4df8-a1de-9869ead23820 admin admin] PATH_INFO: `/v3/projects/e284ee0d43044b11b711ede03335cfa1/users/5da0c98eadc94788b5636567ccdd9927/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:39.960892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade782f8-19ad-46ae-8fca-a25d678569f1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:39.975241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae16c13-be5b-403a-b6eb-a2a33ac790b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:39.976869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16c13-be5b-403a-b6eb-a2a33ac790b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:39.977161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16c13-be5b-403a-b6eb-a2a33ac790b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:39.977620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16c13-be5b-403a-b6eb-a2a33ac790b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:39.978869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae16c13-be5b-403a-b6eb-a2a33ac790b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:39.983351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae16c13-be5b-403a-b6eb-a2a33ac790b8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:39.996018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d0f24-b1a6-4df8-a1de-9869ead23820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e284ee0d43044b11b711ede03335cfa1, user_id=5da0c98eadc94788b5636567ccdd9927, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:40.002067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d0f24-b1a6-4df8-a1de-9869ead23820 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:40.019101 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1920/3840] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:39 2021] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:40.023003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae16c13-be5b-403a-b6eb-a2a33ac790b8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:40.040033 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1921/3841] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:39 2021] PUT /identity/v3/projects/e284ee0d43044b11b711ede03335cfa1/users/5da0c98eadc94788b5636567ccdd9927/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:40.048305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109d5c7-5be4-42da-ad9b-b179a8ebcdd2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:40.050714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109d5c7-5be4-42da-ad9b-b179a8ebcdd2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:40.051380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109d5c7-5be4-42da-ad9b-b179a8ebcdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:40.060756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae16c13-be5b-403a-b6eb-a2a33ac790b8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:40.096181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1109d5c7-5be4-42da-ad9b-b179a8ebcdd2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:40.097599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1109d5c7-5be4-42da-ad9b-b179a8ebcdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:40.168623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831b55-0001-4e8a-a2e9-1965afa1dc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:40.169586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831b55-0001-4e8a-a2e9-1965afa1dc59 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:40.169972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831b55-0001-4e8a-a2e9-1965afa1dc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:40.170342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831b55-0001-4e8a-a2e9-1965afa1dc59 admin admin] PATH_INFO: `/v3/projects/c01921b9fc504c9fb9e4bc7c1c1ee7b0/users/fb283704372a4d519a6d83b216bbdbee/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:40.176317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c831b55-0001-4e8a-a2e9-1965afa1dc59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01921b9fc504c9fb9e4bc7c1c1ee7b0, user_id=fb283704372a4d519a6d83b216bbdbee, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:40.182061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c831b55-0001-4e8a-a2e9-1965afa1dc59 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:40.241049 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1921/3842] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:40 2021] PUT /identity/v3/projects/c01921b9fc504c9fb9e4bc7c1c1ee7b0/users/fb283704372a4d519a6d83b216bbdbee/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:40.253355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215e80a-b393-459a-beb0-03241fe621fc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:40.253652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215e80a-b393-459a-beb0-03241fe621fc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:40.253929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215e80a-b393-459a-beb0-03241fe621fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:40.269294 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1922/3843] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:40.307427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b215e80a-b393-459a-beb0-03241fe621fc None None] MFA Rules not processed for user `fb283704372a4d519a6d83b216bbdbee`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:40.309190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b215e80a-b393-459a-beb0-03241fe621fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:40.361976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109d5c7-5be4-42da-ad9b-b179a8ebcdd2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:40.364187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1109d5c7-5be4-42da-ad9b-b179a8ebcdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:40.439106 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1922/3844] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:40 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:40.473821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215e80a-b393-459a-beb0-03241fe621fc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:40.475782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b215e80a-b393-459a-beb0-03241fe621fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:40.492777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109d5c7-5be4-42da-ad9b-b179a8ebcdd2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:40.561589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fddea-7bd5-4d73-8410-889dd77501dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:40.562436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fddea-7bd5-4d73-8410-889dd77501dc service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:40.562728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fddea-7bd5-4d73-8410-889dd77501dc service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:40.563290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fddea-7bd5-4d73-8410-889dd77501dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:40.639221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fddea-7bd5-4d73-8410-889dd77501dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:40.641323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fddea-7bd5-4d73-8410-889dd77501dc service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:40.656088 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1923/3845] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:40.686769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215e80a-b393-459a-beb0-03241fe621fc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:40.697277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f163e2-464d-4fa4-9c52-6c82d5fda839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:40.701393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f163e2-464d-4fa4-9c52-6c82d5fda839 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:40.701393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f163e2-464d-4fa4-9c52-6c82d5fda839 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:40.702045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f163e2-464d-4fa4-9c52-6c82d5fda839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:40.803613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f163e2-464d-4fa4-9c52-6c82d5fda839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:40.805520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f163e2-464d-4fa4-9c52-6c82d5fda839 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:40.820622 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1923/3846] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:40 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:55:42.230606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fddea-7bd5-4d73-8410-889dd77501dc service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:42.240013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fddea-7bd5-4d73-8410-889dd77501dc service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:42.252559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12202118-1bef-4cf4-a817-7376b6de809c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:42.253914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12202118-1bef-4cf4-a817-7376b6de809c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:42.254377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12202118-1bef-4cf4-a817-7376b6de809c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:42.254863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12202118-1bef-4cf4-a817-7376b6de809c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:42.286104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12202118-1bef-4cf4-a817-7376b6de809c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:42.288311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12202118-1bef-4cf4-a817-7376b6de809c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:42.304015 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1924/3847] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:42 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:42.507009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045cb0d-e74f-4d1c-88e1-f155bb44bf35 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:42.507449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045cb0d-e74f-4d1c-88e1-f155bb44bf35 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:42.507624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045cb0d-e74f-4d1c-88e1-f155bb44bf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:42.572200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c045cb0d-e74f-4d1c-88e1-f155bb44bf35 None None] MFA Rules not processed for user `5da0c98eadc94788b5636567ccdd9927`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:42.575535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c045cb0d-e74f-4d1c-88e1-f155bb44bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:42.724611 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1924/3848] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:42 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:42.738270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056689-95d8-4b79-b864-7fb04008d8a1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:42.738721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056689-95d8-4b79-b864-7fb04008d8a1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:42.739494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056689-95d8-4b79-b864-7fb04008d8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:42.763720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6d056689-95d8-4b79-b864-7fb04008d8a1 None None] MFA Rules not processed for user `5da0c98eadc94788b5636567ccdd9927`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:42.765391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6d056689-95d8-4b79-b864-7fb04008d8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:42.779466 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1925/3849] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:42 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:42.839744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045cb0d-e74f-4d1c-88e1-f155bb44bf35 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:42.841181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c045cb0d-e74f-4d1c-88e1-f155bb44bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:42.953165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045cb0d-e74f-4d1c-88e1-f155bb44bf35 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:42.966768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c290187-99d0-43ec-bdd1-fe010f11a7c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:42.968320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290187-99d0-43ec-bdd1-fe010f11a7c2 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:42.969030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290187-99d0-43ec-bdd1-fe010f11a7c2 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:42.970530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290187-99d0-43ec-bdd1-fe010f11a7c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:42.982200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c290187-99d0-43ec-bdd1-fe010f11a7c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:42.984733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c290187-99d0-43ec-bdd1-fe010f11a7c2 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:43.012863 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1925/3850] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:42 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:48.455168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056689-95d8-4b79-b864-7fb04008d8a1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:48.470594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056689-95d8-4b79-b864-7fb04008d8a1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:48.475079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09fb03-acbe-4970-aa59-ec316579e2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:48.476500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09fb03-acbe-4970-aa59-ec316579e2de service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:48.476932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09fb03-acbe-4970-aa59-ec316579e2de service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:48.477491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09fb03-acbe-4970-aa59-ec316579e2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:48.480394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ff09fb03-acbe-4970-aa59-ec316579e2de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:48.493229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09fb03-acbe-4970-aa59-ec316579e2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:48.495933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09fb03-acbe-4970-aa59-ec316579e2de service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:48.512300 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1926/3851] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:48 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:50.071539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0fe77-4bb1-4815-a9fd-3c58a2aa3dbe None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:50.072625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0fe77-4bb1-4815-a9fd-3c58a2aa3dbe None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:50.073049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0fe77-4bb1-4815-a9fd-3c58a2aa3dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:50.095094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d0c0fe77-4bb1-4815-a9fd-3c58a2aa3dbe None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:50.096582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d0c0fe77-4bb1-4815-a9fd-3c58a2aa3dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:50.156278 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1926/3852] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:55:50 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:50.175404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09fb03-acbe-4970-aa59-ec316579e2de service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:50.177667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ff09fb03-acbe-4970-aa59-ec316579e2de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:50.257014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09fb03-acbe-4970-aa59-ec316579e2de service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:50.265700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bba4d6-a7c3-4e63-8d2c-dda7d6b189bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:50.266615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bba4d6-a7c3-4e63-8d2c-dda7d6b189bc service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:50.267084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bba4d6-a7c3-4e63-8d2c-dda7d6b189bc service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:50.267574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bba4d6-a7c3-4e63-8d2c-dda7d6b189bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:50.277215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bba4d6-a7c3-4e63-8d2c-dda7d6b189bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:50.278894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bba4d6-a7c3-4e63-8d2c-dda7d6b189bc service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:50.287873 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1927/3853] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:55:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:50.504707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabcaaa-1132-45ae-8729-5d505bb4734a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:50.505140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabcaaa-1132-45ae-8729-5d505bb4734a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:50.505315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabcaaa-1132-45ae-8729-5d505bb4734a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:50.528863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9dabcaaa-1132-45ae-8729-5d505bb4734a None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:50.530382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9dabcaaa-1132-45ae-8729-5d505bb4734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:50.547139 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1927/3854] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:55:50 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:50.559033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bba4d6-a7c3-4e63-8d2c-dda7d6b189bc service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:50.576325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bba4d6-a7c3-4e63-8d2c-dda7d6b189bc service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:50.586158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088b44f-7cd2-4684-8759-6d77744c829e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:50.587284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088b44f-7cd2-4684-8759-6d77744c829e service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:50.587574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088b44f-7cd2-4684-8759-6d77744c829e service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:50.587869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088b44f-7cd2-4684-8759-6d77744c829e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:50.599305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088b44f-7cd2-4684-8759-6d77744c829e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:50.601011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088b44f-7cd2-4684-8759-6d77744c829e service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:50.612474 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1928/3855] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:55:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:55:51.092994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca641d1-b98d-4d45-b187-2e2ed26de661 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:51.093494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca641d1-b98d-4d45-b187-2e2ed26de661 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:51.093583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca641d1-b98d-4d45-b187-2e2ed26de661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:51.113747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fca641d1-b98d-4d45-b187-2e2ed26de661 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:51.115970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fca641d1-b98d-4d45-b187-2e2ed26de661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:51.125755 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1928/3856] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:55:51 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:51.141206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088b44f-7cd2-4684-8759-6d77744c829e service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:51.153509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088b44f-7cd2-4684-8759-6d77744c829e service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:51.159584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126833c5-d3ba-4ada-b4c1-1b07ec257775 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:51.160330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126833c5-d3ba-4ada-b4c1-1b07ec257775 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:51.160679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126833c5-d3ba-4ada-b4c1-1b07ec257775 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:51.161039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126833c5-d3ba-4ada-b4c1-1b07ec257775 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:51.172915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126833c5-d3ba-4ada-b4c1-1b07ec257775 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:51.174949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126833c5-d3ba-4ada-b4c1-1b07ec257775 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:51.186749 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1929/3857] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:55:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 20:55:51.332262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca641d1-b98d-4d45-b187-2e2ed26de661 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:51.335045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fca641d1-b98d-4d45-b187-2e2ed26de661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:51.378837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca641d1-b98d-4d45-b187-2e2ed26de661 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:51.388816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:51.390005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:51.391059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:51.391566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] PATH_INFO: `/v3/users/5206ef55b9694b4faa3ef71d001d94d4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:51.393051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5206ef55b9694b4faa3ef71d001d94d4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:51.395828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:51.489375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5206ef55b9694b4faa3ef71d001d94d4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:51.506532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5206ef55b9694b4faa3ef71d001d94d4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:51.507404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5206ef55b9694b4faa3ef71d001d94d4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:51.516419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5206ef55b9694b4faa3ef71d001d94d4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:51.535648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5206ef55b9694b4faa3ef71d001d94d4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:51.545302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1929/3858] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:51 2021] DELETE /identity/v3/users/5206ef55b9694b4faa3ef71d001d94d4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:51.549564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca6b5-828d-4306-b1a1-ecc3eabc051b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:51.549856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca6b5-828d-4306-b1a1-ecc3eabc051b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:51.550128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca6b5-828d-4306-b1a1-ecc3eabc051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:51.570142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-685ca6b5-828d-4306-b1a1-ecc3eabc051b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:51.571444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-685ca6b5-828d-4306-b1a1-ecc3eabc051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:51.744273 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1930/3859] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:51.772409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:51.774183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:51.880167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643af12-61e4-4dc6-953d-23eda6cd3007 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:51.890078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570700-97da-4dfc-bec1-9256f0c4f48b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:51.893449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570700-97da-4dfc-bec1-9256f0c4f48b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:51.893753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570700-97da-4dfc-bec1-9256f0c4f48b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:51.894039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570700-97da-4dfc-bec1-9256f0c4f48b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:51.915220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570700-97da-4dfc-bec1-9256f0c4f48b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:51.917987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570700-97da-4dfc-bec1-9256f0c4f48b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:51.947562 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1930/3860] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:52.821479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ca6b5-828d-4306-b1a1-ecc3eabc051b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:52.822964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-685ca6b5-828d-4306-b1a1-ecc3eabc051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:52.844563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ca6b5-828d-4306-b1a1-ecc3eabc051b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:52.872894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:52.874329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:52.874329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:52.874777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] PATH_INFO: `/v3/projects/65a608f2c265434999aa734f1841b2a3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:52.879831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a608f2c265434999aa734f1841b2a3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:52.882749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:52.989185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a608f2c265434999aa734f1841b2a3', 'request_id': 'req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:53.010139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a608f2c265434999aa734f1841b2a3', 'request_id': 'req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:53.025356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a608f2c265434999aa734f1841b2a3', 'request_id': 'req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:53.045803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] The token cache is being invalidate because project 65a608f2c265434999aa734f1841b2a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:55:53.046546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:53.047538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-166b6d7e-7679-4433-86b2-eff0ce7c8a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:53.050321 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1931/3861] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:52 2021] DELETE /identity/v3/projects/65a608f2c265434999aa734f1841b2a3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:53.058186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c5dda-80e2-47e1-84cf-6497586e029a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:53.059037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c5dda-80e2-47e1-84cf-6497586e029a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:53.059612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c5dda-80e2-47e1-84cf-6497586e029a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:53.107442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bf2c5dda-80e2-47e1-84cf-6497586e029a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:53.109187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bf2c5dda-80e2-47e1-84cf-6497586e029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:53.230733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0bc14-7628-42c1-acee-1fefa356de3e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:53.231380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0bc14-7628-42c1-acee-1fefa356de3e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:53.231488 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1931/3862] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:53.231976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0bc14-7628-42c1-acee-1fefa356de3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:53.285510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d3c0bc14-7628-42c1-acee-1fefa356de3e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:53.289394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d3c0bc14-7628-42c1-acee-1fefa356de3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:53.318090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c5dda-80e2-47e1-84cf-6497586e029a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:53.325640 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1932/3863] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:53.334298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c5dda-80e2-47e1-84cf-6497586e029a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:53.344631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324dbe9-4d4b-49fb-a856-ca7576c730e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:53.345589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324dbe9-4d4b-49fb-a856-ca7576c730e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:53.349761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324dbe9-4d4b-49fb-a856-ca7576c730e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:53.350524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324dbe9-4d4b-49fb-a856-ca7576c730e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:53.351516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324dbe9-4d4b-49fb-a856-ca7576c730e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:55:53.351979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324dbe9-4d4b-49fb-a856-ca7576c730e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:53.355604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324dbe9-4d4b-49fb-a856-ca7576c730e8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:53.389508 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1932/3864] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:55:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:55:53.393822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0bc14-7628-42c1-acee-1fefa356de3e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:53.405887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0bc14-7628-42c1-acee-1fefa356de3e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:53.416662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcca67b-9eaf-418c-8fb0-441bc12e1da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:53.418181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcca67b-9eaf-418c-8fb0-441bc12e1da9 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:53.418609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcca67b-9eaf-418c-8fb0-441bc12e1da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:53.419055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcca67b-9eaf-418c-8fb0-441bc12e1da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:53.421107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcca67b-9eaf-418c-8fb0-441bc12e1da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:53.423746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcca67b-9eaf-418c-8fb0-441bc12e1da9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:53.485910 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1933/3865] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:55:53 2021] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:55:53.486625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324dbe9-4d4b-49fb-a856-ca7576c730e8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:53.510082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324dbe9-4d4b-49fb-a856-ca7576c730e8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:53.599614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8b5d0-e673-468d-98b8-99637eb447ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:53.600297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b5d0-e673-468d-98b8-99637eb447ef admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:53.600579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b5d0-e673-468d-98b8-99637eb447ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:53.600853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b5d0-e673-468d-98b8-99637eb447ef admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:53.602909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8b5d0-e673-468d-98b8-99637eb447ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:53.607108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8b5d0-e673-468d-98b8-99637eb447ef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:53.637169 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1933/3866] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:55:53 2021] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:55:53.641355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcca67b-9eaf-418c-8fb0-441bc12e1da9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:53.665429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcca67b-9eaf-418c-8fb0-441bc12e1da9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:53.672309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc8679-3a64-40b4-bc9b-17f0357d331a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:53.673179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc8679-3a64-40b4-bc9b-17f0357d331a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:53.673606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc8679-3a64-40b4-bc9b-17f0357d331a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:53.674048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc8679-3a64-40b4-bc9b-17f0357d331a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:53.676190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc8679-3a64-40b4-bc9b-17f0357d331a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:53.678139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc8679-3a64-40b4-bc9b-17f0357d331a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:53.695951 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1934/3867] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:53 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:53.697317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8b5d0-e673-468d-98b8-99637eb447ef admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:53.714556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8b5d0-e673-468d-98b8-99637eb447ef admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:53.727902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef0e7f-7151-49b1-aa0d-cb046716c7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:53.728856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef0e7f-7151-49b1-aa0d-cb046716c7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:53.729067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef0e7f-7151-49b1-aa0d-cb046716c7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:53.729449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef0e7f-7151-49b1-aa0d-cb046716c7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:53.730268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef0e7f-7151-49b1-aa0d-cb046716c7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:53.732172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef0e7f-7151-49b1-aa0d-cb046716c7e5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:53.755301 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1934/3868] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:55:53 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:55:53.759785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc8679-3a64-40b4-bc9b-17f0357d331a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:53.772164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc8679-3a64-40b4-bc9b-17f0357d331a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:53.786929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44020c-6301-4330-ad4b-422cb597bd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:53.789085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44020c-6301-4330-ad4b-422cb597bd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:53.791862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44020c-6301-4330-ad4b-422cb597bd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:53.792312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44020c-6301-4330-ad4b-422cb597bd3f admin admin] PATH_INFO: `/v3/projects/0e3934c8eb824af986aa4f0624cd4037/users/e9cca4bb4c784112a09e5577e8758288/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:53.824614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44020c-6301-4330-ad4b-422cb597bd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3934c8eb824af986aa4f0624cd4037, user_id=e9cca4bb4c784112a09e5577e8758288, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:53.828220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44020c-6301-4330-ad4b-422cb597bd3f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:53.848899 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1935/3869] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:55:53 2021] PUT /identity/v3/projects/0e3934c8eb824af986aa4f0624cd4037/users/e9cca4bb4c784112a09e5577e8758288/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:53.856662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7062e-e6d3-4363-8e47-6753a9110fe3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:53.856946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7062e-e6d3-4363-8e47-6753a9110fe3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:53.857217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7062e-e6d3-4363-8e47-6753a9110fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:53.880366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-37d7062e-e6d3-4363-8e47-6753a9110fe3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:53.883692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-37d7062e-e6d3-4363-8e47-6753a9110fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:54.012344 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1935/3870] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:54.023632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44020c-6301-4330-ad4b-422cb597bd3f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:54.025506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9b44020c-6301-4330-ad4b-422cb597bd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:54.104796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44020c-6301-4330-ad4b-422cb597bd3f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:54.109537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be9878-1e36-4a92-81f5-311267f9e17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:54.110492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9878-1e36-4a92-81f5-311267f9e17a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:54.110918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9878-1e36-4a92-81f5-311267f9e17a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:54.112802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9878-1e36-4a92-81f5-311267f9e17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:54.125075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be9878-1e36-4a92-81f5-311267f9e17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:54.127170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be9878-1e36-4a92-81f5-311267f9e17a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:54.141629 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1936/3871] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:56.184563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ca05-0a2d-42ac-8f06-ae8ee31f4dfd None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:56.185086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ca05-0a2d-42ac-8f06-ae8ee31f4dfd None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:56.185086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ca05-0a2d-42ac-8f06-ae8ee31f4dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:56.217519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d433ca05-0a2d-42ac-8f06-ae8ee31f4dfd None None] MFA Rules not processed for user `e9cca4bb4c784112a09e5577e8758288`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:56.218649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d433ca05-0a2d-42ac-8f06-ae8ee31f4dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:56.334561 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1936/3872] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:56 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:56.352092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be9878-1e36-4a92-81f5-311267f9e17a service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:56.353498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c6be9878-1e36-4a92-81f5-311267f9e17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:56.398685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433ca05-0a2d-42ac-8f06-ae8ee31f4dfd None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:56.401684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d433ca05-0a2d-42ac-8f06-ae8ee31f4dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:56.419608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433ca05-0a2d-42ac-8f06-ae8ee31f4dfd None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:56.428722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510bd3-4fdd-4dc4-9ca3-d13ab84d593f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:56.429570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510bd3-4fdd-4dc4-9ca3-d13ab84d593f service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:56.430003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510bd3-4fdd-4dc4-9ca3-d13ab84d593f service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:56.433760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510bd3-4fdd-4dc4-9ca3-d13ab84d593f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:56.437260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c0510bd3-4fdd-4dc4-9ca3-d13ab84d593f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:56.450513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0510bd3-4fdd-4dc4-9ca3-d13ab84d593f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:56.452182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0510bd3-4fdd-4dc4-9ca3-d13ab84d593f service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:56.479180 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1937/3873] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:56 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:55:56.479402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be9878-1e36-4a92-81f5-311267f9e17a service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:56.486532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b26282-6d80-4351-85e8-5ac912f8309c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:56.487303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26282-6d80-4351-85e8-5ac912f8309c service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:56.487761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26282-6d80-4351-85e8-5ac912f8309c service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:56.488180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b26282-6d80-4351-85e8-5ac912f8309c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:56.499574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b26282-6d80-4351-85e8-5ac912f8309c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:56.501712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b26282-6d80-4351-85e8-5ac912f8309c service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:56.526402 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1937/3874] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:56 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:57.548314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510bd3-4fdd-4dc4-9ca3-d13ab84d593f service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:57.566229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510bd3-4fdd-4dc4-9ca3-d13ab84d593f service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:57.573512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da379c8b-f471-425f-b761-9761c1df5c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:57.574391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da379c8b-f471-425f-b761-9761c1df5c7c service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:57.574908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da379c8b-f471-425f-b761-9761c1df5c7c service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:57.575287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da379c8b-f471-425f-b761-9761c1df5c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:57.577582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-da379c8b-f471-425f-b761-9761c1df5c7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:57.592937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da379c8b-f471-425f-b761-9761c1df5c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:57.594636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da379c8b-f471-425f-b761-9761c1df5c7c service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:57.610443 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1938/3875] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:57 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:58.746686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b26282-6d80-4351-85e8-5ac912f8309c service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:58.748731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d9b26282-6d80-4351-85e8-5ac912f8309c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:58.784250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b26282-6d80-4351-85e8-5ac912f8309c service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:58.795093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:58.796905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:58.797722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:58.798144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] PATH_INFO: `/v3/users/340e329dda9f4b75adb23c70ed7b8eb7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:58.799625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=340e329dda9f4b75adb23c70ed7b8eb7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:58.801580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:58.882186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340e329dda9f4b75adb23c70ed7b8eb7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:58.883109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340e329dda9f4b75adb23c70ed7b8eb7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:58.895221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340e329dda9f4b75adb23c70ed7b8eb7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:58.895873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340e329dda9f4b75adb23c70ed7b8eb7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:58.905584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340e329dda9f4b75adb23c70ed7b8eb7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:55:58.928186 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1938/3876] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:55:58 2021] DELETE /identity/v3/users/340e329dda9f4b75adb23c70ed7b8eb7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:55:58.933778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6b4f5-bb48-4bd5-904d-9bb44398f088 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:58.934203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6b4f5-bb48-4bd5-904d-9bb44398f088 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:58.934332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6b4f5-bb48-4bd5-904d-9bb44398f088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:58.952859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-77e6b4f5-bb48-4bd5-904d-9bb44398f088 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:55:58.954122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-77e6b4f5-bb48-4bd5-904d-9bb44398f088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:59.062328 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1939/3877] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:55:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:55:59.084121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:59.085824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:59.181541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e0f08-b66c-4300-8b70-f5f2dfb07172 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:59.189614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ecd9-8664-48ba-9921-fe1c604ab2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:59.191052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ecd9-8664-48ba-9921-fe1c604ab2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:59.191698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ecd9-8664-48ba-9921-fe1c604ab2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:59.192753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816ecd9-8664-48ba-9921-fe1c604ab2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:59.210417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816ecd9-8664-48ba-9921-fe1c604ab2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:59.212812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816ecd9-8664-48ba-9921-fe1c604ab2a6 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:59.228620 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1939/3878] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:55:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:55:59.834094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6b4f5-bb48-4bd5-904d-9bb44398f088 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:55:59.837813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-77e6b4f5-bb48-4bd5-904d-9bb44398f088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:55:59.866980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6b4f5-bb48-4bd5-904d-9bb44398f088 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:55:59.879748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:55:59.882799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:55:59.883290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:55:59.883715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] PATH_INFO: `/v3/projects/eaf0a3c55d6947a7b6cb4b7cf26a2264` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:55:59.887390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf0a3c55d6947a7b6cb4b7cf26a2264)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:55:59.889469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:55:59.990517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf0a3c55d6947a7b6cb4b7cf26a2264', 'request_id': 'req-738a5694-00dd-4a67-aa6d-78d645244eac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.004992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf0a3c55d6947a7b6cb4b7cf26a2264', 'request_id': 'req-738a5694-00dd-4a67-aa6d-78d645244eac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.014818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf0a3c55d6947a7b6cb4b7cf26a2264', 'request_id': 'req-738a5694-00dd-4a67-aa6d-78d645244eac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.032129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] The token cache is being invalidate because project eaf0a3c55d6947a7b6cb4b7cf26a2264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:00.032701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.033676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.036029 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1940/3879] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:55:59 2021] DELETE /identity/v3/projects/eaf0a3c55d6947a7b6cb4b7cf26a2264 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:00.040067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ecd9-8664-48ba-9921-fe1c604ab2a6 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:00.061398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816ecd9-8664-48ba-9921-fe1c604ab2a6 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:00.164028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:00.165471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:00.166078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:00.167300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] PATH_INFO: `/v3/users/fb283704372a4d519a6d83b216bbdbee` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:00.168981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb283704372a4d519a6d83b216bbdbee)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:00.171901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:00.247290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb283704372a4d519a6d83b216bbdbee'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.248035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb283704372a4d519a6d83b216bbdbee'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.256850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb283704372a4d519a6d83b216bbdbee'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.257515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb283704372a4d519a6d83b216bbdbee'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.266789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb283704372a4d519a6d83b216bbdbee'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.287367 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1940/3880] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:00 2021] DELETE /identity/v3/users/fb283704372a4d519a6d83b216bbdbee => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:00.601278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:00.603464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:00.622806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a5694-00dd-4a67-aa6d-78d645244eac admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:00.670552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:00.672383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:00.753482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:00.755161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:00.755622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:00.756097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] PATH_INFO: `/v3/projects/c01921b9fc504c9fb9e4bc7c1c1ee7b0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:00.757755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01921b9fc504c9fb9e4bc7c1c1ee7b0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:00.760962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:00.782917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11af788-caa1-4162-a08b-be4534d788a5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:00.810021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae700d7-6346-4cac-8556-d72a14a15555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:00.812075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae700d7-6346-4cac-8556-d72a14a15555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:00.812435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae700d7-6346-4cac-8556-d72a14a15555 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:00.812783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae700d7-6346-4cac-8556-d72a14a15555 admin admin] PATH_INFO: `/v3/users/a5e06f88a7a941909e40b105d2f30310` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:00.814581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae700d7-6346-4cac-8556-d72a14a15555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e06f88a7a941909e40b105d2f30310)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:00.817077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae700d7-6346-4cac-8556-d72a14a15555 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:00.826664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01921b9fc504c9fb9e4bc7c1c1ee7b0', 'request_id': 'req-770f99ed-1433-41c7-96b8-6c079d39d074'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.837842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01921b9fc504c9fb9e4bc7c1c1ee7b0', 'request_id': 'req-770f99ed-1433-41c7-96b8-6c079d39d074'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.849145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01921b9fc504c9fb9e4bc7c1c1ee7b0', 'request_id': 'req-770f99ed-1433-41c7-96b8-6c079d39d074'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.864023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] The token cache is being invalidate because project c01921b9fc504c9fb9e4bc7c1c1ee7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:00.864521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.865323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-770f99ed-1433-41c7-96b8-6c079d39d074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.868537 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1941/3881] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:00 2021] DELETE /identity/v3/projects/c01921b9fc504c9fb9e4bc7c1c1ee7b0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:00.875705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746e0bb-56cd-47cd-865b-52b9a50d63b5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:00.876339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746e0bb-56cd-47cd-865b-52b9a50d63b5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:00.876866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746e0bb-56cd-47cd-865b-52b9a50d63b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:00.877967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4ae700d7-6346-4cac-8556-d72a14a15555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e06f88a7a941909e40b105d2f30310'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.878490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4ae700d7-6346-4cac-8556-d72a14a15555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e06f88a7a941909e40b105d2f30310'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.887547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4ae700d7-6346-4cac-8556-d72a14a15555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e06f88a7a941909e40b105d2f30310'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.888418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4ae700d7-6346-4cac-8556-d72a14a15555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e06f88a7a941909e40b105d2f30310'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.897679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4ae700d7-6346-4cac-8556-d72a14a15555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e06f88a7a941909e40b105d2f30310'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:00.908806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b746e0bb-56cd-47cd-865b-52b9a50d63b5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:00.910040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b746e0bb-56cd-47cd-865b-52b9a50d63b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:00.920557 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1941/3882] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:00 2021] DELETE /identity/v3/users/a5e06f88a7a941909e40b105d2f30310 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:00.977181 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1942/3883] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:00.988559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01747a-ac1a-49cc-889a-119a3bf8204b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:00.990672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01747a-ac1a-49cc-889a-119a3bf8204b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:00.990672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01747a-ac1a-49cc-889a-119a3bf8204b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.019561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4f01747a-ac1a-49cc-889a-119a3bf8204b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:01.020858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4f01747a-ac1a-49cc-889a-119a3bf8204b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:01.118259 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1942/3884] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:01.123167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746e0bb-56cd-47cd-865b-52b9a50d63b5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.144719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746e0bb-56cd-47cd-865b-52b9a50d63b5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.155785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703715d8-abea-4c3c-9c36-63650ef8536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.158433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703715d8-abea-4c3c-9c36-63650ef8536c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.159008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703715d8-abea-4c3c-9c36-63650ef8536c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.160505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703715d8-abea-4c3c-9c36-63650ef8536c admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.161471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703715d8-abea-4c3c-9c36-63650ef8536c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:01.165319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703715d8-abea-4c3c-9c36-63650ef8536c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:01.167703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703715d8-abea-4c3c-9c36-63650ef8536c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:01.199303 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1943/3885] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:56:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:01.202573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01747a-ac1a-49cc-889a-119a3bf8204b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.218151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01747a-ac1a-49cc-889a-119a3bf8204b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.228278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703715d8-abea-4c3c-9c36-63650ef8536c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.230633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-703715d8-abea-4c3c-9c36-63650ef8536c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:01.237041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12060c33-87ea-4cb5-bc89-553e0f1b5b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.238187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12060c33-87ea-4cb5-bc89-553e0f1b5b14 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.238308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12060c33-87ea-4cb5-bc89-553e0f1b5b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.238575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12060c33-87ea-4cb5-bc89-553e0f1b5b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.239399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12060c33-87ea-4cb5-bc89-553e0f1b5b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:01.241480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12060c33-87ea-4cb5-bc89-553e0f1b5b14 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:01.264658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703715d8-abea-4c3c-9c36-63650ef8536c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.282996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.284223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.284813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.285252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] PATH_INFO: `/v3/projects/7895e84a65ed41808aae6e8f05780bca` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.286872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7895e84a65ed41808aae6e8f05780bca)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:01.289343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:01.302948 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1943/3886] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:01 2021] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:01.304159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12060c33-87ea-4cb5-bc89-553e0f1b5b14 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.354223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7895e84a65ed41808aae6e8f05780bca', 'request_id': 'req-f53d27ad-576d-46f1-81f9-3185a983c5b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:01.366624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7895e84a65ed41808aae6e8f05780bca', 'request_id': 'req-f53d27ad-576d-46f1-81f9-3185a983c5b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:01.376368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7895e84a65ed41808aae6e8f05780bca', 'request_id': 'req-f53d27ad-576d-46f1-81f9-3185a983c5b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:01.391408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] The token cache is being invalidate because project 7895e84a65ed41808aae6e8f05780bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:01.391702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:01.392448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f53d27ad-576d-46f1-81f9-3185a983c5b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:01.394324 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1944/3887] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:01 2021] DELETE /identity/v3/projects/7895e84a65ed41808aae6e8f05780bca => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:01.399671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a777-7866-4e91-89f8-aa5908722a97 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.400183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a777-7866-4e91-89f8-aa5908722a97 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.400676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a777-7866-4e91-89f8-aa5908722a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.406709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12060c33-87ea-4cb5-bc89-553e0f1b5b14 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.441951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0008a777-7866-4e91-89f8-aa5908722a97 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:01.444653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0008a777-7866-4e91-89f8-aa5908722a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:01.475233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af14e21-dbd6-4f15-835f-9a65a7bedf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.476464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af14e21-dbd6-4f15-835f-9a65a7bedf7b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.476891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af14e21-dbd6-4f15-835f-9a65a7bedf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.477329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af14e21-dbd6-4f15-835f-9a65a7bedf7b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.478239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af14e21-dbd6-4f15-835f-9a65a7bedf7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:01.481156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af14e21-dbd6-4f15-835f-9a65a7bedf7b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:01.544122 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1944/3888] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:01 2021] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:01.546468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af14e21-dbd6-4f15-835f-9a65a7bedf7b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.550593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3af14e21-dbd6-4f15-835f-9a65a7bedf7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:01.556594 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1945/3889] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:01.564463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6eb4-8e52-47b7-85a3-e010ae482b1c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.564917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6eb4-8e52-47b7-85a3-e010ae482b1c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.565210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c6eb4-8e52-47b7-85a3-e010ae482b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.569844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af14e21-dbd6-4f15-835f-9a65a7bedf7b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.577765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafddea-6553-4ae8-8669-4ad5e366653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.578935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafddea-6553-4ae8-8669-4ad5e366653c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.579402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafddea-6553-4ae8-8669-4ad5e366653c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.579992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafddea-6553-4ae8-8669-4ad5e366653c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.581455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafddea-6553-4ae8-8669-4ad5e366653c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:01.583824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafddea-6553-4ae8-8669-4ad5e366653c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:01.588851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-535c6eb4-8e52-47b7-85a3-e010ae482b1c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:01.590163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-535c6eb4-8e52-47b7-85a3-e010ae482b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:01.595317 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1945/3890] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:01 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:01.598762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafddea-6553-4ae8-8669-4ad5e366653c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.600269 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1946/3891] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:01.604709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6eb4-8e52-47b7-85a3-e010ae482b1c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.614708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c6eb4-8e52-47b7-85a3-e010ae482b1c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.618375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafddea-6553-4ae8-8669-4ad5e366653c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.622818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858d79-d3cd-4059-9502-50e74f492135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.623720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858d79-d3cd-4059-9502-50e74f492135 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.624110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858d79-d3cd-4059-9502-50e74f492135 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.624475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858d79-d3cd-4059-9502-50e74f492135 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.625314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a858d79-d3cd-4059-9502-50e74f492135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:01.625873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a858d79-d3cd-4059-9502-50e74f492135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:01.626806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d8e8a-0e65-4aac-b985-fa38694ff612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.627511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d8e8a-0e65-4aac-b985-fa38694ff612 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.627799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d8e8a-0e65-4aac-b985-fa38694ff612 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.627924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a858d79-d3cd-4059-9502-50e74f492135 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:01.628075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d8e8a-0e65-4aac-b985-fa38694ff612 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.629411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d8e8a-0e65-4aac-b985-fa38694ff612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:01.632490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d8e8a-0e65-4aac-b985-fa38694ff612 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:01.642974 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1947/3892] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:56:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:01.647072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858d79-d3cd-4059-9502-50e74f492135 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.651889 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1946/3893] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:01 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:01.656980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d8e8a-0e65-4aac-b985-fa38694ff612 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.659384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858d79-d3cd-4059-9502-50e74f492135 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.671199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87e1ad-ca79-4da5-ad67-3bfb5fc0b3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.671199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e1ad-ca79-4da5-ad67-3bfb5fc0b3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.671199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e1ad-ca79-4da5-ad67-3bfb5fc0b3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.671199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e1ad-ca79-4da5-ad67-3bfb5fc0b3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.671662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87e1ad-ca79-4da5-ad67-3bfb5fc0b3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:01.671740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d8e8a-0e65-4aac-b985-fa38694ff612 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.671828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87e1ad-ca79-4da5-ad67-3bfb5fc0b3f1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:01.674897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e8065-c17e-41b3-9d60-35a54789a238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.675839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e8065-c17e-41b3-9d60-35a54789a238 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.676582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e8065-c17e-41b3-9d60-35a54789a238 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.677179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e8065-c17e-41b3-9d60-35a54789a238 admin admin] PATH_INFO: `/v3/projects/b84cea885cbf49b78dd7d4222747c05b/users/e21e34fcd97e4d0d99fc526a7d684e1f/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.718468 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1948/3894] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:01 2021] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:56:01.722925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87e1ad-ca79-4da5-ad67-3bfb5fc0b3f1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.725981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e8065-c17e-41b3-9d60-35a54789a238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84cea885cbf49b78dd7d4222747c05b, user_id=e21e34fcd97e4d0d99fc526a7d684e1f, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:01.729151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e8065-c17e-41b3-9d60-35a54789a238 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:01.757287 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1947/3895] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:01 2021] PUT /identity/v3/projects/b84cea885cbf49b78dd7d4222747c05b/users/e21e34fcd97e4d0d99fc526a7d684e1f/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:01.767892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44368-d66b-495d-951b-e2bcf9c47e6e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.768301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44368-d66b-495d-951b-e2bcf9c47e6e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.768681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd44368-d66b-495d-951b-e2bcf9c47e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.799645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8fd44368-d66b-495d-951b-e2bcf9c47e6e None None] MFA Rules not processed for user `e21e34fcd97e4d0d99fc526a7d684e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:01.801664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8fd44368-d66b-495d-951b-e2bcf9c47e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:01.806095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87e1ad-ca79-4da5-ad67-3bfb5fc0b3f1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.888675 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1948/3896] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:01 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:01.894304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd44368-d66b-495d-951b-e2bcf9c47e6e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.905227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149d76d-619e-46fa-8ca3-7459aa1d3941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.906016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149d76d-619e-46fa-8ca3-7459aa1d3941 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.906266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149d76d-619e-46fa-8ca3-7459aa1d3941 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.906541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149d76d-619e-46fa-8ca3-7459aa1d3941 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.907310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149d76d-619e-46fa-8ca3-7459aa1d3941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:01.909269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149d76d-619e-46fa-8ca3-7459aa1d3941 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:01.946342 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1949/3897] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:01 2021] POST /identity/v3/users => generated 291 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:01.952302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149d76d-619e-46fa-8ca3-7459aa1d3941 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:01.971462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149d76d-619e-46fa-8ca3-7459aa1d3941 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.976842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca229f-b121-4cab-a906-a258e534ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.977620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca229f-b121-4cab-a906-a258e534ff32 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.978004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca229f-b121-4cab-a906-a258e534ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.978379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca229f-b121-4cab-a906-a258e534ff32 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.979782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca229f-b121-4cab-a906-a258e534ff32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:01.982651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca229f-b121-4cab-a906-a258e534ff32 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:01.991321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd44368-d66b-495d-951b-e2bcf9c47e6e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:01.997039 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1950/3898] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:01 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:01.997443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b7758-b123-416d-8f0a-e61161a33cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:01.998172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b7758-b123-416d-8f0a-e61161a33cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:01.998654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b7758-b123-416d-8f0a-e61161a33cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:01.998930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b7758-b123-416d-8f0a-e61161a33cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:01.999669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b7758-b123-416d-8f0a-e61161a33cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.001667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b7758-b123-416d-8f0a-e61161a33cb0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.002848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca229f-b121-4cab-a906-a258e534ff32 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.016579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca229f-b121-4cab-a906-a258e534ff32 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:02.030978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32019e3-f220-4bfb-b238-d3f689506f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:02.031867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32019e3-f220-4bfb-b238-d3f689506f26 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.032257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32019e3-f220-4bfb-b238-d3f689506f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.032811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32019e3-f220-4bfb-b238-d3f689506f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.033783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32019e3-f220-4bfb-b238-d3f689506f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.035783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32019e3-f220-4bfb-b238-d3f689506f26 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.039553 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1949/3899] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:01 2021] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:02.043964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b7758-b123-416d-8f0a-e61161a33cb0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.051836 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1951/3900] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:02 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:02.055977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32019e3-f220-4bfb-b238-d3f689506f26 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.074879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32019e3-f220-4bfb-b238-d3f689506f26 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:02.119464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b7758-b123-416d-8f0a-e61161a33cb0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:02.125719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bac957-6fcd-4a61-8e80-e903007c8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:02.126586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bac957-6fcd-4a61-8e80-e903007c8e4b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.126940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bac957-6fcd-4a61-8e80-e903007c8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.127343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bac957-6fcd-4a61-8e80-e903007c8e4b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.128124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bac957-6fcd-4a61-8e80-e903007c8e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.130535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bac957-6fcd-4a61-8e80-e903007c8e4b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.158011 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1950/3901] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:02 2021] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:56:02.162658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bac957-6fcd-4a61-8e80-e903007c8e4b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.176483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3ff3-ec3e-4065-be93-cd15232f9f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:02.177177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3ff3-ec3e-4065-be93-cd15232f9f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.177460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3ff3-ec3e-4065-be93-cd15232f9f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.177744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3ff3-ec3e-4065-be93-cd15232f9f58 admin admin] PATH_INFO: `/v3/projects/79be4e7871e9465b82698fe64c318285/users/1ed72c3ee9064f34aa08e7b328100a9a/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.181104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bac957-6fcd-4a61-8e80-e903007c8e4b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:02.189724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8883c-d624-489d-88f9-7bd7b5f25e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:02.191182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8883c-d624-489d-88f9-7bd7b5f25e5b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.191646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8883c-d624-489d-88f9-7bd7b5f25e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.192075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8883c-d624-489d-88f9-7bd7b5f25e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.193201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8883c-d624-489d-88f9-7bd7b5f25e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.195236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8883c-d624-489d-88f9-7bd7b5f25e5b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.213413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3ff3-ec3e-4065-be93-cd15232f9f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79be4e7871e9465b82698fe64c318285, user_id=1ed72c3ee9064f34aa08e7b328100a9a, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.214253 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1951/3902] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:02 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:02.215144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8883c-d624-489d-88f9-7bd7b5f25e5b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.225885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8883c-d624-489d-88f9-7bd7b5f25e5b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:02.227090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3ff3-ec3e-4065-be93-cd15232f9f58 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.237491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ddb2-d5da-4f6c-b420-ee8b00faefd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:02.238270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ddb2-d5da-4f6c-b420-ee8b00faefd2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.238575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ddb2-d5da-4f6c-b420-ee8b00faefd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.238904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64ddb2-d5da-4f6c-b420-ee8b00faefd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.239660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64ddb2-d5da-4f6c-b420-ee8b00faefd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.241487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64ddb2-d5da-4f6c-b420-ee8b00faefd2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.256738 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1952/3903] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:02 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:02.261611 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1952/3904] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:02 2021] PUT /identity/v3/projects/79be4e7871e9465b82698fe64c318285/users/1ed72c3ee9064f34aa08e7b328100a9a/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:02.261867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ddb2-d5da-4f6c-b420-ee8b00faefd2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.263275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8cce5-f454-4026-a668-37573897c01e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.263594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8cce5-f454-4026-a668-37573897c01e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.264412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8cce5-f454-4026-a668-37573897c01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.273472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64ddb2-d5da-4f6c-b420-ee8b00faefd2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:02.296257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d8f8cce5-f454-4026-a668-37573897c01e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:02.297481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d8f8cce5-f454-4026-a668-37573897c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:02.365507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7af17-c64d-4ce5-a601-4bab783bb7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:02.366418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7af17-c64d-4ce5-a601-4bab783bb7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.366704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7af17-c64d-4ce5-a601-4bab783bb7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.366985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7af17-c64d-4ce5-a601-4bab783bb7c7 admin admin] PATH_INFO: `/v3/projects/2e2791405ace4a148721ae418010bdde/users/1a621f91487a416684eeee05b6c29053/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.377500 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1953/3905] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:02.386474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7af17-c64d-4ce5-a601-4bab783bb7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2791405ace4a148721ae418010bdde, user_id=1a621f91487a416684eeee05b6c29053, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.389370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7af17-c64d-4ce5-a601-4bab783bb7c7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.396971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8cce5-f454-4026-a668-37573897c01e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.403398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d8f8cce5-f454-4026-a668-37573897c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:02.410271 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1953/3906] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:02 2021] PUT /identity/v3/projects/2e2791405ace4a148721ae418010bdde/users/1a621f91487a416684eeee05b6c29053/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:02.420375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93381-4576-48e8-9f75-976f6099354d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.421168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93381-4576-48e8-9f75-976f6099354d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.421968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93381-4576-48e8-9f75-976f6099354d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.458611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-aec93381-4576-48e8-9f75-976f6099354d None None] MFA Rules not processed for user `1a621f91487a416684eeee05b6c29053`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:02.460001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aec93381-4576-48e8-9f75-976f6099354d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:02.505564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8cce5-f454-4026-a668-37573897c01e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:02.579972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dd17d-47f5-4486-be8f-7cadbcf505bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:02.580632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd17d-47f5-4486-be8f-7cadbcf505bb service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.580914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd17d-47f5-4486-be8f-7cadbcf505bb service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.581189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dd17d-47f5-4486-be8f-7cadbcf505bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.583406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1954/3907] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:02 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:02.584345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec93381-4576-48e8-9f75-976f6099354d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.671684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dd17d-47f5-4486-be8f-7cadbcf505bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.673558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dd17d-47f5-4486-be8f-7cadbcf505bb service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.684607 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1954/3908] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:56:02.690673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec93381-4576-48e8-9f75-976f6099354d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:02.695888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1850a03-a7ee-46b5-97a2-c58b37158db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:02.696737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1850a03-a7ee-46b5-97a2-c58b37158db8 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.697085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1850a03-a7ee-46b5-97a2-c58b37158db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.697521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1850a03-a7ee-46b5-97a2-c58b37158db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.698306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1850a03-a7ee-46b5-97a2-c58b37158db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.700497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1850a03-a7ee-46b5-97a2-c58b37158db8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.730204 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1955/3909] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:02 2021] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:02.734313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dd17d-47f5-4486-be8f-7cadbcf505bb service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.746193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dd17d-47f5-4486-be8f-7cadbcf505bb service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:02.809737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55db52-181c-4c8f-aebd-0b2d8ea6e6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:02.810890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55db52-181c-4c8f-aebd-0b2d8ea6e6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.812680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55db52-181c-4c8f-aebd-0b2d8ea6e6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.813112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55db52-181c-4c8f-aebd-0b2d8ea6e6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.814024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55db52-181c-4c8f-aebd-0b2d8ea6e6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.816332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55db52-181c-4c8f-aebd-0b2d8ea6e6f5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.840034 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1955/3910] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:02 2021] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:02.843999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1850a03-a7ee-46b5-97a2-c58b37158db8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.860820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1850a03-a7ee-46b5-97a2-c58b37158db8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:02.865598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960606d-65b6-4706-8955-d8b9c97c48fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:02.866273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960606d-65b6-4706-8955-d8b9c97c48fe admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.866555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960606d-65b6-4706-8955-d8b9c97c48fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.866845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960606d-65b6-4706-8955-d8b9c97c48fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.867626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960606d-65b6-4706-8955-d8b9c97c48fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.869241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960606d-65b6-4706-8955-d8b9c97c48fe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.884917 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1956/3911] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:02 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:02.885990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55db52-181c-4c8f-aebd-0b2d8ea6e6f5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.898064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55db52-181c-4c8f-aebd-0b2d8ea6e6f5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:02.903119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ed00a-0c3f-4466-aaf1-a28a00643771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:02.905284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ed00a-0c3f-4466-aaf1-a28a00643771 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:02.905575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ed00a-0c3f-4466-aaf1-a28a00643771 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:02.905858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ed00a-0c3f-4466-aaf1-a28a00643771 admin admin] PATH_INFO: `/v3/projects/32d6fe7b5a114c2cb1eac33eb7ac36da/users/f971bd03f2344cfe8c47769c4b97a71a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:02.925044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ed00a-0c3f-4466-aaf1-a28a00643771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d6fe7b5a114c2cb1eac33eb7ac36da, user_id=f971bd03f2344cfe8c47769c4b97a71a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:02.928050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ed00a-0c3f-4466-aaf1-a28a00643771 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:02.943657 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1956/3912] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:02 2021] PUT /identity/v3/projects/32d6fe7b5a114c2cb1eac33eb7ac36da/users/f971bd03f2344cfe8c47769c4b97a71a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:02.947946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960606d-65b6-4706-8955-d8b9c97c48fe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:02.963023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960606d-65b6-4706-8955-d8b9c97c48fe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:03.019962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f285e63-d258-4cdd-9c19-1a7639db2a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:03.020634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285e63-d258-4cdd-9c19-1a7639db2a85 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:03.020919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285e63-d258-4cdd-9c19-1a7639db2a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:03.021197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285e63-d258-4cdd-9c19-1a7639db2a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:03.021931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f285e63-d258-4cdd-9c19-1a7639db2a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:03.023545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f285e63-d258-4cdd-9c19-1a7639db2a85 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:03.038694 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1957/3913] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:02 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:56:03.044070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ed00a-0c3f-4466-aaf1-a28a00643771 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:03.056712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ed00a-0c3f-4466-aaf1-a28a00643771 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:03.061675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b165823-56a1-41b0-8de3-bac07b347012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:03.062554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b165823-56a1-41b0-8de3-bac07b347012 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:03.062863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b165823-56a1-41b0-8de3-bac07b347012 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:03.063181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b165823-56a1-41b0-8de3-bac07b347012 admin admin] PATH_INFO: `/v3/projects/32d6fe7b5a114c2cb1eac33eb7ac36da/users/f971bd03f2344cfe8c47769c4b97a71a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:03.065165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b165823-56a1-41b0-8de3-bac07b347012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d6fe7b5a114c2cb1eac33eb7ac36da, user_id=f971bd03f2344cfe8c47769c4b97a71a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:03.067859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b165823-56a1-41b0-8de3-bac07b347012 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:03.079168 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1957/3914] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:03 2021] PUT /identity/v3/projects/32d6fe7b5a114c2cb1eac33eb7ac36da/users/f971bd03f2344cfe8c47769c4b97a71a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:03.089666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06935c13-b29f-499b-8163-03eac92111e9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:03.089961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06935c13-b29f-499b-8163-03eac92111e9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:03.090232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06935c13-b29f-499b-8163-03eac92111e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:03.123324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-06935c13-b29f-499b-8163-03eac92111e9 None None] MFA Rules not processed for user `f971bd03f2344cfe8c47769c4b97a71a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:03.124531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-06935c13-b29f-499b-8163-03eac92111e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:03.195505 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1958/3915] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:03 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:03.207404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b165823-56a1-41b0-8de3-bac07b347012 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:03.209642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0b165823-56a1-41b0-8de3-bac07b347012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:03.272913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b165823-56a1-41b0-8de3-bac07b347012 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:03.277136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947dc58-056a-4a5e-bbc6-a34a21adcd66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:03.277807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947dc58-056a-4a5e-bbc6-a34a21adcd66 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:03.278095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947dc58-056a-4a5e-bbc6-a34a21adcd66 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:03.278372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947dc58-056a-4a5e-bbc6-a34a21adcd66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:03.340899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947dc58-056a-4a5e-bbc6-a34a21adcd66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:03.343127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947dc58-056a-4a5e-bbc6-a34a21adcd66 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:03.358154 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1958/3916] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:03 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:03.397022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06935c13-b29f-499b-8163-03eac92111e9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:03.398656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-06935c13-b29f-499b-8163-03eac92111e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:03.535704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06935c13-b29f-499b-8163-03eac92111e9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:03.543551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:03.544615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:03.544953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:03.545235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] PATH_INFO: `/v3/users/b8a8aa467b0a42459f18f6bd4ee623e4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:03.546738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a8aa467b0a42459f18f6bd4ee623e4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:03.548980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:03.616440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a8aa467b0a42459f18f6bd4ee623e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:03.617402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a8aa467b0a42459f18f6bd4ee623e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:03.631586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a8aa467b0a42459f18f6bd4ee623e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:03.633354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a8aa467b0a42459f18f6bd4ee623e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:03.643440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a8aa467b0a42459f18f6bd4ee623e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:03.664138 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1959/3917] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:03 2021] DELETE /identity/v3/users/b8a8aa467b0a42459f18f6bd4ee623e4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:04.350839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947dc58-056a-4a5e-bbc6-a34a21adcd66 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:04.353604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5947dc58-056a-4a5e-bbc6-a34a21adcd66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:04.358193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:04.360171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:04.523992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5464361-42c7-410d-b719-535564ee1a85 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:04.528718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947dc58-056a-4a5e-bbc6-a34a21adcd66 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:04.532902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:04.534817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:04.535276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:04.535832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] PATH_INFO: `/v3/projects/fe84ac649b6b4faea051ddfd2d4b6185` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:04.538288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe84ac649b6b4faea051ddfd2d4b6185)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:04.540999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:04.616506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe84ac649b6b4faea051ddfd2d4b6185', 'request_id': 'req-72f6aefa-5964-4a97-9dca-b15ccb579b89'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:04.627992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe84ac649b6b4faea051ddfd2d4b6185', 'request_id': 'req-72f6aefa-5964-4a97-9dca-b15ccb579b89'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:04.634640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef3b3c-a017-45be-a4b7-5abbace59cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:04.636431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef3b3c-a017-45be-a4b7-5abbace59cab service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:04.636869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef3b3c-a017-45be-a4b7-5abbace59cab service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:04.637561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef3b3c-a017-45be-a4b7-5abbace59cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:04.639694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ceef3b3c-a017-45be-a4b7-5abbace59cab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:04.639964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe84ac649b6b4faea051ddfd2d4b6185', 'request_id': 'req-72f6aefa-5964-4a97-9dca-b15ccb579b89'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:04.654853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef3b3c-a017-45be-a4b7-5abbace59cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:04.655810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] The token cache is being invalidate because project fe84ac649b6b4faea051ddfd2d4b6185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:04.656201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:04.656709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef3b3c-a017-45be-a4b7-5abbace59cab service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:04.657012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-72f6aefa-5964-4a97-9dca-b15ccb579b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:04.659444 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1960/3918] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:04 2021] DELETE /identity/v3/projects/fe84ac649b6b4faea051ddfd2d4b6185 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:04.664718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480ddbe-00b6-4f86-bbe7-0ae6a76274d3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:04.665216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480ddbe-00b6-4f86-bbe7-0ae6a76274d3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:04.665652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480ddbe-00b6-4f86-bbe7-0ae6a76274d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:04.675155 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1959/3919] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:04.687830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c480ddbe-00b6-4f86-bbe7-0ae6a76274d3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:04.689063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c480ddbe-00b6-4f86-bbe7-0ae6a76274d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:04.768749 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1961/3920] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:04.777735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e9db1-b88a-4a55-8b90-80a6279c286e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:04.779768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e9db1-b88a-4a55-8b90-80a6279c286e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:04.782224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e9db1-b88a-4a55-8b90-80a6279c286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:04.810902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f62e9db1-b88a-4a55-8b90-80a6279c286e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:04.812583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f62e9db1-b88a-4a55-8b90-80a6279c286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:04.828992 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1960/3921] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:04.829625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480ddbe-00b6-4f86-bbe7-0ae6a76274d3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:04.854226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480ddbe-00b6-4f86-bbe7-0ae6a76274d3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:04.865550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c591e6-be77-4d10-baff-13a40777b6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:04.866783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c591e6-be77-4d10-baff-13a40777b6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:04.866783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c591e6-be77-4d10-baff-13a40777b6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:04.867779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c591e6-be77-4d10-baff-13a40777b6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:04.868786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c591e6-be77-4d10-baff-13a40777b6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:04.869199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c591e6-be77-4d10-baff-13a40777b6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:04.872774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c591e6-be77-4d10-baff-13a40777b6d7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:04.891528 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1962/3922] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:56:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:04.897730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e9db1-b88a-4a55-8b90-80a6279c286e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:04.912299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e9db1-b88a-4a55-8b90-80a6279c286e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:04.921010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9e565-c4d9-4aa3-97d2-bd141b8e6225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:04.922083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e565-c4d9-4aa3-97d2-bd141b8e6225 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:04.922547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e565-c4d9-4aa3-97d2-bd141b8e6225 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:04.923162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e565-c4d9-4aa3-97d2-bd141b8e6225 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:04.924286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9e565-c4d9-4aa3-97d2-bd141b8e6225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:04.926413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9e565-c4d9-4aa3-97d2-bd141b8e6225 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:04.935035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d21e-58e8-4d2a-a7df-21adf08687e8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:04.935531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d21e-58e8-4d2a-a7df-21adf08687e8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:04.935959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0d21e-58e8-4d2a-a7df-21adf08687e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:05.001989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-66d0d21e-58e8-4d2a-a7df-21adf08687e8 None None] MFA Rules not processed for user `1ed72c3ee9064f34aa08e7b328100a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:05.006595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-66d0d21e-58e8-4d2a-a7df-21adf08687e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:05.020148 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1961/3923] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:04 2021] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:05.025872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9e565-c4d9-4aa3-97d2-bd141b8e6225 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:05.126621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9e565-c4d9-4aa3-97d2-bd141b8e6225 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:05.133284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b09758-143a-4de9-86a2-04a489d42593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:05.134669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b09758-143a-4de9-86a2-04a489d42593 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:05.135765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b09758-143a-4de9-86a2-04a489d42593 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:05.136427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b09758-143a-4de9-86a2-04a489d42593 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:05.138152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b09758-143a-4de9-86a2-04a489d42593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:05.140797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b09758-143a-4de9-86a2-04a489d42593 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:05.162146 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1963/3924] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:04 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:05.172210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1de79-7319-4f33-8e38-f6c092019b0b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:05.173798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1de79-7319-4f33-8e38-f6c092019b0b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:05.174737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1de79-7319-4f33-8e38-f6c092019b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:05.181055 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1962/3925] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:05 2021] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:05.185123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b09758-143a-4de9-86a2-04a489d42593 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:05.214650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b09758-143a-4de9-86a2-04a489d42593 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:05.224461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328d8b6-f86f-4946-9d7a-004740672d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:05.226456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328d8b6-f86f-4946-9d7a-004740672d7d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:05.227333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328d8b6-f86f-4946-9d7a-004740672d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:05.227828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-08e1de79-7319-4f33-8e38-f6c092019b0b None None] MFA Rules not processed for user `1ed72c3ee9064f34aa08e7b328100a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:05.227958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328d8b6-f86f-4946-9d7a-004740672d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:05.229138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328d8b6-f86f-4946-9d7a-004740672d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:05.230327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-08e1de79-7319-4f33-8e38-f6c092019b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:05.232506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328d8b6-f86f-4946-9d7a-004740672d7d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:05.247008 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1963/3926] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:05 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:05.252062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328d8b6-f86f-4946-9d7a-004740672d7d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:05.265926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328d8b6-f86f-4946-9d7a-004740672d7d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:05.279848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064593-da0d-408b-bbd4-0241aca0ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:05.279848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064593-da0d-408b-bbd4-0241aca0ec01 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:05.279848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064593-da0d-408b-bbd4-0241aca0ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:05.279848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064593-da0d-408b-bbd4-0241aca0ec01 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:05.280275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99064593-da0d-408b-bbd4-0241aca0ec01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:05.280275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99064593-da0d-408b-bbd4-0241aca0ec01 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:05.291514 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1964/3927] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:05 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:05.295885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064593-da0d-408b-bbd4-0241aca0ec01 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:05.310216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064593-da0d-408b-bbd4-0241aca0ec01 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:05.316674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce3e44-5c8f-4fc1-8917-e23e22f21cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:05.317834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce3e44-5c8f-4fc1-8917-e23e22f21cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:05.318525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce3e44-5c8f-4fc1-8917-e23e22f21cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:05.318727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce3e44-5c8f-4fc1-8917-e23e22f21cd9 admin admin] PATH_INFO: `/v3/projects/6bc9d999317e427fa446cec7242dbab1/users/d79734c0300042b3b0f7326fc80e13ea/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:05.343341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce3e44-5c8f-4fc1-8917-e23e22f21cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc9d999317e427fa446cec7242dbab1, user_id=d79734c0300042b3b0f7326fc80e13ea, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:05.346805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce3e44-5c8f-4fc1-8917-e23e22f21cd9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:05.389515 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1965/3928] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:05 2021] PUT /identity/v3/projects/6bc9d999317e427fa446cec7242dbab1/users/d79734c0300042b3b0f7326fc80e13ea/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:05.399965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614574-76f0-4ab3-9099-356c69884483 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:05.400470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614574-76f0-4ab3-9099-356c69884483 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:05.401155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a614574-76f0-4ab3-9099-356c69884483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:05.436948 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1964/3929] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:05 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:05.452696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8a614574-76f0-4ab3-9099-356c69884483 None None] MFA Rules not processed for user `d79734c0300042b3b0f7326fc80e13ea`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:05.454102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8a614574-76f0-4ab3-9099-356c69884483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:05.487202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1de79-7319-4f33-8e38-f6c092019b0b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:05.488977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-08e1de79-7319-4f33-8e38-f6c092019b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:05.557942 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1966/3930] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:05 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:05.585050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1de79-7319-4f33-8e38-f6c092019b0b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:05.678848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e18d6-6003-42f1-ad0d-d0af7927afd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:05.679701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e18d6-6003-42f1-ad0d-d0af7927afd1 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:05.680221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e18d6-6003-42f1-ad0d-d0af7927afd1 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:05.681255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e18d6-6003-42f1-ad0d-d0af7927afd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:05.775146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e18d6-6003-42f1-ad0d-d0af7927afd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:05.777775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e18d6-6003-42f1-ad0d-d0af7927afd1 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:05.795574 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1965/3931] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:05 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:56:06.099838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a614574-76f0-4ab3-9099-356c69884483 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:06.103648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8a614574-76f0-4ab3-9099-356c69884483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:06.162904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e18d6-6003-42f1-ad0d-d0af7927afd1 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:06.164743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6e4e18d6-6003-42f1-ad0d-d0af7927afd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:06.192946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e18d6-6003-42f1-ad0d-d0af7927afd1 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:06.219605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa8445-2f9e-4930-bac6-8f97abb38372 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:06.223217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa8445-2f9e-4930-bac6-8f97abb38372 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:06.223606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa8445-2f9e-4930-bac6-8f97abb38372 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:06.223929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa8445-2f9e-4930-bac6-8f97abb38372 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:06.236085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa8445-2f9e-4930-bac6-8f97abb38372 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:06.237996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa8445-2f9e-4930-bac6-8f97abb38372 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:06.251969 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1966/3932] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:06 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:06.253036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a614574-76f0-4ab3-9099-356c69884483 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:06.266590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:06.267899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:06.268194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:06.268461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] PATH_INFO: `/v3/users/5da0c98eadc94788b5636567ccdd9927` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:06.270257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da0c98eadc94788b5636567ccdd9927)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:06.272464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:06.336751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da0c98eadc94788b5636567ccdd9927'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:06.350299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da0c98eadc94788b5636567ccdd9927'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:06.352452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da0c98eadc94788b5636567ccdd9927'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:06.365390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da0c98eadc94788b5636567ccdd9927'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:06.385275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da0c98eadc94788b5636567ccdd9927'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:06.392944 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1967/3933] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:06 2021] DELETE /identity/v3/users/5da0c98eadc94788b5636567ccdd9927 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:06.689320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa8445-2f9e-4930-bac6-8f97abb38372 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:06.690822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f9fa8445-2f9e-4930-bac6-8f97abb38372 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:06.749048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:06.750546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:06.835763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa8445-2f9e-4930-bac6-8f97abb38372 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:06.884426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3479b8-d2df-4295-b605-a2adfd5b464d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:06.892779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:06.894250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:06.894927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:06.895403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] PATH_INFO: `/v3/projects/e284ee0d43044b11b711ede03335cfa1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:06.898324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e284ee0d43044b11b711ede03335cfa1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:06.902899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:06.944185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf49d00-5ccb-486d-b5f3-0e6068725030 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:06.948496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf49d00-5ccb-486d-b5f3-0e6068725030 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:06.949014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf49d00-5ccb-486d-b5f3-0e6068725030 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:06.950582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf49d00-5ccb-486d-b5f3-0e6068725030 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:06.954328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6bf49d00-5ccb-486d-b5f3-0e6068725030 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:06.998098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf49d00-5ccb-486d-b5f3-0e6068725030 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:07.000661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf49d00-5ccb-486d-b5f3-0e6068725030 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:07.007745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e284ee0d43044b11b711ede03335cfa1', 'request_id': 'req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:07.019036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e284ee0d43044b11b711ede03335cfa1', 'request_id': 'req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:07.036139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e284ee0d43044b11b711ede03335cfa1', 'request_id': 'req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:07.037257 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1967/3934] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:06 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:56:07.049707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] The token cache is being invalidate because project e284ee0d43044b11b711ede03335cfa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:07.050516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:07.051537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0bd13d26-49bb-4fbd-ac7b-515b5d934cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:07.053629 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1968/3935] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:06 2021] DELETE /identity/v3/projects/e284ee0d43044b11b711ede03335cfa1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:07.060714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25af00-79bd-4a3b-8949-cce6cf74316d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:07.061451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25af00-79bd-4a3b-8949-cce6cf74316d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:07.062010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25af00-79bd-4a3b-8949-cce6cf74316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:07.087311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-eb25af00-79bd-4a3b-8949-cce6cf74316d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:07.088880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eb25af00-79bd-4a3b-8949-cce6cf74316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:07.184956 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1968/3936] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:07.191999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adb965-96ef-467d-9f44-0aaeb8cf6087 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:07.192352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adb965-96ef-467d-9f44-0aaeb8cf6087 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:07.192557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adb965-96ef-467d-9f44-0aaeb8cf6087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:07.233768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-90adb965-96ef-467d-9f44-0aaeb8cf6087 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:07.235555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-90adb965-96ef-467d-9f44-0aaeb8cf6087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:07.252974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25af00-79bd-4a3b-8949-cce6cf74316d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:07.262373 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1969/3937] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:07.297987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25af00-79bd-4a3b-8949-cce6cf74316d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:07.314202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0b0a-8896-4d17-a7b2-a0db75ce1279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:07.315292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0b0a-8896-4d17-a7b2-a0db75ce1279 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:07.315619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0b0a-8896-4d17-a7b2-a0db75ce1279 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:07.316008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0b0a-8896-4d17-a7b2-a0db75ce1279 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:07.316901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf0b0a-8896-4d17-a7b2-a0db75ce1279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:07.317315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf0b0a-8896-4d17-a7b2-a0db75ce1279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:07.327594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf0b0a-8896-4d17-a7b2-a0db75ce1279 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:07.364667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adb965-96ef-467d-9f44-0aaeb8cf6087 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:07.374474 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1969/3938] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:56:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:07.378915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adb965-96ef-467d-9f44-0aaeb8cf6087 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:07.402219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea2af-ef01-41ac-9f34-1293af0fe320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:07.404946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea2af-ef01-41ac-9f34-1293af0fe320 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:07.405868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea2af-ef01-41ac-9f34-1293af0fe320 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:07.406157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea2af-ef01-41ac-9f34-1293af0fe320 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:07.407459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ea2af-ef01-41ac-9f34-1293af0fe320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:07.426682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ea2af-ef01-41ac-9f34-1293af0fe320 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:07.513678 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1970/3939] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:07 2021] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:07.514014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0b0a-8896-4d17-a7b2-a0db75ce1279 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:07.532453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0b0a-8896-4d17-a7b2-a0db75ce1279 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:07.623613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6448c83-f5a8-4a87-af22-8c86bf7a191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:07.624311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6448c83-f5a8-4a87-af22-8c86bf7a191a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:07.624597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6448c83-f5a8-4a87-af22-8c86bf7a191a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:07.624875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6448c83-f5a8-4a87-af22-8c86bf7a191a admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:07.625779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6448c83-f5a8-4a87-af22-8c86bf7a191a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:07.628150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6448c83-f5a8-4a87-af22-8c86bf7a191a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:07.666147 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1970/3940] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:07 2021] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:56:07.671013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea2af-ef01-41ac-9f34-1293af0fe320 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:07.686325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea2af-ef01-41ac-9f34-1293af0fe320 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:07.700752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c4499-c3c2-4dbb-935e-f7fd290eb0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:07.701448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4499-c3c2-4dbb-935e-f7fd290eb0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:07.701739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4499-c3c2-4dbb-935e-f7fd290eb0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:07.702014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c4499-c3c2-4dbb-935e-f7fd290eb0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:07.702865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c4499-c3c2-4dbb-935e-f7fd290eb0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:07.704590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c4499-c3c2-4dbb-935e-f7fd290eb0a5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:07.770348 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1971/3941] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:07 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:07.774645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6448c83-f5a8-4a87-af22-8c86bf7a191a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:07.792123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6448c83-f5a8-4a87-af22-8c86bf7a191a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:07.809359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97daf2a-71a8-4f98-a138-7a2015c448bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:07.810321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97daf2a-71a8-4f98-a138-7a2015c448bb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:07.810768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97daf2a-71a8-4f98-a138-7a2015c448bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:07.811216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97daf2a-71a8-4f98-a138-7a2015c448bb admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:07.816138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97daf2a-71a8-4f98-a138-7a2015c448bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:07.818545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97daf2a-71a8-4f98-a138-7a2015c448bb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:07.851780 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1971/3942] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:07 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:07.853104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c4499-c3c2-4dbb-935e-f7fd290eb0a5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:07.880944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c4499-c3c2-4dbb-935e-f7fd290eb0a5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:07.886544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534dbd9-0224-4d9e-913d-4447566c58a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:07.887740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534dbd9-0224-4d9e-913d-4447566c58a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:07.888210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534dbd9-0224-4d9e-913d-4447566c58a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:07.888532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534dbd9-0224-4d9e-913d-4447566c58a7 admin admin] PATH_INFO: `/v3/projects/4e0000db558e40a5a68130b07178b447/users/18b2bfa328264fb39c380fe21eae79cc/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:07.919328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534dbd9-0224-4d9e-913d-4447566c58a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0000db558e40a5a68130b07178b447, user_id=18b2bfa328264fb39c380fe21eae79cc, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:07.923284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534dbd9-0224-4d9e-913d-4447566c58a7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:07.944031 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1972/3943] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:07 2021] PUT /identity/v3/projects/4e0000db558e40a5a68130b07178b447/users/18b2bfa328264fb39c380fe21eae79cc/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:07.949762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4d7f-cb27-4d60-8db3-dee270f92898 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:07.950394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4d7f-cb27-4d60-8db3-dee270f92898 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:07.950940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df4d7f-cb27-4d60-8db3-dee270f92898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:08.041866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d4df4d7f-cb27-4d60-8db3-dee270f92898 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:08.043442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d4df4d7f-cb27-4d60-8db3-dee270f92898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:08.198168 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1972/3944] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:08.243946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534dbd9-0224-4d9e-913d-4447566c58a7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:08.246633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f534dbd9-0224-4d9e-913d-4447566c58a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:08.383324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534dbd9-0224-4d9e-913d-4447566c58a7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:08.389052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aa841-6272-462c-a332-e8548790d5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:08.391068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aa841-6272-462c-a332-e8548790d5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:08.391535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aa841-6272-462c-a332-e8548790d5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:08.392028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aa841-6272-462c-a332-e8548790d5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:08.403554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aa841-6272-462c-a332-e8548790d5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:08.406949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aa841-6272-462c-a332-e8548790d5d6 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:08.420581 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1973/3945] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:10.608022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df4d7f-cb27-4d60-8db3-dee270f92898 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:10.610629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d4df4d7f-cb27-4d60-8db3-dee270f92898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:10.623672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df4d7f-cb27-4d60-8db3-dee270f92898 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:10.629064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:10.630171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:10.630624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:10.631044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] PATH_INFO: `/v3/users/d79734c0300042b3b0f7326fc80e13ea` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:10.632418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79734c0300042b3b0f7326fc80e13ea)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:10.634929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:10.696929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79734c0300042b3b0f7326fc80e13ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:10.698985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79734c0300042b3b0f7326fc80e13ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:10.710953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79734c0300042b3b0f7326fc80e13ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:10.712857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79734c0300042b3b0f7326fc80e13ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:10.726588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79734c0300042b3b0f7326fc80e13ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:10.748848 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1973/3946] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:10 2021] DELETE /identity/v3/users/d79734c0300042b3b0f7326fc80e13ea => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:10.753974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639cc9b-1fee-4a1f-8df6-0dd817ab3df0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:10.754492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639cc9b-1fee-4a1f-8df6-0dd817ab3df0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:10.754591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639cc9b-1fee-4a1f-8df6-0dd817ab3df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:10.774741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9639cc9b-1fee-4a1f-8df6-0dd817ab3df0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:10.776785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9639cc9b-1fee-4a1f-8df6-0dd817ab3df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:10.847561 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1974/3947] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:10.862031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:10.864014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:10.940202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3c04-ee5b-4005-a2fc-47ebc33b8957 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:10.940840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3c04-ee5b-4005-a2fc-47ebc33b8957 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:10.941308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3c04-ee5b-4005-a2fc-47ebc33b8957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:10.972042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a86f3c04-ee5b-4005-a2fc-47ebc33b8957 None None] MFA Rules not processed for user `18b2bfa328264fb39c380fe21eae79cc`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:10.973597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a86f3c04-ee5b-4005-a2fc-47ebc33b8957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:10.983016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452d02f-2099-40d9-bf24-aa1b7426ed5d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:10.991143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cda951-6c51-467b-918c-88bad7bb134e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:10.992198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cda951-6c51-467b-918c-88bad7bb134e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:10.993053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cda951-6c51-467b-918c-88bad7bb134e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:10.993487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cda951-6c51-467b-918c-88bad7bb134e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:11.009225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cda951-6c51-467b-918c-88bad7bb134e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:11.011631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cda951-6c51-467b-918c-88bad7bb134e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:11.027116 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1974/3948] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:11.087109 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1975/3949] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:10 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:11.255962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cda951-6c51-467b-918c-88bad7bb134e service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:11.257807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-35cda951-6c51-467b-918c-88bad7bb134e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:11.414593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cda951-6c51-467b-918c-88bad7bb134e service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:11.433539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdd1f9-8cc5-401c-ae27-b62b699c94f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:11.434437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdd1f9-8cc5-401c-ae27-b62b699c94f9 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:11.434829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdd1f9-8cc5-401c-ae27-b62b699c94f9 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:11.435208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdd1f9-8cc5-401c-ae27-b62b699c94f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:11.452208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdd1f9-8cc5-401c-ae27-b62b699c94f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:11.454265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdd1f9-8cc5-401c-ae27-b62b699c94f9 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:11.475110 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1975/3950] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:11 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:11.991483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3c04-ee5b-4005-a2fc-47ebc33b8957 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:11.992973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a86f3c04-ee5b-4005-a2fc-47ebc33b8957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:12.018367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3c04-ee5b-4005-a2fc-47ebc33b8957 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:12.033259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:12.034999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:12.035536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:12.036033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] PATH_INFO: `/v3/projects/6bc9d999317e427fa446cec7242dbab1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:12.038380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc9d999317e427fa446cec7242dbab1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:12.041161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:12.172072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc9d999317e427fa446cec7242dbab1', 'request_id': 'req-83753e6f-3a7b-4a8d-a562-6720f41f9c46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:12.194681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc9d999317e427fa446cec7242dbab1', 'request_id': 'req-83753e6f-3a7b-4a8d-a562-6720f41f9c46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:12.211857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc9d999317e427fa446cec7242dbab1', 'request_id': 'req-83753e6f-3a7b-4a8d-a562-6720f41f9c46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:12.236579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] The token cache is being invalidate because project 6bc9d999317e427fa446cec7242dbab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:12.237072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:12.237909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:12.240853 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1976/3951] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:11 2021] DELETE /identity/v3/projects/6bc9d999317e427fa446cec7242dbab1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:12.248690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda01e1-477f-473b-9eb5-15cc88cee055 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:12.250562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda01e1-477f-473b-9eb5-15cc88cee055 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:12.250983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda01e1-477f-473b-9eb5-15cc88cee055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:12.402984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9eda01e1-477f-473b-9eb5-15cc88cee055 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:12.405696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9eda01e1-477f-473b-9eb5-15cc88cee055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:12.456767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:12.458501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:12.643711 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1976/3952] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:12.651386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c106c-23d3-47f9-b5b8-46bace7a436b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:12.651682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c106c-23d3-47f9-b5b8-46bace7a436b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:12.651967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c106c-23d3-47f9-b5b8-46bace7a436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:12.670985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83753e6f-3a7b-4a8d-a562-6720f41f9c46 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:12.671846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-354c106c-23d3-47f9-b5b8-46bace7a436b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:12.676829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-354c106c-23d3-47f9-b5b8-46bace7a436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:12.687891 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1977/3953] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:12.689070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c106c-23d3-47f9-b5b8-46bace7a436b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:12.689301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:12.690289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:12.690637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:12.690979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] PATH_INFO: `/v3/users/e9cca4bb4c784112a09e5577e8758288` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:12.693853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cca4bb4c784112a09e5577e8758288)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:12.696248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:12.700983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c106c-23d3-47f9-b5b8-46bace7a436b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:12.708594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4871-92c7-4145-9f87-cbbd7d86ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:12.709296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4871-92c7-4145-9f87-cbbd7d86ea7d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:12.709586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4871-92c7-4145-9f87-cbbd7d86ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:12.709862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4871-92c7-4145-9f87-cbbd7d86ea7d admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:12.710713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc4871-92c7-4145-9f87-cbbd7d86ea7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:12.711027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc4871-92c7-4145-9f87-cbbd7d86ea7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:12.713374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc4871-92c7-4145-9f87-cbbd7d86ea7d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:12.733787 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1978/3954] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:56:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:12.734740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4871-92c7-4145-9f87-cbbd7d86ea7d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:12.765273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4871-92c7-4145-9f87-cbbd7d86ea7d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:12.778874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307da5e-8498-4bac-9241-6ec211600541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:12.779843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307da5e-8498-4bac-9241-6ec211600541 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:12.780147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307da5e-8498-4bac-9241-6ec211600541 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:12.780816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307da5e-8498-4bac-9241-6ec211600541 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:12.780992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307da5e-8498-4bac-9241-6ec211600541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:12.788562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307da5e-8498-4bac-9241-6ec211600541 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:12.807525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cca4bb4c784112a09e5577e8758288'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:12.817978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cca4bb4c784112a09e5577e8758288'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:12.818912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cca4bb4c784112a09e5577e8758288'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:12.830534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cca4bb4c784112a09e5577e8758288'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:12.851118 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1979/3955] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:12 2021] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:12.852030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307da5e-8498-4bac-9241-6ec211600541 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:12.858296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cca4bb4c784112a09e5577e8758288'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:12.861586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a307da5e-8498-4bac-9241-6ec211600541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:12.870525 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1977/3956] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:12 2021] DELETE /identity/v3/users/e9cca4bb4c784112a09e5577e8758288 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:12.969423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307da5e-8498-4bac-9241-6ec211600541 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:13.053062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d54680-abc5-40c6-82ba-e57e79c99b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:13.054993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d54680-abc5-40c6-82ba-e57e79c99b42 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:13.055664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d54680-abc5-40c6-82ba-e57e79c99b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:13.056155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d54680-abc5-40c6-82ba-e57e79c99b42 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:13.057419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d54680-abc5-40c6-82ba-e57e79c99b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:13.061050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d54680-abc5-40c6-82ba-e57e79c99b42 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:13.097529 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1980/3957] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:12 2021] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:13.101634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:13.118447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa537d01-2925-4bfd-af23-2121dd93ca0b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:13.125609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9a5f9-9a2f-48e1-8e32-cefad9e14670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:13.126708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9a5f9-9a2f-48e1-8e32-cefad9e14670 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:13.127304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9a5f9-9a2f-48e1-8e32-cefad9e14670 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:13.127796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9a5f9-9a2f-48e1-8e32-cefad9e14670 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:13.128923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9a5f9-9a2f-48e1-8e32-cefad9e14670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:13.131897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9a5f9-9a2f-48e1-8e32-cefad9e14670 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:13.146492 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1978/3958] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:13 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:56:13.150031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d54680-abc5-40c6-82ba-e57e79c99b42 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:13.164389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d54680-abc5-40c6-82ba-e57e79c99b42 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:13.173081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9500e07-9fc3-483d-b031-8ffa9c709ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:13.174141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9500e07-9fc3-483d-b031-8ffa9c709ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:13.175074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9500e07-9fc3-483d-b031-8ffa9c709ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:13.175074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9500e07-9fc3-483d-b031-8ffa9c709ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:13.175762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9500e07-9fc3-483d-b031-8ffa9c709ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:13.178518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9500e07-9fc3-483d-b031-8ffa9c709ea1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:13.193994 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1981/3959] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:13 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:13.196443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9a5f9-9a2f-48e1-8e32-cefad9e14670 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:13.215531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9a5f9-9a2f-48e1-8e32-cefad9e14670 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:13.228065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607701a1-49d5-4d9d-a3f7-8036cf17d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:13.229696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607701a1-49d5-4d9d-a3f7-8036cf17d818 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:13.230148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607701a1-49d5-4d9d-a3f7-8036cf17d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:13.230529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607701a1-49d5-4d9d-a3f7-8036cf17d818 admin admin] PATH_INFO: `/v3/projects/e5b09831584c4f48b5948b481d2913cb/users/8fff05064e37409c8f7a700b54dab65b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:13.251355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607701a1-49d5-4d9d-a3f7-8036cf17d818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b09831584c4f48b5948b481d2913cb, user_id=8fff05064e37409c8f7a700b54dab65b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:13.254396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607701a1-49d5-4d9d-a3f7-8036cf17d818 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:13.280404 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1979/3960] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:13 2021] PUT /identity/v3/projects/e5b09831584c4f48b5948b481d2913cb/users/8fff05064e37409c8f7a700b54dab65b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:13.283933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825c3c1-541e-4e10-8144-892544850d25 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:13.284420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825c3c1-541e-4e10-8144-892544850d25 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:13.284816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825c3c1-541e-4e10-8144-892544850d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:13.345044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6825c3c1-541e-4e10-8144-892544850d25 None None] MFA Rules not processed for user `8fff05064e37409c8f7a700b54dab65b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:13.346635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6825c3c1-541e-4e10-8144-892544850d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:13.521274 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1982/3961] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:13 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:13.618061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607701a1-49d5-4d9d-a3f7-8036cf17d818 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:13.621231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-607701a1-49d5-4d9d-a3f7-8036cf17d818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:13.744989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607701a1-49d5-4d9d-a3f7-8036cf17d818 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:13.761592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91028f-657a-496e-ad40-48afeb16d92c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:13.763192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91028f-657a-496e-ad40-48afeb16d92c service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:13.763508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91028f-657a-496e-ad40-48afeb16d92c service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:13.764871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91028f-657a-496e-ad40-48afeb16d92c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:13.779725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91028f-657a-496e-ad40-48afeb16d92c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:13.782388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91028f-657a-496e-ad40-48afeb16d92c service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:13.796308 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1980/3962] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:13 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:13.872562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf847fc7-4c3d-4b96-b6bf-a4b403225226 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:13.873085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf847fc7-4c3d-4b96-b6bf-a4b403225226 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:13.873532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf847fc7-4c3d-4b96-b6bf-a4b403225226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:13.930000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-bf847fc7-4c3d-4b96-b6bf-a4b403225226 None None] MFA Rules not processed for user `18b2bfa328264fb39c380fe21eae79cc`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:13.940155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bf847fc7-4c3d-4b96-b6bf-a4b403225226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:14.090554 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1983/3963] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:13 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:14.402750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91028f-657a-496e-ad40-48afeb16d92c service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:14.404988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6e91028f-657a-496e-ad40-48afeb16d92c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:14.606459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91028f-657a-496e-ad40-48afeb16d92c service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:14.621727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:14.622633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:14.623422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:14.623713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] PATH_INFO: `/v3/projects/0e3934c8eb824af986aa4f0624cd4037` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:14.629502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3934c8eb824af986aa4f0624cd4037)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:14.633496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:14.731730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3934c8eb824af986aa4f0624cd4037', 'request_id': 'req-01a4cac9-6fa2-42e4-a2d5-c0678431e180'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:14.748030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3934c8eb824af986aa4f0624cd4037', 'request_id': 'req-01a4cac9-6fa2-42e4-a2d5-c0678431e180'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:14.757093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3934c8eb824af986aa4f0624cd4037', 'request_id': 'req-01a4cac9-6fa2-42e4-a2d5-c0678431e180'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:14.778446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] The token cache is being invalidate because project 0e3934c8eb824af986aa4f0624cd4037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:14.779583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:14.781268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-01a4cac9-6fa2-42e4-a2d5-c0678431e180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:14.784250 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1981/3964] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:14 2021] DELETE /identity/v3/projects/0e3934c8eb824af986aa4f0624cd4037 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:14.792326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147286-a9bd-4607-89a0-f87cce961484 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:14.793810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147286-a9bd-4607-89a0-f87cce961484 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:14.794418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147286-a9bd-4607-89a0-f87cce961484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:14.826931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-02147286-a9bd-4607-89a0-f87cce961484 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:14.829900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-02147286-a9bd-4607-89a0-f87cce961484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:14.924396 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1984/3965] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:14.932765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daed69-80f3-44f4-b274-08d9e6dfcc52 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:14.933512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daed69-80f3-44f4-b274-08d9e6dfcc52 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:14.934047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daed69-80f3-44f4-b274-08d9e6dfcc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:14.963733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-17daed69-80f3-44f4-b274-08d9e6dfcc52 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:14.965804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-17daed69-80f3-44f4-b274-08d9e6dfcc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:14.988359 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1982/3966] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:14.992974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02147286-a9bd-4607-89a0-f87cce961484 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:15.003842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02147286-a9bd-4607-89a0-f87cce961484 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:15.011196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d07d2-9c97-47bb-9843-c01901d6c994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:15.012269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d07d2-9c97-47bb-9843-c01901d6c994 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:15.012975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d07d2-9c97-47bb-9843-c01901d6c994 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:15.013561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d07d2-9c97-47bb-9843-c01901d6c994 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:15.014443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d07d2-9c97-47bb-9843-c01901d6c994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:15.014889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d07d2-9c97-47bb-9843-c01901d6c994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:15.016678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d07d2-9c97-47bb-9843-c01901d6c994 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:15.051885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daed69-80f3-44f4-b274-08d9e6dfcc52 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:15.052662 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1985/3967] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:56:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:15.063396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daed69-80f3-44f4-b274-08d9e6dfcc52 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:15.069250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6387d1-70aa-4f72-8d0d-831604b57e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:15.071665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6387d1-70aa-4f72-8d0d-831604b57e14 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:15.072185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6387d1-70aa-4f72-8d0d-831604b57e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:15.073378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6387d1-70aa-4f72-8d0d-831604b57e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:15.074320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6387d1-70aa-4f72-8d0d-831604b57e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:15.077862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6387d1-70aa-4f72-8d0d-831604b57e14 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:15.117891 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1983/3968] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:15 2021] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:56:15.122408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d07d2-9c97-47bb-9843-c01901d6c994 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:15.144819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d07d2-9c97-47bb-9843-c01901d6c994 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:15.243443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a53f72-de11-4b51-a39a-5faa30186426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:15.245933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a53f72-de11-4b51-a39a-5faa30186426 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:15.246842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a53f72-de11-4b51-a39a-5faa30186426 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:15.247442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a53f72-de11-4b51-a39a-5faa30186426 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:15.249159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a53f72-de11-4b51-a39a-5faa30186426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:15.252167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a53f72-de11-4b51-a39a-5faa30186426 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:15.284928 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1986/3969] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:15 2021] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:15.286940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6387d1-70aa-4f72-8d0d-831604b57e14 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:15.306256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6387d1-70aa-4f72-8d0d-831604b57e14 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:15.314008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e16bc-0514-41c9-b3a6-c56bf6289078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:15.315721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e16bc-0514-41c9-b3a6-c56bf6289078 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:15.316121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e16bc-0514-41c9-b3a6-c56bf6289078 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:15.316509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e16bc-0514-41c9-b3a6-c56bf6289078 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:15.317653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e16bc-0514-41c9-b3a6-c56bf6289078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:15.319501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e16bc-0514-41c9-b3a6-c56bf6289078 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:15.337091 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1984/3970] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:15 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:15.338164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a53f72-de11-4b51-a39a-5faa30186426 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:15.352652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a53f72-de11-4b51-a39a-5faa30186426 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:15.366165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e8334-8af1-43ac-8e69-1043c9723a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:15.370486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e8334-8af1-43ac-8e69-1043c9723a2e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:15.370705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e8334-8af1-43ac-8e69-1043c9723a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:15.370949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e8334-8af1-43ac-8e69-1043c9723a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:15.372031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e8334-8af1-43ac-8e69-1043c9723a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:15.373665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e8334-8af1-43ac-8e69-1043c9723a2e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:15.385546 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1987/3971] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:15 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:56:15.389392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e16bc-0514-41c9-b3a6-c56bf6289078 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:15.404275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e16bc-0514-41c9-b3a6-c56bf6289078 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:15.409517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebcf5f-007a-4504-9344-f4b988a0ac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:15.410645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebcf5f-007a-4504-9344-f4b988a0ac1a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:15.411033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebcf5f-007a-4504-9344-f4b988a0ac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:15.411461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebcf5f-007a-4504-9344-f4b988a0ac1a admin admin] PATH_INFO: `/v3/projects/c03be159839446f2a47ca07f13bb552c/users/8e7695cf8df749e9af62b1746e818ea3/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:15.430378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebcf5f-007a-4504-9344-f4b988a0ac1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03be159839446f2a47ca07f13bb552c, user_id=8e7695cf8df749e9af62b1746e818ea3, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:15.436747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebcf5f-007a-4504-9344-f4b988a0ac1a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:15.467268 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1985/3972] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:15 2021] PUT /identity/v3/projects/c03be159839446f2a47ca07f13bb552c/users/8e7695cf8df749e9af62b1746e818ea3/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:15.473203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cacef-955f-42a7-a54c-7c59a6602f50 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:15.473574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cacef-955f-42a7-a54c-7c59a6602f50 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:15.473919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cacef-955f-42a7-a54c-7c59a6602f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:15.502511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-682cacef-955f-42a7-a54c-7c59a6602f50 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:15.504691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-682cacef-955f-42a7-a54c-7c59a6602f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:15.634244 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1988/3973] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:15.776881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebcf5f-007a-4504-9344-f4b988a0ac1a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:15.778729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-80ebcf5f-007a-4504-9344-f4b988a0ac1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:15.906776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cacef-955f-42a7-a54c-7c59a6602f50 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:15.910076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-682cacef-955f-42a7-a54c-7c59a6602f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:15.942400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cacef-955f-42a7-a54c-7c59a6602f50 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:15.951923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:15.953623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:15.955138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:15.955487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] PATH_INFO: `/v3/users/8fff05064e37409c8f7a700b54dab65b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:15.958828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fff05064e37409c8f7a700b54dab65b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:15.966592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:16.008571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebcf5f-007a-4504-9344-f4b988a0ac1a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:16.013745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992af778-e930-4457-804c-eb8d52db7446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:16.032684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992af778-e930-4457-804c-eb8d52db7446 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:16.033165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992af778-e930-4457-804c-eb8d52db7446 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:16.034078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992af778-e930-4457-804c-eb8d52db7446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:16.047900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992af778-e930-4457-804c-eb8d52db7446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:16.049715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992af778-e930-4457-804c-eb8d52db7446 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:16.063588 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1986/3974] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:16.083793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fff05064e37409c8f7a700b54dab65b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:16.085401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fff05064e37409c8f7a700b54dab65b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:16.109951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fff05064e37409c8f7a700b54dab65b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:16.110580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fff05064e37409c8f7a700b54dab65b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:16.134190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fff05064e37409c8f7a700b54dab65b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:16.193353 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1989/3975] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:15 2021] DELETE /identity/v3/users/8fff05064e37409c8f7a700b54dab65b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:16.198641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ddaa1-20e9-4056-8cd6-96c6b9b81773 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:16.198929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ddaa1-20e9-4056-8cd6-96c6b9b81773 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:16.199210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ddaa1-20e9-4056-8cd6-96c6b9b81773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:16.249889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6a7ddaa1-20e9-4056-8cd6-96c6b9b81773 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:16.254989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6a7ddaa1-20e9-4056-8cd6-96c6b9b81773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:16.358631 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1987/3976] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:16.380657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:16.382525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:16.480115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8fdc2-9e4c-46b8-9e06-6411315b2a82 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:16.488251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef499b7-c7d7-4111-816e-a38d8e5543fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:16.489842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef499b7-c7d7-4111-816e-a38d8e5543fe service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:16.490132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef499b7-c7d7-4111-816e-a38d8e5543fe service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:16.490406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef499b7-c7d7-4111-816e-a38d8e5543fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:16.520181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef499b7-c7d7-4111-816e-a38d8e5543fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:16.521912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef499b7-c7d7-4111-816e-a38d8e5543fe service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:16.538692 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1990/3977] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:17.560460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ddaa1-20e9-4056-8cd6-96c6b9b81773 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:17.562049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6a7ddaa1-20e9-4056-8cd6-96c6b9b81773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:17.580885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ddaa1-20e9-4056-8cd6-96c6b9b81773 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:17.585862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:17.586718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:17.587203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:17.587711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] PATH_INFO: `/v3/projects/e5b09831584c4f48b5948b481d2913cb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:17.589137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b09831584c4f48b5948b481d2913cb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:17.603030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:17.692230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b09831584c4f48b5948b481d2913cb', 'request_id': 'req-0f5a8430-b335-4a5c-be2b-336f65c88f01'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:17.707083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b09831584c4f48b5948b481d2913cb', 'request_id': 'req-0f5a8430-b335-4a5c-be2b-336f65c88f01'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:17.717755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b09831584c4f48b5948b481d2913cb', 'request_id': 'req-0f5a8430-b335-4a5c-be2b-336f65c88f01'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:17.736456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] The token cache is being invalidate because project e5b09831584c4f48b5948b481d2913cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:17.736755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:17.737508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0f5a8430-b335-4a5c-be2b-336f65c88f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:17.747946 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1988/3978] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:17 2021] DELETE /identity/v3/projects/e5b09831584c4f48b5948b481d2913cb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:17.748777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c7391-9ffa-4653-8ed7-bb9bbc25e5ef None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:17.749252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c7391-9ffa-4653-8ed7-bb9bbc25e5ef None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:17.749361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c7391-9ffa-4653-8ed7-bb9bbc25e5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:17.781568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4e4c7391-9ffa-4653-8ed7-bb9bbc25e5ef None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:17.782877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4e4c7391-9ffa-4653-8ed7-bb9bbc25e5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:17.978269 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1991/3979] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:17.979083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea522-5ae2-4071-963e-042dd4cdcfd4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:17.979406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea522-5ae2-4071-963e-042dd4cdcfd4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:17.979678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea522-5ae2-4071-963e-042dd4cdcfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:18.016952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-96fea522-5ae2-4071-963e-042dd4cdcfd4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:18.020252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-96fea522-5ae2-4071-963e-042dd4cdcfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:18.039943 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1989/3980] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:18.046046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c7391-9ffa-4653-8ed7-bb9bbc25e5ef None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:18.058792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c7391-9ffa-4653-8ed7-bb9bbc25e5ef None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:18.065001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad351502-7ece-42dd-bc0f-151ecb375fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:18.065747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351502-7ece-42dd-bc0f-151ecb375fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:18.066099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351502-7ece-42dd-bc0f-151ecb375fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:18.066451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351502-7ece-42dd-bc0f-151ecb375fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:18.067609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad351502-7ece-42dd-bc0f-151ecb375fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:18.067999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad351502-7ece-42dd-bc0f-151ecb375fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:18.069781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad351502-7ece-42dd-bc0f-151ecb375fc4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:18.085991 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1992/3981] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:56:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:18.090756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea522-5ae2-4071-963e-042dd4cdcfd4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:18.103047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea522-5ae2-4071-963e-042dd4cdcfd4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:18.113443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83695ab-651e-4d86-a623-128d59e2c4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:18.114344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83695ab-651e-4d86-a623-128d59e2c4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:18.114778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83695ab-651e-4d86-a623-128d59e2c4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:18.115201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83695ab-651e-4d86-a623-128d59e2c4d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:18.116108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83695ab-651e-4d86-a623-128d59e2c4d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:18.118521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83695ab-651e-4d86-a623-128d59e2c4d6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:18.159409 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1990/3982] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:18 2021] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:18.163906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad351502-7ece-42dd-bc0f-151ecb375fc4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:18.181265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad351502-7ece-42dd-bc0f-151ecb375fc4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:18.274492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c1d77-42bc-42f4-9029-d76e92f7cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:18.275427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c1d77-42bc-42f4-9029-d76e92f7cfce admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:18.275967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c1d77-42bc-42f4-9029-d76e92f7cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:18.276622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c1d77-42bc-42f4-9029-d76e92f7cfce admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:18.277252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c1d77-42bc-42f4-9029-d76e92f7cfce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:18.279419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c1d77-42bc-42f4-9029-d76e92f7cfce admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:18.316141 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1993/3983] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:18 2021] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:18.318904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83695ab-651e-4d86-a623-128d59e2c4d6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:18.337699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83695ab-651e-4d86-a623-128d59e2c4d6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:18.346678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60075e79-107d-4074-b8ea-1d4a36d7f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:18.347443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60075e79-107d-4074-b8ea-1d4a36d7f856 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:18.347727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60075e79-107d-4074-b8ea-1d4a36d7f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:18.347999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60075e79-107d-4074-b8ea-1d4a36d7f856 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:18.348899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60075e79-107d-4074-b8ea-1d4a36d7f856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:18.351131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60075e79-107d-4074-b8ea-1d4a36d7f856 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:18.376110 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1991/3984] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:18 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:18.377128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c1d77-42bc-42f4-9029-d76e92f7cfce admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:18.389661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c1d77-42bc-42f4-9029-d76e92f7cfce admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:18.398663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c201dbc-f6ed-4ffc-a390-9f728e00f179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:18.399371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c201dbc-f6ed-4ffc-a390-9f728e00f179 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:18.399658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c201dbc-f6ed-4ffc-a390-9f728e00f179 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:18.399952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c201dbc-f6ed-4ffc-a390-9f728e00f179 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:18.400703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c201dbc-f6ed-4ffc-a390-9f728e00f179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:18.402682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c201dbc-f6ed-4ffc-a390-9f728e00f179 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:18.416688 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1994/3985] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:18 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:56:18.428977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60075e79-107d-4074-b8ea-1d4a36d7f856 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:18.460573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60075e79-107d-4074-b8ea-1d4a36d7f856 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:18.470462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2916aa4-4118-422a-8afe-2b2c49f3a738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:18.473307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2916aa4-4118-422a-8afe-2b2c49f3a738 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:18.473926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2916aa4-4118-422a-8afe-2b2c49f3a738 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:18.474423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2916aa4-4118-422a-8afe-2b2c49f3a738 admin admin] PATH_INFO: `/v3/projects/7860bb78a8bc43fd80d4c01ce057e5ef/users/dcb3f0e11efd43278f9c4c34f7eda52d/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:18.499224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2916aa4-4118-422a-8afe-2b2c49f3a738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7860bb78a8bc43fd80d4c01ce057e5ef, user_id=dcb3f0e11efd43278f9c4c34f7eda52d, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:18.502851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2916aa4-4118-422a-8afe-2b2c49f3a738 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:18.526492 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1992/3986] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:18 2021] PUT /identity/v3/projects/7860bb78a8bc43fd80d4c01ce057e5ef/users/dcb3f0e11efd43278f9c4c34f7eda52d/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:18.531493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b9406-2e0c-4c08-913a-9a930fff6632 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:18.532608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b9406-2e0c-4c08-913a-9a930fff6632 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:18.533058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b9406-2e0c-4c08-913a-9a930fff6632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:18.563117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e69b9406-2e0c-4c08-913a-9a930fff6632 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:18.564882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e69b9406-2e0c-4c08-913a-9a930fff6632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:18.650291 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1995/3987] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:18.677013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2916aa4-4118-422a-8afe-2b2c49f3a738 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:18.682592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b2916aa4-4118-422a-8afe-2b2c49f3a738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:18.781128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2916aa4-4118-422a-8afe-2b2c49f3a738 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:18.786640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dee53-fdba-4de1-9788-bc10167f115e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:18.788039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dee53-fdba-4de1-9788-bc10167f115e service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:18.789043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dee53-fdba-4de1-9788-bc10167f115e service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:18.790078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dee53-fdba-4de1-9788-bc10167f115e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:18.815015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dee53-fdba-4de1-9788-bc10167f115e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:18.816353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dee53-fdba-4de1-9788-bc10167f115e service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:18.836091 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1993/3988] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:56:20.010509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b9406-2e0c-4c08-913a-9a930fff6632 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:20.030526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b9406-2e0c-4c08-913a-9a930fff6632 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:20.035195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b73bc-b692-4142-86c0-cd69aad43ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:20.035910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b73bc-b692-4142-86c0-cd69aad43ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:20.036194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b73bc-b692-4142-86c0-cd69aad43ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:20.036472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b73bc-b692-4142-86c0-cd69aad43ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:20.038671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f11b73bc-b692-4142-86c0-cd69aad43ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:20.117073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b73bc-b692-4142-86c0-cd69aad43ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:20.118558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b73bc-b692-4142-86c0-cd69aad43ce3 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:20.131771 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1996/3989] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:20 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:29.289367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbed61-7c0c-4727-8976-a761c120374d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:29.290227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbed61-7c0c-4727-8976-a761c120374d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:29.290741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbed61-7c0c-4727-8976-a761c120374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:29.343554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2fbbed61-7c0c-4727-8976-a761c120374d None None] MFA Rules not processed for user `8e7695cf8df749e9af62b1746e818ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:29.347590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2fbbed61-7c0c-4727-8976-a761c120374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:29.511309 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1994/3990] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:29 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:29.514335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b73bc-b692-4142-86c0-cd69aad43ce3 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:29.516286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f11b73bc-b692-4142-86c0-cd69aad43ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:29.540809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b73bc-b692-4142-86c0-cd69aad43ce3 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:29.547197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4186b-9ee5-4322-851c-20902d52f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:29.548559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4186b-9ee5-4322-851c-20902d52f298 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:29.549153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4186b-9ee5-4322-851c-20902d52f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:29.549734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4186b-9ee5-4322-851c-20902d52f298 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:29.550647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4186b-9ee5-4322-851c-20902d52f298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:29.554507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4186b-9ee5-4322-851c-20902d52f298 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:29.615455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbed61-7c0c-4727-8976-a761c120374d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:29.616520 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1997/3991] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:29 2021] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:29.632043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbed61-7c0c-4727-8976-a761c120374d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:29.790379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd29cb-7010-4d53-b58c-80eed1749652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:29.791608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd29cb-7010-4d53-b58c-80eed1749652 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:29.791965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd29cb-7010-4d53-b58c-80eed1749652 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:29.792220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd29cb-7010-4d53-b58c-80eed1749652 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:29.792883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd29cb-7010-4d53-b58c-80eed1749652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:29.800670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd29cb-7010-4d53-b58c-80eed1749652 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:29.843654 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1995/3992] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:29 2021] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:29.847716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4186b-9ee5-4322-851c-20902d52f298 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:29.868475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4186b-9ee5-4322-851c-20902d52f298 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:29.879437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ff73a-2094-4cf1-b653-373d12618e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:29.880949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ff73a-2094-4cf1-b653-373d12618e23 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:29.881347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ff73a-2094-4cf1-b653-373d12618e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:29.881629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ff73a-2094-4cf1-b653-373d12618e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:29.882527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ff73a-2094-4cf1-b653-373d12618e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:29.884662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ff73a-2094-4cf1-b653-373d12618e23 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:29.909344 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1998/3993] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:29 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:29.909887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd29cb-7010-4d53-b58c-80eed1749652 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:29.926301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd29cb-7010-4d53-b58c-80eed1749652 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:29.941328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd41983-b6ad-42b0-b962-4ee0d931dec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:29.942247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd41983-b6ad-42b0-b962-4ee0d931dec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:29.942534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd41983-b6ad-42b0-b962-4ee0d931dec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:29.942809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd41983-b6ad-42b0-b962-4ee0d931dec4 admin admin] PATH_INFO: `/v3/projects/441ce7b15a1a4d9bb575c26f6393b942/users/8a6b24888695498b9b368d5f906b0926/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:29.984536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd41983-b6ad-42b0-b962-4ee0d931dec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=441ce7b15a1a4d9bb575c26f6393b942, user_id=8a6b24888695498b9b368d5f906b0926, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:29.991632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd41983-b6ad-42b0-b962-4ee0d931dec4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:30.036970 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1996/3994] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:29 2021] PUT /identity/v3/projects/441ce7b15a1a4d9bb575c26f6393b942/users/8a6b24888695498b9b368d5f906b0926/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:30.040510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ff73a-2094-4cf1-b653-373d12618e23 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:30.059100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ff73a-2094-4cf1-b653-373d12618e23 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:30.199888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd385937-d2a8-4601-b166-e202465afc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:30.200873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd385937-d2a8-4601-b166-e202465afc4c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:30.201311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd385937-d2a8-4601-b166-e202465afc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:30.201739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd385937-d2a8-4601-b166-e202465afc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:30.202626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd385937-d2a8-4601-b166-e202465afc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:30.205368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd385937-d2a8-4601-b166-e202465afc4c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:30.227494 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 1999/3995] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:30 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:30.232102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd41983-b6ad-42b0-b962-4ee0d931dec4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:30.262185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd41983-b6ad-42b0-b962-4ee0d931dec4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:30.274568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeb820-f062-40ca-93c1-a0db6dbbfdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:30.280108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb820-f062-40ca-93c1-a0db6dbbfdff admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:30.280688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb820-f062-40ca-93c1-a0db6dbbfdff admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:30.281167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb820-f062-40ca-93c1-a0db6dbbfdff admin admin] PATH_INFO: `/v3/projects/441ce7b15a1a4d9bb575c26f6393b942/users/8a6b24888695498b9b368d5f906b0926/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:30.284363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aeb820-f062-40ca-93c1-a0db6dbbfdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=441ce7b15a1a4d9bb575c26f6393b942, user_id=8a6b24888695498b9b368d5f906b0926, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:30.292592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aeb820-f062-40ca-93c1-a0db6dbbfdff admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:30.325111 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1997/3996] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:30 2021] PUT /identity/v3/projects/441ce7b15a1a4d9bb575c26f6393b942/users/8a6b24888695498b9b368d5f906b0926/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:30.803920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd385937-d2a8-4601-b166-e202465afc4c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:30.807300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dd385937-d2a8-4601-b166-e202465afc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:30.865377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd385937-d2a8-4601-b166-e202465afc4c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:31.034401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:31.036790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:31.037879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:31.038721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] PATH_INFO: `/v3/users/1ed72c3ee9064f34aa08e7b328100a9a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:31.042531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed72c3ee9064f34aa08e7b328100a9a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:31.052482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:31.153852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed72c3ee9064f34aa08e7b328100a9a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:31.154617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed72c3ee9064f34aa08e7b328100a9a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:31.169664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed72c3ee9064f34aa08e7b328100a9a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:31.170183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed72c3ee9064f34aa08e7b328100a9a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:31.189327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed72c3ee9064f34aa08e7b328100a9a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:31.248394 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2000/3997] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:30 2021] DELETE /identity/v3/users/1ed72c3ee9064f34aa08e7b328100a9a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:31.871702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeb820-f062-40ca-93c1-a0db6dbbfdff admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:31.874127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a7aeb820-f062-40ca-93c1-a0db6dbbfdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:31.898025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeb820-f062-40ca-93c1-a0db6dbbfdff admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:32.026406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b05f42-524e-454f-ae8f-ff5d3355d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:32.028885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b05f42-524e-454f-ae8f-ff5d3355d3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:32.029346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b05f42-524e-454f-ae8f-ff5d3355d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:32.032182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b05f42-524e-454f-ae8f-ff5d3355d3ae admin admin] PATH_INFO: `/v3/users/3cc24888898d4d20bcfdc3d7c8cde8bf` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:32.036867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b05f42-524e-454f-ae8f-ff5d3355d3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc24888898d4d20bcfdc3d7c8cde8bf)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:32.042783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b05f42-524e-454f-ae8f-ff5d3355d3ae admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:32.152751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a1b05f42-524e-454f-ae8f-ff5d3355d3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc24888898d4d20bcfdc3d7c8cde8bf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:32.176138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a1b05f42-524e-454f-ae8f-ff5d3355d3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc24888898d4d20bcfdc3d7c8cde8bf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:32.176998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a1b05f42-524e-454f-ae8f-ff5d3355d3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc24888898d4d20bcfdc3d7c8cde8bf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:32.189337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a1b05f42-524e-454f-ae8f-ff5d3355d3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc24888898d4d20bcfdc3d7c8cde8bf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:32.207500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a1b05f42-524e-454f-ae8f-ff5d3355d3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc24888898d4d20bcfdc3d7c8cde8bf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:32.220538 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1998/3998] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:31 2021] DELETE /identity/v3/users/3cc24888898d4d20bcfdc3d7c8cde8bf => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:32.699816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:32.701327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:32.725521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aff09f-134a-457f-bede-3c811d199614 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:32.811931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:32.813071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:32.813550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:32.813841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] PATH_INFO: `/v3/projects/79be4e7871e9465b82698fe64c318285` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:32.815536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79be4e7871e9465b82698fe64c318285)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:32.818289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:32.897077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79be4e7871e9465b82698fe64c318285', 'request_id': 'req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:32.907880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79be4e7871e9465b82698fe64c318285', 'request_id': 'req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:32.919866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79be4e7871e9465b82698fe64c318285', 'request_id': 'req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:32.943661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] The token cache is being invalidate because project 79be4e7871e9465b82698fe64c318285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:32.944973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:32.946236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:32.953630 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2001/3999] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:32 2021] DELETE /identity/v3/projects/79be4e7871e9465b82698fe64c318285 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:32.954874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2760-5a84-44c5-92d5-7de4331ed7eb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:32.955352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2760-5a84-44c5-92d5-7de4331ed7eb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:32.955466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2760-5a84-44c5-92d5-7de4331ed7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:32.998237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:33.000896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:33.033217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1e9a2760-5a84-44c5-92d5-7de4331ed7eb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:33.035363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1e9a2760-5a84-44c5-92d5-7de4331ed7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:33.211950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cc14b-6aaa-410e-986a-b196c52c4cb7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:33.230008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:33.231191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:33.232411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:33.236733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] PATH_INFO: `/v3/projects/949d330b01384fb091f743a127f26402` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:33.261831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949d330b01384fb091f743a127f26402)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:33.283406 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 1999/4000] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:33.288724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6d805-cd20-4772-afa1-fbb0afb2cad8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:33.288973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6d805-cd20-4772-afa1-fbb0afb2cad8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:33.290249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6d805-cd20-4772-afa1-fbb0afb2cad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:33.294485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:33.340052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-04f6d805-cd20-4772-afa1-fbb0afb2cad8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:33.342350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-04f6d805-cd20-4772-afa1-fbb0afb2cad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:33.376298 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2000/4001] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:33.377442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6d805-cd20-4772-afa1-fbb0afb2cad8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:33.400258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6d805-cd20-4772-afa1-fbb0afb2cad8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:33.420498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7c6a-4834-4296-9356-2ca0310aac17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:33.421099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7c6a-4834-4296-9356-2ca0310aac17 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:33.421382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7c6a-4834-4296-9356-2ca0310aac17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:33.421800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f7c6a-4834-4296-9356-2ca0310aac17 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:33.422407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f7c6a-4834-4296-9356-2ca0310aac17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:33.422706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f7c6a-4834-4296-9356-2ca0310aac17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:33.439394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f7c6a-4834-4296-9356-2ca0310aac17 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:33.482480 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2001/4002] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:56:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:56:33.487146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7c6a-4834-4296-9356-2ca0310aac17 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:33.545135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f7c6a-4834-4296-9356-2ca0310aac17 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:33.585591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949d330b01384fb091f743a127f26402', 'request_id': 'req-d6201b32-c40b-49f4-8142-09ecd4e09f07'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:33.600562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949d330b01384fb091f743a127f26402', 'request_id': 'req-d6201b32-c40b-49f4-8142-09ecd4e09f07'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:33.620453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949d330b01384fb091f743a127f26402', 'request_id': 'req-d6201b32-c40b-49f4-8142-09ecd4e09f07'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:33.632811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] The token cache is being invalidate because project 949d330b01384fb091f743a127f26402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:33.633105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:33.633968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d6201b32-c40b-49f4-8142-09ecd4e09f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:33.641432 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2002/4003] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:32 2021] DELETE /identity/v3/projects/949d330b01384fb091f743a127f26402 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:33.644018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eb6b1-61a1-489a-a1be-2550661f772a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:33.644018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eb6b1-61a1-489a-a1be-2550661f772a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:33.644207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eb6b1-61a1-489a-a1be-2550661f772a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:33.666652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-765eb6b1-61a1-489a-a1be-2550661f772a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:33.668527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-765eb6b1-61a1-489a-a1be-2550661f772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:33.753006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10f8fe-c787-49a8-be39-198df2a6bbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:33.753768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10f8fe-c787-49a8-be39-198df2a6bbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:33.754055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10f8fe-c787-49a8-be39-198df2a6bbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:33.754329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10f8fe-c787-49a8-be39-198df2a6bbe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:33.755108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10f8fe-c787-49a8-be39-198df2a6bbe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:33.760647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10f8fe-c787-49a8-be39-198df2a6bbe8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:33.779577 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2003/4004] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:33.792075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f110bf-5b4f-4ff9-a7db-13c0829063fa None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:33.792389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f110bf-5b4f-4ff9-a7db-13c0829063fa None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:33.792636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f110bf-5b4f-4ff9-a7db-13c0829063fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:33.845991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-17f110bf-5b4f-4ff9-a7db-13c0829063fa None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:33.848257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-17f110bf-5b4f-4ff9-a7db-13c0829063fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:33.865075 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2002/4005] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:33 2021] POST /identity/v3/projects => generated 367 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:33.869177 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2004/4006] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:33.869457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10f8fe-c787-49a8-be39-198df2a6bbe8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:33.872719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f110bf-5b4f-4ff9-a7db-13c0829063fa None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:33.881674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2c10f8fe-c787-49a8-be39-198df2a6bbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:33.894137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f110bf-5b4f-4ff9-a7db-13c0829063fa None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:34.007071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10f8fe-c787-49a8-be39-198df2a6bbe8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:34.013497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eac48-6143-40ac-aff4-0a5e431d8ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:34.014499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eac48-6143-40ac-aff4-0a5e431d8ebd admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.015030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eac48-6143-40ac-aff4-0a5e431d8ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.015549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eac48-6143-40ac-aff4-0a5e431d8ebd admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.015937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699b324-c1af-4062-a4d4-6558483ddea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:34.016618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699b324-c1af-4062-a4d4-6558483ddea1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.016901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699b324-c1af-4062-a4d4-6558483ddea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.017180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699b324-c1af-4062-a4d4-6558483ddea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.017701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eac48-6143-40ac-aff4-0a5e431d8ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:34.017919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699b324-c1af-4062-a4d4-6558483ddea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:34.018248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699b324-c1af-4062-a4d4-6558483ddea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:34.020529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eac48-6143-40ac-aff4-0a5e431d8ebd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:34.022451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699b324-c1af-4062-a4d4-6558483ddea1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:34.047391 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2003/4007] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:33 2021] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:56:34.051727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eac48-6143-40ac-aff4-0a5e431d8ebd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:34.054069 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2005/4008] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:56:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:34.057511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699b324-c1af-4062-a4d4-6558483ddea1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:34.071791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eac48-6143-40ac-aff4-0a5e431d8ebd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:34.079383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faa7ed-fa3d-46aa-ae50-a0034eaf5c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:34.080519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa7ed-fa3d-46aa-ae50-a0034eaf5c9f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.081338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa7ed-fa3d-46aa-ae50-a0034eaf5c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.081987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa7ed-fa3d-46aa-ae50-a0034eaf5c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.083133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faa7ed-fa3d-46aa-ae50-a0034eaf5c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:34.084934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699b324-c1af-4062-a4d4-6558483ddea1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:34.086220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faa7ed-fa3d-46aa-ae50-a0034eaf5c9f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:34.098822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec23e7-2962-4b0e-9b63-05cd4bbe698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:34.099551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec23e7-2962-4b0e-9b63-05cd4bbe698b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.099830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec23e7-2962-4b0e-9b63-05cd4bbe698b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.100109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec23e7-2962-4b0e-9b63-05cd4bbe698b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.100875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec23e7-2962-4b0e-9b63-05cd4bbe698b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:34.103072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec23e7-2962-4b0e-9b63-05cd4bbe698b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:34.107600 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2004/4009] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:34 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:34.111591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faa7ed-fa3d-46aa-ae50-a0034eaf5c9f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:34.125832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faa7ed-fa3d-46aa-ae50-a0034eaf5c9f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:34.133063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df14de-63e4-48ea-86f6-b2b4a2be645b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:34.134081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df14de-63e4-48ea-86f6-b2b4a2be645b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.134686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df14de-63e4-48ea-86f6-b2b4a2be645b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.136010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df14de-63e4-48ea-86f6-b2b4a2be645b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.137145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df14de-63e4-48ea-86f6-b2b4a2be645b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:34.139030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df14de-63e4-48ea-86f6-b2b4a2be645b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:34.155461 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2005/4010] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:34 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:34.159461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df14de-63e4-48ea-86f6-b2b4a2be645b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:34.174070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df14de-63e4-48ea-86f6-b2b4a2be645b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:34.180882 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2006/4011] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:34 2021] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:34.181974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eea058-84e2-44d9-b82b-fcbdb1f43dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:34.183289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eea058-84e2-44d9-b82b-fcbdb1f43dce admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.184462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eea058-84e2-44d9-b82b-fcbdb1f43dce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.185300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec23e7-2962-4b0e-9b63-05cd4bbe698b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:34.185614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eea058-84e2-44d9-b82b-fcbdb1f43dce admin admin] PATH_INFO: `/v3/projects/1dfbe03e6096449783e6909fbae314bc/users/3395780dcbad4113990572d4936153de/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.205922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eea058-84e2-44d9-b82b-fcbdb1f43dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfbe03e6096449783e6909fbae314bc, user_id=3395780dcbad4113990572d4936153de, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:34.210004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eea058-84e2-44d9-b82b-fcbdb1f43dce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:34.236848 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2006/4012] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:34 2021] PUT /identity/v3/projects/1dfbe03e6096449783e6909fbae314bc/users/3395780dcbad4113990572d4936153de/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:34.248701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540695a7-fce3-47dc-85e7-27213738c075 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.250703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540695a7-fce3-47dc-85e7-27213738c075 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.251180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540695a7-fce3-47dc-85e7-27213738c075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.323771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-540695a7-fce3-47dc-85e7-27213738c075 None None] MFA Rules not processed for user `3395780dcbad4113990572d4936153de`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:34.325955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-540695a7-fce3-47dc-85e7-27213738c075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:34.346383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec23e7-2962-4b0e-9b63-05cd4bbe698b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:34.521439 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2007/4013] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:34 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:34.524537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1973b73-31ef-4771-b5db-d91a87df9b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:34.526315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973b73-31ef-4771-b5db-d91a87df9b49 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.526607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973b73-31ef-4771-b5db-d91a87df9b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.526887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973b73-31ef-4771-b5db-d91a87df9b49 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.527723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1973b73-31ef-4771-b5db-d91a87df9b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:34.530312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540695a7-fce3-47dc-85e7-27213738c075 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:34.533013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1973b73-31ef-4771-b5db-d91a87df9b49 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:34.535458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-540695a7-fce3-47dc-85e7-27213738c075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:34.583913 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2007/4014] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:34 2021] POST /identity/v3/users => generated 290 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:56:34.587622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1973b73-31ef-4771-b5db-d91a87df9b49 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:34.608997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1973b73-31ef-4771-b5db-d91a87df9b49 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:34.626768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e883908-291d-4043-9bd2-478fbb854eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:34.627793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e883908-291d-4043-9bd2-478fbb854eef admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.628078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e883908-291d-4043-9bd2-478fbb854eef admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.628357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e883908-291d-4043-9bd2-478fbb854eef admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.629105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e883908-291d-4043-9bd2-478fbb854eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:34.631734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e883908-291d-4043-9bd2-478fbb854eef admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:34.657027 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2008/4015] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:34 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:34.661240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e883908-291d-4043-9bd2-478fbb854eef admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:34.670761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540695a7-fce3-47dc-85e7-27213738c075 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:34.682027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40134b15-5ccf-41c9-8901-25871437c21e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:34.682767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40134b15-5ccf-41c9-8901-25871437c21e service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.684969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e883908-291d-4043-9bd2-478fbb854eef admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:34.686760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40134b15-5ccf-41c9-8901-25871437c21e service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.687196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40134b15-5ccf-41c9-8901-25871437c21e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.700706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317ae2a-b661-48c7-9063-3101084a6164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:34.701080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ae2a-b661-48c7-9063-3101084a6164 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.701367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ae2a-b661-48c7-9063-3101084a6164 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.701645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ae2a-b661-48c7-9063-3101084a6164 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.702388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317ae2a-b661-48c7-9063-3101084a6164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:34.710413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40134b15-5ccf-41c9-8901-25871437c21e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:34.711819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40134b15-5ccf-41c9-8901-25871437c21e service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:34.713717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317ae2a-b661-48c7-9063-3101084a6164 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:34.736553 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2009/4016] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:34 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:34.742376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317ae2a-b661-48c7-9063-3101084a6164 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:34.752133 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2008/4017] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:34 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:34.766755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317ae2a-b661-48c7-9063-3101084a6164 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:34.772336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d15324-fdc0-4ff7-8e64-4a83a2c31c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:34.773323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d15324-fdc0-4ff7-8e64-4a83a2c31c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.773647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d15324-fdc0-4ff7-8e64-4a83a2c31c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.773925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d15324-fdc0-4ff7-8e64-4a83a2c31c54 admin admin] PATH_INFO: `/v3/projects/376670c463284dec902268e55ba60b72/users/ed87ef17973a49f2a9108bdfbff65415/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.793158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d15324-fdc0-4ff7-8e64-4a83a2c31c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=376670c463284dec902268e55ba60b72, user_id=ed87ef17973a49f2a9108bdfbff65415, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:34.800357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d15324-fdc0-4ff7-8e64-4a83a2c31c54 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:34.826223 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2010/4018] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:34 2021] PUT /identity/v3/projects/376670c463284dec902268e55ba60b72/users/ed87ef17973a49f2a9108bdfbff65415/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:34.831378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf818c65-1279-412e-a6a7-3ebd4070079c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:34.832101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf818c65-1279-412e-a6a7-3ebd4070079c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:34.832101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf818c65-1279-412e-a6a7-3ebd4070079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:34.873669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bf818c65-1279-412e-a6a7-3ebd4070079c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:34.874924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bf818c65-1279-412e-a6a7-3ebd4070079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:35.040584 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2009/4019] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:35.054187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d15324-fdc0-4ff7-8e64-4a83a2c31c54 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:35.057506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a0d15324-fdc0-4ff7-8e64-4a83a2c31c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:35.095490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4129c1a-faf7-4017-8232-001e8c2b1b80 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:35.095790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4129c1a-faf7-4017-8232-001e8c2b1b80 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:35.096378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4129c1a-faf7-4017-8232-001e8c2b1b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:35.150982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b4129c1a-faf7-4017-8232-001e8c2b1b80 None None] MFA Rules not processed for user `dcb3f0e11efd43278f9c4c34f7eda52d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:35.153362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b4129c1a-faf7-4017-8232-001e8c2b1b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:35.166391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d15324-fdc0-4ff7-8e64-4a83a2c31c54 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:35.178520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20050a27-5345-49eb-a1e7-aa1f79384587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:35.179314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20050a27-5345-49eb-a1e7-aa1f79384587 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:35.179599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20050a27-5345-49eb-a1e7-aa1f79384587 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:35.179870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20050a27-5345-49eb-a1e7-aa1f79384587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:35.200674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20050a27-5345-49eb-a1e7-aa1f79384587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:35.202153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20050a27-5345-49eb-a1e7-aa1f79384587 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:35.224309 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2011/4020] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:35.333457 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2010/4021] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:35 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:35.342740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20050a27-5345-49eb-a1e7-aa1f79384587 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:35.344651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-20050a27-5345-49eb-a1e7-aa1f79384587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:35.478428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20050a27-5345-49eb-a1e7-aa1f79384587 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:35.485921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6737d89-bd01-4365-a221-bb89ab615d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:35.486597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737d89-bd01-4365-a221-bb89ab615d4f service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:35.486887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737d89-bd01-4365-a221-bb89ab615d4f service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:35.487214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6737d89-bd01-4365-a221-bb89ab615d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:35.498187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6737d89-bd01-4365-a221-bb89ab615d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:35.499909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6737d89-bd01-4365-a221-bb89ab615d4f service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:35.512846 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2012/4022] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:35 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:36.753051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43213944-becc-4275-9d87-9d59118583fc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:36.753588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43213944-becc-4275-9d87-9d59118583fc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:36.753588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43213944-becc-4275-9d87-9d59118583fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:36.807766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-43213944-becc-4275-9d87-9d59118583fc None None] MFA Rules not processed for user `ed87ef17973a49f2a9108bdfbff65415`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:36.809290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-43213944-becc-4275-9d87-9d59118583fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:36.950010 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2011/4023] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:36 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:36.963560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e871f6-b960-4166-8b5d-3e3ed21c1dd0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:36.964184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e871f6-b960-4166-8b5d-3e3ed21c1dd0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:36.964184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e871f6-b960-4166-8b5d-3e3ed21c1dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:37.005370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-79e871f6-b960-4166-8b5d-3e3ed21c1dd0 None None] MFA Rules not processed for user `ed87ef17973a49f2a9108bdfbff65415`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:37.023725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-79e871f6-b960-4166-8b5d-3e3ed21c1dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:37.058215 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2013/4024] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:36 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:37.073807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43213944-becc-4275-9d87-9d59118583fc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:37.075354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-43213944-becc-4275-9d87-9d59118583fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:37.119193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43213944-becc-4275-9d87-9d59118583fc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:37.154812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a960d7-1eb8-4904-82bd-b5a154b568aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:37.155901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a960d7-1eb8-4904-82bd-b5a154b568aa service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:37.156610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a960d7-1eb8-4904-82bd-b5a154b568aa service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:37.157105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a960d7-1eb8-4904-82bd-b5a154b568aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:37.178648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a960d7-1eb8-4904-82bd-b5a154b568aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:37.181162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a960d7-1eb8-4904-82bd-b5a154b568aa service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:37.223046 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2012/4025] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:37 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:38.336679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e871f6-b960-4166-8b5d-3e3ed21c1dd0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:38.338804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-79e871f6-b960-4166-8b5d-3e3ed21c1dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:38.376416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e871f6-b960-4166-8b5d-3e3ed21c1dd0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:38.388523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046df15-23bc-48d2-9e76-2d8ef9ecbb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:38.389682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046df15-23bc-48d2-9e76-2d8ef9ecbb3a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:38.392204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046df15-23bc-48d2-9e76-2d8ef9ecbb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:38.392745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046df15-23bc-48d2-9e76-2d8ef9ecbb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:38.406313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a046df15-23bc-48d2-9e76-2d8ef9ecbb3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:38.639314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046df15-23bc-48d2-9e76-2d8ef9ecbb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:38.644597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046df15-23bc-48d2-9e76-2d8ef9ecbb3a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:38.675982 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2014/4026] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:38 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:40.832532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a960d7-1eb8-4904-82bd-b5a154b568aa service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:40.834624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-46a960d7-1eb8-4904-82bd-b5a154b568aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:40.876180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a960d7-1eb8-4904-82bd-b5a154b568aa service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:40.899203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b3613-b30e-4177-a175-709671385305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:40.900786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3613-b30e-4177-a175-709671385305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:40.901274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3613-b30e-4177-a175-709671385305 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:40.901807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3613-b30e-4177-a175-709671385305 admin admin] PATH_INFO: `/v3/users/18b2bfa328264fb39c380fe21eae79cc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:40.904888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b3613-b30e-4177-a175-709671385305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b2bfa328264fb39c380fe21eae79cc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:40.907101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b3613-b30e-4177-a175-709671385305 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:41.009763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-da7b3613-b30e-4177-a175-709671385305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b2bfa328264fb39c380fe21eae79cc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:41.022742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-da7b3613-b30e-4177-a175-709671385305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b2bfa328264fb39c380fe21eae79cc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:41.023907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-da7b3613-b30e-4177-a175-709671385305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b2bfa328264fb39c380fe21eae79cc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:41.033415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-da7b3613-b30e-4177-a175-709671385305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b2bfa328264fb39c380fe21eae79cc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:41.052404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-da7b3613-b30e-4177-a175-709671385305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b2bfa328264fb39c380fe21eae79cc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:41.063360 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2013/4027] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:40 2021] DELETE /identity/v3/users/18b2bfa328264fb39c380fe21eae79cc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:41.977961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046df15-23bc-48d2-9e76-2d8ef9ecbb3a service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:41.993471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046df15-23bc-48d2-9e76-2d8ef9ecbb3a service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:42.144715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:42.145639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:42.146131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:42.146559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] PATH_INFO: `/v3/projects/4e0000db558e40a5a68130b07178b447` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:42.149655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0000db558e40a5a68130b07178b447)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:42.154852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:42.290582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0000db558e40a5a68130b07178b447', 'request_id': 'req-cd5a048b-42de-4df9-acb3-913713fac5ed'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:42.301074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0000db558e40a5a68130b07178b447', 'request_id': 'req-cd5a048b-42de-4df9-acb3-913713fac5ed'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:42.315719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0000db558e40a5a68130b07178b447', 'request_id': 'req-cd5a048b-42de-4df9-acb3-913713fac5ed'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:42.334317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] The token cache is being invalidate because project 4e0000db558e40a5a68130b07178b447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:42.335210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:42.337878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd5a048b-42de-4df9-acb3-913713fac5ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:42.346953 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2015/4028] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:41 2021] DELETE /identity/v3/projects/4e0000db558e40a5a68130b07178b447 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:42.350010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2405318-1088-44d2-aa12-1ab04b349ae9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:42.350765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2405318-1088-44d2-aa12-1ab04b349ae9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:42.350765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2405318-1088-44d2-aa12-1ab04b349ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:42.396731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b2405318-1088-44d2-aa12-1ab04b349ae9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:42.401431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b2405318-1088-44d2-aa12-1ab04b349ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:42.418577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0445b8-6844-44a3-ba93-dcebfdd1c72f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:42.419231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0445b8-6844-44a3-ba93-dcebfdd1c72f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:42.419864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0445b8-6844-44a3-ba93-dcebfdd1c72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:42.504102 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2014/4029] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:42.515721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a1dfa-1299-406a-b8b2-d4c991a16d98 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:42.516115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a1dfa-1299-406a-b8b2-d4c991a16d98 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:42.516394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a1dfa-1299-406a-b8b2-d4c991a16d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:42.520619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8d0445b8-6844-44a3-ba93-dcebfdd1c72f None None] MFA Rules not processed for user `dcb3f0e11efd43278f9c4c34f7eda52d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:42.524334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8d0445b8-6844-44a3-ba93-dcebfdd1c72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:42.562600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7d8a1dfa-1299-406a-b8b2-d4c991a16d98 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:42.565939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7d8a1dfa-1299-406a-b8b2-d4c991a16d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:42.584805 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2015/4030] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:42.592807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a1dfa-1299-406a-b8b2-d4c991a16d98 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:42.629004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a1dfa-1299-406a-b8b2-d4c991a16d98 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:42.652640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6466-3218-4beb-a83c-b8fa729903ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:42.653419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6466-3218-4beb-a83c-b8fa729903ae admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:42.653794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6466-3218-4beb-a83c-b8fa729903ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:42.654130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6466-3218-4beb-a83c-b8fa729903ae admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:42.654992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c6466-3218-4beb-a83c-b8fa729903ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:42.655324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c6466-3218-4beb-a83c-b8fa729903ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:42.657214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c6466-3218-4beb-a83c-b8fa729903ae admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:42.687441 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2016/4031] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:56:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:42.694739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6466-3218-4beb-a83c-b8fa729903ae admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:42.707946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c6466-3218-4beb-a83c-b8fa729903ae admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:42.717746 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2016/4032] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:42 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:42.718779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae263d-91b5-45c1-99d9-057396af8664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:42.720323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae263d-91b5-45c1-99d9-057396af8664 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:42.720768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae263d-91b5-45c1-99d9-057396af8664 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:42.721191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae263d-91b5-45c1-99d9-057396af8664 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:42.722214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae263d-91b5-45c1-99d9-057396af8664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:42.738450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae263d-91b5-45c1-99d9-057396af8664 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:42.822642 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2017/4033] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:42 2021] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:42.825806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0445b8-6844-44a3-ba93-dcebfdd1c72f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:42.843038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0445b8-6844-44a3-ba93-dcebfdd1c72f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:43.066895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c48cb-839f-4be2-a093-46a7b32d98b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:43.068336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c48cb-839f-4be2-a093-46a7b32d98b5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:43.069027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c48cb-839f-4be2-a093-46a7b32d98b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:43.069489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c48cb-839f-4be2-a093-46a7b32d98b5 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:43.082325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c48cb-839f-4be2-a093-46a7b32d98b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:43.092825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c48cb-839f-4be2-a093-46a7b32d98b5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:43.139434 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2017/4034] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:42 2021] POST /identity/v3/users => generated 297 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:43.144377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae263d-91b5-45c1-99d9-057396af8664 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:43.167022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae263d-91b5-45c1-99d9-057396af8664 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:43.204264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8bdca-5dd8-453d-a325-c644e6aacc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:43.207153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8bdca-5dd8-453d-a325-c644e6aacc8c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:43.208632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8bdca-5dd8-453d-a325-c644e6aacc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:43.209358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8bdca-5dd8-453d-a325-c644e6aacc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:43.213337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8bdca-5dd8-453d-a325-c644e6aacc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:43.220314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8bdca-5dd8-453d-a325-c644e6aacc8c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:43.262228 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2018/4035] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:43 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:43.264297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c48cb-839f-4be2-a093-46a7b32d98b5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:43.289507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c48cb-839f-4be2-a093-46a7b32d98b5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:43.303285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f2743-e394-4a1a-a4fb-49ccc95ac0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:43.304210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f2743-e394-4a1a-a4fb-49ccc95ac0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:43.304643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f2743-e394-4a1a-a4fb-49ccc95ac0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:43.305164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f2743-e394-4a1a-a4fb-49ccc95ac0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:43.307245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f2743-e394-4a1a-a4fb-49ccc95ac0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:43.313232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f2743-e394-4a1a-a4fb-49ccc95ac0c0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:43.344723 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2018/4036] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:43 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:43.347881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8bdca-5dd8-453d-a325-c644e6aacc8c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:43.361331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8bdca-5dd8-453d-a325-c644e6aacc8c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:43.369857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8a838-5682-47df-b92d-be1d64e4b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:43.397149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a838-5682-47df-b92d-be1d64e4b586 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:43.399712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a838-5682-47df-b92d-be1d64e4b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:43.400497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8a838-5682-47df-b92d-be1d64e4b586 admin admin] PATH_INFO: `/v3/projects/ea113326fcea4903b6f63e84c0339fa7/users/d83a3fe020954cddb42864198a20ea9d/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:43.445658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8a838-5682-47df-b92d-be1d64e4b586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea113326fcea4903b6f63e84c0339fa7, user_id=d83a3fe020954cddb42864198a20ea9d, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:43.454932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8a838-5682-47df-b92d-be1d64e4b586 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:43.501971 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2019/4037] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:43 2021] PUT /identity/v3/projects/ea113326fcea4903b6f63e84c0339fa7/users/d83a3fe020954cddb42864198a20ea9d/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:43.507220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eb001-bbb5-4dc3-807e-5c2e98be4527 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:43.507900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eb001-bbb5-4dc3-807e-5c2e98be4527 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:43.508528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eb001-bbb5-4dc3-807e-5c2e98be4527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:43.545019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0a7eb001-bbb5-4dc3-807e-5c2e98be4527 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:43.551878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0a7eb001-bbb5-4dc3-807e-5c2e98be4527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:43.703746 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2019/4038] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:43.718735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8a838-5682-47df-b92d-be1d64e4b586 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:43.721936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b8e8a838-5682-47df-b92d-be1d64e4b586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:43.910873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8a838-5682-47df-b92d-be1d64e4b586 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:43.919208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00efbf-7613-4967-858e-6a57832e2cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:43.919893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00efbf-7613-4967-858e-6a57832e2cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:43.920297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00efbf-7613-4967-858e-6a57832e2cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:43.920540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00efbf-7613-4967-858e-6a57832e2cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:43.959229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00efbf-7613-4967-858e-6a57832e2cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:43.960867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00efbf-7613-4967-858e-6a57832e2cc0 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:43.982258 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2020/4039] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:45.545274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee370b1-5cbc-49cd-ac2a-5b6c9d087a32 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:45.545839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee370b1-5cbc-49cd-ac2a-5b6c9d087a32 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:45.545839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee370b1-5cbc-49cd-ac2a-5b6c9d087a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:45.593026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-eee370b1-5cbc-49cd-ac2a-5b6c9d087a32 None None] MFA Rules not processed for user `8a6b24888695498b9b368d5f906b0926`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:45.594915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eee370b1-5cbc-49cd-ac2a-5b6c9d087a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:45.796770 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2020/4040] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:45 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:45.812746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00efbf-7613-4967-858e-6a57832e2cc0 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:45.817904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ca00efbf-7613-4967-858e-6a57832e2cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:45.949383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00efbf-7613-4967-858e-6a57832e2cc0 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:45.956400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac905f-60c4-44a6-8504-291ee16b5518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:45.957503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac905f-60c4-44a6-8504-291ee16b5518 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:45.957928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac905f-60c4-44a6-8504-291ee16b5518 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:45.958539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac905f-60c4-44a6-8504-291ee16b5518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:45.961928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a6ac905f-60c4-44a6-8504-291ee16b5518 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:46.135788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac905f-60c4-44a6-8504-291ee16b5518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:46.137392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac905f-60c4-44a6-8504-291ee16b5518 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:46.159995 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2021/4041] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:45 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:46.934193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee370b1-5cbc-49cd-ac2a-5b6c9d087a32 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:46.940601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eee370b1-5cbc-49cd-ac2a-5b6c9d087a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:46.967918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee370b1-5cbc-49cd-ac2a-5b6c9d087a32 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:46.986496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:46.989555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:46.989861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:46.990167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] PATH_INFO: `/v3/users/3395780dcbad4113990572d4936153de` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:46.991586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3395780dcbad4113990572d4936153de)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:46.995211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:47.147084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3395780dcbad4113990572d4936153de'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:47.149656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3395780dcbad4113990572d4936153de'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:47.176568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3395780dcbad4113990572d4936153de'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:47.177444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3395780dcbad4113990572d4936153de'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:47.228976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3395780dcbad4113990572d4936153de'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:47.314512 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2021/4042] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:46 2021] DELETE /identity/v3/users/3395780dcbad4113990572d4936153de => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:47.319092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d69599-48ea-47ab-92b3-4851d165c347 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:47.319995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d69599-48ea-47ab-92b3-4851d165c347 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:47.320269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d69599-48ea-47ab-92b3-4851d165c347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:47.384837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-20d69599-48ea-47ab-92b3-4851d165c347 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:47.392201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-20d69599-48ea-47ab-92b3-4851d165c347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:47.551813 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2022/4043] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:47.593324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:47.596571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:47.722591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963dbab-8653-4bef-9b3e-04ac902e02a4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:47.733415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61476ec2-80e2-4175-9135-bd34d8eb94c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:47.734119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61476ec2-80e2-4175-9135-bd34d8eb94c1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:47.734438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61476ec2-80e2-4175-9135-bd34d8eb94c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:47.734744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61476ec2-80e2-4175-9135-bd34d8eb94c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:47.757641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61476ec2-80e2-4175-9135-bd34d8eb94c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:47.759998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61476ec2-80e2-4175-9135-bd34d8eb94c1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:47.772723 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2022/4044] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:48.992499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d69599-48ea-47ab-92b3-4851d165c347 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:48.994946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-20d69599-48ea-47ab-92b3-4851d165c347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:49.039631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d69599-48ea-47ab-92b3-4851d165c347 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:49.059511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:49.060720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:49.061191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:49.061613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] PATH_INFO: `/v3/projects/1dfbe03e6096449783e6909fbae314bc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:49.063350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dfbe03e6096449783e6909fbae314bc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:49.066546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:49.291703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dfbe03e6096449783e6909fbae314bc', 'request_id': 'req-05b3db14-b523-4a27-aaf7-a88c47f859ef'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:49.314192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dfbe03e6096449783e6909fbae314bc', 'request_id': 'req-05b3db14-b523-4a27-aaf7-a88c47f859ef'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:49.336071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dfbe03e6096449783e6909fbae314bc', 'request_id': 'req-05b3db14-b523-4a27-aaf7-a88c47f859ef'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:49.379589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] The token cache is being invalidate because project 1dfbe03e6096449783e6909fbae314bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:49.380007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:49.380822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-05b3db14-b523-4a27-aaf7-a88c47f859ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:49.382203 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2023/4045] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:48 2021] DELETE /identity/v3/projects/1dfbe03e6096449783e6909fbae314bc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:49.393480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2861d-4bae-4d24-be91-5e16e836e8a9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:49.395578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2861d-4bae-4d24-be91-5e16e836e8a9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:49.396587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2861d-4bae-4d24-be91-5e16e836e8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:49.436710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-94b2861d-4bae-4d24-be91-5e16e836e8a9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:49.439636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-94b2861d-4bae-4d24-be91-5e16e836e8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:49.584071 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2023/4046] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:49.584899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe4b1-ced9-4bb8-afb2-c0617c5384c8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:49.585249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe4b1-ced9-4bb8-afb2-c0617c5384c8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:49.585568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe4b1-ced9-4bb8-afb2-c0617c5384c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:49.641984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c1efe4b1-ced9-4bb8-afb2-c0617c5384c8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:49.653634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c1efe4b1-ced9-4bb8-afb2-c0617c5384c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:49.684485 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2024/4047] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:49.691637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2861d-4bae-4d24-be91-5e16e836e8a9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:49.713094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2861d-4bae-4d24-be91-5e16e836e8a9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:49.730163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c9764-2f3f-476e-9a44-203e050d9d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:49.736520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c9764-2f3f-476e-9a44-203e050d9d51 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:49.736867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c9764-2f3f-476e-9a44-203e050d9d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:49.737150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c9764-2f3f-476e-9a44-203e050d9d51 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:49.738058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c9764-2f3f-476e-9a44-203e050d9d51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:49.742828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c9764-2f3f-476e-9a44-203e050d9d51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:49.748661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c9764-2f3f-476e-9a44-203e050d9d51 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:49.787190 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2024/4048] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:56:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:49.789189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efe4b1-ced9-4bb8-afb2-c0617c5384c8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:49.804592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efe4b1-ced9-4bb8-afb2-c0617c5384c8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:49.821841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f385a-a90e-4f13-964b-cbe2362c8cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:49.822978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f385a-a90e-4f13-964b-cbe2362c8cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:49.824908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f385a-a90e-4f13-964b-cbe2362c8cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:49.825387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f385a-a90e-4f13-964b-cbe2362c8cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:49.826996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f385a-a90e-4f13-964b-cbe2362c8cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:49.833503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f385a-a90e-4f13-964b-cbe2362c8cd2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:49.969765 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2025/4049] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:49 2021] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:56:49.970133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c9764-2f3f-476e-9a44-203e050d9d51 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:49.994490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c9764-2f3f-476e-9a44-203e050d9d51 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:50.243020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aacaf-ac4c-4de8-bb11-ba8767bf0726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:50.248195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aacaf-ac4c-4de8-bb11-ba8767bf0726 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:50.249013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aacaf-ac4c-4de8-bb11-ba8767bf0726 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:50.249671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aacaf-ac4c-4de8-bb11-ba8767bf0726 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:50.254908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aacaf-ac4c-4de8-bb11-ba8767bf0726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:50.271907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aacaf-ac4c-4de8-bb11-ba8767bf0726 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:50.367342 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2025/4050] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:49 2021] POST /identity/v3/users => generated 286 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:50.372861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f385a-a90e-4f13-964b-cbe2362c8cd2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:50.401131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f385a-a90e-4f13-964b-cbe2362c8cd2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:50.417501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbe9fe-5896-4911-b090-de01331a6332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:50.418936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbe9fe-5896-4911-b090-de01331a6332 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:50.420707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbe9fe-5896-4911-b090-de01331a6332 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:50.421753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbe9fe-5896-4911-b090-de01331a6332 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:50.434225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbe9fe-5896-4911-b090-de01331a6332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:50.436977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbe9fe-5896-4911-b090-de01331a6332 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:50.471840 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2026/4051] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:50 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:50.472771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aacaf-ac4c-4de8-bb11-ba8767bf0726 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:50.501182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aacaf-ac4c-4de8-bb11-ba8767bf0726 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:50.512799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10abe0-463b-43fd-af1a-7c3b132d2026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:50.513504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10abe0-463b-43fd-af1a-7c3b132d2026 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:50.514700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10abe0-463b-43fd-af1a-7c3b132d2026 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:50.515598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10abe0-463b-43fd-af1a-7c3b132d2026 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:50.516637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10abe0-463b-43fd-af1a-7c3b132d2026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:50.527054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10abe0-463b-43fd-af1a-7c3b132d2026 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:50.564468 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2026/4052] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:50 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:56:50.585501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbe9fe-5896-4911-b090-de01331a6332 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:50.620894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbe9fe-5896-4911-b090-de01331a6332 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:50.630196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a19aa-95bd-4c8b-8988-1e274323afd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:50.633444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a19aa-95bd-4c8b-8988-1e274323afd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:50.634126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a19aa-95bd-4c8b-8988-1e274323afd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:50.634764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a19aa-95bd-4c8b-8988-1e274323afd5 admin admin] PATH_INFO: `/v3/projects/2d83af57b54a4447a95c70884c32042b/users/9ffb4c7354984f1d93b22266b1c80374/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:50.672021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a19aa-95bd-4c8b-8988-1e274323afd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d83af57b54a4447a95c70884c32042b, user_id=9ffb4c7354984f1d93b22266b1c80374, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:50.675907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a19aa-95bd-4c8b-8988-1e274323afd5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:50.727300 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2027/4053] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:50 2021] PUT /identity/v3/projects/2d83af57b54a4447a95c70884c32042b/users/9ffb4c7354984f1d93b22266b1c80374/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:50.727791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95017575-0f6d-4e33-86d9-bc02a2b2bd45 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:50.728299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95017575-0f6d-4e33-86d9-bc02a2b2bd45 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:50.728980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95017575-0f6d-4e33-86d9-bc02a2b2bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:50.805785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-95017575-0f6d-4e33-86d9-bc02a2b2bd45 None None] MFA Rules not processed for user `9ffb4c7354984f1d93b22266b1c80374`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:50.807440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-95017575-0f6d-4e33-86d9-bc02a2b2bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:50.986228 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2027/4054] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:50 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:50.990883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a19aa-95bd-4c8b-8988-1e274323afd5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:51.174656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a19aa-95bd-4c8b-8988-1e274323afd5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:51.195716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f21935-b134-4e5c-a7b1-d1e8a3df4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:51.197128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f21935-b134-4e5c-a7b1-d1e8a3df4f8e admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:51.197314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f21935-b134-4e5c-a7b1-d1e8a3df4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:51.197589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f21935-b134-4e5c-a7b1-d1e8a3df4f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:51.198337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f21935-b134-4e5c-a7b1-d1e8a3df4f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:51.200318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f21935-b134-4e5c-a7b1-d1e8a3df4f8e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:51.312961 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2028/4055] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:50 2021] POST /identity/v3/projects => generated 373 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:51.314225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95017575-0f6d-4e33-86d9-bc02a2b2bd45 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:51.336086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95017575-0f6d-4e33-86d9-bc02a2b2bd45 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:51.477349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ced47-c376-4a33-9268-79606f7540d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:51.478793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ced47-c376-4a33-9268-79606f7540d5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:51.478891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ced47-c376-4a33-9268-79606f7540d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:51.479151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ced47-c376-4a33-9268-79606f7540d5 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:51.479947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ced47-c376-4a33-9268-79606f7540d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:51.482139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ced47-c376-4a33-9268-79606f7540d5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:51.521850 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2028/4056] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:51 2021] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:51.526470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f21935-b134-4e5c-a7b1-d1e8a3df4f8e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:51.545011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f21935-b134-4e5c-a7b1-d1e8a3df4f8e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:51.579278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52206f8f-1349-41af-8054-20cf4ea11029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:51.580231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52206f8f-1349-41af-8054-20cf4ea11029 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:51.580671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52206f8f-1349-41af-8054-20cf4ea11029 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:51.581600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52206f8f-1349-41af-8054-20cf4ea11029 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:51.583175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52206f8f-1349-41af-8054-20cf4ea11029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:51.607962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52206f8f-1349-41af-8054-20cf4ea11029 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:51.635276 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2029/4057] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:51 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:51.637169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ced47-c376-4a33-9268-79606f7540d5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:51.651802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ced47-c376-4a33-9268-79606f7540d5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:51.667894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f152a68-d15a-42f9-9b81-3b75aa0c4582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:51.673036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f152a68-d15a-42f9-9b81-3b75aa0c4582 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:51.674589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f152a68-d15a-42f9-9b81-3b75aa0c4582 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:51.675361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f152a68-d15a-42f9-9b81-3b75aa0c4582 admin admin] PATH_INFO: `/v3/projects/f4cb973d5d49407ba12340640a42cd48/users/dab7f245f3244bec8ed31e108478215c/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:51.721856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f152a68-d15a-42f9-9b81-3b75aa0c4582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cb973d5d49407ba12340640a42cd48, user_id=dab7f245f3244bec8ed31e108478215c, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:51.732355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f152a68-d15a-42f9-9b81-3b75aa0c4582 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:51.789141 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2029/4058] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:51 2021] PUT /identity/v3/projects/f4cb973d5d49407ba12340640a42cd48/users/dab7f245f3244bec8ed31e108478215c/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:51.790218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52206f8f-1349-41af-8054-20cf4ea11029 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:51.811297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52206f8f-1349-41af-8054-20cf4ea11029 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:51.948589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810f7f8-a713-4b4c-8e23-811a9b3e8a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:51.949500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810f7f8-a713-4b4c-8e23-811a9b3e8a44 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:51.949973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810f7f8-a713-4b4c-8e23-811a9b3e8a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:51.950397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810f7f8-a713-4b4c-8e23-811a9b3e8a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:51.951525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810f7f8-a713-4b4c-8e23-811a9b3e8a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:51.953588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810f7f8-a713-4b4c-8e23-811a9b3e8a44 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:51.972900 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2030/4059] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:56:51 2021] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:56:51.977325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f152a68-d15a-42f9-9b81-3b75aa0c4582 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:51.997775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f152a68-d15a-42f9-9b81-3b75aa0c4582 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:52.009697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce0965-2957-493a-9c50-a7c6d4ad23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:52.010639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce0965-2957-493a-9c50-a7c6d4ad23fe admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:52.011176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce0965-2957-493a-9c50-a7c6d4ad23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:52.011502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce0965-2957-493a-9c50-a7c6d4ad23fe admin admin] PATH_INFO: `/v3/projects/f4cb973d5d49407ba12340640a42cd48/users/dab7f245f3244bec8ed31e108478215c/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:52.017001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce0965-2957-493a-9c50-a7c6d4ad23fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cb973d5d49407ba12340640a42cd48, user_id=dab7f245f3244bec8ed31e108478215c, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:52.021629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce0965-2957-493a-9c50-a7c6d4ad23fe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:52.042775 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2030/4060] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:56:51 2021] PUT /identity/v3/projects/f4cb973d5d49407ba12340640a42cd48/users/dab7f245f3244bec8ed31e108478215c/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:52.053564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe113cb-55d5-419c-afb9-936738cba6c8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:52.053943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe113cb-55d5-419c-afb9-936738cba6c8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:52.054229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe113cb-55d5-419c-afb9-936738cba6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:52.109005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-afe113cb-55d5-419c-afb9-936738cba6c8 None None] MFA Rules not processed for user `dab7f245f3244bec8ed31e108478215c`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:52.112904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-afe113cb-55d5-419c-afb9-936738cba6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:52.319469 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2031/4061] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:52 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:56:52.324932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce0965-2957-493a-9c50-a7c6d4ad23fe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:52.339122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce0965-2957-493a-9c50-a7c6d4ad23fe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:52.353124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe0410-222f-4d0e-bece-ff3bdb34f824 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:52.353753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe0410-222f-4d0e-bece-ff3bdb34f824 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:52.354032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe0410-222f-4d0e-bece-ff3bdb34f824 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:52.354306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe0410-222f-4d0e-bece-ff3bdb34f824 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:52.355059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe0410-222f-4d0e-bece-ff3bdb34f824 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:52.357791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe0410-222f-4d0e-bece-ff3bdb34f824 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:52.382812 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2031/4062] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:56:52 2021] POST /identity/v3/domains => generated 276 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:52.388674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe113cb-55d5-419c-afb9-936738cba6c8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:52.403044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe113cb-55d5-419c-afb9-936738cba6c8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:52.573090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac53f14-f895-4c6b-affd-fcf58dc7d8ce tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:52.577249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53f14-f895-4c6b-affd-fcf58dc7d8ce tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:52.578270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53f14-f895-4c6b-affd-fcf58dc7d8ce tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:52.578727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac53f14-f895-4c6b-affd-fcf58dc7d8ce tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:52.580000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac53f14-f895-4c6b-affd-fcf58dc7d8ce tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:52.583891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac53f14-f895-4c6b-affd-fcf58dc7d8ce tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:52.663647 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2032/4063] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:52 2021] POST /identity/v3/projects => generated 401 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:52.671964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe0410-222f-4d0e-bece-ff3bdb34f824 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:52.705186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe0410-222f-4d0e-bece-ff3bdb34f824 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:52.938084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11efbe-a024-441a-b78b-e102f17ebc32 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:52.938919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11efbe-a024-441a-b78b-e102f17ebc32 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:52.939464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11efbe-a024-441a-b78b-e102f17ebc32 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:52.939831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11efbe-a024-441a-b78b-e102f17ebc32 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/groups` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:52.943905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11efbe-a024-441a-b78b-e102f17ebc32 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:52.953890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11efbe-a024-441a-b78b-e102f17ebc32 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:52.978531 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2032/4064] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:56:52 2021] POST /identity/v3/groups => generated 301 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:52.982806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac53f14-f895-4c6b-affd-fcf58dc7d8ce tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:53.022031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac53f14-f895-4c6b-affd-fcf58dc7d8ce tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:53.053420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211e45f-4294-4904-9e7e-d9bbd048a943 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:53.058800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211e45f-4294-4904-9e7e-d9bbd048a943 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:53.061333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211e45f-4294-4904-9e7e-d9bbd048a943 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:53.061660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211e45f-4294-4904-9e7e-d9bbd048a943 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:53.065527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211e45f-4294-4904-9e7e-d9bbd048a943 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:53.075789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211e45f-4294-4904-9e7e-d9bbd048a943 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:53.134205 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2033/4065] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:56:52 2021] POST /identity/v3/users => generated 442 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:56:53.137085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11efbe-a024-441a-b78b-e102f17ebc32 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:53.181889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11efbe-a024-441a-b78b-e102f17ebc32 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:53.201905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36219d-1971-437b-ba1c-133196a51ea7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:53.202684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36219d-1971-437b-ba1c-133196a51ea7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:53.202966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36219d-1971-437b-ba1c-133196a51ea7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:53.206770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36219d-1971-437b-ba1c-133196a51ea7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:53.208804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36219d-1971-437b-ba1c-133196a51ea7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:53.220884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36219d-1971-437b-ba1c-133196a51ea7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:53.268868 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2033/4066] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:56:53 2021] POST /identity/v3/roles => generated 240 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:53.271750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211e45f-4294-4904-9e7e-d9bbd048a943 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:53.292731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211e45f-4294-4904-9e7e-d9bbd048a943 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:53.326826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcf051-4331-4fec-919d-6346cc036838 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:53.332476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf051-4331-4fec-919d-6346cc036838 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:53.335806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf051-4331-4fec-919d-6346cc036838 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:53.336228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcf051-4331-4fec-919d-6346cc036838 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/6100b4e8201c42fe91713b97d0a4887a/inherited_to_projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:53.364335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcf051-4331-4fec-919d-6346cc036838 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_grant(project_id=656d29c33a384b7d9e26b9f8570abaff, group_id=fbdcd1c12a8d467abd2db7c4ae6b0066, role_id=6100b4e8201c42fe91713b97d0a4887a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:53.376055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcf051-4331-4fec-919d-6346cc036838 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:53.419966 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2034/4067] 10.222.0.21 () {60 vars in 1584 bytes} [Sat Nov 27 20:56:53 2021] PUT /identity/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/6100b4e8201c42fe91713b97d0a4887a/inherited_to_projects => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:53.433110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36219d-1971-437b-ba1c-133196a51ea7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:53.461386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36219d-1971-437b-ba1c-133196a51ea7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:53.616409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17f85-376c-4faa-94d9-06ae486fabb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:53.617321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17f85-376c-4faa-94d9-06ae486fabb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:53.618910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17f85-376c-4faa-94d9-06ae486fabb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:53.619352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17f85-376c-4faa-94d9-06ae486fabb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/6100b4e8201c42fe91713b97d0a4887a/inherited_to_projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:53.626806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd17f85-376c-4faa-94d9-06ae486fabb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:check_grant(project_id=656d29c33a384b7d9e26b9f8570abaff, group_id=fbdcd1c12a8d467abd2db7c4ae6b0066, role_id=6100b4e8201c42fe91713b97d0a4887a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:53.628927 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-9dd17f85-376c-4faa-94d9-06ae486fabb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:53.628927 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:56:53.628927 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:56:53.635986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd17f85-376c-4faa-94d9-06ae486fabb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:53.662072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcf051-4331-4fec-919d-6346cc036838 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:53.662607 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2034/4068] 10.222.0.21 () {58 vars in 1566 bytes} [Sat Nov 27 20:56:53 2021] HEAD /identity/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/6100b4e8201c42fe91713b97d0a4887a/inherited_to_projects => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:53.675303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcf051-4331-4fec-919d-6346cc036838 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:53.685257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:53.688270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:53.688709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:53.689491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/6100b4e8201c42fe91713b97d0a4887a/inherited_to_projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:53.698235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=656d29c33a384b7d9e26b9f8570abaff, group_id=fbdcd1c12a8d467abd2db7c4ae6b0066, role_id=6100b4e8201c42fe91713b97d0a4887a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:53.699984 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:revoke_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:53.699984 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:56:53.699984 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:56:53.704972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:53.724871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role 6100b4e8201c42fe91713b97d0a4887a was removed from group fbdcd1c12a8d467abd2db7c4ae6b0066 on project 656d29c33a384b7d9e26b9f8570abaff. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:53.726639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:53.729252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:53.769628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17f85-376c-4faa-94d9-06ae486fabb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:53.770178 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2035/4069] 10.222.0.21 () {58 vars in 1568 bytes} [Sat Nov 27 20:56:53 2021] DELETE /identity/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/6100b4e8201c42fe91713b97d0a4887a/inherited_to_projects => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:53.772747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9dd17f85-376c-4faa-94d9-06ae486fabb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:53.798101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17f85-376c-4faa-94d9-06ae486fabb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:53.926661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:53.932614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:53.933557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:53.934032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles/6100b4e8201c42fe91713b97d0a4887a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:53.937337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6100b4e8201c42fe91713b97d0a4887a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:53.941711 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:53.941711 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:56:53.941711 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:56:53.945217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:54.078151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role 6100b4e8201c42fe91713b97d0a4887a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:54.078535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:54.083236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:54.095712 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2035/4070] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:53 2021] DELETE /identity/v3/roles/6100b4e8201c42fe91713b97d0a4887a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:54.101581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:54.113939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c18de-3b3a-453d-a784-69ee644bbd1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:54.263789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2e39e-9ac5-4493-8912-468b7253c379 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:54.265022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2e39e-9ac5-4493-8912-468b7253c379 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:54.265495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2e39e-9ac5-4493-8912-468b7253c379 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:54.265978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2e39e-9ac5-4493-8912-468b7253c379 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:54.267087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2e39e-9ac5-4493-8912-468b7253c379 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:54.269256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2e39e-9ac5-4493-8912-468b7253c379 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:54.322279 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2036/4071] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:56:54 2021] POST /identity/v3/roles => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:54.322622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:54.324661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:54.350679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb6df1-abcd-44e6-96f4-47fb43e1ac83 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:54.365152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0690138-6efb-438c-92ac-be6214142e82 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:54.369174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690138-6efb-438c-92ac-be6214142e82 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:54.369810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690138-6efb-438c-92ac-be6214142e82 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:54.370284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690138-6efb-438c-92ac-be6214142e82 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/cf66d0553b30400fb3c719ecfd1aa667/inherited_to_projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:54.423981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0690138-6efb-438c-92ac-be6214142e82 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_grant(project_id=656d29c33a384b7d9e26b9f8570abaff, user_id=bbbf8d9b784b4f5a93ca16015672d8c9, role_id=cf66d0553b30400fb3c719ecfd1aa667)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:54.452292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0690138-6efb-438c-92ac-be6214142e82 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:54.482123 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2036/4072] 10.222.0.21 () {60 vars in 1581 bytes} [Sat Nov 27 20:56:54 2021] PUT /identity/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/cf66d0553b30400fb3c719ecfd1aa667/inherited_to_projects => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:54.486095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2e39e-9ac5-4493-8912-468b7253c379 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:54.502160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2e39e-9ac5-4493-8912-468b7253c379 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:54.586612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1a97a-bf03-44ae-bcea-88cbb302c8cf tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:54.589341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1a97a-bf03-44ae-bcea-88cbb302c8cf tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:54.590113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1a97a-bf03-44ae-bcea-88cbb302c8cf tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:54.590113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1a97a-bf03-44ae-bcea-88cbb302c8cf tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/cf66d0553b30400fb3c719ecfd1aa667/inherited_to_projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:54.595970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1a97a-bf03-44ae-bcea-88cbb302c8cf tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:check_grant(project_id=656d29c33a384b7d9e26b9f8570abaff, user_id=bbbf8d9b784b4f5a93ca16015672d8c9, role_id=cf66d0553b30400fb3c719ecfd1aa667)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:54.597034 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-4bd1a97a-bf03-44ae-bcea-88cbb302c8cf tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:54.597034 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:56:54.597034 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:56:54.600047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1a97a-bf03-44ae-bcea-88cbb302c8cf tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:54.615094 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2037/4073] 10.222.0.21 () {58 vars in 1563 bytes} [Sat Nov 27 20:56:54 2021] HEAD /identity/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/cf66d0553b30400fb3c719ecfd1aa667/inherited_to_projects => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:54.615726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0690138-6efb-438c-92ac-be6214142e82 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:54.646031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0690138-6efb-438c-92ac-be6214142e82 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:54.661893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:54.664140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:54.664765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:54.665521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/cf66d0553b30400fb3c719ecfd1aa667/inherited_to_projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:54.670112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=656d29c33a384b7d9e26b9f8570abaff, user_id=bbbf8d9b784b4f5a93ca16015672d8c9, role_id=cf66d0553b30400fb3c719ecfd1aa667)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:54.683025 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:revoke_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:54.683025 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:56:54.683025 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:56:54.689756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:54.708291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role cf66d0553b30400fb3c719ecfd1aa667 was removed from user bbbf8d9b784b4f5a93ca16015672d8c9 on project 656d29c33a384b7d9e26b9f8570abaff. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:54.709013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:54.710290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:54.747428 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2037/4074] 10.222.0.21 () {58 vars in 1565 bytes} [Sat Nov 27 20:56:54 2021] DELETE /identity/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/cf66d0553b30400fb3c719ecfd1aa667/inherited_to_projects => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:54.751941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1a97a-bf03-44ae-bcea-88cbb302c8cf tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:54.754559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4bd1a97a-bf03-44ae-bcea-88cbb302c8cf tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:54.771054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1a97a-bf03-44ae-bcea-88cbb302c8cf tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:54.884879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:54.886061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:54.886347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:54.886855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles/cf66d0553b30400fb3c719ecfd1aa667` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:54.889462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cf66d0553b30400fb3c719ecfd1aa667)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:54.892977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:54.964948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role cf66d0553b30400fb3c719ecfd1aa667 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:54.965167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:54.965819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:54.972799 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2038/4075] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:54 2021] DELETE /identity/v3/roles/cf66d0553b30400fb3c719ecfd1aa667 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:54.974099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:54.991056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382277e-f8fa-4650-a88e-5429d66857c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:55.168214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382707b-6274-411a-92db-b7aea415a314 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:55.169403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382707b-6274-411a-92db-b7aea415a314 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:55.170206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382707b-6274-411a-92db-b7aea415a314 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:55.170685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382707b-6274-411a-92db-b7aea415a314 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:55.171696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382707b-6274-411a-92db-b7aea415a314 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:55.173672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382707b-6274-411a-92db-b7aea415a314 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:55.204065 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2038/4076] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:56:54 2021] POST /identity/v3/roles => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:56:55.207177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:55.208805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:55.226430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcbbfc-67e3-47f4-a518-c12b768e10fc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:55.235540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d19b72-7495-4cc1-90fe-b8ca2e9c93c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:55.236860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d19b72-7495-4cc1-90fe-b8ca2e9c93c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:55.237579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d19b72-7495-4cc1-90fe-b8ca2e9c93c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:55.238098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d19b72-7495-4cc1-90fe-b8ca2e9c93c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/a76122af460a4ff4af858a5841a5ec5c/inherited_to_projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:55.244091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d19b72-7495-4cc1-90fe-b8ca2e9c93c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d8d7740e72364c499f30e50e45e6f8bd, group_id=fbdcd1c12a8d467abd2db7c4ae6b0066, role_id=a76122af460a4ff4af858a5841a5ec5c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:55.248421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d19b72-7495-4cc1-90fe-b8ca2e9c93c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:55.283954 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2039/4077] 10.222.0.21 () {60 vars in 1581 bytes} [Sat Nov 27 20:56:55 2021] PUT /identity/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/a76122af460a4ff4af858a5841a5ec5c/inherited_to_projects => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:55.288734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382707b-6274-411a-92db-b7aea415a314 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:55.312020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382707b-6274-411a-92db-b7aea415a314 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:55.476592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16e15d-d6f4-4728-b40a-2c07bf7f0cb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:55.496306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16e15d-d6f4-4728-b40a-2c07bf7f0cb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:55.497176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16e15d-d6f4-4728-b40a-2c07bf7f0cb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:55.497629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16e15d-d6f4-4728-b40a-2c07bf7f0cb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/inherited_to_projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:55.500138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16e15d-d6f4-4728-b40a-2c07bf7f0cb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=d8d7740e72364c499f30e50e45e6f8bd, group_id=fbdcd1c12a8d467abd2db7c4ae6b0066)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:55.502045 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-4c16e15d-d6f4-4728-b40a-2c07bf7f0cb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_grants failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:56:55.502045 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:56:55.502045 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:56:55.504686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16e15d-d6f4-4728-b40a-2c07bf7f0cb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:55.532717 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2039/4078] 10.222.0.21 () {58 vars in 1463 bytes} [Sat Nov 27 20:56:55 2021] GET /identity/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/inherited_to_projects => generated 448 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:55.536848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d19b72-7495-4cc1-90fe-b8ca2e9c93c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:55.550894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d19b72-7495-4cc1-90fe-b8ca2e9c93c2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:55.559024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c36c3e-d334-4c34-824d-c69213e68c44 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:55.560339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c36c3e-d334-4c34-824d-c69213e68c44 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:55.560869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c36c3e-d334-4c34-824d-c69213e68c44 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:55.561358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c36c3e-d334-4c34-824d-c69213e68c44 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/a76122af460a4ff4af858a5841a5ec5c/inherited_to_projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:55.564710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c36c3e-d334-4c34-824d-c69213e68c44 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=d8d7740e72364c499f30e50e45e6f8bd, group_id=fbdcd1c12a8d467abd2db7c4ae6b0066, role_id=a76122af460a4ff4af858a5841a5ec5c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:55.568336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c36c3e-d334-4c34-824d-c69213e68c44 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:55.584124 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2040/4079] 10.222.0.21 () {58 vars in 1563 bytes} [Sat Nov 27 20:56:55 2021] HEAD /identity/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/a76122af460a4ff4af858a5841a5ec5c/inherited_to_projects => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:55.584813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16e15d-d6f4-4728-b40a-2c07bf7f0cb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:55.604785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16e15d-d6f4-4728-b40a-2c07bf7f0cb5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:55.615786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab230268-b4b7-409e-9b5b-1ad3c64589a2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:55.617878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230268-b4b7-409e-9b5b-1ad3c64589a2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:55.618821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230268-b4b7-409e-9b5b-1ad3c64589a2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:55.619851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab230268-b4b7-409e-9b5b-1ad3c64589a2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/a76122af460a4ff4af858a5841a5ec5c/inherited_to_projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:55.630241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab230268-b4b7-409e-9b5b-1ad3c64589a2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d8d7740e72364c499f30e50e45e6f8bd, group_id=fbdcd1c12a8d467abd2db7c4ae6b0066, role_id=a76122af460a4ff4af858a5841a5ec5c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:55.635118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab230268-b4b7-409e-9b5b-1ad3c64589a2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:55.651858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ab230268-b4b7-409e-9b5b-1ad3c64589a2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role a76122af460a4ff4af858a5841a5ec5c was removed from group fbdcd1c12a8d467abd2db7c4ae6b0066 on domain d8d7740e72364c499f30e50e45e6f8bd. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:55.652673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ab230268-b4b7-409e-9b5b-1ad3c64589a2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:55.654910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ab230268-b4b7-409e-9b5b-1ad3c64589a2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:55.687365 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2040/4080] 10.222.0.21 () {58 vars in 1565 bytes} [Sat Nov 27 20:56:55 2021] DELETE /identity/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/groups/fbdcd1c12a8d467abd2db7c4ae6b0066/roles/a76122af460a4ff4af858a5841a5ec5c/inherited_to_projects => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:55.692286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c36c3e-d334-4c34-824d-c69213e68c44 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:55.694483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-18c36c3e-d334-4c34-824d-c69213e68c44 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:55.722512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c36c3e-d334-4c34-824d-c69213e68c44 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:55.892331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:55.894829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:55.896540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:55.897012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles/a76122af460a4ff4af858a5841a5ec5c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:55.901855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a76122af460a4ff4af858a5841a5ec5c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:55.907013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:56.002486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role a76122af460a4ff4af858a5841a5ec5c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:56.003050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:56.003931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:56.006163 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2041/4081] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:55 2021] DELETE /identity/v3/roles/a76122af460a4ff4af858a5841a5ec5c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:56.012115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab230268-b4b7-409e-9b5b-1ad3c64589a2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:56.032991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab230268-b4b7-409e-9b5b-1ad3c64589a2 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:56.138863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7322220-c173-4d05-93d5-11df10ddae98 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:56.146784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7322220-c173-4d05-93d5-11df10ddae98 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:56.149263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7322220-c173-4d05-93d5-11df10ddae98 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:56.150265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7322220-c173-4d05-93d5-11df10ddae98 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:56.151488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7322220-c173-4d05-93d5-11df10ddae98 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:56.154754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7322220-c173-4d05-93d5-11df10ddae98 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:56.198070 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2041/4082] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:56:56 2021] POST /identity/v3/roles => generated 239 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:56.203221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:56.209844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:56.247748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bcd40-fd29-43ac-a130-dbd0e7491cd1 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:56.267670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89651b6f-1e4c-4df3-bc96-b5c114f52235 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:56.269681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89651b6f-1e4c-4df3-bc96-b5c114f52235 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:56.270193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89651b6f-1e4c-4df3-bc96-b5c114f52235 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:56.271886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89651b6f-1e4c-4df3-bc96-b5c114f52235 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/28a9df274a0547f78720bd38cca45a51/inherited_to_projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:56.287772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89651b6f-1e4c-4df3-bc96-b5c114f52235 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d8d7740e72364c499f30e50e45e6f8bd, user_id=bbbf8d9b784b4f5a93ca16015672d8c9, role_id=28a9df274a0547f78720bd38cca45a51)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:56.292153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89651b6f-1e4c-4df3-bc96-b5c114f52235 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:56.319054 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2042/4083] 10.222.0.21 () {60 vars in 1578 bytes} [Sat Nov 27 20:56:56 2021] PUT /identity/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/28a9df274a0547f78720bd38cca45a51/inherited_to_projects => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:56.323874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7322220-c173-4d05-93d5-11df10ddae98 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:56.342201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7322220-c173-4d05-93d5-11df10ddae98 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:56.455342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43bc86-1221-4d4c-afce-be2638e7f50a tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:56.456202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43bc86-1221-4d4c-afce-be2638e7f50a tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:56.456495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43bc86-1221-4d4c-afce-be2638e7f50a tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:56.456780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43bc86-1221-4d4c-afce-be2638e7f50a tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/inherited_to_projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:56.459122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43bc86-1221-4d4c-afce-be2638e7f50a tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=d8d7740e72364c499f30e50e45e6f8bd, user_id=bbbf8d9b784b4f5a93ca16015672d8c9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:56.464037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43bc86-1221-4d4c-afce-be2638e7f50a tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:56.501096 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2042/4084] 10.222.0.21 () {58 vars in 1460 bytes} [Sat Nov 27 20:56:56 2021] GET /identity/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/inherited_to_projects => generated 446 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:56.505148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89651b6f-1e4c-4df3-bc96-b5c114f52235 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:56.523488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89651b6f-1e4c-4df3-bc96-b5c114f52235 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:56.541987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3aa17f-f9c8-4030-8c65-96186580c41a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:56.542604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3aa17f-f9c8-4030-8c65-96186580c41a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:56.542999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3aa17f-f9c8-4030-8c65-96186580c41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:56.546189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91943a-c620-42e8-8194-73c18c27b02e tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:56.547455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91943a-c620-42e8-8194-73c18c27b02e tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:56.547861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91943a-c620-42e8-8194-73c18c27b02e tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:56.548237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91943a-c620-42e8-8194-73c18c27b02e tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/28a9df274a0547f78720bd38cca45a51/inherited_to_projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:56.551400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91943a-c620-42e8-8194-73c18c27b02e tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=d8d7740e72364c499f30e50e45e6f8bd, user_id=bbbf8d9b784b4f5a93ca16015672d8c9, role_id=28a9df274a0547f78720bd38cca45a51)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:56.554727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91943a-c620-42e8-8194-73c18c27b02e tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:56.566181 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2043/4085] 10.222.0.21 () {58 vars in 1560 bytes} [Sat Nov 27 20:56:56 2021] HEAD /identity/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/28a9df274a0547f78720bd38cca45a51/inherited_to_projects => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:56.571143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91943a-c620-42e8-8194-73c18c27b02e tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:56.580869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4b3aa17f-f9c8-4030-8c65-96186580c41a None None] MFA Rules not processed for user `d83a3fe020954cddb42864198a20ea9d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:56.582434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4b3aa17f-f9c8-4030-8c65-96186580c41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:56.589718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91943a-c620-42e8-8194-73c18c27b02e tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:56.595871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:56.596952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:56.599024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:56.599805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/28a9df274a0547f78720bd38cca45a51/inherited_to_projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:56.604366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d8d7740e72364c499f30e50e45e6f8bd, user_id=bbbf8d9b784b4f5a93ca16015672d8c9, role_id=28a9df274a0547f78720bd38cca45a51)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:56.609684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:56.616866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role 28a9df274a0547f78720bd38cca45a51 was removed from user bbbf8d9b784b4f5a93ca16015672d8c9 on domain d8d7740e72364c499f30e50e45e6f8bd. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:56.617218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:56.618563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:56.635361 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2044/4086] 10.222.0.21 () {58 vars in 1562 bytes} [Sat Nov 27 20:56:56 2021] DELETE /identity/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/28a9df274a0547f78720bd38cca45a51/inherited_to_projects => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:56:56.639239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:56.641697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:56.706081 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2043/4087] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:56 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:56.721950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9889a-784a-4a0d-8417-fad5d59bb3bf None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:56.723316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9889a-784a-4a0d-8417-fad5d59bb3bf None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:56.723909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9889a-784a-4a0d-8417-fad5d59bb3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:56.757990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9db9889a-784a-4a0d-8417-fad5d59bb3bf None None] MFA Rules not processed for user `d83a3fe020954cddb42864198a20ea9d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:56:56.762797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9db9889a-784a-4a0d-8417-fad5d59bb3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:56.784610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf836b4-3e30-4eed-bd7f-e348f5188f65 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:56.800569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:56.801839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:56.802890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:56.803671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles/28a9df274a0547f78720bd38cca45a51` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:56.805701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_role(role_id=28a9df274a0547f78720bd38cca45a51)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:56.807713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:56.888716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role 28a9df274a0547f78720bd38cca45a51 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:56.889243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:56.891090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:56.896366 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2045/4088] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:56 2021] DELETE /identity/v3/roles/28a9df274a0547f78720bd38cca45a51 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:56.907666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:56.909375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:56.910578 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2044/4089] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:56:56 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:56:57.048427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed632297-0c10-4ea9-9323-5f39c9b4effe tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:57.054365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d5e97-43b1-46cb-968e-c84ff0797898 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:57.055193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d5e97-43b1-46cb-968e-c84ff0797898 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:57.056106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d5e97-43b1-46cb-968e-c84ff0797898 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:57.056434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d5e97-43b1-46cb-968e-c84ff0797898 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:57.057827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d5e97-43b1-46cb-968e-c84ff0797898 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:57.059793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d5e97-43b1-46cb-968e-c84ff0797898 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:57.085341 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2046/4090] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:56:56 2021] POST /identity/v3/roles => generated 238 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:57.090622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9889a-784a-4a0d-8417-fad5d59bb3bf None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:57.127839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9889a-784a-4a0d-8417-fad5d59bb3bf None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:57.156341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeb31f-6d14-4b47-847d-934bf711fabc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:57.158132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeb31f-6d14-4b47-847d-934bf711fabc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:57.158427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeb31f-6d14-4b47-847d-934bf711fabc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:57.159068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afeb31f-6d14-4b47-847d-934bf711fabc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:57.160059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afeb31f-6d14-4b47-847d-934bf711fabc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:57.162937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afeb31f-6d14-4b47-847d-934bf711fabc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:57.227923 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2045/4091] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:57 2021] POST /identity/v3/projects => generated 409 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:57.229740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d5e97-43b1-46cb-968e-c84ff0797898 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:57.249834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d5e97-43b1-46cb-968e-c84ff0797898 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:57.306930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeb31f-6d14-4b47-847d-934bf711fabc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:57.312537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1afeb31f-6d14-4b47-847d-934bf711fabc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:57.394814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb931c-4c8e-4e8d-89b1-da3d79a3acbb tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:57.396116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb931c-4c8e-4e8d-89b1-da3d79a3acbb tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:57.396698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb931c-4c8e-4e8d-89b1-da3d79a3acbb tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:57.397091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb931c-4c8e-4e8d-89b1-da3d79a3acbb tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/89fac63b529f4fb991cbdf1ef86927b2/inherited_to_projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:57.399975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb931c-4c8e-4e8d-89b1-da3d79a3acbb tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d8d7740e72364c499f30e50e45e6f8bd, user_id=bbbf8d9b784b4f5a93ca16015672d8c9, role_id=89fac63b529f4fb991cbdf1ef86927b2)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:57.403028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb931c-4c8e-4e8d-89b1-da3d79a3acbb tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:57.432984 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2047/4092] 10.222.0.21 () {60 vars in 1578 bytes} [Sat Nov 27 20:56:57 2021] PUT /identity/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/89fac63b529f4fb991cbdf1ef86927b2/inherited_to_projects => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:57.439539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb931c-4c8e-4e8d-89b1-da3d79a3acbb tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:57.527196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb931c-4c8e-4e8d-89b1-da3d79a3acbb tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:57.537667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78194cb-8ee9-4cd9-b15f-561846541545 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:57.538731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78194cb-8ee9-4cd9-b15f-561846541545 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:57.540348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78194cb-8ee9-4cd9-b15f-561846541545 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:57.542010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78194cb-8ee9-4cd9-b15f-561846541545 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:57.543361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78194cb-8ee9-4cd9-b15f-561846541545 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Adding query filter params (scope.project.id=656d29c33a384b7d9e26b9f8570abaff, user.id=bbbf8d9b784b4f5a93ca16015672d8c9) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:57.543679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78194cb-8ee9-4cd9-b15f-561846541545 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:57.545512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78194cb-8ee9-4cd9-b15f-561846541545 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:57.581697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afeb31f-6d14-4b47-847d-934bf711fabc tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:57.669569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1332d7-dcac-4fba-9a82-10bb7be3bfa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:57.670331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1332d7-dcac-4fba-9a82-10bb7be3bfa5 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:57.670640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1332d7-dcac-4fba-9a82-10bb7be3bfa5 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:57.670949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1332d7-dcac-4fba-9a82-10bb7be3bfa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:57.673796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bb1332d7-dcac-4fba-9a82-10bb7be3bfa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:57.756183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1332d7-dcac-4fba-9a82-10bb7be3bfa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:57.758554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1332d7-dcac-4fba-9a82-10bb7be3bfa5 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:57.762607 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2048/4093] 10.222.0.21 () {58 vars in 1355 bytes} [Sat Nov 27 20:56:57 2021] GET /identity/v3/role_assignments?scope.project.id=656d29c33a384b7d9e26b9f8570abaff&user.id=bbbf8d9b784b4f5a93ca16015672d8c9&effective => generated 648 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:57.764516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78194cb-8ee9-4cd9-b15f-561846541545 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:57.788049 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2046/4094] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:57 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:57.795117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78194cb-8ee9-4cd9-b15f-561846541545 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:57.809002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18274714-3e28-4471-832f-963301f512d5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:57.810032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18274714-3e28-4471-832f-963301f512d5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:57.810587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18274714-3e28-4471-832f-963301f512d5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:57.810794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18274714-3e28-4471-832f-963301f512d5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:57.811960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18274714-3e28-4471-832f-963301f512d5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Adding query filter params (scope.project.id=ca2fa0ae72454944a2398c083c9b1be7, user.id=bbbf8d9b784b4f5a93ca16015672d8c9) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:57.813082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18274714-3e28-4471-832f-963301f512d5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:57.839031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18274714-3e28-4471-832f-963301f512d5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:57.996132 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2049/4095] 10.222.0.21 () {58 vars in 1355 bytes} [Sat Nov 27 20:56:57 2021] GET /identity/v3/role_assignments?scope.project.id=ca2fa0ae72454944a2398c083c9b1be7&user.id=bbbf8d9b784b4f5a93ca16015672d8c9&effective => generated 648 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:57.997577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1332d7-dcac-4fba-9a82-10bb7be3bfa5 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:58.016995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1332d7-dcac-4fba-9a82-10bb7be3bfa5 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:58.042902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:58.045077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:58.052015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:58.053697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/89fac63b529f4fb991cbdf1ef86927b2/inherited_to_projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:58.059905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18274714-3e28-4471-832f-963301f512d5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:58.060813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d8d7740e72364c499f30e50e45e6f8bd, user_id=bbbf8d9b784b4f5a93ca16015672d8c9, role_id=89fac63b529f4fb991cbdf1ef86927b2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:58.065008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:58.065853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-18274714-3e28-4471-832f-963301f512d5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:58.076887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role 89fac63b529f4fb991cbdf1ef86927b2 was removed from user bbbf8d9b784b4f5a93ca16015672d8c9 on domain d8d7740e72364c499f30e50e45e6f8bd. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:58.077874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:58.078919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:58.101275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18274714-3e28-4471-832f-963301f512d5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:58.120993 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2047/4096] 10.222.0.21 () {58 vars in 1562 bytes} [Sat Nov 27 20:56:57 2021] DELETE /identity/v3/OS-INHERIT/domains/d8d7740e72364c499f30e50e45e6f8bd/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/89fac63b529f4fb991cbdf1ef86927b2/inherited_to_projects => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:58.124476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0fb78-1814-47aa-9401-0e74ab7e5f8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:58.125176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0fb78-1814-47aa-9401-0e74ab7e5f8f service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:58.125472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0fb78-1814-47aa-9401-0e74ab7e5f8f service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:58.125874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0fb78-1814-47aa-9401-0e74ab7e5f8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:58.127909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:58.130848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:58.133006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8ab0fb78-1814-47aa-9401-0e74ab7e5f8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:58.174064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0fb78-1814-47aa-9401-0e74ab7e5f8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:58.176905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0fb78-1814-47aa-9401-0e74ab7e5f8f service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:58.217165 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2050/4097] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:56:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:56:58.248361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c8d75-4001-4a46-b8fe-13ef20b8a201 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:58.262262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34e38b-fbcd-4051-8d20-0f87ab2be547 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:58.262262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34e38b-fbcd-4051-8d20-0f87ab2be547 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:58.262262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34e38b-fbcd-4051-8d20-0f87ab2be547 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:58.262650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34e38b-fbcd-4051-8d20-0f87ab2be547 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:58.262650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34e38b-fbcd-4051-8d20-0f87ab2be547 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Adding query filter params (scope.project.id=656d29c33a384b7d9e26b9f8570abaff, user.id=bbbf8d9b784b4f5a93ca16015672d8c9) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:58.262781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34e38b-fbcd-4051-8d20-0f87ab2be547 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:58.264824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34e38b-fbcd-4051-8d20-0f87ab2be547 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:58.313950 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2048/4098] 10.222.0.21 () {58 vars in 1355 bytes} [Sat Nov 27 20:56:58 2021] GET /identity/v3/role_assignments?scope.project.id=656d29c33a384b7d9e26b9f8570abaff&user.id=bbbf8d9b784b4f5a93ca16015672d8c9&effective => generated 228 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:58.318625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0fb78-1814-47aa-9401-0e74ab7e5f8f service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:58.343131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0fb78-1814-47aa-9401-0e74ab7e5f8f service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:58.348346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dafb2-2e07-4ef5-b19f-399824a06653 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:58.349009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dafb2-2e07-4ef5-b19f-399824a06653 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:58.349406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dafb2-2e07-4ef5-b19f-399824a06653 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:58.349661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546dafb2-2e07-4ef5-b19f-399824a06653 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:58.350501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dafb2-2e07-4ef5-b19f-399824a06653 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Adding query filter params (scope.project.id=ca2fa0ae72454944a2398c083c9b1be7, user.id=bbbf8d9b784b4f5a93ca16015672d8c9) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:58.350819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dafb2-2e07-4ef5-b19f-399824a06653 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:58.355799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546dafb2-2e07-4ef5-b19f-399824a06653 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:58.488285 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2051/4099] 10.222.0.21 () {58 vars in 1355 bytes} [Sat Nov 27 20:56:58 2021] GET /identity/v3/role_assignments?scope.project.id=ca2fa0ae72454944a2398c083c9b1be7&user.id=bbbf8d9b784b4f5a93ca16015672d8c9&effective => generated 228 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:56:58.490254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34e38b-fbcd-4051-8d20-0f87ab2be547 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:58.508156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34e38b-fbcd-4051-8d20-0f87ab2be547 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:58.514928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:58.517394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:58.517698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:58.518384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/projects/ca2fa0ae72454944a2398c083c9b1be7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:58.519712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca2fa0ae72454944a2398c083c9b1be7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:58.525089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:58.600829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2fa0ae72454944a2398c083c9b1be7', 'request_id': 'req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:58.611426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2fa0ae72454944a2398c083c9b1be7', 'request_id': 'req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:58.626722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2fa0ae72454944a2398c083c9b1be7', 'request_id': 'req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:58.654244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] The token cache is being invalidate because project ca2fa0ae72454944a2398c083c9b1be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:58.655014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:58.656043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:58.663900 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2049/4100] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:56:58 2021] DELETE /identity/v3/projects/ca2fa0ae72454944a2398c083c9b1be7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:58.664921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dafb2-2e07-4ef5-b19f-399824a06653 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:58.667356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-546dafb2-2e07-4ef5-b19f-399824a06653 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:58.686159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546dafb2-2e07-4ef5-b19f-399824a06653 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:58.777831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:58.778748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:58.779045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:58.779553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles/89fac63b529f4fb991cbdf1ef86927b2` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:58.781371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_role(role_id=89fac63b529f4fb991cbdf1ef86927b2)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:58.783822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:58.840104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role 89fac63b529f4fb991cbdf1ef86927b2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:58.840409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:58.841079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:58.843798 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2052/4101] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:56:58 2021] DELETE /identity/v3/roles/89fac63b529f4fb991cbdf1ef86927b2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:58.849451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:58.884990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8034c-ed29-4b3c-9445-56a9aff3ba1c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:59.069652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4e2e3-ffa4-4cde-85c7-a180bab5ea12 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:59.070421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4e2e3-ffa4-4cde-85c7-a180bab5ea12 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:59.070713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4e2e3-ffa4-4cde-85c7-a180bab5ea12 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:59.071097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4e2e3-ffa4-4cde-85c7-a180bab5ea12 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:59.072025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4e2e3-ffa4-4cde-85c7-a180bab5ea12 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:59.073823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4e2e3-ffa4-4cde-85c7-a180bab5ea12 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:59.096350 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2050/4102] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:56:58 2021] POST /identity/v3/roles => generated 239 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:56:59.100590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:59.103893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:59.132114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd89132-9001-483d-ba92-465beb1ca560 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:59.140772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7b152-c404-4566-9fc4-a1ad8fd0bc00 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:59.141452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7b152-c404-4566-9fc4-a1ad8fd0bc00 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:59.142356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7b152-c404-4566-9fc4-a1ad8fd0bc00 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:59.142637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7b152-c404-4566-9fc4-a1ad8fd0bc00 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:59.143665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7b152-c404-4566-9fc4-a1ad8fd0bc00 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:59.146154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7b152-c404-4566-9fc4-a1ad8fd0bc00 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:59.242000 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2053/4103] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:56:59 2021] POST /identity/v3/projects => generated 408 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:56:59.247479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4e2e3-ffa4-4cde-85c7-a180bab5ea12 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:59.266255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4e2e3-ffa4-4cde-85c7-a180bab5ea12 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:59.418369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d7431-403e-49cf-a0ec-b98d17d961c7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:59.419239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d7431-403e-49cf-a0ec-b98d17d961c7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:59.419642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d7431-403e-49cf-a0ec-b98d17d961c7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:59.419930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d7431-403e-49cf-a0ec-b98d17d961c7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/2a3c2431e585461e84ca1d7ab7c27a9c/inherited_to_projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:59.429284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d7431-403e-49cf-a0ec-b98d17d961c7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:create_grant(project_id=656d29c33a384b7d9e26b9f8570abaff, user_id=bbbf8d9b784b4f5a93ca16015672d8c9, role_id=2a3c2431e585461e84ca1d7ab7c27a9c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:59.445176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d7431-403e-49cf-a0ec-b98d17d961c7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:59.464111 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2051/4104] 10.222.0.21 () {60 vars in 1581 bytes} [Sat Nov 27 20:56:59 2021] PUT /identity/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/2a3c2431e585461e84ca1d7ab7c27a9c/inherited_to_projects => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:59.469694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7b152-c404-4566-9fc4-a1ad8fd0bc00 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:59.484714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7b152-c404-4566-9fc4-a1ad8fd0bc00 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:59.619989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9264de-685f-4b68-bc34-bfc4e745ccfd tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:59.621968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9264de-685f-4b68-bc34-bfc4e745ccfd tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:59.622470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9264de-685f-4b68-bc34-bfc4e745ccfd tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:59.622962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9264de-685f-4b68-bc34-bfc4e745ccfd tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:59.624683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9264de-685f-4b68-bc34-bfc4e745ccfd tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Adding query filter params (scope.project.id=0f65c1def47e41eeb05f6186469062a5, user.id=bbbf8d9b784b4f5a93ca16015672d8c9) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:59.625264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9264de-685f-4b68-bc34-bfc4e745ccfd tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:59.628428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9264de-685f-4b68-bc34-bfc4e745ccfd tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:59.730558 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2054/4105] 10.222.0.21 () {58 vars in 1355 bytes} [Sat Nov 27 20:56:59 2021] GET /identity/v3/role_assignments?scope.project.id=0f65c1def47e41eeb05f6186469062a5&user.id=bbbf8d9b784b4f5a93ca16015672d8c9&effective => generated 649 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:56:59.734591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d7431-403e-49cf-a0ec-b98d17d961c7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:59.752064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d7431-403e-49cf-a0ec-b98d17d961c7 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:59.760940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0781896-e566-44bc-bc38-29567e0cf66b tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:59.761995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0781896-e566-44bc-bc38-29567e0cf66b tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:59.761995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0781896-e566-44bc-bc38-29567e0cf66b tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:59.762343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0781896-e566-44bc-bc38-29567e0cf66b tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/2a3c2431e585461e84ca1d7ab7c27a9c/inherited_to_projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:59.769016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0781896-e566-44bc-bc38-29567e0cf66b tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=656d29c33a384b7d9e26b9f8570abaff, user_id=bbbf8d9b784b4f5a93ca16015672d8c9, role_id=2a3c2431e585461e84ca1d7ab7c27a9c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:59.780332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0781896-e566-44bc-bc38-29567e0cf66b tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:56:59.785983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d0781896-e566-44bc-bc38-29567e0cf66b tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role 2a3c2431e585461e84ca1d7ab7c27a9c was removed from user bbbf8d9b784b4f5a93ca16015672d8c9 on project 656d29c33a384b7d9e26b9f8570abaff. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:56:59.786290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d0781896-e566-44bc-bc38-29567e0cf66b tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:59.788046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d0781896-e566-44bc-bc38-29567e0cf66b tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:56:59.818452 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2052/4106] 10.222.0.21 () {58 vars in 1565 bytes} [Sat Nov 27 20:56:59 2021] DELETE /identity/v3/OS-INHERIT/projects/656d29c33a384b7d9e26b9f8570abaff/users/bbbf8d9b784b4f5a93ca16015672d8c9/roles/2a3c2431e585461e84ca1d7ab7c27a9c/inherited_to_projects => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:56:59.822644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9264de-685f-4b68-bc34-bfc4e745ccfd tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:56:59.824694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3a9264de-685f-4b68-bc34-bfc4e745ccfd tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:56:59.853365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9264de-685f-4b68-bc34-bfc4e745ccfd tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:56:59.968544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800e901-5ef9-4d3f-94da-7466441e9351 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:56:59.969313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800e901-5ef9-4d3f-94da-7466441e9351 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:56:59.969540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800e901-5ef9-4d3f-94da-7466441e9351 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:56:59.969792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800e901-5ef9-4d3f-94da-7466441e9351 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:56:59.971347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800e901-5ef9-4d3f-94da-7466441e9351 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Adding query filter params (scope.project.id=0f65c1def47e41eeb05f6186469062a5, user.id=bbbf8d9b784b4f5a93ca16015672d8c9) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:56:59.971843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800e901-5ef9-4d3f-94da-7466441e9351 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:56:59.973763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800e901-5ef9-4d3f-94da-7466441e9351 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:00.094626 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2055/4107] 10.222.0.21 () {58 vars in 1355 bytes} [Sat Nov 27 20:56:59 2021] GET /identity/v3/role_assignments?scope.project.id=0f65c1def47e41eeb05f6186469062a5&user.id=bbbf8d9b784b4f5a93ca16015672d8c9&effective => generated 228 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:00.096464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0781896-e566-44bc-bc38-29567e0cf66b tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:00.111595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0781896-e566-44bc-bc38-29567e0cf66b tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:00.124627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:00.126989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:00.128304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:00.128630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/projects/0f65c1def47e41eeb05f6186469062a5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:00.143838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f65c1def47e41eeb05f6186469062a5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:00.148928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:00.308708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f65c1def47e41eeb05f6186469062a5', 'request_id': 'req-8f1346a1-211e-4412-af56-23f5f12a24c8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.335901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f65c1def47e41eeb05f6186469062a5', 'request_id': 'req-8f1346a1-211e-4412-af56-23f5f12a24c8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.361496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f65c1def47e41eeb05f6186469062a5', 'request_id': 'req-8f1346a1-211e-4412-af56-23f5f12a24c8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.386122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] The token cache is being invalidate because project 0f65c1def47e41eeb05f6186469062a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:00.386413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.389093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.398711 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2053/4108] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:00 2021] DELETE /identity/v3/projects/0f65c1def47e41eeb05f6186469062a5 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:00.400844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800e901-5ef9-4d3f-94da-7466441e9351 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:00.404093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4800e901-5ef9-4d3f-94da-7466441e9351 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:00.428856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800e901-5ef9-4d3f-94da-7466441e9351 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:00.518616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:00.519879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:00.520375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:00.521270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/roles/2a3c2431e585461e84ca1d7ab7c27a9c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:00.523086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2a3c2431e585461e84ca1d7ab7c27a9c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:00.525560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:00.590069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invalidating the token cache because role 2a3c2431e585461e84ca1d7ab7c27a9c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:00.590625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.591540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.593906 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2056/4109] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:00 2021] DELETE /identity/v3/roles/2a3c2431e585461e84ca1d7ab7c27a9c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:00.600490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:00.619147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1346a1-211e-4412-af56-23f5f12a24c8 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:00.744437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:00.748346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:00.749313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:00.751440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/users/bbbf8d9b784b4f5a93ca16015672d8c9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:00.760103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bbbf8d9b784b4f5a93ca16015672d8c9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:00.762301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:00.861200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbbf8d9b784b4f5a93ca16015672d8c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.863717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbbf8d9b784b4f5a93ca16015672d8c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.877621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbbf8d9b784b4f5a93ca16015672d8c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.878345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbbf8d9b784b4f5a93ca16015672d8c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.894237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbbf8d9b784b4f5a93ca16015672d8c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:00.917223 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2054/4110] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:00 2021] DELETE /identity/v3/users/bbbf8d9b784b4f5a93ca16015672d8c9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:00.918404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:00.919902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:00.973121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ea142-39cf-4b9f-bfcd-7e08a446e095 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:01.042728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655a8de-c962-46dd-b461-a0d962cdfb2c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:01.044088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655a8de-c962-46dd-b461-a0d962cdfb2c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:01.044601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655a8de-c962-46dd-b461-a0d962cdfb2c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:01.045111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655a8de-c962-46dd-b461-a0d962cdfb2c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/groups/fbdcd1c12a8d467abd2db7c4ae6b0066` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:01.046647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655a8de-c962-46dd-b461-a0d962cdfb2c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fbdcd1c12a8d467abd2db7c4ae6b0066)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:01.048797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655a8de-c962-46dd-b461-a0d962cdfb2c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:01.135755 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2057/4111] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:57:00 2021] DELETE /identity/v3/groups/fbdcd1c12a8d467abd2db7c4ae6b0066 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:01.140683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:01.142504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:01.176519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09988e-b20d-467d-a5fb-639d18572054 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:01.285097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:01.286194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:01.286550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:01.287434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/projects/656d29c33a384b7d9e26b9f8570abaff` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:01.297349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_project(project_id=656d29c33a384b7d9e26b9f8570abaff)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:01.299695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:01.418121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656d29c33a384b7d9e26b9f8570abaff', 'request_id': 'req-59fb0c48-3631-44cd-964d-3da33cd5d082'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:01.446765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656d29c33a384b7d9e26b9f8570abaff', 'request_id': 'req-59fb0c48-3631-44cd-964d-3da33cd5d082'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:01.470616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656d29c33a384b7d9e26b9f8570abaff', 'request_id': 'req-59fb0c48-3631-44cd-964d-3da33cd5d082'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:01.487484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] The token cache is being invalidate because project 656d29c33a384b7d9e26b9f8570abaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:01.488033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:01.488873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-59fb0c48-3631-44cd-964d-3da33cd5d082 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:01.490523 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2055/4112] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:01 2021] DELETE /identity/v3/projects/656d29c33a384b7d9e26b9f8570abaff => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:01.498578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655a8de-c962-46dd-b461-a0d962cdfb2c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:01.501250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3655a8de-c962-46dd-b461-a0d962cdfb2c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:01.522839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655a8de-c962-46dd-b461-a0d962cdfb2c tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:01.693915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:01.694799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:01.695210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:01.704343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/domains/d8d7740e72364c499f30e50e45e6f8bd` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:01.706500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d8d7740e72364c499f30e50e45e6f8bd)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:01.715892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:01.780083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:01.781955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:01.809741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025e8f-ba38-4f2a-abc6-607a9a8ca833 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:01.810052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025e8f-ba38-4f2a-abc6-607a9a8ca833 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:01.810319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025e8f-ba38-4f2a-abc6-607a9a8ca833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:01.845348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-13025e8f-ba38-4f2a-abc6-607a9a8ca833 None None] MFA Rules not processed for user `ed87ef17973a49f2a9108bdfbff65415`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:01.848711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-13025e8f-ba38-4f2a-abc6-607a9a8ca833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:01.856077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:01.857367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:01.867526 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2058/4113] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:57:01 2021] PATCH /identity/v3/domains/d8d7740e72364c499f30e50e45e6f8bd => generated 277 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:01.872505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:01.882868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:01.963310 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2056/4114] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:01 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:02.007997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4b5dc-c7fa-4452-ae35-f47f238fb3ae tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:02.014132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dab7f245f3244bec8ed31e108478215c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4cb973d5d49407ba12340640a42cd48', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:02.015218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:02.015630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:02.016016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] PATH_INFO: `/v3/domains/d8d7740e72364c499f30e50e45e6f8bd` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:02.037487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d8d7740e72364c499f30e50e45e6f8bd)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:02.039543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:02.067740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.080442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.148171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd', 'request_id': 'req-f107b1d9-3a12-47f8-93dd-78a0411184a5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.159325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd', 'request_id': 'req-f107b1d9-3a12-47f8-93dd-78a0411184a5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.172419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd', 'request_id': 'req-f107b1d9-3a12-47f8-93dd-78a0411184a5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.185162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] The token cache is being invalidate because project d8d7740e72364c499f30e50e45e6f8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:02.185937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.186856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.196648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd', 'request_id': 'req-f107b1d9-3a12-47f8-93dd-78a0411184a5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.197518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd', 'request_id': 'req-f107b1d9-3a12-47f8-93dd-78a0411184a5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.198479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f107b1d9-3a12-47f8-93dd-78a0411184a5 tempest-InheritsV3TestJSON-2011643536 tempest-InheritsV3TestJSON-2011643536-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd8d7740e72364c499f30e50e45e6f8bd', 'request_id': 'req-f107b1d9-3a12-47f8-93dd-78a0411184a5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.217090 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2059/4115] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:57:01 2021] DELETE /identity/v3/domains/d8d7740e72364c499f30e50e45e6f8bd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:02.223048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13025e8f-ba38-4f2a-abc6-607a9a8ca833 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:02.236157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-13025e8f-ba38-4f2a-abc6-607a9a8ca833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:02.337399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13025e8f-ba38-4f2a-abc6-607a9a8ca833 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:02.464112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:02.465095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:02.465849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:02.466129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] PATH_INFO: `/v3/users/9ffb4c7354984f1d93b22266b1c80374` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:02.468297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ffb4c7354984f1d93b22266b1c80374)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:02.473040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:02.567513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ffb4c7354984f1d93b22266b1c80374'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.569820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ffb4c7354984f1d93b22266b1c80374'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.582040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ffb4c7354984f1d93b22266b1c80374'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.582947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ffb4c7354984f1d93b22266b1c80374'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.600086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ffb4c7354984f1d93b22266b1c80374'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.627970 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2057/4116] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:02 2021] DELETE /identity/v3/users/9ffb4c7354984f1d93b22266b1c80374 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:02.629582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414e314-c6ac-4b45-b028-6b21ed0e4795 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:02.630057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414e314-c6ac-4b45-b028-6b21ed0e4795 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:02.630137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414e314-c6ac-4b45-b028-6b21ed0e4795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:02.651388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1414e314-c6ac-4b45-b028-6b21ed0e4795 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:02.653087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1414e314-c6ac-4b45-b028-6b21ed0e4795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:02.683340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:02.685453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:02.788462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2069d-95c4-4fe2-a6d5-13d457725c5d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:02.795195 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2060/4117] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:57:02.800617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390869c-4871-430b-b4ed-06181144c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:02.801729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390869c-4871-430b-b4ed-06181144c748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:02.802114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390869c-4871-430b-b4ed-06181144c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:02.802493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390869c-4871-430b-b4ed-06181144c748 admin admin] PATH_INFO: `/v3/users/e21e34fcd97e4d0d99fc526a7d684e1f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:02.804145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390869c-4871-430b-b4ed-06181144c748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21e34fcd97e4d0d99fc526a7d684e1f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:02.807870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390869c-4871-430b-b4ed-06181144c748 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:02.810729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414e314-c6ac-4b45-b028-6b21ed0e4795 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:02.812078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1414e314-c6ac-4b45-b028-6b21ed0e4795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:02.923773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3390869c-4871-430b-b4ed-06181144c748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21e34fcd97e4d0d99fc526a7d684e1f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.925948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3390869c-4871-430b-b4ed-06181144c748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21e34fcd97e4d0d99fc526a7d684e1f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.937336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414e314-c6ac-4b45-b028-6b21ed0e4795 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:02.942567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c202f86-abef-4a0d-9bdf-809d54f6bdf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:02.942926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c202f86-abef-4a0d-9bdf-809d54f6bdf0 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:02.944122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c202f86-abef-4a0d-9bdf-809d54f6bdf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:02.944122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c202f86-abef-4a0d-9bdf-809d54f6bdf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:02.946325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3390869c-4871-430b-b4ed-06181144c748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21e34fcd97e4d0d99fc526a7d684e1f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.947727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3390869c-4871-430b-b4ed-06181144c748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21e34fcd97e4d0d99fc526a7d684e1f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.956747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7c202f86-abef-4a0d-9bdf-809d54f6bdf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:02.958375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3390869c-4871-430b-b4ed-06181144c748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21e34fcd97e4d0d99fc526a7d684e1f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:02.986598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c202f86-abef-4a0d-9bdf-809d54f6bdf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:02.993870 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2058/4118] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:02 2021] DELETE /identity/v3/users/e21e34fcd97e4d0d99fc526a7d684e1f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:02.995135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c202f86-abef-4a0d-9bdf-809d54f6bdf0 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:02.999316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0655068-3383-4376-9ed8-00f86cd215f2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:02.999803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0655068-3383-4376-9ed8-00f86cd215f2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:03.000528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0655068-3383-4376-9ed8-00f86cd215f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:03.010072 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2061/4119] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:03.026507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b0655068-3383-4376-9ed8-00f86cd215f2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:03.028119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b0655068-3383-4376-9ed8-00f86cd215f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:03.127406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2059/4120] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:57:03.144377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c202f86-abef-4a0d-9bdf-809d54f6bdf0 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:03.146449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7c202f86-abef-4a0d-9bdf-809d54f6bdf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:03.169285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c202f86-abef-4a0d-9bdf-809d54f6bdf0 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:03.322378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ced17-3775-4f0e-b592-b9f87680b08a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:03.323590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ced17-3775-4f0e-b592-b9f87680b08a service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:03.323972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ced17-3775-4f0e-b592-b9f87680b08a service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:03.324250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ced17-3775-4f0e-b592-b9f87680b08a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:03.335438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ced17-3775-4f0e-b592-b9f87680b08a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:03.338017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ced17-3775-4f0e-b592-b9f87680b08a service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:03.349083 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2062/4121] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:57:03.910575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0655068-3383-4376-9ed8-00f86cd215f2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:03.912694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b0655068-3383-4376-9ed8-00f86cd215f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:03.948226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0655068-3383-4376-9ed8-00f86cd215f2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:03.970958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:03.972551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:03.976963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:03.977358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] PATH_INFO: `/v3/projects/2d83af57b54a4447a95c70884c32042b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:03.982247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d83af57b54a4447a95c70884c32042b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:03.987875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:04.212172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d83af57b54a4447a95c70884c32042b', 'request_id': 'req-8367bc10-1818-4538-bd7b-3e3c279ada94'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.223549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d83af57b54a4447a95c70884c32042b', 'request_id': 'req-8367bc10-1818-4538-bd7b-3e3c279ada94'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.263784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d83af57b54a4447a95c70884c32042b', 'request_id': 'req-8367bc10-1818-4538-bd7b-3e3c279ada94'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.284043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] The token cache is being invalidate because project 2d83af57b54a4447a95c70884c32042b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:04.284485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.285415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.287681 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2060/4122] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:03 2021] DELETE /identity/v3/projects/2d83af57b54a4447a95c70884c32042b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:04.292471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ced17-3775-4f0e-b592-b9f87680b08a service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:04.312253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ced17-3775-4f0e-b592-b9f87680b08a service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:04.468473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:04.469853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:04.470385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:04.470862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] PATH_INFO: `/v3/users/dab7f245f3244bec8ed31e108478215c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:04.472517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab7f245f3244bec8ed31e108478215c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:04.475407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:04.544498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:04.546346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:04.559785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab7f245f3244bec8ed31e108478215c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.571834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367bc10-1818-4538-bd7b-3e3c279ada94 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:04.572585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab7f245f3244bec8ed31e108478215c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.573636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab7f245f3244bec8ed31e108478215c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.582197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:04.585110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:04.586899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:04.587678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] PATH_INFO: `/v3/projects/b84cea885cbf49b78dd7d4222747c05b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:04.591053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84cea885cbf49b78dd7d4222747c05b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:04.595024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:04.597393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab7f245f3244bec8ed31e108478215c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.619367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab7f245f3244bec8ed31e108478215c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.628407 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2063/4123] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:04 2021] DELETE /identity/v3/users/dab7f245f3244bec8ed31e108478215c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:04.744460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84cea885cbf49b78dd7d4222747c05b', 'request_id': 'req-d9a58e5e-c536-469a-915c-fead25c16def'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.757996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84cea885cbf49b78dd7d4222747c05b', 'request_id': 'req-d9a58e5e-c536-469a-915c-fead25c16def'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.776591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84cea885cbf49b78dd7d4222747c05b', 'request_id': 'req-d9a58e5e-c536-469a-915c-fead25c16def'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.793560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] The token cache is being invalidate because project b84cea885cbf49b78dd7d4222747c05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:04.793860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.794823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:04.802995 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2061/4124] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:04 2021] DELETE /identity/v3/projects/b84cea885cbf49b78dd7d4222747c05b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:04.804230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:04.806086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:04.995632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846da8a-ae60-426e-9ddd-3ad0a2cdf511 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:05.144616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9035d-a2ed-45af-bfce-cd3167e56819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:05.145982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9035d-a2ed-45af-bfce-cd3167e56819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:05.146282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9035d-a2ed-45af-bfce-cd3167e56819 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:05.146639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9035d-a2ed-45af-bfce-cd3167e56819 admin admin] PATH_INFO: `/v3/users/1a621f91487a416684eeee05b6c29053` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:05.147954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9035d-a2ed-45af-bfce-cd3167e56819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a621f91487a416684eeee05b6c29053)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:05.150504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9035d-a2ed-45af-bfce-cd3167e56819 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:05.257435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25f9035d-a2ed-45af-bfce-cd3167e56819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a621f91487a416684eeee05b6c29053'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:05.276242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25f9035d-a2ed-45af-bfce-cd3167e56819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a621f91487a416684eeee05b6c29053'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:05.277233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25f9035d-a2ed-45af-bfce-cd3167e56819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a621f91487a416684eeee05b6c29053'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:05.294669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25f9035d-a2ed-45af-bfce-cd3167e56819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a621f91487a416684eeee05b6c29053'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:05.313162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25f9035d-a2ed-45af-bfce-cd3167e56819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a621f91487a416684eeee05b6c29053'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:05.326951 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2064/4125] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:04 2021] DELETE /identity/v3/users/1a621f91487a416684eeee05b6c29053 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:06.733602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:06.736802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:06.772203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a58e5e-c536-469a-915c-fead25c16def admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:06.880372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:06.884055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:06.884767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:06.885571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] PATH_INFO: `/v3/projects/f4cb973d5d49407ba12340640a42cd48` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:06.888175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cb973d5d49407ba12340640a42cd48)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:06.892061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:07.081260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cb973d5d49407ba12340640a42cd48', 'request_id': 'req-263fc601-12b3-4912-96be-583ff3eec3e9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:07.097966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cb973d5d49407ba12340640a42cd48', 'request_id': 'req-263fc601-12b3-4912-96be-583ff3eec3e9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:07.135238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cb973d5d49407ba12340640a42cd48', 'request_id': 'req-263fc601-12b3-4912-96be-583ff3eec3e9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:07.166384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] The token cache is being invalidate because project f4cb973d5d49407ba12340640a42cd48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:07.166689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:07.169160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-263fc601-12b3-4912-96be-583ff3eec3e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:07.175417 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2062/4126] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:06 2021] DELETE /identity/v3/projects/f4cb973d5d49407ba12340640a42cd48 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:07.180221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989a4aa-ea76-4e1a-bb0f-f34f7e9bbe30 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:07.181598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989a4aa-ea76-4e1a-bb0f-f34f7e9bbe30 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:07.182218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989a4aa-ea76-4e1a-bb0f-f34f7e9bbe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:07.236418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6989a4aa-ea76-4e1a-bb0f-f34f7e9bbe30 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:07.238834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6989a4aa-ea76-4e1a-bb0f-f34f7e9bbe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:07.315379 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2065/4127] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:07.324239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27498d1c-1ca7-44e0-859e-5bf1a1d622d6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:07.324622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27498d1c-1ca7-44e0-859e-5bf1a1d622d6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:07.324999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27498d1c-1ca7-44e0-859e-5bf1a1d622d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:07.348758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-27498d1c-1ca7-44e0-859e-5bf1a1d622d6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:07.350135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-27498d1c-1ca7-44e0-859e-5bf1a1d622d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:07.363616 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2063/4128] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:07.367030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989a4aa-ea76-4e1a-bb0f-f34f7e9bbe30 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:07.378321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989a4aa-ea76-4e1a-bb0f-f34f7e9bbe30 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:07.384073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f4c3e-8617-4f87-9b6a-dd43aaa9b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:07.384731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f4c3e-8617-4f87-9b6a-dd43aaa9b99d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:07.385305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f4c3e-8617-4f87-9b6a-dd43aaa9b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:07.385528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f4c3e-8617-4f87-9b6a-dd43aaa9b99d admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:07.386263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f4c3e-8617-4f87-9b6a-dd43aaa9b99d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:07.386703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f4c3e-8617-4f87-9b6a-dd43aaa9b99d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:07.388376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f4c3e-8617-4f87-9b6a-dd43aaa9b99d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:07.402066 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2066/4129] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:57:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:07.406492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27498d1c-1ca7-44e0-859e-5bf1a1d622d6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:07.416552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27498d1c-1ca7-44e0-859e-5bf1a1d622d6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:07.422168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562af1d-8313-4afa-95c5-260b122e958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:07.422643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562af1d-8313-4afa-95c5-260b122e958b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:07.422643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562af1d-8313-4afa-95c5-260b122e958b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:07.422939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562af1d-8313-4afa-95c5-260b122e958b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:07.427754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562af1d-8313-4afa-95c5-260b122e958b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:07.427754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562af1d-8313-4afa-95c5-260b122e958b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:07.537466 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2064/4130] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:07 2021] POST /identity/v3/projects => generated 389 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:07.542446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f4c3e-8617-4f87-9b6a-dd43aaa9b99d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:07.557651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562af1d-8313-4afa-95c5-260b122e958b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:07.560259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7562af1d-8313-4afa-95c5-260b122e958b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:07.569248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f4c3e-8617-4f87-9b6a-dd43aaa9b99d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:07.690150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562af1d-8313-4afa-95c5-260b122e958b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:07.696736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:07.697627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:07.697908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:07.698180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] PATH_INFO: `/v3/projects/2e2791405ace4a148721ae418010bdde` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:07.699753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2791405ace4a148721ae418010bdde)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:07.701686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:07.756958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da3094-6b74-44b6-acaf-a20a825f1e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:07.757826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da3094-6b74-44b6-acaf-a20a825f1e12 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:07.758103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da3094-6b74-44b6-acaf-a20a825f1e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:07.761455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da3094-6b74-44b6-acaf-a20a825f1e12 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:07.762261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da3094-6b74-44b6-acaf-a20a825f1e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:07.767442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da3094-6b74-44b6-acaf-a20a825f1e12 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:07.788741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2791405ace4a148721ae418010bdde', 'request_id': 'req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:07.798866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2791405ace4a148721ae418010bdde', 'request_id': 'req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:07.814118 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2067/4131] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:07 2021] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:07.817491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da3094-6b74-44b6-acaf-a20a825f1e12 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:07.827566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2791405ace4a148721ae418010bdde', 'request_id': 'req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:07.833906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da3094-6b74-44b6-acaf-a20a825f1e12 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:07.844193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] The token cache is being invalidate because project 2e2791405ace4a148721ae418010bdde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:07.844495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:07.845366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:07.848170 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2065/4132] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:07 2021] DELETE /identity/v3/projects/2e2791405ace4a148721ae418010bdde => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:07.853823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:07.856006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:07.950927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0ccda-3a1f-4305-a706-4e8e5cc764b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:07.952210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0ccda-3a1f-4305-a706-4e8e5cc764b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:07.952801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0ccda-3a1f-4305-a706-4e8e5cc764b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:07.953240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0ccda-3a1f-4305-a706-4e8e5cc764b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:07.954174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0ccda-3a1f-4305-a706-4e8e5cc764b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:07.957761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0ccda-3a1f-4305-a706-4e8e5cc764b0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:07.975637 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2068/4133] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:07 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:07.980844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0ccda-3a1f-4305-a706-4e8e5cc764b0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:07.983164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-72d0ccda-3a1f-4305-a706-4e8e5cc764b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:07.993562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb7d0e-0dd7-4f31-a146-d95d31f7c06d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:07.998145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0ccda-3a1f-4305-a706-4e8e5cc764b0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:08.005561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c671ec-a80e-4c94-902b-16597468c989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:08.006743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c671ec-a80e-4c94-902b-16597468c989 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:08.006743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c671ec-a80e-4c94-902b-16597468c989 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:08.006943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c671ec-a80e-4c94-902b-16597468c989 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:08.007707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c671ec-a80e-4c94-902b-16597468c989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:08.010833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c671ec-a80e-4c94-902b-16597468c989 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:08.012821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:08.013987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:08.014432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:08.014885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] PATH_INFO: `/v3/users/f971bd03f2344cfe8c47769c4b97a71a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:08.017401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f971bd03f2344cfe8c47769c4b97a71a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:08.020057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:08.029069 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2069/4134] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:07 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:08.030294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c671ec-a80e-4c94-902b-16597468c989 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:08.045073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c671ec-a80e-4c94-902b-16597468c989 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:08.061149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b7834-b00f-4acc-9486-18f1e7f90264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:08.062769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7834-b00f-4acc-9486-18f1e7f90264 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:08.063055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7834-b00f-4acc-9486-18f1e7f90264 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:08.063431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7834-b00f-4acc-9486-18f1e7f90264 admin admin] PATH_INFO: `/v3/projects/5d4b3c2fd3b140adbdbb39e98b3aa76f/users/2c03dc0595ca466a966d25f89e448dc4/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:08.085334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b7834-b00f-4acc-9486-18f1e7f90264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4b3c2fd3b140adbdbb39e98b3aa76f, user_id=2c03dc0595ca466a966d25f89e448dc4, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:08.088525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b7834-b00f-4acc-9486-18f1e7f90264 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:08.118959 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2070/4135] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:08 2021] PUT /identity/v3/projects/5d4b3c2fd3b140adbdbb39e98b3aa76f/users/2c03dc0595ca466a966d25f89e448dc4/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:08.132768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f971bd03f2344cfe8c47769c4b97a71a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:08.132983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aac9c-507f-4919-8b47-dd235917337f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:08.133343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aac9c-507f-4919-8b47-dd235917337f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:08.133661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f971bd03f2344cfe8c47769c4b97a71a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:08.133817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aac9c-507f-4919-8b47-dd235917337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:08.146210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f971bd03f2344cfe8c47769c4b97a71a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:08.146891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f971bd03f2344cfe8c47769c4b97a71a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:08.158818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f971bd03f2344cfe8c47769c4b97a71a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:08.176296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1e0aac9c-507f-4919-8b47-dd235917337f None None] MFA Rules not processed for user `2c03dc0595ca466a966d25f89e448dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:08.177862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1e0aac9c-507f-4919-8b47-dd235917337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:08.211724 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2066/4136] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:07 2021] DELETE /identity/v3/users/f971bd03f2344cfe8c47769c4b97a71a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:08.294817 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2071/4137] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:08 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:08.295434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:08.296733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:08.424333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98de219-d103-4614-9ded-0f45e1c08e54 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:08.437054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac924c-7296-4588-b17d-c5e1d8068fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:08.438123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac924c-7296-4588-b17d-c5e1d8068fea admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:08.438596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac924c-7296-4588-b17d-c5e1d8068fea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:08.439282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac924c-7296-4588-b17d-c5e1d8068fea admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:08.449978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac924c-7296-4588-b17d-c5e1d8068fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:08.453121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac924c-7296-4588-b17d-c5e1d8068fea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:08.503130 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2067/4138] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:08 2021] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:08.505869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aac9c-507f-4919-8b47-dd235917337f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:08.761008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac924c-7296-4588-b17d-c5e1d8068fea admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:08.763589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-42ac924c-7296-4588-b17d-c5e1d8068fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:08.789773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aac9c-507f-4919-8b47-dd235917337f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:08.892966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918572b8-120a-4001-83b6-25834fb8d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:08.897159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918572b8-120a-4001-83b6-25834fb8d3ae admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:08.897159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918572b8-120a-4001-83b6-25834fb8d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:08.897159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918572b8-120a-4001-83b6-25834fb8d3ae admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:08.897159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918572b8-120a-4001-83b6-25834fb8d3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:08.901011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918572b8-120a-4001-83b6-25834fb8d3ae admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:08.926198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac924c-7296-4588-b17d-c5e1d8068fea admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:08.932008 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2072/4139] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:08 2021] POST /identity/v3/users => generated 300 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:08.935926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918572b8-120a-4001-83b6-25834fb8d3ae admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:08.939865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:08.940839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:08.941406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:08.941693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] PATH_INFO: `/v3/projects/32d6fe7b5a114c2cb1eac33eb7ac36da` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:08.943890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d6fe7b5a114c2cb1eac33eb7ac36da)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:08.947578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:08.950348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918572b8-120a-4001-83b6-25834fb8d3ae admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:08.957948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03ae9f-6609-41e5-bdbb-31a3da241119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:08.959530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03ae9f-6609-41e5-bdbb-31a3da241119 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:08.960033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03ae9f-6609-41e5-bdbb-31a3da241119 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:08.960561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03ae9f-6609-41e5-bdbb-31a3da241119 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:08.972659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03ae9f-6609-41e5-bdbb-31a3da241119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:08.976238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03ae9f-6609-41e5-bdbb-31a3da241119 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:09.000502 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2073/4140] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:08 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:09.005123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03ae9f-6609-41e5-bdbb-31a3da241119 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.018287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03ae9f-6609-41e5-bdbb-31a3da241119 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:09.026440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e5dd2-f522-4250-81d6-fdb9ca81ff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:09.027268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e5dd2-f522-4250-81d6-fdb9ca81ff6d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.027707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e5dd2-f522-4250-81d6-fdb9ca81ff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.028164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e5dd2-f522-4250-81d6-fdb9ca81ff6d admin admin] PATH_INFO: `/v3/projects/cbbd3a2f56be444e92da365dc9fc7e67/users/08cfe0a891154563b1c0b7732315c981/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.048845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e5dd2-f522-4250-81d6-fdb9ca81ff6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbd3a2f56be444e92da365dc9fc7e67, user_id=08cfe0a891154563b1c0b7732315c981, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:09.052075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e5dd2-f522-4250-81d6-fdb9ca81ff6d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:09.076188 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2074/4141] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:09 2021] PUT /identity/v3/projects/cbbd3a2f56be444e92da365dc9fc7e67/users/08cfe0a891154563b1c0b7732315c981/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:09.083233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e5dd2-f522-4250-81d6-fdb9ca81ff6d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.093158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d6fe7b5a114c2cb1eac33eb7ac36da', 'request_id': 'req-abc667af-9d87-4015-8398-8d48d3a77820'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:09.100814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d6fe7b5a114c2cb1eac33eb7ac36da', 'request_id': 'req-abc667af-9d87-4015-8398-8d48d3a77820'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:09.112233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d6fe7b5a114c2cb1eac33eb7ac36da', 'request_id': 'req-abc667af-9d87-4015-8398-8d48d3a77820'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:09.128579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] The token cache is being invalidate because project 32d6fe7b5a114c2cb1eac33eb7ac36da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:09.129020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:09.130069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-abc667af-9d87-4015-8398-8d48d3a77820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:09.131797 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2068/4142] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:08 2021] DELETE /identity/v3/projects/32d6fe7b5a114c2cb1eac33eb7ac36da => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:09.137911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0389b9-b725-4e77-981d-77131ab48180 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.138327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0389b9-b725-4e77-981d-77131ab48180 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.139503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0389b9-b725-4e77-981d-77131ab48180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.169777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7f0389b9-b725-4e77-981d-77131ab48180 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:09.173082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7f0389b9-b725-4e77-981d-77131ab48180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:09.226639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e5dd2-f522-4250-81d6-fdb9ca81ff6d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:09.239693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257c6d9-26b1-4dba-b687-ee2d77e5b9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:09.243801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257c6d9-26b1-4dba-b687-ee2d77e5b9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.245068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257c6d9-26b1-4dba-b687-ee2d77e5b9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.245731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257c6d9-26b1-4dba-b687-ee2d77e5b9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.248563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257c6d9-26b1-4dba-b687-ee2d77e5b9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:09.250976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257c6d9-26b1-4dba-b687-ee2d77e5b9f3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:09.264709 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2075/4143] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:09 2021] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:57:09.272332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257c6d9-26b1-4dba-b687-ee2d77e5b9f3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.282369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6257c6d9-26b1-4dba-b687-ee2d77e5b9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:09.301924 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2069/4144] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:09.308270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50115e6-0090-4006-b624-0d560d72fd43 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.308845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50115e6-0090-4006-b624-0d560d72fd43 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.309474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50115e6-0090-4006-b624-0d560d72fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.336073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257c6d9-26b1-4dba-b687-ee2d77e5b9f3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:09.345828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04527a5-eae1-4924-bf66-d2e6797d0ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:09.346821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04527a5-eae1-4924-bf66-d2e6797d0ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.347112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04527a5-eae1-4924-bf66-d2e6797d0ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.347422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04527a5-eae1-4924-bf66-d2e6797d0ee4 admin admin] PATH_INFO: `/v3/projects/cbbd3a2f56be444e92da365dc9fc7e67/users/08cfe0a891154563b1c0b7732315c981/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.350284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04527a5-eae1-4924-bf66-d2e6797d0ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbd3a2f56be444e92da365dc9fc7e67, user_id=08cfe0a891154563b1c0b7732315c981, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:09.354619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04527a5-eae1-4924-bf66-d2e6797d0ee4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:09.358416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f50115e6-0090-4006-b624-0d560d72fd43 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:09.360834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f50115e6-0090-4006-b624-0d560d72fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:09.381858 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2076/4145] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:09 2021] PUT /identity/v3/projects/cbbd3a2f56be444e92da365dc9fc7e67/users/08cfe0a891154563b1c0b7732315c981/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:09.403664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364affa-24bc-4551-8f79-c5e3f6aadb85 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.407126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364affa-24bc-4551-8f79-c5e3f6aadb85 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.407435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364affa-24bc-4551-8f79-c5e3f6aadb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.495312 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2070/4146] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:09.497571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50115e6-0090-4006-b624-0d560d72fd43 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.503784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b364affa-24bc-4551-8f79-c5e3f6aadb85 None None] MFA Rules not processed for user `08cfe0a891154563b1c0b7732315c981`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:09.505568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b364affa-24bc-4551-8f79-c5e3f6aadb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:09.509278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50115e6-0090-4006-b624-0d560d72fd43 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:09.514399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c13676-7d91-4d97-a9a1-d68e57596add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:09.515090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c13676-7d91-4d97-a9a1-d68e57596add admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.515409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c13676-7d91-4d97-a9a1-d68e57596add admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.515786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c13676-7d91-4d97-a9a1-d68e57596add admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.516767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c13676-7d91-4d97-a9a1-d68e57596add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:09.517083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c13676-7d91-4d97-a9a1-d68e57596add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:09.518835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c13676-7d91-4d97-a9a1-d68e57596add admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:09.541508 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2071/4147] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:57:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:09.549867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c13676-7d91-4d97-a9a1-d68e57596add admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.576539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c13676-7d91-4d97-a9a1-d68e57596add admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:09.584433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78b9ba-c0f8-46c4-937d-acf6ed8d6d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:09.585649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78b9ba-c0f8-46c4-937d-acf6ed8d6d16 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.585942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78b9ba-c0f8-46c4-937d-acf6ed8d6d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.586808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78b9ba-c0f8-46c4-937d-acf6ed8d6d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.588485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78b9ba-c0f8-46c4-937d-acf6ed8d6d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:09.591058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78b9ba-c0f8-46c4-937d-acf6ed8d6d16 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:09.618762 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2077/4148] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:09 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:09.630582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364affa-24bc-4551-8f79-c5e3f6aadb85 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.639907 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2072/4149] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:09 2021] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:09.640915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78b9ba-c0f8-46c4-937d-acf6ed8d6d16 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.665163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364affa-24bc-4551-8f79-c5e3f6aadb85 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:09.725246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78b9ba-c0f8-46c4-937d-acf6ed8d6d16 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:09.736554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f442c64-ef31-4b8d-ad46-d1b0b2531b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:09.738201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f442c64-ef31-4b8d-ad46-d1b0b2531b72 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.738541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f442c64-ef31-4b8d-ad46-d1b0b2531b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.738827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f442c64-ef31-4b8d-ad46-d1b0b2531b72 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.739665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f442c64-ef31-4b8d-ad46-d1b0b2531b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:09.741683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f442c64-ef31-4b8d-ad46-d1b0b2531b72 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:09.770087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1d9d8-7deb-4c56-83f5-fe11e796cc18 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:09.770964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1d9d8-7deb-4c56-83f5-fe11e796cc18 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.771628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1d9d8-7deb-4c56-83f5-fe11e796cc18 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.771913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1d9d8-7deb-4c56-83f5-fe11e796cc18 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects/5d4b3c2fd3b140adbdbb39e98b3aa76f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.773241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1d9d8-7deb-4c56-83f5-fe11e796cc18 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:get_project(project_id=5d4b3c2fd3b140adbdbb39e98b3aa76f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:09.776140 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2073/4150] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:09 2021] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:09.776285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1d9d8-7deb-4c56-83f5-fe11e796cc18 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:09.777700 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2078/4151] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:57:09 2021] GET /identity/v3/projects/5d4b3c2fd3b140adbdbb39e98b3aa76f => generated 389 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:09.780452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f442c64-ef31-4b8d-ad46-d1b0b2531b72 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.784219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1d9d8-7deb-4c56-83f5-fe11e796cc18 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.792503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f442c64-ef31-4b8d-ad46-d1b0b2531b72 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:09.797549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28568d-ce73-447a-b8b7-8bd6bd578ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:09.797718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1d9d8-7deb-4c56-83f5-fe11e796cc18 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:09.798369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28568d-ce73-447a-b8b7-8bd6bd578ceb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.798657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28568d-ce73-447a-b8b7-8bd6bd578ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.799037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28568d-ce73-447a-b8b7-8bd6bd578ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.799974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28568d-ce73-447a-b8b7-8bd6bd578ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:09.801994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28568d-ce73-447a-b8b7-8bd6bd578ceb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:09.813957 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2074/4152] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:09 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:09.818009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28568d-ce73-447a-b8b7-8bd6bd578ceb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.822675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa255531-4a20-41a8-bde7-bbcd1029619e tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:09.823444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255531-4a20-41a8-bde7-bbcd1029619e tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.823760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255531-4a20-41a8-bde7-bbcd1029619e tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.824002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255531-4a20-41a8-bde7-bbcd1029619e tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.827069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa255531-4a20-41a8-bde7-bbcd1029619e tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:09.830763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa255531-4a20-41a8-bde7-bbcd1029619e tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:09.841573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28568d-ce73-447a-b8b7-8bd6bd578ceb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:09.864614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0b22e-e691-4c12-9639-48380fe1e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:09.869797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0b22e-e691-4c12-9639-48380fe1e113 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:09.872289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0b22e-e691-4c12-9639-48380fe1e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:09.872803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0b22e-e691-4c12-9639-48380fe1e113 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:09.877687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0b22e-e691-4c12-9639-48380fe1e113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:09.882581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0b22e-e691-4c12-9639-48380fe1e113 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:09.913067 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2079/4153] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 20:57:09 2021] POST /identity/v3/projects => generated 338 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:09.915137 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2075/4154] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:09 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:57:09.915829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa255531-4a20-41a8-bde7-bbcd1029619e tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.916042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0b22e-e691-4c12-9639-48380fe1e113 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:09.933325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0b22e-e691-4c12-9639-48380fe1e113 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.036465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa255531-4a20-41a8-bde7-bbcd1029619e tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.055442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f3715-2460-472a-a1cc-0b6a34521233 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.057071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065e479-66db-4f6b-a6c2-b89041cfafd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.057968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065e479-66db-4f6b-a6c2-b89041cfafd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.058256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065e479-66db-4f6b-a6c2-b89041cfafd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.058845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065e479-66db-4f6b-a6c2-b89041cfafd9 admin admin] PATH_INFO: `/v3/projects/03c8cfe27fd0403d99e9315b0e5e9c66/users/3d35bf2ec4db4c909ce8533464dde6e6/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.059035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3715-2460-472a-a1cc-0b6a34521233 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.059539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3715-2460-472a-a1cc-0b6a34521233 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.061792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3715-2460-472a-a1cc-0b6a34521233 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.062781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f3715-2460-472a-a1cc-0b6a34521233 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.070328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f3715-2460-472a-a1cc-0b6a34521233 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.096885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065e479-66db-4f6b-a6c2-b89041cfafd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c8cfe27fd0403d99e9315b0e5e9c66, user_id=3d35bf2ec4db4c909ce8533464dde6e6, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.099747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a065e479-66db-4f6b-a6c2-b89041cfafd9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.131078 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2076/4155] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:09 2021] PUT /identity/v3/projects/03c8cfe27fd0403d99e9315b0e5e9c66/users/3d35bf2ec4db4c909ce8533464dde6e6/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:10.132619 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2080/4156] 10.222.0.21 () {58 vars in 1130 bytes} [Sat Nov 27 20:57:09 2021] GET /identity/v3/projects => generated 6994 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:57:10.134934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065e479-66db-4f6b-a6c2-b89041cfafd9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.142850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622a13-a0a8-4de7-93f6-8f57c4c27999 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.143128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622a13-a0a8-4de7-93f6-8f57c4c27999 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.143454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622a13-a0a8-4de7-93f6-8f57c4c27999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.204326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d4622a13-a0a8-4de7-93f6-8f57c4c27999 None None] MFA Rules not processed for user `3d35bf2ec4db4c909ce8533464dde6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:10.205571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d4622a13-a0a8-4de7-93f6-8f57c4c27999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:10.264515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a065e479-66db-4f6b-a6c2-b89041cfafd9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.278539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513acd2-7c30-47c1-ac61-3c889d967453 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.279455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513acd2-7c30-47c1-ac61-3c889d967453 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.279741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513acd2-7c30-47c1-ac61-3c889d967453 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.280019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513acd2-7c30-47c1-ac61-3c889d967453 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects/5d4b3c2fd3b140adbdbb39e98b3aa76f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.288063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513acd2-7c30-47c1-ac61-3c889d967453 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:get_project(project_id=5d4b3c2fd3b140adbdbb39e98b3aa76f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.291958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513acd2-7c30-47c1-ac61-3c889d967453 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.294342 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2077/4157] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:57:10 2021] GET /identity/v3/projects/5d4b3c2fd3b140adbdbb39e98b3aa76f => generated 389 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:57:10.299360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513acd2-7c30-47c1-ac61-3c889d967453 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.324887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513acd2-7c30-47c1-ac61-3c889d967453 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.335976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae057a-0c3b-4723-9fa4-ef511a731d57 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.339736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae057a-0c3b-4723-9fa4-ef511a731d57 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.343553 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2081/4158] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:10 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:57:10.344050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae057a-0c3b-4723-9fa4-ef511a731d57 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.344050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae057a-0c3b-4723-9fa4-ef511a731d57 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects/0efd0f0f7bc44d34a08ae6a10c7e7999` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.344050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae057a-0c3b-4723-9fa4-ef511a731d57 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:get_project(project_id=0efd0f0f7bc44d34a08ae6a10c7e7999)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.345455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622a13-a0a8-4de7-93f6-8f57c4c27999 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.350501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae057a-0c3b-4723-9fa4-ef511a731d57 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.356745 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2078/4159] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:57:10 2021] GET /identity/v3/projects/0efd0f0f7bc44d34a08ae6a10c7e7999 => generated 338 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:57:10.362609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae057a-0c3b-4723-9fa4-ef511a731d57 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.386935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae057a-0c3b-4723-9fa4-ef511a731d57 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.400847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb60db-64de-4506-8a38-d8d7434e24c5 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.401543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb60db-64de-4506-8a38-d8d7434e24c5 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.401973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb60db-64de-4506-8a38-d8d7434e24c5 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.402255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb60db-64de-4506-8a38-d8d7434e24c5 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.403001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb60db-64de-4506-8a38-d8d7434e24c5 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.404896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb60db-64de-4506-8a38-d8d7434e24c5 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.512141 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2079/4160] 10.222.0.21 () {58 vars in 1130 bytes} [Sat Nov 27 20:57:10 2021] GET /identity/v3/projects => generated 6994 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:10.516669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb60db-64de-4506-8a38-d8d7434e24c5 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.532852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb60db-64de-4506-8a38-d8d7434e24c5 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.543782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622a13-a0a8-4de7-93f6-8f57c4c27999 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.548401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4eea0-9d63-4c0e-9d75-6d8edd659e11 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.549117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4eea0-9d63-4c0e-9d75-6d8edd659e11 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.549610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4eea0-9d63-4c0e-9d75-6d8edd659e11 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.549969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4eea0-9d63-4c0e-9d75-6d8edd659e11 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.550904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4eea0-9d63-4c0e-9d75-6d8edd659e11 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:10.551309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4eea0-9d63-4c0e-9d75-6d8edd659e11 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.553290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4eea0-9d63-4c0e-9d75-6d8edd659e11 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.564520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb164d-3f4e-4ead-ab4c-b631b4acbea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.565307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb164d-3f4e-4ead-ab4c-b631b4acbea2 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.565591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb164d-3f4e-4ead-ab4c-b631b4acbea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.567466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb164d-3f4e-4ead-ab4c-b631b4acbea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.570334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb164d-3f4e-4ead-ab4c-b631b4acbea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.576867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb164d-3f4e-4ead-ab4c-b631b4acbea2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.605071 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2080/4161] 10.222.0.21 () {58 vars in 1165 bytes} [Sat Nov 27 20:57:10 2021] GET /identity/v3/projects?domain_id=default => generated 6663 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:10.608789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4eea0-9d63-4c0e-9d75-6d8edd659e11 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.623172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4eea0-9d63-4c0e-9d75-6d8edd659e11 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.631394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ee113-1918-4fe6-81f3-67eb831a0a9a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.632211 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2082/4162] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:10 2021] POST /identity/v3/projects => generated 399 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:10.636033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ee113-1918-4fe6-81f3-67eb831a0a9a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.636372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb164d-3f4e-4ead-ab4c-b631b4acbea2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.636690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ee113-1918-4fe6-81f3-67eb831a0a9a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.637091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ee113-1918-4fe6-81f3-67eb831a0a9a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.638102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ee113-1918-4fe6-81f3-67eb831a0a9a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.640694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ee113-1918-4fe6-81f3-67eb831a0a9a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.668054 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2081/4163] 10.222.0.21 () {58 vars in 1130 bytes} [Sat Nov 27 20:57:10 2021] GET /identity/v3/projects => generated 7381 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:57:10.672866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ee113-1918-4fe6-81f3-67eb831a0a9a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.684773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ee113-1918-4fe6-81f3-67eb831a0a9a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.745378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb164d-3f4e-4ead-ab4c-b631b4acbea2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.752181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708569e-8b9f-45f3-9327-93d69db5c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.753169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708569e-8b9f-45f3-9327-93d69db5c600 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.753657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708569e-8b9f-45f3-9327-93d69db5c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.754090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad6446-e751-4a36-b3f6-d29f4f36ee8c tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.754801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708569e-8b9f-45f3-9327-93d69db5c600 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.755074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad6446-e751-4a36-b3f6-d29f4f36ee8c tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.755475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad6446-e751-4a36-b3f6-d29f4f36ee8c tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.755885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad6446-e751-4a36-b3f6-d29f4f36ee8c tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.756620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708569e-8b9f-45f3-9327-93d69db5c600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.756922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad6446-e751-4a36-b3f6-d29f4f36ee8c tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:10.757296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad6446-e751-4a36-b3f6-d29f4f36ee8c tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.759947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad6446-e751-4a36-b3f6-d29f4f36ee8c tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.760475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708569e-8b9f-45f3-9327-93d69db5c600 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.809281 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2083/4164] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:10 2021] POST /identity/v3/users => generated 306 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:57:10.810031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708569e-8b9f-45f3-9327-93d69db5c600 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.814755 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2082/4165] 10.222.0.21 () {58 vars in 1165 bytes} [Sat Nov 27 20:57:10 2021] GET /identity/v3/projects?domain_id=default => generated 7050 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:10.823868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad6446-e751-4a36-b3f6-d29f4f36ee8c tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.829564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708569e-8b9f-45f3-9327-93d69db5c600 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.838394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad6446-e751-4a36-b3f6-d29f4f36ee8c tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.839861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca89aa-ec73-46a5-870a-bedb7ac2f9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.840296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca89aa-ec73-46a5-870a-bedb7ac2f9cd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.840985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca89aa-ec73-46a5-870a-bedb7ac2f9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.840985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca89aa-ec73-46a5-870a-bedb7ac2f9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.841736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca89aa-ec73-46a5-870a-bedb7ac2f9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.843620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca89aa-ec73-46a5-870a-bedb7ac2f9cd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.848918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f45361-0ed7-4371-8dc3-f6b726594f17 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.850013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f45361-0ed7-4371-8dc3-f6b726594f17 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.850641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f45361-0ed7-4371-8dc3-f6b726594f17 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.851133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f45361-0ed7-4371-8dc3-f6b726594f17 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.852270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f45361-0ed7-4371-8dc3-f6b726594f17 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.854377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f45361-0ed7-4371-8dc3-f6b726594f17 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.875188 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2084/4166] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:10 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:10.879939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca89aa-ec73-46a5-870a-bedb7ac2f9cd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.887055 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2083/4167] 10.222.0.21 () {58 vars in 1130 bytes} [Sat Nov 27 20:57:10 2021] GET /identity/v3/projects => generated 7381 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:57:10.888396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f45361-0ed7-4371-8dc3-f6b726594f17 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.903110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f45361-0ed7-4371-8dc3-f6b726594f17 tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.904787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca89aa-ec73-46a5-870a-bedb7ac2f9cd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.910552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca1009-4ff8-4327-ae5b-7b2a89aeb71a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.911493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca1009-4ff8-4327-ae5b-7b2a89aeb71a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.912154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca1009-4ff8-4327-ae5b-7b2a89aeb71a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.912571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca1009-4ff8-4327-ae5b-7b2a89aeb71a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.913767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca1009-4ff8-4327-ae5b-7b2a89aeb71a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-2143123193) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:10.914005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca1009-4ff8-4327-ae5b-7b2a89aeb71a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.915393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe9a67-15db-4329-97b8-7f55ac6f0e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.917459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca1009-4ff8-4327-ae5b-7b2a89aeb71a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.918198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9a67-15db-4329-97b8-7f55ac6f0e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.918640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9a67-15db-4329-97b8-7f55ac6f0e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.920333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe9a67-15db-4329-97b8-7f55ac6f0e7b admin admin] PATH_INFO: `/v3/projects/89a0fcf23abe43e088d94360e09bfc43/users/626e6df5f42a4b5794e7ebac34e215c6/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.935298 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2084/4168] 10.222.0.21 () {58 vars in 1231 bytes} [Sat Nov 27 20:57:10 2021] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-2143123193 => generated 537 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:10.939147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca1009-4ff8-4327-ae5b-7b2a89aeb71a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:10.949183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe9a67-15db-4329-97b8-7f55ac6f0e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a0fcf23abe43e088d94360e09bfc43, user_id=626e6df5f42a4b5794e7ebac34e215c6, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.953412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe9a67-15db-4329-97b8-7f55ac6f0e7b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.957852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca1009-4ff8-4327-ae5b-7b2a89aeb71a tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:10.965356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cfe0a891154563b1c0b7732315c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbbd3a2f56be444e92da365dc9fc7e67', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:10.966342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:10.966618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:10.966939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] PATH_INFO: `/v3/projects/0efd0f0f7bc44d34a08ae6a10c7e7999` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:10.968533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0efd0f0f7bc44d34a08ae6a10c7e7999)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:10.972261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:10.983520 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2085/4169] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:10 2021] PUT /identity/v3/projects/89a0fcf23abe43e088d94360e09bfc43/users/626e6df5f42a4b5794e7ebac34e215c6/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:10.984395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe9a67-15db-4329-97b8-7f55ac6f0e7b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:11.057018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0efd0f0f7bc44d34a08ae6a10c7e7999', 'request_id': 'req-bfc9a98c-68d7-4d51-845f-e202038d461b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:11.067146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0efd0f0f7bc44d34a08ae6a10c7e7999', 'request_id': 'req-bfc9a98c-68d7-4d51-845f-e202038d461b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:11.076544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe9a67-15db-4329-97b8-7f55ac6f0e7b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:11.080385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0efd0f0f7bc44d34a08ae6a10c7e7999', 'request_id': 'req-bfc9a98c-68d7-4d51-845f-e202038d461b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:11.105266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] The token cache is being invalidate because project 0efd0f0f7bc44d34a08ae6a10c7e7999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:11.105856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:11.108176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:11.114703 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2085/4170] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:10 2021] DELETE /identity/v3/projects/0efd0f0f7bc44d34a08ae6a10c7e7999 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:11.120021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:11.122980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:11.168742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b15882-4b42-48a3-9afa-65b6820093e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:11.170222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15882-4b42-48a3-9afa-65b6820093e4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:11.170571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15882-4b42-48a3-9afa-65b6820093e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:11.170858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15882-4b42-48a3-9afa-65b6820093e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:11.172135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b15882-4b42-48a3-9afa-65b6820093e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:11.174013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b15882-4b42-48a3-9afa-65b6820093e4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:11.202774 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2086/4171] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:10 2021] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:11.212225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b15882-4b42-48a3-9afa-65b6820093e4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:11.216452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-43b15882-4b42-48a3-9afa-65b6820093e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:11.247981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b15882-4b42-48a3-9afa-65b6820093e4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:11.254816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0a229-d6ac-4f75-8e6d-235dfaf03edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:11.255848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a229-d6ac-4f75-8e6d-235dfaf03edd admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:11.256162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a229-d6ac-4f75-8e6d-235dfaf03edd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:11.256441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a229-d6ac-4f75-8e6d-235dfaf03edd admin admin] PATH_INFO: `/v3/projects/89a0fcf23abe43e088d94360e09bfc43/users/626e6df5f42a4b5794e7ebac34e215c6/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:11.259166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0a229-d6ac-4f75-8e6d-235dfaf03edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a0fcf23abe43e088d94360e09bfc43, user_id=626e6df5f42a4b5794e7ebac34e215c6, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:11.261394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9a98c-68d7-4d51-845f-e202038d461b tempest-ListProjectsStaticTestJSON-317085450 tempest-ListProjectsStaticTestJSON-317085450-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:11.261884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0a229-d6ac-4f75-8e6d-235dfaf03edd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:11.275690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f4ed0-d9ed-4c39-bfdc-dcf9192746d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:11.277066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f4ed0-d9ed-4c39-bfdc-dcf9192746d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:11.278397 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2087/4172] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:11 2021] PUT /identity/v3/projects/89a0fcf23abe43e088d94360e09bfc43/users/626e6df5f42a4b5794e7ebac34e215c6/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:11.283946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f4ed0-d9ed-4c39-bfdc-dcf9192746d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:11.284308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f4ed0-d9ed-4c39-bfdc-dcf9192746d9 admin admin] PATH_INFO: `/v3/users/2c03dc0595ca466a966d25f89e448dc4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:11.286062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f4ed0-d9ed-4c39-bfdc-dcf9192746d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c03dc0595ca466a966d25f89e448dc4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:11.290227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2100f0f-0ec9-407c-86b8-e812132e3c2a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:11.291273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2100f0f-0ec9-407c-86b8-e812132e3c2a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:11.291626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2100f0f-0ec9-407c-86b8-e812132e3c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:11.296942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f4ed0-d9ed-4c39-bfdc-dcf9192746d9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:11.347469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c2100f0f-0ec9-407c-86b8-e812132e3c2a None None] MFA Rules not processed for user `626e6df5f42a4b5794e7ebac34e215c6`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:11.350229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c2100f0f-0ec9-407c-86b8-e812132e3c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:11.401940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-260f4ed0-d9ed-4c39-bfdc-dcf9192746d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c03dc0595ca466a966d25f89e448dc4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:11.402789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-260f4ed0-d9ed-4c39-bfdc-dcf9192746d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c03dc0595ca466a966d25f89e448dc4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:11.433456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-260f4ed0-d9ed-4c39-bfdc-dcf9192746d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c03dc0595ca466a966d25f89e448dc4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:11.434934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-260f4ed0-d9ed-4c39-bfdc-dcf9192746d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c03dc0595ca466a966d25f89e448dc4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:11.457247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-260f4ed0-d9ed-4c39-bfdc-dcf9192746d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c03dc0595ca466a966d25f89e448dc4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:11.480621 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2086/4173] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:11 2021] DELETE /identity/v3/users/2c03dc0595ca466a966d25f89e448dc4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:11.485305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402669ce-9843-4083-88e6-298f7be69712 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:11.489187 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2088/4174] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:11 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:11.489369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402669ce-9843-4083-88e6-298f7be69712 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:11.491672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402669ce-9843-4083-88e6-298f7be69712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:11.512756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2100f0f-0ec9-407c-86b8-e812132e3c2a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:11.514274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c2100f0f-0ec9-407c-86b8-e812132e3c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:11.519285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-402669ce-9843-4083-88e6-298f7be69712 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:11.521108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-402669ce-9843-4083-88e6-298f7be69712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:11.615547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2100f0f-0ec9-407c-86b8-e812132e3c2a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:11.661530 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2087/4175] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:11.677510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402669ce-9843-4083-88e6-298f7be69712 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:11.723500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240ae2c-ad67-40d5-9d50-c1a05a96970f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:11.724418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240ae2c-ad67-40d5-9d50-c1a05a96970f service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:11.724812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240ae2c-ad67-40d5-9d50-c1a05a96970f service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:11.726238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240ae2c-ad67-40d5-9d50-c1a05a96970f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:11.736278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c240ae2c-ad67-40d5-9d50-c1a05a96970f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:11.834340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402669ce-9843-4083-88e6-298f7be69712 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:11.840370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc04fa4-2282-4157-974e-0a20ae313f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:11.842557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04fa4-2282-4157-974e-0a20ae313f35 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:11.843509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04fa4-2282-4157-974e-0a20ae313f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:11.843854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04fa4-2282-4157-974e-0a20ae313f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:11.859165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc04fa4-2282-4157-974e-0a20ae313f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:11.862010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc04fa4-2282-4157-974e-0a20ae313f35 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:11.879884 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2088/4176] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:11.896709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240ae2c-ad67-40d5-9d50-c1a05a96970f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:11.899449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240ae2c-ad67-40d5-9d50-c1a05a96970f service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:11.911446 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2089/4177] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:11 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:12.932052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc04fa4-2282-4157-974e-0a20ae313f35 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:12.933830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2dc04fa4-2282-4157-974e-0a20ae313f35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:13.017588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc04fa4-2282-4157-974e-0a20ae313f35 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:13.025073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd3e2c-d3d2-4e53-b27b-650a72c3c9d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:13.028042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3e2c-d3d2-4e53-b27b-650a72c3c9d0 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:13.028586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3e2c-d3d2-4e53-b27b-650a72c3c9d0 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:13.029105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3e2c-d3d2-4e53-b27b-650a72c3c9d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:13.073050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240ae2c-ad67-40d5-9d50-c1a05a96970f service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:13.075337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c240ae2c-ad67-40d5-9d50-c1a05a96970f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:13.103786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240ae2c-ad67-40d5-9d50-c1a05a96970f service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:13.116774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:13.118960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:13.119400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:13.119756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] PATH_INFO: `/v3/projects/5d4b3c2fd3b140adbdbb39e98b3aa76f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:13.123412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4b3c2fd3b140adbdbb39e98b3aa76f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:13.127865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:13.144979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd3e2c-d3d2-4e53-b27b-650a72c3c9d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:13.147343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd3e2c-d3d2-4e53-b27b-650a72c3c9d0 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:13.176338 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2089/4178] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:12 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:13.236390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4b3c2fd3b140adbdbb39e98b3aa76f', 'request_id': 'req-8cd519d4-19d0-4f38-90cf-68386d975865'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:13.254220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4b3c2fd3b140adbdbb39e98b3aa76f', 'request_id': 'req-8cd519d4-19d0-4f38-90cf-68386d975865'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:13.263181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4b3c2fd3b140adbdbb39e98b3aa76f', 'request_id': 'req-8cd519d4-19d0-4f38-90cf-68386d975865'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:13.327543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] The token cache is being invalidate because project 5d4b3c2fd3b140adbdbb39e98b3aa76f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:13.328238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:13.329699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8cd519d4-19d0-4f38-90cf-68386d975865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:13.335614 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2090/4179] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:13 2021] DELETE /identity/v3/projects/5d4b3c2fd3b140adbdbb39e98b3aa76f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:13.337949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd3e2c-d3d2-4e53-b27b-650a72c3c9d0 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:13.351580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd3e2c-d3d2-4e53-b27b-650a72c3c9d0 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:13.438547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd531d-375c-4a89-8a64-ee227fd2b7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:13.439670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd531d-375c-4a89-8a64-ee227fd2b7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:13.440107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd531d-375c-4a89-8a64-ee227fd2b7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:13.440470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd531d-375c-4a89-8a64-ee227fd2b7fd admin admin] PATH_INFO: `/v3/users/08cfe0a891154563b1c0b7732315c981` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:13.443113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd531d-375c-4a89-8a64-ee227fd2b7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=08cfe0a891154563b1c0b7732315c981)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:13.445994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd531d-375c-4a89-8a64-ee227fd2b7fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:13.520359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5fd531d-375c-4a89-8a64-ee227fd2b7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08cfe0a891154563b1c0b7732315c981'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:13.521535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5fd531d-375c-4a89-8a64-ee227fd2b7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08cfe0a891154563b1c0b7732315c981'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:13.532535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5fd531d-375c-4a89-8a64-ee227fd2b7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08cfe0a891154563b1c0b7732315c981'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:13.533589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5fd531d-375c-4a89-8a64-ee227fd2b7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08cfe0a891154563b1c0b7732315c981'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:13.546342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5fd531d-375c-4a89-8a64-ee227fd2b7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08cfe0a891154563b1c0b7732315c981'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:13.582783 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2090/4180] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:13 2021] DELETE /identity/v3/users/08cfe0a891154563b1c0b7732315c981 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:13.959735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba38f01-f79f-42e1-aa6f-04eb21e809ee None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:13.959899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba38f01-f79f-42e1-aa6f-04eb21e809ee None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:13.960196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba38f01-f79f-42e1-aa6f-04eb21e809ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:13.991559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7ba38f01-f79f-42e1-aa6f-04eb21e809ee None None] MFA Rules not processed for user `8e7695cf8df749e9af62b1746e818ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:13.993287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7ba38f01-f79f-42e1-aa6f-04eb21e809ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:14.070065 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2091/4181] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:13 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:14.081436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3238-7154-4198-b923-081183d34a4c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:14.083834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3238-7154-4198-b923-081183d34a4c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:14.084959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3238-7154-4198-b923-081183d34a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:14.112767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-108e3238-7154-4198-b923-081183d34a4c None None] MFA Rules not processed for user `8e7695cf8df749e9af62b1746e818ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:14.114347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-108e3238-7154-4198-b923-081183d34a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:14.129754 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2091/4182] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:14 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:14.970238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba38f01-f79f-42e1-aa6f-04eb21e809ee None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:14.972450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7ba38f01-f79f-42e1-aa6f-04eb21e809ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:15.083709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba38f01-f79f-42e1-aa6f-04eb21e809ee None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:15.092957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:15.093952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:15.094232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:15.094558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] PATH_INFO: `/v3/projects/cbbd3a2f56be444e92da365dc9fc7e67` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:15.096667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbbd3a2f56be444e92da365dc9fc7e67)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:15.099026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:15.168328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbbd3a2f56be444e92da365dc9fc7e67', 'request_id': 'req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:15.183901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbbd3a2f56be444e92da365dc9fc7e67', 'request_id': 'req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:15.215585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbbd3a2f56be444e92da365dc9fc7e67', 'request_id': 'req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:15.246512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] The token cache is being invalidate because project cbbd3a2f56be444e92da365dc9fc7e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:15.249678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:15.250796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-81c4d88d-d6a0-4536-b9a1-3ad52d72cc97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:15.260369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316e8be-7550-44a0-88a8-f22938b78389 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:15.260965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316e8be-7550-44a0-88a8-f22938b78389 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:15.261666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316e8be-7550-44a0-88a8-f22938b78389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:15.262489 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2092/4183] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:14 2021] DELETE /identity/v3/projects/cbbd3a2f56be444e92da365dc9fc7e67 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:15.311660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1316e8be-7550-44a0-88a8-f22938b78389 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:15.313505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1316e8be-7550-44a0-88a8-f22938b78389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:15.422445 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2092/4184] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:15.426348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2966e7-5e1a-4f16-bee2-89b3ed6c6090 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:15.426845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2966e7-5e1a-4f16-bee2-89b3ed6c6090 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:15.427384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2966e7-5e1a-4f16-bee2-89b3ed6c6090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:15.472698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ce2966e7-5e1a-4f16-bee2-89b3ed6c6090 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:15.478348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ce2966e7-5e1a-4f16-bee2-89b3ed6c6090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:15.522238 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2093/4185] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:15.526501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316e8be-7550-44a0-88a8-f22938b78389 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:15.564033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316e8be-7550-44a0-88a8-f22938b78389 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:15.589582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e1c26-556d-471e-a223-9987033542c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:15.590310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1c26-556d-471e-a223-9987033542c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:15.590671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1c26-556d-471e-a223-9987033542c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:15.591446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e1c26-556d-471e-a223-9987033542c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:15.592273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e1c26-556d-471e-a223-9987033542c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:15.592743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e1c26-556d-471e-a223-9987033542c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:15.594982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e1c26-556d-471e-a223-9987033542c6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:15.626919 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2093/4186] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:57:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:15.628098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2966e7-5e1a-4f16-bee2-89b3ed6c6090 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:15.641445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2966e7-5e1a-4f16-bee2-89b3ed6c6090 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:15.651203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe9d8b-1d5a-49ef-b975-3a864eeb33eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:15.653718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe9d8b-1d5a-49ef-b975-3a864eeb33eb admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:15.654090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe9d8b-1d5a-49ef-b975-3a864eeb33eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:15.655211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe9d8b-1d5a-49ef-b975-3a864eeb33eb admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:15.656485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe9d8b-1d5a-49ef-b975-3a864eeb33eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:15.659032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe9d8b-1d5a-49ef-b975-3a864eeb33eb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:15.703414 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2094/4187] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:15 2021] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:15.706130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e1c26-556d-471e-a223-9987033542c6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:15.728478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e1c26-556d-471e-a223-9987033542c6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:15.809527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3d08e-2076-4d99-81c5-541953fa59eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:15.810279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3d08e-2076-4d99-81c5-541953fa59eb admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:15.810560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3d08e-2076-4d99-81c5-541953fa59eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:15.810886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3d08e-2076-4d99-81c5-541953fa59eb admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:15.813055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3d08e-2076-4d99-81c5-541953fa59eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:15.816522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3d08e-2076-4d99-81c5-541953fa59eb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:15.845124 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2094/4188] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:15 2021] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:15.849671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe9d8b-1d5a-49ef-b975-3a864eeb33eb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:15.866507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe9d8b-1d5a-49ef-b975-3a864eeb33eb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:15.876211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378b140-d63d-45a0-b3b4-62f083add525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:15.876811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378b140-d63d-45a0-b3b4-62f083add525 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:15.877247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378b140-d63d-45a0-b3b4-62f083add525 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:15.877910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378b140-d63d-45a0-b3b4-62f083add525 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:15.878947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378b140-d63d-45a0-b3b4-62f083add525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:15.881104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378b140-d63d-45a0-b3b4-62f083add525 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:15.899461 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2095/4189] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:15 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:15.901474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3d08e-2076-4d99-81c5-541953fa59eb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:15.915587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3d08e-2076-4d99-81c5-541953fa59eb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:15.922195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32960d-3a7a-4c70-b9de-8ca06d9ca293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:15.923111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32960d-3a7a-4c70-b9de-8ca06d9ca293 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:15.923509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32960d-3a7a-4c70-b9de-8ca06d9ca293 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:15.923852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32960d-3a7a-4c70-b9de-8ca06d9ca293 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:15.925011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32960d-3a7a-4c70-b9de-8ca06d9ca293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:15.928431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32960d-3a7a-4c70-b9de-8ca06d9ca293 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:15.943304 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2095/4190] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:15 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:57:15.947417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378b140-d63d-45a0-b3b4-62f083add525 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:15.973951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378b140-d63d-45a0-b3b4-62f083add525 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:15.982773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364be295-d16d-43b1-a8d1-bb175ec4921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:15.983944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364be295-d16d-43b1-a8d1-bb175ec4921e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:15.984703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364be295-d16d-43b1-a8d1-bb175ec4921e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:15.986253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364be295-d16d-43b1-a8d1-bb175ec4921e admin admin] PATH_INFO: `/v3/projects/fbc05b0c433942d4b3a3b7d148a4513b/users/a1c63410ce7d47c7957be6e3dfbdea6e/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:16.020172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364be295-d16d-43b1-a8d1-bb175ec4921e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc05b0c433942d4b3a3b7d148a4513b, user_id=a1c63410ce7d47c7957be6e3dfbdea6e, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:16.023115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364be295-d16d-43b1-a8d1-bb175ec4921e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:16.043193 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2096/4191] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:15 2021] PUT /identity/v3/projects/fbc05b0c433942d4b3a3b7d148a4513b/users/a1c63410ce7d47c7957be6e3dfbdea6e/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:16.056875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27cb4-41d6-4af7-8bd6-c9241a7e605a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:16.058578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27cb4-41d6-4af7-8bd6-c9241a7e605a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:16.059162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27cb4-41d6-4af7-8bd6-c9241a7e605a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:16.108937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-18c27cb4-41d6-4af7-8bd6-c9241a7e605a None None] MFA Rules not processed for user `a1c63410ce7d47c7957be6e3dfbdea6e`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:16.111085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-18c27cb4-41d6-4af7-8bd6-c9241a7e605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:16.192226 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2096/4192] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:16 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:16.197373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364be295-d16d-43b1-a8d1-bb175ec4921e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:16.290814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364be295-d16d-43b1-a8d1-bb175ec4921e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:16.298000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8159-62c1-469d-9596-492b37962939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:16.298979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8159-62c1-469d-9596-492b37962939 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:16.299472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8159-62c1-469d-9596-492b37962939 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:16.299754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8159-62c1-469d-9596-492b37962939 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:16.300720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8159-62c1-469d-9596-492b37962939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:16.303962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8159-62c1-469d-9596-492b37962939 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:16.337612 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2097/4193] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:16 2021] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:16.342369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c27cb4-41d6-4af7-8bd6-c9241a7e605a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:16.355184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c27cb4-41d6-4af7-8bd6-c9241a7e605a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:16.462155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14043-3ca8-4fa0-bed3-86a0a7b8c66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:16.463408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14043-3ca8-4fa0-bed3-86a0a7b8c66e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:16.464066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14043-3ca8-4fa0-bed3-86a0a7b8c66e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:16.464556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14043-3ca8-4fa0-bed3-86a0a7b8c66e admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:16.465816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a14043-3ca8-4fa0-bed3-86a0a7b8c66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:16.468267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a14043-3ca8-4fa0-bed3-86a0a7b8c66e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:16.504721 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2097/4194] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:16 2021] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:16.508776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8159-62c1-469d-9596-492b37962939 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:16.520062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14043-3ca8-4fa0-bed3-86a0a7b8c66e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:16.522773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-61a14043-3ca8-4fa0-bed3-86a0a7b8c66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:16.523151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8159-62c1-469d-9596-492b37962939 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:16.531937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e5013-14ea-4630-bcc5-d34e2f1fa58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:16.533414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e5013-14ea-4630-bcc5-d34e2f1fa58d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:16.533701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e5013-14ea-4630-bcc5-d34e2f1fa58d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:16.533974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e5013-14ea-4630-bcc5-d34e2f1fa58d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:16.535532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e5013-14ea-4630-bcc5-d34e2f1fa58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:16.541601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e5013-14ea-4630-bcc5-d34e2f1fa58d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:16.578136 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2098/4195] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:16 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:16.582227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e5013-14ea-4630-bcc5-d34e2f1fa58d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:16.595303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e5013-14ea-4630-bcc5-d34e2f1fa58d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:16.607197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f2653-18e9-40ca-8f31-0fb095cadfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:16.608352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f2653-18e9-40ca-8f31-0fb095cadfb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:16.608639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f2653-18e9-40ca-8f31-0fb095cadfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:16.609044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f2653-18e9-40ca-8f31-0fb095cadfb8 admin admin] PATH_INFO: `/v3/projects/56c6b3ce78a440edb867e0f833c831f8/users/6bb4cfa923aa436fb756ba7ec8a86f42/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:16.627826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f2653-18e9-40ca-8f31-0fb095cadfb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c6b3ce78a440edb867e0f833c831f8, user_id=6bb4cfa923aa436fb756ba7ec8a86f42, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:16.631229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f2653-18e9-40ca-8f31-0fb095cadfb8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:16.633687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14043-3ca8-4fa0-bed3-86a0a7b8c66e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:16.638094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0344a-024b-4c6f-9563-5199626bf2e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:16.638708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0344a-024b-4c6f-9563-5199626bf2e6 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:16.639043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0344a-024b-4c6f-9563-5199626bf2e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:16.639485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0344a-024b-4c6f-9563-5199626bf2e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:16.642838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-46b0344a-024b-4c6f-9563-5199626bf2e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:16.655960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0344a-024b-4c6f-9563-5199626bf2e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:16.656298 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2099/4196] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:16 2021] PUT /identity/v3/projects/56c6b3ce78a440edb867e0f833c831f8/users/6bb4cfa923aa436fb756ba7ec8a86f42/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:16.660447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0344a-024b-4c6f-9563-5199626bf2e6 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:16.662263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f2653-18e9-40ca-8f31-0fb095cadfb8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:16.671871 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2098/4197] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:16 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:16.749119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f2653-18e9-40ca-8f31-0fb095cadfb8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:16.755595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08571b8-cc9f-4669-855d-5f4306a71a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:16.756486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08571b8-cc9f-4669-855d-5f4306a71a1a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:16.756989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08571b8-cc9f-4669-855d-5f4306a71a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:16.757704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08571b8-cc9f-4669-855d-5f4306a71a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:16.758843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08571b8-cc9f-4669-855d-5f4306a71a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:16.760651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08571b8-cc9f-4669-855d-5f4306a71a1a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:16.781539 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2100/4198] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:16 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:16.783463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0344a-024b-4c6f-9563-5199626bf2e6 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:16.801299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0344a-024b-4c6f-9563-5199626bf2e6 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:16.807451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e33db-27c0-4ee5-a371-549522534f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:16.809162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e33db-27c0-4ee5-a371-549522534f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:16.809760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e33db-27c0-4ee5-a371-549522534f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:16.810241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e33db-27c0-4ee5-a371-549522534f57 admin admin] PATH_INFO: `/v3/projects/56c6b3ce78a440edb867e0f833c831f8/users/6bb4cfa923aa436fb756ba7ec8a86f42/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:16.812713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e33db-27c0-4ee5-a371-549522534f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c6b3ce78a440edb867e0f833c831f8, user_id=6bb4cfa923aa436fb756ba7ec8a86f42, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:16.816166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e33db-27c0-4ee5-a371-549522534f57 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:16.831345 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2099/4199] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:16 2021] PUT /identity/v3/projects/56c6b3ce78a440edb867e0f833c831f8/users/6bb4cfa923aa436fb756ba7ec8a86f42/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:16.840954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f8d5d-e206-454f-87c2-7200fb65a3e8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:16.841281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f8d5d-e206-454f-87c2-7200fb65a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:16.841520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f8d5d-e206-454f-87c2-7200fb65a3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:16.887609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-301f8d5d-e206-454f-87c2-7200fb65a3e8 None None] MFA Rules not processed for user `6bb4cfa923aa436fb756ba7ec8a86f42`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:16.889750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-301f8d5d-e206-454f-87c2-7200fb65a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:17.005997 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2101/4200] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:16 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:17.008790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e33db-27c0-4ee5-a371-549522534f57 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:17.125980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e33db-27c0-4ee5-a371-549522534f57 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:17.135552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656653c5-a655-417c-bd72-b87341f49896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:17.136273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656653c5-a655-417c-bd72-b87341f49896 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:17.137289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656653c5-a655-417c-bd72-b87341f49896 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:17.137564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656653c5-a655-417c-bd72-b87341f49896 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:17.138428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656653c5-a655-417c-bd72-b87341f49896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:17.140864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656653c5-a655-417c-bd72-b87341f49896 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:17.178118 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2100/4201] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:17 2021] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:17.183612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f8d5d-e206-454f-87c2-7200fb65a3e8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:17.198004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f8d5d-e206-454f-87c2-7200fb65a3e8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:17.280909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22243c3c-1ef1-479b-a004-a2e6054b2f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:17.281749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22243c3c-1ef1-479b-a004-a2e6054b2f90 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:17.282089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22243c3c-1ef1-479b-a004-a2e6054b2f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:17.282507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22243c3c-1ef1-479b-a004-a2e6054b2f90 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:17.283457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22243c3c-1ef1-479b-a004-a2e6054b2f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:17.285697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22243c3c-1ef1-479b-a004-a2e6054b2f90 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:17.309297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2102/4202] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:17 2021] POST /identity/v3/users => generated 285 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:17.314134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656653c5-a655-417c-bd72-b87341f49896 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:17.327687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656653c5-a655-417c-bd72-b87341f49896 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:17.333719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8c297-e3b3-47e0-bbb5-b0d66b92ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:17.334457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c297-e3b3-47e0-bbb5-b0d66b92ec2a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:17.334955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c297-e3b3-47e0-bbb5-b0d66b92ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:17.335069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c297-e3b3-47e0-bbb5-b0d66b92ec2a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:17.336669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8c297-e3b3-47e0-bbb5-b0d66b92ec2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:17.338842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8c297-e3b3-47e0-bbb5-b0d66b92ec2a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:17.353205 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2101/4203] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:17 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:17.356875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22243c3c-1ef1-479b-a004-a2e6054b2f90 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:17.369045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22243c3c-1ef1-479b-a004-a2e6054b2f90 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:17.375018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32c09f-cecf-433c-9183-9e8457835eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:17.375836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32c09f-cecf-433c-9183-9e8457835eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:17.376140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32c09f-cecf-433c-9183-9e8457835eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:17.376487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32c09f-cecf-433c-9183-9e8457835eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:17.377510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32c09f-cecf-433c-9183-9e8457835eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:17.379669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32c09f-cecf-433c-9183-9e8457835eb6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:17.392522 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2103/4204] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:17 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:17.396858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8c297-e3b3-47e0-bbb5-b0d66b92ec2a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:17.412734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8c297-e3b3-47e0-bbb5-b0d66b92ec2a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:17.419240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ba98f-fee3-4f57-8c64-f77e7eef71a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:17.420364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba98f-fee3-4f57-8c64-f77e7eef71a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:17.420661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba98f-fee3-4f57-8c64-f77e7eef71a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:17.420989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba98f-fee3-4f57-8c64-f77e7eef71a9 admin admin] PATH_INFO: `/v3/projects/fd63c2cc89124cd98641639372a7dfd8/users/35c29f92a3204429822a2ce208a8212b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:17.471842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ba98f-fee3-4f57-8c64-f77e7eef71a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd63c2cc89124cd98641639372a7dfd8, user_id=35c29f92a3204429822a2ce208a8212b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:17.478085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ba98f-fee3-4f57-8c64-f77e7eef71a9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:17.537757 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2102/4205] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:17 2021] PUT /identity/v3/projects/fd63c2cc89124cd98641639372a7dfd8/users/35c29f92a3204429822a2ce208a8212b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:17.548880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd33ca-1ca3-4729-8648-625b2a9d7bfe None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:17.549922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd33ca-1ca3-4729-8648-625b2a9d7bfe None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:17.549922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd33ca-1ca3-4729-8648-625b2a9d7bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:17.591493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2dfd33ca-1ca3-4729-8648-625b2a9d7bfe None None] MFA Rules not processed for user `35c29f92a3204429822a2ce208a8212b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:17.593553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2dfd33ca-1ca3-4729-8648-625b2a9d7bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:17.765517 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2104/4206] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:17 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:17.772306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ba98f-fee3-4f57-8c64-f77e7eef71a9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:17.874106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ba98f-fee3-4f57-8c64-f77e7eef71a9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:17.881583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fc2e5-e596-41cc-8b11-c7b4506e89c8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:17.882403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fc2e5-e596-41cc-8b11-c7b4506e89c8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:17.883472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fc2e5-e596-41cc-8b11-c7b4506e89c8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:17.883835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fc2e5-e596-41cc-8b11-c7b4506e89c8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:17.885472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fc2e5-e596-41cc-8b11-c7b4506e89c8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:17.887658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fc2e5-e596-41cc-8b11-c7b4506e89c8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:17.916153 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2103/4207] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:57:17 2021] POST /identity/v3/domains => generated 276 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:17.919093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd33ca-1ca3-4729-8648-625b2a9d7bfe None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:17.942098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd33ca-1ca3-4729-8648-625b2a9d7bfe None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:18.060849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c03df7-0762-45bb-95c4-dc1bb15bd7b2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:18.061671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c03df7-0762-45bb-95c4-dc1bb15bd7b2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:18.062037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c03df7-0762-45bb-95c4-dc1bb15bd7b2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:18.062492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c03df7-0762-45bb-95c4-dc1bb15bd7b2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:18.063379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c03df7-0762-45bb-95c4-dc1bb15bd7b2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:18.065208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c03df7-0762-45bb-95c4-dc1bb15bd7b2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:18.089728 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2105/4208] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:57:17 2021] POST /identity/v3/roles => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:57:18.094292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fc2e5-e596-41cc-8b11-c7b4506e89c8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:18.117717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fc2e5-e596-41cc-8b11-c7b4506e89c8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:18.127477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6398b4-9e0e-4ccb-b2d5-a6f266a60a18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:18.129310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6398b4-9e0e-4ccb-b2d5-a6f266a60a18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:18.129742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6398b4-9e0e-4ccb-b2d5-a6f266a60a18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:18.130212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6398b4-9e0e-4ccb-b2d5-a6f266a60a18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/8e121eb6eabf4f4bb5932ad3a042cae8/users/35c29f92a3204429822a2ce208a8212b/roles/c55b9f1d37da4b0a8f1c269d7c00b31c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:18.150018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6398b4-9e0e-4ccb-b2d5-a6f266a60a18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8e121eb6eabf4f4bb5932ad3a042cae8, user_id=35c29f92a3204429822a2ce208a8212b, role_id=c55b9f1d37da4b0a8f1c269d7c00b31c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:18.153058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6398b4-9e0e-4ccb-b2d5-a6f266a60a18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:18.188975 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2104/4209] 10.222.0.21 () {60 vars in 1479 bytes} [Sat Nov 27 20:57:18 2021] PUT /identity/v3/domains/8e121eb6eabf4f4bb5932ad3a042cae8/users/35c29f92a3204429822a2ce208a8212b/roles/c55b9f1d37da4b0a8f1c269d7c00b31c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:18.197350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c03df7-0762-45bb-95c4-dc1bb15bd7b2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:18.225955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c03df7-0762-45bb-95c4-dc1bb15bd7b2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:18.368854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300cb39-07a8-41e9-a064-2c3d8e8c626b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:18.369539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300cb39-07a8-41e9-a064-2c3d8e8c626b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:18.369831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300cb39-07a8-41e9-a064-2c3d8e8c626b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:18.370105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300cb39-07a8-41e9-a064-2c3d8e8c626b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:18.370995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300cb39-07a8-41e9-a064-2c3d8e8c626b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:18.373059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300cb39-07a8-41e9-a064-2c3d8e8c626b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:18.401641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6398b4-9e0e-4ccb-b2d5-a6f266a60a18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:18.403680 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2106/4210] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:57:18 2021] POST /identity/v3/domains => generated 274 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:18.421355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6398b4-9e0e-4ccb-b2d5-a6f266a60a18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:18.574394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4045b3-7129-4409-9ce4-b230efa83544 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:18.576402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4045b3-7129-4409-9ce4-b230efa83544 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:18.577867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4045b3-7129-4409-9ce4-b230efa83544 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:18.579398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4045b3-7129-4409-9ce4-b230efa83544 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:18.584676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4045b3-7129-4409-9ce4-b230efa83544 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:18.591973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4045b3-7129-4409-9ce4-b230efa83544 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:18.623878 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2105/4211] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:57:18 2021] POST /identity/v3/roles => generated 239 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:18.631790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300cb39-07a8-41e9-a064-2c3d8e8c626b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:18.654271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300cb39-07a8-41e9-a064-2c3d8e8c626b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:18.668085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b01d66-d4c0-4e9f-9c55-7f712873d72b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:18.668781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b01d66-d4c0-4e9f-9c55-7f712873d72b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:18.669104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b01d66-d4c0-4e9f-9c55-7f712873d72b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:18.669372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b01d66-d4c0-4e9f-9c55-7f712873d72b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:18.670047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b01d66-d4c0-4e9f-9c55-7f712873d72b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:18.675023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b01d66-d4c0-4e9f-9c55-7f712873d72b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:18.733778 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2107/4212] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:57:18 2021] POST /identity/v3/groups => generated 326 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:18.738612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4045b3-7129-4409-9ce4-b230efa83544 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:18.754099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4045b3-7129-4409-9ce4-b230efa83544 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:18.764572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41c45-e1fc-4f65-abe4-83b5193b92c7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:18.766891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41c45-e1fc-4f65-abe4-83b5193b92c7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:18.767785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41c45-e1fc-4f65-abe4-83b5193b92c7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:18.768572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d41c45-e1fc-4f65-abe4-83b5193b92c7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/groups/02e841ad9df44ef992952fbb0b2c727a/users/35c29f92a3204429822a2ce208a8212b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:18.781786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d41c45-e1fc-4f65-abe4-83b5193b92c7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=02e841ad9df44ef992952fbb0b2c727a, user_id=35c29f92a3204429822a2ce208a8212b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:18.785969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d41c45-e1fc-4f65-abe4-83b5193b92c7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:18.851265 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2106/4213] 10.222.0.21 () {60 vars in 1359 bytes} [Sat Nov 27 20:57:18 2021] PUT /identity/v3/groups/02e841ad9df44ef992952fbb0b2c727a/users/35c29f92a3204429822a2ce208a8212b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:18.853142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b01d66-d4c0-4e9f-9c55-7f712873d72b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:18.872724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b01d66-d4c0-4e9f-9c55-7f712873d72b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:19.085575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25919c31-ee79-44f0-ac48-697cbb65351f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:19.091402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25919c31-ee79-44f0-ac48-697cbb65351f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:19.092849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25919c31-ee79-44f0-ac48-697cbb65351f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:19.093499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25919c31-ee79-44f0-ac48-697cbb65351f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/2fcb3b15d7a4499f84a00432558f68bd/groups/02e841ad9df44ef992952fbb0b2c727a/roles/fa2c1730e2f143cebb7de7f3b41e6fc4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:19.101146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25919c31-ee79-44f0-ac48-697cbb65351f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2fcb3b15d7a4499f84a00432558f68bd, group_id=02e841ad9df44ef992952fbb0b2c727a, role_id=fa2c1730e2f143cebb7de7f3b41e6fc4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:19.118869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25919c31-ee79-44f0-ac48-697cbb65351f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:19.155324 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2108/4214] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:18 2021] PUT /identity/v3/domains/2fcb3b15d7a4499f84a00432558f68bd/groups/02e841ad9df44ef992952fbb0b2c727a/roles/fa2c1730e2f143cebb7de7f3b41e6fc4 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:19.159810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41c45-e1fc-4f65-abe4-83b5193b92c7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:19.175787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d41c45-e1fc-4f65-abe4-83b5193b92c7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:19.308034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf1811-6d45-4acf-84fa-502ce7866393 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:19.309147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf1811-6d45-4acf-84fa-502ce7866393 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:19.309879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf1811-6d45-4acf-84fa-502ce7866393 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:19.310368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf1811-6d45-4acf-84fa-502ce7866393 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:19.311398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf1811-6d45-4acf-84fa-502ce7866393 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:19.314452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf1811-6d45-4acf-84fa-502ce7866393 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:19.369508 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2107/4215] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:57:19 2021] POST /identity/v3/domains => generated 276 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:57:19.373541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25919c31-ee79-44f0-ac48-697cbb65351f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:19.387137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25919c31-ee79-44f0-ac48-697cbb65351f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:19.511555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf1811-6d45-4acf-84fa-502ce7866393 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:19.514930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-84cf1811-6d45-4acf-84fa-502ce7866393 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:19.537978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2fa37-62de-4d09-b991-5158ecbfd8af tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:19.538601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2fa37-62de-4d09-b991-5158ecbfd8af tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:19.538968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2fa37-62de-4d09-b991-5158ecbfd8af tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:19.539374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2fa37-62de-4d09-b991-5158ecbfd8af tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:19.540174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2fa37-62de-4d09-b991-5158ecbfd8af tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:19.542097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2fa37-62de-4d09-b991-5158ecbfd8af tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:19.571599 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2109/4216] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:57:19 2021] POST /identity/v3/roles => generated 240 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:57:19.575112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2fa37-62de-4d09-b991-5158ecbfd8af tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:19.589314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2fa37-62de-4d09-b991-5158ecbfd8af tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:19.596497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27b08-d930-4a39-9911-059e77eb1fb7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:19.597748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27b08-d930-4a39-9911-059e77eb1fb7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:19.598103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27b08-d930-4a39-9911-059e77eb1fb7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:19.598818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e27b08-d930-4a39-9911-059e77eb1fb7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/970213bc49e1495692cce5a4c3898924/users/35c29f92a3204429822a2ce208a8212b/roles/7afe68391c5647b4aadeef96821b28c8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:19.621390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27b08-d930-4a39-9911-059e77eb1fb7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=970213bc49e1495692cce5a4c3898924, user_id=35c29f92a3204429822a2ce208a8212b, role_id=7afe68391c5647b4aadeef96821b28c8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:19.627789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e27b08-d930-4a39-9911-059e77eb1fb7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:19.655827 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2110/4217] 10.222.0.21 () {60 vars in 1479 bytes} [Sat Nov 27 20:57:19 2021] PUT /identity/v3/domains/970213bc49e1495692cce5a4c3898924/users/35c29f92a3204429822a2ce208a8212b/roles/7afe68391c5647b4aadeef96821b28c8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:19.661240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27b08-d930-4a39-9911-059e77eb1fb7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:19.664055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf1811-6d45-4acf-84fa-502ce7866393 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:19.801337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:19.802574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:19.803055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:19.803543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] PATH_INFO: `/v3/users/7c837598a18f439d93cfce37b86aa235` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:19.806330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c837598a18f439d93cfce37b86aa235)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:19.808588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:19.884856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e27b08-d930-4a39-9911-059e77eb1fb7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:19.901888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9082df5-c690-499e-b08b-c5b74d4f2f8c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:19.911907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9082df5-c690-499e-b08b-c5b74d4f2f8c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:19.912259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9082df5-c690-499e-b08b-c5b74d4f2f8c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:19.915625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9082df5-c690-499e-b08b-c5b74d4f2f8c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:19.916515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9082df5-c690-499e-b08b-c5b74d4f2f8c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:19.918495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9082df5-c690-499e-b08b-c5b74d4f2f8c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:19.937080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c837598a18f439d93cfce37b86aa235'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:19.937846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c837598a18f439d93cfce37b86aa235'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:19.958027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c837598a18f439d93cfce37b86aa235'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:19.958770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c837598a18f439d93cfce37b86aa235'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:19.959489 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2111/4218] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:57:19 2021] POST /identity/v3/domains => generated 277 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:19.967429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9082df5-c690-499e-b08b-c5b74d4f2f8c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:19.969625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b9082df5-c690-499e-b08b-c5b74d4f2f8c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:19.976439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c837598a18f439d93cfce37b86aa235'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:20.015164 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2108/4219] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:19 2021] DELETE /identity/v3/users/7c837598a18f439d93cfce37b86aa235 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:20.091584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9082df5-c690-499e-b08b-c5b74d4f2f8c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:20.178925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f152e2-b387-4295-a54c-8dbea1ebfcfe tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:20.181356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f152e2-b387-4295-a54c-8dbea1ebfcfe tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:20.181740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f152e2-b387-4295-a54c-8dbea1ebfcfe tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:20.182165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f152e2-b387-4295-a54c-8dbea1ebfcfe tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:20.183324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f152e2-b387-4295-a54c-8dbea1ebfcfe tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:20.185236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f152e2-b387-4295-a54c-8dbea1ebfcfe tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:20.209542 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2112/4220] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:57:19 2021] POST /identity/v3/roles => generated 240 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:20.210308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:20.226637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a7942-7b71-40eb-b12d-44d522121bc8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:20.232856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a3d24-e56c-4786-87ba-d36b30da6c8d tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:20.233652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a3d24-e56c-4786-87ba-d36b30da6c8d tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:20.234037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a3d24-e56c-4786-87ba-d36b30da6c8d tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:20.234259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a3d24-e56c-4786-87ba-d36b30da6c8d tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/groups` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:20.235905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a3d24-e56c-4786-87ba-d36b30da6c8d tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:20.243337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a3d24-e56c-4786-87ba-d36b30da6c8d tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:20.291623 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2109/4221] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:57:20 2021] POST /identity/v3/groups => generated 326 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:57:20.296092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f152e2-b387-4295-a54c-8dbea1ebfcfe tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:20.318404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f152e2-b387-4295-a54c-8dbea1ebfcfe tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:20.327623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d391b3-5bbc-4082-84a2-a8e508656c78 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:20.328592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d391b3-5bbc-4082-84a2-a8e508656c78 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:20.329139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d391b3-5bbc-4082-84a2-a8e508656c78 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:20.329490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d391b3-5bbc-4082-84a2-a8e508656c78 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/groups/4f90b79cc0a54073b7ce48da57f60389/users/35c29f92a3204429822a2ce208a8212b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:20.337540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d391b3-5bbc-4082-84a2-a8e508656c78 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4f90b79cc0a54073b7ce48da57f60389, user_id=35c29f92a3204429822a2ce208a8212b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:20.341253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d391b3-5bbc-4082-84a2-a8e508656c78 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:20.403308 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2113/4222] 10.222.0.21 () {60 vars in 1359 bytes} [Sat Nov 27 20:57:20 2021] PUT /identity/v3/groups/4f90b79cc0a54073b7ce48da57f60389/users/35c29f92a3204429822a2ce208a8212b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:20.405451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a3d24-e56c-4786-87ba-d36b30da6c8d tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:20.422272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d391b3-5bbc-4082-84a2-a8e508656c78 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:20.428804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-03d391b3-5bbc-4082-84a2-a8e508656c78 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:20.432540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a3d24-e56c-4786-87ba-d36b30da6c8d tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:20.548300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366482-2403-4bb7-95f3-0a76609bbee2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:20.549825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366482-2403-4bb7-95f3-0a76609bbee2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:20.550035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366482-2403-4bb7-95f3-0a76609bbee2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:20.550524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7366482-2403-4bb7-95f3-0a76609bbee2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/9577c15ac0b2444d8797bdf954ed5707/groups/4f90b79cc0a54073b7ce48da57f60389/roles/25666e98435f4b95ae7e704d29374ff5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:20.554507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7366482-2403-4bb7-95f3-0a76609bbee2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9577c15ac0b2444d8797bdf954ed5707, group_id=4f90b79cc0a54073b7ce48da57f60389, role_id=25666e98435f4b95ae7e704d29374ff5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:20.558002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7366482-2403-4bb7-95f3-0a76609bbee2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:20.578959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d391b3-5bbc-4082-84a2-a8e508656c78 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:20.591139 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2110/4223] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:20 2021] PUT /identity/v3/domains/9577c15ac0b2444d8797bdf954ed5707/groups/4f90b79cc0a54073b7ce48da57f60389/roles/25666e98435f4b95ae7e704d29374ff5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:20.595358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366482-2403-4bb7-95f3-0a76609bbee2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:20.599044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f7366482-2403-4bb7-95f3-0a76609bbee2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:20.699226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:20.700138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:20.700422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:20.700697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] PATH_INFO: `/v3/projects/659003b54d7c4726bc5197bfd351d3c1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:20.708390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=659003b54d7c4726bc5197bfd351d3c1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:20.712449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:20.807866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7366482-2403-4bb7-95f3-0a76609bbee2 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:20.830033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659003b54d7c4726bc5197bfd351d3c1', 'request_id': 'req-7a928ee8-fd34-449a-b524-23313a913f05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:20.852596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659003b54d7c4726bc5197bfd351d3c1', 'request_id': 'req-7a928ee8-fd34-449a-b524-23313a913f05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:20.864306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659003b54d7c4726bc5197bfd351d3c1', 'request_id': 'req-7a928ee8-fd34-449a-b524-23313a913f05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:20.880674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] The token cache is being invalidate because project 659003b54d7c4726bc5197bfd351d3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:20.881288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:20.882771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7a928ee8-fd34-449a-b524-23313a913f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:20.885907 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2114/4224] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:20 2021] DELETE /identity/v3/projects/659003b54d7c4726bc5197bfd351d3c1 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:20.894443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444ad7-2e3c-4f07-bbe7-52940890c536 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:20.894742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444ad7-2e3c-4f07-bbe7-52940890c536 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:20.895025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444ad7-2e3c-4f07-bbe7-52940890c536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:20.942806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-00444ad7-2e3c-4f07-bbe7-52940890c536 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:20.946299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-00444ad7-2e3c-4f07-bbe7-52940890c536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:21.019622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecea7-ef3e-4d35-9055-bb5aae662453 tempest-TokensV3TestJSON-1443066660 tempest-TokensV3TestJSON-1443066660-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35c29f92a3204429822a2ce208a8212b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd63c2cc89124cd98641639372a7dfd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:21.020880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecea7-ef3e-4d35-9055-bb5aae662453 tempest-TokensV3TestJSON-1443066660 tempest-TokensV3TestJSON-1443066660-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:21.021244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecea7-ef3e-4d35-9055-bb5aae662453 tempest-TokensV3TestJSON-1443066660 tempest-TokensV3TestJSON-1443066660-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:21.022703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecea7-ef3e-4d35-9055-bb5aae662453 tempest-TokensV3TestJSON-1443066660 tempest-TokensV3TestJSON-1443066660-project] PATH_INFO: `/v3/auth/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:21.024648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ecea7-ef3e-4d35-9055-bb5aae662453 tempest-TokensV3TestJSON-1443066660 tempest-TokensV3TestJSON-1443066660-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:21.026605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ecea7-ef3e-4d35-9055-bb5aae662453 tempest-TokensV3TestJSON-1443066660 tempest-TokensV3TestJSON-1443066660-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:21.102830 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2115/4225] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:21.116313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b8f37-8fbc-4e60-ad9e-edae7db19796 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:21.116862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b8f37-8fbc-4e60-ad9e-edae7db19796 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:21.117845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b8f37-8fbc-4e60-ad9e-edae7db19796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:21.194845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bb8b8f37-8fbc-4e60-ad9e-edae7db19796 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:21.201086 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2111/4226] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:57:20 2021] GET /identity/v3/auth/domains => generated 1171 bytes in 609 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:21.206702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecea7-ef3e-4d35-9055-bb5aae662453 tempest-TokensV3TestJSON-1443066660 tempest-TokensV3TestJSON-1443066660-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:21.212077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bb8b8f37-8fbc-4e60-ad9e-edae7db19796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:21.215522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3b8ecea7-ef3e-4d35-9055-bb5aae662453 tempest-TokensV3TestJSON-1443066660 tempest-TokensV3TestJSON-1443066660-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:21.245759 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2116/4227] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:21.249041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b8f37-8fbc-4e60-ad9e-edae7db19796 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:21.274748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b8f37-8fbc-4e60-ad9e-edae7db19796 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:21.300004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d3eb8-982b-4a5a-8475-5522cb2245d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:21.301068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d3eb8-982b-4a5a-8475-5522cb2245d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:21.301726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d3eb8-982b-4a5a-8475-5522cb2245d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:21.302451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d3eb8-982b-4a5a-8475-5522cb2245d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:21.304293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d3eb8-982b-4a5a-8475-5522cb2245d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:21.305418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d3eb8-982b-4a5a-8475-5522cb2245d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:21.310327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d3eb8-982b-4a5a-8475-5522cb2245d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:21.350223 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2117/4228] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:57:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:21.351931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d3eb8-982b-4a5a-8475-5522cb2245d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:21.379220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d3eb8-982b-4a5a-8475-5522cb2245d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:21.390038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fc3d3-0330-40d2-8814-503cdc75c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:21.391750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc3d3-0330-40d2-8814-503cdc75c396 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:21.392826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc3d3-0330-40d2-8814-503cdc75c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:21.393601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc3d3-0330-40d2-8814-503cdc75c396 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:21.394893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fc3d3-0330-40d2-8814-503cdc75c396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:21.399749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fc3d3-0330-40d2-8814-503cdc75c396 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:21.452285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecea7-ef3e-4d35-9055-bb5aae662453 tempest-TokensV3TestJSON-1443066660 tempest-TokensV3TestJSON-1443066660-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:21.465828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:21.467530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:21.467969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:21.468262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/9577c15ac0b2444d8797bdf954ed5707/groups/4f90b79cc0a54073b7ce48da57f60389/roles/25666e98435f4b95ae7e704d29374ff5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:21.470915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9577c15ac0b2444d8797bdf954ed5707, group_id=4f90b79cc0a54073b7ce48da57f60389, role_id=25666e98435f4b95ae7e704d29374ff5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:21.473487 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2118/4229] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:21 2021] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:21.475111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fc3d3-0330-40d2-8814-503cdc75c396 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:21.481546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:21.501078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invalidating the token cache because role 25666e98435f4b95ae7e704d29374ff5 was removed from group 4f90b79cc0a54073b7ce48da57f60389 on domain 9577c15ac0b2444d8797bdf954ed5707. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:21.502112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:21.503560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:21.535719 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2112/4230] 10.222.0.21 () {58 vars in 1466 bytes} [Sat Nov 27 20:57:21 2021] DELETE /identity/v3/domains/9577c15ac0b2444d8797bdf954ed5707/groups/4f90b79cc0a54073b7ce48da57f60389/roles/25666e98435f4b95ae7e704d29374ff5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:21.541323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:21.543695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:21.642718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8dc9b-6308-424d-a8b2-6025703b5f1c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:21.648985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acddcb-f366-4786-9684-659a750111eb tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:21.649156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fc3d3-0330-40d2-8814-503cdc75c396 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:21.650116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acddcb-f366-4786-9684-659a750111eb tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:21.650425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acddcb-f366-4786-9684-659a750111eb tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:21.650720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acddcb-f366-4786-9684-659a750111eb tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/groups/4f90b79cc0a54073b7ce48da57f60389/users/35c29f92a3204429822a2ce208a8212b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:21.653518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acddcb-f366-4786-9684-659a750111eb tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=4f90b79cc0a54073b7ce48da57f60389, user_id=35c29f92a3204429822a2ce208a8212b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:21.655011 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-82acddcb-f366-4786-9684-659a750111eb tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:remove_user_from_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:21.655011 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:57:21.655011 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:57:21.657179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acddcb-f366-4786-9684-659a750111eb tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:21.669631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-82acddcb-f366-4786-9684-659a750111eb tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '35c29f92a3204429822a2ce208a8212b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:21.699689 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2113/4231] 10.222.0.21 () {58 vars in 1343 bytes} [Sat Nov 27 20:57:21 2021] DELETE /identity/v3/groups/4f90b79cc0a54073b7ce48da57f60389/users/35c29f92a3204429822a2ce208a8212b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:21.706948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acddcb-f366-4786-9684-659a750111eb tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:21.753569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba920c4-834f-4527-a2bf-cb9bba53b1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:21.754716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba920c4-834f-4527-a2bf-cb9bba53b1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:21.755206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba920c4-834f-4527-a2bf-cb9bba53b1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:21.755741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba920c4-834f-4527-a2bf-cb9bba53b1c1 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:21.757107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba920c4-834f-4527-a2bf-cb9bba53b1c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:21.760702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba920c4-834f-4527-a2bf-cb9bba53b1c1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:21.794362 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2119/4232] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:21 2021] POST /identity/v3/users => generated 287 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:21.799922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba920c4-834f-4527-a2bf-cb9bba53b1c1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:21.802451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8ba920c4-834f-4527-a2bf-cb9bba53b1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:21.821341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba920c4-834f-4527-a2bf-cb9bba53b1c1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:21.921595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b01bdb-e108-4223-a0bd-327b6a4fec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:21.922593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b01bdb-e108-4223-a0bd-327b6a4fec96 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:21.923235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b01bdb-e108-4223-a0bd-327b6a4fec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:21.923463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b01bdb-e108-4223-a0bd-327b6a4fec96 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:21.924637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b01bdb-e108-4223-a0bd-327b6a4fec96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:21.936957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b01bdb-e108-4223-a0bd-327b6a4fec96 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:21.957694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acddcb-f366-4786-9684-659a750111eb tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:21.958237 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2120/4233] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:21 2021] GET /identity/v3/roles => generated 2343 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:21.960916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b01bdb-e108-4223-a0bd-327b6a4fec96 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:21.967660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee7dac-9949-47dc-a867-95b5209dc16b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:21.969153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee7dac-9949-47dc-a867-95b5209dc16b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:21.969487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee7dac-9949-47dc-a867-95b5209dc16b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:21.970638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee7dac-9949-47dc-a867-95b5209dc16b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/groups/4f90b79cc0a54073b7ce48da57f60389` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:21.973181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee7dac-9949-47dc-a867-95b5209dc16b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4f90b79cc0a54073b7ce48da57f60389)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:21.974641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b01bdb-e108-4223-a0bd-327b6a4fec96 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:21.979504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee7dac-9949-47dc-a867-95b5209dc16b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:21.980430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e64e4-1c67-4b35-8594-8a2af0a920af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:21.981633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e64e4-1c67-4b35-8594-8a2af0a920af admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:21.981749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e64e4-1c67-4b35-8594-8a2af0a920af admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:21.982016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e64e4-1c67-4b35-8594-8a2af0a920af admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:21.982803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e64e4-1c67-4b35-8594-8a2af0a920af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:21.985098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e64e4-1c67-4b35-8594-8a2af0a920af admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:22.005371 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2121/4234] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:21 2021] GET /identity/v3/roles => generated 2343 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:57:22.006466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e64e4-1c67-4b35-8594-8a2af0a920af admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:22.020101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e64e4-1c67-4b35-8594-8a2af0a920af admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:22.027974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecaf03-b67e-4264-af1c-b07ad2274573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:22.029307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecaf03-b67e-4264-af1c-b07ad2274573 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:22.029794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecaf03-b67e-4264-af1c-b07ad2274573 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:22.030139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecaf03-b67e-4264-af1c-b07ad2274573 admin admin] PATH_INFO: `/v3/projects/90d16fd50eb2412992297f88bb1d4580/users/2bb012478bf740468bba9fa762ac06ca/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:22.050641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecaf03-b67e-4264-af1c-b07ad2274573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d16fd50eb2412992297f88bb1d4580, user_id=2bb012478bf740468bba9fa762ac06ca, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:22.054001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecaf03-b67e-4264-af1c-b07ad2274573 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:22.064065 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2114/4235] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:57:21 2021] DELETE /identity/v3/groups/4f90b79cc0a54073b7ce48da57f60389 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:22.069291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee7dac-9949-47dc-a867-95b5209dc16b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:22.076663 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2122/4236] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:22 2021] PUT /identity/v3/projects/90d16fd50eb2412992297f88bb1d4580/users/2bb012478bf740468bba9fa762ac06ca/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:22.081943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89762-43d2-499f-82b7-cdd8ea76bfef None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:22.082198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89762-43d2-499f-82b7-cdd8ea76bfef None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:22.082538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89762-43d2-499f-82b7-cdd8ea76bfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:22.106955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1ea89762-43d2-499f-82b7-cdd8ea76bfef None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:22.108416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1ea89762-43d2-499f-82b7-cdd8ea76bfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:22.153403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee7dac-9949-47dc-a867-95b5209dc16b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:22.207612 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2123/4237] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:22.217021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea89762-43d2-499f-82b7-cdd8ea76bfef None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:22.221399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1ea89762-43d2-499f-82b7-cdd8ea76bfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:22.267662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:22.268681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:22.268986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:22.269452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/roles/25666e98435f4b95ae7e704d29374ff5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:22.276535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_role(role_id=25666e98435f4b95ae7e704d29374ff5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:22.279145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:22.299364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea89762-43d2-499f-82b7-cdd8ea76bfef None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:22.306788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b1d46-0093-448c-af5f-beff3ebd47d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:22.307665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b1d46-0093-448c-af5f-beff3ebd47d9 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:22.308048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b1d46-0093-448c-af5f-beff3ebd47d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:22.308427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b1d46-0093-448c-af5f-beff3ebd47d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:22.326828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b1d46-0093-448c-af5f-beff3ebd47d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:22.329326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b1d46-0093-448c-af5f-beff3ebd47d9 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:22.343537 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2124/4238] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:57:22.364363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invalidating the token cache because role 25666e98435f4b95ae7e704d29374ff5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:22.364925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:22.368021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:22.371395 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2115/4239] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:22 2021] DELETE /identity/v3/roles/25666e98435f4b95ae7e704d29374ff5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:22.376675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b1d46-0093-448c-af5f-beff3ebd47d9 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:22.391110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b1d46-0093-448c-af5f-beff3ebd47d9 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:22.538319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:22.540698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:22.541144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:22.542195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/9577c15ac0b2444d8797bdf954ed5707` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:22.543970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9577c15ac0b2444d8797bdf954ed5707)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:22.545998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:22.594590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:22.596717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:22.641695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:22.642416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:22.646764 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2125/4240] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:57:22 2021] PATCH /identity/v3/domains/9577c15ac0b2444d8797bdf954ed5707 => generated 278 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:22.651170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:22.652940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:22.668365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd458e1f-e69f-4d03-a122-742193c4479b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:22.784469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:22.787187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:22.787836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:22.788513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/9577c15ac0b2444d8797bdf954ed5707` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:22.818613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9577c15ac0b2444d8797bdf954ed5707)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:22.819801 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:57:22.819801 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:57:22.819801 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:57:22.821119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:22.916884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:22.966301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.068164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707', 'request_id': 'req-c1e2ee68-82a4-4b11-8efb-9495048d7b31'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.080523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707', 'request_id': 'req-c1e2ee68-82a4-4b11-8efb-9495048d7b31'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.103405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707', 'request_id': 'req-c1e2ee68-82a4-4b11-8efb-9495048d7b31'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.127294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] The token cache is being invalidate because project 9577c15ac0b2444d8797bdf954ed5707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:23.128279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.131216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.171575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707', 'request_id': 'req-c1e2ee68-82a4-4b11-8efb-9495048d7b31'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.172794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707', 'request_id': 'req-c1e2ee68-82a4-4b11-8efb-9495048d7b31'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.178213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9577c15ac0b2444d8797bdf954ed5707', 'request_id': 'req-c1e2ee68-82a4-4b11-8efb-9495048d7b31'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.188494 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2116/4241] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:57:22 2021] DELETE /identity/v3/domains/9577c15ac0b2444d8797bdf954ed5707 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:23.190931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:23.193026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:23.209198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725961-32ad-41b7-9317-7ea82e568421 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:23.298577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:23.299888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:23.300176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:23.300450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/970213bc49e1495692cce5a4c3898924/users/35c29f92a3204429822a2ce208a8212b/roles/7afe68391c5647b4aadeef96821b28c8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:23.305689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=970213bc49e1495692cce5a4c3898924, user_id=35c29f92a3204429822a2ce208a8212b, role_id=7afe68391c5647b4aadeef96821b28c8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:23.309601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:23.318049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invalidating the token cache because role 7afe68391c5647b4aadeef96821b28c8 was removed from user 35c29f92a3204429822a2ce208a8212b on domain 970213bc49e1495692cce5a4c3898924. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:23.318485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.319575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.348763 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2126/4242] 10.222.0.21 () {58 vars in 1463 bytes} [Sat Nov 27 20:57:23 2021] DELETE /identity/v3/domains/970213bc49e1495692cce5a4c3898924/users/35c29f92a3204429822a2ce208a8212b/roles/7afe68391c5647b4aadeef96821b28c8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:23.352535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:23.369595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:23.407582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2ee68-82a4-4b11-8efb-9495048d7b31 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:23.539959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:23.544041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:23.544601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:23.545009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/roles/7afe68391c5647b4aadeef96821b28c8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:23.548717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7afe68391c5647b4aadeef96821b28c8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:23.557690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:23.694900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invalidating the token cache because role 7afe68391c5647b4aadeef96821b28c8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:23.696711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.697754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.703305 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2117/4243] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:23 2021] DELETE /identity/v3/roles/7afe68391c5647b4aadeef96821b28c8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:23.704364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:23.706251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:23.723005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445ff9b-02de-41c4-8193-f97eedd78ed1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:23.822378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:23.837068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:23.840302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:23.841345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/970213bc49e1495692cce5a4c3898924` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:23.845250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=970213bc49e1495692cce5a4c3898924)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:23.850949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:23.917361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '970213bc49e1495692cce5a4c3898924'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.919023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '970213bc49e1495692cce5a4c3898924'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.974488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '970213bc49e1495692cce5a4c3898924'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.976070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '970213bc49e1495692cce5a4c3898924'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:23.980331 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2127/4244] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:57:23 2021] PATCH /identity/v3/domains/970213bc49e1495692cce5a4c3898924 => generated 277 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:23.984150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:23.985715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:24.009141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044137e3-98a7-4c8a-abcf-b8b3f94dcede tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:24.114218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:24.115607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:24.116109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:24.116578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/970213bc49e1495692cce5a4c3898924` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:24.131296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=970213bc49e1495692cce5a4c3898924)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:24.134475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:24.171438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '970213bc49e1495692cce5a4c3898924'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.184601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '970213bc49e1495692cce5a4c3898924'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.262065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970213bc49e1495692cce5a4c3898924', 'request_id': 'req-c919208d-8443-4f48-889d-14e57e61c084'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.276669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970213bc49e1495692cce5a4c3898924', 'request_id': 'req-c919208d-8443-4f48-889d-14e57e61c084'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.295918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970213bc49e1495692cce5a4c3898924', 'request_id': 'req-c919208d-8443-4f48-889d-14e57e61c084'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.316791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] The token cache is being invalidate because project 970213bc49e1495692cce5a4c3898924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:24.330458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.335689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.352547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '970213bc49e1495692cce5a4c3898924', 'request_id': 'req-c919208d-8443-4f48-889d-14e57e61c084'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.355576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '970213bc49e1495692cce5a4c3898924', 'request_id': 'req-c919208d-8443-4f48-889d-14e57e61c084'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.360039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '970213bc49e1495692cce5a4c3898924', 'request_id': 'req-c919208d-8443-4f48-889d-14e57e61c084'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.393425 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2118/4245] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:57:23 2021] DELETE /identity/v3/domains/970213bc49e1495692cce5a4c3898924 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:24.397306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:24.399717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:24.460794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac843fed-72b5-47a8-b6c5-599d30eeb9c5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:24.624069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:24.625361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:24.625875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:24.626168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/2fcb3b15d7a4499f84a00432558f68bd/groups/02e841ad9df44ef992952fbb0b2c727a/roles/fa2c1730e2f143cebb7de7f3b41e6fc4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:24.631365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2fcb3b15d7a4499f84a00432558f68bd, group_id=02e841ad9df44ef992952fbb0b2c727a, role_id=fa2c1730e2f143cebb7de7f3b41e6fc4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:24.636902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:24.652030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invalidating the token cache because role fa2c1730e2f143cebb7de7f3b41e6fc4 was removed from group 02e841ad9df44ef992952fbb0b2c727a on domain 2fcb3b15d7a4499f84a00432558f68bd. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:24.652428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.654086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.686382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:24.686639 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2128/4246] 10.222.0.21 () {58 vars in 1466 bytes} [Sat Nov 27 20:57:24 2021] DELETE /identity/v3/domains/2fcb3b15d7a4499f84a00432558f68bd/groups/02e841ad9df44ef992952fbb0b2c727a/roles/fa2c1730e2f143cebb7de7f3b41e6fc4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:24.693911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:24.717072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919208d-8443-4f48-889d-14e57e61c084 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:24.811833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a5cd8-d6e0-4bb4-a81d-80383df32d23 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:24.814488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a5cd8-d6e0-4bb4-a81d-80383df32d23 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:24.816381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a5cd8-d6e0-4bb4-a81d-80383df32d23 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:24.817038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a5cd8-d6e0-4bb4-a81d-80383df32d23 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/groups/02e841ad9df44ef992952fbb0b2c727a/users/35c29f92a3204429822a2ce208a8212b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:24.820453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a5cd8-d6e0-4bb4-a81d-80383df32d23 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=02e841ad9df44ef992952fbb0b2c727a, user_id=35c29f92a3204429822a2ce208a8212b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:24.825090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a5cd8-d6e0-4bb4-a81d-80383df32d23 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:24.840371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-374a5cd8-d6e0-4bb4-a81d-80383df32d23 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '35c29f92a3204429822a2ce208a8212b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:24.873773 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2119/4247] 10.222.0.21 () {58 vars in 1343 bytes} [Sat Nov 27 20:57:24 2021] DELETE /identity/v3/groups/02e841ad9df44ef992952fbb0b2c727a/users/35c29f92a3204429822a2ce208a8212b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:24.879353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:24.881694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:24.916013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67545085-f214-4b59-9de1-0dc1a6ec27e4 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:25.030470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9e9df-ae9b-409d-b756-01c993a7c2a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:25.031850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e9df-ae9b-409d-b756-01c993a7c2a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:25.031850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e9df-ae9b-409d-b756-01c993a7c2a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:25.032917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e9df-ae9b-409d-b756-01c993a7c2a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/groups/02e841ad9df44ef992952fbb0b2c727a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:25.036852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9e9df-ae9b-409d-b756-01c993a7c2a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_group(group_id=02e841ad9df44ef992952fbb0b2c727a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:25.038768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9e9df-ae9b-409d-b756-01c993a7c2a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:25.171559 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2129/4248] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:57:24 2021] DELETE /identity/v3/groups/02e841ad9df44ef992952fbb0b2c727a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:25.175607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a5cd8-d6e0-4bb4-a81d-80383df32d23 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:25.191093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a5cd8-d6e0-4bb4-a81d-80383df32d23 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:25.319346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3954c-2e41-4ee4-b7f5-d0e33f18d547 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:25.320774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3954c-2e41-4ee4-b7f5-d0e33f18d547 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:25.320970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3954c-2e41-4ee4-b7f5-d0e33f18d547 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:25.321251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3954c-2e41-4ee4-b7f5-d0e33f18d547 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/roles/fa2c1730e2f143cebb7de7f3b41e6fc4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:25.324270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3954c-2e41-4ee4-b7f5-d0e33f18d547 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fa2c1730e2f143cebb7de7f3b41e6fc4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:25.327153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3954c-2e41-4ee4-b7f5-d0e33f18d547 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:25.402924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-50c3954c-2e41-4ee4-b7f5-d0e33f18d547 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invalidating the token cache because role fa2c1730e2f143cebb7de7f3b41e6fc4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:25.403293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-50c3954c-2e41-4ee4-b7f5-d0e33f18d547 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:25.404009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-50c3954c-2e41-4ee4-b7f5-d0e33f18d547 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:25.406227 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2120/4249] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:25 2021] DELETE /identity/v3/roles/fa2c1730e2f143cebb7de7f3b41e6fc4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:25.411041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9e9df-ae9b-409d-b756-01c993a7c2a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:25.414483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f7c9e9df-ae9b-409d-b756-01c993a7c2a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:25.453400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9e9df-ae9b-409d-b756-01c993a7c2a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:25.598515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:25.600183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:25.601500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:25.602447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/2fcb3b15d7a4499f84a00432558f68bd` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:25.613074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2fcb3b15d7a4499f84a00432558f68bd)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:25.621458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:25.659195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:25.660241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:25.709866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:25.711477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:25.716605 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2130/4250] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:57:25 2021] PATCH /identity/v3/domains/2fcb3b15d7a4499f84a00432558f68bd => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:57:25.723467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3954c-2e41-4ee4-b7f5-d0e33f18d547 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:25.745533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3954c-2e41-4ee4-b7f5-d0e33f18d547 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:25.918908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:25.919824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:25.920101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:25.920484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/2fcb3b15d7a4499f84a00432558f68bd` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:25.943380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2fcb3b15d7a4499f84a00432558f68bd)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:25.946166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:26.004916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.020311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.094192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd', 'request_id': 'req-7c1fa394-245d-4bbe-bbd5-346388e62d8e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.113455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd', 'request_id': 'req-7c1fa394-245d-4bbe-bbd5-346388e62d8e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.133966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd', 'request_id': 'req-7c1fa394-245d-4bbe-bbd5-346388e62d8e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.166304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] The token cache is being invalidate because project 2fcb3b15d7a4499f84a00432558f68bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:26.166687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.167447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.180528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd', 'request_id': 'req-7c1fa394-245d-4bbe-bbd5-346388e62d8e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.181485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd', 'request_id': 'req-7c1fa394-245d-4bbe-bbd5-346388e62d8e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.190063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2fcb3b15d7a4499f84a00432558f68bd', 'request_id': 'req-7c1fa394-245d-4bbe-bbd5-346388e62d8e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.224987 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2121/4251] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:57:25 2021] DELETE /identity/v3/domains/2fcb3b15d7a4499f84a00432558f68bd => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:26.225646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:26.231372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:26.275160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33c431-d3d8-479f-8b8a-d328aee91a28 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:26.522679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:26.526786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:26.528425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:26.528712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/8e121eb6eabf4f4bb5932ad3a042cae8/users/35c29f92a3204429822a2ce208a8212b/roles/c55b9f1d37da4b0a8f1c269d7c00b31c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:26.534918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8e121eb6eabf4f4bb5932ad3a042cae8, user_id=35c29f92a3204429822a2ce208a8212b, role_id=c55b9f1d37da4b0a8f1c269d7c00b31c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:26.540379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:26.549339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invalidating the token cache because role c55b9f1d37da4b0a8f1c269d7c00b31c was removed from user 35c29f92a3204429822a2ce208a8212b on domain 8e121eb6eabf4f4bb5932ad3a042cae8. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:26.550002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.551268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.605144 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2131/4252] 10.222.0.21 () {58 vars in 1463 bytes} [Sat Nov 27 20:57:26 2021] DELETE /identity/v3/domains/8e121eb6eabf4f4bb5932ad3a042cae8/users/35c29f92a3204429822a2ce208a8212b/roles/c55b9f1d37da4b0a8f1c269d7c00b31c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:26.609034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:26.610657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:26.647488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fa394-245d-4bbe-bbd5-346388e62d8e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:26.768606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:26.771118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:26.771615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:26.772082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/roles/c55b9f1d37da4b0a8f1c269d7c00b31c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:26.775886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c55b9f1d37da4b0a8f1c269d7c00b31c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:26.779713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:26.854650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invalidating the token cache because role c55b9f1d37da4b0a8f1c269d7c00b31c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:26.854954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.855699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:26.861211 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2122/4253] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:26 2021] DELETE /identity/v3/roles/c55b9f1d37da4b0a8f1c269d7c00b31c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:26.865869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:26.868300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:26.906822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97af59d-d14a-4d09-852f-01bdab372ae7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:27.092127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:27.093219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:27.093514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:27.093791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/8e121eb6eabf4f4bb5932ad3a042cae8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:27.100442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8e121eb6eabf4f4bb5932ad3a042cae8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:27.106242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:27.160277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.162280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.218412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.219579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.231336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:27.233692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:27.238138 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2132/4254] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:57:26 2021] PATCH /identity/v3/domains/8e121eb6eabf4f4bb5932ad3a042cae8 => generated 277 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:27.258181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919a78e-cc51-4b83-9b23-d78a7ff57ebc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:27.434995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:27.436640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:27.437376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:27.437843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/8e121eb6eabf4f4bb5932ad3a042cae8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:27.461644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8e121eb6eabf4f4bb5932ad3a042cae8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:27.463314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:27.522809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.545621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.658441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8', 'request_id': 'req-4379b7b2-f041-4811-a255-97bb60a17c2f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.682639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8', 'request_id': 'req-4379b7b2-f041-4811-a255-97bb60a17c2f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.706491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8', 'request_id': 'req-4379b7b2-f041-4811-a255-97bb60a17c2f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.752531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] The token cache is being invalidate because project 8e121eb6eabf4f4bb5932ad3a042cae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:27.754290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.758023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.781765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8', 'request_id': 'req-4379b7b2-f041-4811-a255-97bb60a17c2f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.784436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8', 'request_id': 'req-4379b7b2-f041-4811-a255-97bb60a17c2f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.795229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8e121eb6eabf4f4bb5932ad3a042cae8', 'request_id': 'req-4379b7b2-f041-4811-a255-97bb60a17c2f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:27.822111 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2123/4255] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:57:27 2021] DELETE /identity/v3/domains/8e121eb6eabf4f4bb5932ad3a042cae8 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:27.830220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:27.833368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:27.858054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334f61-99e0-447c-a246-4032ec25d5a7 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:28.019402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c472c9-7707-4f69-bddf-e5bb5a8feea5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:28.029912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c472c9-7707-4f69-bddf-e5bb5a8feea5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:28.030969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c472c9-7707-4f69-bddf-e5bb5a8feea5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:28.031279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c472c9-7707-4f69-bddf-e5bb5a8feea5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:28.033640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c472c9-7707-4f69-bddf-e5bb5a8feea5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:28.038369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c472c9-7707-4f69-bddf-e5bb5a8feea5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:28.068116 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2133/4256] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:27 2021] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:28.072099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:28.076153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:28.100137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379b7b2-f041-4811-a255-97bb60a17c2f tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:28.128244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526891-0557-42cc-8980-d87d3d29568e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:28.130050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526891-0557-42cc-8980-d87d3d29568e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:28.130571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526891-0557-42cc-8980-d87d3d29568e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:28.131636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9526891-0557-42cc-8980-d87d3d29568e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/projects/fbc05b0c433942d4b3a3b7d148a4513b/users/6bb4cfa923aa436fb756ba7ec8a86f42/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:28.136242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9526891-0557-42cc-8980-d87d3d29568e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fbc05b0c433942d4b3a3b7d148a4513b, user_id=6bb4cfa923aa436fb756ba7ec8a86f42, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:28.140734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9526891-0557-42cc-8980-d87d3d29568e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:28.186642 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2124/4257] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:28 2021] PUT /identity/v3/projects/fbc05b0c433942d4b3a3b7d148a4513b/users/6bb4cfa923aa436fb756ba7ec8a86f42/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:28.191573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c472c9-7707-4f69-bddf-e5bb5a8feea5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:28.203814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c472c9-7707-4f69-bddf-e5bb5a8feea5 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:28.351675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa131221-931f-4e3d-a8fa-9d1d7c57c105 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:28.352572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131221-931f-4e3d-a8fa-9d1d7c57c105 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:28.352855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131221-931f-4e3d-a8fa-9d1d7c57c105 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:28.353128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131221-931f-4e3d-a8fa-9d1d7c57c105 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:28.355650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa131221-931f-4e3d-a8fa-9d1d7c57c105 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:28.363756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa131221-931f-4e3d-a8fa-9d1d7c57c105 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:28.476264 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2134/4258] 10.222.0.21 () {58 vars in 1145 bytes} [Sat Nov 27 20:57:28 2021] GET /identity/v3/auth/projects => generated 826 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:28.477497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526891-0557-42cc-8980-d87d3d29568e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:28.493021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9526891-0557-42cc-8980-d87d3d29568e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:28.504219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babb374-f615-4633-b549-4d24499e2d18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:28.506984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babb374-f615-4633-b549-4d24499e2d18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:28.508089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babb374-f615-4633-b549-4d24499e2d18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:28.508776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babb374-f615-4633-b549-4d24499e2d18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/projects/fbc05b0c433942d4b3a3b7d148a4513b/users/6bb4cfa923aa436fb756ba7ec8a86f42/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:28.511684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babb374-f615-4633-b549-4d24499e2d18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=fbc05b0c433942d4b3a3b7d148a4513b, user_id=6bb4cfa923aa436fb756ba7ec8a86f42, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:28.516718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babb374-f615-4633-b549-4d24499e2d18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:28.525878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1babb374-f615-4633-b549-4d24499e2d18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invalidating the token cache because role f0f7eb6ce00345e79b333982649f1ff7 was removed from user 6bb4cfa923aa436fb756ba7ec8a86f42 on project fbc05b0c433942d4b3a3b7d148a4513b. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:28.527861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1babb374-f615-4633-b549-4d24499e2d18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:28.530717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1babb374-f615-4633-b549-4d24499e2d18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:28.562976 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2125/4259] 10.222.0.21 () {58 vars in 1466 bytes} [Sat Nov 27 20:57:28 2021] DELETE /identity/v3/projects/fbc05b0c433942d4b3a3b7d148a4513b/users/6bb4cfa923aa436fb756ba7ec8a86f42/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:28.568747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa131221-931f-4e3d-a8fa-9d1d7c57c105 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:28.572103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-aa131221-931f-4e3d-a8fa-9d1d7c57c105 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:28.598207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa131221-931f-4e3d-a8fa-9d1d7c57c105 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:28.716452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50610e-0843-4606-aac1-078b7b08078c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:28.717353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50610e-0843-4606-aac1-078b7b08078c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:28.717942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50610e-0843-4606-aac1-078b7b08078c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:28.718856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50610e-0843-4606-aac1-078b7b08078c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:28.719720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50610e-0843-4606-aac1-078b7b08078c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:28.721972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50610e-0843-4606-aac1-078b7b08078c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:28.763951 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2135/4260] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:28 2021] POST /identity/v3/users => generated 323 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:28.768156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babb374-f615-4633-b549-4d24499e2d18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:28.779336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babb374-f615-4633-b549-4d24499e2d18 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:28.785172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e599df0-7b3e-4195-b863-2467643da540 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:28.786667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e599df0-7b3e-4195-b863-2467643da540 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:28.787106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e599df0-7b3e-4195-b863-2467643da540 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:28.787571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e599df0-7b3e-4195-b863-2467643da540 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:28.788697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e599df0-7b3e-4195-b863-2467643da540 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:28.790775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e599df0-7b3e-4195-b863-2467643da540 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:28.858013 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2126/4261] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:28 2021] POST /identity/v3/projects => generated 364 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:28.860301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50610e-0843-4606-aac1-078b7b08078c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:28.887056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50610e-0843-4606-aac1-078b7b08078c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:28.989989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78b9dd-fb71-4e13-9efd-23289c6fbbac tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:28.990771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78b9dd-fb71-4e13-9efd-23289c6fbbac tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:28.991296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78b9dd-fb71-4e13-9efd-23289c6fbbac tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:28.991431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78b9dd-fb71-4e13-9efd-23289c6fbbac tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:28.992982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78b9dd-fb71-4e13-9efd-23289c6fbbac tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:28.997789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78b9dd-fb71-4e13-9efd-23289c6fbbac tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:29.053052 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2136/4262] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:28 2021] POST /identity/v3/projects => generated 364 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:57:29.058700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e599df0-7b3e-4195-b863-2467643da540 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:29.085361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e599df0-7b3e-4195-b863-2467643da540 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:29.235712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83099c-d4c5-4362-a3a2-291e009a5b22 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:29.238331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83099c-d4c5-4362-a3a2-291e009a5b22 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:29.238900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83099c-d4c5-4362-a3a2-291e009a5b22 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:29.239526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83099c-d4c5-4362-a3a2-291e009a5b22 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:29.241096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83099c-d4c5-4362-a3a2-291e009a5b22 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:29.247698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83099c-d4c5-4362-a3a2-291e009a5b22 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:29.280409 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2127/4263] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 20:57:29 2021] POST /identity/v3/roles => generated 240 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:29.282047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78b9dd-fb71-4e13-9efd-23289c6fbbac tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:29.310935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78b9dd-fb71-4e13-9efd-23289c6fbbac tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:29.325328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426409c6-3583-47f1-974d-023e53965d2a tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:29.326853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426409c6-3583-47f1-974d-023e53965d2a tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:29.327260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426409c6-3583-47f1-974d-023e53965d2a tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:29.327580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426409c6-3583-47f1-974d-023e53965d2a tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/projects/880ee4f25b384635b45f53abf6f9d014/users/b0be3aa2e7a64911b3066f3842d66a6b/roles/7fdb2f9375b246219f4b396a0e5f561e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:29.367155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426409c6-3583-47f1-974d-023e53965d2a tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_grant(project_id=880ee4f25b384635b45f53abf6f9d014, user_id=b0be3aa2e7a64911b3066f3842d66a6b, role_id=7fdb2f9375b246219f4b396a0e5f561e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:29.373125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426409c6-3583-47f1-974d-023e53965d2a tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:29.392884 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2137/4264] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:29 2021] PUT /identity/v3/projects/880ee4f25b384635b45f53abf6f9d014/users/b0be3aa2e7a64911b3066f3842d66a6b/roles/7fdb2f9375b246219f4b396a0e5f561e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:29.397508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83099c-d4c5-4362-a3a2-291e009a5b22 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:29.411423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83099c-d4c5-4362-a3a2-291e009a5b22 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:29.499064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8fc22-813d-45b3-9459-b26c79342a82 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:29.500302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8fc22-813d-45b3-9459-b26c79342a82 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:29.501035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8fc22-813d-45b3-9459-b26c79342a82 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:29.501510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8fc22-813d-45b3-9459-b26c79342a82 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/projects/c75eb751a2fd4f798e08ca75b61dcae9/users/b0be3aa2e7a64911b3066f3842d66a6b/roles/7fdb2f9375b246219f4b396a0e5f561e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:29.504693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8fc22-813d-45b3-9459-b26c79342a82 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c75eb751a2fd4f798e08ca75b61dcae9, user_id=b0be3aa2e7a64911b3066f3842d66a6b, role_id=7fdb2f9375b246219f4b396a0e5f561e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:29.508204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8fc22-813d-45b3-9459-b26c79342a82 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:29.530017 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2128/4265] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:29 2021] PUT /identity/v3/projects/c75eb751a2fd4f798e08ca75b61dcae9/users/b0be3aa2e7a64911b3066f3842d66a6b/roles/7fdb2f9375b246219f4b396a0e5f561e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:29.534680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb62e1-df16-4051-93eb-a8ec4586b5a8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:29.535239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb62e1-df16-4051-93eb-a8ec4586b5a8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:29.535765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb62e1-df16-4051-93eb-a8ec4586b5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:29.575067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-14cb62e1-df16-4051-93eb-a8ec4586b5a8 None None] MFA Rules not processed for user `b0be3aa2e7a64911b3066f3842d66a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:29.576821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-14cb62e1-df16-4051-93eb-a8ec4586b5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:29.582491 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2138/4266] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:29 2021] POST /identity/v3/auth/tokens => generated 335 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:57:29.587398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ffeee-6dc9-4b80-952c-a7d27ff089e5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:29.587775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ffeee-6dc9-4b80-952c-a7d27ff089e5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:29.588070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ffeee-6dc9-4b80-952c-a7d27ff089e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:29.601384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-834ffeee-6dc9-4b80-952c-a7d27ff089e5 None None] MFA Rules not processed for user `b0be3aa2e7a64911b3066f3842d66a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:29.603487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-834ffeee-6dc9-4b80-952c-a7d27ff089e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:29.705684 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2129/4267] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:29 2021] POST /identity/v3/auth/tokens => generated 3216 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Nov 27 20:57:29.709576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb62e1-df16-4051-93eb-a8ec4586b5a8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:29.834283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb62e1-df16-4051-93eb-a8ec4586b5a8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:29.845121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf41cd-c29c-4e60-a02f-70ba9ed7e7e1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:29.845855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf41cd-c29c-4e60-a02f-70ba9ed7e7e1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:29.846138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf41cd-c29c-4e60-a02f-70ba9ed7e7e1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:29.847201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf41cd-c29c-4e60-a02f-70ba9ed7e7e1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:29.869401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf41cd-c29c-4e60-a02f-70ba9ed7e7e1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:29.875274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf41cd-c29c-4e60-a02f-70ba9ed7e7e1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:29.904942 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2139/4268] 10.222.0.21 () {56 vars in 1307 bytes} [Sat Nov 27 20:57:29 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:29.910160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243786-0a93-4b26-a873-76c85b9b93c2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:29.911735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243786-0a93-4b26-a873-76c85b9b93c2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:29.911735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75243786-0a93-4b26-a873-76c85b9b93c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:29.924401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-75243786-0a93-4b26-a873-76c85b9b93c2 None None] MFA Rules not processed for user `b0be3aa2e7a64911b3066f3842d66a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:29.925762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-75243786-0a93-4b26-a873-76c85b9b93c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:30.018224 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2130/4269] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:29 2021] POST /identity/v3/auth/tokens => generated 3216 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Nov 27 20:57:30.024485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf41cd-c29c-4e60-a02f-70ba9ed7e7e1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:30.038333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf41cd-c29c-4e60-a02f-70ba9ed7e7e1 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:30.046286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:30.047563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:30.047951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:30.048437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/roles/7fdb2f9375b246219f4b396a0e5f561e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:30.050967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7fdb2f9375b246219f4b396a0e5f561e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:30.053170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:30.166173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invalidating the token cache because role 7fdb2f9375b246219f4b396a0e5f561e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:30.166173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.168226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.171899 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2140/4270] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:30 2021] DELETE /identity/v3/roles/7fdb2f9375b246219f4b396a0e5f561e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:30.176724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75243786-0a93-4b26-a873-76c85b9b93c2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:30.197272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75243786-0a93-4b26-a873-76c85b9b93c2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:30.356210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:30.357593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:30.357883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:30.358189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/projects/c75eb751a2fd4f798e08ca75b61dcae9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:30.360771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c75eb751a2fd4f798e08ca75b61dcae9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:30.363848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:30.494746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75eb751a2fd4f798e08ca75b61dcae9', 'request_id': 'req-f637cdf1-6349-4e4b-bed5-da279fbae945'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.511702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75eb751a2fd4f798e08ca75b61dcae9', 'request_id': 'req-f637cdf1-6349-4e4b-bed5-da279fbae945'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.530227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75eb751a2fd4f798e08ca75b61dcae9', 'request_id': 'req-f637cdf1-6349-4e4b-bed5-da279fbae945'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.550935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] The token cache is being invalidate because project c75eb751a2fd4f798e08ca75b61dcae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:30.551303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.553114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.559866 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2131/4271] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:30 2021] DELETE /identity/v3/projects/c75eb751a2fd4f798e08ca75b61dcae9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:30.567866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:30.572475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:30.602435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd0a21-12f6-4f01-9439-1809022b8a50 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:30.687209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5826c-5d0b-4c93-a212-cecd4d5792dc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:30.687701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5826c-5d0b-4c93-a212-cecd4d5792dc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:30.688374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5826c-5d0b-4c93-a212-cecd4d5792dc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:30.688809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5826c-5d0b-4c93-a212-cecd4d5792dc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/projects/c75eb751a2fd4f798e08ca75b61dcae9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:30.700157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5826c-5d0b-4c93-a212-cecd4d5792dc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c75eb751a2fd4f798e08ca75b61dcae9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:30.705133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5826c-5d0b-4c93-a212-cecd4d5792dc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:30.731224 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-9ec5826c-5d0b-4c93-a212-cecd4d5792dc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Could not find project: c75eb751a2fd4f798e08ca75b61dcae9.: keystone.exception.ProjectNotFound: Could not find project: c75eb751a2fd4f798e08ca75b61dcae9. Nov 27 20:57:30.733296 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2141/4272] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:30 2021] DELETE /identity/v3/projects/c75eb751a2fd4f798e08ca75b61dcae9 => generated 113 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:57:30.738206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:30.741119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:30.763019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637cdf1-6349-4e4b-bed5-da279fbae945 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:30.769609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:30.771279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:30.771605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:30.771875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/projects/880ee4f25b384635b45f53abf6f9d014` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:30.774564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_project(project_id=880ee4f25b384635b45f53abf6f9d014)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:30.777083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:30.899054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880ee4f25b384635b45f53abf6f9d014', 'request_id': 'req-cd2c93f4-8371-4c90-9293-208977633f57'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.918552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880ee4f25b384635b45f53abf6f9d014', 'request_id': 'req-cd2c93f4-8371-4c90-9293-208977633f57'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.946029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880ee4f25b384635b45f53abf6f9d014', 'request_id': 'req-cd2c93f4-8371-4c90-9293-208977633f57'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.965281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] The token cache is being invalidate because project 880ee4f25b384635b45f53abf6f9d014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:30.965982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.967026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:30.970424 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2132/4273] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:30 2021] DELETE /identity/v3/projects/880ee4f25b384635b45f53abf6f9d014 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:30.974968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5826c-5d0b-4c93-a212-cecd4d5792dc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:30.979537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9ec5826c-5d0b-4c93-a212-cecd4d5792dc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:31.012005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5826c-5d0b-4c93-a212-cecd4d5792dc tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:31.130991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:31.132074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:31.132412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:31.133214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/users/b0be3aa2e7a64911b3066f3842d66a6b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:31.134901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b0be3aa2e7a64911b3066f3842d66a6b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:31.138098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:31.285178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0be3aa2e7a64911b3066f3842d66a6b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:31.314566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0be3aa2e7a64911b3066f3842d66a6b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:31.315468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0be3aa2e7a64911b3066f3842d66a6b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:31.336463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0be3aa2e7a64911b3066f3842d66a6b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:31.385615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0be3aa2e7a64911b3066f3842d66a6b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:31.402470 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2142/4274] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:30 2021] DELETE /identity/v3/users/b0be3aa2e7a64911b3066f3842d66a6b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:31.408476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:31.430135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c93f4-8371-4c90-9293-208977633f57 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:31.599317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53e9bb-f533-4016-aaa1-432dabdbf779 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:31.603141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e9bb-f533-4016-aaa1-432dabdbf779 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:31.603494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e9bb-f533-4016-aaa1-432dabdbf779 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:31.603878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53e9bb-f533-4016-aaa1-432dabdbf779 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/9577c15ac0b2444d8797bdf954ed5707` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:31.623354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53e9bb-f533-4016-aaa1-432dabdbf779 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:57:31.646792 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-dc53e9bb-f533-4016-aaa1-432dabdbf779 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Could not find domain: 9577c15ac0b2444d8797bdf954ed5707.: keystone.exception.DomainNotFound: Could not find domain: 9577c15ac0b2444d8797bdf954ed5707. Nov 27 20:57:31.654613 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2133/4275] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:57:31 2021] PATCH /identity/v3/domains/9577c15ac0b2444d8797bdf954ed5707 => generated 112 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:57:31.655322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:31.663412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:31.702075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2846ace-f320-4630-b6fd-bfc1f99ab64b tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:31.724750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77693f1-e043-4996-b759-506ad16b2f1e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:31.727417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77693f1-e043-4996-b759-506ad16b2f1e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:31.729243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77693f1-e043-4996-b759-506ad16b2f1e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:31.729960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77693f1-e043-4996-b759-506ad16b2f1e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/970213bc49e1495692cce5a4c3898924` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:31.751988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77693f1-e043-4996-b759-506ad16b2f1e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:57:31.791226 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-a77693f1-e043-4996-b759-506ad16b2f1e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Could not find domain: 970213bc49e1495692cce5a4c3898924.: keystone.exception.DomainNotFound: Could not find domain: 970213bc49e1495692cce5a4c3898924. Nov 27 20:57:31.795702 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2143/4276] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:57:31 2021] PATCH /identity/v3/domains/970213bc49e1495692cce5a4c3898924 => generated 112 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:57:31.801263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53e9bb-f533-4016-aaa1-432dabdbf779 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:31.824806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53e9bb-f533-4016-aaa1-432dabdbf779 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:31.832096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d65cb9-c0dd-4d5a-8fb7-f61a3c88354c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:31.834282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d65cb9-c0dd-4d5a-8fb7-f61a3c88354c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:31.834875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d65cb9-c0dd-4d5a-8fb7-f61a3c88354c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:31.835433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d65cb9-c0dd-4d5a-8fb7-f61a3c88354c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/2fcb3b15d7a4499f84a00432558f68bd` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:31.846840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d65cb9-c0dd-4d5a-8fb7-f61a3c88354c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:57:31.859807 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-d7d65cb9-c0dd-4d5a-8fb7-f61a3c88354c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Could not find domain: 2fcb3b15d7a4499f84a00432558f68bd.: keystone.exception.DomainNotFound: Could not find domain: 2fcb3b15d7a4499f84a00432558f68bd. Nov 27 20:57:31.865544 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2134/4277] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:57:31 2021] PATCH /identity/v3/domains/2fcb3b15d7a4499f84a00432558f68bd => generated 112 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:57:31.867354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77693f1-e043-4996-b759-506ad16b2f1e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:31.880720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77693f1-e043-4996-b759-506ad16b2f1e tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:31.888906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e2e36-1482-4f58-b11c-8befd8da73e8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bb4cfa923aa436fb756ba7ec8a86f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56c6b3ce78a440edb867e0f833c831f8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:31.889992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2e36-1482-4f58-b11c-8befd8da73e8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:31.890943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2e36-1482-4f58-b11c-8befd8da73e8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:31.891679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2e36-1482-4f58-b11c-8befd8da73e8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] PATH_INFO: `/v3/domains/8e121eb6eabf4f4bb5932ad3a042cae8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:31.902994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e2e36-1482-4f58-b11c-8befd8da73e8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:57:31.916663 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-375e2e36-1482-4f58-b11c-8befd8da73e8 tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Could not find domain: 8e121eb6eabf4f4bb5932ad3a042cae8.: keystone.exception.DomainNotFound: Could not find domain: 8e121eb6eabf4f4bb5932ad3a042cae8. Nov 27 20:57:31.921796 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2144/4278] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:57:31 2021] PATCH /identity/v3/domains/8e121eb6eabf4f4bb5932ad3a042cae8 => generated 112 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 20:57:31.926122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d65cb9-c0dd-4d5a-8fb7-f61a3c88354c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:31.930077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d7d65cb9-c0dd-4d5a-8fb7-f61a3c88354c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:32.113116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d65cb9-c0dd-4d5a-8fb7-f61a3c88354c tempest-TokensV3TestJSON-983714252 tempest-TokensV3TestJSON-983714252-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:32.130473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:32.133770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:32.133770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:32.133770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] PATH_INFO: `/v3/users/a1c63410ce7d47c7957be6e3dfbdea6e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:32.138506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c63410ce7d47c7957be6e3dfbdea6e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:32.144822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:32.285451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c63410ce7d47c7957be6e3dfbdea6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:32.289069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c63410ce7d47c7957be6e3dfbdea6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:32.304878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c63410ce7d47c7957be6e3dfbdea6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:32.305628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c63410ce7d47c7957be6e3dfbdea6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:32.316162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c63410ce7d47c7957be6e3dfbdea6e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:32.339947 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2135/4279] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:31 2021] DELETE /identity/v3/users/a1c63410ce7d47c7957be6e3dfbdea6e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:32.344198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a043a-b588-46ea-bebe-e1b7146534d0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:32.345216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a043a-b588-46ea-bebe-e1b7146534d0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:32.345701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a043a-b588-46ea-bebe-e1b7146534d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:32.372680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1c8a043a-b588-46ea-bebe-e1b7146534d0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:32.376208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1c8a043a-b588-46ea-bebe-e1b7146534d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:32.499850 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2145/4280] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:32.519433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:32.520901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:32.642364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a43e5-5b75-4644-ac2c-2dc4e27432c1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:32.657286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3e18b-88df-4b79-93e6-786e0301d006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:32.657956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3e18b-88df-4b79-93e6-786e0301d006 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:32.658241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3e18b-88df-4b79-93e6-786e0301d006 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:32.658623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3e18b-88df-4b79-93e6-786e0301d006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:32.682193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3e18b-88df-4b79-93e6-786e0301d006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:32.683703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3e18b-88df-4b79-93e6-786e0301d006 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:32.718557 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2136/4281] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:33.752281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02e088-c6f3-4bb7-8da0-e8b9ba41291c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:33.753258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02e088-c6f3-4bb7-8da0-e8b9ba41291c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:33.753694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02e088-c6f3-4bb7-8da0-e8b9ba41291c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:33.788929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8e02e088-c6f3-4bb7-8da0-e8b9ba41291c None None] MFA Rules not processed for user `ed87ef17973a49f2a9108bdfbff65415`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:33.790184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8e02e088-c6f3-4bb7-8da0-e8b9ba41291c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:33.933121 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2146/4282] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:33 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:34.151998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3e18b-88df-4b79-93e6-786e0301d006 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:34.153321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a3d3e18b-88df-4b79-93e6-786e0301d006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:34.190281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3e18b-88df-4b79-93e6-786e0301d006 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:34.200398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:34.201689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:34.202192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:34.202776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] PATH_INFO: `/v3/projects/fbc05b0c433942d4b3a3b7d148a4513b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:34.204361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc05b0c433942d4b3a3b7d148a4513b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:34.210076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:34.336283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc05b0c433942d4b3a3b7d148a4513b', 'request_id': 'req-60250d55-f029-4838-8f73-1c13bf9985f7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:34.356807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc05b0c433942d4b3a3b7d148a4513b', 'request_id': 'req-60250d55-f029-4838-8f73-1c13bf9985f7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:34.378593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc05b0c433942d4b3a3b7d148a4513b', 'request_id': 'req-60250d55-f029-4838-8f73-1c13bf9985f7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:34.412343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] The token cache is being invalidate because project fbc05b0c433942d4b3a3b7d148a4513b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:34.413114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:34.414790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:34.418467 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2137/4283] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:34 2021] DELETE /identity/v3/projects/fbc05b0c433942d4b3a3b7d148a4513b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:34.425832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02e088-c6f3-4bb7-8da0-e8b9ba41291c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:34.459397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02e088-c6f3-4bb7-8da0-e8b9ba41291c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:34.554901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98333c-dd27-4d3d-8537-449addb3ae38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:34.556434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98333c-dd27-4d3d-8537-449addb3ae38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:34.557209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98333c-dd27-4d3d-8537-449addb3ae38 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:34.557977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98333c-dd27-4d3d-8537-449addb3ae38 admin admin] PATH_INFO: `/v3/users/6bb4cfa923aa436fb756ba7ec8a86f42` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:34.559914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98333c-dd27-4d3d-8537-449addb3ae38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb4cfa923aa436fb756ba7ec8a86f42)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:34.562740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98333c-dd27-4d3d-8537-449addb3ae38 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:34.643406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7d98333c-dd27-4d3d-8537-449addb3ae38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb4cfa923aa436fb756ba7ec8a86f42'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:34.661198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7d98333c-dd27-4d3d-8537-449addb3ae38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb4cfa923aa436fb756ba7ec8a86f42'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:34.662391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7d98333c-dd27-4d3d-8537-449addb3ae38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb4cfa923aa436fb756ba7ec8a86f42'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:34.677256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7d98333c-dd27-4d3d-8537-449addb3ae38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb4cfa923aa436fb756ba7ec8a86f42'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:34.697610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7d98333c-dd27-4d3d-8537-449addb3ae38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb4cfa923aa436fb756ba7ec8a86f42'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:34.708093 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2147/4284] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:34 2021] DELETE /identity/v3/users/6bb4cfa923aa436fb756ba7ec8a86f42 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:35.140739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:35.142587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:35.157220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60250d55-f029-4838-8f73-1c13bf9985f7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:35.249208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:35.251801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:35.252167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:35.252462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] PATH_INFO: `/v3/users/3d35bf2ec4db4c909ce8533464dde6e6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:35.254508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d35bf2ec4db4c909ce8533464dde6e6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:35.257300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:35.344711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d35bf2ec4db4c909ce8533464dde6e6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:35.346060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d35bf2ec4db4c909ce8533464dde6e6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:35.370286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d35bf2ec4db4c909ce8533464dde6e6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:35.373012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d35bf2ec4db4c909ce8533464dde6e6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:35.388092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d35bf2ec4db4c909ce8533464dde6e6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:35.422502 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2138/4285] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:35 2021] DELETE /identity/v3/users/3d35bf2ec4db4c909ce8533464dde6e6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:35.430401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459290d-080e-404b-b002-377e640affc0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:35.430401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459290d-080e-404b-b002-377e640affc0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:35.430401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459290d-080e-404b-b002-377e640affc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:35.470622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d459290d-080e-404b-b002-377e640affc0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:35.471795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d459290d-080e-404b-b002-377e640affc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:35.583123 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2148/4286] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:35.614583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:35.616792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:35.715497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d873d-2f07-48d5-a626-8853920b6a39 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:35.720200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1eafea-691f-4836-b347-629bdbe777d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:35.722904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eafea-691f-4836-b347-629bdbe777d5 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:35.723304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eafea-691f-4836-b347-629bdbe777d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:35.723624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1eafea-691f-4836-b347-629bdbe777d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:35.740634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1eafea-691f-4836-b347-629bdbe777d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:35.757132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1eafea-691f-4836-b347-629bdbe777d5 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:35.778321 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2139/4287] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:57:35.912530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459290d-080e-404b-b002-377e640affc0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:35.914682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d459290d-080e-404b-b002-377e640affc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:35.940933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459290d-080e-404b-b002-377e640affc0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:35.965863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:35.967014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:35.967600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:35.972677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] PATH_INFO: `/v3/projects/56c6b3ce78a440edb867e0f833c831f8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:35.978020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c6b3ce78a440edb867e0f833c831f8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:35.990848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:36.204112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c6b3ce78a440edb867e0f833c831f8', 'request_id': 'req-24aba06f-38c4-4b72-b65a-114759faa95c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.231331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c6b3ce78a440edb867e0f833c831f8', 'request_id': 'req-24aba06f-38c4-4b72-b65a-114759faa95c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.249157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c6b3ce78a440edb867e0f833c831f8', 'request_id': 'req-24aba06f-38c4-4b72-b65a-114759faa95c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.274847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] The token cache is being invalidate because project 56c6b3ce78a440edb867e0f833c831f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:36.278773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.279909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.283941 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2149/4288] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:35 2021] DELETE /identity/v3/projects/56c6b3ce78a440edb867e0f833c831f8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:36.288294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1eafea-691f-4836-b347-629bdbe777d5 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:36.306584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1eafea-691f-4836-b347-629bdbe777d5 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:36.464943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67875b-eeec-4c8e-ad52-37aa91561c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:36.466531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67875b-eeec-4c8e-ad52-37aa91561c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:36.467463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67875b-eeec-4c8e-ad52-37aa91561c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:36.467743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67875b-eeec-4c8e-ad52-37aa91561c49 admin admin] PATH_INFO: `/v3/users/35c29f92a3204429822a2ce208a8212b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:36.470636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67875b-eeec-4c8e-ad52-37aa91561c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c29f92a3204429822a2ce208a8212b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:36.473476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67875b-eeec-4c8e-ad52-37aa91561c49 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:36.493294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:36.497193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:36.530651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aba06f-38c4-4b72-b65a-114759faa95c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:36.539824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:36.540703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:36.540988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:36.541268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] PATH_INFO: `/v3/projects/03c8cfe27fd0403d99e9315b0e5e9c66` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:36.542611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c8cfe27fd0403d99e9315b0e5e9c66)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:36.544616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:36.626506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e67875b-eeec-4c8e-ad52-37aa91561c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c29f92a3204429822a2ce208a8212b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.627782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e67875b-eeec-4c8e-ad52-37aa91561c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c29f92a3204429822a2ce208a8212b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.644319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e67875b-eeec-4c8e-ad52-37aa91561c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c29f92a3204429822a2ce208a8212b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.645827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e67875b-eeec-4c8e-ad52-37aa91561c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c29f92a3204429822a2ce208a8212b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.660372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e67875b-eeec-4c8e-ad52-37aa91561c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c29f92a3204429822a2ce208a8212b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.701747 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2140/4289] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:36 2021] DELETE /identity/v3/users/35c29f92a3204429822a2ce208a8212b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:36.703173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a400ca7-99fd-426a-b85f-6893cb3df29d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:36.703496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a400ca7-99fd-426a-b85f-6893cb3df29d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:36.707722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a400ca7-99fd-426a-b85f-6893cb3df29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:36.727833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c8cfe27fd0403d99e9315b0e5e9c66', 'request_id': 'req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.759505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c8cfe27fd0403d99e9315b0e5e9c66', 'request_id': 'req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.791834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c8cfe27fd0403d99e9315b0e5e9c66', 'request_id': 'req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.817810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5a400ca7-99fd-426a-b85f-6893cb3df29d None None] MFA Rules not processed for user `2bb012478bf740468bba9fa762ac06ca`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:36.818941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] The token cache is being invalidate because project 03c8cfe27fd0403d99e9315b0e5e9c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:36.819441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.821941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:36.825192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5a400ca7-99fd-426a-b85f-6893cb3df29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:36.825383 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2150/4290] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:36 2021] DELETE /identity/v3/projects/03c8cfe27fd0403d99e9315b0e5e9c66 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:36.829446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:36.832252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:37.020719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4f97b-6dea-4a7b-9e2c-78076ddffecb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:37.099762 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2141/4291] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:36 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:37.099762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38377d0-a62a-4f35-9833-2859d239e5d4 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:37.099762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38377d0-a62a-4f35-9833-2859d239e5d4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:37.099762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38377d0-a62a-4f35-9833-2859d239e5d4 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:37.120146 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2142/4292] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 20:57:37 2021] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 20:57:37.124053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ee58-8b1e-4260-87eb-c727bf9a1bfc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:37.124393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ee58-8b1e-4260-87eb-c727bf9a1bfc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:37.125567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ee58-8b1e-4260-87eb-c727bf9a1bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:37.192003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:37.193063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:37.193425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:37.193643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] PATH_INFO: `/v3/users/626e6df5f42a4b5794e7ebac34e215c6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:37.196010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] RBAC: Authorizing `identity:delete_user(user_id=626e6df5f42a4b5794e7ebac34e215c6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:37.197949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:37.308734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9762ee58-8b1e-4260-87eb-c727bf9a1bfc None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:37.313104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9762ee58-8b1e-4260-87eb-c727bf9a1bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:37.317748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626e6df5f42a4b5794e7ebac34e215c6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:37.369280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626e6df5f42a4b5794e7ebac34e215c6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:37.370241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626e6df5f42a4b5794e7ebac34e215c6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:37.379783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626e6df5f42a4b5794e7ebac34e215c6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:37.409378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626e6df5f42a4b5794e7ebac34e215c6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:37.425672 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2151/4293] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:36 2021] DELETE /identity/v3/users/626e6df5f42a4b5794e7ebac34e215c6 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:37.426913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:37.435936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:37.563952 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2143/4294] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:57:37 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:37.578936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c560b72-5556-45c8-bb4a-a662ad91666b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:37.589099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d534c-2034-4037-bfe0-0b7cdd6a1553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:37.592901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d534c-2034-4037-bfe0-0b7cdd6a1553 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:37.593264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d534c-2034-4037-bfe0-0b7cdd6a1553 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:37.593645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d534c-2034-4037-bfe0-0b7cdd6a1553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:37.599766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8f2d534c-2034-4037-bfe0-0b7cdd6a1553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:37.621550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762ee58-8b1e-4260-87eb-c727bf9a1bfc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:37.623471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9762ee58-8b1e-4260-87eb-c727bf9a1bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:37.647698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762ee58-8b1e-4260-87eb-c727bf9a1bfc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:37.775082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065d840-344a-49cf-be0b-5ef2922efe35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:37.775901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065d840-344a-49cf-be0b-5ef2922efe35 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:37.776724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065d840-344a-49cf-be0b-5ef2922efe35 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:37.777033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065d840-344a-49cf-be0b-5ef2922efe35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:37.786134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d534c-2034-4037-bfe0-0b7cdd6a1553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:37.787653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d534c-2034-4037-bfe0-0b7cdd6a1553 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:37.803359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065d840-344a-49cf-be0b-5ef2922efe35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:37.811598 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2152/4295] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:37 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:37.812989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d534c-2034-4037-bfe0-0b7cdd6a1553 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:37.817362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8f2d534c-2034-4037-bfe0-0b7cdd6a1553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:37.818512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065d840-344a-49cf-be0b-5ef2922efe35 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:37.846086 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2144/4296] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:38.151455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d534c-2034-4037-bfe0-0b7cdd6a1553 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:38.167440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:38.171388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:38.172106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:38.173498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] PATH_INFO: `/v3/projects/89a0fcf23abe43e088d94360e09bfc43` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:38.176817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a0fcf23abe43e088d94360e09bfc43)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:38.180923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:38.191829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5de884-2133-4305-b2aa-20bd3f4934a6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:38.191829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5de884-2133-4305-b2aa-20bd3f4934a6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:38.192198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5de884-2133-4305-b2aa-20bd3f4934a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:38.224762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-df5de884-2133-4305-b2aa-20bd3f4934a6 None None] MFA Rules not processed for user `ed87ef17973a49f2a9108bdfbff65415`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:38.227645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-df5de884-2133-4305-b2aa-20bd3f4934a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:38.309967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a0fcf23abe43e088d94360e09bfc43', 'request_id': 'req-0693bcaf-784d-4622-ad7f-78eec122cf79'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:38.340257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a0fcf23abe43e088d94360e09bfc43', 'request_id': 'req-0693bcaf-784d-4622-ad7f-78eec122cf79'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:38.385465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a0fcf23abe43e088d94360e09bfc43', 'request_id': 'req-0693bcaf-784d-4622-ad7f-78eec122cf79'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:38.470287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] The token cache is being invalidate because project 89a0fcf23abe43e088d94360e09bfc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:38.473889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:38.475164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0693bcaf-784d-4622-ad7f-78eec122cf79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:38.484605 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2153/4297] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:37 2021] DELETE /identity/v3/projects/89a0fcf23abe43e088d94360e09bfc43 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:38.491626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec168f-0414-4223-9b3c-3bbd09e87a4b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:38.495464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec168f-0414-4223-9b3c-3bbd09e87a4b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:38.495905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec168f-0414-4223-9b3c-3bbd09e87a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:38.502215 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2145/4298] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:38 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:38.554287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-08ec168f-0414-4223-9b3c-3bbd09e87a4b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:38.555714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-08ec168f-0414-4223-9b3c-3bbd09e87a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:38.697389 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2154/4299] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:38.705223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3847dfb-7008-4297-9538-350c8479635f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:38.705523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3847dfb-7008-4297-9538-350c8479635f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:38.705839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3847dfb-7008-4297-9538-350c8479635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:38.761484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a3847dfb-7008-4297-9538-350c8479635f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:38.763571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a3847dfb-7008-4297-9538-350c8479635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:38.777380 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2146/4300] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:38.782440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec168f-0414-4223-9b3c-3bbd09e87a4b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:38.795008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec168f-0414-4223-9b3c-3bbd09e87a4b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:38.808538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25492e11-7910-41bc-b368-2cd259104e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:38.809239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25492e11-7910-41bc-b368-2cd259104e9d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:38.810287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25492e11-7910-41bc-b368-2cd259104e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:38.810573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25492e11-7910-41bc-b368-2cd259104e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:38.812098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25492e11-7910-41bc-b368-2cd259104e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:38.812239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25492e11-7910-41bc-b368-2cd259104e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:38.814402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25492e11-7910-41bc-b368-2cd259104e9d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:38.841143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3847dfb-7008-4297-9538-350c8479635f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:38.854250 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2155/4301] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:57:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:38.857517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3847dfb-7008-4297-9538-350c8479635f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:38.864555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc9a9b-126e-4d69-abc8-69d9b146aba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:38.865767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc9a9b-126e-4d69-abc8-69d9b146aba9 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:38.866130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc9a9b-126e-4d69-abc8-69d9b146aba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:38.867041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc9a9b-126e-4d69-abc8-69d9b146aba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:38.868687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc9a9b-126e-4d69-abc8-69d9b146aba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:38.871202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc9a9b-126e-4d69-abc8-69d9b146aba9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:38.951313 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2147/4302] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:38 2021] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:38.955339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25492e11-7910-41bc-b368-2cd259104e9d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:38.973627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25492e11-7910-41bc-b368-2cd259104e9d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:39.134788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbbb0b-8ed5-45fb-8bb4-03869d01bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:39.137259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbbb0b-8ed5-45fb-8bb4-03869d01bbaf admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:39.137945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbbb0b-8ed5-45fb-8bb4-03869d01bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:39.138241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbbb0b-8ed5-45fb-8bb4-03869d01bbaf admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:39.138978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbbb0b-8ed5-45fb-8bb4-03869d01bbaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:39.140940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbbb0b-8ed5-45fb-8bb4-03869d01bbaf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:39.190562 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2156/4303] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:38 2021] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:39.192297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc9a9b-126e-4d69-abc8-69d9b146aba9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:39.210894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc9a9b-126e-4d69-abc8-69d9b146aba9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:39.226734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703857-0b62-434c-a9c2-01ccd08645a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:39.227762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703857-0b62-434c-a9c2-01ccd08645a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:39.227971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703857-0b62-434c-a9c2-01ccd08645a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:39.228195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39703857-0b62-434c-a9c2-01ccd08645a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:39.229099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39703857-0b62-434c-a9c2-01ccd08645a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:39.230992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39703857-0b62-434c-a9c2-01ccd08645a2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:39.261417 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2148/4304] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:39 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:39.263241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbbb0b-8ed5-45fb-8bb4-03869d01bbaf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:39.281285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbbb0b-8ed5-45fb-8bb4-03869d01bbaf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:39.307725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cacdc-8aa8-4c28-b997-10cba03f3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:39.310873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cacdc-8aa8-4c28-b997-10cba03f3021 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:39.311274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cacdc-8aa8-4c28-b997-10cba03f3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:39.311753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cacdc-8aa8-4c28-b997-10cba03f3021 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:39.313881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cacdc-8aa8-4c28-b997-10cba03f3021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:39.317740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cacdc-8aa8-4c28-b997-10cba03f3021 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:39.363420 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2157/4305] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:39 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:57:39.364785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703857-0b62-434c-a9c2-01ccd08645a2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:39.417649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39703857-0b62-434c-a9c2-01ccd08645a2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:39.459325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facf778-b95d-468a-8969-2d6862e3de06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:39.460349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facf778-b95d-468a-8969-2d6862e3de06 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:39.460724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facf778-b95d-468a-8969-2d6862e3de06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:39.460996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facf778-b95d-468a-8969-2d6862e3de06 admin admin] PATH_INFO: `/v3/projects/8d7fc485a424450f8be4cc53e8cdf68b/users/c477e5c4c7cd469ea0e1cb95cfaf0fdf/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:39.508398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cacdc-8aa8-4c28-b997-10cba03f3021 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:39.510654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-043cacdc-8aa8-4c28-b997-10cba03f3021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:39.512314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facf778-b95d-468a-8969-2d6862e3de06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7fc485a424450f8be4cc53e8cdf68b, user_id=c477e5c4c7cd469ea0e1cb95cfaf0fdf, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:39.516885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facf778-b95d-468a-8969-2d6862e3de06 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:39.545739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cacdc-8aa8-4c28-b997-10cba03f3021 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:39.559549 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2149/4306] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:39 2021] PUT /identity/v3/projects/8d7fc485a424450f8be4cc53e8cdf68b/users/c477e5c4c7cd469ea0e1cb95cfaf0fdf/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:39.570071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06456b8-6f37-4927-a5f7-57ebabb7583a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:39.570623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06456b8-6f37-4927-a5f7-57ebabb7583a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:39.573657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06456b8-6f37-4927-a5f7-57ebabb7583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:39.688277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c06456b8-6f37-4927-a5f7-57ebabb7583a None None] MFA Rules not processed for user `c477e5c4c7cd469ea0e1cb95cfaf0fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:39.690024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c06456b8-6f37-4927-a5f7-57ebabb7583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:39.711147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:39.736719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:39.737503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:39.738461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] PATH_INFO: `/v3/projects/fd63c2cc89124cd98641639372a7dfd8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:39.748230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd63c2cc89124cd98641639372a7dfd8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:39.754746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:39.934409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd63c2cc89124cd98641639372a7dfd8', 'request_id': 'req-fbf68419-27a0-4f15-94f2-b92f98ca81a6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:39.950152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd63c2cc89124cd98641639372a7dfd8', 'request_id': 'req-fbf68419-27a0-4f15-94f2-b92f98ca81a6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:39.954197 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2150/4307] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:39 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:57:39.959190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06456b8-6f37-4927-a5f7-57ebabb7583a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:39.969645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd63c2cc89124cd98641639372a7dfd8', 'request_id': 'req-fbf68419-27a0-4f15-94f2-b92f98ca81a6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:39.992575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06456b8-6f37-4927-a5f7-57ebabb7583a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:40.006603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] The token cache is being invalidate because project fd63c2cc89124cd98641639372a7dfd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:40.006789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:40.009558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fbf68419-27a0-4f15-94f2-b92f98ca81a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:40.029497 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2158/4308] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:39 2021] DELETE /identity/v3/projects/fd63c2cc89124cd98641639372a7dfd8 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:40.035426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed505e2-1d62-4ec4-a680-1235ff4654eb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.035751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed505e2-1d62-4ec4-a680-1235ff4654eb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.035990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed505e2-1d62-4ec4-a680-1235ff4654eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.129891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bed505e2-1d62-4ec4-a680-1235ff4654eb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:40.131051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bed505e2-1d62-4ec4-a680-1235ff4654eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:40.153904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73243e-65bf-4688-838d-ab32138ab348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:40.155736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73243e-65bf-4688-838d-ab32138ab348 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.156244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73243e-65bf-4688-838d-ab32138ab348 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.156765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73243e-65bf-4688-838d-ab32138ab348 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.157705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73243e-65bf-4688-838d-ab32138ab348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:40.160013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73243e-65bf-4688-838d-ab32138ab348 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:40.240187 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2151/4309] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:39 2021] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:40.244378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73243e-65bf-4688-838d-ab32138ab348 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:40.247881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0d73243e-65bf-4688-838d-ab32138ab348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:40.337112 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2159/4310] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:40.338653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca92f-b89e-43ad-83c9-f0a4358ddc3f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.338947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca92f-b89e-43ad-83c9-f0a4358ddc3f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.343901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca92f-b89e-43ad-83c9-f0a4358ddc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.400950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-03cca92f-b89e-43ad-83c9-f0a4358ddc3f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:40.404543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-03cca92f-b89e-43ad-83c9-f0a4358ddc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:40.416651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73243e-65bf-4688-838d-ab32138ab348 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:40.423428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52d164-45a0-4424-881d-c262fadb4af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:40.425097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52d164-45a0-4424-881d-c262fadb4af6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.425560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52d164-45a0-4424-881d-c262fadb4af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.425998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52d164-45a0-4424-881d-c262fadb4af6 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.426880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52d164-45a0-4424-881d-c262fadb4af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:40.429530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52d164-45a0-4424-881d-c262fadb4af6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:40.437131 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2160/4311] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:40.449522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cca92f-b89e-43ad-83c9-f0a4358ddc3f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:40.476399 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2152/4312] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:40 2021] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:40.478083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cca92f-b89e-43ad-83c9-f0a4358ddc3f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:40.482616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52d164-45a0-4424-881d-c262fadb4af6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:40.486332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588ab2d-9b16-4bc3-8f46-15dff7bdb3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:40.488671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588ab2d-9b16-4bc3-8f46-15dff7bdb3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.489239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588ab2d-9b16-4bc3-8f46-15dff7bdb3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.489239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588ab2d-9b16-4bc3-8f46-15dff7bdb3a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.490168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588ab2d-9b16-4bc3-8f46-15dff7bdb3a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:40.490479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588ab2d-9b16-4bc3-8f46-15dff7bdb3a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:40.493406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588ab2d-9b16-4bc3-8f46-15dff7bdb3a8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:40.509866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52d164-45a0-4424-881d-c262fadb4af6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:40.528104 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2161/4313] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:57:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:40.528633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e469c-a178-4f95-8eeb-1e3cf04c5177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:40.529352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588ab2d-9b16-4bc3-8f46-15dff7bdb3a8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:40.531172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e469c-a178-4f95-8eeb-1e3cf04c5177 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.531954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e469c-a178-4f95-8eeb-1e3cf04c5177 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.532895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e469c-a178-4f95-8eeb-1e3cf04c5177 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.535697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e469c-a178-4f95-8eeb-1e3cf04c5177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:40.539647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e469c-a178-4f95-8eeb-1e3cf04c5177 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:40.552683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588ab2d-9b16-4bc3-8f46-15dff7bdb3a8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:40.566985 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2153/4314] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:40 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:57:40.568057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0919ca8-cc73-4503-acad-af3d76dc7b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:40.568729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919ca8-cc73-4503-acad-af3d76dc7b55 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.571676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919ca8-cc73-4503-acad-af3d76dc7b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.572154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919ca8-cc73-4503-acad-af3d76dc7b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.573097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0919ca8-cc73-4503-acad-af3d76dc7b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:40.573571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e469c-a178-4f95-8eeb-1e3cf04c5177 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:40.576949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0919ca8-cc73-4503-acad-af3d76dc7b55 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:40.586640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e469c-a178-4f95-8eeb-1e3cf04c5177 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:40.601997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f2470-5317-4f21-98e7-eb21c0ba0d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:40.602611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f2470-5317-4f21-98e7-eb21c0ba0d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.602901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f2470-5317-4f21-98e7-eb21c0ba0d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.603213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f2470-5317-4f21-98e7-eb21c0ba0d91 admin admin] PATH_INFO: `/v3/projects/af1ec0ee913a4ec28efc54b8d380a0ea/users/aab5c407b9784f66bae131d530fd6f80/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.626908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f2470-5317-4f21-98e7-eb21c0ba0d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1ec0ee913a4ec28efc54b8d380a0ea, user_id=aab5c407b9784f66bae131d530fd6f80, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:40.630092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f2470-5317-4f21-98e7-eb21c0ba0d91 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:40.646412 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2162/4315] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:40 2021] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:40.647848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0919ca8-cc73-4503-acad-af3d76dc7b55 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:40.652793 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2154/4316] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:40 2021] PUT /identity/v3/projects/af1ec0ee913a4ec28efc54b8d380a0ea/users/aab5c407b9784f66bae131d530fd6f80/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:40.657705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f2470-5317-4f21-98e7-eb21c0ba0d91 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:40.777926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f2470-5317-4f21-98e7-eb21c0ba0d91 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:40.800642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0919ca8-cc73-4503-acad-af3d76dc7b55 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:40.816935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acb2f2-0c66-453e-84d9-5d3769bbdff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:40.818114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acb2f2-0c66-453e-84d9-5d3769bbdff8 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.818433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acb2f2-0c66-453e-84d9-5d3769bbdff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.818682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acb2f2-0c66-453e-84d9-5d3769bbdff8 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.820563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acb2f2-0c66-453e-84d9-5d3769bbdff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:40.824885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acb2f2-0c66-453e-84d9-5d3769bbdff8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:40.851754 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2163/4317] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:40 2021] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:40.856124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acb2f2-0c66-453e-84d9-5d3769bbdff8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:40.871612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acb2f2-0c66-453e-84d9-5d3769bbdff8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:40.878843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490de3-2bdf-4bab-99a9-e545aff6e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:40.879678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141caf1f-bd04-402d-9dc3-c0748c12e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:40.880520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490de3-2bdf-4bab-99a9-e545aff6e1ce admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.880663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141caf1f-bd04-402d-9dc3-c0748c12e39f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.880993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141caf1f-bd04-402d-9dc3-c0748c12e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.881274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490de3-2bdf-4bab-99a9-e545aff6e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.881407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141caf1f-bd04-402d-9dc3-c0748c12e39f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.881829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490de3-2bdf-4bab-99a9-e545aff6e1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.882963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141caf1f-bd04-402d-9dc3-c0748c12e39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:40.883657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92490de3-2bdf-4bab-99a9-e545aff6e1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:40.884831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141caf1f-bd04-402d-9dc3-c0748c12e39f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:40.885748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92490de3-2bdf-4bab-99a9-e545aff6e1ce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:40.901420 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2155/4318] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:40 2021] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:40.902652 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2164/4319] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:40 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:40.908178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490de3-2bdf-4bab-99a9-e545aff6e1ce admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:40.909051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141caf1f-bd04-402d-9dc3-c0748c12e39f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:40.926769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141caf1f-bd04-402d-9dc3-c0748c12e39f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:40.931856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490de3-2bdf-4bab-99a9-e545aff6e1ce admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:40.933210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ff97a-25e3-4592-9963-3a4f7c4ba600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:40.934367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff97a-25e3-4592-9963-3a4f7c4ba600 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.934639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff97a-25e3-4592-9963-3a4f7c4ba600 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.935053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ff97a-25e3-4592-9963-3a4f7c4ba600 admin admin] PATH_INFO: `/v3/projects/af1ec0ee913a4ec28efc54b8d380a0ea/users/aab5c407b9784f66bae131d530fd6f80/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.937899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ff97a-25e3-4592-9963-3a4f7c4ba600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1ec0ee913a4ec28efc54b8d380a0ea, user_id=aab5c407b9784f66bae131d530fd6f80, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:40.939713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91493f9-3259-432b-b19b-a12a6a09048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:40.940642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91493f9-3259-432b-b19b-a12a6a09048b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.940938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ff97a-25e3-4592-9963-3a4f7c4ba600 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:40.942247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91493f9-3259-432b-b19b-a12a6a09048b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.942869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91493f9-3259-432b-b19b-a12a6a09048b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.944272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91493f9-3259-432b-b19b-a12a6a09048b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:40.948568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91493f9-3259-432b-b19b-a12a6a09048b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:40.966540 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2156/4320] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:40 2021] PUT /identity/v3/projects/af1ec0ee913a4ec28efc54b8d380a0ea/users/aab5c407b9784f66bae131d530fd6f80/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:40.970268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d47e7-c59c-4819-9130-8817f31ff808 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:40.970619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d47e7-c59c-4819-9130-8817f31ff808 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:40.970812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d47e7-c59c-4819-9130-8817f31ff808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:40.980283 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2165/4321] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:40 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:40.987387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91493f9-3259-432b-b19b-a12a6a09048b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:41.008560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91493f9-3259-432b-b19b-a12a6a09048b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:41.015679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f58d47e7-c59c-4819-9130-8817f31ff808 None None] MFA Rules not processed for user `aab5c407b9784f66bae131d530fd6f80`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:41.017043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f58d47e7-c59c-4819-9130-8817f31ff808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:41.100339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01d4ed-7680-4f59-bf8b-a64dd3649e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:41.107767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d4ed-7680-4f59-bf8b-a64dd3649e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:41.109464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d4ed-7680-4f59-bf8b-a64dd3649e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:41.109958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d4ed-7680-4f59-bf8b-a64dd3649e8b admin admin] PATH_INFO: `/v3/projects/eb77aeb45a684f00a2c60bcd84ce7588/users/184df0d264a34f37871cd800828caa07/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:41.170346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01d4ed-7680-4f59-bf8b-a64dd3649e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb77aeb45a684f00a2c60bcd84ce7588, user_id=184df0d264a34f37871cd800828caa07, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:41.182114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01d4ed-7680-4f59-bf8b-a64dd3649e8b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:41.209831 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2157/4322] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:40 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:41.211603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d47e7-c59c-4819-9130-8817f31ff808 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:41.213966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f58d47e7-c59c-4819-9130-8817f31ff808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:41.234932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2166/4323] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:40 2021] PUT /identity/v3/projects/eb77aeb45a684f00a2c60bcd84ce7588/users/184df0d264a34f37871cd800828caa07/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:41.237089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b80c88-3ccb-4465-81b2-4611581dcb56 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:41.244497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b80c88-3ccb-4465-81b2-4611581dcb56 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:41.244987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b80c88-3ccb-4465-81b2-4611581dcb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:41.314423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-81b80c88-3ccb-4465-81b2-4611581dcb56 None None] MFA Rules not processed for user `184df0d264a34f37871cd800828caa07`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:41.319409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-81b80c88-3ccb-4465-81b2-4611581dcb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:41.334966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d47e7-c59c-4819-9130-8817f31ff808 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:41.529113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e08c7-cb06-4fc8-bcce-579d78ca0646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:41.529759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e08c7-cb06-4fc8-bcce-579d78ca0646 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:41.530072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e08c7-cb06-4fc8-bcce-579d78ca0646 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:41.530353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e08c7-cb06-4fc8-bcce-579d78ca0646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:41.536086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e65e08c7-cb06-4fc8-bcce-579d78ca0646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:41.564282 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2167/4324] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:41 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:41.565298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e08c7-cb06-4fc8-bcce-579d78ca0646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:41.566781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e08c7-cb06-4fc8-bcce-579d78ca0646 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:41.569801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b80c88-3ccb-4465-81b2-4611581dcb56 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:41.594774 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2158/4325] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:41.597000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e08c7-cb06-4fc8-bcce-579d78ca0646 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:41.606676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b80c88-3ccb-4465-81b2-4611581dcb56 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:41.613134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880de25-507f-4d89-aca1-81be21edcb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:41.613800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880de25-507f-4d89-aca1-81be21edcb6d service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:41.629627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880de25-507f-4d89-aca1-81be21edcb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:41.630245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880de25-507f-4d89-aca1-81be21edcb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:41.734319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880de25-507f-4d89-aca1-81be21edcb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:41.736207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880de25-507f-4d89-aca1-81be21edcb6d service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:41.798772 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2168/4326] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:41 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:41.825045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e08c7-cb06-4fc8-bcce-579d78ca0646 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:41.837001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb67fd-f1cd-47c4-9f5b-32c3474f674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:41.837369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb67fd-f1cd-47c4-9f5b-32c3474f674b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:41.837604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb67fd-f1cd-47c4-9f5b-32c3474f674b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:41.840923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb67fd-f1cd-47c4-9f5b-32c3474f674b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:41.841788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb67fd-f1cd-47c4-9f5b-32c3474f674b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:41.846500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb67fd-f1cd-47c4-9f5b-32c3474f674b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:41.901877 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2159/4327] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:41 2021] POST /identity/v3/projects => generated 371 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:41.906344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880de25-507f-4d89-aca1-81be21edcb6d service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:41.922627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880de25-507f-4d89-aca1-81be21edcb6d service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:42.075549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703d072-0e10-41c9-a1b7-7f017780e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:42.076258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703d072-0e10-41c9-a1b7-7f017780e837 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:42.081298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703d072-0e10-41c9-a1b7-7f017780e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:42.081589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703d072-0e10-41c9-a1b7-7f017780e837 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:42.087382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703d072-0e10-41c9-a1b7-7f017780e837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:42.094525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703d072-0e10-41c9-a1b7-7f017780e837 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:42.169943 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2169/4328] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:41 2021] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:57:42.173798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb67fd-f1cd-47c4-9f5b-32c3474f674b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:42.190934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb67fd-f1cd-47c4-9f5b-32c3474f674b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:42.202254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f095fdf-d05a-496e-bfc9-01fb2be8964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:42.203181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f095fdf-d05a-496e-bfc9-01fb2be8964b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:42.203692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f095fdf-d05a-496e-bfc9-01fb2be8964b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:42.204218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f095fdf-d05a-496e-bfc9-01fb2be8964b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:42.206263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f095fdf-d05a-496e-bfc9-01fb2be8964b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:42.208877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f095fdf-d05a-496e-bfc9-01fb2be8964b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:42.227915 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2160/4329] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:42 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:42.233671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703d072-0e10-41c9-a1b7-7f017780e837 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:42.256868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703d072-0e10-41c9-a1b7-7f017780e837 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:42.266768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbee13-73a5-4611-925c-0a6e4551bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:42.269239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbee13-73a5-4611-925c-0a6e4551bcc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:42.271611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbee13-73a5-4611-925c-0a6e4551bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:42.272184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbee13-73a5-4611-925c-0a6e4551bcc7 admin admin] PATH_INFO: `/v3/projects/ddc9e5d8a5ec44958efb47e0709e5add/users/52690d0c89e042818e26f1ba5df2c092/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:42.297358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbee13-73a5-4611-925c-0a6e4551bcc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc9e5d8a5ec44958efb47e0709e5add, user_id=52690d0c89e042818e26f1ba5df2c092, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:42.300943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbee13-73a5-4611-925c-0a6e4551bcc7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:42.359048 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2170/4330] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:42 2021] PUT /identity/v3/projects/ddc9e5d8a5ec44958efb47e0709e5add/users/52690d0c89e042818e26f1ba5df2c092/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:42.364705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f095fdf-d05a-496e-bfc9-01fb2be8964b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:42.423104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f095fdf-d05a-496e-bfc9-01fb2be8964b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:42.580729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe49dd-e9d5-4265-9555-ad19085e50ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:42.581559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe49dd-e9d5-4265-9555-ad19085e50ff admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:42.581955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe49dd-e9d5-4265-9555-ad19085e50ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:42.582386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe49dd-e9d5-4265-9555-ad19085e50ff admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:42.583403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe49dd-e9d5-4265-9555-ad19085e50ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:42.585269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe49dd-e9d5-4265-9555-ad19085e50ff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:42.608871 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2161/4331] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:42 2021] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:42.614130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbee13-73a5-4611-925c-0a6e4551bcc7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:42.630794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbee13-73a5-4611-925c-0a6e4551bcc7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:42.652797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a66949-84cd-4d72-a641-fc66de5fd73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:42.654274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a66949-84cd-4d72-a641-fc66de5fd73f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:42.654658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a66949-84cd-4d72-a641-fc66de5fd73f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:42.655004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a66949-84cd-4d72-a641-fc66de5fd73f admin admin] PATH_INFO: `/v3/projects/ddc9e5d8a5ec44958efb47e0709e5add/users/52690d0c89e042818e26f1ba5df2c092/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:42.659819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a66949-84cd-4d72-a641-fc66de5fd73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc9e5d8a5ec44958efb47e0709e5add, user_id=52690d0c89e042818e26f1ba5df2c092, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:42.666986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a66949-84cd-4d72-a641-fc66de5fd73f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:42.723286 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2171/4332] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:42 2021] PUT /identity/v3/projects/ddc9e5d8a5ec44958efb47e0709e5add/users/52690d0c89e042818e26f1ba5df2c092/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:42.825463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da556dc-d96d-4591-b2dd-4689763d4f84 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:42.826089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da556dc-d96d-4591-b2dd-4689763d4f84 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:42.826820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da556dc-d96d-4591-b2dd-4689763d4f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:42.890495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6da556dc-d96d-4591-b2dd-4689763d4f84 None None] MFA Rules not processed for user `52690d0c89e042818e26f1ba5df2c092`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:42.894778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6da556dc-d96d-4591-b2dd-4689763d4f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:43.115313 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2162/4333] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:42 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:43.119834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a66949-84cd-4d72-a641-fc66de5fd73f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:43.136142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a66949-84cd-4d72-a641-fc66de5fd73f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:43.142746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86efcd5-a923-4e26-a877-ad0a4ee72040 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52690d0c89e042818e26f1ba5df2c092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddc9e5d8a5ec44958efb47e0709e5add', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:43.143517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86efcd5-a923-4e26-a877-ad0a4ee72040 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:43.143920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86efcd5-a923-4e26-a877-ad0a4ee72040 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:43.144243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86efcd5-a923-4e26-a877-ad0a4ee72040 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:43.145088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86efcd5-a923-4e26-a877-ad0a4ee72040 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:43.149009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86efcd5-a923-4e26-a877-ad0a4ee72040 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:43.212987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da556dc-d96d-4591-b2dd-4689763d4f84 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:43.222021 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2172/4334] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:43 2021] POST /identity/v3/projects => generated 360 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:43.234081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da556dc-d96d-4591-b2dd-4689763d4f84 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:43.518405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06cd21-45e8-42f5-8be7-93822ec08396 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52690d0c89e042818e26f1ba5df2c092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddc9e5d8a5ec44958efb47e0709e5add', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:43.519697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06cd21-45e8-42f5-8be7-93822ec08396 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:43.520210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06cd21-45e8-42f5-8be7-93822ec08396 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:43.521295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06cd21-45e8-42f5-8be7-93822ec08396 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:43.522212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06cd21-45e8-42f5-8be7-93822ec08396 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:43.525363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06cd21-45e8-42f5-8be7-93822ec08396 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:43.578052 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2163/4335] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:43 2021] POST /identity/v3/users => generated 371 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:43.582488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86efcd5-a923-4e26-a877-ad0a4ee72040 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:43.600175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86efcd5-a923-4e26-a877-ad0a4ee72040 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:43.631231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c19786-0acd-416b-886f-99a9c075fa92 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52690d0c89e042818e26f1ba5df2c092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddc9e5d8a5ec44958efb47e0709e5add', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:43.633881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c19786-0acd-416b-886f-99a9c075fa92 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:43.637100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c19786-0acd-416b-886f-99a9c075fa92 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:43.639882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c19786-0acd-416b-886f-99a9c075fa92 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:43.645007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c19786-0acd-416b-886f-99a9c075fa92 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:43.647407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c19786-0acd-416b-886f-99a9c075fa92 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:43.655733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c19786-0acd-416b-886f-99a9c075fa92 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:43.781017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06cd21-45e8-42f5-8be7-93822ec08396 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:43.792790 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2173/4336] 10.222.0.21 () {58 vars in 1156 bytes} [Sat Nov 27 20:57:43 2021] GET /identity/v3/users?domain_id=default => generated 8595 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:43.801440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06cd21-45e8-42f5-8be7-93822ec08396 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:43.814353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52690d0c89e042818e26f1ba5df2c092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddc9e5d8a5ec44958efb47e0709e5add', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:43.816476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:43.817202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:43.818160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] PATH_INFO: `/v3/users/60d696a2abd8469aa8910fcfe749c00f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:43.853609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorizing `identity:update_user(user_id=60d696a2abd8469aa8910fcfe749c00f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:43.856642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:43.938322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '60d696a2abd8469aa8910fcfe749c00f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:43.966433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invalidating the token cache because user 60d696a2abd8469aa8910fcfe749c00f was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:43.968020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.004417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.022139 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2164/4337] 10.222.0.21 () {60 vars in 1243 bytes} [Sat Nov 27 20:57:43 2021] PATCH /identity/v3/users/60d696a2abd8469aa8910fcfe749c00f => generated 485 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:57:44.024813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d313-6a2f-4e50-9c3c-fa2b71aa3c44 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:44.025137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d313-6a2f-4e50-9c3c-fa2b71aa3c44 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:44.025691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d313-6a2f-4e50-9c3c-fa2b71aa3c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:44.055109 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.auth.plugins.core [None req-e9a1d313-6a2f-4e50-9c3c-fa2b71aa3c44 None None] User is disabled: 60d696a2abd8469aa8910fcfe749c00f: AssertionError: User is disabled: 60d696a2abd8469aa8910fcfe749c00f Nov 27 20:57:44.084504 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-e9a1d313-6a2f-4e50-9c3c-fa2b71aa3c44 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.21: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 27 20:57:44.091060 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2174/4338] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:44 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 69 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 27 20:57:44.092456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:44.095530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:44.120882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20188a3e-868b-4c90-9b1c-9ebc91cdb80e tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:44.128992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52690d0c89e042818e26f1ba5df2c092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddc9e5d8a5ec44958efb47e0709e5add', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:44.131690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:44.132494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:44.132494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] PATH_INFO: `/v3/users/60d696a2abd8469aa8910fcfe749c00f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:44.164977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorizing `identity:delete_user(user_id=60d696a2abd8469aa8910fcfe749c00f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:44.169655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:44.298892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d696a2abd8469aa8910fcfe749c00f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.300900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d696a2abd8469aa8910fcfe749c00f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.313165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d696a2abd8469aa8910fcfe749c00f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.316147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d696a2abd8469aa8910fcfe749c00f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.344958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d696a2abd8469aa8910fcfe749c00f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.406184 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2165/4339] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:44 2021] DELETE /identity/v3/users/60d696a2abd8469aa8910fcfe749c00f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:44.410874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1d313-6a2f-4e50-9c3c-fa2b71aa3c44 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:44.414401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e9a1d313-6a2f-4e50-9c3c-fa2b71aa3c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:44.622007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1d313-6a2f-4e50-9c3c-fa2b71aa3c44 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:44.635619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52690d0c89e042818e26f1ba5df2c092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddc9e5d8a5ec44958efb47e0709e5add', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:44.638451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:44.638829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:44.639776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] PATH_INFO: `/v3/projects/531980c7de8b474386e29d307b971169` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:44.643704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorizing `identity:delete_project(project_id=531980c7de8b474386e29d307b971169)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:44.651167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:44.769317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531980c7de8b474386e29d307b971169', 'request_id': 'req-8668ccce-e5aa-4051-bd9e-1773c9d26b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.780497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531980c7de8b474386e29d307b971169', 'request_id': 'req-8668ccce-e5aa-4051-bd9e-1773c9d26b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.790037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531980c7de8b474386e29d307b971169', 'request_id': 'req-8668ccce-e5aa-4051-bd9e-1773c9d26b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.807602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] The token cache is being invalidate because project 531980c7de8b474386e29d307b971169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:44.808164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.809180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:44.811713 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2175/4340] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:44 2021] DELETE /identity/v3/projects/531980c7de8b474386e29d307b971169 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:44.817332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:44.832487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41fbba-1e1b-4453-a8e6-2492336614c4 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:44.930923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c980df8-a5e7-429a-88b7-d74473fc4507 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52690d0c89e042818e26f1ba5df2c092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddc9e5d8a5ec44958efb47e0709e5add', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:44.933082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c980df8-a5e7-429a-88b7-d74473fc4507 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:44.934085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c980df8-a5e7-429a-88b7-d74473fc4507 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:44.934576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c980df8-a5e7-429a-88b7-d74473fc4507 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:44.935595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c980df8-a5e7-429a-88b7-d74473fc4507 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:44.937923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c980df8-a5e7-429a-88b7-d74473fc4507 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:44.954674 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-1c980df8-a5e7-429a-88b7-d74473fc4507 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Could not find domain: 246cfb93fab34f2e910bd0939f3cd7ab.: keystone.exception.DomainNotFound: Could not find domain: 246cfb93fab34f2e910bd0939f3cd7ab. Nov 27 20:57:44.958127 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2166/4341] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:44 2021] POST /identity/v3/users => generated 112 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 20:57:44.965316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:44.966622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:45.079678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668ccce-e5aa-4051-bd9e-1773c9d26b00 tempest-UsersNegativeTest-1402571698 tempest-UsersNegativeTest-1402571698-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:45.085383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c19a1-9424-4574-ba64-06fa2d59b2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:45.086717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c19a1-9424-4574-ba64-06fa2d59b2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:45.087353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c19a1-9424-4574-ba64-06fa2d59b2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:45.088774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c19a1-9424-4574-ba64-06fa2d59b2c0 admin admin] PATH_INFO: `/v3/users/184df0d264a34f37871cd800828caa07` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:45.090280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c19a1-9424-4574-ba64-06fa2d59b2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=184df0d264a34f37871cd800828caa07)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:45.094941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c19a1-9424-4574-ba64-06fa2d59b2c0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:45.195708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3a6c19a1-9424-4574-ba64-06fa2d59b2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '184df0d264a34f37871cd800828caa07'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:45.212873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3a6c19a1-9424-4574-ba64-06fa2d59b2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '184df0d264a34f37871cd800828caa07'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:45.214183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3a6c19a1-9424-4574-ba64-06fa2d59b2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '184df0d264a34f37871cd800828caa07'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:45.245137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3a6c19a1-9424-4574-ba64-06fa2d59b2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '184df0d264a34f37871cd800828caa07'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:45.289805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3a6c19a1-9424-4574-ba64-06fa2d59b2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '184df0d264a34f37871cd800828caa07'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:45.310604 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2176/4342] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:44 2021] DELETE /identity/v3/users/184df0d264a34f37871cd800828caa07 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:45.320923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f577177-ce98-4ad3-a0d6-cc0fa79eff1c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:45.322897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f577177-ce98-4ad3-a0d6-cc0fa79eff1c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:45.323463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f577177-ce98-4ad3-a0d6-cc0fa79eff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:45.338652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a77fc-8bd6-42b1-b339-debb3b673977 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:45.341360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a77fc-8bd6-42b1-b339-debb3b673977 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:45.342054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a77fc-8bd6-42b1-b339-debb3b673977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:45.409163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3f577177-ce98-4ad3-a0d6-cc0fa79eff1c None None] MFA Rules not processed for user `2bb012478bf740468bba9fa762ac06ca`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:45.414562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3f577177-ce98-4ad3-a0d6-cc0fa79eff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:45.432585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b13a77fc-8bd6-42b1-b339-debb3b673977 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:45.442359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b13a77fc-8bd6-42b1-b339-debb3b673977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:45.593343 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2177/4343] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:45.602939 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2167/4344] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:45 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:45.632843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a77fc-8bd6-42b1-b339-debb3b673977 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:45.634721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b13a77fc-8bd6-42b1-b339-debb3b673977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:45.837367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a77fc-8bd6-42b1-b339-debb3b673977 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:45.847895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c23a39-932c-4b8b-bb3d-61dcae3434dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:45.850683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23a39-932c-4b8b-bb3d-61dcae3434dd service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:45.851971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23a39-932c-4b8b-bb3d-61dcae3434dd service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:45.852261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c23a39-932c-4b8b-bb3d-61dcae3434dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:45.873696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c23a39-932c-4b8b-bb3d-61dcae3434dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:45.875825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c23a39-932c-4b8b-bb3d-61dcae3434dd service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:45.893660 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2178/4345] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:57:47.733068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f577177-ce98-4ad3-a0d6-cc0fa79eff1c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:47.734541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3f577177-ce98-4ad3-a0d6-cc0fa79eff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:47.765338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f577177-ce98-4ad3-a0d6-cc0fa79eff1c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:47.777026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:47.777937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:47.778270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:47.778498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] PATH_INFO: `/v3/projects/eb77aeb45a684f00a2c60bcd84ce7588` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:47.784269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb77aeb45a684f00a2c60bcd84ce7588)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:47.786363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:47.909334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb77aeb45a684f00a2c60bcd84ce7588', 'request_id': 'req-75cf5f1c-eaee-4308-ba1b-50194377df19'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:47.954924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb77aeb45a684f00a2c60bcd84ce7588', 'request_id': 'req-75cf5f1c-eaee-4308-ba1b-50194377df19'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:47.986190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb77aeb45a684f00a2c60bcd84ce7588', 'request_id': 'req-75cf5f1c-eaee-4308-ba1b-50194377df19'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:48.009672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] The token cache is being invalidate because project eb77aeb45a684f00a2c60bcd84ce7588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:48.010420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:48.011503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:48.014851 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2168/4346] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:47 2021] DELETE /identity/v3/projects/eb77aeb45a684f00a2c60bcd84ce7588 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:48.018767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c23a39-932c-4b8b-bb3d-61dcae3434dd service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:48.035512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c23a39-932c-4b8b-bb3d-61dcae3434dd service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:48.201938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c523da8-2d70-4a21-a2c4-c0de7c165fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:48.202680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523da8-2d70-4a21-a2c4-c0de7c165fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:48.203082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523da8-2d70-4a21-a2c4-c0de7c165fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:48.205032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c523da8-2d70-4a21-a2c4-c0de7c165fd4 admin admin] PATH_INFO: `/v3/users/52690d0c89e042818e26f1ba5df2c092` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:48.209181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c523da8-2d70-4a21-a2c4-c0de7c165fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52690d0c89e042818e26f1ba5df2c092)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:48.211213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c523da8-2d70-4a21-a2c4-c0de7c165fd4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:48.333626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2c523da8-2d70-4a21-a2c4-c0de7c165fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52690d0c89e042818e26f1ba5df2c092'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:48.355708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2c523da8-2d70-4a21-a2c4-c0de7c165fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52690d0c89e042818e26f1ba5df2c092'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:48.356949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2c523da8-2d70-4a21-a2c4-c0de7c165fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52690d0c89e042818e26f1ba5df2c092'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:48.378690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2c523da8-2d70-4a21-a2c4-c0de7c165fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52690d0c89e042818e26f1ba5df2c092'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:48.408351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2c523da8-2d70-4a21-a2c4-c0de7c165fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52690d0c89e042818e26f1ba5df2c092'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:48.425802 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2179/4347] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:48 2021] DELETE /identity/v3/users/52690d0c89e042818e26f1ba5df2c092 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:57:49.618356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:49.621702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:49.654290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf5f1c-eaee-4308-ba1b-50194377df19 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:49.828473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:49.830580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:49.831032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:49.831496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] PATH_INFO: `/v3/projects/ddc9e5d8a5ec44958efb47e0709e5add` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:49.833256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc9e5d8a5ec44958efb47e0709e5add)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:49.835586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:49.976216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc9e5d8a5ec44958efb47e0709e5add', 'request_id': 'req-56262c9d-cd90-47a3-85b0-aa3db05e8717'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:49.989233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc9e5d8a5ec44958efb47e0709e5add', 'request_id': 'req-56262c9d-cd90-47a3-85b0-aa3db05e8717'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:50.009959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc9e5d8a5ec44958efb47e0709e5add', 'request_id': 'req-56262c9d-cd90-47a3-85b0-aa3db05e8717'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:50.040561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] The token cache is being invalidate because project ddc9e5d8a5ec44958efb47e0709e5add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:50.042484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:50.045163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56262c9d-cd90-47a3-85b0-aa3db05e8717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:50.051633 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2169/4348] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:49 2021] DELETE /identity/v3/projects/ddc9e5d8a5ec44958efb47e0709e5add => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:50.058255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a7b93-f38c-4765-a82a-7817c938d31f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:50.058797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a7b93-f38c-4765-a82a-7817c938d31f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:50.058982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a7b93-f38c-4765-a82a-7817c938d31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:50.088882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-765a7b93-f38c-4765-a82a-7817c938d31f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:50.090886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-765a7b93-f38c-4765-a82a-7817c938d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:50.208516 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2180/4349] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:50.217519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b5d9a-7bfe-4d74-a802-920ff3fee648 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:50.218137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b5d9a-7bfe-4d74-a802-920ff3fee648 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:50.218729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b5d9a-7bfe-4d74-a802-920ff3fee648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:50.266447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4e0b5d9a-7bfe-4d74-a802-920ff3fee648 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:50.270898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4e0b5d9a-7bfe-4d74-a802-920ff3fee648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:50.286624 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2170/4350] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:50.293877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a7b93-f38c-4765-a82a-7817c938d31f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:50.310737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a7b93-f38c-4765-a82a-7817c938d31f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:50.320144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e18c4-bc66-4b5b-864d-23b6942c1fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:50.321595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e18c4-bc66-4b5b-864d-23b6942c1fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:50.322344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e18c4-bc66-4b5b-864d-23b6942c1fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:50.322989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e18c4-bc66-4b5b-864d-23b6942c1fd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:50.324435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e18c4-bc66-4b5b-864d-23b6942c1fd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:50.324933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e18c4-bc66-4b5b-864d-23b6942c1fd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:50.329846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e18c4-bc66-4b5b-864d-23b6942c1fd3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:50.353131 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2181/4351] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:57:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:50.353862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b5d9a-7bfe-4d74-a802-920ff3fee648 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:50.366433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b5d9a-7bfe-4d74-a802-920ff3fee648 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:50.373969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d08b7e-6b3c-4916-8de6-afb7df1b744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:50.375948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d08b7e-6b3c-4916-8de6-afb7df1b744c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:50.376531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d08b7e-6b3c-4916-8de6-afb7df1b744c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:50.377099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d08b7e-6b3c-4916-8de6-afb7df1b744c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:50.378337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d08b7e-6b3c-4916-8de6-afb7df1b744c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:50.381917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d08b7e-6b3c-4916-8de6-afb7df1b744c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:50.425617 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2171/4352] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:50 2021] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:57:50.429235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e18c4-bc66-4b5b-864d-23b6942c1fd3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:50.443618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e18c4-bc66-4b5b-864d-23b6942c1fd3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:50.561987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92779-ca4a-435f-8de0-987127dbdabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:50.562783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92779-ca4a-435f-8de0-987127dbdabf admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:50.563143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92779-ca4a-435f-8de0-987127dbdabf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:50.563856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c92779-ca4a-435f-8de0-987127dbdabf admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:50.564268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c92779-ca4a-435f-8de0-987127dbdabf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:50.566839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c92779-ca4a-435f-8de0-987127dbdabf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:50.610962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d08b7e-6b3c-4916-8de6-afb7df1b744c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:50.620316 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2182/4353] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:50 2021] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:50.624471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d08b7e-6b3c-4916-8de6-afb7df1b744c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:50.641683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b9c1-2ef1-42d4-91da-a6c78903aff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:50.643025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b9c1-2ef1-42d4-91da-a6c78903aff5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:50.643559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b9c1-2ef1-42d4-91da-a6c78903aff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:50.644051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b9c1-2ef1-42d4-91da-a6c78903aff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:50.645096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7b9c1-2ef1-42d4-91da-a6c78903aff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:50.648648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7b9c1-2ef1-42d4-91da-a6c78903aff5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:50.661884 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2172/4354] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:50 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:50.666514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92779-ca4a-435f-8de0-987127dbdabf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:50.679297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c92779-ca4a-435f-8de0-987127dbdabf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:50.685186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534b3e-c50b-477b-93cb-3a2bf7385bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:50.686121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534b3e-c50b-477b-93cb-3a2bf7385bee admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:50.686385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534b3e-c50b-477b-93cb-3a2bf7385bee admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:50.686910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534b3e-c50b-477b-93cb-3a2bf7385bee admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:50.687784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534b3e-c50b-477b-93cb-3a2bf7385bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:50.689973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534b3e-c50b-477b-93cb-3a2bf7385bee admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:50.713061 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2183/4355] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:50 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:50.717836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b9c1-2ef1-42d4-91da-a6c78903aff5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:50.732415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b9c1-2ef1-42d4-91da-a6c78903aff5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:50.750166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82215c2-cbed-44d5-9e68-551c34a4ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:50.752580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82215c2-cbed-44d5-9e68-551c34a4ea84 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:50.753326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82215c2-cbed-44d5-9e68-551c34a4ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:50.754000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82215c2-cbed-44d5-9e68-551c34a4ea84 admin admin] PATH_INFO: `/v3/projects/f54bbef057ec44e1b85b9ab4de2525ce/users/8bc1f6401cc947afbfab212ca39ebc7f/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:50.796446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82215c2-cbed-44d5-9e68-551c34a4ea84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54bbef057ec44e1b85b9ab4de2525ce, user_id=8bc1f6401cc947afbfab212ca39ebc7f, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:50.799984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82215c2-cbed-44d5-9e68-551c34a4ea84 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:50.832519 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2173/4356] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:50 2021] PUT /identity/v3/projects/f54bbef057ec44e1b85b9ab4de2525ce/users/8bc1f6401cc947afbfab212ca39ebc7f/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:50.844717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d520d-56db-4626-a575-d0023e7c7bab None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:50.849100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d520d-56db-4626-a575-d0023e7c7bab None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:50.849677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d520d-56db-4626-a575-d0023e7c7bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:50.896064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ac7d520d-56db-4626-a575-d0023e7c7bab None None] MFA Rules not processed for user `8bc1f6401cc947afbfab212ca39ebc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:50.898817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ac7d520d-56db-4626-a575-d0023e7c7bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:51.065995 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2184/4357] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:50 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:51.071769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82215c2-cbed-44d5-9e68-551c34a4ea84 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:51.085958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82215c2-cbed-44d5-9e68-551c34a4ea84 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:51.091285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb3e5c-0bb7-4148-bdc0-ace951ce162d tempest-IdentityCatalogTest-1688881939 tempest-IdentityCatalogTest-1688881939-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc1f6401cc947afbfab212ca39ebc7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f54bbef057ec44e1b85b9ab4de2525ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:51.092061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb3e5c-0bb7-4148-bdc0-ace951ce162d tempest-IdentityCatalogTest-1688881939 tempest-IdentityCatalogTest-1688881939-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:51.092594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb3e5c-0bb7-4148-bdc0-ace951ce162d tempest-IdentityCatalogTest-1688881939 tempest-IdentityCatalogTest-1688881939-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:51.092987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb3e5c-0bb7-4148-bdc0-ace951ce162d tempest-IdentityCatalogTest-1688881939 tempest-IdentityCatalogTest-1688881939-project] PATH_INFO: `/v3/auth/catalog` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:51.093816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb3e5c-0bb7-4148-bdc0-ace951ce162d tempest-IdentityCatalogTest-1688881939 tempest-IdentityCatalogTest-1688881939-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:51.095404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb3e5c-0bb7-4148-bdc0-ace951ce162d tempest-IdentityCatalogTest-1688881939 tempest-IdentityCatalogTest-1688881939-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:51.097959 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2174/4358] 10.222.0.21 () {58 vars in 1142 bytes} [Sat Nov 27 20:57:51 2021] GET /identity/v3/auth/catalog => generated 2648 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:51.104605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d520d-56db-4626-a575-d0023e7c7bab None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:51.278137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d520d-56db-4626-a575-d0023e7c7bab None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:51.290065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:51.291419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:51.292124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:51.293738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] PATH_INFO: `/v3/users/8bc1f6401cc947afbfab212ca39ebc7f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:51.297206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc1f6401cc947afbfab212ca39ebc7f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:51.304613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:51.389196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc1f6401cc947afbfab212ca39ebc7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:51.399669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc1f6401cc947afbfab212ca39ebc7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:51.400728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc1f6401cc947afbfab212ca39ebc7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:51.411760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc1f6401cc947afbfab212ca39ebc7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:51.428688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc1f6401cc947afbfab212ca39ebc7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:51.437923 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2185/4359] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:51 2021] DELETE /identity/v3/users/8bc1f6401cc947afbfab212ca39ebc7f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:51.442496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6436-5b92-4be4-aee8-ef9eeba2e6fd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:51.443118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6436-5b92-4be4-aee8-ef9eeba2e6fd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:51.443793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d6436-5b92-4be4-aee8-ef9eeba2e6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:51.470505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fd2d6436-5b92-4be4-aee8-ef9eeba2e6fd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:51.472029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fd2d6436-5b92-4be4-aee8-ef9eeba2e6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:51.570408 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2175/4360] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:51.588868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:51.591050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:51.728890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519bfa6-dfd3-4141-ac00-19d81f40b7a4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:51.742573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa718a-1c7a-42c7-8822-1774fae00629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:51.744150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa718a-1c7a-42c7-8822-1774fae00629 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:51.744949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa718a-1c7a-42c7-8822-1774fae00629 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:51.745251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa718a-1c7a-42c7-8822-1774fae00629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:51.762139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa718a-1c7a-42c7-8822-1774fae00629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:51.764065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa718a-1c7a-42c7-8822-1774fae00629 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:51.781364 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2186/4361] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:53.283841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d6436-5b92-4be4-aee8-ef9eeba2e6fd None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:53.291748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fd2d6436-5b92-4be4-aee8-ef9eeba2e6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:53.346833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d6436-5b92-4be4-aee8-ef9eeba2e6fd None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:53.364258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:53.365255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:53.365469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:53.366799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] PATH_INFO: `/v3/projects/f54bbef057ec44e1b85b9ab4de2525ce` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:53.369042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54bbef057ec44e1b85b9ab4de2525ce)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:53.373799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:53.452620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54bbef057ec44e1b85b9ab4de2525ce', 'request_id': 'req-e30f7344-1be3-4870-bf71-84a223aa5a33'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:53.465628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54bbef057ec44e1b85b9ab4de2525ce', 'request_id': 'req-e30f7344-1be3-4870-bf71-84a223aa5a33'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:53.477848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54bbef057ec44e1b85b9ab4de2525ce', 'request_id': 'req-e30f7344-1be3-4870-bf71-84a223aa5a33'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:53.490672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] The token cache is being invalidate because project f54bbef057ec44e1b85b9ab4de2525ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:53.490958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:53.491985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e30f7344-1be3-4870-bf71-84a223aa5a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:53.493878 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2176/4362] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:53 2021] DELETE /identity/v3/projects/f54bbef057ec44e1b85b9ab4de2525ce => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:53.502649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350c0f-3b3f-4cf1-b215-c8775ad61cd6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:53.503492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350c0f-3b3f-4cf1-b215-c8775ad61cd6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:53.503492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0350c0f-3b3f-4cf1-b215-c8775ad61cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:53.528495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d0350c0f-3b3f-4cf1-b215-c8775ad61cd6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:53.530268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d0350c0f-3b3f-4cf1-b215-c8775ad61cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:53.639344 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2187/4363] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:53.648999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2cdc7-3b37-4450-88df-8b7997556dec None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:53.649488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2cdc7-3b37-4450-88df-8b7997556dec None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:53.650005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2cdc7-3b37-4450-88df-8b7997556dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:53.675529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-acc2cdc7-3b37-4450-88df-8b7997556dec None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:53.676795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-acc2cdc7-3b37-4450-88df-8b7997556dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:53.687748 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2177/4364] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:53.692106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350c0f-3b3f-4cf1-b215-c8775ad61cd6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:53.704770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0350c0f-3b3f-4cf1-b215-c8775ad61cd6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:53.711394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afa079-3fcd-4470-a3f7-d0ed673016c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:53.711999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afa079-3fcd-4470-a3f7-d0ed673016c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:53.712117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afa079-3fcd-4470-a3f7-d0ed673016c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:53.712374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afa079-3fcd-4470-a3f7-d0ed673016c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:53.713118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afa079-3fcd-4470-a3f7-d0ed673016c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:57:53.713475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afa079-3fcd-4470-a3f7-d0ed673016c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:53.715096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afa079-3fcd-4470-a3f7-d0ed673016c7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:53.730791 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2188/4365] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:57:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:57:53.735614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2cdc7-3b37-4450-88df-8b7997556dec None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:53.755053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2cdc7-3b37-4450-88df-8b7997556dec None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:53.774663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e69d13-4864-448c-8a51-52909696ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:53.776374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e69d13-4864-448c-8a51-52909696ac74 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:53.776956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e69d13-4864-448c-8a51-52909696ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:53.778714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e69d13-4864-448c-8a51-52909696ac74 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:53.781096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e69d13-4864-448c-8a51-52909696ac74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:53.783505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e69d13-4864-448c-8a51-52909696ac74 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:53.825068 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2178/4366] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:53 2021] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:53.829580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afa079-3fcd-4470-a3f7-d0ed673016c7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:53.844543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afa079-3fcd-4470-a3f7-d0ed673016c7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:53.949879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89d65-06de-4d94-aada-e5c23b9807fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:53.951032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89d65-06de-4d94-aada-e5c23b9807fa admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:53.951696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89d65-06de-4d94-aada-e5c23b9807fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:53.952198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89d65-06de-4d94-aada-e5c23b9807fa admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:53.953350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de89d65-06de-4d94-aada-e5c23b9807fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:53.956384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de89d65-06de-4d94-aada-e5c23b9807fa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:53.998693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e69d13-4864-448c-8a51-52909696ac74 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:54.005220 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2189/4367] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:53 2021] POST /identity/v3/users => generated 300 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:54.013588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e69d13-4864-448c-8a51-52909696ac74 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:54.025203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652fb79-c641-4f78-928b-8b25cc0a5d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:54.027383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652fb79-c641-4f78-928b-8b25cc0a5d8e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:54.028615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652fb79-c641-4f78-928b-8b25cc0a5d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:54.029104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652fb79-c641-4f78-928b-8b25cc0a5d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:54.030220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652fb79-c641-4f78-928b-8b25cc0a5d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:54.032883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652fb79-c641-4f78-928b-8b25cc0a5d8e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:54.049462 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2179/4368] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:53 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:54.056632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89d65-06de-4d94-aada-e5c23b9807fa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:54.078756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89d65-06de-4d94-aada-e5c23b9807fa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:54.086257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2a8bd-775b-43e0-9981-27197ef62b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:54.087382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a8bd-775b-43e0-9981-27197ef62b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:54.087738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a8bd-775b-43e0-9981-27197ef62b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:54.088133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a8bd-775b-43e0-9981-27197ef62b5a admin admin] PATH_INFO: `/v3/projects/2e2949bb5bac4bb6b65901d5675cf144/users/bd2e6f10d8d440609087ac497e767b14/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:54.109539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2a8bd-775b-43e0-9981-27197ef62b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2949bb5bac4bb6b65901d5675cf144, user_id=bd2e6f10d8d440609087ac497e767b14, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:54.112923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2a8bd-775b-43e0-9981-27197ef62b5a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:54.141008 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2190/4369] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:54 2021] PUT /identity/v3/projects/2e2949bb5bac4bb6b65901d5675cf144/users/bd2e6f10d8d440609087ac497e767b14/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:54.144227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652fb79-c641-4f78-928b-8b25cc0a5d8e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:54.157385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652fb79-c641-4f78-928b-8b25cc0a5d8e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:54.259198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9e551-a48e-4fb5-9af4-d31c2ad800b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:54.261827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9e551-a48e-4fb5-9af4-d31c2ad800b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:54.262324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9e551-a48e-4fb5-9af4-d31c2ad800b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:54.263614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9e551-a48e-4fb5-9af4-d31c2ad800b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:54.265586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9e551-a48e-4fb5-9af4-d31c2ad800b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:54.269900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9e551-a48e-4fb5-9af4-d31c2ad800b7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:54.295763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2a8bd-775b-43e0-9981-27197ef62b5a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:54.298296 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2180/4370] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:54 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:54.311940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2a8bd-775b-43e0-9981-27197ef62b5a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:54.320035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fc70a-c29a-493b-8a11-1535f17c99e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:54.321072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc70a-c29a-493b-8a11-1535f17c99e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:54.322166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc70a-c29a-493b-8a11-1535f17c99e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:54.322166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc70a-c29a-493b-8a11-1535f17c99e8 admin admin] PATH_INFO: `/v3/projects/2e2949bb5bac4bb6b65901d5675cf144/users/bd2e6f10d8d440609087ac497e767b14/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:54.325633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fc70a-c29a-493b-8a11-1535f17c99e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2949bb5bac4bb6b65901d5675cf144, user_id=bd2e6f10d8d440609087ac497e767b14, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:54.329107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fc70a-c29a-493b-8a11-1535f17c99e8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:54.347503 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2191/4371] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:54 2021] PUT /identity/v3/projects/2e2949bb5bac4bb6b65901d5675cf144/users/bd2e6f10d8d440609087ac497e767b14/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:54.356822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfe659-9792-4c8d-9461-a9053c0eafc6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:54.357445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfe659-9792-4c8d-9461-a9053c0eafc6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:54.358165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfe659-9792-4c8d-9461-a9053c0eafc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:54.406728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f6dfe659-9792-4c8d-9461-a9053c0eafc6 None None] MFA Rules not processed for user `bd2e6f10d8d440609087ac497e767b14`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:54.408882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f6dfe659-9792-4c8d-9461-a9053c0eafc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:54.518518 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2181/4372] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:54 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:57:54.524966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fc70a-c29a-493b-8a11-1535f17c99e8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:54.717799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fc70a-c29a-493b-8a11-1535f17c99e8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:54.734268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d2c51-47b2-40a9-959b-4b953d03a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:54.735214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d2c51-47b2-40a9-959b-4b953d03a59e admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:54.735595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d2c51-47b2-40a9-959b-4b953d03a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:54.735877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d2c51-47b2-40a9-959b-4b953d03a59e admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:54.736696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d2c51-47b2-40a9-959b-4b953d03a59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:54.738999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d2c51-47b2-40a9-959b-4b953d03a59e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:54.808257 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2192/4373] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:57:54 2021] POST /identity/v3/projects => generated 387 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:57:54.812813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfe659-9792-4c8d-9461-a9053c0eafc6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:54.831416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfe659-9792-4c8d-9461-a9053c0eafc6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:54.990855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5bcb2-72bf-4a08-89ba-b0e5c867d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:54.992559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5bcb2-72bf-4a08-89ba-b0e5c867d0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:54.993150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5bcb2-72bf-4a08-89ba-b0e5c867d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:54.993593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5bcb2-72bf-4a08-89ba-b0e5c867d0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:54.994894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5bcb2-72bf-4a08-89ba-b0e5c867d0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:54.999401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5bcb2-72bf-4a08-89ba-b0e5c867d0c8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:55.051403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d2c51-47b2-40a9-959b-4b953d03a59e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:55.051851 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2182/4374] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:57:54 2021] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:57:55.066332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d2c51-47b2-40a9-959b-4b953d03a59e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:55.081317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c048b45-3d7e-4875-ab07-b3e6757546a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:55.082156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048b45-3d7e-4875-ab07-b3e6757546a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:55.082476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048b45-3d7e-4875-ab07-b3e6757546a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:55.082885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048b45-3d7e-4875-ab07-b3e6757546a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:55.083762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c048b45-3d7e-4875-ab07-b3e6757546a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:55.092698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c048b45-3d7e-4875-ab07-b3e6757546a4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:55.107226 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2193/4375] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:55 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:57:55.112037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5bcb2-72bf-4a08-89ba-b0e5c867d0c8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:55.130501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5bcb2-72bf-4a08-89ba-b0e5c867d0c8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:55.140168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b56a3-d120-4f51-91d6-58bb817f194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:55.140863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b56a3-d120-4f51-91d6-58bb817f194e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:55.141292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b56a3-d120-4f51-91d6-58bb817f194e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:55.141580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b56a3-d120-4f51-91d6-58bb817f194e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:55.143127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b56a3-d120-4f51-91d6-58bb817f194e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:55.145091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b56a3-d120-4f51-91d6-58bb817f194e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:55.164455 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2183/4376] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:57:55 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:57:55.170414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c048b45-3d7e-4875-ab07-b3e6757546a4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:55.195863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c048b45-3d7e-4875-ab07-b3e6757546a4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:55.208062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af03c7-95aa-4885-906e-2b88ba3dfddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:55.209165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af03c7-95aa-4885-906e-2b88ba3dfddc admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:55.209554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af03c7-95aa-4885-906e-2b88ba3dfddc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:55.210699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af03c7-95aa-4885-906e-2b88ba3dfddc admin admin] PATH_INFO: `/v3/projects/0003f64c8e37488eb599eb35f26db062/users/ffba1b51e0164639b39b5af3f53b5e8c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:55.245393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af03c7-95aa-4885-906e-2b88ba3dfddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0003f64c8e37488eb599eb35f26db062, user_id=ffba1b51e0164639b39b5af3f53b5e8c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:55.260518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af03c7-95aa-4885-906e-2b88ba3dfddc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:55.300980 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2194/4377] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:57:55 2021] PUT /identity/v3/projects/0003f64c8e37488eb599eb35f26db062/users/ffba1b51e0164639b39b5af3f53b5e8c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:55.308129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4435f36-c1d0-4678-9364-9ddc18e6c078 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:55.308664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4435f36-c1d0-4678-9364-9ddc18e6c078 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:55.308664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4435f36-c1d0-4678-9364-9ddc18e6c078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:55.367119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f4435f36-c1d0-4678-9364-9ddc18e6c078 None None] MFA Rules not processed for user `ffba1b51e0164639b39b5af3f53b5e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:55.369321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f4435f36-c1d0-4678-9364-9ddc18e6c078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:55.473786 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2184/4378] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:55 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:57:55.489197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af03c7-95aa-4885-906e-2b88ba3dfddc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:55.492644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-89af03c7-95aa-4885-906e-2b88ba3dfddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:55.638849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af03c7-95aa-4885-906e-2b88ba3dfddc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:55.644488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f6334-1264-41f5-8b95-fa167536d83a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:55.645678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f6334-1264-41f5-8b95-fa167536d83a service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:55.646222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f6334-1264-41f5-8b95-fa167536d83a service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:55.646708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f6334-1264-41f5-8b95-fa167536d83a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:55.797921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f6334-1264-41f5-8b95-fa167536d83a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:55.801321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f6334-1264-41f5-8b95-fa167536d83a service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:55.827861 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2195/4379] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:55 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:56.735277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4435f36-c1d0-4678-9364-9ddc18e6c078 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:56.854089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4435f36-c1d0-4678-9364-9ddc18e6c078 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:56.861479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:56.863122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:56.863928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:56.864819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] PATH_INFO: `/v3/users/bd2e6f10d8d440609087ac497e767b14` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:56.867021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2e6f10d8d440609087ac497e767b14)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:56.874151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:56.945562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2e6f10d8d440609087ac497e767b14'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:56.946880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2e6f10d8d440609087ac497e767b14'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:56.959529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2e6f10d8d440609087ac497e767b14'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:56.961844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2e6f10d8d440609087ac497e767b14'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:56.972505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2e6f10d8d440609087ac497e767b14'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:57.002949 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2185/4380] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:56 2021] DELETE /identity/v3/users/bd2e6f10d8d440609087ac497e767b14 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:57.004141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb30ed-91d0-4c4b-a740-9ddf3f7adbff None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:57.004996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb30ed-91d0-4c4b-a740-9ddf3f7adbff None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:57.004996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb30ed-91d0-4c4b-a740-9ddf3f7adbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:57.033252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-20cb30ed-91d0-4c4b-a740-9ddf3f7adbff None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:57:57.035417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-20cb30ed-91d0-4c4b-a740-9ddf3f7adbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:57.191468 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2196/4381] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:57:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:57:57.241468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:57.248594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:57.374540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d461462-ac55-4842-a5c7-4d3f6ed9517e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:57.383728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b8194-e87a-41bc-91d0-e32f5f32dae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:57.384532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b8194-e87a-41bc-91d0-e32f5f32dae3 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:57.385733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b8194-e87a-41bc-91d0-e32f5f32dae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:57.386042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b8194-e87a-41bc-91d0-e32f5f32dae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:57.405173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b8194-e87a-41bc-91d0-e32f5f32dae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:57.410090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b8194-e87a-41bc-91d0-e32f5f32dae3 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:57.442408 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2186/4382] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:57:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:57:59.167304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb30ed-91d0-4c4b-a740-9ddf3f7adbff None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:59.169693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-20cb30ed-91d0-4c4b-a740-9ddf3f7adbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:57:59.189237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb30ed-91d0-4c4b-a740-9ddf3f7adbff None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:59.200316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:59.202035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:59.202330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:59.204711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] PATH_INFO: `/v3/projects/2e2949bb5bac4bb6b65901d5675cf144` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:59.207732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2949bb5bac4bb6b65901d5675cf144)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:59.213173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:59.346772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2949bb5bac4bb6b65901d5675cf144', 'request_id': 'req-4021beae-a195-4c79-8623-30653fbf1dd4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:59.356882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2949bb5bac4bb6b65901d5675cf144', 'request_id': 'req-4021beae-a195-4c79-8623-30653fbf1dd4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:59.365896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2949bb5bac4bb6b65901d5675cf144', 'request_id': 'req-4021beae-a195-4c79-8623-30653fbf1dd4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:59.380534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] The token cache is being invalidate because project 2e2949bb5bac4bb6b65901d5675cf144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:57:59.380917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:59.383131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:59.387608 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2197/4383] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:57:59 2021] DELETE /identity/v3/projects/2e2949bb5bac4bb6b65901d5675cf144 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:57:59.389551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b8194-e87a-41bc-91d0-e32f5f32dae3 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:57:59.416443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b8194-e87a-41bc-91d0-e32f5f32dae3 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:57:59.578618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:57:59.579807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:57:59.580155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:57:59.580501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] PATH_INFO: `/v3/users/ffba1b51e0164639b39b5af3f53b5e8c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:57:59.582767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffba1b51e0164639b39b5af3f53b5e8c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:57:59.586784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:57:59.687502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffba1b51e0164639b39b5af3f53b5e8c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:59.688184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffba1b51e0164639b39b5af3f53b5e8c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:59.704622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffba1b51e0164639b39b5af3f53b5e8c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:59.705640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffba1b51e0164639b39b5af3f53b5e8c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:59.719767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffba1b51e0164639b39b5af3f53b5e8c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:57:59.748260 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2187/4384] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:57:59 2021] DELETE /identity/v3/users/ffba1b51e0164639b39b5af3f53b5e8c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:01.039943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:01.043811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:01.216310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021beae-a195-4c79-8623-30653fbf1dd4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:01.282153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:01.284241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:01.360135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658cca3-3cef-40b1-915e-8a08a1515bc8 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab5c407b9784f66bae131d530fd6f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af1ec0ee913a4ec28efc54b8d380a0ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:01.361346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658cca3-3cef-40b1-915e-8a08a1515bc8 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:01.361648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658cca3-3cef-40b1-915e-8a08a1515bc8 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:01.361929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658cca3-3cef-40b1-915e-8a08a1515bc8 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:01.363289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658cca3-3cef-40b1-915e-8a08a1515bc8 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:01.363615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658cca3-3cef-40b1-915e-8a08a1515bc8 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:01.365235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658cca3-3cef-40b1-915e-8a08a1515bc8 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:01.401401 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2198/4385] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:01.406871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658cca3-3cef-40b1-915e-8a08a1515bc8 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:01.408701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a658cca3-3cef-40b1-915e-8a08a1515bc8 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:01.426624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658cca3-3cef-40b1-915e-8a08a1515bc8 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:01.435396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfebb0-689e-43ad-8f4d-c1182633e51f tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab5c407b9784f66bae131d530fd6f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af1ec0ee913a4ec28efc54b8d380a0ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:01.437549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfebb0-689e-43ad-8f4d-c1182633e51f tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:01.437549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfebb0-689e-43ad-8f4d-c1182633e51f tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:01.437745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfebb0-689e-43ad-8f4d-c1182633e51f tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:01.438505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfebb0-689e-43ad-8f4d-c1182633e51f tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:01.442234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfebb0-689e-43ad-8f4d-c1182633e51f tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:01.489295 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2199/4386] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:01 2021] POST /identity/v3/projects => generated 348 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:01.492463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfebb0-689e-43ad-8f4d-c1182633e51f tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:01.493977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d57ec-a105-4898-9c66-62f11e6f3801 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:01.598471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:01.600227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:01.601232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:01.601506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] PATH_INFO: `/v3/projects/0003f64c8e37488eb599eb35f26db062` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:01.605111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0003f64c8e37488eb599eb35f26db062)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:01.610105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:01.614465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfebb0-689e-43ad-8f4d-c1182633e51f tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:01.625131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7193c2-1a56-42f2-b936-ca578eaaee89 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab5c407b9784f66bae131d530fd6f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af1ec0ee913a4ec28efc54b8d380a0ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:01.626386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7193c2-1a56-42f2-b936-ca578eaaee89 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:01.626895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7193c2-1a56-42f2-b936-ca578eaaee89 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:01.628217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7193c2-1a56-42f2-b936-ca578eaaee89 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:01.630426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7193c2-1a56-42f2-b936-ca578eaaee89 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:01.631389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7193c2-1a56-42f2-b936-ca578eaaee89 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:01.634337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7193c2-1a56-42f2-b936-ca578eaaee89 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:01.652622 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2200/4387] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:01.711296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0003f64c8e37488eb599eb35f26db062', 'request_id': 'req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:01.723692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0003f64c8e37488eb599eb35f26db062', 'request_id': 'req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:01.741060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0003f64c8e37488eb599eb35f26db062', 'request_id': 'req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:01.759615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] The token cache is being invalidate because project 0003f64c8e37488eb599eb35f26db062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:01.760023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:01.761378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a7c8a42a-2cd7-45f3-bfd2-b1a0155c29e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:01.765471 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2188/4388] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:01 2021] DELETE /identity/v3/projects/0003f64c8e37488eb599eb35f26db062 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:01.776981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8e4f-e6ac-40cc-a224-18bc0d3c2fda None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:01.778527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8e4f-e6ac-40cc-a224-18bc0d3c2fda None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:01.779094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8e4f-e6ac-40cc-a224-18bc0d3c2fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:01.820643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cc4e8e4f-e6ac-40cc-a224-18bc0d3c2fda None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:01.821890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cc4e8e4f-e6ac-40cc-a224-18bc0d3c2fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:01.924321 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2201/4389] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:01.935450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d35e-4eab-4e27-89e5-5f6508c0952f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:01.936620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d35e-4eab-4e27-89e5-5f6508c0952f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:01.937759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5d35e-4eab-4e27-89e5-5f6508c0952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:01.984018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-31d5d35e-4eab-4e27-89e5-5f6508c0952f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:01.985602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-31d5d35e-4eab-4e27-89e5-5f6508c0952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:01.996584 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2189/4390] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:02.001285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e8e4f-e6ac-40cc-a224-18bc0d3c2fda None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:02.016145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e8e4f-e6ac-40cc-a224-18bc0d3c2fda None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:02.024282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba21075-e431-452a-9a25-9c2d16346df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:02.025082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21075-e431-452a-9a25-9c2d16346df3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:02.025425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21075-e431-452a-9a25-9c2d16346df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:02.025721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba21075-e431-452a-9a25-9c2d16346df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:02.026740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba21075-e431-452a-9a25-9c2d16346df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:02.027685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba21075-e431-452a-9a25-9c2d16346df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:02.030978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba21075-e431-452a-9a25-9c2d16346df3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:02.053539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5d35e-4eab-4e27-89e5-5f6508c0952f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:02.064321 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2202/4391] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:02.067736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5d35e-4eab-4e27-89e5-5f6508c0952f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:02.081003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101b897-dbab-4fbd-a7a7-7ffe3919b597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:02.081958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101b897-dbab-4fbd-a7a7-7ffe3919b597 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:02.083982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101b897-dbab-4fbd-a7a7-7ffe3919b597 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:02.085683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101b897-dbab-4fbd-a7a7-7ffe3919b597 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:02.089223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101b897-dbab-4fbd-a7a7-7ffe3919b597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:02.097006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101b897-dbab-4fbd-a7a7-7ffe3919b597 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:02.175395 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2190/4392] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:02 2021] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:02.176663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba21075-e431-452a-9a25-9c2d16346df3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:02.196406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba21075-e431-452a-9a25-9c2d16346df3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:02.306867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dc45f-6b89-423b-847f-e1daf996b7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:02.307665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc45f-6b89-423b-847f-e1daf996b7dc admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:02.308269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc45f-6b89-423b-847f-e1daf996b7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:02.308711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dc45f-6b89-423b-847f-e1daf996b7dc admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:02.309855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dc45f-6b89-423b-847f-e1daf996b7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:02.312420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dc45f-6b89-423b-847f-e1daf996b7dc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:02.344523 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2203/4393] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:02 2021] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:02.348912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101b897-dbab-4fbd-a7a7-7ffe3919b597 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:02.365339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101b897-dbab-4fbd-a7a7-7ffe3919b597 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:02.372662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d6288-4a4e-47aa-831b-61ea959c3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:02.373998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d6288-4a4e-47aa-831b-61ea959c3b82 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:02.374701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d6288-4a4e-47aa-831b-61ea959c3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:02.374701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d6288-4a4e-47aa-831b-61ea959c3b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:02.375319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d6288-4a4e-47aa-831b-61ea959c3b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:02.377188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d6288-4a4e-47aa-831b-61ea959c3b82 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:02.394228 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2191/4394] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:02 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:02.395871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dc45f-6b89-423b-847f-e1daf996b7dc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:02.407368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dc45f-6b89-423b-847f-e1daf996b7dc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:02.413794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71fe3a-3ed6-40c9-a14c-74448387ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:02.414868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71fe3a-3ed6-40c9-a14c-74448387ffd9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:02.415324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71fe3a-3ed6-40c9-a14c-74448387ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:02.415709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71fe3a-3ed6-40c9-a14c-74448387ffd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:02.416640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71fe3a-3ed6-40c9-a14c-74448387ffd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:02.418807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71fe3a-3ed6-40c9-a14c-74448387ffd9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:02.433929 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2204/4395] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:02 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:02.438372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d6288-4a4e-47aa-831b-61ea959c3b82 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:02.461263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d6288-4a4e-47aa-831b-61ea959c3b82 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:02.467065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b1dd2-88aa-4bfc-8d74-b698f5d62e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:02.468065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1dd2-88aa-4bfc-8d74-b698f5d62e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:02.468518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1dd2-88aa-4bfc-8d74-b698f5d62e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:02.468958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1dd2-88aa-4bfc-8d74-b698f5d62e52 admin admin] PATH_INFO: `/v3/projects/e3bccb72ca48413d856528288a44fdab/users/44544a77ac9249598beda46a0b9acd53/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:02.489573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b1dd2-88aa-4bfc-8d74-b698f5d62e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bccb72ca48413d856528288a44fdab, user_id=44544a77ac9249598beda46a0b9acd53, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:02.493798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b1dd2-88aa-4bfc-8d74-b698f5d62e52 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:02.514503 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2192/4396] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:02 2021] PUT /identity/v3/projects/e3bccb72ca48413d856528288a44fdab/users/44544a77ac9249598beda46a0b9acd53/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:02.525231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bf13e-1ed5-4e7a-b0a7-f12bb71a3f79 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:02.525543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bf13e-1ed5-4e7a-b0a7-f12bb71a3f79 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:02.525922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bf13e-1ed5-4e7a-b0a7-f12bb71a3f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:02.561203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cd3bf13e-1ed5-4e7a-b0a7-f12bb71a3f79 None None] MFA Rules not processed for user `44544a77ac9249598beda46a0b9acd53`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:02.563205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cd3bf13e-1ed5-4e7a-b0a7-f12bb71a3f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:02.673057 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2205/4397] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:02 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:02.674490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b1dd2-88aa-4bfc-8d74-b698f5d62e52 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:02.787328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b1dd2-88aa-4bfc-8d74-b698f5d62e52 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:02.796331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08491803-44e4-4b13-8d23-87073f3d110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:02.797287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08491803-44e4-4b13-8d23-87073f3d110f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:02.797587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08491803-44e4-4b13-8d23-87073f3d110f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:02.797862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08491803-44e4-4b13-8d23-87073f3d110f admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:02.798760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08491803-44e4-4b13-8d23-87073f3d110f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:02.800782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08491803-44e4-4b13-8d23-87073f3d110f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:02.830801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bf13e-1ed5-4e7a-b0a7-f12bb71a3f79 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:02.833974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cd3bf13e-1ed5-4e7a-b0a7-f12bb71a3f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:02.860157 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2193/4398] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:02 2021] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:02.861698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08491803-44e4-4b13-8d23-87073f3d110f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:02.951123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08491803-44e4-4b13-8d23-87073f3d110f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:02.961483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70f2e0-7d3f-4c1f-b251-9ebdaaf8ef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:02.962777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f2e0-7d3f-4c1f-b251-9ebdaaf8ef17 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:02.962902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f2e0-7d3f-4c1f-b251-9ebdaaf8ef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:02.963349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70f2e0-7d3f-4c1f-b251-9ebdaaf8ef17 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:02.964284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70f2e0-7d3f-4c1f-b251-9ebdaaf8ef17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:02.966495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70f2e0-7d3f-4c1f-b251-9ebdaaf8ef17 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:03.000426 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2194/4399] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:02 2021] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:03.001563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70f2e0-7d3f-4c1f-b251-9ebdaaf8ef17 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:03.007982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bf13e-1ed5-4e7a-b0a7-f12bb71a3f79 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:03.015301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70f2e0-7d3f-4c1f-b251-9ebdaaf8ef17 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:03.024388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b517c6-e5d5-4302-a859-4df7f0283828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:03.025079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b517c6-e5d5-4302-a859-4df7f0283828 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:03.026349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b517c6-e5d5-4302-a859-4df7f0283828 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:03.026842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b517c6-e5d5-4302-a859-4df7f0283828 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:03.027833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b517c6-e5d5-4302-a859-4df7f0283828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:03.029551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b517c6-e5d5-4302-a859-4df7f0283828 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:03.053192 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2195/4400] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:03 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:03.057867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b517c6-e5d5-4302-a859-4df7f0283828 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:03.088809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b517c6-e5d5-4302-a859-4df7f0283828 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:03.104013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f70766-0601-4f18-9212-ccc8a9627810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:03.104740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f70766-0601-4f18-9212-ccc8a9627810 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:03.105380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f70766-0601-4f18-9212-ccc8a9627810 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:03.107341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f70766-0601-4f18-9212-ccc8a9627810 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:03.109134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f70766-0601-4f18-9212-ccc8a9627810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:03.112849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f70766-0601-4f18-9212-ccc8a9627810 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:03.134415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aab5c407b9784f66bae131d530fd6f80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af1ec0ee913a4ec28efc54b8d380a0ea', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:03.135436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:03.135902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:03.137663 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2196/4401] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:03 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:58:03.137979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] PATH_INFO: `/v3/projects/769a21ae0dfd498789fff037be718b06` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:03.139812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: Authorizing `identity:delete_project(project_id=769a21ae0dfd498789fff037be718b06)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:03.142513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f70766-0601-4f18-9212-ccc8a9627810 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:03.142968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:03.163524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f70766-0601-4f18-9212-ccc8a9627810 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:03.170694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f58a1-b062-426b-af5b-98d60493120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:03.173005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f58a1-b062-426b-af5b-98d60493120e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:03.173149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f58a1-b062-426b-af5b-98d60493120e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:03.173414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f58a1-b062-426b-af5b-98d60493120e admin admin] PATH_INFO: `/v3/projects/23a09b31232e4c51a2459b0a9e01e784/users/e750adb2b3fb45099af3dfe61c042283/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:03.217596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769a21ae0dfd498789fff037be718b06', 'request_id': 'req-fcc19fc1-24b9-432b-8d1a-966572d55804'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:03.230723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f58a1-b062-426b-af5b-98d60493120e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a09b31232e4c51a2459b0a9e01e784, user_id=e750adb2b3fb45099af3dfe61c042283, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:03.241993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f58a1-b062-426b-af5b-98d60493120e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:03.248500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769a21ae0dfd498789fff037be718b06', 'request_id': 'req-fcc19fc1-24b9-432b-8d1a-966572d55804'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:03.261977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769a21ae0dfd498789fff037be718b06', 'request_id': 'req-fcc19fc1-24b9-432b-8d1a-966572d55804'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:03.281188 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2197/4402] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:03 2021] PUT /identity/v3/projects/23a09b31232e4c51a2459b0a9e01e784/users/e750adb2b3fb45099af3dfe61c042283/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:03.295031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242393-4278-42f0-b05f-9551bbedd046 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:03.295411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242393-4278-42f0-b05f-9551bbedd046 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:03.296374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] The token cache is being invalidate because project 769a21ae0dfd498789fff037be718b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:03.296762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242393-4278-42f0-b05f-9551bbedd046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:03.297013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:03.298209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:03.301869 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2206/4403] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:02 2021] DELETE /identity/v3/projects/769a21ae0dfd498789fff037be718b06 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:03.317846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:03.319705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:03.347899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f6242393-4278-42f0-b05f-9551bbedd046 None None] MFA Rules not processed for user `e750adb2b3fb45099af3dfe61c042283`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:03.349129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f6242393-4278-42f0-b05f-9551bbedd046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:03.473545 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2198/4404] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:03 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:03.480284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc19fc1-24b9-432b-8d1a-966572d55804 tempest-RoutersIpV6AdminTest-1868407038 tempest-RoutersIpV6AdminTest-1868407038-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:03.495041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6242393-4278-42f0-b05f-9551bbedd046 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:03.497382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f6242393-4278-42f0-b05f-9551bbedd046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:03.613865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3d6da-faa3-48c0-b591-beb63f633fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:03.615466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3d6da-faa3-48c0-b591-beb63f633fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:03.616193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3d6da-faa3-48c0-b591-beb63f633fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:03.616676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3d6da-faa3-48c0-b591-beb63f633fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:03.619791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e3c3d6da-faa3-48c0-b591-beb63f633fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:03.639843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6242393-4278-42f0-b05f-9551bbedd046 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:03.651225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3509b2-3fc5-403a-b173-1e665657fa41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:03.651926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3509b2-3fc5-403a-b173-1e665657fa41 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:03.652212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3509b2-3fc5-403a-b173-1e665657fa41 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:03.652640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3509b2-3fc5-403a-b173-1e665657fa41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:03.656907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7f3509b2-3fc5-403a-b173-1e665657fa41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:03.741609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3d6da-faa3-48c0-b591-beb63f633fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:03.745144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3d6da-faa3-48c0-b591-beb63f633fd6 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:03.769069 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2207/4405] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:03 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:03.784948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3509b2-3fc5-403a-b173-1e665657fa41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:03.787434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3509b2-3fc5-403a-b173-1e665657fa41 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:03.826413 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2199/4406] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:03 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:58:03.967122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcb4fa-616e-48dc-a1fd-3fb51ea25e1e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:03.968522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcb4fa-616e-48dc-a1fd-3fb51ea25e1e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:03.968753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcb4fa-616e-48dc-a1fd-3fb51ea25e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:04.044980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b1dcb4fa-616e-48dc-a1fd-3fb51ea25e1e None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:04.048176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b1dcb4fa-616e-48dc-a1fd-3fb51ea25e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:04.170631 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2208/4407] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:58:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:04.275304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3509b2-3fc5-403a-b173-1e665657fa41 service glance] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:04.278247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7f3509b2-3fc5-403a-b173-1e665657fa41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:04.548086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3509b2-3fc5-403a-b173-1e665657fa41 service glance] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:04.561164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9bab4-7de2-449b-822b-4b3ce5d455f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:04.561838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9bab4-7de2-449b-822b-4b3ce5d455f9 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:04.562124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9bab4-7de2-449b-822b-4b3ce5d455f9 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:04.562491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9bab4-7de2-449b-822b-4b3ce5d455f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:04.582441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9bab4-7de2-449b-822b-4b3ce5d455f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:04.585613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9bab4-7de2-449b-822b-4b3ce5d455f9 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:04.606189 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2200/4408] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:58:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:58:04.947113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcb4fa-616e-48dc-a1fd-3fb51ea25e1e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:04.948877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b1dcb4fa-616e-48dc-a1fd-3fb51ea25e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:04.972154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcb4fa-616e-48dc-a1fd-3fb51ea25e1e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:04.976277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe78dbb-d8b9-4663-b332-967b5a99f399 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:04.976970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe78dbb-d8b9-4663-b332-967b5a99f399 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:04.977259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe78dbb-d8b9-4663-b332-967b5a99f399 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:04.977546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe78dbb-d8b9-4663-b332-967b5a99f399 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:04.987399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe78dbb-d8b9-4663-b332-967b5a99f399 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:04.988848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe78dbb-d8b9-4663-b332-967b5a99f399 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:05.000292 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2209/4409] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:04 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:05.143203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec888-5810-4111-a881-e674c308a2db None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:05.143795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec888-5810-4111-a881-e674c308a2db None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:05.144352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec888-5810-4111-a881-e674c308a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:05.175513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8abec888-5810-4111-a881-e674c308a2db None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:05.176760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8abec888-5810-4111-a881-e674c308a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:05.196239 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2201/4410] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:58:05 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:05.216672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe78dbb-d8b9-4663-b332-967b5a99f399 service glance] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:05.236567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe78dbb-d8b9-4663-b332-967b5a99f399 service glance] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:05.251081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558ffc6-d614-4e30-9ba8-83f30b34d61e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:05.252976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ffc6-d614-4e30-9ba8-83f30b34d61e service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:05.253265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ffc6-d614-4e30-9ba8-83f30b34d61e service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:05.253542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558ffc6-d614-4e30-9ba8-83f30b34d61e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:05.281999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558ffc6-d614-4e30-9ba8-83f30b34d61e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:05.283952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558ffc6-d614-4e30-9ba8-83f30b34d61e service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:05.305396 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2210/4411] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:58:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:58:05.498375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abec888-5810-4111-a881-e674c308a2db None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:05.501856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8abec888-5810-4111-a881-e674c308a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:05.597696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abec888-5810-4111-a881-e674c308a2db None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:05.604910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:05.606561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:05.606831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:05.607181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] PATH_INFO: `/v3/users/44544a77ac9249598beda46a0b9acd53` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:05.608812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44544a77ac9249598beda46a0b9acd53)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:05.611542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:05.693373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44544a77ac9249598beda46a0b9acd53'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:05.695571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44544a77ac9249598beda46a0b9acd53'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:05.709832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44544a77ac9249598beda46a0b9acd53'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:05.713126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44544a77ac9249598beda46a0b9acd53'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:05.723787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44544a77ac9249598beda46a0b9acd53'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:05.751419 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2202/4412] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:05 2021] DELETE /identity/v3/users/44544a77ac9249598beda46a0b9acd53 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:05.754583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6164d2a-ed9c-4565-a5c6-8d82f75661cb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:05.755152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6164d2a-ed9c-4565-a5c6-8d82f75661cb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:05.755486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6164d2a-ed9c-4565-a5c6-8d82f75661cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:05.781745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c6164d2a-ed9c-4565-a5c6-8d82f75661cb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:05.783476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c6164d2a-ed9c-4565-a5c6-8d82f75661cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:05.880932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2211/4413] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:05.891794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:05.893160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:05.972659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fe0f6-9c20-48e2-a84b-7737b6517692 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:05.977525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0a667-c9f8-487d-813b-4f00d3f7930c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:05.978179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0a667-c9f8-487d-813b-4f00d3f7930c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:05.978462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0a667-c9f8-487d-813b-4f00d3f7930c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:05.978827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0a667-c9f8-487d-813b-4f00d3f7930c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:05.999640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0a667-c9f8-487d-813b-4f00d3f7930c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:06.002011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0a667-c9f8-487d-813b-4f00d3f7930c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:06.019883 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2203/4414] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:06.584554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6164d2a-ed9c-4565-a5c6-8d82f75661cb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:06.586446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c6164d2a-ed9c-4565-a5c6-8d82f75661cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:06.602148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6164d2a-ed9c-4565-a5c6-8d82f75661cb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:06.609596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:06.610475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:06.611013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:06.611586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] PATH_INFO: `/v3/projects/e3bccb72ca48413d856528288a44fdab` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:06.613128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3bccb72ca48413d856528288a44fdab)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:06.616983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:06.684682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3bccb72ca48413d856528288a44fdab', 'request_id': 'req-54d67c6d-f1c7-416f-b080-d995cb7f791e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:06.715140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3bccb72ca48413d856528288a44fdab', 'request_id': 'req-54d67c6d-f1c7-416f-b080-d995cb7f791e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:06.736114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3bccb72ca48413d856528288a44fdab', 'request_id': 'req-54d67c6d-f1c7-416f-b080-d995cb7f791e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:06.752253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] The token cache is being invalidate because project e3bccb72ca48413d856528288a44fdab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:06.752786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:06.753556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:06.756606 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2212/4415] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:06 2021] DELETE /identity/v3/projects/e3bccb72ca48413d856528288a44fdab => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:06.760591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0a667-c9f8-487d-813b-4f00d3f7930c service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:06.776002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0a667-c9f8-487d-813b-4f00d3f7930c service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:06.868434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7dc45-6e8c-4f20-8757-5e76a36f5e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:06.871003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7dc45-6e8c-4f20-8757-5e76a36f5e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:06.871548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7dc45-6e8c-4f20-8757-5e76a36f5e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:06.872421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7dc45-6e8c-4f20-8757-5e76a36f5e2d admin admin] PATH_INFO: `/v3/users/e750adb2b3fb45099af3dfe61c042283` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:06.874321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7dc45-6e8c-4f20-8757-5e76a36f5e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e750adb2b3fb45099af3dfe61c042283)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:06.877318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7dc45-6e8c-4f20-8757-5e76a36f5e2d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:06.959150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9d7dc45-6e8c-4f20-8757-5e76a36f5e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e750adb2b3fb45099af3dfe61c042283'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:06.963599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9d7dc45-6e8c-4f20-8757-5e76a36f5e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e750adb2b3fb45099af3dfe61c042283'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:06.973105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9d7dc45-6e8c-4f20-8757-5e76a36f5e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e750adb2b3fb45099af3dfe61c042283'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:06.973899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9d7dc45-6e8c-4f20-8757-5e76a36f5e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e750adb2b3fb45099af3dfe61c042283'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:06.989374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9d7dc45-6e8c-4f20-8757-5e76a36f5e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e750adb2b3fb45099af3dfe61c042283'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:07.022920 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2204/4416] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:06 2021] DELETE /identity/v3/users/e750adb2b3fb45099af3dfe61c042283 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:07.758538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:07.760987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:07.797022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d67c6d-f1c7-416f-b080-d995cb7f791e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:07.888428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:07.889447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:07.890186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:07.890537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] PATH_INFO: `/v3/projects/23a09b31232e4c51a2459b0a9e01e784` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:07.893981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a09b31232e4c51a2459b0a9e01e784)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:07.896579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:07.984314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a09b31232e4c51a2459b0a9e01e784', 'request_id': 'req-8b74b3ca-be46-4136-bd81-135130c896e8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:07.997794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a09b31232e4c51a2459b0a9e01e784', 'request_id': 'req-8b74b3ca-be46-4136-bd81-135130c896e8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:08.039670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a09b31232e4c51a2459b0a9e01e784', 'request_id': 'req-8b74b3ca-be46-4136-bd81-135130c896e8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:08.060135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] The token cache is being invalidate because project 23a09b31232e4c51a2459b0a9e01e784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:08.060387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:08.061712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b74b3ca-be46-4136-bd81-135130c896e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:08.070584 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2213/4417] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:07 2021] DELETE /identity/v3/projects/23a09b31232e4c51a2459b0a9e01e784 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:08.070795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4c164-2e09-4845-8c2c-1b50d1b1ed5b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:08.071348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4c164-2e09-4845-8c2c-1b50d1b1ed5b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:08.071348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4c164-2e09-4845-8c2c-1b50d1b1ed5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:08.100892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-43e4c164-2e09-4845-8c2c-1b50d1b1ed5b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:08.104081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-43e4c164-2e09-4845-8c2c-1b50d1b1ed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:08.223402 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2205/4418] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:08.233015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43830-0c62-4e0c-a43c-cb9c886af77a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:08.233514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43830-0c62-4e0c-a43c-cb9c886af77a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:08.234169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43830-0c62-4e0c-a43c-cb9c886af77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:08.258918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d3d43830-0c62-4e0c-a43c-cb9c886af77a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:08.260587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d3d43830-0c62-4e0c-a43c-cb9c886af77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:08.275297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2214/4419] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:08.276581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4c164-2e09-4845-8c2c-1b50d1b1ed5b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:08.290904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4c164-2e09-4845-8c2c-1b50d1b1ed5b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:08.299802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a94ccd-3546-4f53-9829-debc42066524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:08.301967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a94ccd-3546-4f53-9829-debc42066524 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:08.302555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a94ccd-3546-4f53-9829-debc42066524 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:08.303158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a94ccd-3546-4f53-9829-debc42066524 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:08.304244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a94ccd-3546-4f53-9829-debc42066524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:08.304670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a94ccd-3546-4f53-9829-debc42066524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:08.307012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a94ccd-3546-4f53-9829-debc42066524 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:08.324372 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2206/4420] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:08.328851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43830-0c62-4e0c-a43c-cb9c886af77a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:08.340377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43830-0c62-4e0c-a43c-cb9c886af77a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:08.347871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a5407-5e69-48a5-b31c-91a40c7ee169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:08.348915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a5407-5e69-48a5-b31c-91a40c7ee169 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:08.351918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a5407-5e69-48a5-b31c-91a40c7ee169 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:08.352436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a5407-5e69-48a5-b31c-91a40c7ee169 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:08.353282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a5407-5e69-48a5-b31c-91a40c7ee169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:08.355617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a5407-5e69-48a5-b31c-91a40c7ee169 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:08.406252 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2215/4421] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:08 2021] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:08.410398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a94ccd-3546-4f53-9829-debc42066524 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:08.428193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a94ccd-3546-4f53-9829-debc42066524 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:08.531607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05ff95-5d33-42aa-b48d-eba425b82c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:08.532693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05ff95-5d33-42aa-b48d-eba425b82c27 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:08.535432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05ff95-5d33-42aa-b48d-eba425b82c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:08.535764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05ff95-5d33-42aa-b48d-eba425b82c27 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:08.536994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05ff95-5d33-42aa-b48d-eba425b82c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:08.541353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05ff95-5d33-42aa-b48d-eba425b82c27 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:08.576544 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2207/4422] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:08 2021] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:08.582015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a5407-5e69-48a5-b31c-91a40c7ee169 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:08.597976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a5407-5e69-48a5-b31c-91a40c7ee169 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:08.609216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada1f42-0371-4372-be6f-01f2367b09fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:08.609999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada1f42-0371-4372-be6f-01f2367b09fb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:08.610602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada1f42-0371-4372-be6f-01f2367b09fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:08.610722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada1f42-0371-4372-be6f-01f2367b09fb admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:08.611619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada1f42-0371-4372-be6f-01f2367b09fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:08.613784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada1f42-0371-4372-be6f-01f2367b09fb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:08.635316 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2216/4423] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:08 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:08.638817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05ff95-5d33-42aa-b48d-eba425b82c27 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:08.667145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05ff95-5d33-42aa-b48d-eba425b82c27 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:08.675039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5569e-6763-4bce-ad5c-382c2e65815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:08.675783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5569e-6763-4bce-ad5c-382c2e65815a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:08.676190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5569e-6763-4bce-ad5c-382c2e65815a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:08.676473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5569e-6763-4bce-ad5c-382c2e65815a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:08.677460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5569e-6763-4bce-ad5c-382c2e65815a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:08.679884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5569e-6763-4bce-ad5c-382c2e65815a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:08.696449 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2208/4424] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:08 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:08.701058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada1f42-0371-4372-be6f-01f2367b09fb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:08.716194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada1f42-0371-4372-be6f-01f2367b09fb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:08.722809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4fe48-b4fe-401f-a128-a9cae4636a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:08.724754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4fe48-b4fe-401f-a128-a9cae4636a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:08.725699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4fe48-b4fe-401f-a128-a9cae4636a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:08.726094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4fe48-b4fe-401f-a128-a9cae4636a03 admin admin] PATH_INFO: `/v3/projects/21e23e4cb46e409cb0f244a7c3880d62/users/6eb744082ec149bda1dec06b0f300399/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:08.750020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4fe48-b4fe-401f-a128-a9cae4636a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e23e4cb46e409cb0f244a7c3880d62, user_id=6eb744082ec149bda1dec06b0f300399, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:08.755104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4fe48-b4fe-401f-a128-a9cae4636a03 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:08.786476 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2217/4425] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:08 2021] PUT /identity/v3/projects/21e23e4cb46e409cb0f244a7c3880d62/users/6eb744082ec149bda1dec06b0f300399/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:08.798852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8cf95-d613-44c9-a7d2-3f07af40c57c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:08.799100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8cf95-d613-44c9-a7d2-3f07af40c57c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:08.799555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8cf95-d613-44c9-a7d2-3f07af40c57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:08.852239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-53f8cf95-d613-44c9-a7d2-3f07af40c57c None None] MFA Rules not processed for user `6eb744082ec149bda1dec06b0f300399`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:08.855397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-53f8cf95-d613-44c9-a7d2-3f07af40c57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:09.010693 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2209/4426] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:08 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:09.015479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4fe48-b4fe-401f-a128-a9cae4636a03 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:09.148688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4fe48-b4fe-401f-a128-a9cae4636a03 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:09.156559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c136b2a-a117-4011-b823-b3817605876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:09.157825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c136b2a-a117-4011-b823-b3817605876e admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:09.158116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c136b2a-a117-4011-b823-b3817605876e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:09.158630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c136b2a-a117-4011-b823-b3817605876e admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:09.159823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c136b2a-a117-4011-b823-b3817605876e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:09.165000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c136b2a-a117-4011-b823-b3817605876e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:09.223071 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2218/4427] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:09 2021] POST /identity/v3/projects => generated 367 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:09.228021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8cf95-d613-44c9-a7d2-3f07af40c57c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:09.248182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8cf95-d613-44c9-a7d2-3f07af40c57c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:09.363088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229fcf-621c-42ff-a12b-9d5fb511f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:09.363967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229fcf-621c-42ff-a12b-9d5fb511f590 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:09.364354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229fcf-621c-42ff-a12b-9d5fb511f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:09.365413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229fcf-621c-42ff-a12b-9d5fb511f590 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:09.366338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2229fcf-621c-42ff-a12b-9d5fb511f590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:09.369507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2229fcf-621c-42ff-a12b-9d5fb511f590 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:09.403312 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2210/4428] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:09 2021] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:09.404780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c136b2a-a117-4011-b823-b3817605876e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:09.419540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c136b2a-a117-4011-b823-b3817605876e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:09.437474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e496f-b0b7-4e2d-9c72-41745bff7c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:09.439485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e496f-b0b7-4e2d-9c72-41745bff7c25 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:09.440212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e496f-b0b7-4e2d-9c72-41745bff7c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:09.440508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e496f-b0b7-4e2d-9c72-41745bff7c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:09.441768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e496f-b0b7-4e2d-9c72-41745bff7c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:09.444177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e496f-b0b7-4e2d-9c72-41745bff7c25 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:09.468012 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2219/4429] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:09 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:09.470310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229fcf-621c-42ff-a12b-9d5fb511f590 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:09.487197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229fcf-621c-42ff-a12b-9d5fb511f590 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:09.506890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7008bd3-3d6d-4e72-9f8f-6352b0c0b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:09.507925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7008bd3-3d6d-4e72-9f8f-6352b0c0b69c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:09.508217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7008bd3-3d6d-4e72-9f8f-6352b0c0b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:09.508803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7008bd3-3d6d-4e72-9f8f-6352b0c0b69c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:09.509781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7008bd3-3d6d-4e72-9f8f-6352b0c0b69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:09.514018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7008bd3-3d6d-4e72-9f8f-6352b0c0b69c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:09.550358 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2211/4430] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:09 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:09.555178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e496f-b0b7-4e2d-9c72-41745bff7c25 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:09.567346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e496f-b0b7-4e2d-9c72-41745bff7c25 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:09.574725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9210f-65c0-46ba-83f4-950c6ecddb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:09.575806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9210f-65c0-46ba-83f4-950c6ecddb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:09.576251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9210f-65c0-46ba-83f4-950c6ecddb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:09.576682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9210f-65c0-46ba-83f4-950c6ecddb07 admin admin] PATH_INFO: `/v3/projects/fc347d9687054256be17d54244159f8f/users/78f844cb432e41c99dc39d3efe3607d2/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:09.598086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9210f-65c0-46ba-83f4-950c6ecddb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc347d9687054256be17d54244159f8f, user_id=78f844cb432e41c99dc39d3efe3607d2, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:09.600915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9210f-65c0-46ba-83f4-950c6ecddb07 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:09.635277 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2220/4431] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:09 2021] PUT /identity/v3/projects/fc347d9687054256be17d54244159f8f/users/78f844cb432e41c99dc39d3efe3607d2/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:09.641968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6dfd7-8682-4c08-bff0-8627b9590ff5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:09.642541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6dfd7-8682-4c08-bff0-8627b9590ff5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:09.643046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6dfd7-8682-4c08-bff0-8627b9590ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:09.688904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-25a6dfd7-8682-4c08-bff0-8627b9590ff5 None None] MFA Rules not processed for user `78f844cb432e41c99dc39d3efe3607d2`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:09.690150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-25a6dfd7-8682-4c08-bff0-8627b9590ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:09.790028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9210f-65c0-46ba-83f4-950c6ecddb07 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:09.790619 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2212/4432] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:09 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:09.791895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-40a9210f-65c0-46ba-83f4-950c6ecddb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:09.858179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9210f-65c0-46ba-83f4-950c6ecddb07 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:09.862661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaad25-e503-4559-b195-2425e6517435 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:09.863505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaad25-e503-4559-b195-2425e6517435 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:09.864823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaad25-e503-4559-b195-2425e6517435 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:09.864823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaad25-e503-4559-b195-2425e6517435 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:09.970969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaad25-e503-4559-b195-2425e6517435 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:09.972469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaad25-e503-4559-b195-2425e6517435 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:09.984918 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2221/4433] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:09 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:10.043830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbc028-3286-4d80-9670-c34b56577dba None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:10.043830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbc028-3286-4d80-9670-c34b56577dba None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:10.044028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbc028-3286-4d80-9670-c34b56577dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:10.073712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f8bbc028-3286-4d80-9670-c34b56577dba None None] MFA Rules not processed for user `ed87ef17973a49f2a9108bdfbff65415`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:10.079455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f8bbc028-3286-4d80-9670-c34b56577dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:10.191237 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2213/4434] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:10 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:10.215086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaad25-e503-4559-b195-2425e6517435 service glance] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:10.240551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaad25-e503-4559-b195-2425e6517435 service glance] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:10.254722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725923b-585e-4f3e-b7fe-98d6ab405416 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:10.255518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725923b-585e-4f3e-b7fe-98d6ab405416 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:10.255712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725923b-585e-4f3e-b7fe-98d6ab405416 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:10.259047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725923b-585e-4f3e-b7fe-98d6ab405416 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:10.274897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725923b-585e-4f3e-b7fe-98d6ab405416 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:10.281005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725923b-585e-4f3e-b7fe-98d6ab405416 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:10.291825 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2222/4435] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:10 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:12.348882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbc028-3286-4d80-9670-c34b56577dba None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:12.456486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbc028-3286-4d80-9670-c34b56577dba None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:12.463448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:12.465296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:12.465296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:12.465551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] PATH_INFO: `/v3/users/6eb744082ec149bda1dec06b0f300399` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:12.481964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb744082ec149bda1dec06b0f300399)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:12.484085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:12.543007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb744082ec149bda1dec06b0f300399'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:12.544472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb744082ec149bda1dec06b0f300399'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:12.562341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb744082ec149bda1dec06b0f300399'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:12.563294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb744082ec149bda1dec06b0f300399'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:12.571714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb744082ec149bda1dec06b0f300399'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:12.610988 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2214/4436] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:12 2021] DELETE /identity/v3/users/6eb744082ec149bda1dec06b0f300399 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:12.616330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5269ce-5883-45f4-8c07-cb9492026f2a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:12.617529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5269ce-5883-45f4-8c07-cb9492026f2a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:12.617977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5269ce-5883-45f4-8c07-cb9492026f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:12.644598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3f5269ce-5883-45f4-8c07-cb9492026f2a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:12.646338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3f5269ce-5883-45f4-8c07-cb9492026f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:12.745613 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2223/4437] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:12.775680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:12.777224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:12.856891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beba3b-61a2-4570-ad1e-3bb52c691bd5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:12.861250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9409772-cb30-47b7-8610-a27decf0ea1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:12.862087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9409772-cb30-47b7-8610-a27decf0ea1b service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:12.862528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9409772-cb30-47b7-8610-a27decf0ea1b service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:12.862949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9409772-cb30-47b7-8610-a27decf0ea1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:12.878036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9409772-cb30-47b7-8610-a27decf0ea1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:12.879538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9409772-cb30-47b7-8610-a27decf0ea1b service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:12.890334 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2215/4438] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:13.976793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5269ce-5883-45f4-8c07-cb9492026f2a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:13.978568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3f5269ce-5883-45f4-8c07-cb9492026f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:13.991778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5269ce-5883-45f4-8c07-cb9492026f2a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:13.997901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:13.999012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:13.999592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:14.000107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] PATH_INFO: `/v3/projects/21e23e4cb46e409cb0f244a7c3880d62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:14.001759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e23e4cb46e409cb0f244a7c3880d62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:14.003937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:14.055431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e23e4cb46e409cb0f244a7c3880d62', 'request_id': 'req-7b9389f1-a075-42d6-a510-acb842915591'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:14.067799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e23e4cb46e409cb0f244a7c3880d62', 'request_id': 'req-7b9389f1-a075-42d6-a510-acb842915591'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:14.082196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e23e4cb46e409cb0f244a7c3880d62', 'request_id': 'req-7b9389f1-a075-42d6-a510-acb842915591'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:14.105841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] The token cache is being invalidate because project 21e23e4cb46e409cb0f244a7c3880d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:14.107211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:14.107954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:14.114208 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2224/4439] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:13 2021] DELETE /identity/v3/projects/21e23e4cb46e409cb0f244a7c3880d62 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:14.115453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9409772-cb30-47b7-8610-a27decf0ea1b service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:14.132191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9409772-cb30-47b7-8610-a27decf0ea1b service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:14.194397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089ab5f-4b44-44e4-b529-c7155dff3af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:14.195739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089ab5f-4b44-44e4-b529-c7155dff3af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:14.195739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089ab5f-4b44-44e4-b529-c7155dff3af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:14.196064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089ab5f-4b44-44e4-b529-c7155dff3af8 admin admin] PATH_INFO: `/v3/users/78f844cb432e41c99dc39d3efe3607d2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:14.197138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089ab5f-4b44-44e4-b529-c7155dff3af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f844cb432e41c99dc39d3efe3607d2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:14.199088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089ab5f-4b44-44e4-b529-c7155dff3af8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:14.249341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e089ab5f-4b44-44e4-b529-c7155dff3af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f844cb432e41c99dc39d3efe3607d2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:14.250098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e089ab5f-4b44-44e4-b529-c7155dff3af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f844cb432e41c99dc39d3efe3607d2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:14.257634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e089ab5f-4b44-44e4-b529-c7155dff3af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f844cb432e41c99dc39d3efe3607d2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:14.258273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e089ab5f-4b44-44e4-b529-c7155dff3af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f844cb432e41c99dc39d3efe3607d2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:14.265772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e089ab5f-4b44-44e4-b529-c7155dff3af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f844cb432e41c99dc39d3efe3607d2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:14.283677 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2216/4440] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:14 2021] DELETE /identity/v3/users/78f844cb432e41c99dc39d3efe3607d2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:15.004445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:15.012426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:15.036421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9389f1-a075-42d6-a510-acb842915591 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:15.121257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:15.122645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:15.123359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:15.123853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] PATH_INFO: `/v3/projects/fc347d9687054256be17d54244159f8f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:15.125413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc347d9687054256be17d54244159f8f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:15.127762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:15.210540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc347d9687054256be17d54244159f8f', 'request_id': 'req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:15.221807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc347d9687054256be17d54244159f8f', 'request_id': 'req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:15.234339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc347d9687054256be17d54244159f8f', 'request_id': 'req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:15.248407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] The token cache is being invalidate because project fc347d9687054256be17d54244159f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:15.249060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:15.249937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b0c583ef-a2ce-4bd3-8d82-714bbd182cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:15.252429 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2225/4441] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:15 2021] DELETE /identity/v3/projects/fc347d9687054256be17d54244159f8f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:15.261966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400b12-9331-46bc-a088-011b35bb263d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:15.262515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400b12-9331-46bc-a088-011b35bb263d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:15.262515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1400b12-9331-46bc-a088-011b35bb263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:15.282766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d1400b12-9331-46bc-a088-011b35bb263d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:15.284435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d1400b12-9331-46bc-a088-011b35bb263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:15.352729 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2217/4442] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:15.361376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55be52-327f-40a8-a99f-344518310828 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:15.362544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55be52-327f-40a8-a99f-344518310828 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:15.363176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55be52-327f-40a8-a99f-344518310828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:15.389777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5d55be52-327f-40a8-a99f-344518310828 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:15.392220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5d55be52-327f-40a8-a99f-344518310828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:15.411725 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2226/4443] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:15.413102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1400b12-9331-46bc-a088-011b35bb263d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:15.424091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1400b12-9331-46bc-a088-011b35bb263d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:15.430518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bbaf9-221d-4ad1-8996-a5f694bfe7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:15.431580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbaf9-221d-4ad1-8996-a5f694bfe7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:15.432047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbaf9-221d-4ad1-8996-a5f694bfe7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:15.432476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbaf9-221d-4ad1-8996-a5f694bfe7e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:15.433385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bbaf9-221d-4ad1-8996-a5f694bfe7e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:15.433844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bbaf9-221d-4ad1-8996-a5f694bfe7e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:15.435660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bbaf9-221d-4ad1-8996-a5f694bfe7e7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:15.458430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55be52-327f-40a8-a99f-344518310828 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:15.469442 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2218/4444] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:15.470096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55be52-327f-40a8-a99f-344518310828 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:15.484470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0be59-9c6f-48c0-98f6-cccb230f88dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:15.485136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0be59-9c6f-48c0-98f6-cccb230f88dd admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:15.485820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0be59-9c6f-48c0-98f6-cccb230f88dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:15.486231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0be59-9c6f-48c0-98f6-cccb230f88dd admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:15.488470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0be59-9c6f-48c0-98f6-cccb230f88dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:15.494020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0be59-9c6f-48c0-98f6-cccb230f88dd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:15.560351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bbaf9-221d-4ad1-8996-a5f694bfe7e7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:15.573468 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2227/4445] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:15 2021] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:15.575287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bbaf9-221d-4ad1-8996-a5f694bfe7e7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:15.673624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a72351-3389-4b1b-8f72-41d3565dd623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:15.674962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a72351-3389-4b1b-8f72-41d3565dd623 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:15.675503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a72351-3389-4b1b-8f72-41d3565dd623 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:15.677085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a72351-3389-4b1b-8f72-41d3565dd623 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:15.679130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a72351-3389-4b1b-8f72-41d3565dd623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:15.682880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a72351-3389-4b1b-8f72-41d3565dd623 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:15.711634 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2219/4446] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:15 2021] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:15.713875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0be59-9c6f-48c0-98f6-cccb230f88dd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:15.728513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0be59-9c6f-48c0-98f6-cccb230f88dd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:15.736549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b094f26-b86d-4a4c-a773-682549f4ed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:15.738250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b094f26-b86d-4a4c-a773-682549f4ed34 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:15.738736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b094f26-b86d-4a4c-a773-682549f4ed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:15.739192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b094f26-b86d-4a4c-a773-682549f4ed34 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:15.740213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b094f26-b86d-4a4c-a773-682549f4ed34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:15.742942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b094f26-b86d-4a4c-a773-682549f4ed34 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:15.766481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a72351-3389-4b1b-8f72-41d3565dd623 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:15.779424 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2228/4447] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:15 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:15.785739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a72351-3389-4b1b-8f72-41d3565dd623 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:15.794019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd673e56-f3ef-4d4c-8b5d-fd458e8514a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:15.794695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd673e56-f3ef-4d4c-8b5d-fd458e8514a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:15.794975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd673e56-f3ef-4d4c-8b5d-fd458e8514a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:15.795247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd673e56-f3ef-4d4c-8b5d-fd458e8514a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:15.805871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd673e56-f3ef-4d4c-8b5d-fd458e8514a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:15.807725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd673e56-f3ef-4d4c-8b5d-fd458e8514a7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:15.824207 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2220/4448] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:15 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:15.828167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b094f26-b86d-4a4c-a773-682549f4ed34 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:15.841054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b094f26-b86d-4a4c-a773-682549f4ed34 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:15.848225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cd76e-c9cd-4cdd-97de-90bd89cdb8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:15.849042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cd76e-c9cd-4cdd-97de-90bd89cdb8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:15.849387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cd76e-c9cd-4cdd-97de-90bd89cdb8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:15.850308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cd76e-c9cd-4cdd-97de-90bd89cdb8c5 admin admin] PATH_INFO: `/v3/projects/6b884d7cda534696b1220abe8016ae42/users/fb0a7d2c3b924df4827c48f5eb919411/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:15.877391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cd76e-c9cd-4cdd-97de-90bd89cdb8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b884d7cda534696b1220abe8016ae42, user_id=fb0a7d2c3b924df4827c48f5eb919411, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:15.882089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cd76e-c9cd-4cdd-97de-90bd89cdb8c5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:15.911661 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2229/4449] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:15 2021] PUT /identity/v3/projects/6b884d7cda534696b1220abe8016ae42/users/fb0a7d2c3b924df4827c48f5eb919411/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:15.916862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279f763-73b9-4b9c-bd59-4184d7872815 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:15.917487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279f763-73b9-4b9c-bd59-4184d7872815 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:15.917746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279f763-73b9-4b9c-bd59-4184d7872815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:15.951064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a279f763-73b9-4b9c-bd59-4184d7872815 None None] MFA Rules not processed for user `fb0a7d2c3b924df4827c48f5eb919411`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:15.953827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a279f763-73b9-4b9c-bd59-4184d7872815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:16.055977 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2221/4450] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:15 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:16.057118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cd76e-c9cd-4cdd-97de-90bd89cdb8c5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:16.161651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cd76e-c9cd-4cdd-97de-90bd89cdb8c5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:16.170379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485361-0501-4220-a761-a4f2432efb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:16.172452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485361-0501-4220-a761-a4f2432efb60 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:16.172997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485361-0501-4220-a761-a4f2432efb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:16.174585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485361-0501-4220-a761-a4f2432efb60 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:16.175662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6485361-0501-4220-a761-a4f2432efb60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:16.178026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6485361-0501-4220-a761-a4f2432efb60 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:16.228115 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2230/4451] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:16 2021] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:16.229581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279f763-73b9-4b9c-bd59-4184d7872815 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:16.252473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279f763-73b9-4b9c-bd59-4184d7872815 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:16.334879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70228fc-50a5-4d98-a6c4-1c7d69a19d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:16.336469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70228fc-50a5-4d98-a6c4-1c7d69a19d18 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:16.336954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70228fc-50a5-4d98-a6c4-1c7d69a19d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:16.337435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70228fc-50a5-4d98-a6c4-1c7d69a19d18 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:16.338356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70228fc-50a5-4d98-a6c4-1c7d69a19d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:16.340540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70228fc-50a5-4d98-a6c4-1c7d69a19d18 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:16.366506 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2222/4452] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:16 2021] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:16.370683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485361-0501-4220-a761-a4f2432efb60 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:16.386163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485361-0501-4220-a761-a4f2432efb60 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:16.408157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638e45-2681-4d44-978b-05e87976f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:16.410684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638e45-2681-4d44-978b-05e87976f1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:16.411207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638e45-2681-4d44-978b-05e87976f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:16.413126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638e45-2681-4d44-978b-05e87976f1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:16.414182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638e45-2681-4d44-978b-05e87976f1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:16.418138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce638e45-2681-4d44-978b-05e87976f1d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:16.463646 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2231/4453] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:16 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:16.464420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70228fc-50a5-4d98-a6c4-1c7d69a19d18 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:16.475995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70228fc-50a5-4d98-a6c4-1c7d69a19d18 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:16.491979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d67e3e-a436-4c2f-94b2-f2d803d53510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:16.492882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d67e3e-a436-4c2f-94b2-f2d803d53510 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:16.493166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d67e3e-a436-4c2f-94b2-f2d803d53510 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:16.493441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d67e3e-a436-4c2f-94b2-f2d803d53510 admin admin] PATH_INFO: `/v3/projects/bea1365c973143559eb726afedda9338/users/0d52ae0b60c94d81b50e9124bb0172b1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:16.510934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d67e3e-a436-4c2f-94b2-f2d803d53510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea1365c973143559eb726afedda9338, user_id=0d52ae0b60c94d81b50e9124bb0172b1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:16.513667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d67e3e-a436-4c2f-94b2-f2d803d53510 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:16.542647 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2223/4454] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:16 2021] PUT /identity/v3/projects/bea1365c973143559eb726afedda9338/users/0d52ae0b60c94d81b50e9124bb0172b1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:16.546757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638e45-2681-4d44-978b-05e87976f1d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:16.566470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638e45-2681-4d44-978b-05e87976f1d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:16.670397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aff7f-2697-416d-9c17-4f80f2179d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:16.671627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aff7f-2697-416d-9c17-4f80f2179d56 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:16.672965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aff7f-2697-416d-9c17-4f80f2179d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:16.674396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aff7f-2697-416d-9c17-4f80f2179d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:16.676139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aff7f-2697-416d-9c17-4f80f2179d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:16.681159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aff7f-2697-416d-9c17-4f80f2179d56 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:16.708485 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2232/4455] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:16 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:16.710099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d67e3e-a436-4c2f-94b2-f2d803d53510 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:16.727624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d67e3e-a436-4c2f-94b2-f2d803d53510 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:16.750117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff229a72-1aed-41d8-951b-e515b6dc1a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:16.751284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff229a72-1aed-41d8-951b-e515b6dc1a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:16.751568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff229a72-1aed-41d8-951b-e515b6dc1a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:16.751847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff229a72-1aed-41d8-951b-e515b6dc1a2c admin admin] PATH_INFO: `/v3/projects/bea1365c973143559eb726afedda9338/users/0d52ae0b60c94d81b50e9124bb0172b1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:16.754461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff229a72-1aed-41d8-951b-e515b6dc1a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea1365c973143559eb726afedda9338, user_id=0d52ae0b60c94d81b50e9124bb0172b1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:16.757830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff229a72-1aed-41d8-951b-e515b6dc1a2c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:16.787024 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2224/4456] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:16 2021] PUT /identity/v3/projects/bea1365c973143559eb726afedda9338/users/0d52ae0b60c94d81b50e9124bb0172b1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:16.798385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918972f-62c1-4259-8fd8-5069a1a25cd6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:16.798672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918972f-62c1-4259-8fd8-5069a1a25cd6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:16.798947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918972f-62c1-4259-8fd8-5069a1a25cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:16.856046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3918972f-62c1-4259-8fd8-5069a1a25cd6 None None] MFA Rules not processed for user `0d52ae0b60c94d81b50e9124bb0172b1`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:16.857393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3918972f-62c1-4259-8fd8-5069a1a25cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:17.026716 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2233/4457] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:16 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:17.059109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff229a72-1aed-41d8-951b-e515b6dc1a2c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:17.065142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ff229a72-1aed-41d8-951b-e515b6dc1a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:17.276074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff229a72-1aed-41d8-951b-e515b6dc1a2c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:17.291148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040d78-ac21-4e05-9c78-3d969d818493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:17.291896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040d78-ac21-4e05-9c78-3d969d818493 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:17.292931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040d78-ac21-4e05-9c78-3d969d818493 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:17.293227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040d78-ac21-4e05-9c78-3d969d818493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:17.327277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a040d78-ac21-4e05-9c78-3d969d818493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:17.331967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a040d78-ac21-4e05-9c78-3d969d818493 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:17.364358 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2225/4458] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:17 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:21.018365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918972f-62c1-4259-8fd8-5069a1a25cd6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:21.216465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918972f-62c1-4259-8fd8-5069a1a25cd6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:21.230286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:21.231891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:21.232175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:21.232457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] PATH_INFO: `/v3/users/fb0a7d2c3b924df4827c48f5eb919411` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:21.233849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0a7d2c3b924df4827c48f5eb919411)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:21.241717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:21.340274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0a7d2c3b924df4827c48f5eb919411'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:21.350497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0a7d2c3b924df4827c48f5eb919411'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:21.352127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0a7d2c3b924df4827c48f5eb919411'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:21.368453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0a7d2c3b924df4827c48f5eb919411'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:21.389274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0a7d2c3b924df4827c48f5eb919411'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:21.398744 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2234/4459] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:21 2021] DELETE /identity/v3/users/fb0a7d2c3b924df4827c48f5eb919411 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:21.403155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fddb5-a4d0-44e9-a8ba-470b2057d6a6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:21.403786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fddb5-a4d0-44e9-a8ba-470b2057d6a6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:21.403786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fddb5-a4d0-44e9-a8ba-470b2057d6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:21.437076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ef6fddb5-a4d0-44e9-a8ba-470b2057d6a6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:21.438313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ef6fddb5-a4d0-44e9-a8ba-470b2057d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:21.559152 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2226/4460] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:21.609717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:21.611629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:21.702962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0b97d-1302-47cf-9021-00d0c4e1011c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:21.707353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb0ab1-6678-4ee9-b896-075e5f5f5170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:21.708039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb0ab1-6678-4ee9-b896-075e5f5f5170 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:21.708353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb0ab1-6678-4ee9-b896-075e5f5f5170 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:21.709751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb0ab1-6678-4ee9-b896-075e5f5f5170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:21.722289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb0ab1-6678-4ee9-b896-075e5f5f5170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:21.724134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb0ab1-6678-4ee9-b896-075e5f5f5170 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:21.743541 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2235/4461] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:22.383638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fddb5-a4d0-44e9-a8ba-470b2057d6a6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:22.385935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ef6fddb5-a4d0-44e9-a8ba-470b2057d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:22.407832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fddb5-a4d0-44e9-a8ba-470b2057d6a6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:22.425999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:22.427297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:22.428340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:22.428840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] PATH_INFO: `/v3/projects/6b884d7cda534696b1220abe8016ae42` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:22.430541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b884d7cda534696b1220abe8016ae42)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:22.433481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:22.610930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b884d7cda534696b1220abe8016ae42', 'request_id': 'req-55bb8048-c33f-48cf-bfb3-b5223969d516'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:22.627840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b884d7cda534696b1220abe8016ae42', 'request_id': 'req-55bb8048-c33f-48cf-bfb3-b5223969d516'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:22.643338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b884d7cda534696b1220abe8016ae42', 'request_id': 'req-55bb8048-c33f-48cf-bfb3-b5223969d516'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:22.673377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] The token cache is being invalidate because project 6b884d7cda534696b1220abe8016ae42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:22.673611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:22.684136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:22.695022 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2227/4462] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:22 2021] DELETE /identity/v3/projects/6b884d7cda534696b1220abe8016ae42 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:22.696091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb0ab1-6678-4ee9-b896-075e5f5f5170 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:22.706173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb0ab1-6678-4ee9-b896-075e5f5f5170 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:22.825495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d8fd5-5648-4e1f-a547-14d73abe9dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:22.839887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d8fd5-5648-4e1f-a547-14d73abe9dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:22.845906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d8fd5-5648-4e1f-a547-14d73abe9dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:22.846549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d8fd5-5648-4e1f-a547-14d73abe9dc1 admin admin] PATH_INFO: `/v3/users/0d52ae0b60c94d81b50e9124bb0172b1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:22.850643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d8fd5-5648-4e1f-a547-14d73abe9dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d52ae0b60c94d81b50e9124bb0172b1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:22.854312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d8fd5-5648-4e1f-a547-14d73abe9dc1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:22.969773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d77d8fd5-5648-4e1f-a547-14d73abe9dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d52ae0b60c94d81b50e9124bb0172b1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:22.982212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d77d8fd5-5648-4e1f-a547-14d73abe9dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d52ae0b60c94d81b50e9124bb0172b1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:22.983908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d77d8fd5-5648-4e1f-a547-14d73abe9dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d52ae0b60c94d81b50e9124bb0172b1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:22.994338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d77d8fd5-5648-4e1f-a547-14d73abe9dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d52ae0b60c94d81b50e9124bb0172b1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:23.014451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d77d8fd5-5648-4e1f-a547-14d73abe9dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d52ae0b60c94d81b50e9124bb0172b1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:23.024144 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2236/4463] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:22 2021] DELETE /identity/v3/users/0d52ae0b60c94d81b50e9124bb0172b1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:23.622185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:23.625331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:23.658192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb8048-c33f-48cf-bfb3-b5223969d516 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:23.751117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:23.752705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:23.753151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:23.753731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] PATH_INFO: `/v3/projects/bea1365c973143559eb726afedda9338` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:23.755716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea1365c973143559eb726afedda9338)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:23.759039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:23.897433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea1365c973143559eb726afedda9338', 'request_id': 'req-4b105f55-31f3-4e83-8299-dfb389db854b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:23.906547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea1365c973143559eb726afedda9338', 'request_id': 'req-4b105f55-31f3-4e83-8299-dfb389db854b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:23.918934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea1365c973143559eb726afedda9338', 'request_id': 'req-4b105f55-31f3-4e83-8299-dfb389db854b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:23.949816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] The token cache is being invalidate because project bea1365c973143559eb726afedda9338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:23.950209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:23.954621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b105f55-31f3-4e83-8299-dfb389db854b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:23.958283 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2228/4464] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:23 2021] DELETE /identity/v3/projects/bea1365c973143559eb726afedda9338 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:23.964103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb5778-3617-4d10-8efe-d690909a3a23 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:23.964980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb5778-3617-4d10-8efe-d690909a3a23 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:23.965474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb5778-3617-4d10-8efe-d690909a3a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:24.003140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-73fb5778-3617-4d10-8efe-d690909a3a23 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:24.005442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-73fb5778-3617-4d10-8efe-d690909a3a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:24.105438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030d9e6-c677-4b70-b1cc-b46acb7a67fe None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:24.105869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030d9e6-c677-4b70-b1cc-b46acb7a67fe None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:24.106383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030d9e6-c677-4b70-b1cc-b46acb7a67fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:24.107432 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2237/4465] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:24.130333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b030d9e6-c677-4b70-b1cc-b46acb7a67fe None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:24.132234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b030d9e6-c677-4b70-b1cc-b46acb7a67fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:24.149553 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2229/4466] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:24.150527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb5778-3617-4d10-8efe-d690909a3a23 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:24.164293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb5778-3617-4d10-8efe-d690909a3a23 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:24.175425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3a487-e770-4fae-8436-1175dfa13021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:24.176520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3a487-e770-4fae-8436-1175dfa13021 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:24.176966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3a487-e770-4fae-8436-1175dfa13021 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:24.177400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3a487-e770-4fae-8436-1175dfa13021 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:24.178554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3a487-e770-4fae-8436-1175dfa13021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:24.179032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3a487-e770-4fae-8436-1175dfa13021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:24.181313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3a487-e770-4fae-8436-1175dfa13021 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:24.199726 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2238/4467] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:58:24.201832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030d9e6-c677-4b70-b1cc-b46acb7a67fe None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:24.213388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030d9e6-c677-4b70-b1cc-b46acb7a67fe None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:24.221298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0574-f5f4-4fed-b96e-b7daf4a7f9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:24.222483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0574-f5f4-4fed-b96e-b7daf4a7f9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:24.222882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0574-f5f4-4fed-b96e-b7daf4a7f9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:24.223537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0574-f5f4-4fed-b96e-b7daf4a7f9a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:24.225409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0574-f5f4-4fed-b96e-b7daf4a7f9a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:24.228095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0574-f5f4-4fed-b96e-b7daf4a7f9a8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:24.260854 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2230/4468] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:24 2021] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:24.265457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3a487-e770-4fae-8436-1175dfa13021 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:24.278786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3a487-e770-4fae-8436-1175dfa13021 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:24.346914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b647953-faef-42a3-96f7-b06c4203c9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:24.347905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b647953-faef-42a3-96f7-b06c4203c9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:24.348381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b647953-faef-42a3-96f7-b06c4203c9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:24.348732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b647953-faef-42a3-96f7-b06c4203c9d1 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:24.350198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b647953-faef-42a3-96f7-b06c4203c9d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:24.352774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b647953-faef-42a3-96f7-b06c4203c9d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:24.377441 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2239/4469] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:24 2021] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:24.381927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0574-f5f4-4fed-b96e-b7daf4a7f9a8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:24.394942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0574-f5f4-4fed-b96e-b7daf4a7f9a8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:24.401508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150e990-29cd-4c3b-ace3-6a4c5c1bc900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:24.402550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150e990-29cd-4c3b-ace3-6a4c5c1bc900 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:24.402843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150e990-29cd-4c3b-ace3-6a4c5c1bc900 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:24.403137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150e990-29cd-4c3b-ace3-6a4c5c1bc900 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:24.404023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150e990-29cd-4c3b-ace3-6a4c5c1bc900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:24.405883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150e990-29cd-4c3b-ace3-6a4c5c1bc900 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:24.420966 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2231/4470] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:24 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:24.428729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b647953-faef-42a3-96f7-b06c4203c9d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:24.441312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b647953-faef-42a3-96f7-b06c4203c9d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:24.458765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96351781-1c0f-4187-8326-57af9477e877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:24.461041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351781-1c0f-4187-8326-57af9477e877 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:24.461754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351781-1c0f-4187-8326-57af9477e877 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:24.462583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351781-1c0f-4187-8326-57af9477e877 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:24.463070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96351781-1c0f-4187-8326-57af9477e877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:24.464899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96351781-1c0f-4187-8326-57af9477e877 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:24.479603 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2240/4471] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:24 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:24.483149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150e990-29cd-4c3b-ace3-6a4c5c1bc900 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:24.496273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150e990-29cd-4c3b-ace3-6a4c5c1bc900 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:24.503762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944da96-edc1-4887-9a8c-aeffae92e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:24.504861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944da96-edc1-4887-9a8c-aeffae92e726 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:24.505238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944da96-edc1-4887-9a8c-aeffae92e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:24.506089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944da96-edc1-4887-9a8c-aeffae92e726 admin admin] PATH_INFO: `/v3/projects/ec1da78274cd49d5925895cd982423e3/users/7c68359193e04350a4d6155648ac5953/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:24.525374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944da96-edc1-4887-9a8c-aeffae92e726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1da78274cd49d5925895cd982423e3, user_id=7c68359193e04350a4d6155648ac5953, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:24.528974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944da96-edc1-4887-9a8c-aeffae92e726 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:24.549468 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2232/4472] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:24 2021] PUT /identity/v3/projects/ec1da78274cd49d5925895cd982423e3/users/7c68359193e04350a4d6155648ac5953/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:24.565729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6ce26-2d51-4563-a74c-c6b4ca47195a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:24.566525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6ce26-2d51-4563-a74c-c6b4ca47195a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:24.567226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6ce26-2d51-4563-a74c-c6b4ca47195a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:24.602503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3fd6ce26-2d51-4563-a74c-c6b4ca47195a None None] MFA Rules not processed for user `7c68359193e04350a4d6155648ac5953`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:24.603756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3fd6ce26-2d51-4563-a74c-c6b4ca47195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:24.683569 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2241/4473] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:24 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:24.697591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944da96-edc1-4887-9a8c-aeffae92e726 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:24.700265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f944da96-edc1-4887-9a8c-aeffae92e726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:24.806099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944da96-edc1-4887-9a8c-aeffae92e726 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:24.811917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813c79c-a250-4f80-86f3-3361a9383ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:24.813009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c79c-a250-4f80-86f3-3361a9383ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:24.813440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c79c-a250-4f80-86f3-3361a9383ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:24.813817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c79c-a250-4f80-86f3-3361a9383ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:24.825707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813c79c-a250-4f80-86f3-3361a9383ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:24.827531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813c79c-a250-4f80-86f3-3361a9383ee7 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:24.843317 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2233/4474] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:24 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:24.887879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6ce26-2d51-4563-a74c-c6b4ca47195a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:24.961575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6ce26-2d51-4563-a74c-c6b4ca47195a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:24.966180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:24.967268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:24.967645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:24.967987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] PATH_INFO: `/v3/users/7c68359193e04350a4d6155648ac5953` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:24.969251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c68359193e04350a4d6155648ac5953)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:24.971539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:25.031729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c68359193e04350a4d6155648ac5953'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:25.043332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c68359193e04350a4d6155648ac5953'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:25.044275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c68359193e04350a4d6155648ac5953'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:25.053129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c68359193e04350a4d6155648ac5953'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:25.072098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c68359193e04350a4d6155648ac5953'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:25.087334 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2242/4475] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:24 2021] DELETE /identity/v3/users/7c68359193e04350a4d6155648ac5953 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:25.089810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fd0b3-8039-4a08-ab95-7f8adc810dbe None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:25.090465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fd0b3-8039-4a08-ab95-7f8adc810dbe None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:25.090971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fd0b3-8039-4a08-ab95-7f8adc810dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:25.117203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ce5fd0b3-8039-4a08-ab95-7f8adc810dbe None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:25.118437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ce5fd0b3-8039-4a08-ab95-7f8adc810dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:25.237878 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2234/4476] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:25.254373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:25.256674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:25.342445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae443e-5d7b-4346-ae64-2dfcfb6045ee admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:25.346658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d1f44-fc88-4663-9ab8-088d3de6d6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:25.347832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d1f44-fc88-4663-9ab8-088d3de6d6ae service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:25.348987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d1f44-fc88-4663-9ab8-088d3de6d6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:25.349520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d1f44-fc88-4663-9ab8-088d3de6d6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:25.360745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d1f44-fc88-4663-9ab8-088d3de6d6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:25.364846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d1f44-fc88-4663-9ab8-088d3de6d6ae service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:25.387763 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2243/4477] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:25.534942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fd0b3-8039-4a08-ab95-7f8adc810dbe None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:25.536637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ce5fd0b3-8039-4a08-ab95-7f8adc810dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:25.556833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fd0b3-8039-4a08-ab95-7f8adc810dbe None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:25.566848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cdca7-e12e-46fd-9b20-0b1ee56f75cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:25.570043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cdca7-e12e-46fd-9b20-0b1ee56f75cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:25.570928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cdca7-e12e-46fd-9b20-0b1ee56f75cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:25.571711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cdca7-e12e-46fd-9b20-0b1ee56f75cf admin admin] PATH_INFO: `/v3/users/d83a3fe020954cddb42864198a20ea9d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:25.577598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cdca7-e12e-46fd-9b20-0b1ee56f75cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83a3fe020954cddb42864198a20ea9d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:25.581264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cdca7-e12e-46fd-9b20-0b1ee56f75cf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:25.686135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c05cdca7-e12e-46fd-9b20-0b1ee56f75cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83a3fe020954cddb42864198a20ea9d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:25.686799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c05cdca7-e12e-46fd-9b20-0b1ee56f75cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83a3fe020954cddb42864198a20ea9d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:25.701290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c05cdca7-e12e-46fd-9b20-0b1ee56f75cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83a3fe020954cddb42864198a20ea9d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:25.702667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c05cdca7-e12e-46fd-9b20-0b1ee56f75cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83a3fe020954cddb42864198a20ea9d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:25.715268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c05cdca7-e12e-46fd-9b20-0b1ee56f75cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83a3fe020954cddb42864198a20ea9d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:25.745104 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2235/4478] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:25 2021] DELETE /identity/v3/users/d83a3fe020954cddb42864198a20ea9d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:26.177170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d1f44-fc88-4663-9ab8-088d3de6d6ae service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:26.178781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-433d1f44-fc88-4663-9ab8-088d3de6d6ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:26.202990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d1f44-fc88-4663-9ab8-088d3de6d6ae service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:26.377985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:26.379002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:26.379586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:26.379866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] PATH_INFO: `/v3/projects/ec1da78274cd49d5925895cd982423e3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:26.384086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1da78274cd49d5925895cd982423e3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:26.386017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:26.454069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1da78274cd49d5925895cd982423e3', 'request_id': 'req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:26.463204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1da78274cd49d5925895cd982423e3', 'request_id': 'req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:26.470883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1da78274cd49d5925895cd982423e3', 'request_id': 'req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:26.483902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] The token cache is being invalidate because project ec1da78274cd49d5925895cd982423e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:26.484192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:26.485317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:26.487359 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2244/4479] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:26 2021] DELETE /identity/v3/projects/ec1da78274cd49d5925895cd982423e3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:26.493260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0153-e8dc-4916-b79b-cf809021c6fb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:26.493756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0153-e8dc-4916-b79b-cf809021c6fb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:26.494084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0153-e8dc-4916-b79b-cf809021c6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:26.515312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-05ea0153-e8dc-4916-b79b-cf809021c6fb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:26.516999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-05ea0153-e8dc-4916-b79b-cf809021c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:26.585894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:26.589528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:26.692213 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2236/4480] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:26.701879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95789-0ff9-42c3-9a79-37e8d7cce96d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:26.702482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95789-0ff9-42c3-9a79-37e8d7cce96d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:26.702567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95789-0ff9-42c3-9a79-37e8d7cce96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:26.750060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b867d0-9624-4c93-a2a7-87eda8e78a7c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:26.756382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-68b95789-0ff9-42c3-9a79-37e8d7cce96d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:26.757603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-68b95789-0ff9-42c3-9a79-37e8d7cce96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:26.762307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:26.763374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:26.763799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:26.764077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] PATH_INFO: `/v3/projects/ea113326fcea4903b6f63e84c0339fa7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:26.767786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea113326fcea4903b6f63e84c0339fa7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:26.770330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:26.774295 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2237/4481] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:26.780237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95789-0ff9-42c3-9a79-37e8d7cce96d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:26.795043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95789-0ff9-42c3-9a79-37e8d7cce96d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:26.800406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef9b54-8733-4fc3-84ea-458dd8005675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:26.801273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9b54-8733-4fc3-84ea-458dd8005675 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:26.801709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9b54-8733-4fc3-84ea-458dd8005675 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:26.802251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9b54-8733-4fc3-84ea-458dd8005675 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:26.803765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef9b54-8733-4fc3-84ea-458dd8005675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:26.804222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef9b54-8733-4fc3-84ea-458dd8005675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:26.805979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef9b54-8733-4fc3-84ea-458dd8005675 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:26.821406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2238/4482] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:26.825240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef9b54-8733-4fc3-84ea-458dd8005675 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:26.836705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef9b54-8733-4fc3-84ea-458dd8005675 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:26.837087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea113326fcea4903b6f63e84c0339fa7', 'request_id': 'req-ecd6bb67-db14-49fd-be5b-391acce3e19e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:26.846629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea113326fcea4903b6f63e84c0339fa7', 'request_id': 'req-ecd6bb67-db14-49fd-be5b-391acce3e19e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:26.856280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea113326fcea4903b6f63e84c0339fa7', 'request_id': 'req-ecd6bb67-db14-49fd-be5b-391acce3e19e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:26.869692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] The token cache is being invalidate because project ea113326fcea4903b6f63e84c0339fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:26.869981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:26.870665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecd6bb67-db14-49fd-be5b-391acce3e19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:26.872593 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2245/4483] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:26 2021] DELETE /identity/v3/projects/ea113326fcea4903b6f63e84c0339fa7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:26.878175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4f35-a8a6-4224-87b0-76e2e22504c1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:26.878467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4f35-a8a6-4224-87b0-76e2e22504c1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:26.878749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b4f35-a8a6-4224-87b0-76e2e22504c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:26.900352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f04b4f35-a8a6-4224-87b0-76e2e22504c1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:26.901476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f04b4f35-a8a6-4224-87b0-76e2e22504c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:26.910018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be0bc-9ae8-4e00-a5e4-8b79b1edf593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:26.910891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be0bc-9ae8-4e00-a5e4-8b79b1edf593 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:26.911170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be0bc-9ae8-4e00-a5e4-8b79b1edf593 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:26.911470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be0bc-9ae8-4e00-a5e4-8b79b1edf593 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:26.912190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390be0bc-9ae8-4e00-a5e4-8b79b1edf593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:26.914182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390be0bc-9ae8-4e00-a5e4-8b79b1edf593 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:26.951236 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2239/4484] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:26 2021] POST /identity/v3/projects => generated 397 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:26.952529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be0bc-9ae8-4e00-a5e4-8b79b1edf593 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:26.954218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-390be0bc-9ae8-4e00-a5e4-8b79b1edf593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:26.970964 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2246/4485] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:26.972339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57688bd-caf6-45b9-b25c-4ce29c19b8ee None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:26.972627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57688bd-caf6-45b9-b25c-4ce29c19b8ee None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:26.972898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57688bd-caf6-45b9-b25c-4ce29c19b8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:26.993192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f57688bd-caf6-45b9-b25c-4ce29c19b8ee None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:26.994397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f57688bd-caf6-45b9-b25c-4ce29c19b8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:27.034450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be0bc-9ae8-4e00-a5e4-8b79b1edf593 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.040556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d7116-99a7-467d-9fd6-53b4ad7cdf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.041444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d7116-99a7-467d-9fd6-53b4ad7cdf56 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.042522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d7116-99a7-467d-9fd6-53b4ad7cdf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.042522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d7116-99a7-467d-9fd6-53b4ad7cdf56 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.043391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d7116-99a7-467d-9fd6-53b4ad7cdf56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.045715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d7116-99a7-467d-9fd6-53b4ad7cdf56 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.063659 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2247/4486] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:27.064727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57688bd-caf6-45b9-b25c-4ce29c19b8ee None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:27.075800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57688bd-caf6-45b9-b25c-4ce29c19b8ee None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.079621 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2240/4487] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:26 2021] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:27.081389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fccce-4555-460a-8ee6-72a6f58939c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.082275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fccce-4555-460a-8ee6-72a6f58939c0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.082972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fccce-4555-460a-8ee6-72a6f58939c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.083389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fccce-4555-460a-8ee6-72a6f58939c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.083720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d7116-99a7-467d-9fd6-53b4ad7cdf56 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:27.084400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fccce-4555-460a-8ee6-72a6f58939c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:27.084943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fccce-4555-460a-8ee6-72a6f58939c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.086687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fccce-4555-460a-8ee6-72a6f58939c0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.094306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d7116-99a7-467d-9fd6-53b4ad7cdf56 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.099574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e80d2-9768-4b37-8b41-d65a5526c056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.100072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e80d2-9768-4b37-8b41-d65a5526c056 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.100411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e80d2-9768-4b37-8b41-d65a5526c056 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.100697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e80d2-9768-4b37-8b41-d65a5526c056 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.101436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e80d2-9768-4b37-8b41-d65a5526c056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.102964 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2248/4488] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:58:27.103084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e80d2-9768-4b37-8b41-d65a5526c056 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.104035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fccce-4555-460a-8ee6-72a6f58939c0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:27.113500 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2241/4489] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:58:27.114495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fccce-4555-460a-8ee6-72a6f58939c0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.117764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e80d2-9768-4b37-8b41-d65a5526c056 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:27.120501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe90d41-d096-4a1a-83bb-bceedc31ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.121276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe90d41-d096-4a1a-83bb-bceedc31ab4b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.121630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe90d41-d096-4a1a-83bb-bceedc31ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.122236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe90d41-d096-4a1a-83bb-bceedc31ab4b admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.123030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe90d41-d096-4a1a-83bb-bceedc31ab4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.125159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe90d41-d096-4a1a-83bb-bceedc31ab4b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.129052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e80d2-9768-4b37-8b41-d65a5526c056 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.135059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0faada-6ec6-4111-a6b1-2035d5e15ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.135770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0faada-6ec6-4111-a6b1-2035d5e15ebf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.136674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0faada-6ec6-4111-a6b1-2035d5e15ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.136674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0faada-6ec6-4111-a6b1-2035d5e15ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.137216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0faada-6ec6-4111-a6b1-2035d5e15ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.138838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0faada-6ec6-4111-a6b1-2035d5e15ebf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.154285 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2242/4490] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:58:27.155876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0faada-6ec6-4111-a6b1-2035d5e15ebf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:27.159292 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2249/4491] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:27 2021] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:27.162968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe90d41-d096-4a1a-83bb-bceedc31ab4b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:27.167436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0faada-6ec6-4111-a6b1-2035d5e15ebf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.226687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39beb18a-ea39-4d45-94fb-2bbb4871b2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.227630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39beb18a-ea39-4d45-94fb-2bbb4871b2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.227963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39beb18a-ea39-4d45-94fb-2bbb4871b2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.228188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39beb18a-ea39-4d45-94fb-2bbb4871b2fd admin admin] PATH_INFO: `/v3/projects/2c6f1f00324d486499003a77e46b2854/users/c63392cdec1047d6b96967fb9a89b1da/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.234156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe90d41-d096-4a1a-83bb-bceedc31ab4b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.240850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13920f76-1e3a-45a0-b5f6-5fd317469eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.241546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13920f76-1e3a-45a0-b5f6-5fd317469eec admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.241827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13920f76-1e3a-45a0-b5f6-5fd317469eec admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.242099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13920f76-1e3a-45a0-b5f6-5fd317469eec admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.242820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13920f76-1e3a-45a0-b5f6-5fd317469eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.245562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13920f76-1e3a-45a0-b5f6-5fd317469eec admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.250951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39beb18a-ea39-4d45-94fb-2bbb4871b2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6f1f00324d486499003a77e46b2854, user_id=c63392cdec1047d6b96967fb9a89b1da, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.256964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39beb18a-ea39-4d45-94fb-2bbb4871b2fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.268960 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2250/4492] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:27 2021] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:27.273587 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2243/4493] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:27 2021] PUT /identity/v3/projects/2c6f1f00324d486499003a77e46b2854/users/c63392cdec1047d6b96967fb9a89b1da/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:27.273813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13920f76-1e3a-45a0-b5f6-5fd317469eec admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:27.283900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3afe15-6e73-453b-9018-e01e6afa5617 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.284228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3afe15-6e73-453b-9018-e01e6afa5617 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.284461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3afe15-6e73-453b-9018-e01e6afa5617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.284791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13920f76-1e3a-45a0-b5f6-5fd317469eec admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.321765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3f3afe15-6e73-453b-9018-e01e6afa5617 None None] MFA Rules not processed for user `c63392cdec1047d6b96967fb9a89b1da`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:27.323324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3f3afe15-6e73-453b-9018-e01e6afa5617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:27.352744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ca651-bb14-4178-8ad1-d831269970ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.353562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ca651-bb14-4178-8ad1-d831269970ef admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.354003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ca651-bb14-4178-8ad1-d831269970ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.354283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ca651-bb14-4178-8ad1-d831269970ef admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.356018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ca651-bb14-4178-8ad1-d831269970ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.357874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ca651-bb14-4178-8ad1-d831269970ef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.371182 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2251/4494] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:58:27.378906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ca651-bb14-4178-8ad1-d831269970ef admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:27.389793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ca651-bb14-4178-8ad1-d831269970ef admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.394950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfcad5-6f28-4d7c-a283-85f683951ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.395666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfcad5-6f28-4d7c-a283-85f683951ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.395945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfcad5-6f28-4d7c-a283-85f683951ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.396313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfcad5-6f28-4d7c-a283-85f683951ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.397107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfcad5-6f28-4d7c-a283-85f683951ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.398758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfcad5-6f28-4d7c-a283-85f683951ae9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.408640 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2244/4495] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:27 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:27.414188 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2252/4496] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:27 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:27.416616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3afe15-6e73-453b-9018-e01e6afa5617 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:27.419687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfcad5-6f28-4d7c-a283-85f683951ae9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:27.421402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9fcfcad5-6f28-4d7c-a283-85f683951ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:27.429773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3afe15-6e73-453b-9018-e01e6afa5617 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.434501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcff24-8828-4f0a-b5b4-a846167f1005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.435417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcff24-8828-4f0a-b5b4-a846167f1005 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.435861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcff24-8828-4f0a-b5b4-a846167f1005 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.436142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcff24-8828-4f0a-b5b4-a846167f1005 admin admin] PATH_INFO: `/v3/projects/bbf50009a3f54b5194229922fb73155c/users/2992d6410c4b449b9a9d0800941bc1b1/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.454231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcff24-8828-4f0a-b5b4-a846167f1005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf50009a3f54b5194229922fb73155c, user_id=2992d6410c4b449b9a9d0800941bc1b1, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.457482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcff24-8828-4f0a-b5b4-a846167f1005 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.493714 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2245/4497] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:27 2021] PUT /identity/v3/projects/bbf50009a3f54b5194229922fb73155c/users/2992d6410c4b449b9a9d0800941bc1b1/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:27.504524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c32e8-bb88-4c3a-8e24-9b10cc89c24f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.504812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c32e8-bb88-4c3a-8e24-9b10cc89c24f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.505131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c32e8-bb88-4c3a-8e24-9b10cc89c24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.512647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfcad5-6f28-4d7c-a283-85f683951ae9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.538581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4a2c32e8-bb88-4c3a-8e24-9b10cc89c24f None None] MFA Rules not processed for user `2992d6410c4b449b9a9d0800941bc1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:27.539895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4a2c32e8-bb88-4c3a-8e24-9b10cc89c24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:27.626393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4792fa-61ad-46b1-8746-bbc96a15de99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.627097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4792fa-61ad-46b1-8746-bbc96a15de99 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.627506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4792fa-61ad-46b1-8746-bbc96a15de99 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.627724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4792fa-61ad-46b1-8746-bbc96a15de99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.647450 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2246/4498] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:27 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:27.663153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c32e8-bb88-4c3a-8e24-9b10cc89c24f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:27.763183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c32e8-bb88-4c3a-8e24-9b10cc89c24f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:27.764454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4792fa-61ad-46b1-8746-bbc96a15de99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.770133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:27.770664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4792fa-61ad-46b1-8746-bbc96a15de99 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.771004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.771887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.772172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] PATH_INFO: `/v3/users/2992d6410c4b449b9a9d0800941bc1b1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.773538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2992d6410c4b449b9a9d0800941bc1b1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:27.776311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:27.821234 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2253/4499] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:27 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:58:27.873048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2992d6410c4b449b9a9d0800941bc1b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:27.874271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2992d6410c4b449b9a9d0800941bc1b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:27.885054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2992d6410c4b449b9a9d0800941bc1b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:27.886317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2992d6410c4b449b9a9d0800941bc1b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:27.898077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2992d6410c4b449b9a9d0800941bc1b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:27.953075 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2247/4500] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:27 2021] DELETE /identity/v3/users/2992d6410c4b449b9a9d0800941bc1b1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:27.955052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0aa3b-d494-4721-8240-dc34681d2015 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:27.955572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0aa3b-d494-4721-8240-dc34681d2015 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:27.956077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0aa3b-d494-4721-8240-dc34681d2015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:27.992155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6dd0aa3b-d494-4721-8240-dc34681d2015 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:27.993514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6dd0aa3b-d494-4721-8240-dc34681d2015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:28.094379 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2254/4501] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:28.125565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:28.127624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:28.233874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c12ef-67cf-4aa5-b54c-fc5423c234c3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:28.241882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed8966-dba7-4211-9c10-2d5f89105d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:28.243122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8966-dba7-4211-9c10-2d5f89105d74 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:28.243883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8966-dba7-4211-9c10-2d5f89105d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:28.244290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed8966-dba7-4211-9c10-2d5f89105d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:28.257962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed8966-dba7-4211-9c10-2d5f89105d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:28.259828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed8966-dba7-4211-9c10-2d5f89105d74 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:28.272638 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2248/4502] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:29.116810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0aa3b-d494-4721-8240-dc34681d2015 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:29.118569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6dd0aa3b-d494-4721-8240-dc34681d2015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:29.133679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0aa3b-d494-4721-8240-dc34681d2015 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:29.138842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:29.139835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:29.140181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:29.140465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] PATH_INFO: `/v3/projects/bbf50009a3f54b5194229922fb73155c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:29.141684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf50009a3f54b5194229922fb73155c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:29.143933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:29.195053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf50009a3f54b5194229922fb73155c', 'request_id': 'req-520c302e-6b27-42c8-879b-f12b9707b619'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:29.207076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf50009a3f54b5194229922fb73155c', 'request_id': 'req-520c302e-6b27-42c8-879b-f12b9707b619'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:29.217446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf50009a3f54b5194229922fb73155c', 'request_id': 'req-520c302e-6b27-42c8-879b-f12b9707b619'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:29.231101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] The token cache is being invalidate because project bbf50009a3f54b5194229922fb73155c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:29.232525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:29.233536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-520c302e-6b27-42c8-879b-f12b9707b619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:29.236297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2255/4503] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:29 2021] DELETE /identity/v3/projects/bbf50009a3f54b5194229922fb73155c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:29.242815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6f84f-b8de-444b-a2e8-838408f9e9f2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:29.243363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6f84f-b8de-444b-a2e8-838408f9e9f2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:29.243936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6f84f-b8de-444b-a2e8-838408f9e9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:29.265547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-edf6f84f-b8de-444b-a2e8-838408f9e9f2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:29.268255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-edf6f84f-b8de-444b-a2e8-838408f9e9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:29.337112 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2249/4504] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:29.346474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de213ee-867e-4832-bf60-09059c5c36be None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:29.346772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de213ee-867e-4832-bf60-09059c5c36be None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:29.347055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de213ee-867e-4832-bf60-09059c5c36be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:29.367625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4de213ee-867e-4832-bf60-09059c5c36be None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:29.369127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4de213ee-867e-4832-bf60-09059c5c36be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:29.382470 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2256/4505] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:29.386660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6f84f-b8de-444b-a2e8-838408f9e9f2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:29.400326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6f84f-b8de-444b-a2e8-838408f9e9f2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:29.405769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d782a-ce75-4313-bf47-f0d6ffd84ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:29.406841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d782a-ce75-4313-bf47-f0d6ffd84ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:29.408032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d782a-ce75-4313-bf47-f0d6ffd84ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:29.408948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d782a-ce75-4313-bf47-f0d6ffd84ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:29.410180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d782a-ce75-4313-bf47-f0d6ffd84ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:29.410701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d782a-ce75-4313-bf47-f0d6ffd84ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:29.414766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d782a-ce75-4313-bf47-f0d6ffd84ef5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:29.429941 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2250/4506] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:29.435648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de213ee-867e-4832-bf60-09059c5c36be None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:29.462013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de213ee-867e-4832-bf60-09059c5c36be None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:29.470644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763daeb-3963-4322-a056-83543befe996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:29.472183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763daeb-3963-4322-a056-83543befe996 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:29.473332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763daeb-3963-4322-a056-83543befe996 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:29.474007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763daeb-3963-4322-a056-83543befe996 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:29.476033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763daeb-3963-4322-a056-83543befe996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:29.504812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763daeb-3963-4322-a056-83543befe996 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:29.554243 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2257/4507] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:29 2021] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:29.558732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d782a-ce75-4313-bf47-f0d6ffd84ef5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:29.579100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d782a-ce75-4313-bf47-f0d6ffd84ef5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:29.652722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4e4f-ed82-4715-926e-88cfe8f54568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:29.653626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4e4f-ed82-4715-926e-88cfe8f54568 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:29.653959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4e4f-ed82-4715-926e-88cfe8f54568 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:29.654239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4e4f-ed82-4715-926e-88cfe8f54568 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:29.655013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f4e4f-ed82-4715-926e-88cfe8f54568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:29.657050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f4e4f-ed82-4715-926e-88cfe8f54568 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:29.708113 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2251/4508] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:29 2021] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:29.712964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763daeb-3963-4322-a056-83543befe996 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:29.730354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763daeb-3963-4322-a056-83543befe996 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:29.737741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97498ba-a041-42ea-866a-607847b32912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:29.738801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97498ba-a041-42ea-866a-607847b32912 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:29.739608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97498ba-a041-42ea-866a-607847b32912 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:29.740123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97498ba-a041-42ea-866a-607847b32912 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:29.741618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97498ba-a041-42ea-866a-607847b32912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:29.744482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97498ba-a041-42ea-866a-607847b32912 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:29.768755 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2258/4509] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:29 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:29.773941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4e4f-ed82-4715-926e-88cfe8f54568 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:29.783825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4e4f-ed82-4715-926e-88cfe8f54568 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:29.788970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519363c-84a1-4c1f-88f9-6494a704a4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:29.789643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519363c-84a1-4c1f-88f9-6494a704a4fd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:29.790608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519363c-84a1-4c1f-88f9-6494a704a4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:29.790608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519363c-84a1-4c1f-88f9-6494a704a4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:29.790923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519363c-84a1-4c1f-88f9-6494a704a4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:29.792760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519363c-84a1-4c1f-88f9-6494a704a4fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:29.809972 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2252/4510] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:29 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:29.814195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97498ba-a041-42ea-866a-607847b32912 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:29.829686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97498ba-a041-42ea-866a-607847b32912 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:29.839936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263a426-171c-4e08-a5f0-67f12308c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:29.840843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a426-171c-4e08-a5f0-67f12308c036 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:29.841904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a426-171c-4e08-a5f0-67f12308c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:29.841904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a426-171c-4e08-a5f0-67f12308c036 admin admin] PATH_INFO: `/v3/projects/2f4a29fd278a4152b2afb8dace47ef8c/users/f09b0874c9ce49a49a553cf6d69aab0b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:29.873810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263a426-171c-4e08-a5f0-67f12308c036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4a29fd278a4152b2afb8dace47ef8c, user_id=f09b0874c9ce49a49a553cf6d69aab0b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:29.877211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263a426-171c-4e08-a5f0-67f12308c036 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:29.910154 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2259/4511] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:29 2021] PUT /identity/v3/projects/2f4a29fd278a4152b2afb8dace47ef8c/users/f09b0874c9ce49a49a553cf6d69aab0b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:29.922245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060102b-9029-4771-9202-8e7f4a625a02 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:29.922476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060102b-9029-4771-9202-8e7f4a625a02 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:29.922686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060102b-9029-4771-9202-8e7f4a625a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:29.965988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0060102b-9029-4771-9202-8e7f4a625a02 None None] MFA Rules not processed for user `f09b0874c9ce49a49a553cf6d69aab0b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:29.968273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0060102b-9029-4771-9202-8e7f4a625a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:30.067355 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2253/4512] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:29 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:30.079860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263a426-171c-4e08-a5f0-67f12308c036 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:30.081831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1263a426-171c-4e08-a5f0-67f12308c036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:30.172373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263a426-171c-4e08-a5f0-67f12308c036 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:30.179301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b67dc-00b8-48c5-83ed-34de7aa03636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:30.180254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b67dc-00b8-48c5-83ed-34de7aa03636 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:30.180254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b67dc-00b8-48c5-83ed-34de7aa03636 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:30.180530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b67dc-00b8-48c5-83ed-34de7aa03636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:30.190318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b67dc-00b8-48c5-83ed-34de7aa03636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:30.192085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b67dc-00b8-48c5-83ed-34de7aa03636 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:30.202548 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2260/4513] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:30 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:30.246718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060102b-9029-4771-9202-8e7f4a625a02 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:30.317402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060102b-9029-4771-9202-8e7f4a625a02 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:30.325018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:30.325972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:30.326678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:30.327144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] PATH_INFO: `/v3/users/f09b0874c9ce49a49a553cf6d69aab0b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:30.328694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09b0874c9ce49a49a553cf6d69aab0b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:30.333644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:30.416379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09b0874c9ce49a49a553cf6d69aab0b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:30.417131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09b0874c9ce49a49a553cf6d69aab0b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:30.436555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09b0874c9ce49a49a553cf6d69aab0b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:30.437700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09b0874c9ce49a49a553cf6d69aab0b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:30.452278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09b0874c9ce49a49a553cf6d69aab0b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:30.488447 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2254/4514] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:30 2021] DELETE /identity/v3/users/f09b0874c9ce49a49a553cf6d69aab0b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:30.492755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e31ea4-48aa-4b2c-8436-e907bbe27907 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:30.493055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e31ea4-48aa-4b2c-8436-e907bbe27907 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:30.493316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e31ea4-48aa-4b2c-8436-e907bbe27907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:30.518098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-57e31ea4-48aa-4b2c-8436-e907bbe27907 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:30.519542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-57e31ea4-48aa-4b2c-8436-e907bbe27907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:30.631672 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2261/4515] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:30.639944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:30.641792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:30.716829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99ec8f-05c4-4ca2-8eee-39fc47c0aac4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:30.720972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff5595-9afa-46f4-9d75-db22d77d95ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:30.721751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff5595-9afa-46f4-9d75-db22d77d95ca service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:30.722843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff5595-9afa-46f4-9d75-db22d77d95ca service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:30.723370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff5595-9afa-46f4-9d75-db22d77d95ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:30.744811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff5595-9afa-46f4-9d75-db22d77d95ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:30.746302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff5595-9afa-46f4-9d75-db22d77d95ca service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:30.761695 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2255/4516] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:31.359175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e31ea4-48aa-4b2c-8436-e907bbe27907 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:31.363245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-57e31ea4-48aa-4b2c-8436-e907bbe27907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:31.415138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e31ea4-48aa-4b2c-8436-e907bbe27907 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:31.455922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:31.456487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:31.456814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:31.457093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] PATH_INFO: `/v3/projects/2f4a29fd278a4152b2afb8dace47ef8c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:31.459315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4a29fd278a4152b2afb8dace47ef8c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:31.461221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:31.573057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4a29fd278a4152b2afb8dace47ef8c', 'request_id': 'req-f0e75c86-5f8a-45f3-a084-72e7a4f30702'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:31.588217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4a29fd278a4152b2afb8dace47ef8c', 'request_id': 'req-f0e75c86-5f8a-45f3-a084-72e7a4f30702'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:31.600719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4a29fd278a4152b2afb8dace47ef8c', 'request_id': 'req-f0e75c86-5f8a-45f3-a084-72e7a4f30702'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:31.615705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] The token cache is being invalidate because project 2f4a29fd278a4152b2afb8dace47ef8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:31.615958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:31.616752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f0e75c86-5f8a-45f3-a084-72e7a4f30702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:31.618328 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2262/4517] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:31 2021] DELETE /identity/v3/projects/2f4a29fd278a4152b2afb8dace47ef8c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:31.624979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad04e0-5a8b-477e-8502-ef441bb43b59 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:31.625438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad04e0-5a8b-477e-8502-ef441bb43b59 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:31.625544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad04e0-5a8b-477e-8502-ef441bb43b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:31.647797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b4ad04e0-5a8b-477e-8502-ef441bb43b59 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:31.649903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b4ad04e0-5a8b-477e-8502-ef441bb43b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:31.751800 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2256/4518] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:31.761024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7380d-64ea-462d-beeb-edb9933a27b2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:31.761321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7380d-64ea-462d-beeb-edb9933a27b2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:31.761601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7380d-64ea-462d-beeb-edb9933a27b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:31.822676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fdb7380d-64ea-462d-beeb-edb9933a27b2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:31.826163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fdb7380d-64ea-462d-beeb-edb9933a27b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:31.856322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad04e0-5a8b-477e-8502-ef441bb43b59 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:31.863949 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2263/4519] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:31.880361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad04e0-5a8b-477e-8502-ef441bb43b59 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:31.890772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89c1ce-e9fc-4c39-adbb-b024848a48c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:31.891564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c1ce-e9fc-4c39-adbb-b024848a48c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:31.891931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c1ce-e9fc-4c39-adbb-b024848a48c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:31.892284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c1ce-e9fc-4c39-adbb-b024848a48c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:31.893177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89c1ce-e9fc-4c39-adbb-b024848a48c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:31.893587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89c1ce-e9fc-4c39-adbb-b024848a48c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:31.895485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89c1ce-e9fc-4c39-adbb-b024848a48c6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:31.919300 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2257/4520] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:31.920961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7380d-64ea-462d-beeb-edb9933a27b2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:31.936928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7380d-64ea-462d-beeb-edb9933a27b2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:31.948003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b8910-2d92-430e-a283-6c10f0c6bc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:31.949009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b8910-2d92-430e-a283-6c10f0c6bc94 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:31.949498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b8910-2d92-430e-a283-6c10f0c6bc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:31.949951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b8910-2d92-430e-a283-6c10f0c6bc94 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:31.950964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b8910-2d92-430e-a283-6c10f0c6bc94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:31.955920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b8910-2d92-430e-a283-6c10f0c6bc94 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:32.015598 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2264/4521] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:31 2021] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:32.016779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89c1ce-e9fc-4c39-adbb-b024848a48c6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:32.031473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89c1ce-e9fc-4c39-adbb-b024848a48c6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:32.146822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b982f1-83e6-4113-9031-36ac8f284daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:32.147612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b982f1-83e6-4113-9031-36ac8f284daa admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:32.148251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b982f1-83e6-4113-9031-36ac8f284daa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:32.148378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b982f1-83e6-4113-9031-36ac8f284daa admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:32.149044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b982f1-83e6-4113-9031-36ac8f284daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:32.151001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b982f1-83e6-4113-9031-36ac8f284daa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:32.193430 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2258/4522] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:32 2021] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:32.196161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b8910-2d92-430e-a283-6c10f0c6bc94 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:32.207673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b8910-2d92-430e-a283-6c10f0c6bc94 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:32.214586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaf9a8-9418-4442-ae60-3b901694e2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:32.215365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaf9a8-9418-4442-ae60-3b901694e2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:32.215654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaf9a8-9418-4442-ae60-3b901694e2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:32.215932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaf9a8-9418-4442-ae60-3b901694e2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:32.217161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaf9a8-9418-4442-ae60-3b901694e2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:32.218796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaf9a8-9418-4442-ae60-3b901694e2a4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:32.239082 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2265/4523] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:32 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:32.241347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b982f1-83e6-4113-9031-36ac8f284daa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:32.256483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b982f1-83e6-4113-9031-36ac8f284daa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:32.262078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfb8e1-ed7c-48e9-91b7-a1fd81acbd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:32.262888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb8e1-ed7c-48e9-91b7-a1fd81acbd7b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:32.263184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb8e1-ed7c-48e9-91b7-a1fd81acbd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:32.264307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb8e1-ed7c-48e9-91b7-a1fd81acbd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:32.264307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfb8e1-ed7c-48e9-91b7-a1fd81acbd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:32.266038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfb8e1-ed7c-48e9-91b7-a1fd81acbd7b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:32.280754 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2259/4524] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:32 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:32.282422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaf9a8-9418-4442-ae60-3b901694e2a4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:32.296943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaf9a8-9418-4442-ae60-3b901694e2a4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:32.315501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b9cbd-cf9d-4fff-a879-cc8f13907f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:32.316466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b9cbd-cf9d-4fff-a879-cc8f13907f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:32.316768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b9cbd-cf9d-4fff-a879-cc8f13907f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:32.317106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b9cbd-cf9d-4fff-a879-cc8f13907f31 admin admin] PATH_INFO: `/v3/projects/8ae18f7a728e418783081b12ecbd54ff/users/7467e399d81b49ef94b329c6c1155845/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:32.348192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b9cbd-cf9d-4fff-a879-cc8f13907f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae18f7a728e418783081b12ecbd54ff, user_id=7467e399d81b49ef94b329c6c1155845, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:32.354311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b9cbd-cf9d-4fff-a879-cc8f13907f31 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:32.362088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfb8e1-ed7c-48e9-91b7-a1fd81acbd7b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:32.364708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fedfb8e1-ed7c-48e9-91b7-a1fd81acbd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:32.378165 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2266/4525] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:32 2021] PUT /identity/v3/projects/8ae18f7a728e418783081b12ecbd54ff/users/7467e399d81b49ef94b329c6c1155845/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:32.391604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280e07e-97f5-4a1d-b68d-89f473371422 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:32.392178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280e07e-97f5-4a1d-b68d-89f473371422 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:32.393813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280e07e-97f5-4a1d-b68d-89f473371422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:32.465497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9280e07e-97f5-4a1d-b68d-89f473371422 None None] MFA Rules not processed for user `7467e399d81b49ef94b329c6c1155845`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:32.467882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9280e07e-97f5-4a1d-b68d-89f473371422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:32.556706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfb8e1-ed7c-48e9-91b7-a1fd81acbd7b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:32.629754 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2267/4526] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:32 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:32.635315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280e07e-97f5-4a1d-b68d-89f473371422 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:32.648363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d8c76-02f1-4afb-988c-66c19a49aacf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:32.649944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d8c76-02f1-4afb-988c-66c19a49aacf service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:32.650420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d8c76-02f1-4afb-988c-66c19a49aacf service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:32.650850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d8c76-02f1-4afb-988c-66c19a49aacf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:32.654768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d69d8c76-02f1-4afb-988c-66c19a49aacf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:32.671397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d8c76-02f1-4afb-988c-66c19a49aacf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:32.673274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d8c76-02f1-4afb-988c-66c19a49aacf service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:32.708505 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2260/4527] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:32 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:32.750830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280e07e-97f5-4a1d-b68d-89f473371422 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:32.756427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f0f7-b6fe-4d80-ae3d-59016a6b5747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:32.757111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f0f7-b6fe-4d80-ae3d-59016a6b5747 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:32.757395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f0f7-b6fe-4d80-ae3d-59016a6b5747 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:32.757672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f0f7-b6fe-4d80-ae3d-59016a6b5747 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:32.758395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371f0f7-b6fe-4d80-ae3d-59016a6b5747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:32.760998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371f0f7-b6fe-4d80-ae3d-59016a6b5747 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:32.798766 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2268/4528] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:32 2021] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:32.803490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d8c76-02f1-4afb-988c-66c19a49aacf service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:32.818402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d8c76-02f1-4afb-988c-66c19a49aacf service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:32.885301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca71a-949b-4143-92b9-23e6c246065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:32.886458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca71a-949b-4143-92b9-23e6c246065f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:32.887401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca71a-949b-4143-92b9-23e6c246065f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:32.887503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca71a-949b-4143-92b9-23e6c246065f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:32.888254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ca71a-949b-4143-92b9-23e6c246065f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:32.890873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ca71a-949b-4143-92b9-23e6c246065f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:32.917872 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2261/4529] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:32 2021] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:32.921693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f0f7-b6fe-4d80-ae3d-59016a6b5747 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:32.935063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f0f7-b6fe-4d80-ae3d-59016a6b5747 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:32.941304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f112f5e-ad44-4cf3-bb48-993c1a8a066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:32.942548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f112f5e-ad44-4cf3-bb48-993c1a8a066d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:32.943212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f112f5e-ad44-4cf3-bb48-993c1a8a066d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:32.943517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f112f5e-ad44-4cf3-bb48-993c1a8a066d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:32.945072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f112f5e-ad44-4cf3-bb48-993c1a8a066d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:32.946709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f112f5e-ad44-4cf3-bb48-993c1a8a066d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:32.963302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2269/4530] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:32 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:32.966684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca71a-949b-4143-92b9-23e6c246065f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:32.980598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca71a-949b-4143-92b9-23e6c246065f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:32.986686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8de39-8ed6-4b5f-9ca8-8623ae273d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:32.987825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8de39-8ed6-4b5f-9ca8-8623ae273d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:32.988113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8de39-8ed6-4b5f-9ca8-8623ae273d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:32.988387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8de39-8ed6-4b5f-9ca8-8623ae273d40 admin admin] PATH_INFO: `/v3/projects/38dbc07239c34ad6ad52bb5961c714d3/users/5e8e903e471c4c74854934bb35f0e19e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:33.016063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8de39-8ed6-4b5f-9ca8-8623ae273d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38dbc07239c34ad6ad52bb5961c714d3, user_id=5e8e903e471c4c74854934bb35f0e19e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:33.024191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8de39-8ed6-4b5f-9ca8-8623ae273d40 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:33.066274 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2262/4531] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:32 2021] PUT /identity/v3/projects/38dbc07239c34ad6ad52bb5961c714d3/users/5e8e903e471c4c74854934bb35f0e19e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:33.070385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f112f5e-ad44-4cf3-bb48-993c1a8a066d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:33.100514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f112f5e-ad44-4cf3-bb48-993c1a8a066d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:33.200825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14481835-0e29-4195-9a20-de89eb831f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:33.201529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481835-0e29-4195-9a20-de89eb831f7c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:33.201880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481835-0e29-4195-9a20-de89eb831f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:33.202228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14481835-0e29-4195-9a20-de89eb831f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:33.203800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14481835-0e29-4195-9a20-de89eb831f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:33.205566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14481835-0e29-4195-9a20-de89eb831f7c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:33.224102 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2270/4532] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:33 2021] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:33.228403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8de39-8ed6-4b5f-9ca8-8623ae273d40 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:33.243389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8de39-8ed6-4b5f-9ca8-8623ae273d40 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:33.273709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a6bd2-51ec-427c-96d3-08f5598b6273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:33.274522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a6bd2-51ec-427c-96d3-08f5598b6273 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:33.274806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a6bd2-51ec-427c-96d3-08f5598b6273 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:33.275075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a6bd2-51ec-427c-96d3-08f5598b6273 admin admin] PATH_INFO: `/v3/projects/38dbc07239c34ad6ad52bb5961c714d3/users/5e8e903e471c4c74854934bb35f0e19e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:33.277993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a6bd2-51ec-427c-96d3-08f5598b6273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38dbc07239c34ad6ad52bb5961c714d3, user_id=5e8e903e471c4c74854934bb35f0e19e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:33.280689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a6bd2-51ec-427c-96d3-08f5598b6273 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:33.315566 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2263/4533] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:33 2021] PUT /identity/v3/projects/38dbc07239c34ad6ad52bb5961c714d3/users/5e8e903e471c4c74854934bb35f0e19e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:33.317562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aacc9-3d23-4e8b-9686-c8774f204ddb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:33.323071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aacc9-3d23-4e8b-9686-c8774f204ddb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:33.323681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aacc9-3d23-4e8b-9686-c8774f204ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:33.382121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-601aacc9-3d23-4e8b-9686-c8774f204ddb None None] MFA Rules not processed for user `5e8e903e471c4c74854934bb35f0e19e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:33.384801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-601aacc9-3d23-4e8b-9686-c8774f204ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:33.582701 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2271/4534] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:33 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:33.587618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a6bd2-51ec-427c-96d3-08f5598b6273 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:33.602078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a6bd2-51ec-427c-96d3-08f5598b6273 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:33.608257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9469d9c-7ebb-48f0-bb82-c034a986cbac tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:33.609318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9469d9c-7ebb-48f0-bb82-c034a986cbac tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:33.611963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9469d9c-7ebb-48f0-bb82-c034a986cbac tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:33.612440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9469d9c-7ebb-48f0-bb82-c034a986cbac tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:33.613785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9469d9c-7ebb-48f0-bb82-c034a986cbac tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:33.616159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9469d9c-7ebb-48f0-bb82-c034a986cbac tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:33.654398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601aacc9-3d23-4e8b-9686-c8774f204ddb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:33.663693 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2264/4535] 10.222.0.21 () {60 vars in 1149 bytes} [Sat Nov 27 20:58:33 2021] POST /identity/v3/domains => generated 276 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:33.667145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601aacc9-3d23-4e8b-9686-c8774f204ddb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:33.831617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bda95-d9bb-4fcf-b6e4-d3d6ce317a3d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:33.832376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bda95-d9bb-4fcf-b6e4-d3d6ce317a3d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:33.832690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bda95-d9bb-4fcf-b6e4-d3d6ce317a3d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:33.833080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bda95-d9bb-4fcf-b6e4-d3d6ce317a3d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:33.834515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bda95-d9bb-4fcf-b6e4-d3d6ce317a3d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:33.836282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bda95-d9bb-4fcf-b6e4-d3d6ce317a3d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:33.878076 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2272/4536] 10.222.0.21 () {60 vars in 1149 bytes} [Sat Nov 27 20:58:33 2021] POST /identity/v3/domains => generated 276 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:33.882024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9469d9c-7ebb-48f0-bb82-c034a986cbac tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:33.900206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9469d9c-7ebb-48f0-bb82-c034a986cbac tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:34.019230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a7e5d-8234-4a19-a955-7155b852be17 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:34.019940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a7e5d-8234-4a19-a955-7155b852be17 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:34.020227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a7e5d-8234-4a19-a955-7155b852be17 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:34.020677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a7e5d-8234-4a19-a955-7155b852be17 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:34.021729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a7e5d-8234-4a19-a955-7155b852be17 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:34.023393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a7e5d-8234-4a19-a955-7155b852be17 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:34.050782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bda95-d9bb-4fcf-b6e4-d3d6ce317a3d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:34.057644 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2265/4537] 10.222.0.21 () {60 vars in 1149 bytes} [Sat Nov 27 20:58:33 2021] POST /identity/v3/domains => generated 278 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:34.064970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bda95-d9bb-4fcf-b6e4-d3d6ce317a3d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:34.214513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf26e3-331c-45f0-af80-8301a05ef66d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:34.215341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf26e3-331c-45f0-af80-8301a05ef66d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:34.215635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf26e3-331c-45f0-af80-8301a05ef66d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:34.215998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf26e3-331c-45f0-af80-8301a05ef66d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:34.216778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf26e3-331c-45f0-af80-8301a05ef66d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:34.219513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf26e3-331c-45f0-af80-8301a05ef66d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:34.265899 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2273/4538] 10.222.0.21 () {60 vars in 1149 bytes} [Sat Nov 27 20:58:34 2021] POST /identity/v3/domains => generated 280 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:34.270694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a7e5d-8234-4a19-a955-7155b852be17 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:34.287530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a7e5d-8234-4a19-a955-7155b852be17 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:34.409683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:34.412134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:34.412432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:34.412760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/02d98efb65904b80941e76b8eb9ae009` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:34.437111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=02d98efb65904b80941e76b8eb9ae009)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:34.448659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:34.494403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '02d98efb65904b80941e76b8eb9ae009'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:34.508914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '02d98efb65904b80941e76b8eb9ae009'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:34.612927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d98efb65904b80941e76b8eb9ae009', 'request_id': 'req-647dfe3f-8c17-49f7-937e-812e047085d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:34.623849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d98efb65904b80941e76b8eb9ae009', 'request_id': 'req-647dfe3f-8c17-49f7-937e-812e047085d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:34.639469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d98efb65904b80941e76b8eb9ae009', 'request_id': 'req-647dfe3f-8c17-49f7-937e-812e047085d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:34.657519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] The token cache is being invalidate because project 02d98efb65904b80941e76b8eb9ae009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:34.658182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:34.659578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:34.670417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '02d98efb65904b80941e76b8eb9ae009', 'request_id': 'req-647dfe3f-8c17-49f7-937e-812e047085d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:34.671275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '02d98efb65904b80941e76b8eb9ae009', 'request_id': 'req-647dfe3f-8c17-49f7-937e-812e047085d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:34.677874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '02d98efb65904b80941e76b8eb9ae009', 'request_id': 'req-647dfe3f-8c17-49f7-937e-812e047085d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:34.703453 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2266/4539] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:58:34 2021] DELETE /identity/v3/domains/02d98efb65904b80941e76b8eb9ae009 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:34.709107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf26e3-331c-45f0-af80-8301a05ef66d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:34.711442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7bcf26e3-331c-45f0-af80-8301a05ef66d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:34.735854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf26e3-331c-45f0-af80-8301a05ef66d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:34.812847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84d5e3-8d02-435d-85e1-c2f80472c9a2 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:34.814135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84d5e3-8d02-435d-85e1-c2f80472c9a2 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:34.814685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84d5e3-8d02-435d-85e1-c2f80472c9a2 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:34.815497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84d5e3-8d02-435d-85e1-c2f80472c9a2 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:34.817512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84d5e3-8d02-435d-85e1-c2f80472c9a2 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:34.820096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84d5e3-8d02-435d-85e1-c2f80472c9a2 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:34.839859 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2274/4540] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:58:34 2021] POST /identity/v3/domains => generated 248 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:34.843741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:34.859050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dfe3f-8c17-49f7-937e-812e047085d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:34.934899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:34.935812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:34.936091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:34.936362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/de85aa4a945b43f584a075649ee22f25` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:34.950875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=de85aa4a945b43f584a075649ee22f25)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:34.952094 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:34.952094 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:58:34.952094 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:58:34.953167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:34.987808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'de85aa4a945b43f584a075649ee22f25'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:34.989625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'de85aa4a945b43f584a075649ee22f25'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.039466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'de85aa4a945b43f584a075649ee22f25'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.040380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'de85aa4a945b43f584a075649ee22f25'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.045919 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2267/4541] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:58:34 2021] PATCH /identity/v3/domains/de85aa4a945b43f584a075649ee22f25 => generated 249 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:35.047419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84d5e3-8d02-435d-85e1-c2f80472c9a2 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:35.049279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ee84d5e3-8d02-435d-85e1-c2f80472c9a2 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:35.062642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84d5e3-8d02-435d-85e1-c2f80472c9a2 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:35.143401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:35.145204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:35.145588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:35.148054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/de85aa4a945b43f584a075649ee22f25` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:35.167847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=de85aa4a945b43f584a075649ee22f25)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:35.169831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:35.204559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'de85aa4a945b43f584a075649ee22f25'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.245420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'de85aa4a945b43f584a075649ee22f25'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.311038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de85aa4a945b43f584a075649ee22f25', 'request_id': 'req-0857edcb-58de-4742-863d-ec21fadbe6b1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.324580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de85aa4a945b43f584a075649ee22f25', 'request_id': 'req-0857edcb-58de-4742-863d-ec21fadbe6b1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.349443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de85aa4a945b43f584a075649ee22f25', 'request_id': 'req-0857edcb-58de-4742-863d-ec21fadbe6b1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.383015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] The token cache is being invalidate because project de85aa4a945b43f584a075649ee22f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:35.383616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.384572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.396322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'de85aa4a945b43f584a075649ee22f25', 'request_id': 'req-0857edcb-58de-4742-863d-ec21fadbe6b1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.397293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'de85aa4a945b43f584a075649ee22f25', 'request_id': 'req-0857edcb-58de-4742-863d-ec21fadbe6b1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.398073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'de85aa4a945b43f584a075649ee22f25', 'request_id': 'req-0857edcb-58de-4742-863d-ec21fadbe6b1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.416967 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2275/4542] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:58:35 2021] DELETE /identity/v3/domains/de85aa4a945b43f584a075649ee22f25 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:35.418126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:35.436675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e697eb-307f-4b37-a9c3-46a9db4872df tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:35.536907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e1fc3-5f94-4002-94ff-88677c254005 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:35.537729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e1fc3-5f94-4002-94ff-88677c254005 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:35.538088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e1fc3-5f94-4002-94ff-88677c254005 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:35.539506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e1fc3-5f94-4002-94ff-88677c254005 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:35.540384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e1fc3-5f94-4002-94ff-88677c254005 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:35.542902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e1fc3-5f94-4002-94ff-88677c254005 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:35.572593 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2268/4543] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:58:35 2021] POST /identity/v3/domains => generated 277 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:35.576369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:35.577818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:35.590973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857edcb-58de-4742-863d-ec21fadbe6b1 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:35.667293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:35.668045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:35.668426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:35.668796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/89f1f4bef74b4c7897f22aab95d7e72e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:35.685771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=89f1f4bef74b4c7897f22aab95d7e72e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:35.690023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:35.714774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.716436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.754131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.756933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:35.760919 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2276/4544] 10.222.0.21 () {60 vars in 1249 bytes} [Sat Nov 27 20:58:35 2021] PATCH /identity/v3/domains/89f1f4bef74b4c7897f22aab95d7e72e => generated 278 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:35.767545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e1fc3-5f94-4002-94ff-88677c254005 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:35.771342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ff5e1fc3-5f94-4002-94ff-88677c254005 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:35.798994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e1fc3-5f94-4002-94ff-88677c254005 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:35.922051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7838d-d657-4025-9f58-e970c99053cc tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:35.923878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7838d-d657-4025-9f58-e970c99053cc tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:35.924745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7838d-d657-4025-9f58-e970c99053cc tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:35.925136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7838d-d657-4025-9f58-e970c99053cc tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/89f1f4bef74b4c7897f22aab95d7e72e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:35.949065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7838d-d657-4025-9f58-e970c99053cc tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=89f1f4bef74b4c7897f22aab95d7e72e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:35.956581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7838d-d657-4025-9f58-e970c99053cc tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:35.964655 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2269/4545] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:58:35 2021] GET /identity/v3/domains/89f1f4bef74b4c7897f22aab95d7e72e => generated 278 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:35.965448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:35.985629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8178838-121f-4d9a-bc3c-98053ba90103 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:35.993549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:35.994992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:35.995556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:35.996054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/89f1f4bef74b4c7897f22aab95d7e72e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:35.998813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=89f1f4bef74b4c7897f22aab95d7e72e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:36.002370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:36.041870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:36.066657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:36.161158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e', 'request_id': 'req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:36.180968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e', 'request_id': 'req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:36.197323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e', 'request_id': 'req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:36.220121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] The token cache is being invalidate because project 89f1f4bef74b4c7897f22aab95d7e72e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:36.220814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:36.221890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:36.236961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e', 'request_id': 'req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:36.238166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e', 'request_id': 'req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:36.239188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '89f1f4bef74b4c7897f22aab95d7e72e', 'request_id': 'req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:36.263068 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2277/4546] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:58:35 2021] DELETE /identity/v3/domains/89f1f4bef74b4c7897f22aab95d7e72e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:36.265040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7838d-d657-4025-9f58-e970c99053cc tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:36.267445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-62f7838d-d657-4025-9f58-e970c99053cc tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:36.305025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7838d-d657-4025-9f58-e970c99053cc tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:36.426208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd3e01-201f-43db-b91c-74b0bef81646 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:36.427020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3e01-201f-43db-b91c-74b0bef81646 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:36.427515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3e01-201f-43db-b91c-74b0bef81646 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:36.427864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd3e01-201f-43db-b91c-74b0bef81646 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:36.428895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd3e01-201f-43db-b91c-74b0bef81646 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:36.431918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd3e01-201f-43db-b91c-74b0bef81646 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:36.464295 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2270/4547] 10.222.0.21 () {58 vars in 1127 bytes} [Sat Nov 27 20:58:36 2021] GET /identity/v3/domains => generated 1348 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:36.468191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:36.483620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5303bd7-45cf-494b-84e7-2c2871dcc2c3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:36.489549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c39f31-e15b-427e-b9d9-08d34a1c06ea tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:36.491648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c39f31-e15b-427e-b9d9-08d34a1c06ea tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:36.492036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c39f31-e15b-427e-b9d9-08d34a1c06ea tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:36.492700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c39f31-e15b-427e-b9d9-08d34a1c06ea tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/89f1f4bef74b4c7897f22aab95d7e72e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:36.502802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c39f31-e15b-427e-b9d9-08d34a1c06ea tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:58:36.516916 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-37c39f31-e15b-427e-b9d9-08d34a1c06ea tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Could not find domain: 89f1f4bef74b4c7897f22aab95d7e72e.: keystone.exception.DomainNotFound: Could not find domain: 89f1f4bef74b4c7897f22aab95d7e72e. Nov 27 20:58:36.523575 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2278/4548] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:58:36 2021] PATCH /identity/v3/domains/89f1f4bef74b4c7897f22aab95d7e72e => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:58:36.525331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd3e01-201f-43db-b91c-74b0bef81646 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:36.545822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd3e01-201f-43db-b91c-74b0bef81646 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:36.556242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1601175-0ad1-481b-9f09-5c4cfa2fdbf0 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:36.558012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1601175-0ad1-481b-9f09-5c4cfa2fdbf0 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:36.559175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1601175-0ad1-481b-9f09-5c4cfa2fdbf0 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:36.559922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1601175-0ad1-481b-9f09-5c4cfa2fdbf0 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:36.560960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1601175-0ad1-481b-9f09-5c4cfa2fdbf0 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:36.563129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1601175-0ad1-481b-9f09-5c4cfa2fdbf0 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:36.595351 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2271/4549] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:58:36 2021] POST /identity/v3/domains => generated 277 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:36.597462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c39f31-e15b-427e-b9d9-08d34a1c06ea tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:36.612693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c39f31-e15b-427e-b9d9-08d34a1c06ea tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:36.760913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c17a6-4bb2-4358-955a-5db4f51d49d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:36.761612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c17a6-4bb2-4358-955a-5db4f51d49d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:36.763500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c17a6-4bb2-4358-955a-5db4f51d49d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:36.764678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c17a6-4bb2-4358-955a-5db4f51d49d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:36.765428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c17a6-4bb2-4358-955a-5db4f51d49d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:36.771754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c17a6-4bb2-4358-955a-5db4f51d49d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:36.845949 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2279/4550] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:36 2021] POST /identity/v3/users => generated 348 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:36.847377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1601175-0ad1-481b-9f09-5c4cfa2fdbf0 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:36.863615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1601175-0ad1-481b-9f09-5c4cfa2fdbf0 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:36.875305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2afe7-f706-46d8-b161-83de4c1ea9ba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:36.877798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2afe7-f706-46d8-b161-83de4c1ea9ba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:36.878082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2afe7-f706-46d8-b161-83de4c1ea9ba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:36.879086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2afe7-f706-46d8-b161-83de4c1ea9ba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/groups` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:36.884217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2afe7-f706-46d8-b161-83de4c1ea9ba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:36.886768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2afe7-f706-46d8-b161-83de4c1ea9ba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:36.934447 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2272/4551] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 20:58:36 2021] POST /identity/v3/groups => generated 324 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:36.935640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c17a6-4bb2-4358-955a-5db4f51d49d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:36.958204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c17a6-4bb2-4358-955a-5db4f51d49d3 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:36.965452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aba9db-437e-4db3-a860-5219fef35b21 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:36.966542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aba9db-437e-4db3-a860-5219fef35b21 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:36.966993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aba9db-437e-4db3-a860-5219fef35b21 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:36.967452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aba9db-437e-4db3-a860-5219fef35b21 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/b6d731ff717f49be8569cfe2ba2b7b67` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:36.981722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aba9db-437e-4db3-a860-5219fef35b21 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b6d731ff717f49be8569cfe2ba2b7b67)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:36.983578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aba9db-437e-4db3-a860-5219fef35b21 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:37.025711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-41aba9db-437e-4db3-a860-5219fef35b21 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.026469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-41aba9db-437e-4db3-a860-5219fef35b21 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.061015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-41aba9db-437e-4db3-a860-5219fef35b21 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.062695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-41aba9db-437e-4db3-a860-5219fef35b21 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.066267 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2280/4552] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:58:36 2021] PATCH /identity/v3/domains/b6d731ff717f49be8569cfe2ba2b7b67 => generated 278 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:37.071312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2afe7-f706-46d8-b161-83de4c1ea9ba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:37.073598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ebd2afe7-f706-46d8-b161-83de4c1ea9ba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:37.089157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2afe7-f706-46d8-b161-83de4c1ea9ba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:37.232765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:37.233787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:37.234075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:37.234415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/b6d731ff717f49be8569cfe2ba2b7b67` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:37.262063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b6d731ff717f49be8569cfe2ba2b7b67)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:37.264262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:37.353365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.596628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eaa1a-536b-40c3-8801-ca1f5a8f4a71 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:37.596628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eaa1a-536b-40c3-8801-ca1f5a8f4a71 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:37.596921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eaa1a-536b-40c3-8801-ca1f5a8f4a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:37.630261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e5ee742784487391e9f421cc2cfdb5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.631038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e5ee742784487391e9f421cc2cfdb5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.638284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-166eaa1a-536b-40c3-8801-ca1f5a8f4a71 None None] MFA Rules not processed for user `2bb012478bf740468bba9fa762ac06ca`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:37.640774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-166eaa1a-536b-40c3-8801-ca1f5a8f4a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:37.647029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e5ee742784487391e9f421cc2cfdb5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.648067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e5ee742784487391e9f421cc2cfdb5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.664946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e5ee742784487391e9f421cc2cfdb5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.692690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.743820 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2281/4553] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:37 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:37.788524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67', 'request_id': 'req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.795246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67', 'request_id': 'req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.806815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67', 'request_id': 'req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.822088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] The token cache is being invalidate because project b6d731ff717f49be8569cfe2ba2b7b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:37.822813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.823857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.845613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67', 'request_id': 'req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.848583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67', 'request_id': 'req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.859638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b6d731ff717f49be8569cfe2ba2b7b67', 'request_id': 'req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:37.871703 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2273/4554] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:58:37 2021] DELETE /identity/v3/domains/b6d731ff717f49be8569cfe2ba2b7b67 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:37.876648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eaa1a-536b-40c3-8801-ca1f5a8f4a71 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:37.878457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-166eaa1a-536b-40c3-8801-ca1f5a8f4a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:38.046489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eaa1a-536b-40c3-8801-ca1f5a8f4a71 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:38.169289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6074375-c8f8-45e9-8a54-994c83ad096b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:38.170808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6074375-c8f8-45e9-8a54-994c83ad096b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:38.171336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6074375-c8f8-45e9-8a54-994c83ad096b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:38.172540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6074375-c8f8-45e9-8a54-994c83ad096b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/b6d731ff717f49be8569cfe2ba2b7b67` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:38.184146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6074375-c8f8-45e9-8a54-994c83ad096b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=b6d731ff717f49be8569cfe2ba2b7b67)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:38.187380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6074375-c8f8-45e9-8a54-994c83ad096b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:38.218819 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-d6074375-c8f8-45e9-8a54-994c83ad096b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Could not find domain: b6d731ff717f49be8569cfe2ba2b7b67.: keystone.exception.DomainNotFound: Could not find domain: b6d731ff717f49be8569cfe2ba2b7b67. Nov 27 20:58:38.220997 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2282/4555] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:58:37 2021] GET /identity/v3/domains/b6d731ff717f49be8569cfe2ba2b7b67 => generated 112 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:58:38.225344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:38.227288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:38.256216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f6c5f-3fa3-4fe5-b79d-26036df8c55d tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:38.262784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ee504-7c94-47a5-a85d-83e776742b40 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:38.264958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ee504-7c94-47a5-a85d-83e776742b40 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:38.265572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ee504-7c94-47a5-a85d-83e776742b40 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:38.266752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ee504-7c94-47a5-a85d-83e776742b40 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/users/05e5ee742784487391e9f421cc2cfdb5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:38.283015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ee504-7c94-47a5-a85d-83e776742b40 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:get_user(user_id=05e5ee742784487391e9f421cc2cfdb5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:38.285889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ee504-7c94-47a5-a85d-83e776742b40 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:38.336582 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-141ee504-7c94-47a5-a85d-83e776742b40 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Could not find user: 05e5ee742784487391e9f421cc2cfdb5.: keystone.exception.UserNotFound: Could not find user: 05e5ee742784487391e9f421cc2cfdb5. Nov 27 20:58:38.342449 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2274/4556] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:58:38 2021] GET /identity/v3/users/05e5ee742784487391e9f421cc2cfdb5 => generated 110 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 20:58:38.348674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6074375-c8f8-45e9-8a54-994c83ad096b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:38.366354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6074375-c8f8-45e9-8a54-994c83ad096b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:38.379234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1233c-62ce-40a1-a2c6-3f8eb68d2e82 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:38.380840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1233c-62ce-40a1-a2c6-3f8eb68d2e82 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:38.381130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1233c-62ce-40a1-a2c6-3f8eb68d2e82 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:38.381407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1233c-62ce-40a1-a2c6-3f8eb68d2e82 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/groups/bc9dbb8ca9264c96a8d1d5901b6157e1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:38.398910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1233c-62ce-40a1-a2c6-3f8eb68d2e82 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:get_group(group_id=bc9dbb8ca9264c96a8d1d5901b6157e1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:38.403747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1233c-62ce-40a1-a2c6-3f8eb68d2e82 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:38.450144 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-dac1233c-62ce-40a1-a2c6-3f8eb68d2e82 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Could not find group: bc9dbb8ca9264c96a8d1d5901b6157e1.: keystone.exception.GroupNotFound: Could not find group: bc9dbb8ca9264c96a8d1d5901b6157e1. Nov 27 20:58:38.458614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ee504-7c94-47a5-a85d-83e776742b40 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:38.461401 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2283/4557] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:38 2021] GET /identity/v3/groups/bc9dbb8ca9264c96a8d1d5901b6157e1 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:58:38.476675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ee504-7c94-47a5-a85d-83e776742b40 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:38.489094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fafd6-3e8a-4f7e-b5dc-89ddd2273e72 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:38.490489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fafd6-3e8a-4f7e-b5dc-89ddd2273e72 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:38.490772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fafd6-3e8a-4f7e-b5dc-89ddd2273e72 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:38.491045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fafd6-3e8a-4f7e-b5dc-89ddd2273e72 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/groups/bc9dbb8ca9264c96a8d1d5901b6157e1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:38.509643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fafd6-3e8a-4f7e-b5dc-89ddd2273e72 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:58:38.525097 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-298fafd6-3e8a-4f7e-b5dc-89ddd2273e72 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Could not find group: bc9dbb8ca9264c96a8d1d5901b6157e1.: keystone.exception.GroupNotFound: Could not find group: bc9dbb8ca9264c96a8d1d5901b6157e1. Nov 27 20:58:38.530618 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2275/4558] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:58:38 2021] DELETE /identity/v3/groups/bc9dbb8ca9264c96a8d1d5901b6157e1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 20:58:38.534840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1233c-62ce-40a1-a2c6-3f8eb68d2e82 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:38.552850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1233c-62ce-40a1-a2c6-3f8eb68d2e82 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:38.565950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cd140-c954-4e6a-872d-b8efe6246dee tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:38.566929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd140-c954-4e6a-872d-b8efe6246dee tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:38.569278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd140-c954-4e6a-872d-b8efe6246dee tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:38.569278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cd140-c954-4e6a-872d-b8efe6246dee tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/users/05e5ee742784487391e9f421cc2cfdb5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:38.594550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cd140-c954-4e6a-872d-b8efe6246dee tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:delete_user(user_id=05e5ee742784487391e9f421cc2cfdb5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:38.601390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cd140-c954-4e6a-872d-b8efe6246dee tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:38.645610 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-082cd140-c954-4e6a-872d-b8efe6246dee tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Could not find user: 05e5ee742784487391e9f421cc2cfdb5.: keystone.exception.UserNotFound: Could not find user: 05e5ee742784487391e9f421cc2cfdb5. Nov 27 20:58:38.656194 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2284/4559] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:38 2021] DELETE /identity/v3/users/05e5ee742784487391e9f421cc2cfdb5 => generated 110 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 20:58:38.656863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fafd6-3e8a-4f7e-b5dc-89ddd2273e72 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:38.678622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fafd6-3e8a-4f7e-b5dc-89ddd2273e72 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:38.688559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf112c8a-6a43-44e3-8d6c-6b4d76d0cfa8 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:38.690645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112c8a-6a43-44e3-8d6c-6b4d76d0cfa8 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:38.691090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112c8a-6a43-44e3-8d6c-6b4d76d0cfa8 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:38.691728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf112c8a-6a43-44e3-8d6c-6b4d76d0cfa8 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/b6d731ff717f49be8569cfe2ba2b7b67` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:38.703394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf112c8a-6a43-44e3-8d6c-6b4d76d0cfa8 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:58:38.723244 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-bf112c8a-6a43-44e3-8d6c-6b4d76d0cfa8 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Could not find domain: b6d731ff717f49be8569cfe2ba2b7b67.: keystone.exception.DomainNotFound: Could not find domain: b6d731ff717f49be8569cfe2ba2b7b67. Nov 27 20:58:38.725400 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2276/4560] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:58:38 2021] PATCH /identity/v3/domains/b6d731ff717f49be8569cfe2ba2b7b67 => generated 112 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:58:38.732951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cd140-c954-4e6a-872d-b8efe6246dee tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:38.750560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cd140-c954-4e6a-872d-b8efe6246dee tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:38.763560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa01e3-09f7-493a-8319-05f160f67f5f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:38.764801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa01e3-09f7-493a-8319-05f160f67f5f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:38.765152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa01e3-09f7-493a-8319-05f160f67f5f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:38.765781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa01e3-09f7-493a-8319-05f160f67f5f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:38.766425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa01e3-09f7-493a-8319-05f160f67f5f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:38.768257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa01e3-09f7-493a-8319-05f160f67f5f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:38.797675 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2285/4561] 10.222.0.21 () {58 vars in 1127 bytes} [Sat Nov 27 20:58:38 2021] GET /identity/v3/domains => generated 1348 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:38.802695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf112c8a-6a43-44e3-8d6c-6b4d76d0cfa8 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:38.820345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf112c8a-6a43-44e3-8d6c-6b4d76d0cfa8 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:38.825784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfb336-d7bb-4887-9321-d0a11a7f9aa4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:38.826725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfb336-d7bb-4887-9321-d0a11a7f9aa4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:38.827110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfb336-d7bb-4887-9321-d0a11a7f9aa4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:38.827512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfb336-d7bb-4887-9321-d0a11a7f9aa4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:38.828371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfb336-d7bb-4887-9321-d0a11a7f9aa4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:38.828776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfb336-d7bb-4887-9321-d0a11a7f9aa4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:38.830472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfb336-d7bb-4887-9321-d0a11a7f9aa4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:38.865709 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2277/4562] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:38 2021] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:38.867085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa01e3-09f7-493a-8319-05f160f67f5f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:38.879705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa01e3-09f7-493a-8319-05f160f67f5f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:38.887765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29c6a7-07fd-4fa6-bbb8-5786b6440df4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:38.888818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c6a7-07fd-4fa6-bbb8-5786b6440df4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:38.889183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c6a7-07fd-4fa6-bbb8-5786b6440df4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:38.889301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c6a7-07fd-4fa6-bbb8-5786b6440df4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:38.890217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29c6a7-07fd-4fa6-bbb8-5786b6440df4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1990359093) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:38.890625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29c6a7-07fd-4fa6-bbb8-5786b6440df4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:38.892518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29c6a7-07fd-4fa6-bbb8-5786b6440df4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:38.910781 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2286/4563] 10.222.0.21 () {58 vars in 1198 bytes} [Sat Nov 27 20:58:38 2021] GET /identity/v3/domains?name=tempest-test_domain-1990359093 => generated 408 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:38.912637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfb336-d7bb-4887-9321-d0a11a7f9aa4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:38.923188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfb336-d7bb-4887-9321-d0a11a7f9aa4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:38.933038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c80b5-5dac-46c0-b0a8-478068a25a3a tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:38.934168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c80b5-5dac-46c0-b0a8-478068a25a3a tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:38.935048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c80b5-5dac-46c0-b0a8-478068a25a3a tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:38.935048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c80b5-5dac-46c0-b0a8-478068a25a3a tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/b6d731ff717f49be8569cfe2ba2b7b67` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:38.942703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c80b5-5dac-46c0-b0a8-478068a25a3a tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:58:38.952534 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-bc9c80b5-5dac-46c0-b0a8-478068a25a3a tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Could not find domain: b6d731ff717f49be8569cfe2ba2b7b67.: keystone.exception.DomainNotFound: Could not find domain: b6d731ff717f49be8569cfe2ba2b7b67. Nov 27 20:58:38.953904 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2278/4564] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:58:38 2021] PATCH /identity/v3/domains/b6d731ff717f49be8569cfe2ba2b7b67 => generated 112 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:58:38.958565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29c6a7-07fd-4fa6-bbb8-5786b6440df4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:38.970476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29c6a7-07fd-4fa6-bbb8-5786b6440df4 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:38.979094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fed05-6cca-4fa6-95c5-3f1cbfdd7bba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:38.980697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fed05-6cca-4fa6-95c5-3f1cbfdd7bba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:38.981323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fed05-6cca-4fa6-95c5-3f1cbfdd7bba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:38.981788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fed05-6cca-4fa6-95c5-3f1cbfdd7bba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/9219ac80937e4cc4aff67d35b032e33a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:38.997955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fed05-6cca-4fa6-95c5-3f1cbfdd7bba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9219ac80937e4cc4aff67d35b032e33a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:38.999893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fed05-6cca-4fa6-95c5-3f1cbfdd7bba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:39.063778 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2287/4565] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:58:38 2021] PATCH /identity/v3/domains/9219ac80937e4cc4aff67d35b032e33a => generated 278 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:58:39.067938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c80b5-5dac-46c0-b0a8-478068a25a3a tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:39.081710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c80b5-5dac-46c0-b0a8-478068a25a3a tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:39.088400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:39.089384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:39.089763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:39.090272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/9219ac80937e4cc4aff67d35b032e33a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:39.112079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9219ac80937e4cc4aff67d35b032e33a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:39.114192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:39.138353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9219ac80937e4cc4aff67d35b032e33a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.153066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9219ac80937e4cc4aff67d35b032e33a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.201125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9219ac80937e4cc4aff67d35b032e33a', 'request_id': 'req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.212596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9219ac80937e4cc4aff67d35b032e33a', 'request_id': 'req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.221609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9219ac80937e4cc4aff67d35b032e33a', 'request_id': 'req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.236596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] The token cache is being invalidate because project 9219ac80937e4cc4aff67d35b032e33a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:39.237097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.238618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.249458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9219ac80937e4cc4aff67d35b032e33a', 'request_id': 'req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.249458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9219ac80937e4cc4aff67d35b032e33a', 'request_id': 'req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.254175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9219ac80937e4cc4aff67d35b032e33a', 'request_id': 'req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.271738 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2279/4566] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:58:39 2021] DELETE /identity/v3/domains/9219ac80937e4cc4aff67d35b032e33a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:39.273223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fed05-6cca-4fa6-95c5-3f1cbfdd7bba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:39.275431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1b7fed05-6cca-4fa6-95c5-3f1cbfdd7bba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:39.295940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fed05-6cca-4fa6-95c5-3f1cbfdd7bba tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:39.414494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:39.416106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:39.416392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:39.416816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/8628b076a22e40f2be6abadbb13eab60` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:39.472609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8628b076a22e40f2be6abadbb13eab60)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:39.476479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:39.514227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8628b076a22e40f2be6abadbb13eab60'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.515523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8628b076a22e40f2be6abadbb13eab60'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.570248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8628b076a22e40f2be6abadbb13eab60'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.571002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8628b076a22e40f2be6abadbb13eab60'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.574011 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2288/4567] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:58:39 2021] PATCH /identity/v3/domains/8628b076a22e40f2be6abadbb13eab60 => generated 277 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:39.577836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:39.597803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a0fc9-b29a-4932-acf9-8d11e84161bb tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:39.790473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:39.791594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:39.791879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:39.792205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/8628b076a22e40f2be6abadbb13eab60` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:39.808208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8628b076a22e40f2be6abadbb13eab60)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:39.817542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:39.889576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8628b076a22e40f2be6abadbb13eab60'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:39.914371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8628b076a22e40f2be6abadbb13eab60'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.019032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8628b076a22e40f2be6abadbb13eab60', 'request_id': 'req-05da9c17-0a61-4b25-9523-4c10db25394f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.048879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8628b076a22e40f2be6abadbb13eab60', 'request_id': 'req-05da9c17-0a61-4b25-9523-4c10db25394f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.064286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8628b076a22e40f2be6abadbb13eab60', 'request_id': 'req-05da9c17-0a61-4b25-9523-4c10db25394f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.091614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] The token cache is being invalidate because project 8628b076a22e40f2be6abadbb13eab60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:40.091915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.097401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.120809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8628b076a22e40f2be6abadbb13eab60', 'request_id': 'req-05da9c17-0a61-4b25-9523-4c10db25394f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.124116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8628b076a22e40f2be6abadbb13eab60', 'request_id': 'req-05da9c17-0a61-4b25-9523-4c10db25394f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.135554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8628b076a22e40f2be6abadbb13eab60', 'request_id': 'req-05da9c17-0a61-4b25-9523-4c10db25394f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.153597 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2280/4568] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:58:39 2021] DELETE /identity/v3/domains/8628b076a22e40f2be6abadbb13eab60 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:40.155439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:40.158397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:40.193449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eab9a6-a963-401c-85a5-1ef132ab1117 tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:40.414725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:40.416250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:40.416533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:40.420421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/26c5adadaad14dfcb181f2049002848d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:40.467914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=26c5adadaad14dfcb181f2049002848d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:40.472305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:40.544150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '26c5adadaad14dfcb181f2049002848d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.545763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '26c5adadaad14dfcb181f2049002848d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.615315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '26c5adadaad14dfcb181f2049002848d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.616226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '26c5adadaad14dfcb181f2049002848d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.619222 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2289/4569] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:58:40 2021] PATCH /identity/v3/domains/26c5adadaad14dfcb181f2049002848d => generated 277 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:40.623361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:40.625017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:40.643210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da9c17-0a61-4b25-9523-4c10db25394f tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:40.806618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e8e903e471c4c74854934bb35f0e19e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38dbc07239c34ad6ad52bb5961c714d3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:40.807454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:40.807746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:40.808023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] PATH_INFO: `/v3/domains/26c5adadaad14dfcb181f2049002848d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:40.823548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=26c5adadaad14dfcb181f2049002848d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:40.825832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:40.862124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '26c5adadaad14dfcb181f2049002848d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.879479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '26c5adadaad14dfcb181f2049002848d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.936616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c5adadaad14dfcb181f2049002848d', 'request_id': 'req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.952933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c5adadaad14dfcb181f2049002848d', 'request_id': 'req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:40.997740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c5adadaad14dfcb181f2049002848d', 'request_id': 'req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:41.016653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] The token cache is being invalidate because project 26c5adadaad14dfcb181f2049002848d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:41.016962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:41.017929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:41.032253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '26c5adadaad14dfcb181f2049002848d', 'request_id': 'req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:41.033242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '26c5adadaad14dfcb181f2049002848d', 'request_id': 'req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:41.038460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '26c5adadaad14dfcb181f2049002848d', 'request_id': 'req-0415bd8f-bb18-4e1d-be27-9daa3fc88e2b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:41.056749 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2281/4570] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:58:40 2021] DELETE /identity/v3/domains/26c5adadaad14dfcb181f2049002848d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:41.060729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:41.062393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:41.154600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ed55e-a48f-4bd1-a6ab-1b906598757e tempest-DomainsTestJSON-1501042984 tempest-DomainsTestJSON-1501042984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:41.219052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:41.220113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:41.220648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:41.221137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] PATH_INFO: `/v3/users/7467e399d81b49ef94b329c6c1155845` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:41.222581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7467e399d81b49ef94b329c6c1155845)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:41.225244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:41.309685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7467e399d81b49ef94b329c6c1155845'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:41.321764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7467e399d81b49ef94b329c6c1155845'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:41.323714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7467e399d81b49ef94b329c6c1155845'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:41.334792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7467e399d81b49ef94b329c6c1155845'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:41.351925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7467e399d81b49ef94b329c6c1155845'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:41.360587 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2290/4571] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:41 2021] DELETE /identity/v3/users/7467e399d81b49ef94b329c6c1155845 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:41.365943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c5b1e-07a8-4ddb-8a08-bffc7aef6686 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:41.366543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c5b1e-07a8-4ddb-8a08-bffc7aef6686 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:41.366953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c5b1e-07a8-4ddb-8a08-bffc7aef6686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:41.393132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-454c5b1e-07a8-4ddb-8a08-bffc7aef6686 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:41.394854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-454c5b1e-07a8-4ddb-8a08-bffc7aef6686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:41.539930 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2282/4572] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:41.553223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:41.556971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:41.741995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320e2cf-3c34-4904-a414-4ace11690550 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:41.745879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5b169-d311-4193-9cd2-4c33ccab8d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:41.746544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5b169-d311-4193-9cd2-4c33ccab8d2b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:41.746831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5b169-d311-4193-9cd2-4c33ccab8d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:41.747390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5b169-d311-4193-9cd2-4c33ccab8d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:41.767705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5b169-d311-4193-9cd2-4c33ccab8d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:41.769178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5b169-d311-4193-9cd2-4c33ccab8d2b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:41.792672 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2291/4573] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:42.908824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c5b1e-07a8-4ddb-8a08-bffc7aef6686 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:42.910410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-454c5b1e-07a8-4ddb-8a08-bffc7aef6686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:42.924820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c5b1e-07a8-4ddb-8a08-bffc7aef6686 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:42.929618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:42.931286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:42.931286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:42.931286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] PATH_INFO: `/v3/projects/8ae18f7a728e418783081b12ecbd54ff` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:42.932812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae18f7a728e418783081b12ecbd54ff)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:42.934766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:43.002058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae18f7a728e418783081b12ecbd54ff', 'request_id': 'req-51dfce37-511a-4711-a2a8-5db42ab890cc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:43.010390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae18f7a728e418783081b12ecbd54ff', 'request_id': 'req-51dfce37-511a-4711-a2a8-5db42ab890cc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:43.023480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae18f7a728e418783081b12ecbd54ff', 'request_id': 'req-51dfce37-511a-4711-a2a8-5db42ab890cc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:43.043444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] The token cache is being invalidate because project 8ae18f7a728e418783081b12ecbd54ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:43.043837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:43.044415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:43.046478 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2283/4574] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:42 2021] DELETE /identity/v3/projects/8ae18f7a728e418783081b12ecbd54ff => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:43.050311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5b169-d311-4193-9cd2-4c33ccab8d2b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:43.060820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5b169-d311-4193-9cd2-4c33ccab8d2b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:43.159902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09abc2-5268-47da-b499-1335124783b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:43.161121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09abc2-5268-47da-b499-1335124783b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:43.162637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09abc2-5268-47da-b499-1335124783b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:43.164625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09abc2-5268-47da-b499-1335124783b4 admin admin] PATH_INFO: `/v3/users/5e8e903e471c4c74854934bb35f0e19e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:43.167582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09abc2-5268-47da-b499-1335124783b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8e903e471c4c74854934bb35f0e19e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:43.169748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09abc2-5268-47da-b499-1335124783b4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:43.283108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8f09abc2-5268-47da-b499-1335124783b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8e903e471c4c74854934bb35f0e19e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:43.293530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8f09abc2-5268-47da-b499-1335124783b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8e903e471c4c74854934bb35f0e19e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:43.294521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8f09abc2-5268-47da-b499-1335124783b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8e903e471c4c74854934bb35f0e19e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:43.304033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8f09abc2-5268-47da-b499-1335124783b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8e903e471c4c74854934bb35f0e19e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:43.374734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8f09abc2-5268-47da-b499-1335124783b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8e903e471c4c74854934bb35f0e19e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:43.400166 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2292/4575] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:43 2021] DELETE /identity/v3/users/5e8e903e471c4c74854934bb35f0e19e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:44.325082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:44.326835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:44.340865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfce37-511a-4711-a2a8-5db42ab890cc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:44.465263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:44.465840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:44.466121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:44.466396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] PATH_INFO: `/v3/projects/38dbc07239c34ad6ad52bb5961c714d3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:44.468516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38dbc07239c34ad6ad52bb5961c714d3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:44.470808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:44.544973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38dbc07239c34ad6ad52bb5961c714d3', 'request_id': 'req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:44.555678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38dbc07239c34ad6ad52bb5961c714d3', 'request_id': 'req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:44.571785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38dbc07239c34ad6ad52bb5961c714d3', 'request_id': 'req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:44.586511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] The token cache is being invalidate because project 38dbc07239c34ad6ad52bb5961c714d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:44.586970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:44.588628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1f8b99f0-7123-4b19-b721-e8a6a22c9b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:44.591958 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2284/4576] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:44 2021] DELETE /identity/v3/projects/38dbc07239c34ad6ad52bb5961c714d3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:44.598147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8b7b-7ee8-490c-896c-5727352dd58b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:44.598610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8b7b-7ee8-490c-896c-5727352dd58b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:44.599406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8b7b-7ee8-490c-896c-5727352dd58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:44.619915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9a3c8b7b-7ee8-490c-896c-5727352dd58b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:44.621503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9a3c8b7b-7ee8-490c-896c-5727352dd58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:44.691404 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2293/4577] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:44.700477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e2762-8261-40f4-a5ba-933b2ceae674 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:44.700773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e2762-8261-40f4-a5ba-933b2ceae674 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:44.701044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e2762-8261-40f4-a5ba-933b2ceae674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:44.724764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1e1e2762-8261-40f4-a5ba-933b2ceae674 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:44.726339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1e1e2762-8261-40f4-a5ba-933b2ceae674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:44.736122 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2285/4578] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:44.741682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c8b7b-7ee8-490c-896c-5727352dd58b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:44.752439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c8b7b-7ee8-490c-896c-5727352dd58b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:44.757938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa2579-14b6-494e-b5fb-75882d8e0eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:44.758734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa2579-14b6-494e-b5fb-75882d8e0eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:44.759112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa2579-14b6-494e-b5fb-75882d8e0eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:44.759535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa2579-14b6-494e-b5fb-75882d8e0eb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:44.760462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa2579-14b6-494e-b5fb-75882d8e0eb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:44.760767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa2579-14b6-494e-b5fb-75882d8e0eb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:44.762397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa2579-14b6-494e-b5fb-75882d8e0eb7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:44.779347 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2294/4579] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:44.781827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e2762-8261-40f4-a5ba-933b2ceae674 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:44.793128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e2762-8261-40f4-a5ba-933b2ceae674 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:44.797922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377f101-7c6a-43ec-8522-4c810e4b4322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:44.798569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f101-7c6a-43ec-8522-4c810e4b4322 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:44.798852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f101-7c6a-43ec-8522-4c810e4b4322 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:44.799126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377f101-7c6a-43ec-8522-4c810e4b4322 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:44.799879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377f101-7c6a-43ec-8522-4c810e4b4322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:44.801921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377f101-7c6a-43ec-8522-4c810e4b4322 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:44.837840 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2286/4580] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:44 2021] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:44.838907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa2579-14b6-494e-b5fb-75882d8e0eb7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:44.853206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa2579-14b6-494e-b5fb-75882d8e0eb7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:44.926224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66f86b-a5d7-4b06-bc7c-5ed9edbb2de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:44.927046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66f86b-a5d7-4b06-bc7c-5ed9edbb2de3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:44.927434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66f86b-a5d7-4b06-bc7c-5ed9edbb2de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:44.927859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66f86b-a5d7-4b06-bc7c-5ed9edbb2de3 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:44.928632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66f86b-a5d7-4b06-bc7c-5ed9edbb2de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:44.930637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66f86b-a5d7-4b06-bc7c-5ed9edbb2de3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:44.956848 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2295/4581] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:44 2021] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:44.958708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377f101-7c6a-43ec-8522-4c810e4b4322 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:44.970520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377f101-7c6a-43ec-8522-4c810e4b4322 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:44.975750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d183bdf-af75-4ec9-908c-61c7ac36354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:44.976418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d183bdf-af75-4ec9-908c-61c7ac36354a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:44.976697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d183bdf-af75-4ec9-908c-61c7ac36354a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:44.977589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d183bdf-af75-4ec9-908c-61c7ac36354a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:44.978676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d183bdf-af75-4ec9-908c-61c7ac36354a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:44.980112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d183bdf-af75-4ec9-908c-61c7ac36354a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:44.994848 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2287/4582] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:44 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:44.996134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66f86b-a5d7-4b06-bc7c-5ed9edbb2de3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:45.008464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66f86b-a5d7-4b06-bc7c-5ed9edbb2de3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:45.013713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d19786-1793-4e41-aa93-1995907be12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:45.014381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19786-1793-4e41-aa93-1995907be12b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:45.014665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19786-1793-4e41-aa93-1995907be12b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:45.014946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d19786-1793-4e41-aa93-1995907be12b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:45.015843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d19786-1793-4e41-aa93-1995907be12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:45.017441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d19786-1793-4e41-aa93-1995907be12b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:45.031655 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2296/4583] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:44 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:45.032856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d183bdf-af75-4ec9-908c-61c7ac36354a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:45.047066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d183bdf-af75-4ec9-908c-61c7ac36354a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:45.054729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0788af-855d-4567-aad2-661079d6cbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:45.056457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0788af-855d-4567-aad2-661079d6cbc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:45.057061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0788af-855d-4567-aad2-661079d6cbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:45.057345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0788af-855d-4567-aad2-661079d6cbc4 admin admin] PATH_INFO: `/v3/projects/692362d52ef24923bd7093b1e81dbd35/users/b2989d05a01e473d91accaffb25ff76f/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:45.075660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0788af-855d-4567-aad2-661079d6cbc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=692362d52ef24923bd7093b1e81dbd35, user_id=b2989d05a01e473d91accaffb25ff76f, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:45.078392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0788af-855d-4567-aad2-661079d6cbc4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:45.095336 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2288/4584] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:45 2021] PUT /identity/v3/projects/692362d52ef24923bd7093b1e81dbd35/users/b2989d05a01e473d91accaffb25ff76f/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:45.104428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783bba1-08f1-4693-ac5a-408444c276f9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:45.104772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783bba1-08f1-4693-ac5a-408444c276f9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:45.105017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783bba1-08f1-4693-ac5a-408444c276f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:45.141191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9783bba1-08f1-4693-ac5a-408444c276f9 None None] MFA Rules not processed for user `b2989d05a01e473d91accaffb25ff76f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:45.142700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9783bba1-08f1-4693-ac5a-408444c276f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:45.229659 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2297/4585] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:45 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:45.234228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0788af-855d-4567-aad2-661079d6cbc4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:45.313664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0788af-855d-4567-aad2-661079d6cbc4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:45.320843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2aeeb8-7dbd-4d32-aefe-87d1f69d352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:45.321733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2aeeb8-7dbd-4d32-aefe-87d1f69d352e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:45.321874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2aeeb8-7dbd-4d32-aefe-87d1f69d352e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:45.322072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2aeeb8-7dbd-4d32-aefe-87d1f69d352e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:45.322770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2aeeb8-7dbd-4d32-aefe-87d1f69d352e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:45.326259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2aeeb8-7dbd-4d32-aefe-87d1f69d352e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:45.395416 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2289/4586] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:45 2021] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:45.398500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783bba1-08f1-4693-ac5a-408444c276f9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:45.418560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783bba1-08f1-4693-ac5a-408444c276f9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:45.522655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03c98c-b37a-41fb-b43e-367f790f05e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:45.523716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c98c-b37a-41fb-b43e-367f790f05e5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:45.524444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c98c-b37a-41fb-b43e-367f790f05e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:45.524939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c98c-b37a-41fb-b43e-367f790f05e5 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:45.525871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03c98c-b37a-41fb-b43e-367f790f05e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:45.529665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03c98c-b37a-41fb-b43e-367f790f05e5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:45.572360 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2298/4587] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:45 2021] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:45.575819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2aeeb8-7dbd-4d32-aefe-87d1f69d352e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:45.590109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2aeeb8-7dbd-4d32-aefe-87d1f69d352e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:45.609675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69737ac-e040-45ec-8cbd-ed6c3ad26dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:45.615918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69737ac-e040-45ec-8cbd-ed6c3ad26dbe admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:45.617564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69737ac-e040-45ec-8cbd-ed6c3ad26dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:45.617962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69737ac-e040-45ec-8cbd-ed6c3ad26dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:45.620030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69737ac-e040-45ec-8cbd-ed6c3ad26dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:45.624150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69737ac-e040-45ec-8cbd-ed6c3ad26dbe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:45.647474 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2290/4588] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:45 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:45.651867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03c98c-b37a-41fb-b43e-367f790f05e5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:45.681345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03c98c-b37a-41fb-b43e-367f790f05e5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:45.694336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed16c-08cf-4b4c-ab14-47497214be30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:45.695626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed16c-08cf-4b4c-ab14-47497214be30 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:45.696789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed16c-08cf-4b4c-ab14-47497214be30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:45.697173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed16c-08cf-4b4c-ab14-47497214be30 admin admin] PATH_INFO: `/v3/projects/33cdda2f73e34fa5b4bc5de60c253c05/users/7a76bb1f7898419dba7f4c53367144b3/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:45.740594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ed16c-08cf-4b4c-ab14-47497214be30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cdda2f73e34fa5b4bc5de60c253c05, user_id=7a76bb1f7898419dba7f4c53367144b3, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:45.743747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ed16c-08cf-4b4c-ab14-47497214be30 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:45.769201 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2299/4589] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:45 2021] PUT /identity/v3/projects/33cdda2f73e34fa5b4bc5de60c253c05/users/7a76bb1f7898419dba7f4c53367144b3/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:45.773439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69737ac-e040-45ec-8cbd-ed6c3ad26dbe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:45.786868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69737ac-e040-45ec-8cbd-ed6c3ad26dbe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:45.921687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c61de-d547-451e-9977-c9f6d02fa0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:45.922375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c61de-d547-451e-9977-c9f6d02fa0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:45.922660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c61de-d547-451e-9977-c9f6d02fa0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:45.922942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c61de-d547-451e-9977-c9f6d02fa0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:45.923732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c61de-d547-451e-9977-c9f6d02fa0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:45.927184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c61de-d547-451e-9977-c9f6d02fa0a7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:45.946914 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2291/4590] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:45 2021] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:45.948813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed16c-08cf-4b4c-ab14-47497214be30 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:45.964405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed16c-08cf-4b4c-ab14-47497214be30 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:45.970680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600ee0-dcfa-4af1-abc6-bd00ffdb2880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:45.972055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600ee0-dcfa-4af1-abc6-bd00ffdb2880 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:45.972643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600ee0-dcfa-4af1-abc6-bd00ffdb2880 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:45.973131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600ee0-dcfa-4af1-abc6-bd00ffdb2880 admin admin] PATH_INFO: `/v3/projects/33cdda2f73e34fa5b4bc5de60c253c05/users/7a76bb1f7898419dba7f4c53367144b3/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:45.976635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2600ee0-dcfa-4af1-abc6-bd00ffdb2880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cdda2f73e34fa5b4bc5de60c253c05, user_id=7a76bb1f7898419dba7f4c53367144b3, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:45.979860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2600ee0-dcfa-4af1-abc6-bd00ffdb2880 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:45.993631 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2300/4591] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:45 2021] PUT /identity/v3/projects/33cdda2f73e34fa5b4bc5de60c253c05/users/7a76bb1f7898419dba7f4c53367144b3/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:46.004944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76494e3-48d8-43c3-9297-3770f1295ce5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:46.005239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76494e3-48d8-43c3-9297-3770f1295ce5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:46.005515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76494e3-48d8-43c3-9297-3770f1295ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:46.042273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f76494e3-48d8-43c3-9297-3770f1295ce5 None None] MFA Rules not processed for user `7a76bb1f7898419dba7f4c53367144b3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:46.043679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f76494e3-48d8-43c3-9297-3770f1295ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:46.121691 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2292/4592] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:46 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:46.127406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600ee0-dcfa-4af1-abc6-bd00ffdb2880 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:46.140352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600ee0-dcfa-4af1-abc6-bd00ffdb2880 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:46.153774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8878d5b-40d4-459b-8d88-a19045460381 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:46.155718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8878d5b-40d4-459b-8d88-a19045460381 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:46.156785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8878d5b-40d4-459b-8d88-a19045460381 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:46.157409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8878d5b-40d4-459b-8d88-a19045460381 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:46.158903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8878d5b-40d4-459b-8d88-a19045460381 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:46.162124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8878d5b-40d4-459b-8d88-a19045460381 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:46.195861 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-b8878d5b-40d4-459b-8d88-a19045460381 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invalid input for field 'name': '' is too short Nov 27 20:58:46.195861 ncdv-master-1 devstack@keystone.service[90123]: Failed validating 'minLength' in schema['properties']['name']: Nov 27 20:58:46.195861 ncdv-master-1 devstack@keystone.service[90123]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 27 20:58:46.195861 ncdv-master-1 devstack@keystone.service[90123]: On instance['name']: Nov 27 20:58:46.195861 ncdv-master-1 devstack@keystone.service[90123]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Nov 27 20:58:46.199659 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2301/4593] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:58:46 2021] POST /identity/v3/domains => generated 283 bytes in 73 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 27 20:58:46.204652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76494e3-48d8-43c3-9297-3770f1295ce5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:46.220530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76494e3-48d8-43c3-9297-3770f1295ce5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:46.226665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54ad25-696c-43d6-9bfc-585ac4a28103 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:46.230692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54ad25-696c-43d6-9bfc-585ac4a28103 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:46.231724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54ad25-696c-43d6-9bfc-585ac4a28103 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:46.232420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54ad25-696c-43d6-9bfc-585ac4a28103 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:46.234857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54ad25-696c-43d6-9bfc-585ac4a28103 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:46.240099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54ad25-696c-43d6-9bfc-585ac4a28103 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:46.247787 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-5d54ad25-696c-43d6-9bfc-585ac4a28103 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 27 20:58:46.247787 ncdv-master-1 devstack@keystone.service[90122]: Failed validating 'maxLength' in schema['properties']['name']: Nov 27 20:58:46.247787 ncdv-master-1 devstack@keystone.service[90122]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 27 20:58:46.247787 ncdv-master-1 devstack@keystone.service[90122]: On instance['name']: Nov 27 20:58:46.247787 ncdv-master-1 devstack@keystone.service[90122]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 27 20:58:46.253747 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2293/4594] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:58:46 2021] POST /identity/v3/domains => generated 412 bytes in 49 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 27 20:58:46.254689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8878d5b-40d4-459b-8d88-a19045460381 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:46.268614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8878d5b-40d4-459b-8d88-a19045460381 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:46.274694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a1a37-eba8-4892-9a44-740c25cd37d9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:46.275336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a1a37-eba8-4892-9a44-740c25cd37d9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:46.275676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a1a37-eba8-4892-9a44-740c25cd37d9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:46.275955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a1a37-eba8-4892-9a44-740c25cd37d9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:46.277031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a1a37-eba8-4892-9a44-740c25cd37d9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:46.281314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a1a37-eba8-4892-9a44-740c25cd37d9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:46.299412 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2302/4595] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:58:46 2021] POST /identity/v3/domains => generated 277 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:46.303452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54ad25-696c-43d6-9bfc-585ac4a28103 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:46.314166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54ad25-696c-43d6-9bfc-585ac4a28103 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:46.387240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae6e8f-4c27-44e2-ab48-8deaa3f2c227 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:46.392194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae6e8f-4c27-44e2-ab48-8deaa3f2c227 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:46.394448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae6e8f-4c27-44e2-ab48-8deaa3f2c227 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:46.395092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae6e8f-4c27-44e2-ab48-8deaa3f2c227 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains/7bf1c6aadb9444de97c58bb3a9b88355` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:46.410441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae6e8f-4c27-44e2-ab48-8deaa3f2c227 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7bf1c6aadb9444de97c58bb3a9b88355)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:46.412240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae6e8f-4c27-44e2-ab48-8deaa3f2c227 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:46.439407 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-fdae6e8f-4c27-44e2-ab48-8deaa3f2c227 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Nov 27 20:58:46.441722 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2294/4596] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:58:46 2021] DELETE /identity/v3/domains/7bf1c6aadb9444de97c58bb3a9b88355 => generated 120 bytes in 139 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:58:46.446111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a1a37-eba8-4892-9a44-740c25cd37d9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:46.461607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a1a37-eba8-4892-9a44-740c25cd37d9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:46.467689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:46.468685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:46.469153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:46.469539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains/7bf1c6aadb9444de97c58bb3a9b88355` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:46.471659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7bf1c6aadb9444de97c58bb3a9b88355)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:46.473247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:46.500133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.500990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.535310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.536546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.540122 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2303/4597] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:58:46 2021] PATCH /identity/v3/domains/7bf1c6aadb9444de97c58bb3a9b88355 => generated 278 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:58:46.544051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae6e8f-4c27-44e2-ab48-8deaa3f2c227 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:46.552492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fdae6e8f-4c27-44e2-ab48-8deaa3f2c227 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:46.571195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae6e8f-4c27-44e2-ab48-8deaa3f2c227 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:46.649981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:46.651415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:46.651886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:46.652310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains/7bf1c6aadb9444de97c58bb3a9b88355` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:46.665155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7bf1c6aadb9444de97c58bb3a9b88355)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:46.667492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:46.693937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.705602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.778015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355', 'request_id': 'req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.791345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355', 'request_id': 'req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.816412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355', 'request_id': 'req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.830275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] The token cache is being invalidate because project 7bf1c6aadb9444de97c58bb3a9b88355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:46.830665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.831450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.842061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355', 'request_id': 'req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.843185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355', 'request_id': 'req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.851004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7bf1c6aadb9444de97c58bb3a9b88355', 'request_id': 'req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:46.863024 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2295/4598] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:58:46 2021] DELETE /identity/v3/domains/7bf1c6aadb9444de97c58bb3a9b88355 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:46.864811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:46.881988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276af8e2-c40d-4f2a-b8ac-e91789798ee6 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:46.996375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f93f26-7a5a-4e2d-b2c7-5909444dcea2 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:46.997498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f93f26-7a5a-4e2d-b2c7-5909444dcea2 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:46.997780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f93f26-7a5a-4e2d-b2c7-5909444dcea2 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:46.998052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f93f26-7a5a-4e2d-b2c7-5909444dcea2 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains/f8b3244dbd204fdc80f5847821b8cadd` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:47.008418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f93f26-7a5a-4e2d-b2c7-5909444dcea2 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:58:47.019511 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-33f93f26-7a5a-4e2d-b2c7-5909444dcea2 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Could not find domain: f8b3244dbd204fdc80f5847821b8cadd.: keystone.exception.DomainNotFound: Could not find domain: f8b3244dbd204fdc80f5847821b8cadd. Nov 27 20:58:47.021154 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2304/4599] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:58:46 2021] DELETE /identity/v3/domains/f8b3244dbd204fdc80f5847821b8cadd => generated 112 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:58:47.025933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:47.027347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:47.041972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d20d8f-afb8-4d78-a4fc-e13d00bae9c9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:47.047411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baf54e-4271-437c-92c6-d760887669e9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:47.048125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baf54e-4271-437c-92c6-d760887669e9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:47.048439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baf54e-4271-437c-92c6-d760887669e9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:47.048675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baf54e-4271-437c-92c6-d760887669e9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:47.054357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baf54e-4271-437c-92c6-d760887669e9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:47.056117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baf54e-4271-437c-92c6-d760887669e9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:47.091348 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2296/4600] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:58:47 2021] POST /identity/v3/domains => generated 252 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:47.094870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f93f26-7a5a-4e2d-b2c7-5909444dcea2 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:47.124003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f93f26-7a5a-4e2d-b2c7-5909444dcea2 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:47.207590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f45d5-4f87-44dc-8ecb-27722374ff4a tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:47.208974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f45d5-4f87-44dc-8ecb-27722374ff4a tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:47.209736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f45d5-4f87-44dc-8ecb-27722374ff4a tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:47.210178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f45d5-4f87-44dc-8ecb-27722374ff4a tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:47.211240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f45d5-4f87-44dc-8ecb-27722374ff4a tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:47.213342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f45d5-4f87-44dc-8ecb-27722374ff4a tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:47.224169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.sql.core [None req-b61f45d5-4f87-44dc-8ecb-27722374ff4a tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-296734226' for key 'project.ixu_project_name_domain_id'") Nov 27 20:58:47.224169 ncdv-master-1 devstack@keystone.service[90123]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 27 20:58:47.224169 ncdv-master-1 devstack@keystone.service[90123]: [parameters: {'id': 'a1e80cdb23b24782bf205780ee9aa02e', 'name': 'tempest-domain-dup-296734226', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 27 20:58:47.224169 ncdv-master-1 devstack@keystone.service[90123]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90123) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 27 20:58:47.236588 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-b61f45d5-4f87-44dc-8ecb-27722374ff4a tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-296734226.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-296734226. Nov 27 20:58:47.242258 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2305/4601] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:58:47 2021] POST /identity/v3/domains => generated 211 bytes in 147 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:58:47.248574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baf54e-4271-437c-92c6-d760887669e9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:47.265133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baf54e-4271-437c-92c6-d760887669e9 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:47.272141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:47.273389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:47.273389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:47.273756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains/7dec1e272c8844bfa452c3866b9592df` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:47.289215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7dec1e272c8844bfa452c3866b9592df)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:47.291143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:47.324382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7dec1e272c8844bfa452c3866b9592df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.325146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7dec1e272c8844bfa452c3866b9592df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.360884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7dec1e272c8844bfa452c3866b9592df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.362366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7dec1e272c8844bfa452c3866b9592df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.365462 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2297/4602] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:58:47 2021] PATCH /identity/v3/domains/7dec1e272c8844bfa452c3866b9592df => generated 253 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:47.369622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f45d5-4f87-44dc-8ecb-27722374ff4a tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:47.372371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b61f45d5-4f87-44dc-8ecb-27722374ff4a tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:47.391389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f45d5-4f87-44dc-8ecb-27722374ff4a tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:47.469989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:47.470908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:47.471189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:47.471489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains/7dec1e272c8844bfa452c3866b9592df` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:47.484733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7dec1e272c8844bfa452c3866b9592df)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:47.486478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:47.511233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7dec1e272c8844bfa452c3866b9592df'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.522907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7dec1e272c8844bfa452c3866b9592df'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.577240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dec1e272c8844bfa452c3866b9592df', 'request_id': 'req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.589760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dec1e272c8844bfa452c3866b9592df', 'request_id': 'req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.602255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dec1e272c8844bfa452c3866b9592df', 'request_id': 'req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.621030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] The token cache is being invalidate because project 7dec1e272c8844bfa452c3866b9592df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:47.621495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.622751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.632538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7dec1e272c8844bfa452c3866b9592df', 'request_id': 'req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.633677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7dec1e272c8844bfa452c3866b9592df', 'request_id': 'req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.635419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7dec1e272c8844bfa452c3866b9592df', 'request_id': 'req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.651030 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2306/4603] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:58:47 2021] DELETE /identity/v3/domains/7dec1e272c8844bfa452c3866b9592df => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:47.652282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:47.667111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f2c0c-7254-4588-be0b-a773db7beeb1 tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:47.746073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26111308-6eda-44a2-9ae8-21522719456b tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a76bb1f7898419dba7f4c53367144b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33cdda2f73e34fa5b4bc5de60c253c05', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:47.747472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26111308-6eda-44a2-9ae8-21522719456b tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:47.747820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26111308-6eda-44a2-9ae8-21522719456b tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:47.748107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26111308-6eda-44a2-9ae8-21522719456b tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] PATH_INFO: `/v3/domains/7bf1c6aadb9444de97c58bb3a9b88355` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:47.757303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26111308-6eda-44a2-9ae8-21522719456b tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 20:58:47.766752 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-26111308-6eda-44a2-9ae8-21522719456b tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Could not find domain: 7bf1c6aadb9444de97c58bb3a9b88355.: keystone.exception.DomainNotFound: Could not find domain: 7bf1c6aadb9444de97c58bb3a9b88355. Nov 27 20:58:47.768072 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2298/4604] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:58:47 2021] PATCH /identity/v3/domains/7bf1c6aadb9444de97c58bb3a9b88355 => generated 112 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:58:47.772908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:47.774385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:47.845074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544d0ad-165f-43d1-b121-3cf4aa28d6ce tempest-DomainsNegativeTestJSON-965223733 tempest-DomainsNegativeTestJSON-965223733-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:47.850314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:47.851241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:47.851575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:47.851883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] PATH_INFO: `/v3/users/b2989d05a01e473d91accaffb25ff76f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:47.853207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2989d05a01e473d91accaffb25ff76f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:47.855179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:47.915681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2989d05a01e473d91accaffb25ff76f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.926400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2989d05a01e473d91accaffb25ff76f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.927808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2989d05a01e473d91accaffb25ff76f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.936304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2989d05a01e473d91accaffb25ff76f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.950758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2989d05a01e473d91accaffb25ff76f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:47.957823 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2307/4605] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:47 2021] DELETE /identity/v3/users/b2989d05a01e473d91accaffb25ff76f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:47.962313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01208bb1-06f5-43c5-9ed5-641fe994088b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:47.962601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01208bb1-06f5-43c5-9ed5-641fe994088b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:47.962878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01208bb1-06f5-43c5-9ed5-641fe994088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:47.984570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-01208bb1-06f5-43c5-9ed5-641fe994088b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:47.985447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-01208bb1-06f5-43c5-9ed5-641fe994088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:48.076680 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2299/4606] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:48.101831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:48.103980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:48.181556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efa02b-dd55-467e-977e-0203e178df8f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:48.185275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204aac5-8700-43d9-9e5e-6276ed24452f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:48.185940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204aac5-8700-43d9-9e5e-6276ed24452f service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:48.186202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204aac5-8700-43d9-9e5e-6276ed24452f service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:48.186472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204aac5-8700-43d9-9e5e-6276ed24452f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:48.196509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204aac5-8700-43d9-9e5e-6276ed24452f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:48.197922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204aac5-8700-43d9-9e5e-6276ed24452f service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:48.207169 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2308/4607] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:49.207026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01208bb1-06f5-43c5-9ed5-641fe994088b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:49.208606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-01208bb1-06f5-43c5-9ed5-641fe994088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:49.231508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01208bb1-06f5-43c5-9ed5-641fe994088b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:49.259632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:49.260511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:49.260798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:49.261079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] PATH_INFO: `/v3/projects/692362d52ef24923bd7093b1e81dbd35` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:49.262419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=692362d52ef24923bd7093b1e81dbd35)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:49.264289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:49.378588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692362d52ef24923bd7093b1e81dbd35', 'request_id': 'req-2c449fac-7165-449a-ab5a-2834befff1fe'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:49.406520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692362d52ef24923bd7093b1e81dbd35', 'request_id': 'req-2c449fac-7165-449a-ab5a-2834befff1fe'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:49.418188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692362d52ef24923bd7093b1e81dbd35', 'request_id': 'req-2c449fac-7165-449a-ab5a-2834befff1fe'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:49.445022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] The token cache is being invalidate because project 692362d52ef24923bd7093b1e81dbd35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:49.445581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:49.449152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:49.455332 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2300/4608] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:49 2021] DELETE /identity/v3/projects/692362d52ef24923bd7093b1e81dbd35 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:49.459069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204aac5-8700-43d9-9e5e-6276ed24452f service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:49.470318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204aac5-8700-43d9-9e5e-6276ed24452f service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:49.575059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538235f-390b-4a3c-9273-36ad14513130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:49.576304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538235f-390b-4a3c-9273-36ad14513130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:49.576586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538235f-390b-4a3c-9273-36ad14513130 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:49.577032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538235f-390b-4a3c-9273-36ad14513130 admin admin] PATH_INFO: `/v3/users/7a76bb1f7898419dba7f4c53367144b3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:49.578766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538235f-390b-4a3c-9273-36ad14513130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a76bb1f7898419dba7f4c53367144b3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:49.581348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538235f-390b-4a3c-9273-36ad14513130 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:49.641825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c538235f-390b-4a3c-9273-36ad14513130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a76bb1f7898419dba7f4c53367144b3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:49.654369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c538235f-390b-4a3c-9273-36ad14513130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a76bb1f7898419dba7f4c53367144b3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:49.655834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c538235f-390b-4a3c-9273-36ad14513130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a76bb1f7898419dba7f4c53367144b3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:49.666032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c538235f-390b-4a3c-9273-36ad14513130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a76bb1f7898419dba7f4c53367144b3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:49.679717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c538235f-390b-4a3c-9273-36ad14513130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a76bb1f7898419dba7f4c53367144b3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:49.688086 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2309/4609] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:49 2021] DELETE /identity/v3/users/7a76bb1f7898419dba7f4c53367144b3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:50.394119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:50.396645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:50.410007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c449fac-7165-449a-ab5a-2834befff1fe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:50.477115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:50.478275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:50.478716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:50.479158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] PATH_INFO: `/v3/projects/33cdda2f73e34fa5b4bc5de60c253c05` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:50.480644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33cdda2f73e34fa5b4bc5de60c253c05)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:50.482917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:50.539014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33cdda2f73e34fa5b4bc5de60c253c05', 'request_id': 'req-7b4101f2-0a06-44d1-abb6-accfd07da095'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:50.546316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33cdda2f73e34fa5b4bc5de60c253c05', 'request_id': 'req-7b4101f2-0a06-44d1-abb6-accfd07da095'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:50.560169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33cdda2f73e34fa5b4bc5de60c253c05', 'request_id': 'req-7b4101f2-0a06-44d1-abb6-accfd07da095'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:50.578028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] The token cache is being invalidate because project 33cdda2f73e34fa5b4bc5de60c253c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:50.578578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:50.579652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b4101f2-0a06-44d1-abb6-accfd07da095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:50.581961 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2301/4610] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:50 2021] DELETE /identity/v3/projects/33cdda2f73e34fa5b4bc5de60c253c05 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:50.592469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad25f5-38f6-4cc3-a1e6-9f7d4b7a03e6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:50.593444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad25f5-38f6-4cc3-a1e6-9f7d4b7a03e6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:50.593876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad25f5-38f6-4cc3-a1e6-9f7d4b7a03e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:50.621206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-42ad25f5-38f6-4cc3-a1e6-9f7d4b7a03e6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:50.623038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-42ad25f5-38f6-4cc3-a1e6-9f7d4b7a03e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:50.741620 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2310/4611] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:50.750858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757b75-980e-4fe3-a490-07f8d841be52 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:50.751151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757b75-980e-4fe3-a490-07f8d841be52 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:50.751534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757b75-980e-4fe3-a490-07f8d841be52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:50.789319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5e757b75-980e-4fe3-a490-07f8d841be52 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:50.791137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5e757b75-980e-4fe3-a490-07f8d841be52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:50.807471 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2302/4612] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:50.808322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad25f5-38f6-4cc3-a1e6-9f7d4b7a03e6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:50.819867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad25f5-38f6-4cc3-a1e6-9f7d4b7a03e6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:50.824994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b4310-3db6-45b6-8c26-21fd09630bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:50.826542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b4310-3db6-45b6-8c26-21fd09630bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:50.826988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b4310-3db6-45b6-8c26-21fd09630bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:50.827460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b4310-3db6-45b6-8c26-21fd09630bc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:50.828926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b4310-3db6-45b6-8c26-21fd09630bc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:50.829425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b4310-3db6-45b6-8c26-21fd09630bc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:50.831169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b4310-3db6-45b6-8c26-21fd09630bc8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:50.846575 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2311/4613] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:50.851542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e757b75-980e-4fe3-a490-07f8d841be52 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:50.863277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e757b75-980e-4fe3-a490-07f8d841be52 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:50.869089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aca18-e9cd-4ed6-a518-de06edcf845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:50.869774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aca18-e9cd-4ed6-a518-de06edcf845d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:50.870059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aca18-e9cd-4ed6-a518-de06edcf845d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:50.870330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aca18-e9cd-4ed6-a518-de06edcf845d admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:50.871050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92aca18-e9cd-4ed6-a518-de06edcf845d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:50.873426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92aca18-e9cd-4ed6-a518-de06edcf845d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:50.906334 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2303/4614] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:50 2021] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:50.907372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b4310-3db6-45b6-8c26-21fd09630bc8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:50.921366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b4310-3db6-45b6-8c26-21fd09630bc8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:51.002236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2e2e-3011-454c-baf1-4ae6c958e4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:51.002842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2e2e-3011-454c-baf1-4ae6c958e4ce admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.003125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2e2e-3011-454c-baf1-4ae6c958e4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.003453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f2e2e-3011-454c-baf1-4ae6c958e4ce admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.004153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f2e2e-3011-454c-baf1-4ae6c958e4ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:51.006089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f2e2e-3011-454c-baf1-4ae6c958e4ce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:51.036578 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2312/4615] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:50 2021] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:51.037787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aca18-e9cd-4ed6-a518-de06edcf845d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:51.053680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aca18-e9cd-4ed6-a518-de06edcf845d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:51.058707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32930899-66ca-46be-83f1-350efa3e396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:51.059475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930899-66ca-46be-83f1-350efa3e396d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.059833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930899-66ca-46be-83f1-350efa3e396d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.060176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930899-66ca-46be-83f1-350efa3e396d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.061291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32930899-66ca-46be-83f1-350efa3e396d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:51.062855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32930899-66ca-46be-83f1-350efa3e396d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:51.079278 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2304/4616] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:51 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:58:51.081185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2e2e-3011-454c-baf1-4ae6c958e4ce admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:51.097104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f2e2e-3011-454c-baf1-4ae6c958e4ce admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:51.107379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e58420-f126-40ac-a72c-7bdfd6380dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:51.107379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e58420-f126-40ac-a72c-7bdfd6380dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.107379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e58420-f126-40ac-a72c-7bdfd6380dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.107379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e58420-f126-40ac-a72c-7bdfd6380dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.107994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e58420-f126-40ac-a72c-7bdfd6380dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:51.109043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e58420-f126-40ac-a72c-7bdfd6380dd7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:51.132660 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2313/4617] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:51 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:51.136992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32930899-66ca-46be-83f1-350efa3e396d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:51.163432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32930899-66ca-46be-83f1-350efa3e396d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:51.176891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01f12-620f-4c10-89c0-5b3907c5a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:51.177951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01f12-620f-4c10-89c0-5b3907c5a27e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.178239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01f12-620f-4c10-89c0-5b3907c5a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.178681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01f12-620f-4c10-89c0-5b3907c5a27e admin admin] PATH_INFO: `/v3/projects/bf42f5573c9140deae4547fc2ce5a717/users/f3053a5803ce445c8dc88bbab94d6d5f/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.197197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01f12-620f-4c10-89c0-5b3907c5a27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf42f5573c9140deae4547fc2ce5a717, user_id=f3053a5803ce445c8dc88bbab94d6d5f, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:51.201193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01f12-620f-4c10-89c0-5b3907c5a27e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:51.223055 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2305/4618] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:51 2021] PUT /identity/v3/projects/bf42f5573c9140deae4547fc2ce5a717/users/f3053a5803ce445c8dc88bbab94d6d5f/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:51.237540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08df103-eef9-492e-b50a-c90db2d0900f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.238565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08df103-eef9-492e-b50a-c90db2d0900f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.238875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08df103-eef9-492e-b50a-c90db2d0900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.289096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b08df103-eef9-492e-b50a-c90db2d0900f None None] MFA Rules not processed for user `f3053a5803ce445c8dc88bbab94d6d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:51.292123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b08df103-eef9-492e-b50a-c90db2d0900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:51.429208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01f12-620f-4c10-89c0-5b3907c5a27e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:51.431120 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2314/4619] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:51 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:51.554727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01f12-620f-4c10-89c0-5b3907c5a27e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:51.559885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a42a29-8fe7-42cf-8398-801d3876a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:51.560783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a42a29-8fe7-42cf-8398-801d3876a98e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.561225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a42a29-8fe7-42cf-8398-801d3876a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.561656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a42a29-8fe7-42cf-8398-801d3876a98e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.562725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a42a29-8fe7-42cf-8398-801d3876a98e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:51.564837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a42a29-8fe7-42cf-8398-801d3876a98e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:51.605445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08df103-eef9-492e-b50a-c90db2d0900f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:51.616816 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2306/4620] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:51 2021] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:51.620070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08df103-eef9-492e-b50a-c90db2d0900f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:51.678801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb1c0d-cc20-4e61-ad6f-a68792d7ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:51.679566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1c0d-cc20-4e61-ad6f-a68792d7ffef admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.679850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1c0d-cc20-4e61-ad6f-a68792d7ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.680124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1c0d-cc20-4e61-ad6f-a68792d7ffef admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.681167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb1c0d-cc20-4e61-ad6f-a68792d7ffef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:51.683266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb1c0d-cc20-4e61-ad6f-a68792d7ffef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:51.709244 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2315/4621] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:51 2021] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:51.710446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a42a29-8fe7-42cf-8398-801d3876a98e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:51.721811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a42a29-8fe7-42cf-8398-801d3876a98e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:51.728072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86116973-c0c3-4de1-aa99-ae6ce4ca434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:51.729115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116973-c0c3-4de1-aa99-ae6ce4ca434d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.729396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116973-c0c3-4de1-aa99-ae6ce4ca434d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.729962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116973-c0c3-4de1-aa99-ae6ce4ca434d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.730919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86116973-c0c3-4de1-aa99-ae6ce4ca434d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:51.732829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86116973-c0c3-4de1-aa99-ae6ce4ca434d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:51.749415 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2307/4622] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:51 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:51.750913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb1c0d-cc20-4e61-ad6f-a68792d7ffef admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:51.762291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb1c0d-cc20-4e61-ad6f-a68792d7ffef admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:51.767705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e5ed5-dbd1-417d-b3b0-48c5723406d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:51.768729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5ed5-dbd1-417d-b3b0-48c5723406d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.769146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5ed5-dbd1-417d-b3b0-48c5723406d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.769550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e5ed5-dbd1-417d-b3b0-48c5723406d5 admin admin] PATH_INFO: `/v3/projects/ce01200f5e8b438c87ac1b25a73bde8a/users/9d080ef150a84e109a25286e5dc2408c/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.788801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e5ed5-dbd1-417d-b3b0-48c5723406d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce01200f5e8b438c87ac1b25a73bde8a, user_id=9d080ef150a84e109a25286e5dc2408c, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:51.791698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e5ed5-dbd1-417d-b3b0-48c5723406d5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:51.806643 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2316/4623] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:51 2021] PUT /identity/v3/projects/ce01200f5e8b438c87ac1b25a73bde8a/users/9d080ef150a84e109a25286e5dc2408c/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:51.810671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86116973-c0c3-4de1-aa99-ae6ce4ca434d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:51.825307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86116973-c0c3-4de1-aa99-ae6ce4ca434d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:51.889914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68528e8b-f4e3-48ed-836e-c0d7d1aee5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:51.890584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528e8b-f4e3-48ed-836e-c0d7d1aee5ac admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.890865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528e8b-f4e3-48ed-836e-c0d7d1aee5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.891135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528e8b-f4e3-48ed-836e-c0d7d1aee5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.891899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68528e8b-f4e3-48ed-836e-c0d7d1aee5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:51.893652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68528e8b-f4e3-48ed-836e-c0d7d1aee5ac admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:51.908328 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2308/4624] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:51 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:51.910581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e5ed5-dbd1-417d-b3b0-48c5723406d5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:51.922977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e5ed5-dbd1-417d-b3b0-48c5723406d5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:51.928739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d103c-9c2a-4bb0-ad8e-0e916ee46aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:51.929723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d103c-9c2a-4bb0-ad8e-0e916ee46aee admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.930095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d103c-9c2a-4bb0-ad8e-0e916ee46aee admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.930437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d103c-9c2a-4bb0-ad8e-0e916ee46aee admin admin] PATH_INFO: `/v3/projects/ce01200f5e8b438c87ac1b25a73bde8a/users/9d080ef150a84e109a25286e5dc2408c/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.933363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d103c-9c2a-4bb0-ad8e-0e916ee46aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce01200f5e8b438c87ac1b25a73bde8a, user_id=9d080ef150a84e109a25286e5dc2408c, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:51.936299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d103c-9c2a-4bb0-ad8e-0e916ee46aee admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:51.951300 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2317/4625] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:51 2021] PUT /identity/v3/projects/ce01200f5e8b438c87ac1b25a73bde8a/users/9d080ef150a84e109a25286e5dc2408c/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:51.960899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fe980-b8e5-459a-9442-3ec81e14136e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:51.961544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fe980-b8e5-459a-9442-3ec81e14136e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:51.962026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fe980-b8e5-459a-9442-3ec81e14136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:51.994381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-857fe980-b8e5-459a-9442-3ec81e14136e None None] MFA Rules not processed for user `9d080ef150a84e109a25286e5dc2408c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:51.995980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-857fe980-b8e5-459a-9442-3ec81e14136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:52.074406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2309/4626] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:51 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:52.078560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d103c-9c2a-4bb0-ad8e-0e916ee46aee admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.091263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d103c-9c2a-4bb0-ad8e-0e916ee46aee admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.096423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c44d4-d01a-45d2-b13a-906967b4139a tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.097074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c44d4-d01a-45d2-b13a-906967b4139a tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.097356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c44d4-d01a-45d2-b13a-906967b4139a tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.097796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c44d4-d01a-45d2-b13a-906967b4139a tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.099189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c44d4-d01a-45d2-b13a-906967b4139a tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.100868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c44d4-d01a-45d2-b13a-906967b4139a tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.131307 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2318/4627] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:52 2021] POST /identity/v3/services => generated 290 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:52.134266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fe980-b8e5-459a-9442-3ec81e14136e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.153097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fe980-b8e5-459a-9442-3ec81e14136e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.173746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4d068-0532-4126-9854-fb2080407578 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.175006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d068-0532-4126-9854-fb2080407578 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.175499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d068-0532-4126-9854-fb2080407578 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.175910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4d068-0532-4126-9854-fb2080407578 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.176955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4d068-0532-4126-9854-fb2080407578 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.178278 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-a1e4d068-0532-4126-9854-fb2080407578 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:52.178278 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:58:52.178278 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:58:52.179676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4d068-0532-4126-9854-fb2080407578 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.207289 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2310/4628] 10.222.0.21 () {60 vars in 1212 bytes} [Sat Nov 27 20:58:52 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:52.209286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c44d4-d01a-45d2-b13a-906967b4139a tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.226205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c44d4-d01a-45d2-b13a-906967b4139a tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.241301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb516e-4bd8-475c-ab74-9c59e7f3a5d6 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.243860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb516e-4bd8-475c-ab74-9c59e7f3a5d6 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.244362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb516e-4bd8-475c-ab74-9c59e7f3a5d6 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.244813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb516e-4bd8-475c-ab74-9c59e7f3a5d6 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.248409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb516e-4bd8-475c-ab74-9c59e7f3a5d6 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.250212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb516e-4bd8-475c-ab74-9c59e7f3a5d6 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.282088 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2319/4629] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:52 2021] POST /identity/v3/services => generated 288 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:52.286135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4d068-0532-4126-9854-fb2080407578 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.299392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4d068-0532-4126-9854-fb2080407578 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.320926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68132b4-7b3e-4320-99f9-21f82cc4aff4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.321884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68132b4-7b3e-4320-99f9-21f82cc4aff4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.322395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68132b4-7b3e-4320-99f9-21f82cc4aff4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.323460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68132b4-7b3e-4320-99f9-21f82cc4aff4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.324329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68132b4-7b3e-4320-99f9-21f82cc4aff4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.326209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68132b4-7b3e-4320-99f9-21f82cc4aff4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.336758 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2311/4630] 10.222.0.21 () {60 vars in 1212 bytes} [Sat Nov 27 20:58:52 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:52.341584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb516e-4bd8-475c-ab74-9c59e7f3a5d6 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.355394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb516e-4bd8-475c-ab74-9c59e7f3a5d6 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.363122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159bd3-92e3-4519-be82-e519f2923be9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.364206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159bd3-92e3-4519-be82-e519f2923be9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.364840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159bd3-92e3-4519-be82-e519f2923be9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.365556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6159bd3-92e3-4519-be82-e519f2923be9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.366483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6159bd3-92e3-4519-be82-e519f2923be9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.367964 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-d6159bd3-92e3-4519-be82-e519f2923be9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoint_groups failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:52.367964 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:58:52.367964 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:58:52.369375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6159bd3-92e3-4519-be82-e519f2923be9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.383311 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2320/4631] 10.222.0.21 () {58 vars in 1190 bytes} [Sat Nov 27 20:58:52 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:52.385485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68132b4-7b3e-4320-99f9-21f82cc4aff4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.396927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68132b4-7b3e-4320-99f9-21f82cc4aff4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.403432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50460405-fb82-4a78-8a35-d620df7e992b tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.404447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50460405-fb82-4a78-8a35-d620df7e992b tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.404913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50460405-fb82-4a78-8a35-d620df7e992b tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.405336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50460405-fb82-4a78-8a35-d620df7e992b tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c002de1a684a4fddb8072eefb51f5ca7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.406156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50460405-fb82-4a78-8a35-d620df7e992b tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=c002de1a684a4fddb8072eefb51f5ca7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.407527 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-50460405-fb82-4a78-8a35-d620df7e992b tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_endpoint_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:52.407527 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:58:52.407527 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:58:52.408743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50460405-fb82-4a78-8a35-d620df7e992b tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.416483 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2312/4632] 10.222.0.21 () {58 vars in 1289 bytes} [Sat Nov 27 20:58:52 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups/c002de1a684a4fddb8072eefb51f5ca7 => generated 333 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:52.420456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159bd3-92e3-4519-be82-e519f2923be9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.443169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6159bd3-92e3-4519-be82-e519f2923be9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.452919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b528d8-cfdc-46ef-a5f3-ed6a2bce0500 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.453953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b528d8-cfdc-46ef-a5f3-ed6a2bce0500 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.454427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b528d8-cfdc-46ef-a5f3-ed6a2bce0500 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.455027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b528d8-cfdc-46ef-a5f3-ed6a2bce0500 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c002de1a684a4fddb8072eefb51f5ca7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.455905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b528d8-cfdc-46ef-a5f3-ed6a2bce0500 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=c002de1a684a4fddb8072eefb51f5ca7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.457066 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-a5b528d8-cfdc-46ef-a5f3-ed6a2bce0500 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_endpoint_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:52.457066 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:58:52.457066 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:58:52.458860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b528d8-cfdc-46ef-a5f3-ed6a2bce0500 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.466769 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2321/4633] 10.222.0.21 () {58 vars in 1290 bytes} [Sat Nov 27 20:58:52 2021] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/c002de1a684a4fddb8072eefb51f5ca7 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:52.471602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50460405-fb82-4a78-8a35-d620df7e992b tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.483355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50460405-fb82-4a78-8a35-d620df7e992b tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.488689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2280ccd-26c0-4cc1-bf95-e05c3aab30e4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.489893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2280ccd-26c0-4cc1-bf95-e05c3aab30e4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.490615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2280ccd-26c0-4cc1-bf95-e05c3aab30e4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.491198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2280ccd-26c0-4cc1-bf95-e05c3aab30e4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c002de1a684a4fddb8072eefb51f5ca7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.492172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2280ccd-26c0-4cc1-bf95-e05c3aab30e4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=c002de1a684a4fddb8072eefb51f5ca7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.493529 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-d2280ccd-26c0-4cc1-bf95-e05c3aab30e4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_endpoint_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:52.493529 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:58:52.493529 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:58:52.494848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2280ccd-26c0-4cc1-bf95-e05c3aab30e4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.514147 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2313/4634] 10.222.0.21 () {58 vars in 1292 bytes} [Sat Nov 27 20:58:52 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/c002de1a684a4fddb8072eefb51f5ca7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:52.515369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b528d8-cfdc-46ef-a5f3-ed6a2bce0500 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.527212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b528d8-cfdc-46ef-a5f3-ed6a2bce0500 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.532588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e4ecc-c900-4492-94bf-5fdb9a440372 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.533229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e4ecc-c900-4492-94bf-5fdb9a440372 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.533512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e4ecc-c900-4492-94bf-5fdb9a440372 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.533788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e4ecc-c900-4492-94bf-5fdb9a440372 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.534493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e4ecc-c900-4492-94bf-5fdb9a440372 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.536237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e4ecc-c900-4492-94bf-5fdb9a440372 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.563402 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2322/4635] 10.222.0.21 () {58 vars in 1190 bytes} [Sat Nov 27 20:58:52 2021] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:58:52.565653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2280ccd-26c0-4cc1-bf95-e05c3aab30e4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.587550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2280ccd-26c0-4cc1-bf95-e05c3aab30e4 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.592740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b1bb-eb69-47fb-84ee-49958b89a308 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.594043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b1bb-eb69-47fb-84ee-49958b89a308 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.594390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b1bb-eb69-47fb-84ee-49958b89a308 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.594737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b1bb-eb69-47fb-84ee-49958b89a308 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c002de1a684a4fddb8072eefb51f5ca7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.595496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494b1bb-eb69-47fb-84ee-49958b89a308 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=c002de1a684a4fddb8072eefb51f5ca7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.597624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494b1bb-eb69-47fb-84ee-49958b89a308 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.610452 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-3494b1bb-eb69-47fb-84ee-49958b89a308 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Could not find Endpoint Group: c002de1a684a4fddb8072eefb51f5ca7.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: c002de1a684a4fddb8072eefb51f5ca7. Nov 27 20:58:52.615807 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2314/4636] 10.222.0.21 () {58 vars in 1292 bytes} [Sat Nov 27 20:58:52 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/c002de1a684a4fddb8072eefb51f5ca7 => generated 120 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 20:58:52.617326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e4ecc-c900-4492-94bf-5fdb9a440372 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.635677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e4ecc-c900-4492-94bf-5fdb9a440372 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.640926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c4ec2-8242-4d74-b502-92a7f63122b7 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.641896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4ec2-8242-4d74-b502-92a7f63122b7 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.642359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4ec2-8242-4d74-b502-92a7f63122b7 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.642798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4ec2-8242-4d74-b502-92a7f63122b7 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/services/918de9745fd94f379dfbdbde4f60e9ba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.643501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c4ec2-8242-4d74-b502-92a7f63122b7 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:delete_service(service_id=918de9745fd94f379dfbdbde4f60e9ba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.644505 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-d38c4ec2-8242-4d74-b502-92a7f63122b7 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:52.644505 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:58:52.644505 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:58:52.645439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c4ec2-8242-4d74-b502-92a7f63122b7 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.679342 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2323/4637] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:52 2021] DELETE /identity/v3/services/918de9745fd94f379dfbdbde4f60e9ba => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:52.682891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b1bb-eb69-47fb-84ee-49958b89a308 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.695181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b1bb-eb69-47fb-84ee-49958b89a308 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.715927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cd1d2-e7d5-4d5a-9e99-49533f6acfa9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.716886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd1d2-e7d5-4d5a-9e99-49533f6acfa9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.717430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd1d2-e7d5-4d5a-9e99-49533f6acfa9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.717921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cd1d2-e7d5-4d5a-9e99-49533f6acfa9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.718871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cd1d2-e7d5-4d5a-9e99-49533f6acfa9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.720848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cd1d2-e7d5-4d5a-9e99-49533f6acfa9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.738680 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2315/4638] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:52 2021] POST /identity/v3/services => generated 287 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:52.743109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c4ec2-8242-4d74-b502-92a7f63122b7 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.755938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c4ec2-8242-4d74-b502-92a7f63122b7 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.771984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adf0fe-b78e-40f1-a487-18678631fcbf tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.772634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adf0fe-b78e-40f1-a487-18678631fcbf tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.772917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adf0fe-b78e-40f1-a487-18678631fcbf tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.773194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adf0fe-b78e-40f1-a487-18678631fcbf tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.774191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adf0fe-b78e-40f1-a487-18678631fcbf tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.775755 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-b6adf0fe-b78e-40f1-a487-18678631fcbf tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:52.775755 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:58:52.775755 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:58:52.776683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adf0fe-b78e-40f1-a487-18678631fcbf tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.791408 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2324/4639] 10.222.0.21 () {60 vars in 1212 bytes} [Sat Nov 27 20:58:52 2021] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:52.792595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cd1d2-e7d5-4d5a-9e99-49533f6acfa9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.805239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cd1d2-e7d5-4d5a-9e99-49533f6acfa9 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.810673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf55b58-4e6d-488c-b166-9654867878fc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.811567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf55b58-4e6d-488c-b166-9654867878fc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.811857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf55b58-4e6d-488c-b166-9654867878fc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.812305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf55b58-4e6d-488c-b166-9654867878fc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.813662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf55b58-4e6d-488c-b166-9654867878fc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.815577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf55b58-4e6d-488c-b166-9654867878fc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.835564 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2316/4640] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:52 2021] POST /identity/v3/services => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:58:52.839388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adf0fe-b78e-40f1-a487-18678631fcbf tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.853085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adf0fe-b78e-40f1-a487-18678631fcbf tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.874178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05d5bb-dc1a-4bc9-b873-1f4bf085a421 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.875363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05d5bb-dc1a-4bc9-b873-1f4bf085a421 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.875717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05d5bb-dc1a-4bc9-b873-1f4bf085a421 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.876062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05d5bb-dc1a-4bc9-b873-1f4bf085a421 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/57202cd1d42d418182d2dbf77a8ec560` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.877031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05d5bb-dc1a-4bc9-b873-1f4bf085a421 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=57202cd1d42d418182d2dbf77a8ec560)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.878452 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-3a05d5bb-dc1a-4bc9-b873-1f4bf085a421 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_endpoint_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:52.878452 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:58:52.878452 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:58:52.879850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05d5bb-dc1a-4bc9-b873-1f4bf085a421 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.893441 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2325/4641] 10.222.0.21 () {60 vars in 1312 bytes} [Sat Nov 27 20:58:52 2021] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/57202cd1d42d418182d2dbf77a8ec560 => generated 333 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:52.895044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf55b58-4e6d-488c-b166-9654867878fc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.907285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf55b58-4e6d-488c-b166-9654867878fc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.912755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d0dd1-eac6-4dcd-b644-1b0903fd6347 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.913789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0dd1-eac6-4dcd-b644-1b0903fd6347 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.914085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0dd1-eac6-4dcd-b644-1b0903fd6347 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.914371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0dd1-eac6-4dcd-b644-1b0903fd6347 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/services/850b27850bb648819dda678f90cc859c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.915043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d0dd1-eac6-4dcd-b644-1b0903fd6347 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:delete_service(service_id=850b27850bb648819dda678f90cc859c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.916119 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-d16d0dd1-eac6-4dcd-b644-1b0903fd6347 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:52.916119 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:58:52.916119 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:58:52.917012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d0dd1-eac6-4dcd-b644-1b0903fd6347 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.945235 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2317/4642] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:52 2021] DELETE /identity/v3/services/850b27850bb648819dda678f90cc859c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:52.949355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05d5bb-dc1a-4bc9-b873-1f4bf085a421 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:52.961303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05d5bb-dc1a-4bc9-b873-1f4bf085a421 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:52.977241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ad261-ef66-4a37-84ed-1936851994a3 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:52.978400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ad261-ef66-4a37-84ed-1936851994a3 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:52.978679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ad261-ef66-4a37-84ed-1936851994a3 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:52.978955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ad261-ef66-4a37-84ed-1936851994a3 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/57202cd1d42d418182d2dbf77a8ec560` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:52.979758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ad261-ef66-4a37-84ed-1936851994a3 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=57202cd1d42d418182d2dbf77a8ec560)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:52.980964 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-921ad261-ef66-4a37-84ed-1936851994a3 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_endpoint_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:58:52.980964 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:58:52.980964 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:58:52.981911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ad261-ef66-4a37-84ed-1936851994a3 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:52.992448 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2326/4643] 10.222.0.21 () {58 vars in 1292 bytes} [Sat Nov 27 20:58:52 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/57202cd1d42d418182d2dbf77a8ec560 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:52.996720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d0dd1-eac6-4dcd-b644-1b0903fd6347 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:53.011775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d0dd1-eac6-4dcd-b644-1b0903fd6347 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:53.018174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66f6f5-cbd7-4158-ba41-ffaff9a6e838 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:53.019173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66f6f5-cbd7-4158-ba41-ffaff9a6e838 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:53.019543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66f6f5-cbd7-4158-ba41-ffaff9a6e838 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:53.019822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66f6f5-cbd7-4158-ba41-ffaff9a6e838 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/services/f635fb121d4949d18551a6f3ad042603` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:53.021200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66f6f5-cbd7-4158-ba41-ffaff9a6e838 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f635fb121d4949d18551a6f3ad042603)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:53.022865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66f6f5-cbd7-4158-ba41-ffaff9a6e838 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:53.045684 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2318/4644] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:52 2021] DELETE /identity/v3/services/f635fb121d4949d18551a6f3ad042603 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:53.050815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ad261-ef66-4a37-84ed-1936851994a3 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:53.061434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ad261-ef66-4a37-84ed-1936851994a3 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:53.078169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05556e2d-a8d9-44fe-bddd-58041d5786dc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:53.079052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05556e2d-a8d9-44fe-bddd-58041d5786dc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:53.079389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05556e2d-a8d9-44fe-bddd-58041d5786dc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:53.079660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05556e2d-a8d9-44fe-bddd-58041d5786dc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8db609064f6b4cb0a1bf90697d637801` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:53.080356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05556e2d-a8d9-44fe-bddd-58041d5786dc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=8db609064f6b4cb0a1bf90697d637801)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:53.081947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05556e2d-a8d9-44fe-bddd-58041d5786dc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:53.093553 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2327/4645] 10.222.0.21 () {58 vars in 1292 bytes} [Sat Nov 27 20:58:53 2021] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/8db609064f6b4cb0a1bf90697d637801 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:53.098148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66f6f5-cbd7-4158-ba41-ffaff9a6e838 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:53.112675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66f6f5-cbd7-4158-ba41-ffaff9a6e838 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:53.117583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccc716-eb8e-4c4a-ac59-d16751231448 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d080ef150a84e109a25286e5dc2408c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce01200f5e8b438c87ac1b25a73bde8a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:53.118906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc716-eb8e-4c4a-ac59-d16751231448 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:53.119343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc716-eb8e-4c4a-ac59-d16751231448 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:53.119565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc716-eb8e-4c4a-ac59-d16751231448 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] PATH_INFO: `/v3/services/af2eaf1ec7524744a21591e486332cdd` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:53.120465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccc716-eb8e-4c4a-ac59-d16751231448 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorizing `identity:delete_service(service_id=af2eaf1ec7524744a21591e486332cdd)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:53.122697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccc716-eb8e-4c4a-ac59-d16751231448 tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:53.153643 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2319/4646] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:53 2021] DELETE /identity/v3/services/af2eaf1ec7524744a21591e486332cdd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:53.157534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05556e2d-a8d9-44fe-bddd-58041d5786dc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:53.236780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05556e2d-a8d9-44fe-bddd-58041d5786dc tempest-EndPointGroupsTest-381792787 tempest-EndPointGroupsTest-381792787-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:53.254008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:53.255440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:53.255721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:53.256033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] PATH_INFO: `/v3/users/f3053a5803ce445c8dc88bbab94d6d5f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:53.257332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3053a5803ce445c8dc88bbab94d6d5f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:53.259340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:53.313449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3053a5803ce445c8dc88bbab94d6d5f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:53.323811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3053a5803ce445c8dc88bbab94d6d5f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:53.324575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3053a5803ce445c8dc88bbab94d6d5f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:53.332980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3053a5803ce445c8dc88bbab94d6d5f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:53.347670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3053a5803ce445c8dc88bbab94d6d5f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:53.354319 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2328/4647] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:53 2021] DELETE /identity/v3/users/f3053a5803ce445c8dc88bbab94d6d5f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:53.359037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bab9-19fc-4399-a8c2-8ce36f856ad7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:53.359371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bab9-19fc-4399-a8c2-8ce36f856ad7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:53.359630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bab9-19fc-4399-a8c2-8ce36f856ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:53.386036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-bcd8bab9-19fc-4399-a8c2-8ce36f856ad7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:53.388052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bcd8bab9-19fc-4399-a8c2-8ce36f856ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:53.491207 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2320/4648] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:53.504314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:53.506370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:53.514151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8bab9-19fc-4399-a8c2-8ce36f856ad7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:53.515675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bcd8bab9-19fc-4399-a8c2-8ce36f856ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:53.536187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8bab9-19fc-4399-a8c2-8ce36f856ad7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:53.543566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbef02-f0a7-408f-85f9-8654a74376db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:53.546082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbef02-f0a7-408f-85f9-8654a74376db admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:53.546375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbef02-f0a7-408f-85f9-8654a74376db admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:53.546656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbef02-f0a7-408f-85f9-8654a74376db admin admin] PATH_INFO: `/v3/users/c63392cdec1047d6b96967fb9a89b1da` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:53.548078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbef02-f0a7-408f-85f9-8654a74376db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c63392cdec1047d6b96967fb9a89b1da)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:53.550147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbef02-f0a7-408f-85f9-8654a74376db admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:53.621239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4fbef02-f0a7-408f-85f9-8654a74376db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63392cdec1047d6b96967fb9a89b1da'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:53.622711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4fbef02-f0a7-408f-85f9-8654a74376db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63392cdec1047d6b96967fb9a89b1da'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:53.636139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4fbef02-f0a7-408f-85f9-8654a74376db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63392cdec1047d6b96967fb9a89b1da'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:53.637315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4fbef02-f0a7-408f-85f9-8654a74376db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63392cdec1047d6b96967fb9a89b1da'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:53.647065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4fbef02-f0a7-408f-85f9-8654a74376db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63392cdec1047d6b96967fb9a89b1da'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:53.666555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9e48d-7ece-4332-925a-ff4821c8d978 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:53.668516 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2321/4649] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:53 2021] DELETE /identity/v3/users/c63392cdec1047d6b96967fb9a89b1da => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:53.672948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1a649-af1b-4f4a-8ed2-0117a2dc5d62 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:53.673722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1a649-af1b-4f4a-8ed2-0117a2dc5d62 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:53.674209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1a649-af1b-4f4a-8ed2-0117a2dc5d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:53.694393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5bb1a649-af1b-4f4a-8ed2-0117a2dc5d62 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:53.696004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5bb1a649-af1b-4f4a-8ed2-0117a2dc5d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:53.748857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf33d9-c12a-4e36-bdb7-8be5398e8773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:53.750151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf33d9-c12a-4e36-bdb7-8be5398e8773 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:53.750786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf33d9-c12a-4e36-bdb7-8be5398e8773 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:53.751221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf33d9-c12a-4e36-bdb7-8be5398e8773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:53.754429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0edf33d9-c12a-4e36-bdb7-8be5398e8773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:53.791497 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2322/4650] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:53.804465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1a649-af1b-4f4a-8ed2-0117a2dc5d62 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:53.806751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5bb1a649-af1b-4f4a-8ed2-0117a2dc5d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:53.830762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf33d9-c12a-4e36-bdb7-8be5398e8773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:53.832233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf33d9-c12a-4e36-bdb7-8be5398e8773 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:53.835503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1a649-af1b-4f4a-8ed2-0117a2dc5d62 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:53.844980 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2329/4651] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:53.845726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95017df-913c-4b64-ae82-5e653be52ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:53.847457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95017df-913c-4b64-ae82-5e653be52ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:53.847987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95017df-913c-4b64-ae82-5e653be52ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:53.848532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95017df-913c-4b64-ae82-5e653be52ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:53.863319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95017df-913c-4b64-ae82-5e653be52ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:53.865384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95017df-913c-4b64-ae82-5e653be52ba2 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:53.879448 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2323/4652] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:54.232198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf33d9-c12a-4e36-bdb7-8be5398e8773 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:54.234738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0edf33d9-c12a-4e36-bdb7-8be5398e8773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:54.256275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf33d9-c12a-4e36-bdb7-8be5398e8773 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:54.262079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:54.262951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:54.263240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:54.263697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] PATH_INFO: `/v3/projects/2c6f1f00324d486499003a77e46b2854` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:54.264804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6f1f00324d486499003a77e46b2854)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:54.266717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:54.315171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6f1f00324d486499003a77e46b2854', 'request_id': 'req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.323056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6f1f00324d486499003a77e46b2854', 'request_id': 'req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.329496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6f1f00324d486499003a77e46b2854', 'request_id': 'req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.340109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] The token cache is being invalidate because project 2c6f1f00324d486499003a77e46b2854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:54.340396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.341049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.342633 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2330/4653] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:54 2021] DELETE /identity/v3/projects/2c6f1f00324d486499003a77e46b2854 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:54.348339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea916529-b58a-416b-b155-eb5909bf1d82 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:54.348727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea916529-b58a-416b-b155-eb5909bf1d82 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:54.349003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea916529-b58a-416b-b155-eb5909bf1d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:54.369103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ea916529-b58a-416b-b155-eb5909bf1d82 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:54.370352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ea916529-b58a-416b-b155-eb5909bf1d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:54.415683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:54.417533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:54.462577 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2324/4654] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:54.470784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c69b0-47d1-4f95-9cd4-b8dde4ca93e4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:54.471072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c69b0-47d1-4f95-9cd4-b8dde4ca93e4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:54.471369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c69b0-47d1-4f95-9cd4-b8dde4ca93e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:54.491679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8e0c69b0-47d1-4f95-9cd4-b8dde4ca93e4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:54.492905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8e0c69b0-47d1-4f95-9cd4-b8dde4ca93e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:54.501360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7a76e-e5be-4c93-afcd-52e69142ee9f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:54.501855 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2325/4655] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:54.506046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c69b0-47d1-4f95-9cd4-b8dde4ca93e4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:54.507871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:54.508781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:54.509071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:54.509348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] PATH_INFO: `/v3/projects/bf42f5573c9140deae4547fc2ce5a717` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:54.510673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf42f5573c9140deae4547fc2ce5a717)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:54.512769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:54.516033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c69b0-47d1-4f95-9cd4-b8dde4ca93e4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:54.521521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6993-115d-4dd4-ae38-1b4d979bac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:54.522183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6993-115d-4dd4-ae38-1b4d979bac54 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:54.522634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6993-115d-4dd4-ae38-1b4d979bac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:54.523067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6993-115d-4dd4-ae38-1b4d979bac54 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:54.523994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6993-115d-4dd4-ae38-1b4d979bac54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:54.524478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6993-115d-4dd4-ae38-1b4d979bac54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:54.526246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6993-115d-4dd4-ae38-1b4d979bac54 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:54.543690 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2326/4656] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:58:54.544572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6993-115d-4dd4-ae38-1b4d979bac54 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:54.557552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6993-115d-4dd4-ae38-1b4d979bac54 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:54.573672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf42f5573c9140deae4547fc2ce5a717', 'request_id': 'req-f3f2055e-c222-4bb2-81dc-503fd85c1b08'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.584537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf42f5573c9140deae4547fc2ce5a717', 'request_id': 'req-f3f2055e-c222-4bb2-81dc-503fd85c1b08'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.592384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf42f5573c9140deae4547fc2ce5a717', 'request_id': 'req-f3f2055e-c222-4bb2-81dc-503fd85c1b08'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.604300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] The token cache is being invalidate because project bf42f5573c9140deae4547fc2ce5a717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:54.604782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.605544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.610361 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2331/4657] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:54 2021] DELETE /identity/v3/projects/bf42f5573c9140deae4547fc2ce5a717 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:54.611321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:54.612824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:54.629909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf10d4-f870-42d7-9920-ddd55221dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:54.630569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf10d4-f870-42d7-9920-ddd55221dd30 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:54.630849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf10d4-f870-42d7-9920-ddd55221dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:54.631237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf10d4-f870-42d7-9920-ddd55221dd30 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:54.631989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf10d4-f870-42d7-9920-ddd55221dd30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:54.633883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf10d4-f870-42d7-9920-ddd55221dd30 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:54.669698 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2327/4658] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:54 2021] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:54.674031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf10d4-f870-42d7-9920-ddd55221dd30 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:54.677228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aaaf10d4-f870-42d7-9920-ddd55221dd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:54.702321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2055e-c222-4bb2-81dc-503fd85c1b08 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:54.752809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf10d4-f870-42d7-9920-ddd55221dd30 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:54.757845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c0a7b-d582-4395-9f5d-a62b83b29996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:54.758506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c0a7b-d582-4395-9f5d-a62b83b29996 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:54.758866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c0a7b-d582-4395-9f5d-a62b83b29996 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:54.759147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c0a7b-d582-4395-9f5d-a62b83b29996 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:54.759900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c0a7b-d582-4395-9f5d-a62b83b29996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:54.761828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c0a7b-d582-4395-9f5d-a62b83b29996 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:54.774256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810e689-df93-4242-a97f-c595348d8bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:54.775123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810e689-df93-4242-a97f-c595348d8bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:54.775567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810e689-df93-4242-a97f-c595348d8bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:54.776315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810e689-df93-4242-a97f-c595348d8bcd admin admin] PATH_INFO: `/v3/users/9d080ef150a84e109a25286e5dc2408c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:54.778033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810e689-df93-4242-a97f-c595348d8bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d080ef150a84e109a25286e5dc2408c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:54.780082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810e689-df93-4242-a97f-c595348d8bcd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:54.787127 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2328/4659] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:54 2021] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:54.791946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c0a7b-d582-4395-9f5d-a62b83b29996 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:54.804635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c0a7b-d582-4395-9f5d-a62b83b29996 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:54.810761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd167c2-6357-4e4b-9c69-9c7ade97505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:54.811812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd167c2-6357-4e4b-9c69-9c7ade97505b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:54.813585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd167c2-6357-4e4b-9c69-9c7ade97505b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:54.813585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd167c2-6357-4e4b-9c69-9c7ade97505b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:54.813585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd167c2-6357-4e4b-9c69-9c7ade97505b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:54.815301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd167c2-6357-4e4b-9c69-9c7ade97505b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:54.826832 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2329/4660] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:54 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:54.830235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f810e689-df93-4242-a97f-c595348d8bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d080ef150a84e109a25286e5dc2408c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.830782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd167c2-6357-4e4b-9c69-9c7ade97505b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:54.840243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f810e689-df93-4242-a97f-c595348d8bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d080ef150a84e109a25286e5dc2408c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.842362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f810e689-df93-4242-a97f-c595348d8bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d080ef150a84e109a25286e5dc2408c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.843302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd167c2-6357-4e4b-9c69-9c7ade97505b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:54.849320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e53960-20e3-4743-82ca-0d944db9fdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:54.850343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e53960-20e3-4743-82ca-0d944db9fdce admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:54.850836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e53960-20e3-4743-82ca-0d944db9fdce admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:54.851378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e53960-20e3-4743-82ca-0d944db9fdce admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:54.851526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f810e689-df93-4242-a97f-c595348d8bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d080ef150a84e109a25286e5dc2408c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.852453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e53960-20e3-4743-82ca-0d944db9fdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:54.854162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e53960-20e3-4743-82ca-0d944db9fdce admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:54.867587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f810e689-df93-4242-a97f-c595348d8bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d080ef150a84e109a25286e5dc2408c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:54.873620 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2330/4661] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:54 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:58:54.878122 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2332/4662] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:54 2021] DELETE /identity/v3/users/9d080ef150a84e109a25286e5dc2408c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:54.878282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e53960-20e3-4743-82ca-0d944db9fdce admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:54.880272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e7e53960-20e3-4743-82ca-0d944db9fdce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:54.896149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e53960-20e3-4743-82ca-0d944db9fdce admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:54.963482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20140ab3-d5f5-4c2a-ac0b-42fd8a2bc4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:54.964703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20140ab3-d5f5-4c2a-ac0b-42fd8a2bc4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:54.965142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20140ab3-d5f5-4c2a-ac0b-42fd8a2bc4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:54.965576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20140ab3-d5f5-4c2a-ac0b-42fd8a2bc4c1 admin admin] PATH_INFO: `/v3/projects/ca0593ed63ef4485bdc237459cf2f12e/users/a40da6fadf6c4e8bbeb5a4d5fc4cc1fd/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:54.985354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20140ab3-d5f5-4c2a-ac0b-42fd8a2bc4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0593ed63ef4485bdc237459cf2f12e, user_id=a40da6fadf6c4e8bbeb5a4d5fc4cc1fd, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:54.988520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20140ab3-d5f5-4c2a-ac0b-42fd8a2bc4c1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:55.020969 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2331/4663] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:54 2021] PUT /identity/v3/projects/ca0593ed63ef4485bdc237459cf2f12e/users/a40da6fadf6c4e8bbeb5a4d5fc4cc1fd/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:55.032607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28308c-6a5a-4e75-9bd1-6f630b96af10 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:55.033442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28308c-6a5a-4e75-9bd1-6f630b96af10 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:55.033655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28308c-6a5a-4e75-9bd1-6f630b96af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:55.085392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0e28308c-6a5a-4e75-9bd1-6f630b96af10 None None] MFA Rules not processed for user `a40da6fadf6c4e8bbeb5a4d5fc4cc1fd`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:55.089822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0e28308c-6a5a-4e75-9bd1-6f630b96af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:55.214950 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2333/4664] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:55 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:55.289671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20140ab3-d5f5-4c2a-ac0b-42fd8a2bc4c1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:55.292309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-20140ab3-d5f5-4c2a-ac0b-42fd8a2bc4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:55.419118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20140ab3-d5f5-4c2a-ac0b-42fd8a2bc4c1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:55.435880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536a9f-599a-40a3-8109-1819a6e4350b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:55.436554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536a9f-599a-40a3-8109-1819a6e4350b service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:55.436819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536a9f-599a-40a3-8109-1819a6e4350b service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:55.437093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536a9f-599a-40a3-8109-1819a6e4350b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:55.454517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02536a9f-599a-40a3-8109-1819a6e4350b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:55.456006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02536a9f-599a-40a3-8109-1819a6e4350b service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:55.482538 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2332/4665] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:55 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:58:55.729434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37ac0-cc3b-4c64-ba1c-11265d54018b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:55.730321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37ac0-cc3b-4c64-ba1c-11265d54018b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:55.730813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37ac0-cc3b-4c64-ba1c-11265d54018b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:55.793156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-43f37ac0-cc3b-4c64-ba1c-11265d54018b None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:55.794387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-43f37ac0-cc3b-4c64-ba1c-11265d54018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:55.880696 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2334/4666] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 20:58:55 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:55.895243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536a9f-599a-40a3-8109-1819a6e4350b service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:55.896697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-02536a9f-599a-40a3-8109-1819a6e4350b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:55.986049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f37ac0-cc3b-4c64-ba1c-11265d54018b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:55.988547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-43f37ac0-cc3b-4c64-ba1c-11265d54018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:56.062583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536a9f-599a-40a3-8109-1819a6e4350b service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:56.077978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50bddf-1858-4cec-9151-070a66ad5a2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:56.082236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50bddf-1858-4cec-9151-070a66ad5a2a service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:56.082741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50bddf-1858-4cec-9151-070a66ad5a2a service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:56.085931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50bddf-1858-4cec-9151-070a66ad5a2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:56.105272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50bddf-1858-4cec-9151-070a66ad5a2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:56.113039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50bddf-1858-4cec-9151-070a66ad5a2a service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:56.124676 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2333/4667] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:58:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:58:56.154005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f37ac0-cc3b-4c64-ba1c-11265d54018b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:56.160567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:56.162071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:56.162396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:56.162781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] PATH_INFO: `/v3/projects/ce01200f5e8b438c87ac1b25a73bde8a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:56.164348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce01200f5e8b438c87ac1b25a73bde8a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:56.166644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:56.273993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce01200f5e8b438c87ac1b25a73bde8a', 'request_id': 'req-4494cd10-893c-441a-a1c7-394dd68c1e70'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:56.290945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce01200f5e8b438c87ac1b25a73bde8a', 'request_id': 'req-4494cd10-893c-441a-a1c7-394dd68c1e70'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:56.304538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce01200f5e8b438c87ac1b25a73bde8a', 'request_id': 'req-4494cd10-893c-441a-a1c7-394dd68c1e70'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:56.331687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] The token cache is being invalidate because project ce01200f5e8b438c87ac1b25a73bde8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:56.334029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:56.334844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4494cd10-893c-441a-a1c7-394dd68c1e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:56.340394 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2335/4668] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:55 2021] DELETE /identity/v3/projects/ce01200f5e8b438c87ac1b25a73bde8a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:56.345328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1e2dd-1739-4873-996f-93cb7ac789d4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:56.345981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1e2dd-1739-4873-996f-93cb7ac789d4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:56.346446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1e2dd-1739-4873-996f-93cb7ac789d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:56.375382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-15b1e2dd-1739-4873-996f-93cb7ac789d4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:56.377139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-15b1e2dd-1739-4873-996f-93cb7ac789d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:56.528532 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2334/4669] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:56.529067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5ba6-58d1-4af3-8b2e-a7bcedd5e1f5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:56.529467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5ba6-58d1-4af3-8b2e-a7bcedd5e1f5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:56.529848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5ba6-58d1-4af3-8b2e-a7bcedd5e1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:56.563464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-345f5ba6-58d1-4af3-8b2e-a7bcedd5e1f5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:56.564936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-345f5ba6-58d1-4af3-8b2e-a7bcedd5e1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:56.580510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1e2dd-1739-4873-996f-93cb7ac789d4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:56.582768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-15b1e2dd-1739-4873-996f-93cb7ac789d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:56.604238 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2336/4670] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:58:56.606062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5ba6-58d1-4af3-8b2e-a7bcedd5e1f5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:56.625151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1e2dd-1739-4873-996f-93cb7ac789d4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:56.636633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5ba6-58d1-4af3-8b2e-a7bcedd5e1f5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:56.638028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447379b-5963-44ce-8ef6-5d820d2c96aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:56.638904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447379b-5963-44ce-8ef6-5d820d2c96aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:56.639187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447379b-5963-44ce-8ef6-5d820d2c96aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:56.639486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447379b-5963-44ce-8ef6-5d820d2c96aa admin admin] PATH_INFO: `/v3/users/c477e5c4c7cd469ea0e1cb95cfaf0fdf` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:56.651032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447379b-5963-44ce-8ef6-5d820d2c96aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c477e5c4c7cd469ea0e1cb95cfaf0fdf)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:56.653031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447379b-5963-44ce-8ef6-5d820d2c96aa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:56.658944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e4b23-4b8b-49c0-9ba4-f954800e114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:56.660054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e4b23-4b8b-49c0-9ba4-f954800e114a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:56.660553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e4b23-4b8b-49c0-9ba4-f954800e114a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:56.661589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e4b23-4b8b-49c0-9ba4-f954800e114a admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:56.662580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e4b23-4b8b-49c0-9ba4-f954800e114a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:56.663104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e4b23-4b8b-49c0-9ba4-f954800e114a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:56.664958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e4b23-4b8b-49c0-9ba4-f954800e114a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:56.694924 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2337/4671] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:56.698517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e4b23-4b8b-49c0-9ba4-f954800e114a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:56.736804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e4b23-4b8b-49c0-9ba4-f954800e114a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:56.758037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30009b49-85a2-4c49-830d-73cce7d1f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:56.759085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30009b49-85a2-4c49-830d-73cce7d1f710 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:56.759846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30009b49-85a2-4c49-830d-73cce7d1f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:56.760338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30009b49-85a2-4c49-830d-73cce7d1f710 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:56.761392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30009b49-85a2-4c49-830d-73cce7d1f710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:56.764680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30009b49-85a2-4c49-830d-73cce7d1f710 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:56.765419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1447379b-5963-44ce-8ef6-5d820d2c96aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c477e5c4c7cd469ea0e1cb95cfaf0fdf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:56.767100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1447379b-5963-44ce-8ef6-5d820d2c96aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c477e5c4c7cd469ea0e1cb95cfaf0fdf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:56.784850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1447379b-5963-44ce-8ef6-5d820d2c96aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c477e5c4c7cd469ea0e1cb95cfaf0fdf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:56.786737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1447379b-5963-44ce-8ef6-5d820d2c96aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c477e5c4c7cd469ea0e1cb95cfaf0fdf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:56.800559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1447379b-5963-44ce-8ef6-5d820d2c96aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c477e5c4c7cd469ea0e1cb95cfaf0fdf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:56.831336 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2338/4673] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:56 2021] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:56.834910 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2335/4673] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:56 2021] DELETE /identity/v3/users/c477e5c4c7cd469ea0e1cb95cfaf0fdf => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:56.835778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30009b49-85a2-4c49-830d-73cce7d1f710 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:56.837041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7af225-13ab-4189-a4eb-b92994796d31 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:56.837560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7af225-13ab-4189-a4eb-b92994796d31 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:56.838130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7af225-13ab-4189-a4eb-b92994796d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:56.839197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-30009b49-85a2-4c49-830d-73cce7d1f710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:56.902355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5e7af225-13ab-4189-a4eb-b92994796d31 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:56.906974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5e7af225-13ab-4189-a4eb-b92994796d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:57.061683 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2336/4674] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:57.077567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7af225-13ab-4189-a4eb-b92994796d31 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:57.081502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5e7af225-13ab-4189-a4eb-b92994796d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:57.092141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30009b49-85a2-4c49-830d-73cce7d1f710 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:57.139824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53d90d-6a1b-47d1-a8d9-f2ee64a04921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:57.141023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53d90d-6a1b-47d1-a8d9-f2ee64a04921 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:57.141555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53d90d-6a1b-47d1-a8d9-f2ee64a04921 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:57.142008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53d90d-6a1b-47d1-a8d9-f2ee64a04921 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:57.142966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53d90d-6a1b-47d1-a8d9-f2ee64a04921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:57.149224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53d90d-6a1b-47d1-a8d9-f2ee64a04921 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:57.210544 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2339/4675] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:56 2021] POST /identity/v3/users => generated 284 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:57.211410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7af225-13ab-4189-a4eb-b92994796d31 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:57.212121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53d90d-6a1b-47d1-a8d9-f2ee64a04921 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:57.223221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817420d-cab8-439e-a0fe-f8a404f3daf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:57.224685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817420d-cab8-439e-a0fe-f8a404f3daf8 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:57.225036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817420d-cab8-439e-a0fe-f8a404f3daf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:57.225324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817420d-cab8-439e-a0fe-f8a404f3daf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:57.244801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53d90d-6a1b-47d1-a8d9-f2ee64a04921 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:57.251169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817420d-cab8-439e-a0fe-f8a404f3daf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:57.252680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817420d-cab8-439e-a0fe-f8a404f3daf8 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:57.264232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9421a23-2c7a-4c15-94d2-39fd79bd6294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:57.265322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9421a23-2c7a-4c15-94d2-39fd79bd6294 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:57.266983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9421a23-2c7a-4c15-94d2-39fd79bd6294 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:57.267406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9421a23-2c7a-4c15-94d2-39fd79bd6294 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:57.270875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9421a23-2c7a-4c15-94d2-39fd79bd6294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:57.275108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9421a23-2c7a-4c15-94d2-39fd79bd6294 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:57.276062 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2337/4676] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:58:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:58:57.323047 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2340/4677] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:57 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:57.326594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817420d-cab8-439e-a0fe-f8a404f3daf8 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:57.340273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817420d-cab8-439e-a0fe-f8a404f3daf8 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:57.355697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47d878-1925-4fb2-a05e-9619e9a280b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:57.356405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47d878-1925-4fb2-a05e-9619e9a280b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:57.360484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47d878-1925-4fb2-a05e-9619e9a280b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:57.360976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47d878-1925-4fb2-a05e-9619e9a280b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:57.366792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47d878-1925-4fb2-a05e-9619e9a280b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:57.370228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47d878-1925-4fb2-a05e-9619e9a280b1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:57.420835 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2338/4678] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:57 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:57.422455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9421a23-2c7a-4c15-94d2-39fd79bd6294 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:57.439829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9421a23-2c7a-4c15-94d2-39fd79bd6294 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:57.464757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecd784-feac-4939-a189-82c7796866a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:57.466092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd784-feac-4939-a189-82c7796866a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:57.466617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd784-feac-4939-a189-82c7796866a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:57.467557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd784-feac-4939-a189-82c7796866a3 admin admin] PATH_INFO: `/v3/projects/f391ff95d8be4c738f6f69cff24b8c59/users/6ba8a0610ba74989b15aaaeeb2db356e/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:57.503003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecd784-feac-4939-a189-82c7796866a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f391ff95d8be4c738f6f69cff24b8c59, user_id=6ba8a0610ba74989b15aaaeeb2db356e, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:57.509013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecd784-feac-4939-a189-82c7796866a3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:57.555710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef66cba-c917-4329-8f82-4be2597d15af None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:57.556372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef66cba-c917-4329-8f82-4be2597d15af None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:57.556876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef66cba-c917-4329-8f82-4be2597d15af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:57.559043 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2341/4679] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:57 2021] PUT /identity/v3/projects/f391ff95d8be4c738f6f69cff24b8c59/users/6ba8a0610ba74989b15aaaeeb2db356e/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:57.619786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2ef66cba-c917-4329-8f82-4be2597d15af None None] MFA Rules not processed for user `6ba8a0610ba74989b15aaaeeb2db356e`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:57.621467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2ef66cba-c917-4329-8f82-4be2597d15af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:57.853458 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2339/4680] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:57 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:57.858574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecd784-feac-4939-a189-82c7796866a3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:57.998823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecd784-feac-4939-a189-82c7796866a3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:58.016108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567e8be-7250-4930-afd2-80a338b37d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:58.016937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e8be-7250-4930-afd2-80a338b37d09 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:58.017257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e8be-7250-4930-afd2-80a338b37d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:58.017632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567e8be-7250-4930-afd2-80a338b37d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:58.019179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567e8be-7250-4930-afd2-80a338b37d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:58.039577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567e8be-7250-4930-afd2-80a338b37d09 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:58.119431 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2342/4681] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:57 2021] POST /identity/v3/projects => generated 365 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:58.124674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef66cba-c917-4329-8f82-4be2597d15af None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:58.148852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567e8be-7250-4930-afd2-80a338b37d09 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:58.159736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f567e8be-7250-4930-afd2-80a338b37d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:58.163699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef66cba-c917-4329-8f82-4be2597d15af None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:58.393361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e41e3-ef1e-4acc-98a0-b23d02776b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:58.394628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e41e3-ef1e-4acc-98a0-b23d02776b40 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:58.395089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e41e3-ef1e-4acc-98a0-b23d02776b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:58.396748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e41e3-ef1e-4acc-98a0-b23d02776b40 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:58.398111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e41e3-ef1e-4acc-98a0-b23d02776b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:58.404863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567e8be-7250-4930-afd2-80a338b37d09 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:58.405175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e41e3-ef1e-4acc-98a0-b23d02776b40 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:58.422414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:58.422414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:58.422414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:58.422414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] PATH_INFO: `/v3/projects/8d7fc485a424450f8be4cc53e8cdf68b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:58.429418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7fc485a424450f8be4cc53e8cdf68b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:58.429418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:58.458942 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2340/4682] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:58 2021] POST /identity/v3/users => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:58.460123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e41e3-ef1e-4acc-98a0-b23d02776b40 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:58.491729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e41e3-ef1e-4acc-98a0-b23d02776b40 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:58.508820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d244-efdc-417c-ad82-ced491e3527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:58.509571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d244-efdc-417c-ad82-ced491e3527c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:58.509887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d244-efdc-417c-ad82-ced491e3527c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:58.510195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89d244-efdc-417c-ad82-ced491e3527c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:58.511200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89d244-efdc-417c-ad82-ced491e3527c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:58.512939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89d244-efdc-417c-ad82-ced491e3527c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:58.538200 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2341/4683] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:58 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:58.544483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d244-efdc-417c-ad82-ced491e3527c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:58.559243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89d244-efdc-417c-ad82-ced491e3527c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:58.579838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7fc485a424450f8be4cc53e8cdf68b', 'request_id': 'req-b8c48aba-ae36-4293-b7c9-1288f264a9b5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:58.594202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7fc485a424450f8be4cc53e8cdf68b', 'request_id': 'req-b8c48aba-ae36-4293-b7c9-1288f264a9b5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:58.605720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7fc485a424450f8be4cc53e8cdf68b', 'request_id': 'req-b8c48aba-ae36-4293-b7c9-1288f264a9b5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:58.622920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] The token cache is being invalidate because project 8d7fc485a424450f8be4cc53e8cdf68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:58.623770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:58.624798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:58.627144 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2343/4684] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:58 2021] DELETE /identity/v3/projects/8d7fc485a424450f8be4cc53e8cdf68b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:58.636238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:58.639237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:58.644682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7446c3-6ecb-4778-a436-522335d4449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:58.646032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7446c3-6ecb-4778-a436-522335d4449f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:58.646319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7446c3-6ecb-4778-a436-522335d4449f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:58.646756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7446c3-6ecb-4778-a436-522335d4449f admin admin] PATH_INFO: `/v3/projects/950cffde5bd246558a8124abb19987d8/users/46d8ee2b55df470fbdb34187aacc58b4/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:58.656531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c48aba-ae36-4293-b7c9-1288f264a9b5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:58.663680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:58.665739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:58.666764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:58.667527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] PATH_INFO: `/v3/users/aab5c407b9784f66bae131d530fd6f80` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:58.670449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7446c3-6ecb-4778-a436-522335d4449f admin admin] RBAC: Authorizing `identity:create_grant(project_id=950cffde5bd246558a8124abb19987d8, user_id=46d8ee2b55df470fbdb34187aacc58b4, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:58.670741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab5c407b9784f66bae131d530fd6f80)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:58.674153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:58.674795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7446c3-6ecb-4778-a436-522335d4449f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:58.714139 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2342/4685] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:58 2021] PUT /identity/v3/projects/950cffde5bd246558a8124abb19987d8/users/46d8ee2b55df470fbdb34187aacc58b4/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:58.716333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7446c3-6ecb-4778-a436-522335d4449f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:58.719194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8d7446c3-6ecb-4778-a436-522335d4449f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:58.777536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab5c407b9784f66bae131d530fd6f80'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:58.793258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab5c407b9784f66bae131d530fd6f80'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:58.794503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab5c407b9784f66bae131d530fd6f80'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:58.805180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab5c407b9784f66bae131d530fd6f80'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:58.828386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab5c407b9784f66bae131d530fd6f80'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:58.839974 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2344/4686] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:58:58 2021] DELETE /identity/v3/users/aab5c407b9784f66bae131d530fd6f80 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:58.847867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7446c3-6ecb-4778-a436-522335d4449f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:58.965069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392815ba-50c1-4a99-940b-0b13c46f07a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:58.966036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392815ba-50c1-4a99-940b-0b13c46f07a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:58.966520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392815ba-50c1-4a99-940b-0b13c46f07a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:58.966963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392815ba-50c1-4a99-940b-0b13c46f07a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:58.968089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392815ba-50c1-4a99-940b-0b13c46f07a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:58.970804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392815ba-50c1-4a99-940b-0b13c46f07a4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:58.992244 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2343/4687] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:58 2021] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:58.993580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:58.995706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:59.039049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ac407-42f4-41ff-8677-8bf7a168b3af admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:59.065199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadbf24-173c-40dc-9c41-45c24eaef350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:59.069058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadbf24-173c-40dc-9c41-45c24eaef350 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.069469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadbf24-173c-40dc-9c41-45c24eaef350 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.069827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadbf24-173c-40dc-9c41-45c24eaef350 admin admin] PATH_INFO: `/v3/projects/950cffde5bd246558a8124abb19987d8/users/46d8ee2b55df470fbdb34187aacc58b4/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.072460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadbf24-173c-40dc-9c41-45c24eaef350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950cffde5bd246558a8124abb19987d8, user_id=46d8ee2b55df470fbdb34187aacc58b4, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:59.076065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadbf24-173c-40dc-9c41-45c24eaef350 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:59.088669 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2345/4688] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:58:58 2021] PUT /identity/v3/projects/950cffde5bd246558a8124abb19987d8/users/46d8ee2b55df470fbdb34187aacc58b4/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:58:59.101458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f71bf-3776-4221-acfe-ee77fd87859a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.101938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f71bf-3776-4221-acfe-ee77fd87859a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.102315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f71bf-3776-4221-acfe-ee77fd87859a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.144404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e62f71bf-3776-4221-acfe-ee77fd87859a None None] MFA Rules not processed for user `46d8ee2b55df470fbdb34187aacc58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:59.146987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e62f71bf-3776-4221-acfe-ee77fd87859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:59.241842 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2344/4689] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:59 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:59.246318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadbf24-173c-40dc-9c41-45c24eaef350 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.277044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadbf24-173c-40dc-9c41-45c24eaef350 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:59.282148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fcfb1-2de5-4210-9821-6deec1994ecf tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:59.283438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fcfb1-2de5-4210-9821-6deec1994ecf tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.283438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fcfb1-2de5-4210-9821-6deec1994ecf tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.283670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fcfb1-2de5-4210-9821-6deec1994ecf tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.284852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fcfb1-2de5-4210-9821-6deec1994ecf tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:59.286701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fcfb1-2de5-4210-9821-6deec1994ecf tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:59.328819 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2346/4690] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:58:59 2021] POST /identity/v3/domains => generated 276 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:59.332745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f71bf-3776-4221-acfe-ee77fd87859a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.345307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f71bf-3776-4221-acfe-ee77fd87859a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:59.363644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fcfb1-2de5-4210-9821-6deec1994ecf tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.366757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-643fcfb1-2de5-4210-9821-6deec1994ecf tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:59.471801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0706f-bc8a-4abf-84c6-4cbb42dc643c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:59.472518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0706f-bc8a-4abf-84c6-4cbb42dc643c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.472800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0706f-bc8a-4abf-84c6-4cbb42dc643c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.473121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0706f-bc8a-4abf-84c6-4cbb42dc643c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.473848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0706f-bc8a-4abf-84c6-4cbb42dc643c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:59.475870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0706f-bc8a-4abf-84c6-4cbb42dc643c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:59.511340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fcfb1-2de5-4210-9821-6deec1994ecf tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:59.529058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:59.529735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.530184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.530955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] PATH_INFO: `/v3/projects/af1ec0ee913a4ec28efc54b8d380a0ea` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.531764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1ec0ee913a4ec28efc54b8d380a0ea)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:59.533741 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2345/4691] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:59 2021] POST /identity/v3/users => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:59.534273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:59.538314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0706f-bc8a-4abf-84c6-4cbb42dc643c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.559456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0706f-bc8a-4abf-84c6-4cbb42dc643c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:59.567171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833b5ae-9237-4e00-8916-9fd6e509e816 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:59.568010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833b5ae-9237-4e00-8916-9fd6e509e816 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.568638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833b5ae-9237-4e00-8916-9fd6e509e816 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.569015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833b5ae-9237-4e00-8916-9fd6e509e816 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.569846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833b5ae-9237-4e00-8916-9fd6e509e816 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:59.572773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833b5ae-9237-4e00-8916-9fd6e509e816 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:59.595952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1ec0ee913a4ec28efc54b8d380a0ea', 'request_id': 'req-4e3b1971-77ec-443e-9c9a-f1ac462b568e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:59.608763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1ec0ee913a4ec28efc54b8d380a0ea', 'request_id': 'req-4e3b1971-77ec-443e-9c9a-f1ac462b568e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:59.613490 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2346/4692] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:59 2021] POST /identity/v3/users => generated 322 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:59.619053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833b5ae-9237-4e00-8916-9fd6e509e816 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.620445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1ec0ee913a4ec28efc54b8d380a0ea', 'request_id': 'req-4e3b1971-77ec-443e-9c9a-f1ac462b568e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:59.635995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833b5ae-9237-4e00-8916-9fd6e509e816 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:59.646931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] The token cache is being invalidate because project af1ec0ee913a4ec28efc54b8d380a0ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:58:59.647227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:59.648811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4e3b1971-77ec-443e-9c9a-f1ac462b568e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:58:59.653778 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2347/4693] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:58:59 2021] DELETE /identity/v3/projects/af1ec0ee913a4ec28efc54b8d380a0ea => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:58:59.660176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9e41a-893d-4f69-98e7-14e0c5b31b64 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.661394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9e41a-893d-4f69-98e7-14e0c5b31b64 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.661675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9e41a-893d-4f69-98e7-14e0c5b31b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.686817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c1f9e41a-893d-4f69-98e7-14e0c5b31b64 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:59.688084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c1f9e41a-893d-4f69-98e7-14e0c5b31b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:59.704044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16ee3e-cdc8-4b42-b5cc-740b1343de03 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:59.705074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16ee3e-cdc8-4b42-b5cc-740b1343de03 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.705454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16ee3e-cdc8-4b42-b5cc-740b1343de03 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.705971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16ee3e-cdc8-4b42-b5cc-740b1343de03 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/users/e86ce298318c49cd91ed6a2726869dc2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.725731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16ee3e-cdc8-4b42-b5cc-740b1343de03 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:get_user(user_id=e86ce298318c49cd91ed6a2726869dc2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:59.729462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b16ee3e-cdc8-4b42-b5cc-740b1343de03 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:59.730823 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2347/4694] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 20:58:59 2021] GET /identity/v3/users/e86ce298318c49cd91ed6a2726869dc2 => generated 347 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:59.735613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16ee3e-cdc8-4b42-b5cc-740b1343de03 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.740610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2b16ee3e-cdc8-4b42-b5cc-740b1343de03 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:59.756659 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2348/4695] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:59.757764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16ee3e-cdc8-4b42-b5cc-740b1343de03 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:59.763410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70c7cb-f8a2-403e-b25f-f4139eb1991c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:59.764190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70c7cb-f8a2-403e-b25f-f4139eb1991c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.764340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d446c1-6b65-411b-ac34-3874f5d02434 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.764548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70c7cb-f8a2-403e-b25f-f4139eb1991c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.764700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d446c1-6b65-411b-ac34-3874f5d02434 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.764872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d446c1-6b65-411b-ac34-3874f5d02434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.764987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70c7cb-f8a2-403e-b25f-f4139eb1991c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.765785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70c7cb-f8a2-403e-b25f-f4139eb1991c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Adding query filter params (domain_id=27aa703a5d8947c793b4027d0316b316) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:59.766232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70c7cb-f8a2-403e-b25f-f4139eb1991c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:59.768086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70c7cb-f8a2-403e-b25f-f4139eb1991c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:59.786806 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2348/4696] 10.222.0.21 () {58 vars in 1206 bytes} [Sat Nov 27 20:58:59 2021] GET /identity/v3/users?domain_id=27aa703a5d8947c793b4027d0316b316 => generated 484 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:58:59.789173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70c7cb-f8a2-403e-b25f-f4139eb1991c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.800680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70c7cb-f8a2-403e-b25f-f4139eb1991c tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:59.803801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-02d446c1-6b65-411b-ac34-3874f5d02434 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:58:59.805498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-02d446c1-6b65-411b-ac34-3874f5d02434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:58:59.810656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebb9e3-0f99-475e-a5cd-b0ecb6cdcc6f tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:59.812759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebb9e3-0f99-475e-a5cd-b0ecb6cdcc6f tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.813232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebb9e3-0f99-475e-a5cd-b0ecb6cdcc6f tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.814360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebb9e3-0f99-475e-a5cd-b0ecb6cdcc6f tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.815356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebb9e3-0f99-475e-a5cd-b0ecb6cdcc6f tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:59.819030 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2349/4697] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:58:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:58:59.820180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d446c1-6b65-411b-ac34-3874f5d02434 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.821655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebb9e3-0f99-475e-a5cd-b0ecb6cdcc6f tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:59.829948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d446c1-6b65-411b-ac34-3874f5d02434 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:59.838047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4a990-da2b-41ac-ba73-4a768940ca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:59.838047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4a990-da2b-41ac-ba73-4a768940ca60 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.838047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4a990-da2b-41ac-ba73-4a768940ca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.838047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4a990-da2b-41ac-ba73-4a768940ca60 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.838458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4a990-da2b-41ac-ba73-4a768940ca60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:59.838589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4a990-da2b-41ac-ba73-4a768940ca60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:59.840505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4a990-da2b-41ac-ba73-4a768940ca60 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:59.853098 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2350/4698] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:58:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:59.857412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4a990-da2b-41ac-ba73-4a768940ca60 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.867937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4a990-da2b-41ac-ba73-4a768940ca60 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:59.872770 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2349/4699] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:58:59 2021] GET /identity/v3/users => generated 8586 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:58:59.877425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebb9e3-0f99-475e-a5cd-b0ecb6cdcc6f tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.878601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6535-9136-4009-bbe6-2e23bc67ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:59.880082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6535-9136-4009-bbe6-2e23bc67ff83 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.880474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6535-9136-4009-bbe6-2e23bc67ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.880852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6535-9136-4009-bbe6-2e23bc67ff83 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.881655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd6535-9136-4009-bbe6-2e23bc67ff83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:59.883696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd6535-9136-4009-bbe6-2e23bc67ff83 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:59.893410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebb9e3-0f99-475e-a5cd-b0ecb6cdcc6f tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:58:59.904139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44574e87-1ca5-4583-bb93-cf4a3cb5f5e2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:58:59.904917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44574e87-1ca5-4583-bb93-cf4a3cb5f5e2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:58:59.905363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44574e87-1ca5-4583-bb93-cf4a3cb5f5e2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:58:59.905655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44574e87-1ca5-4583-bb93-cf4a3cb5f5e2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:58:59.906687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44574e87-1ca5-4583-bb93-cf4a3cb5f5e2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Adding query filter params (name=tempest-test_user-2128108842) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:58:59.907007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44574e87-1ca5-4583-bb93-cf4a3cb5f5e2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:58:59.909291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44574e87-1ca5-4583-bb93-cf4a3cb5f5e2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:58:59.936126 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2351/4700] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:58:59 2021] POST /identity/v3/projects => generated 361 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:58:59.943387 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2350/4701] 10.222.0.21 () {58 vars in 1188 bytes} [Sat Nov 27 20:58:59 2021] GET /identity/v3/users?name=tempest-test_user-2128108842 => generated 475 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:58:59.944531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6535-9136-4009-bbe6-2e23bc67ff83 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.949187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44574e87-1ca5-4583-bb93-cf4a3cb5f5e2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:58:59.961002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44574e87-1ca5-4583-bb93-cf4a3cb5f5e2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:00.029174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d716c-f0ed-4e1b-b8bb-4ce83c8639cd tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:00.030307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d716c-f0ed-4e1b-b8bb-4ce83c8639cd tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:00.031170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d716c-f0ed-4e1b-b8bb-4ce83c8639cd tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:00.032166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d716c-f0ed-4e1b-b8bb-4ce83c8639cd tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:00.033231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d716c-f0ed-4e1b-b8bb-4ce83c8639cd tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:59:00.033749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d716c-f0ed-4e1b-b8bb-4ce83c8639cd tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:00.035990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d716c-f0ed-4e1b-b8bb-4ce83c8639cd tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:00.036671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6535-9136-4009-bbe6-2e23bc67ff83 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:00.042868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398f30e-a6c6-4b72-8b49-d55c19de116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:00.043708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f30e-a6c6-4b72-8b49-d55c19de116a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:00.043992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f30e-a6c6-4b72-8b49-d55c19de116a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:00.044268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f30e-a6c6-4b72-8b49-d55c19de116a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:00.044982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398f30e-a6c6-4b72-8b49-d55c19de116a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:00.048141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398f30e-a6c6-4b72-8b49-d55c19de116a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:00.064480 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2351/4702] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 20:58:59 2021] GET /identity/v3/users?enabled=False => generated 430 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:00.073072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d716c-f0ed-4e1b-b8bb-4ce83c8639cd tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:00.093185 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2352/4703] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:58:59 2021] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:00.096397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d716c-f0ed-4e1b-b8bb-4ce83c8639cd tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:00.100055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398f30e-a6c6-4b72-8b49-d55c19de116a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:00.109000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:00.110022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:00.110416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:00.110767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/users/12bf76174e5f4db78eb6d8d0de540777` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:00.133206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398f30e-a6c6-4b72-8b49-d55c19de116a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:00.137509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:delete_user(user_id=12bf76174e5f4db78eb6d8d0de540777)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:00.140337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:00.144431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af190bf-f033-4efd-bb88-9cdd25fe87e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:00.145235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af190bf-f033-4efd-bb88-9cdd25fe87e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:00.147736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af190bf-f033-4efd-bb88-9cdd25fe87e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:00.148340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af190bf-f033-4efd-bb88-9cdd25fe87e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:00.149194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af190bf-f033-4efd-bb88-9cdd25fe87e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:00.152778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af190bf-f033-4efd-bb88-9cdd25fe87e0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:00.179101 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2353/4704] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:00 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:00.187618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af190bf-f033-4efd-bb88-9cdd25fe87e0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:00.203403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af190bf-f033-4efd-bb88-9cdd25fe87e0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:00.209961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7de59d-e1b4-4d62-b8be-90610ee39956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:00.210814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de59d-e1b4-4d62-b8be-90610ee39956 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:00.211317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de59d-e1b4-4d62-b8be-90610ee39956 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:00.211700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de59d-e1b4-4d62-b8be-90610ee39956 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:00.212591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7de59d-e1b4-4d62-b8be-90610ee39956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:00.214773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7de59d-e1b4-4d62-b8be-90610ee39956 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:00.217180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bf76174e5f4db78eb6d8d0de540777'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:00.219481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bf76174e5f4db78eb6d8d0de540777'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:00.235422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bf76174e5f4db78eb6d8d0de540777'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:00.236500 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2354/4705] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:00 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:00.237312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bf76174e5f4db78eb6d8d0de540777'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:00.241966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7de59d-e1b4-4d62-b8be-90610ee39956 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:00.247521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bb7de59d-e1b4-4d62-b8be-90610ee39956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:00.255514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bf76174e5f4db78eb6d8d0de540777'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:00.283931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7de59d-e1b4-4d62-b8be-90610ee39956 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:00.301717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f167b0-e6e6-4cb2-846a-87976fbf6016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:00.304780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f167b0-e6e6-4cb2-846a-87976fbf6016 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:00.307817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f167b0-e6e6-4cb2-846a-87976fbf6016 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:00.308259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f167b0-e6e6-4cb2-846a-87976fbf6016 admin admin] PATH_INFO: `/v3/projects/ff57a16edd1243ee81deda551a2c5e5a/users/a210268fa0e8425399936ee0d3eea7a4/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:00.311813 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2352/4706] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:00 2021] DELETE /identity/v3/users/12bf76174e5f4db78eb6d8d0de540777 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:00.313000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:00.317919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:00.367810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f167b0-e6e6-4cb2-846a-87976fbf6016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff57a16edd1243ee81deda551a2c5e5a, user_id=a210268fa0e8425399936ee0d3eea7a4, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:00.384111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f167b0-e6e6-4cb2-846a-87976fbf6016 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:00.436325 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2355/4707] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:00 2021] PUT /identity/v3/projects/ff57a16edd1243ee81deda551a2c5e5a/users/a210268fa0e8425399936ee0d3eea7a4/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:00.446889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a92343-e321-4abd-a146-b0b5840a6b6e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:00.447328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a92343-e321-4abd-a146-b0b5840a6b6e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:00.447760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a92343-e321-4abd-a146-b0b5840a6b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:00.533080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-95a92343-e321-4abd-a146-b0b5840a6b6e None None] MFA Rules not processed for user `a210268fa0e8425399936ee0d3eea7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:00.534616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-95a92343-e321-4abd-a146-b0b5840a6b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:00.550028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344adf3-06a8-430d-bc02-5832c6f46f48 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:00.674896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:00.677345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:00.677835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:00.678126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/users/e86ce298318c49cd91ed6a2726869dc2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:00.682970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e86ce298318c49cd91ed6a2726869dc2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:00.686463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:00.731939 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2356/4708] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:00 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:59:00.770802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a92343-e321-4abd-a146-b0b5840a6b6e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:00.772714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-95a92343-e321-4abd-a146-b0b5840a6b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:00.809183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86ce298318c49cd91ed6a2726869dc2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:00.810651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86ce298318c49cd91ed6a2726869dc2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:00.831084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86ce298318c49cd91ed6a2726869dc2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:00.832920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86ce298318c49cd91ed6a2726869dc2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:00.846311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86ce298318c49cd91ed6a2726869dc2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:00.916716 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2353/4709] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:00 2021] DELETE /identity/v3/users/e86ce298318c49cd91ed6a2726869dc2 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:00.923308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:00.928102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:01.000912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a92343-e321-4abd-a146-b0b5840a6b6e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:01.114496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb854c8b-6189-4a32-a668-b32354448582 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:01.118065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48783a1c-2694-4007-b7fa-7b5ccedf8f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:01.119597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783a1c-2694-4007-b7fa-7b5ccedf8f50 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:01.120135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783a1c-2694-4007-b7fa-7b5ccedf8f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:01.121559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783a1c-2694-4007-b7fa-7b5ccedf8f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:01.130710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-48783a1c-2694-4007-b7fa-7b5ccedf8f50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:01.132182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:01.133180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:01.133697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:01.134099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/domains/27aa703a5d8947c793b4027d0316b316` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:01.135989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=27aa703a5d8947c793b4027d0316b316)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:01.138207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:01.177171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '27aa703a5d8947c793b4027d0316b316'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.178185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '27aa703a5d8947c793b4027d0316b316'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.228750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '27aa703a5d8947c793b4027d0316b316'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.230532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '27aa703a5d8947c793b4027d0316b316'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.235453 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2354/4710] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 20:59:00 2021] PATCH /identity/v3/domains/27aa703a5d8947c793b4027d0316b316 => generated 277 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:01.236699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:01.240182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:01.367122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48783a1c-2694-4007-b7fa-7b5ccedf8f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:01.370935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48783a1c-2694-4007-b7fa-7b5ccedf8f50 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:01.400559 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2357/4711] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:59:00 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:59:01.401652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48783a1c-2694-4007-b7fa-7b5ccedf8f50 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:01.425325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48783a1c-2694-4007-b7fa-7b5ccedf8f50 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:01.457242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2e273-a689-4985-b83f-1ab4dbe65fe4 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:01.474628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07131834-497f-4931-bb5e-d2f246a26947 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:01.475426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07131834-497f-4931-bb5e-d2f246a26947 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:01.476455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07131834-497f-4931-bb5e-d2f246a26947 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:01.476739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07131834-497f-4931-bb5e-d2f246a26947 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:01.484377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-07131834-497f-4931-bb5e-d2f246a26947 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:01.516600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07131834-497f-4931-bb5e-d2f246a26947 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:01.520470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07131834-497f-4931-bb5e-d2f246a26947 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:01.564020 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2355/4712] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:59:01 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:59:01.590625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46d8ee2b55df470fbdb34187aacc58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '950cffde5bd246558a8124abb19987d8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:01.592090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:01.592090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:01.592090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] PATH_INFO: `/v3/domains/27aa703a5d8947c793b4027d0316b316` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:01.623880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=27aa703a5d8947c793b4027d0316b316)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:01.625512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:01.672428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '27aa703a5d8947c793b4027d0316b316'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.696269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '27aa703a5d8947c793b4027d0316b316'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.773625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27aa703a5d8947c793b4027d0316b316', 'request_id': 'req-1bbf940b-51b2-416b-be5b-bd7fff028fa2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.794778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27aa703a5d8947c793b4027d0316b316', 'request_id': 'req-1bbf940b-51b2-416b-be5b-bd7fff028fa2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.805530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27aa703a5d8947c793b4027d0316b316', 'request_id': 'req-1bbf940b-51b2-416b-be5b-bd7fff028fa2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.836277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] The token cache is being invalidate because project 27aa703a5d8947c793b4027d0316b316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:01.836680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.839040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.861703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '27aa703a5d8947c793b4027d0316b316', 'request_id': 'req-1bbf940b-51b2-416b-be5b-bd7fff028fa2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.862614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '27aa703a5d8947c793b4027d0316b316', 'request_id': 'req-1bbf940b-51b2-416b-be5b-bd7fff028fa2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.864329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1bbf940b-51b2-416b-be5b-bd7fff028fa2 tempest-UsersV3TestJSON-352160724 tempest-UsersV3TestJSON-352160724-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '27aa703a5d8947c793b4027d0316b316', 'request_id': 'req-1bbf940b-51b2-416b-be5b-bd7fff028fa2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:01.878976 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2358/4713] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:59:01 2021] DELETE /identity/v3/domains/27aa703a5d8947c793b4027d0316b316 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:01.883417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07131834-497f-4931-bb5e-d2f246a26947 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:01.885034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-07131834-497f-4931-bb5e-d2f246a26947 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:02.040281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07131834-497f-4931-bb5e-d2f246a26947 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:02.126625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:02.127729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:02.127860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:02.128141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] PATH_INFO: `/v3/users/6ba8a0610ba74989b15aaaeeb2db356e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:02.132117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba8a0610ba74989b15aaaeeb2db356e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:02.135605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:02.316632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba8a0610ba74989b15aaaeeb2db356e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:02.317831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba8a0610ba74989b15aaaeeb2db356e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:02.333826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba8a0610ba74989b15aaaeeb2db356e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:02.336235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba8a0610ba74989b15aaaeeb2db356e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:02.354047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba8a0610ba74989b15aaaeeb2db356e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:02.388207 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2356/4714] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:01 2021] DELETE /identity/v3/users/6ba8a0610ba74989b15aaaeeb2db356e => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:02.389642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639a25a-e6bc-4464-b7c8-2701ad1c1c41 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:02.390177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639a25a-e6bc-4464-b7c8-2701ad1c1c41 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:02.390281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639a25a-e6bc-4464-b7c8-2701ad1c1c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:02.427927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3639a25a-e6bc-4464-b7c8-2701ad1c1c41 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:02.427927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3639a25a-e6bc-4464-b7c8-2701ad1c1c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:02.533838 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2359/4715] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:59:02.602570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:02.604899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:02.745750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c515c-5422-437b-9947-a803e6af0841 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:02.751145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b690c-53bf-4a7e-b8d9-4b90074377db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:02.751991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b690c-53bf-4a7e-b8d9-4b90074377db service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:02.752306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b690c-53bf-4a7e-b8d9-4b90074377db service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:02.752704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b690c-53bf-4a7e-b8d9-4b90074377db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:02.769960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b690c-53bf-4a7e-b8d9-4b90074377db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:02.771450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b690c-53bf-4a7e-b8d9-4b90074377db service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:02.806571 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2357/4716] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:59:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:59:04.297446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639a25a-e6bc-4464-b7c8-2701ad1c1c41 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:04.299243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3639a25a-e6bc-4464-b7c8-2701ad1c1c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:04.336699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639a25a-e6bc-4464-b7c8-2701ad1c1c41 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:04.366273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:04.367155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:04.372711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:04.373090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] PATH_INFO: `/v3/projects/f391ff95d8be4c738f6f69cff24b8c59` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:04.383489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f391ff95d8be4c738f6f69cff24b8c59)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:04.388825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:04.537985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f391ff95d8be4c738f6f69cff24b8c59', 'request_id': 'req-f41a4a9c-1306-4557-a54d-5dfa954023f1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:04.550643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f391ff95d8be4c738f6f69cff24b8c59', 'request_id': 'req-f41a4a9c-1306-4557-a54d-5dfa954023f1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:04.565150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f391ff95d8be4c738f6f69cff24b8c59', 'request_id': 'req-f41a4a9c-1306-4557-a54d-5dfa954023f1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:04.588539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] The token cache is being invalidate because project f391ff95d8be4c738f6f69cff24b8c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:04.588888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:04.590288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:04.592252 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2360/4717] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:59:04 2021] DELETE /identity/v3/projects/f391ff95d8be4c738f6f69cff24b8c59 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:04.597169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b690c-53bf-4a7e-b8d9-4b90074377db service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:04.614661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b690c-53bf-4a7e-b8d9-4b90074377db service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:04.695809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05302f8-2015-43a0-93aa-d176c3883062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:04.696607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05302f8-2015-43a0-93aa-d176c3883062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:04.696893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05302f8-2015-43a0-93aa-d176c3883062 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:04.697169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05302f8-2015-43a0-93aa-d176c3883062 admin admin] PATH_INFO: `/v3/users/46d8ee2b55df470fbdb34187aacc58b4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:04.698608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05302f8-2015-43a0-93aa-d176c3883062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d8ee2b55df470fbdb34187aacc58b4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:04.701216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05302f8-2015-43a0-93aa-d176c3883062 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:04.784183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f05302f8-2015-43a0-93aa-d176c3883062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d8ee2b55df470fbdb34187aacc58b4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:04.785047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f05302f8-2015-43a0-93aa-d176c3883062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d8ee2b55df470fbdb34187aacc58b4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:04.820691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f05302f8-2015-43a0-93aa-d176c3883062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d8ee2b55df470fbdb34187aacc58b4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:04.821467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f05302f8-2015-43a0-93aa-d176c3883062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d8ee2b55df470fbdb34187aacc58b4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:04.864591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f05302f8-2015-43a0-93aa-d176c3883062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d8ee2b55df470fbdb34187aacc58b4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:04.921071 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2358/4718] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:04 2021] DELETE /identity/v3/users/46d8ee2b55df470fbdb34187aacc58b4 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:07.689095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:07.690873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:07.721083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a4a9c-1306-4557-a54d-5dfa954023f1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:07.965471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:07.967631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:07.969730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:07.971732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] PATH_INFO: `/v3/projects/950cffde5bd246558a8124abb19987d8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:07.978876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950cffde5bd246558a8124abb19987d8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:07.984812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:08.156270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950cffde5bd246558a8124abb19987d8', 'request_id': 'req-dfbc584e-2898-4a8d-aed9-a07679c93547'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:08.201732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950cffde5bd246558a8124abb19987d8', 'request_id': 'req-dfbc584e-2898-4a8d-aed9-a07679c93547'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:08.212603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950cffde5bd246558a8124abb19987d8', 'request_id': 'req-dfbc584e-2898-4a8d-aed9-a07679c93547'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:08.234735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] The token cache is being invalidate because project 950cffde5bd246558a8124abb19987d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:08.235053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:08.238253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dfbc584e-2898-4a8d-aed9-a07679c93547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:08.242682 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2361/4719] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:59:07 2021] DELETE /identity/v3/projects/950cffde5bd246558a8124abb19987d8 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:08.248887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc57f-da12-4128-977f-f311452cca48 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:08.249628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc57f-da12-4128-977f-f311452cca48 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:08.249628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adc57f-da12-4128-977f-f311452cca48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:08.290493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-99adc57f-da12-4128-977f-f311452cca48 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:08.291762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-99adc57f-da12-4128-977f-f311452cca48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:08.469260 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2359/4720] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:08.477287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b72ba-dd4d-4e7a-a5e5-64db04df0243 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:08.477465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b72ba-dd4d-4e7a-a5e5-64db04df0243 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:08.477737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b72ba-dd4d-4e7a-a5e5-64db04df0243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:08.517061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-111b72ba-dd4d-4e7a-a5e5-64db04df0243 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:08.518307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-111b72ba-dd4d-4e7a-a5e5-64db04df0243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:08.549649 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2362/4721] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:08.554915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adc57f-da12-4128-977f-f311452cca48 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:08.583599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adc57f-da12-4128-977f-f311452cca48 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:08.589537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2215c8-b62b-4f48-833d-a111e7d393c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:08.591076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2215c8-b62b-4f48-833d-a111e7d393c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:08.591805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2215c8-b62b-4f48-833d-a111e7d393c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:08.592595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2215c8-b62b-4f48-833d-a111e7d393c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:08.595813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2215c8-b62b-4f48-833d-a111e7d393c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:59:08.596486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2215c8-b62b-4f48-833d-a111e7d393c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:08.600015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2215c8-b62b-4f48-833d-a111e7d393c5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:08.650894 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2360/4722] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:59:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:08.652228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b72ba-dd4d-4e7a-a5e5-64db04df0243 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:08.665821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b72ba-dd4d-4e7a-a5e5-64db04df0243 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:08.685013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac60a3-aa4c-4756-9b42-7314d8f4f3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:08.685703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac60a3-aa4c-4756-9b42-7314d8f4f3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:08.685984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac60a3-aa4c-4756-9b42-7314d8f4f3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:08.686254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac60a3-aa4c-4756-9b42-7314d8f4f3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:08.687729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac60a3-aa4c-4756-9b42-7314d8f4f3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:08.689661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac60a3-aa4c-4756-9b42-7314d8f4f3d9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:08.780924 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2363/4723] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:59:08 2021] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:08.785993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2215c8-b62b-4f48-833d-a111e7d393c5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:08.803180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2215c8-b62b-4f48-833d-a111e7d393c5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:09.026495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b32b9-c5b3-4e54-91c2-8015db7df7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:09.027837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b32b9-c5b3-4e54-91c2-8015db7df7de admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:09.028380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b32b9-c5b3-4e54-91c2-8015db7df7de admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:09.028895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b32b9-c5b3-4e54-91c2-8015db7df7de admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:09.029895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b32b9-c5b3-4e54-91c2-8015db7df7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:09.033869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b32b9-c5b3-4e54-91c2-8015db7df7de admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:09.172192 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2361/4724] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:59:08 2021] POST /identity/v3/users => generated 288 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:09.178787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac60a3-aa4c-4756-9b42-7314d8f4f3d9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:09.208789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac60a3-aa4c-4756-9b42-7314d8f4f3d9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:09.216109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18011a3-8c22-4fa6-8605-71c1ea12acb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:09.218190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18011a3-8c22-4fa6-8605-71c1ea12acb9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:09.218528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18011a3-8c22-4fa6-8605-71c1ea12acb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:09.218976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18011a3-8c22-4fa6-8605-71c1ea12acb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:09.219966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18011a3-8c22-4fa6-8605-71c1ea12acb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:09.222409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18011a3-8c22-4fa6-8605-71c1ea12acb9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:09.260695 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2364/4725] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:09 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:09.264320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b32b9-c5b3-4e54-91c2-8015db7df7de admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:09.309329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b32b9-c5b3-4e54-91c2-8015db7df7de admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:09.324619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d227b-a326-4d46-96a6-c7d796b0b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:09.326367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d227b-a326-4d46-96a6-c7d796b0b7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:09.326844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d227b-a326-4d46-96a6-c7d796b0b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:09.328115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d227b-a326-4d46-96a6-c7d796b0b7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:09.329082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d227b-a326-4d46-96a6-c7d796b0b7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:09.346136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d227b-a326-4d46-96a6-c7d796b0b7a7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:09.370588 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2362/4726] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:09 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:09.375211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18011a3-8c22-4fa6-8605-71c1ea12acb9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:09.392217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18011a3-8c22-4fa6-8605-71c1ea12acb9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:09.439044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e547664-5757-4596-909d-487e4c6748c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:09.452801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547664-5757-4596-909d-487e4c6748c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:09.453271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547664-5757-4596-909d-487e4c6748c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:09.458113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e547664-5757-4596-909d-487e4c6748c6 admin admin] PATH_INFO: `/v3/projects/f4d41f7e12524e49bed33b94f8d9701e/users/96f9f4030a2f4f05a4c114d9d167b3b9/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:09.556088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e547664-5757-4596-909d-487e4c6748c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d41f7e12524e49bed33b94f8d9701e, user_id=96f9f4030a2f4f05a4c114d9d167b3b9, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:09.571381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e547664-5757-4596-909d-487e4c6748c6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:09.631311 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2365/4727] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:09 2021] PUT /identity/v3/projects/f4d41f7e12524e49bed33b94f8d9701e/users/96f9f4030a2f4f05a4c114d9d167b3b9/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:09.642713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e30c-da86-43cf-8564-8d3f68d45176 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:09.643182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e30c-da86-43cf-8564-8d3f68d45176 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:09.643613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81e30c-da86-43cf-8564-8d3f68d45176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:09.766898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5c81e30c-da86-43cf-8564-8d3f68d45176 None None] MFA Rules not processed for user `96f9f4030a2f4f05a4c114d9d167b3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:09.775070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5c81e30c-da86-43cf-8564-8d3f68d45176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:10.036592 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2363/4728] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:09 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:10.042471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e547664-5757-4596-909d-487e4c6748c6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:10.219463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e547664-5757-4596-909d-487e4c6748c6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:10.231008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411b52c-09fc-4daa-87d5-ccc0193ec68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:10.232042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411b52c-09fc-4daa-87d5-ccc0193ec68b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:10.232181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411b52c-09fc-4daa-87d5-ccc0193ec68b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:10.232753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411b52c-09fc-4daa-87d5-ccc0193ec68b admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:10.234016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411b52c-09fc-4daa-87d5-ccc0193ec68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:10.240834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411b52c-09fc-4daa-87d5-ccc0193ec68b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:10.304051 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2366/4729] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:59:10 2021] POST /identity/v3/projects => generated 375 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:10.306185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81e30c-da86-43cf-8564-8d3f68d45176 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:10.325561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81e30c-da86-43cf-8564-8d3f68d45176 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:10.470260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87e2e0-73d1-48f6-8e51-ab5387da5943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:10.472348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e2e0-73d1-48f6-8e51-ab5387da5943 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:10.472636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e2e0-73d1-48f6-8e51-ab5387da5943 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:10.475767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e2e0-73d1-48f6-8e51-ab5387da5943 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:10.482388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87e2e0-73d1-48f6-8e51-ab5387da5943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:10.485908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87e2e0-73d1-48f6-8e51-ab5387da5943 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:10.545775 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2364/4730] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:59:10 2021] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:59:10.549656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411b52c-09fc-4daa-87d5-ccc0193ec68b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:10.565859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411b52c-09fc-4daa-87d5-ccc0193ec68b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:10.577920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801c38f-4934-4140-9d70-b5a0f62f1069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:10.579215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801c38f-4934-4140-9d70-b5a0f62f1069 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:10.580270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801c38f-4934-4140-9d70-b5a0f62f1069 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:10.581724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801c38f-4934-4140-9d70-b5a0f62f1069 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:10.588537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801c38f-4934-4140-9d70-b5a0f62f1069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:10.594205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801c38f-4934-4140-9d70-b5a0f62f1069 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:10.625205 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2367/4731] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:10 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:10.629436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87e2e0-73d1-48f6-8e51-ab5387da5943 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:10.643303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87e2e0-73d1-48f6-8e51-ab5387da5943 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:10.656049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc95dbd-5f51-4117-9676-8ca991782d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:10.657285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc95dbd-5f51-4117-9676-8ca991782d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:10.659122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc95dbd-5f51-4117-9676-8ca991782d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:10.659734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc95dbd-5f51-4117-9676-8ca991782d9e admin admin] PATH_INFO: `/v3/projects/1af34e755c5f4b3cbb59cab1876279e7/users/1cf3acc41afd4d1781689e9f83110e13/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:10.697551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc95dbd-5f51-4117-9676-8ca991782d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af34e755c5f4b3cbb59cab1876279e7, user_id=1cf3acc41afd4d1781689e9f83110e13, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:10.705733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc95dbd-5f51-4117-9676-8ca991782d9e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:10.733507 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2365/4732] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:10 2021] PUT /identity/v3/projects/1af34e755c5f4b3cbb59cab1876279e7/users/1cf3acc41afd4d1781689e9f83110e13/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:10.739326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801c38f-4934-4140-9d70-b5a0f62f1069 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:10.755773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801c38f-4934-4140-9d70-b5a0f62f1069 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:10.891563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702cef9-6dbd-4e02-8540-c61b7842a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:10.893861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702cef9-6dbd-4e02-8540-c61b7842a153 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:10.894368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702cef9-6dbd-4e02-8540-c61b7842a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:10.895066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702cef9-6dbd-4e02-8540-c61b7842a153 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:10.896908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702cef9-6dbd-4e02-8540-c61b7842a153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:10.900725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702cef9-6dbd-4e02-8540-c61b7842a153 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:10.930692 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2368/4733] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:10 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:10.934058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc95dbd-5f51-4117-9676-8ca991782d9e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:10.947091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc95dbd-5f51-4117-9676-8ca991782d9e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:10.961542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6d3b0-ad7e-41e9-a018-c1d7087b7165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:10.962691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3b0-ad7e-41e9-a018-c1d7087b7165 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:10.967401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3b0-ad7e-41e9-a018-c1d7087b7165 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:10.976563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3b0-ad7e-41e9-a018-c1d7087b7165 admin admin] PATH_INFO: `/v3/projects/1af34e755c5f4b3cbb59cab1876279e7/users/1cf3acc41afd4d1781689e9f83110e13/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:10.980356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6d3b0-ad7e-41e9-a018-c1d7087b7165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af34e755c5f4b3cbb59cab1876279e7, user_id=1cf3acc41afd4d1781689e9f83110e13, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:10.988097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6d3b0-ad7e-41e9-a018-c1d7087b7165 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:11.031295 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2366/4734] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:10 2021] PUT /identity/v3/projects/1af34e755c5f4b3cbb59cab1876279e7/users/1cf3acc41afd4d1781689e9f83110e13/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:11.127848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f23ac-c76d-4802-9644-b73630b78cbc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:11.140850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f23ac-c76d-4802-9644-b73630b78cbc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:11.141577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f23ac-c76d-4802-9644-b73630b78cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:11.181600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-038f23ac-c76d-4802-9644-b73630b78cbc None None] MFA Rules not processed for user `1cf3acc41afd4d1781689e9f83110e13`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:11.183275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-038f23ac-c76d-4802-9644-b73630b78cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:11.307748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6d3b0-ad7e-41e9-a018-c1d7087b7165 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:11.320548 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2369/4735] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:11 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:11.323500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6d3b0-ad7e-41e9-a018-c1d7087b7165 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:11.328670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b5036-ec83-4096-94a2-90d6789e4bab tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:11.329549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b5036-ec83-4096-94a2-90d6789e4bab tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:11.329985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b5036-ec83-4096-94a2-90d6789e4bab tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:11.330530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b5036-ec83-4096-94a2-90d6789e4bab tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:11.331467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b5036-ec83-4096-94a2-90d6789e4bab tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:11.333218 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-ef0b5036-ec83-4096-94a2-90d6789e4bab tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:11.333218 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:59:11.333218 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:59:11.334442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b5036-ec83-4096-94a2-90d6789e4bab tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:11.368211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f23ac-c76d-4802-9644-b73630b78cbc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:11.376066 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2367/4736] 10.222.0.21 () {60 vars in 1184 bytes} [Sat Nov 27 20:59:11 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:11.381259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f23ac-c76d-4802-9644-b73630b78cbc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:11.386659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233c0a0-0049-4837-9453-c25de8df2a29 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:11.387828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233c0a0-0049-4837-9453-c25de8df2a29 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:11.388283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233c0a0-0049-4837-9453-c25de8df2a29 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:11.388712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233c0a0-0049-4837-9453-c25de8df2a29 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f9f8f34f0c6c45ee9b372607de4923b3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:11.389593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233c0a0-0049-4837-9453-c25de8df2a29 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=f9f8f34f0c6c45ee9b372607de4923b3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:11.390847 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-5233c0a0-0049-4837-9453-c25de8df2a29 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:11.390847 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:59:11.390847 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:59:11.392675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233c0a0-0049-4837-9453-c25de8df2a29 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:11.402377 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2370/4737] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:59:11 2021] GET /identity/v3/OS-OAUTH1/consumers/f9f8f34f0c6c45ee9b372607de4923b3 => generated 220 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:11.407950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b5036-ec83-4096-94a2-90d6789e4bab tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:11.424394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b5036-ec83-4096-94a2-90d6789e4bab tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:11.453560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:11.454643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:11.455090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:11.455718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f9f8f34f0c6c45ee9b372607de4923b3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:11.456569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=f9f8f34f0c6c45ee9b372607de4923b3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:11.457804 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:11.457804 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:59:11.457804 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:59:11.459832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:11.460258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invalidating token cache because consumer f9f8f34f0c6c45ee9b372607de4923b3 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:11.461066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:11.462021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:11.517055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'f9f8f34f0c6c45ee9b372607de4923b3', 'request_id': 'req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:11.549308 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2368/4738] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:59:11 2021] DELETE /identity/v3/OS-OAUTH1/consumers/f9f8f34f0c6c45ee9b372607de4923b3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:11.550532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233c0a0-0049-4837-9453-c25de8df2a29 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:11.552916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5233c0a0-0049-4837-9453-c25de8df2a29 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:11.574775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233c0a0-0049-4837-9453-c25de8df2a29 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:11.593436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf97de0-8341-4c57-82df-04e7af4e5740 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:11.597580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf97de0-8341-4c57-82df-04e7af4e5740 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:11.597580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf97de0-8341-4c57-82df-04e7af4e5740 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:11.597580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf97de0-8341-4c57-82df-04e7af4e5740 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:11.600035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf97de0-8341-4c57-82df-04e7af4e5740 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:11.605802 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-bbf97de0-8341-4c57-82df-04e7af4e5740 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:11.605802 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:59:11.605802 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:59:11.606764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf97de0-8341-4c57-82df-04e7af4e5740 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:11.648677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:11.649500 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2371/4739] 10.222.0.21 () {60 vars in 1184 bytes} [Sat Nov 27 20:59:11 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:11.661251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb607d-9a56-4dc2-a9be-c48b3df0fa79 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:11.685721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b711-fa52-4398-a903-e215ee52172d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:11.686575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b711-fa52-4398-a903-e215ee52172d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:11.686863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b711-fa52-4398-a903-e215ee52172d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:11.687147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b711-fa52-4398-a903-e215ee52172d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/66df4d16461c4e24b7f81be85bf1eff5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:11.687860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32b711-fa52-4398-a903-e215ee52172d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=66df4d16461c4e24b7f81be85bf1eff5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:11.696553 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-6d32b711-fa52-4398-a903-e215ee52172d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:11.696553 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:59:11.696553 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:59:11.700732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32b711-fa52-4398-a903-e215ee52172d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:11.720848 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2369/4740] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:59:11 2021] GET /identity/v3/OS-OAUTH1/consumers/66df4d16461c4e24b7f81be85bf1eff5 => generated 221 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:11.722484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf97de0-8341-4c57-82df-04e7af4e5740 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:11.736493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf97de0-8341-4c57-82df-04e7af4e5740 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:11.753489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:11.754375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:11.754656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:11.754924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/66df4d16461c4e24b7f81be85bf1eff5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:11.758120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=66df4d16461c4e24b7f81be85bf1eff5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:11.759290 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:11.759290 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:59:11.759290 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:59:11.760103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:11.760368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invalidating token cache because consumer 66df4d16461c4e24b7f81be85bf1eff5 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:11.760649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:11.769176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:11.815829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '66df4d16461c4e24b7f81be85bf1eff5', 'request_id': 'req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:11.842274 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2372/4741] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:59:11 2021] DELETE /identity/v3/OS-OAUTH1/consumers/66df4d16461c4e24b7f81be85bf1eff5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:11.846606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b711-fa52-4398-a903-e215ee52172d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:11.854154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6d32b711-fa52-4398-a903-e215ee52172d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:11.888477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b711-fa52-4398-a903-e215ee52172d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:11.901464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df71d4-2abd-429c-8ae3-1e191f856d4d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:11.902316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df71d4-2abd-429c-8ae3-1e191f856d4d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:11.902608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df71d4-2abd-429c-8ae3-1e191f856d4d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:11.902897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df71d4-2abd-429c-8ae3-1e191f856d4d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/66df4d16461c4e24b7f81be85bf1eff5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:11.908633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df71d4-2abd-429c-8ae3-1e191f856d4d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=66df4d16461c4e24b7f81be85bf1eff5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:11.910832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df71d4-2abd-429c-8ae3-1e191f856d4d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:11.963011 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-58df71d4-2abd-429c-8ae3-1e191f856d4d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Nov 27 20:59:11.971931 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2370/4742] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:59:11 2021] GET /identity/v3/OS-OAUTH1/consumers/66df4d16461c4e24b7f81be85bf1eff5 => generated 74 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:59:11.974953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:11.996066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d995f2-fb5b-4dfc-81e8-1e9efa036339 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:12.012251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:12.012952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:12.014413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:12.015556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/66df4d16461c4e24b7f81be85bf1eff5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:12.017901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=66df4d16461c4e24b7f81be85bf1eff5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:12.029646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:12.033028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invalidating token cache because consumer 66df4d16461c4e24b7f81be85bf1eff5 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:12.033573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:12.034442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:12.080700 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Nov 27 20:59:12.087380 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2373/4743] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:59:11 2021] DELETE /identity/v3/OS-OAUTH1/consumers/66df4d16461c4e24b7f81be85bf1eff5 => generated 74 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:59:12.089016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df71d4-2abd-429c-8ae3-1e191f856d4d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:12.091899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-58df71d4-2abd-429c-8ae3-1e191f856d4d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:12.123008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df71d4-2abd-429c-8ae3-1e191f856d4d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:12.143706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db04318-13c3-49d2-bbae-8965913891a1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:12.144381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db04318-13c3-49d2-bbae-8965913891a1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:12.144709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db04318-13c3-49d2-bbae-8965913891a1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:12.151034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db04318-13c3-49d2-bbae-8965913891a1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:12.152040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db04318-13c3-49d2-bbae-8965913891a1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:12.153566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db04318-13c3-49d2-bbae-8965913891a1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:12.194783 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2371/4744] 10.222.0.21 () {60 vars in 1184 bytes} [Sat Nov 27 20:59:12 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:12.205692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:12.219166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8db08-a44c-40a7-bc42-ff41865b7a19 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:12.226793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0a6e8-350a-48c1-88b6-374b425800a0 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:12.229796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0a6e8-350a-48c1-88b6-374b425800a0 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:12.230609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0a6e8-350a-48c1-88b6-374b425800a0 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:12.231119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0a6e8-350a-48c1-88b6-374b425800a0 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:12.232164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0a6e8-350a-48c1-88b6-374b425800a0 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:12.234129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0a6e8-350a-48c1-88b6-374b425800a0 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:12.276461 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2374/4745] 10.222.0.21 () {60 vars in 1184 bytes} [Sat Nov 27 20:59:12 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:12.280551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db04318-13c3-49d2-bbae-8965913891a1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:12.311662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db04318-13c3-49d2-bbae-8965913891a1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:12.325825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6987cd-b090-4d9b-891a-8d0288848166 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:12.326484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6987cd-b090-4d9b-891a-8d0288848166 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:12.330345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6987cd-b090-4d9b-891a-8d0288848166 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:12.331097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6987cd-b090-4d9b-891a-8d0288848166 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:12.334309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6987cd-b090-4d9b-891a-8d0288848166 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:12.336545 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-bc6987cd-b090-4d9b-891a-8d0288848166 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_consumers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:12.336545 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:59:12.336545 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:59:12.343932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6987cd-b090-4d9b-891a-8d0288848166 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:12.374002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0a6e8-350a-48c1-88b6-374b425800a0 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:12.379854 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2372/4746] 10.222.0.21 () {58 vars in 1163 bytes} [Sat Nov 27 20:59:12 2021] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:12.399236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0a6e8-350a-48c1-88b6-374b425800a0 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:12.421808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:12.423022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:12.433383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:12.433913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/46f4bab03afc43a2a1bbb413cdf43243` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:12.435001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=46f4bab03afc43a2a1bbb413cdf43243)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:12.436830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:12.437269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invalidating token cache because consumer 46f4bab03afc43a2a1bbb413cdf43243 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:12.437724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:12.438741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:12.460892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '46f4bab03afc43a2a1bbb413cdf43243', 'request_id': 'req-29d2f728-a097-439c-b595-4a17ee9a4f8a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:12.486112 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2375/4747] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:59:12 2021] DELETE /identity/v3/OS-OAUTH1/consumers/46f4bab03afc43a2a1bbb413cdf43243 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:59:12.492101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6987cd-b090-4d9b-891a-8d0288848166 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:12.502231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bc6987cd-b090-4d9b-891a-8d0288848166 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:12.534248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6987cd-b090-4d9b-891a-8d0288848166 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:12.547831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:12.548729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:12.548941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:12.550517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/6cb6b9cde7e74999b7f8fbc15b731ad2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:12.552356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=6cb6b9cde7e74999b7f8fbc15b731ad2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:12.562194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:12.562732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invalidating token cache because consumer 6cb6b9cde7e74999b7f8fbc15b731ad2 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:12.564963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:12.566275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:12.605093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '6cb6b9cde7e74999b7f8fbc15b731ad2', 'request_id': 'req-21d65e7a-6677-44cf-89f4-813b18998be8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:12.640068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:12.640608 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2373/4748] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:59:12 2021] DELETE /identity/v3/OS-OAUTH1/consumers/6cb6b9cde7e74999b7f8fbc15b731ad2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:12.664732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2f728-a097-439c-b595-4a17ee9a4f8a tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:12.690480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b45895-e29d-4d9d-bdfd-6beaf6020d1d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:12.692142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b45895-e29d-4d9d-bdfd-6beaf6020d1d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:12.692654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b45895-e29d-4d9d-bdfd-6beaf6020d1d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:12.693152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b45895-e29d-4d9d-bdfd-6beaf6020d1d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:12.694142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b45895-e29d-4d9d-bdfd-6beaf6020d1d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:12.696110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b45895-e29d-4d9d-bdfd-6beaf6020d1d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:12.733717 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2376/4749] 10.222.0.21 () {60 vars in 1184 bytes} [Sat Nov 27 20:59:12 2021] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:12.739173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:12.741516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:12.776727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d65e7a-6677-44cf-89f4-813b18998be8 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:12.791683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b62ee-3a86-4e43-a8a9-90d2590a6fca tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:12.794068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b62ee-3a86-4e43-a8a9-90d2590a6fca tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:12.794362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b62ee-3a86-4e43-a8a9-90d2590a6fca tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:12.796025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b62ee-3a86-4e43-a8a9-90d2590a6fca tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4d5b3717fcb3404d9ab2c1afa3979997` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:12.798561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b62ee-3a86-4e43-a8a9-90d2590a6fca tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=4d5b3717fcb3404d9ab2c1afa3979997)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:12.801379 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-ea8b62ee-3a86-4e43-a8a9-90d2590a6fca tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_consumer failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:12.801379 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:59:12.801379 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:59:12.803128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b62ee-3a86-4e43-a8a9-90d2590a6fca tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:12.838637 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2374/4750] 10.222.0.21 () {60 vars in 1284 bytes} [Sat Nov 27 20:59:12 2021] PATCH /identity/v3/OS-OAUTH1/consumers/4d5b3717fcb3404d9ab2c1afa3979997 => generated 221 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:12.839707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b45895-e29d-4d9d-bdfd-6beaf6020d1d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:12.854561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b45895-e29d-4d9d-bdfd-6beaf6020d1d tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:12.874383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd23d-c375-4f99-b80b-30c8b7f89be5 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:12.875516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd23d-c375-4f99-b80b-30c8b7f89be5 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:12.876178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd23d-c375-4f99-b80b-30c8b7f89be5 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:12.876717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dd23d-c375-4f99-b80b-30c8b7f89be5 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4d5b3717fcb3404d9ab2c1afa3979997` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:12.877735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dd23d-c375-4f99-b80b-30c8b7f89be5 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=4d5b3717fcb3404d9ab2c1afa3979997)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:12.881377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dd23d-c375-4f99-b80b-30c8b7f89be5 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:12.893108 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2377/4751] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 20:59:12 2021] GET /identity/v3/OS-OAUTH1/consumers/4d5b3717fcb3404d9ab2c1afa3979997 => generated 221 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:59:12.897059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b62ee-3a86-4e43-a8a9-90d2590a6fca tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:12.908865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b62ee-3a86-4e43-a8a9-90d2590a6fca tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:12.914731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5648ee-6f5c-42b3-84e0-a1c0ed79a0c1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cf3acc41afd4d1781689e9f83110e13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af34e755c5f4b3cbb59cab1876279e7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:12.915809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5648ee-6f5c-42b3-84e0-a1c0ed79a0c1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:12.916340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5648ee-6f5c-42b3-84e0-a1c0ed79a0c1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:12.916933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5648ee-6f5c-42b3-84e0-a1c0ed79a0c1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4d5b3717fcb3404d9ab2c1afa3979997` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:12.917839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5648ee-6f5c-42b3-84e0-a1c0ed79a0c1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4d5b3717fcb3404d9ab2c1afa3979997)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:12.919888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5648ee-6f5c-42b3-84e0-a1c0ed79a0c1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:12.920470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa5648ee-6f5c-42b3-84e0-a1c0ed79a0c1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invalidating token cache because consumer 4d5b3717fcb3404d9ab2c1afa3979997 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:12.921011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa5648ee-6f5c-42b3-84e0-a1c0ed79a0c1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:12.921962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa5648ee-6f5c-42b3-84e0-a1c0ed79a0c1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:12.936658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa5648ee-6f5c-42b3-84e0-a1c0ed79a0c1 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4d5b3717fcb3404d9ab2c1afa3979997', 'request_id': 'req-aa5648ee-6f5c-42b3-84e0-a1c0ed79a0c1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:12.966606 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2375/4752] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 20:59:12 2021] DELETE /identity/v3/OS-OAUTH1/consumers/4d5b3717fcb3404d9ab2c1afa3979997 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:12.967528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd23d-c375-4f99-b80b-30c8b7f89be5 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:12.969361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-942dd23d-c375-4f99-b80b-30c8b7f89be5 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:13.122791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dd23d-c375-4f99-b80b-30c8b7f89be5 tempest-OAUTHConsumersV3Test-752000984 tempest-OAUTHConsumersV3Test-752000984-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:13.163314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:13.166993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:13.167466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:13.168480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] PATH_INFO: `/v3/users/96f9f4030a2f4f05a4c114d9d167b3b9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:13.186073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f9f4030a2f4f05a4c114d9d167b3b9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:13.188337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:13.320379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f9f4030a2f4f05a4c114d9d167b3b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:13.338487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f9f4030a2f4f05a4c114d9d167b3b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:13.339145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f9f4030a2f4f05a4c114d9d167b3b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:13.352859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f9f4030a2f4f05a4c114d9d167b3b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:13.396121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f9f4030a2f4f05a4c114d9d167b3b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:13.416787 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2378/4753] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:12 2021] DELETE /identity/v3/users/96f9f4030a2f4f05a4c114d9d167b3b9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:13.422451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ac8c-6208-42b5-b2d1-c1211481e9d8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:13.423940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ac8c-6208-42b5-b2d1-c1211481e9d8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:13.425491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ac8c-6208-42b5-b2d1-c1211481e9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:13.479406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9708ac8c-6208-42b5-b2d1-c1211481e9d8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:13.483933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9708ac8c-6208-42b5-b2d1-c1211481e9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:13.660955 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2376/4754] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:13.674250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:13.676124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:13.853935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad1858-2924-4501-b21d-ed7e14519951 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:13.865568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987a456-eec1-4c79-81bd-cae775edf969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:13.866202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987a456-eec1-4c79-81bd-cae775edf969 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:13.866484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987a456-eec1-4c79-81bd-cae775edf969 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:13.866934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987a456-eec1-4c79-81bd-cae775edf969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:13.901512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987a456-eec1-4c79-81bd-cae775edf969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:13.914804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987a456-eec1-4c79-81bd-cae775edf969 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:13.946315 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2379/4755] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:59:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:59:14.449682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708ac8c-6208-42b5-b2d1-c1211481e9d8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:14.451479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9708ac8c-6208-42b5-b2d1-c1211481e9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:14.656101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708ac8c-6208-42b5-b2d1-c1211481e9d8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:14.679676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e400d67-2d7f-49bd-b90e-70b30ff8a8c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:14.680930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e400d67-2d7f-49bd-b90e-70b30ff8a8c8 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:14.681431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e400d67-2d7f-49bd-b90e-70b30ff8a8c8 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:14.701982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e400d67-2d7f-49bd-b90e-70b30ff8a8c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:14.717451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7e400d67-2d7f-49bd-b90e-70b30ff8a8c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:14.756204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e400d67-2d7f-49bd-b90e-70b30ff8a8c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:14.760070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e400d67-2d7f-49bd-b90e-70b30ff8a8c8 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:14.795239 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2377/4756] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:59:14 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:59:15.470807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987a456-eec1-4c79-81bd-cae775edf969 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:15.473141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b987a456-eec1-4c79-81bd-cae775edf969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:15.501424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987a456-eec1-4c79-81bd-cae775edf969 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:15.519707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:15.523445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:15.523746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:15.524029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] PATH_INFO: `/v3/projects/f4d41f7e12524e49bed33b94f8d9701e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:15.528925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d41f7e12524e49bed33b94f8d9701e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:15.533337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:15.710631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d41f7e12524e49bed33b94f8d9701e', 'request_id': 'req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:15.727162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d41f7e12524e49bed33b94f8d9701e', 'request_id': 'req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:15.744318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d41f7e12524e49bed33b94f8d9701e', 'request_id': 'req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:15.766107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] The token cache is being invalidate because project f4d41f7e12524e49bed33b94f8d9701e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:15.766934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:15.768223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:15.774648 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2380/4757] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:59:15 2021] DELETE /identity/v3/projects/f4d41f7e12524e49bed33b94f8d9701e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:15.778720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e400d67-2d7f-49bd-b90e-70b30ff8a8c8 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:15.796819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e400d67-2d7f-49bd-b90e-70b30ff8a8c8 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:16.060574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41f66b-7807-444e-be3d-930b9b5712b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:16.062612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41f66b-7807-444e-be3d-930b9b5712b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:16.066174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41f66b-7807-444e-be3d-930b9b5712b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:16.067421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41f66b-7807-444e-be3d-930b9b5712b5 admin admin] PATH_INFO: `/v3/users/1cf3acc41afd4d1781689e9f83110e13` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:16.070955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41f66b-7807-444e-be3d-930b9b5712b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf3acc41afd4d1781689e9f83110e13)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:16.077282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41f66b-7807-444e-be3d-930b9b5712b5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:16.249853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ab41f66b-7807-444e-be3d-930b9b5712b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf3acc41afd4d1781689e9f83110e13'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:16.250695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ab41f66b-7807-444e-be3d-930b9b5712b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf3acc41afd4d1781689e9f83110e13'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:16.268505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ab41f66b-7807-444e-be3d-930b9b5712b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf3acc41afd4d1781689e9f83110e13'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:16.270875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ab41f66b-7807-444e-be3d-930b9b5712b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf3acc41afd4d1781689e9f83110e13'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:16.283353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ab41f66b-7807-444e-be3d-930b9b5712b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf3acc41afd4d1781689e9f83110e13'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:16.334982 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2378/4758] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:15 2021] DELETE /identity/v3/users/1cf3acc41afd4d1781689e9f83110e13 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:16.983973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:16.988261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:17.037858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586b3e4-3f1e-4ef8-8b7c-f556b52bc16c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:17.248119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:17.249299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:17.251921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:17.252659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] PATH_INFO: `/v3/projects/1af34e755c5f4b3cbb59cab1876279e7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:17.257065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af34e755c5f4b3cbb59cab1876279e7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:17.263155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:17.345947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af34e755c5f4b3cbb59cab1876279e7', 'request_id': 'req-e01dab84-76f5-48d9-a368-17fc87961ebf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:17.377053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af34e755c5f4b3cbb59cab1876279e7', 'request_id': 'req-e01dab84-76f5-48d9-a368-17fc87961ebf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:17.391282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af34e755c5f4b3cbb59cab1876279e7', 'request_id': 'req-e01dab84-76f5-48d9-a368-17fc87961ebf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:17.414826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] The token cache is being invalidate because project 1af34e755c5f4b3cbb59cab1876279e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:17.415126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:17.416529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e01dab84-76f5-48d9-a368-17fc87961ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:17.425330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e730-e8ae-4a6e-84d3-8c28b17bfc71 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:17.427684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e730-e8ae-4a6e-84d3-8c28b17bfc71 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:17.428212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220e730-e8ae-4a6e-84d3-8c28b17bfc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:17.440270 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2381/4759] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:59:16 2021] DELETE /identity/v3/projects/1af34e755c5f4b3cbb59cab1876279e7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:17.483600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7220e730-e8ae-4a6e-84d3-8c28b17bfc71 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:17.485500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7220e730-e8ae-4a6e-84d3-8c28b17bfc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:17.660625 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2379/4760] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:17.670488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319898b4-9661-4082-89c9-91f66d6faeec None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:17.670841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319898b4-9661-4082-89c9-91f66d6faeec None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:17.671530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319898b4-9661-4082-89c9-91f66d6faeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:17.714764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-319898b4-9661-4082-89c9-91f66d6faeec None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:17.718359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-319898b4-9661-4082-89c9-91f66d6faeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:17.746295 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2382/4761] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:17.750948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220e730-e8ae-4a6e-84d3-8c28b17bfc71 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:17.763847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220e730-e8ae-4a6e-84d3-8c28b17bfc71 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:17.770795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a096a-27e9-4f6b-9802-8a8a89efb02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:17.771696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a096a-27e9-4f6b-9802-8a8a89efb02d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:17.772137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a096a-27e9-4f6b-9802-8a8a89efb02d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:17.772519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a096a-27e9-4f6b-9802-8a8a89efb02d admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:17.773480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a096a-27e9-4f6b-9802-8a8a89efb02d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:59:17.773907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a096a-27e9-4f6b-9802-8a8a89efb02d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:17.775706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a096a-27e9-4f6b-9802-8a8a89efb02d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:17.792233 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2380/4762] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:59:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:17.798553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319898b4-9661-4082-89c9-91f66d6faeec None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:17.814328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319898b4-9661-4082-89c9-91f66d6faeec None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:17.827968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b270c3-15ae-43c6-a3a3-0d182c8cecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:17.828647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b270c3-15ae-43c6-a3a3-0d182c8cecff admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:17.828928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b270c3-15ae-43c6-a3a3-0d182c8cecff admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:17.829201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b270c3-15ae-43c6-a3a3-0d182c8cecff admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:17.829914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b270c3-15ae-43c6-a3a3-0d182c8cecff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:17.831882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b270c3-15ae-43c6-a3a3-0d182c8cecff admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:17.891503 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2383/4763] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:59:17 2021] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:17.911826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a096a-27e9-4f6b-9802-8a8a89efb02d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:17.933701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a096a-27e9-4f6b-9802-8a8a89efb02d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:18.092732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa952132-882c-45b4-805d-c7c229387c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:18.094008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa952132-882c-45b4-805d-c7c229387c3e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:18.094509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa952132-882c-45b4-805d-c7c229387c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:18.095010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa952132-882c-45b4-805d-c7c229387c3e admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:18.096216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa952132-882c-45b4-805d-c7c229387c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:18.098971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa952132-882c-45b4-805d-c7c229387c3e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:18.187177 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2381/4764] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:59:17 2021] POST /identity/v3/users => generated 284 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:18.191374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b270c3-15ae-43c6-a3a3-0d182c8cecff admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:18.210439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b270c3-15ae-43c6-a3a3-0d182c8cecff admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:18.229755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160a16-6781-4a23-a029-cb0e73ff539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:18.235416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160a16-6781-4a23-a029-cb0e73ff539f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:18.236214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160a16-6781-4a23-a029-cb0e73ff539f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:18.236966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160a16-6781-4a23-a029-cb0e73ff539f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:18.239573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b160a16-6781-4a23-a029-cb0e73ff539f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:18.250311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b160a16-6781-4a23-a029-cb0e73ff539f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:18.278272 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2384/4765] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:18 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:59:18.281504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa952132-882c-45b4-805d-c7c229387c3e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:18.296421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa952132-882c-45b4-805d-c7c229387c3e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:18.315714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d4020-b65b-4d3a-b341-352308298d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:18.316604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4020-b65b-4d3a-b341-352308298d4c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:18.316990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4020-b65b-4d3a-b341-352308298d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:18.319214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d4020-b65b-4d3a-b341-352308298d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:18.322214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4020-b65b-4d3a-b341-352308298d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:18.327495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d4020-b65b-4d3a-b341-352308298d4c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:18.355008 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2382/4766] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:18 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:18.358012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160a16-6781-4a23-a029-cb0e73ff539f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:18.375536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160a16-6781-4a23-a029-cb0e73ff539f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:18.397846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bae9c5-6f14-4bc1-b838-f2239020bc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:18.401905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bae9c5-6f14-4bc1-b838-f2239020bc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:18.402217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bae9c5-6f14-4bc1-b838-f2239020bc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:18.404378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bae9c5-6f14-4bc1-b838-f2239020bc3a admin admin] PATH_INFO: `/v3/projects/3c26af09c9a34ccbbcb44ac73b55030f/users/bbeca7fa44424450a4bdc848915d36f7/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:18.478518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bae9c5-6f14-4bc1-b838-f2239020bc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c26af09c9a34ccbbcb44ac73b55030f, user_id=bbeca7fa44424450a4bdc848915d36f7, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:18.483967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bae9c5-6f14-4bc1-b838-f2239020bc3a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:18.509634 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2385/4767] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:18 2021] PUT /identity/v3/projects/3c26af09c9a34ccbbcb44ac73b55030f/users/bbeca7fa44424450a4bdc848915d36f7/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:18.522113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17847f1-c380-4770-8b98-a60f119d5b7d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:18.522644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17847f1-c380-4770-8b98-a60f119d5b7d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:18.522740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17847f1-c380-4770-8b98-a60f119d5b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:18.604993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e17847f1-c380-4770-8b98-a60f119d5b7d None None] MFA Rules not processed for user `bbeca7fa44424450a4bdc848915d36f7`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:18.607082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e17847f1-c380-4770-8b98-a60f119d5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:18.699976 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2383/4768] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:18 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:18.704417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bae9c5-6f14-4bc1-b838-f2239020bc3a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:18.839908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bae9c5-6f14-4bc1-b838-f2239020bc3a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:18.848923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d290b4-5ce8-4c88-b352-f6fe4f2eeed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:18.855084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d290b4-5ce8-4c88-b352-f6fe4f2eeed7 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:18.855399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d290b4-5ce8-4c88-b352-f6fe4f2eeed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:18.855665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d290b4-5ce8-4c88-b352-f6fe4f2eeed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:18.857864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d290b4-5ce8-4c88-b352-f6fe4f2eeed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:18.860746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d290b4-5ce8-4c88-b352-f6fe4f2eeed7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:18.903813 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2386/4769] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:59:18 2021] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:18.908058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17847f1-c380-4770-8b98-a60f119d5b7d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:18.923526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17847f1-c380-4770-8b98-a60f119d5b7d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:19.058907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17307c44-67b8-4d4e-b633-6657160a1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:19.059737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307c44-67b8-4d4e-b633-6657160a1758 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:19.060003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307c44-67b8-4d4e-b633-6657160a1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:19.060277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307c44-67b8-4d4e-b633-6657160a1758 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:19.061262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17307c44-67b8-4d4e-b633-6657160a1758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:19.063474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17307c44-67b8-4d4e-b633-6657160a1758 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:19.100572 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2384/4770] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:59:18 2021] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:19.104120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d290b4-5ce8-4c88-b352-f6fe4f2eeed7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:19.119619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d290b4-5ce8-4c88-b352-f6fe4f2eeed7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:19.126514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02750735-4d2e-441f-b158-efa9e64ebd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:19.127115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02750735-4d2e-441f-b158-efa9e64ebd6c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:19.127437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02750735-4d2e-441f-b158-efa9e64ebd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:19.128082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02750735-4d2e-441f-b158-efa9e64ebd6c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:19.128949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02750735-4d2e-441f-b158-efa9e64ebd6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:19.131296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02750735-4d2e-441f-b158-efa9e64ebd6c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:19.148893 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2387/4771] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:19 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:19.153363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17307c44-67b8-4d4e-b633-6657160a1758 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:19.165322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17307c44-67b8-4d4e-b633-6657160a1758 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:19.177132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c06084-8374-434b-9449-7287f67687a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:19.178075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c06084-8374-434b-9449-7287f67687a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:19.178357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c06084-8374-434b-9449-7287f67687a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:19.178636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c06084-8374-434b-9449-7287f67687a0 admin admin] PATH_INFO: `/v3/projects/a7a1daed9ce648c89f1826e948c6515b/users/cd0277caf27442d980ace2d9113444d3/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:19.196402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c06084-8374-434b-9449-7287f67687a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a1daed9ce648c89f1826e948c6515b, user_id=cd0277caf27442d980ace2d9113444d3, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:19.200845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c06084-8374-434b-9449-7287f67687a0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:19.217626 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2385/4772] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:19 2021] PUT /identity/v3/projects/a7a1daed9ce648c89f1826e948c6515b/users/cd0277caf27442d980ace2d9113444d3/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:19.222237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02750735-4d2e-441f-b158-efa9e64ebd6c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:19.237876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02750735-4d2e-441f-b158-efa9e64ebd6c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:19.319238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7428a-7f77-406b-83ab-f91f21b35c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:19.320249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7428a-7f77-406b-83ab-f91f21b35c52 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:19.320703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7428a-7f77-406b-83ab-f91f21b35c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:19.321146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7428a-7f77-406b-83ab-f91f21b35c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:19.322052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7428a-7f77-406b-83ab-f91f21b35c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:19.323934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7428a-7f77-406b-83ab-f91f21b35c52 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:19.336446 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2388/4773] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:19 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:19.340457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c06084-8374-434b-9449-7287f67687a0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:19.356161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c06084-8374-434b-9449-7287f67687a0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:19.380300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ee87b-a97a-4dbe-a4cd-610fb4cc3b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:19.381125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ee87b-a97a-4dbe-a4cd-610fb4cc3b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:19.381411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ee87b-a97a-4dbe-a4cd-610fb4cc3b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:19.381817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ee87b-a97a-4dbe-a4cd-610fb4cc3b05 admin admin] PATH_INFO: `/v3/projects/a7a1daed9ce648c89f1826e948c6515b/users/cd0277caf27442d980ace2d9113444d3/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:19.384171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ee87b-a97a-4dbe-a4cd-610fb4cc3b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a1daed9ce648c89f1826e948c6515b, user_id=cd0277caf27442d980ace2d9113444d3, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:19.386903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ee87b-a97a-4dbe-a4cd-610fb4cc3b05 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:19.418712 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2386/4774] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:19 2021] PUT /identity/v3/projects/a7a1daed9ce648c89f1826e948c6515b/users/cd0277caf27442d980ace2d9113444d3/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:19.431954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60ddc-8ba3-473e-aae9-e7383b30f7fd None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:19.431954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60ddc-8ba3-473e-aae9-e7383b30f7fd None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:19.431954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60ddc-8ba3-473e-aae9-e7383b30f7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:19.494209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a4c60ddc-8ba3-473e-aae9-e7383b30f7fd None None] MFA Rules not processed for user `cd0277caf27442d980ace2d9113444d3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:19.495491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a4c60ddc-8ba3-473e-aae9-e7383b30f7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:19.604028 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2389/4775] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:19 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:19.605480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ee87b-a97a-4dbe-a4cd-610fb4cc3b05 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:19.622887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ee87b-a97a-4dbe-a4cd-610fb4cc3b05 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:19.636716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256d60c-4aed-474c-a690-518e61654ebe tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:19.637453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d60c-4aed-474c-a690-518e61654ebe tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:19.637978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d60c-4aed-474c-a690-518e61654ebe tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:19.638482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d60c-4aed-474c-a690-518e61654ebe tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:19.639494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256d60c-4aed-474c-a690-518e61654ebe tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:19.640728 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-8256d60c-4aed-474c-a690-518e61654ebe tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_region failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:19.640728 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:59:19.640728 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:59:19.641998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256d60c-4aed-474c-a690-518e61654ebe tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:19.692381 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2387/4776] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:59:19 2021] POST /identity/v3/regions => generated 223 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:19.695946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c60ddc-8ba3-473e-aae9-e7383b30f7fd None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:19.709623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c60ddc-8ba3-473e-aae9-e7383b30f7fd None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:19.729344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f20bb2-3e41-4bfd-aa3f-6527178aaee4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:19.730200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f20bb2-3e41-4bfd-aa3f-6527178aaee4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:19.730608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f20bb2-3e41-4bfd-aa3f-6527178aaee4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:19.730980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f20bb2-3e41-4bfd-aa3f-6527178aaee4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:19.731902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f20bb2-3e41-4bfd-aa3f-6527178aaee4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:19.733140 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-36f20bb2-3e41-4bfd-aa3f-6527178aaee4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_region failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:19.733140 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:59:19.733140 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:59:19.734293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f20bb2-3e41-4bfd-aa3f-6527178aaee4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:19.766805 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2390/4777] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 20:59:19 2021] POST /identity/v3/regions => generated 224 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:59:19.771865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256d60c-4aed-474c-a690-518e61654ebe tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:19.788201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256d60c-4aed-474c-a690-518e61654ebe tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:19.820831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a73ebf-5668-4659-89f7-5b687e388864 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:19.825068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a73ebf-5668-4659-89f7-5b687e388864 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:19.825361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a73ebf-5668-4659-89f7-5b687e388864 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:19.825646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a73ebf-5668-4659-89f7-5b687e388864 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions/149cdd33-dfa7-4980-8308-8fec7eb85e98` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:19.826476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a73ebf-5668-4659-89f7-5b687e388864 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:create_region(region_id=149cdd33-dfa7-4980-8308-8fec7eb85e98)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:19.829850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a73ebf-5668-4659-89f7-5b687e388864 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:19.864656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f20bb2-3e41-4bfd-aa3f-6527178aaee4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:19.877353 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2388/4778] 10.222.0.21 () {60 vars in 1258 bytes} [Sat Nov 27 20:59:19 2021] PUT /identity/v3/regions/149cdd33-dfa7-4980-8308-8fec7eb85e98 => generated 232 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:19.879214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f20bb2-3e41-4bfd-aa3f-6527178aaee4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:19.897288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b51df-dbf2-4e21-ab9f-9d7a1f7e7794 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:19.898369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b51df-dbf2-4e21-ab9f-9d7a1f7e7794 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:19.898834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b51df-dbf2-4e21-ab9f-9d7a1f7e7794 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:19.899299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b51df-dbf2-4e21-ab9f-9d7a1f7e7794 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions/149cdd33-dfa7-4980-8308-8fec7eb85e98` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:19.900144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b51df-dbf2-4e21-ab9f-9d7a1f7e7794 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:delete_region(region_id=149cdd33-dfa7-4980-8308-8fec7eb85e98)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:19.901328 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-e41b51df-dbf2-4e21-ab9f-9d7a1f7e7794 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_region failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:19.901328 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:59:19.901328 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:59:19.902610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b51df-dbf2-4e21-ab9f-9d7a1f7e7794 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:19.939820 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2391/4779] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 20:59:19 2021] DELETE /identity/v3/regions/149cdd33-dfa7-4980-8308-8fec7eb85e98 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:19.949420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a73ebf-5668-4659-89f7-5b687e388864 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:19.967096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a73ebf-5668-4659-89f7-5b687e388864 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:19.991079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7a470-2a5a-459f-a494-214e5afaa8f6 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:19.991876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a470-2a5a-459f-a494-214e5afaa8f6 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:19.992223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a470-2a5a-459f-a494-214e5afaa8f6 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:19.992612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7a470-2a5a-459f-a494-214e5afaa8f6 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:19.993427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7a470-2a5a-459f-a494-214e5afaa8f6 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:19.995114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7a470-2a5a-459f-a494-214e5afaa8f6 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.026361 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2389/4780] 10.222.0.21 () {60 vars in 1149 bytes} [Sat Nov 27 20:59:19 2021] POST /identity/v3/regions => generated 254 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:20.029941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b51df-dbf2-4e21-ab9f-9d7a1f7e7794 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:20.043484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b51df-dbf2-4e21-ab9f-9d7a1f7e7794 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:20.081977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e7664-ce55-4b3b-827d-788638ce338f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:20.083307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7664-ce55-4b3b-827d-788638ce338f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:20.083599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7664-ce55-4b3b-827d-788638ce338f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:20.084269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7664-ce55-4b3b-827d-788638ce338f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions/10ae8c8d0cfa4b5fbe97db94b040f06b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:20.089821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e7664-ce55-4b3b-827d-788638ce338f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:update_region(region_id=10ae8c8d0cfa4b5fbe97db94b040f06b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:20.095564 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-f77e7664-ce55-4b3b-827d-788638ce338f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_region failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:20.095564 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 20:59:20.095564 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 20:59:20.100007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e7664-ce55-4b3b-827d-788638ce338f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.166283 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2392/4781] 10.222.0.21 () {60 vars in 1249 bytes} [Sat Nov 27 20:59:20 2021] PATCH /identity/v3/regions/10ae8c8d0cfa4b5fbe97db94b040f06b => generated 254 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:20.170622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7a470-2a5a-459f-a494-214e5afaa8f6 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:20.184342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7a470-2a5a-459f-a494-214e5afaa8f6 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:20.202677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4acde3-4123-4ff6-b148-95a45c86e20a tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:20.203856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4acde3-4123-4ff6-b148-95a45c86e20a tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:20.204610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4acde3-4123-4ff6-b148-95a45c86e20a tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:20.205217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4acde3-4123-4ff6-b148-95a45c86e20a tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions/10ae8c8d0cfa4b5fbe97db94b040f06b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:20.206096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4acde3-4123-4ff6-b148-95a45c86e20a tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:get_region(region_id=10ae8c8d0cfa4b5fbe97db94b040f06b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:20.207636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4acde3-4123-4ff6-b148-95a45c86e20a tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.217073 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2390/4782] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:59:20 2021] GET /identity/v3/regions/10ae8c8d0cfa4b5fbe97db94b040f06b => generated 254 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:20.220076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e7664-ce55-4b3b-827d-788638ce338f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:20.239713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e7664-ce55-4b3b-827d-788638ce338f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:20.247612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa2bcb-1cd6-44dd-89d7-ef94635f246b tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:20.248783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa2bcb-1cd6-44dd-89d7-ef94635f246b tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:20.249270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa2bcb-1cd6-44dd-89d7-ef94635f246b tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:20.249736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa2bcb-1cd6-44dd-89d7-ef94635f246b tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions/10ae8c8d0cfa4b5fbe97db94b040f06b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:20.250844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa2bcb-1cd6-44dd-89d7-ef94635f246b tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:delete_region(region_id=10ae8c8d0cfa4b5fbe97db94b040f06b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:20.252673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa2bcb-1cd6-44dd-89d7-ef94635f246b tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.284404 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2393/4783] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:59:20 2021] DELETE /identity/v3/regions/10ae8c8d0cfa4b5fbe97db94b040f06b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:59:20.289676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4acde3-4123-4ff6-b148-95a45c86e20a tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:20.316299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4acde3-4123-4ff6-b148-95a45c86e20a tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:20.336317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad314f-646d-42a7-be07-ec6362867b97 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:20.337277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad314f-646d-42a7-be07-ec6362867b97 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:20.337634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad314f-646d-42a7-be07-ec6362867b97 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:20.338176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad314f-646d-42a7-be07-ec6362867b97 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:20.339390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad314f-646d-42a7-be07-ec6362867b97 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:20.341129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad314f-646d-42a7-be07-ec6362867b97 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.355462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa2bcb-1cd6-44dd-89d7-ef94635f246b tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:20.357811 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2391/4784] 10.222.0.21 () {58 vars in 1127 bytes} [Sat Nov 27 20:59:20 2021] GET /identity/v3/regions => generated 669 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:20.379664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa2bcb-1cd6-44dd-89d7-ef94635f246b tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:20.390209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f597d4-75d8-49da-b064-2236c5beb8d4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:20.392201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f597d4-75d8-49da-b064-2236c5beb8d4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:20.392725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f597d4-75d8-49da-b064-2236c5beb8d4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:20.393219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f597d4-75d8-49da-b064-2236c5beb8d4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions/10ae8c8d0cfa4b5fbe97db94b040f06b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:20.394102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f597d4-75d8-49da-b064-2236c5beb8d4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:delete_region(region_id=10ae8c8d0cfa4b5fbe97db94b040f06b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:20.396731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f597d4-75d8-49da-b064-2236c5beb8d4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.413760 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-e9f597d4-75d8-49da-b064-2236c5beb8d4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Could not find region: 10ae8c8d0cfa4b5fbe97db94b040f06b.: keystone.exception.RegionNotFound: Could not find region: 10ae8c8d0cfa4b5fbe97db94b040f06b. Nov 27 20:59:20.415284 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2394/4785] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:59:20 2021] DELETE /identity/v3/regions/10ae8c8d0cfa4b5fbe97db94b040f06b => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 20:59:20.421266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad314f-646d-42a7-be07-ec6362867b97 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:20.436624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad314f-646d-42a7-be07-ec6362867b97 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:20.444054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0d540-ed62-4513-993a-0b00607f340f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:20.444977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0d540-ed62-4513-993a-0b00607f340f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:20.445269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0d540-ed62-4513-993a-0b00607f340f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:20.445550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0d540-ed62-4513-993a-0b00607f340f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:20.446242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0d540-ed62-4513-993a-0b00607f340f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:20.447668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0d540-ed62-4513-993a-0b00607f340f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.460841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f597d4-75d8-49da-b064-2236c5beb8d4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:20.474535 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2392/4786] 10.222.0.21 () {58 vars in 1127 bytes} [Sat Nov 27 20:59:20 2021] GET /identity/v3/regions => generated 669 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:20.479879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f597d4-75d8-49da-b064-2236c5beb8d4 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:20.485272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066ad4-7a53-45b9-8c0a-88967e17eb5d tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:20.485947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066ad4-7a53-45b9-8c0a-88967e17eb5d tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:20.486285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066ad4-7a53-45b9-8c0a-88967e17eb5d tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:20.486576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066ad4-7a53-45b9-8c0a-88967e17eb5d tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:20.487359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82066ad4-7a53-45b9-8c0a-88967e17eb5d tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:20.489247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82066ad4-7a53-45b9-8c0a-88967e17eb5d tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.531217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0d540-ed62-4513-993a-0b00607f340f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:20.541163 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2395/4787] 10.222.0.21 () {60 vars in 1149 bytes} [Sat Nov 27 20:59:20 2021] POST /identity/v3/regions => generated 254 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:59:20.545396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0d540-ed62-4513-993a-0b00607f340f tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:20.569538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60c526-310c-4a8c-8d7a-0a82c18e78f9 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:20.570588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c526-310c-4a8c-8d7a-0a82c18e78f9 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:20.570954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c526-310c-4a8c-8d7a-0a82c18e78f9 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:20.571357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c526-310c-4a8c-8d7a-0a82c18e78f9 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:20.572259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60c526-310c-4a8c-8d7a-0a82c18e78f9 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Adding query filter params (parent_region_id=6c84406ecdf54e7d9887e589afe00761) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:59:20.572811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60c526-310c-4a8c-8d7a-0a82c18e78f9 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:20.574037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60c526-310c-4a8c-8d7a-0a82c18e78f9 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.584953 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2393/4788] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 20:59:20 2021] GET /identity/v3/regions?parent_region_id=6c84406ecdf54e7d9887e589afe00761 => generated 400 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:59:20.586119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066ad4-7a53-45b9-8c0a-88967e17eb5d tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:20.599557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066ad4-7a53-45b9-8c0a-88967e17eb5d tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:20.616963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ef5ac-05d5-42f1-8b2f-2d9818fc0fe8 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:20.617981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef5ac-05d5-42f1-8b2f-2d9818fc0fe8 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:20.618273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef5ac-05d5-42f1-8b2f-2d9818fc0fe8 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:20.618549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef5ac-05d5-42f1-8b2f-2d9818fc0fe8 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions/eb85a2990cf647cbad922489e0aa61b8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:20.619219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ef5ac-05d5-42f1-8b2f-2d9818fc0fe8 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:delete_region(region_id=eb85a2990cf647cbad922489e0aa61b8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:20.621617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ef5ac-05d5-42f1-8b2f-2d9818fc0fe8 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.652836 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2396/4789] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:59:20 2021] DELETE /identity/v3/regions/eb85a2990cf647cbad922489e0aa61b8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:20.659659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60c526-310c-4a8c-8d7a-0a82c18e78f9 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:20.674535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60c526-310c-4a8c-8d7a-0a82c18e78f9 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:20.704797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eb18e-7b46-40d5-aa02-8f6b0f43e8f7 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:20.705648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eb18e-7b46-40d5-aa02-8f6b0f43e8f7 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:20.705936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eb18e-7b46-40d5-aa02-8f6b0f43e8f7 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:20.706221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eb18e-7b46-40d5-aa02-8f6b0f43e8f7 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions/0d6231f142be4a4899ad1317113ac34c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:20.707466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70eb18e-7b46-40d5-aa02-8f6b0f43e8f7 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0d6231f142be4a4899ad1317113ac34c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:20.708539 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-f70eb18e-7b46-40d5-aa02-8f6b0f43e8f7 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_region failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 20:59:20.708539 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 20:59:20.708539 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 20:59:20.709430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70eb18e-7b46-40d5-aa02-8f6b0f43e8f7 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.743880 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2394/4790] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:59:20 2021] DELETE /identity/v3/regions/0d6231f142be4a4899ad1317113ac34c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:20.748208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ef5ac-05d5-42f1-8b2f-2d9818fc0fe8 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:20.768520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ef5ac-05d5-42f1-8b2f-2d9818fc0fe8 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:20.797165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052fecd-6142-42ce-b214-34ffb8100f78 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0277caf27442d980ace2d9113444d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a1daed9ce648c89f1826e948c6515b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:20.798645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052fecd-6142-42ce-b214-34ffb8100f78 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:20.799163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052fecd-6142-42ce-b214-34ffb8100f78 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:20.799745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052fecd-6142-42ce-b214-34ffb8100f78 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] PATH_INFO: `/v3/regions/6c84406ecdf54e7d9887e589afe00761` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:20.814951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052fecd-6142-42ce-b214-34ffb8100f78 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorizing `identity:delete_region(region_id=6c84406ecdf54e7d9887e589afe00761)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:20.814951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052fecd-6142-42ce-b214-34ffb8100f78 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:20.851592 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2397/4791] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 20:59:20 2021] DELETE /identity/v3/regions/6c84406ecdf54e7d9887e589afe00761 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:20.852500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eb18e-7b46-40d5-aa02-8f6b0f43e8f7 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:21.002628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eb18e-7b46-40d5-aa02-8f6b0f43e8f7 tempest-RegionsTestJSON-1683673784 tempest-RegionsTestJSON-1683673784-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:21.030005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:21.031176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:21.032135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:21.032584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] PATH_INFO: `/v3/users/bbeca7fa44424450a4bdc848915d36f7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:21.035094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbeca7fa44424450a4bdc848915d36f7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:21.038378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:21.099379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbeca7fa44424450a4bdc848915d36f7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:21.100310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbeca7fa44424450a4bdc848915d36f7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:21.112490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbeca7fa44424450a4bdc848915d36f7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:21.119194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbeca7fa44424450a4bdc848915d36f7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:21.131684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbeca7fa44424450a4bdc848915d36f7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:21.170719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676300-610e-44ec-883b-d489f32ca8ec None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:21.171009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676300-610e-44ec-883b-d489f32ca8ec None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:21.171329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676300-610e-44ec-883b-d489f32ca8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:21.174243 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2395/4792] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:20 2021] DELETE /identity/v3/users/bbeca7fa44424450a4bdc848915d36f7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:59:21.193973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3f676300-610e-44ec-883b-d489f32ca8ec None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:21.195197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3f676300-610e-44ec-883b-d489f32ca8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:21.275844 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2398/4793] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:21.286149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:21.288763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:21.388275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d262bd2-e1e4-4784-84ca-da34ee8ee9f3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:21.392889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29b21d-a0f5-425c-baec-4f35ad8bbb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:21.393805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29b21d-a0f5-425c-baec-4f35ad8bbb43 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:21.394316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29b21d-a0f5-425c-baec-4f35ad8bbb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:21.394759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29b21d-a0f5-425c-baec-4f35ad8bbb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:21.413601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29b21d-a0f5-425c-baec-4f35ad8bbb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:21.415752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29b21d-a0f5-425c-baec-4f35ad8bbb43 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:21.440333 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2396/4794] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:59:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:59:22.308618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f676300-610e-44ec-883b-d489f32ca8ec None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:22.310179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3f676300-610e-44ec-883b-d489f32ca8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:22.324956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f676300-610e-44ec-883b-d489f32ca8ec None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:22.331661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:22.333037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:22.333521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:22.333801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] PATH_INFO: `/v3/projects/3c26af09c9a34ccbbcb44ac73b55030f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:22.335179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c26af09c9a34ccbbcb44ac73b55030f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:22.337128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:22.397070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c26af09c9a34ccbbcb44ac73b55030f', 'request_id': 'req-6bbe12bd-03ec-4541-89ad-00e489ec57dd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:22.406722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c26af09c9a34ccbbcb44ac73b55030f', 'request_id': 'req-6bbe12bd-03ec-4541-89ad-00e489ec57dd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:22.413887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c26af09c9a34ccbbcb44ac73b55030f', 'request_id': 'req-6bbe12bd-03ec-4541-89ad-00e489ec57dd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:22.424940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] The token cache is being invalidate because project 3c26af09c9a34ccbbcb44ac73b55030f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:22.425512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:22.426453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:22.429303 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2399/4795] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:59:22 2021] DELETE /identity/v3/projects/3c26af09c9a34ccbbcb44ac73b55030f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:22.433006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29b21d-a0f5-425c-baec-4f35ad8bbb43 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:22.453610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29b21d-a0f5-425c-baec-4f35ad8bbb43 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:22.517671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380bc0a-378a-454f-9243-b71b53bc5483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:22.518531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380bc0a-378a-454f-9243-b71b53bc5483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:22.518810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380bc0a-378a-454f-9243-b71b53bc5483 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:22.519106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380bc0a-378a-454f-9243-b71b53bc5483 admin admin] PATH_INFO: `/v3/users/cd0277caf27442d980ace2d9113444d3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:22.521352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380bc0a-378a-454f-9243-b71b53bc5483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0277caf27442d980ace2d9113444d3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:22.524131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380bc0a-378a-454f-9243-b71b53bc5483 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:22.591961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b380bc0a-378a-454f-9243-b71b53bc5483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0277caf27442d980ace2d9113444d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:22.592774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b380bc0a-378a-454f-9243-b71b53bc5483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0277caf27442d980ace2d9113444d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:22.604451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b380bc0a-378a-454f-9243-b71b53bc5483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0277caf27442d980ace2d9113444d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:22.605677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b380bc0a-378a-454f-9243-b71b53bc5483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0277caf27442d980ace2d9113444d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:22.616869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b380bc0a-378a-454f-9243-b71b53bc5483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0277caf27442d980ace2d9113444d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:22.642296 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2397/4796] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:22 2021] DELETE /identity/v3/users/cd0277caf27442d980ace2d9113444d3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:23.884211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:23.885806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:23.901716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe12bd-03ec-4541-89ad-00e489ec57dd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:24.012822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:24.015061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:24.028021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:24.028152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] PATH_INFO: `/v3/projects/a7a1daed9ce648c89f1826e948c6515b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:24.030963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a1daed9ce648c89f1826e948c6515b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:24.033725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:24.138322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a1daed9ce648c89f1826e948c6515b', 'request_id': 'req-907d0673-e56e-406f-9ee5-d156101238ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:24.158316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a1daed9ce648c89f1826e948c6515b', 'request_id': 'req-907d0673-e56e-406f-9ee5-d156101238ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:24.178666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a1daed9ce648c89f1826e948c6515b', 'request_id': 'req-907d0673-e56e-406f-9ee5-d156101238ba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:24.209808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] The token cache is being invalidate because project a7a1daed9ce648c89f1826e948c6515b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:24.210365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:24.212662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-907d0673-e56e-406f-9ee5-d156101238ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:24.217924 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2400/4797] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:59:23 2021] DELETE /identity/v3/projects/a7a1daed9ce648c89f1826e948c6515b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:24.225033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f12244-62bf-4277-9909-04f7e71ff069 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:24.225935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f12244-62bf-4277-9909-04f7e71ff069 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:24.226392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f12244-62bf-4277-9909-04f7e71ff069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:24.259769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e1f12244-62bf-4277-9909-04f7e71ff069 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:24.261283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e1f12244-62bf-4277-9909-04f7e71ff069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:24.355128 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2398/4798] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:24.365805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42238df-717f-41c6-8d08-c5652a740c22 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:24.368037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42238df-717f-41c6-8d08-c5652a740c22 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:24.368516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42238df-717f-41c6-8d08-c5652a740c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:24.403976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e42238df-717f-41c6-8d08-c5652a740c22 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:24.405860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e42238df-717f-41c6-8d08-c5652a740c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:24.419420 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2401/4799] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:24.423312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f12244-62bf-4277-9909-04f7e71ff069 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:24.436419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f12244-62bf-4277-9909-04f7e71ff069 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:24.447431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf743fad-d654-4695-ba37-ed51478348f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:24.448793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743fad-d654-4695-ba37-ed51478348f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:24.449246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743fad-d654-4695-ba37-ed51478348f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:24.450596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf743fad-d654-4695-ba37-ed51478348f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:24.451635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf743fad-d654-4695-ba37-ed51478348f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:59:24.452360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf743fad-d654-4695-ba37-ed51478348f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:24.454828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf743fad-d654-4695-ba37-ed51478348f9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:24.494138 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2399/4800] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:59:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:24.498880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42238df-717f-41c6-8d08-c5652a740c22 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:24.512732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42238df-717f-41c6-8d08-c5652a740c22 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:24.532189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0d9aa-304c-4be8-ba46-7d61d8881ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:24.532916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0d9aa-304c-4be8-ba46-7d61d8881ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:24.533300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0d9aa-304c-4be8-ba46-7d61d8881ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:24.533799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0d9aa-304c-4be8-ba46-7d61d8881ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:24.534669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0d9aa-304c-4be8-ba46-7d61d8881ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:24.537275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0d9aa-304c-4be8-ba46-7d61d8881ae5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:24.618060 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2402/4801] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:59:24 2021] POST /identity/v3/projects => generated 359 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:24.618861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf743fad-d654-4695-ba37-ed51478348f9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:24.634743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf743fad-d654-4695-ba37-ed51478348f9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:24.764073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cc6cf-ff48-41d1-bd54-c3d66545535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:24.765593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cc6cf-ff48-41d1-bd54-c3d66545535f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:24.767686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cc6cf-ff48-41d1-bd54-c3d66545535f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:24.768205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cc6cf-ff48-41d1-bd54-c3d66545535f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:24.769687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cc6cf-ff48-41d1-bd54-c3d66545535f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:24.771656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cc6cf-ff48-41d1-bd54-c3d66545535f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:24.795790 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2400/4802] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:59:24 2021] POST /identity/v3/users => generated 280 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:24.802444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0d9aa-304c-4be8-ba46-7d61d8881ae5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:24.827094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0d9aa-304c-4be8-ba46-7d61d8881ae5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:24.852200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cd774-0b31-46ac-96f7-8e130865ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:24.853243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cd774-0b31-46ac-96f7-8e130865ca40 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:24.853683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cd774-0b31-46ac-96f7-8e130865ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:24.854142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cd774-0b31-46ac-96f7-8e130865ca40 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:24.855055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cd774-0b31-46ac-96f7-8e130865ca40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:24.860898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cd774-0b31-46ac-96f7-8e130865ca40 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:24.898463 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2403/4803] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:24 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:24.900956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cc6cf-ff48-41d1-bd54-c3d66545535f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:24.931579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cc6cf-ff48-41d1-bd54-c3d66545535f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:24.937499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d876e1-bfaf-47d0-ad5d-fa4886cde2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:24.939022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d876e1-bfaf-47d0-ad5d-fa4886cde2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:24.939674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d876e1-bfaf-47d0-ad5d-fa4886cde2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:24.940054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d876e1-bfaf-47d0-ad5d-fa4886cde2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:24.944213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d876e1-bfaf-47d0-ad5d-fa4886cde2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:24.946643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d876e1-bfaf-47d0-ad5d-fa4886cde2d3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:24.964836 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2401/4804] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:24 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 20:59:24.966668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cd774-0b31-46ac-96f7-8e130865ca40 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:24.981863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cd774-0b31-46ac-96f7-8e130865ca40 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:24.996573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e258000-526d-4787-94f8-a57222b1e50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:24.997964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e258000-526d-4787-94f8-a57222b1e50c admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:24.998393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e258000-526d-4787-94f8-a57222b1e50c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:24.998828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e258000-526d-4787-94f8-a57222b1e50c admin admin] PATH_INFO: `/v3/projects/f19803722bd14f04bf31794801d8eab3/users/73664beeb4b04dbdb2d965cab814c4a4/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.036301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e258000-526d-4787-94f8-a57222b1e50c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19803722bd14f04bf31794801d8eab3, user_id=73664beeb4b04dbdb2d965cab814c4a4, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:25.039438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e258000-526d-4787-94f8-a57222b1e50c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:25.067678 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2404/4805] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:24 2021] PUT /identity/v3/projects/f19803722bd14f04bf31794801d8eab3/users/73664beeb4b04dbdb2d965cab814c4a4/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:25.085302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02352b7d-b1c5-46f6-85e3-5320ae1de73c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.085302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02352b7d-b1c5-46f6-85e3-5320ae1de73c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.085302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02352b7d-b1c5-46f6-85e3-5320ae1de73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.152554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-02352b7d-b1c5-46f6-85e3-5320ae1de73c None None] MFA Rules not processed for user `73664beeb4b04dbdb2d965cab814c4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:25.156487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-02352b7d-b1c5-46f6-85e3-5320ae1de73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:25.351029 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2402/4806] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:25 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:25.357835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544854d-513a-47dc-8748-9610976b1e7f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.358256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544854d-513a-47dc-8748-9610976b1e7f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.358655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544854d-513a-47dc-8748-9610976b1e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.395621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f544854d-513a-47dc-8748-9610976b1e7f None None] MFA Rules not processed for user `73664beeb4b04dbdb2d965cab814c4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:25.397467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f544854d-513a-47dc-8748-9610976b1e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:25.404642 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2405/4807] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:25 2021] POST /identity/v3/auth/tokens => generated 345 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:25.410974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea3f04-295d-45cb-89f4-687dcb2ff0b3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.411545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea3f04-295d-45cb-89f4-687dcb2ff0b3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.412174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea3f04-295d-45cb-89f4-687dcb2ff0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.435803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0aea3f04-295d-45cb-89f4-687dcb2ff0b3 None None] MFA Rules not processed for user `73664beeb4b04dbdb2d965cab814c4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:25.437115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0aea3f04-295d-45cb-89f4-687dcb2ff0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:25.443348 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2403/4808] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:25 2021] POST /identity/v3/auth/tokens => generated 345 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 27 20:59:25.447186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544854d-513a-47dc-8748-9610976b1e7f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:25.460828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544854d-513a-47dc-8748-9610976b1e7f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:25.470332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce8193-83ba-4c2b-afc3-b2841ac0b83b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73664beeb4b04dbdb2d965cab814c4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19803722bd14f04bf31794801d8eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:25.470332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce8193-83ba-4c2b-afc3-b2841ac0b83b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.470332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce8193-83ba-4c2b-afc3-b2841ac0b83b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.470653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce8193-83ba-4c2b-afc3-b2841ac0b83b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.489670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce8193-83ba-4c2b-afc3-b2841ac0b83b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: Authorizing `identity:check_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:25.492125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce8193-83ba-4c2b-afc3-b2841ac0b83b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:25.504822 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2406/4809] 10.222.0.21 () {56 vars in 1263 bytes} [Sat Nov 27 20:59:25 2021] HEAD /identity/v3/auth/tokens => generated 0 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:25.517631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea3f04-295d-45cb-89f4-687dcb2ff0b3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:25.541362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea3f04-295d-45cb-89f4-687dcb2ff0b3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:25.555874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e4985-f03a-4b38-a515-e3d87d6a93c2 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73664beeb4b04dbdb2d965cab814c4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19803722bd14f04bf31794801d8eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:25.556603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4985-f03a-4b38-a515-e3d87d6a93c2 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.558448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4985-f03a-4b38-a515-e3d87d6a93c2 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.559177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4985-f03a-4b38-a515-e3d87d6a93c2 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.570351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e4985-f03a-4b38-a515-e3d87d6a93c2 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:25.572408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e4985-f03a-4b38-a515-e3d87d6a93c2 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:25.587937 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2404/4810] 10.222.0.21 () {56 vars in 1262 bytes} [Sat Nov 27 20:59:25 2021] GET /identity/v3/auth/tokens => generated 345 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:25.593111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce8193-83ba-4c2b-afc3-b2841ac0b83b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:25.616360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce8193-83ba-4c2b-afc3-b2841ac0b83b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:25.626684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099d8ce-6c7f-4ae9-972c-789dc1d39357 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73664beeb4b04dbdb2d965cab814c4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19803722bd14f04bf31794801d8eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:25.628899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099d8ce-6c7f-4ae9-972c-789dc1d39357 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.629491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099d8ce-6c7f-4ae9-972c-789dc1d39357 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.629931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099d8ce-6c7f-4ae9-972c-789dc1d39357 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.641607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099d8ce-6c7f-4ae9-972c-789dc1d39357 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:25.644946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099d8ce-6c7f-4ae9-972c-789dc1d39357 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:25.665089 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2407/4811] 10.222.0.21 () {56 vars in 1265 bytes} [Sat Nov 27 20:59:25 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:25.671504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e4985-f03a-4b38-a515-e3d87d6a93c2 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:25.688798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e4985-f03a-4b38-a515-e3d87d6a93c2 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:25.696901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74d924-9260-4749-9ce7-db510d8f503b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73664beeb4b04dbdb2d965cab814c4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19803722bd14f04bf31794801d8eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:25.698502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74d924-9260-4749-9ce7-db510d8f503b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] REQUEST_METHOD: `HEAD` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.700236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74d924-9260-4749-9ce7-db510d8f503b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.700747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74d924-9260-4749-9ce7-db510d8f503b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.705310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3a74d924-9260-4749-9ce7-db510d8f503b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:25.734107 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-3a74d924-9260-4749-9ce7-db510d8f503b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Nov 27 20:59:25.738941 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2405/4812] 10.222.0.21 () {56 vars in 1263 bytes} [Sat Nov 27 20:59:25 2021] HEAD /identity/v3/auth/tokens => generated 0 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:59:25.744406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7a74-4b9f-4baa-b6bb-9f1f2ce57f19 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.744983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7a74-4b9f-4baa-b6bb-9f1f2ce57f19 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.745459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7a74-4b9f-4baa-b6bb-9f1f2ce57f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.754493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e241b-45c2-44d1-8b3c-a6787762710e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.760055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e241b-45c2-44d1-8b3c-a6787762710e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.760200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e241b-45c2-44d1-8b3c-a6787762710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.774070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-559c7a74-4b9f-4baa-b6bb-9f1f2ce57f19 None None] MFA Rules not processed for user `73664beeb4b04dbdb2d965cab814c4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:25.775144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-559c7a74-4b9f-4baa-b6bb-9f1f2ce57f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:25.782647 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2408/4813] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:25 2021] POST /identity/v3/auth/tokens => generated 345 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:25.785938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c7a74-4b9f-4baa-b6bb-9f1f2ce57f19 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:25.802453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c7a74-4b9f-4baa-b6bb-9f1f2ce57f19 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:25.810938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a50e241b-45c2-44d1-8b3c-a6787762710e None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:25.812364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a50e241b-45c2-44d1-8b3c-a6787762710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:25.816810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a58851-cb86-4ab3-9216-b16af5144fd6 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73664beeb4b04dbdb2d965cab814c4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19803722bd14f04bf31794801d8eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:25.817837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58851-cb86-4ab3-9216-b16af5144fd6 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.818290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58851-cb86-4ab3-9216-b16af5144fd6 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.818961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a58851-cb86-4ab3-9216-b16af5144fd6 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.835733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a58851-cb86-4ab3-9216-b16af5144fd6 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:25.840063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a58851-cb86-4ab3-9216-b16af5144fd6 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:25.860223 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2409/4814] 10.222.0.21 () {56 vars in 1262 bytes} [Sat Nov 27 20:59:25 2021] GET /identity/v3/auth/tokens => generated 345 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 27 20:59:25.863775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a58851-cb86-4ab3-9216-b16af5144fd6 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:25.881011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a58851-cb86-4ab3-9216-b16af5144fd6 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:25.889319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446738da-fee5-4645-ae17-934dfdc828c0 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73664beeb4b04dbdb2d965cab814c4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19803722bd14f04bf31794801d8eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:25.890515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446738da-fee5-4645-ae17-934dfdc828c0 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.891167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446738da-fee5-4645-ae17-934dfdc828c0 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.891988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446738da-fee5-4645-ae17-934dfdc828c0 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.909459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446738da-fee5-4645-ae17-934dfdc828c0 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:25.913206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446738da-fee5-4645-ae17-934dfdc828c0 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:25.947449 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2410/4815] 10.222.0.21 () {56 vars in 1265 bytes} [Sat Nov 27 20:59:25 2021] DELETE /identity/v3/auth/tokens => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:25.949343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446738da-fee5-4645-ae17-934dfdc828c0 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:25.974735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446738da-fee5-4645-ae17-934dfdc828c0 tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:25.981224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e97acc-0e9f-46d8-8d57-4a2289fe236b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73664beeb4b04dbdb2d965cab814c4a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f19803722bd14f04bf31794801d8eab3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:25.983966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97acc-0e9f-46d8-8d57-4a2289fe236b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:25.984478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97acc-0e9f-46d8-8d57-4a2289fe236b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:25.984919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e97acc-0e9f-46d8-8d57-4a2289fe236b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:25.989711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c7e97acc-0e9f-46d8-8d57-4a2289fe236b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:25.992131 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2406/4816] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 20:59:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:25.993323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e241b-45c2-44d1-8b3c-a6787762710e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:25.995311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a50e241b-45c2-44d1-8b3c-a6787762710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:26.011220 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-c7e97acc-0e9f-46d8-8d57-4a2289fe236b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Nov 27 20:59:26.016692 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2411/4817] 10.222.0.21 () {56 vars in 1262 bytes} [Sat Nov 27 20:59:25 2021] GET /identity/v3/auth/tokens => generated 80 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:59:26.022008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e97acc-0e9f-46d8-8d57-4a2289fe236b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:26.133032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e241b-45c2-44d1-8b3c-a6787762710e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:26.140165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e07f7-f9fb-41c7-bcc7-80d0afbca39a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:26.141206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e07f7-f9fb-41c7-bcc7-80d0afbca39a service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:26.141206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e07f7-f9fb-41c7-bcc7-80d0afbca39a service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:26.141537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e07f7-f9fb-41c7-bcc7-80d0afbca39a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:26.157064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e07f7-f9fb-41c7-bcc7-80d0afbca39a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:26.158983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e97acc-0e9f-46d8-8d57-4a2289fe236b tempest-TokensV3Test-854596223 tempest-TokensV3Test-854596223-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:26.159407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e07f7-f9fb-41c7-bcc7-80d0afbca39a service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:26.166770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:26.167858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:26.168239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:26.168613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] PATH_INFO: `/v3/users/73664beeb4b04dbdb2d965cab814c4a4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:26.170193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73664beeb4b04dbdb2d965cab814c4a4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:26.172820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:26.174575 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2407/4818] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 20:59:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 20:59:26.289177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73664beeb4b04dbdb2d965cab814c4a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:26.309277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73664beeb4b04dbdb2d965cab814c4a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:26.310411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73664beeb4b04dbdb2d965cab814c4a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:26.342719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73664beeb4b04dbdb2d965cab814c4a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:26.370691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73664beeb4b04dbdb2d965cab814c4a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:26.384178 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2412/4819] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:26 2021] DELETE /identity/v3/users/73664beeb4b04dbdb2d965cab814c4a4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:59:26.388523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae985ef-adc4-4757-97f1-4c57a8f6a7e9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:26.389426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae985ef-adc4-4757-97f1-4c57a8f6a7e9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:26.389860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae985ef-adc4-4757-97f1-4c57a8f6a7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:26.453223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9ae985ef-adc4-4757-97f1-4c57a8f6a7e9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:26.454896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9ae985ef-adc4-4757-97f1-4c57a8f6a7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:26.624974 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2408/4820] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:59:26.713356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:26.714749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:26.885591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005651d-df75-4196-b597-1af877942a8e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:26.892476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49785f85-b3bf-451d-815d-0d32982e85ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:26.893619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785f85-b3bf-451d-815d-0d32982e85ad service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:26.894825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785f85-b3bf-451d-815d-0d32982e85ad service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:26.895868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785f85-b3bf-451d-815d-0d32982e85ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:26.909101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49785f85-b3bf-451d-815d-0d32982e85ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:26.910691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49785f85-b3bf-451d-815d-0d32982e85ad service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:26.924152 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2413/4821] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:59:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:59:28.535378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae985ef-adc4-4757-97f1-4c57a8f6a7e9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:28.536975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9ae985ef-adc4-4757-97f1-4c57a8f6a7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:28.561182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae985ef-adc4-4757-97f1-4c57a8f6a7e9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:28.569306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:28.570270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:28.571113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:28.571657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] PATH_INFO: `/v3/projects/f19803722bd14f04bf31794801d8eab3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:28.578691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19803722bd14f04bf31794801d8eab3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:28.586131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:28.615201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f353da-f5ab-4d5b-94db-744b812b72a7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:28.616058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f353da-f5ab-4d5b-94db-744b812b72a7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:28.616662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f353da-f5ab-4d5b-94db-744b812b72a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:28.649683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-00f353da-f5ab-4d5b-94db-744b812b72a7 None None] MFA Rules not processed for user `ed87ef17973a49f2a9108bdfbff65415`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:28.651234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-00f353da-f5ab-4d5b-94db-744b812b72a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:28.697308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19803722bd14f04bf31794801d8eab3', 'request_id': 'req-15f041c8-f522-4362-9efa-61ed92149f6c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:28.714975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19803722bd14f04bf31794801d8eab3', 'request_id': 'req-15f041c8-f522-4362-9efa-61ed92149f6c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:28.732669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19803722bd14f04bf31794801d8eab3', 'request_id': 'req-15f041c8-f522-4362-9efa-61ed92149f6c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:28.749151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] The token cache is being invalidate because project f19803722bd14f04bf31794801d8eab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:28.749675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:28.750701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:28.753145 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2409/4822] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:59:28 2021] DELETE /identity/v3/projects/f19803722bd14f04bf31794801d8eab3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:28.754818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:28.761155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:28.772779 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2414/4823] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:28 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:28.774558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc53c2-67ee-4f42-a64d-0453e2e3698d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:28.774934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc53c2-67ee-4f42-a64d-0453e2e3698d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:28.775130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc53c2-67ee-4f42-a64d-0453e2e3698d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:28.821756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b7cc53c2-67ee-4f42-a64d-0453e2e3698d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:28.826063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b7cc53c2-67ee-4f42-a64d-0453e2e3698d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:28.919895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f041c8-f522-4362-9efa-61ed92149f6c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:28.925737 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2415/4824] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:28.932460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:28.933468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:28.933768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:28.934092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] PATH_INFO: `/v3/users/2bb012478bf740468bba9fa762ac06ca` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:28.934215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d6571-ff1e-40fb-bd0a-4662a8c3771a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:28.935750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb012478bf740468bba9fa762ac06ca)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:28.936368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d6571-ff1e-40fb-bd0a-4662a8c3771a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:28.936738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d6571-ff1e-40fb-bd0a-4662a8c3771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:28.938112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:28.965345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-909d6571-ff1e-40fb-bd0a-4662a8c3771a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:28.966675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-909d6571-ff1e-40fb-bd0a-4662a8c3771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:28.979626 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2416/4825] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:28.984724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d6571-ff1e-40fb-bd0a-4662a8c3771a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:29.001593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d6571-ff1e-40fb-bd0a-4662a8c3771a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:29.013225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bf402-48e0-425e-938b-b4cc2f6b4667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:29.014495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bf402-48e0-425e-938b-b4cc2f6b4667 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.014808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bf402-48e0-425e-938b-b4cc2f6b4667 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.014929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bf402-48e0-425e-938b-b4cc2f6b4667 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.023952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb012478bf740468bba9fa762ac06ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:29.024426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bf402-48e0-425e-938b-b4cc2f6b4667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:59:29.026028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb012478bf740468bba9fa762ac06ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:29.028294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bf402-48e0-425e-938b-b4cc2f6b4667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:29.030003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bf402-48e0-425e-938b-b4cc2f6b4667 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:29.039488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb012478bf740468bba9fa762ac06ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:29.040267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb012478bf740468bba9fa762ac06ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:29.048522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb012478bf740468bba9fa762ac06ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:29.058217 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2417/4826] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:59:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:29.063736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bf402-48e0-425e-938b-b4cc2f6b4667 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:29.068623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2d9bf402-48e0-425e-938b-b4cc2f6b4667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:29.077722 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2410/4827] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:28 2021] DELETE /identity/v3/users/2bb012478bf740468bba9fa762ac06ca => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:29.090009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bf402-48e0-425e-938b-b4cc2f6b4667 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:29.174069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4252d3-67d8-4f5d-91ce-ae17dbec7b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:29.175193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4252d3-67d8-4f5d-91ce-ae17dbec7b85 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.176520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4252d3-67d8-4f5d-91ce-ae17dbec7b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.176723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4252d3-67d8-4f5d-91ce-ae17dbec7b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.177751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4252d3-67d8-4f5d-91ce-ae17dbec7b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:29.179851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4252d3-67d8-4f5d-91ce-ae17dbec7b85 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:29.225536 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2418/4828] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:59:29 2021] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:59:29.227616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:29.241556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780809ba-097f-4d45-9e3c-cdbd72cddad0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:29.327572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f09cc-134c-43cb-a6df-4dfd80c96659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:29.328951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f09cc-134c-43cb-a6df-4dfd80c96659 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.329246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f09cc-134c-43cb-a6df-4dfd80c96659 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.329526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f09cc-134c-43cb-a6df-4dfd80c96659 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.330249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f09cc-134c-43cb-a6df-4dfd80c96659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:29.332771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f09cc-134c-43cb-a6df-4dfd80c96659 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:29.358496 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2411/4829] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:59:29 2021] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:29.362858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4252d3-67d8-4f5d-91ce-ae17dbec7b85 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:29.381013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4252d3-67d8-4f5d-91ce-ae17dbec7b85 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:29.390746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a69d35-3c02-44ab-8a8c-9ac458dd32e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:29.391501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a69d35-3c02-44ab-8a8c-9ac458dd32e6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.392243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a69d35-3c02-44ab-8a8c-9ac458dd32e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.392534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a69d35-3c02-44ab-8a8c-9ac458dd32e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.400291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a69d35-3c02-44ab-8a8c-9ac458dd32e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:29.402636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a69d35-3c02-44ab-8a8c-9ac458dd32e6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:29.418962 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2419/4830] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:29 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:29.424146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f09cc-134c-43cb-a6df-4dfd80c96659 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:29.433200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a69d35-3c02-44ab-8a8c-9ac458dd32e6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:29.436540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b0a69d35-3c02-44ab-8a8c-9ac458dd32e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:29.439623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f09cc-134c-43cb-a6df-4dfd80c96659 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:29.454852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7a2e-97bb-4ab8-988c-c4c340199412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:29.455804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7a2e-97bb-4ab8-988c-c4c340199412 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.456098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7a2e-97bb-4ab8-988c-c4c340199412 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.457169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f7a2e-97bb-4ab8-988c-c4c340199412 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.458095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f7a2e-97bb-4ab8-988c-c4c340199412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:29.460599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f7a2e-97bb-4ab8-988c-c4c340199412 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:29.475076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a69d35-3c02-44ab-8a8c-9ac458dd32e6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:29.482913 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2412/4831] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:29 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:29.484586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7a2e-97bb-4ab8-988c-c4c340199412 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:29.491031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:29.491937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.492217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.492489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] PATH_INFO: `/v3/projects/90d16fd50eb2412992297f88bb1d4580` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.496314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d16fd50eb2412992297f88bb1d4580)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:29.499566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:29.503077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f7a2e-97bb-4ab8-988c-c4c340199412 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:29.510912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511eb115-13b8-4af8-bb75-ef8dd5ce5469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:29.512229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eb115-13b8-4af8-bb75-ef8dd5ce5469 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.512510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eb115-13b8-4af8-bb75-ef8dd5ce5469 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.512997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511eb115-13b8-4af8-bb75-ef8dd5ce5469 admin admin] PATH_INFO: `/v3/projects/a0d6036f118d4a8daaae5e0253609483/users/a47cddaaf6a942ceaa99f23c06dd33a3/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.551839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511eb115-13b8-4af8-bb75-ef8dd5ce5469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d6036f118d4a8daaae5e0253609483, user_id=a47cddaaf6a942ceaa99f23c06dd33a3, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:29.555964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511eb115-13b8-4af8-bb75-ef8dd5ce5469 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:29.592767 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2413/4832] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:29 2021] PUT /identity/v3/projects/a0d6036f118d4a8daaae5e0253609483/users/a47cddaaf6a942ceaa99f23c06dd33a3/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:29.604474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dd555-5aec-4daa-a39c-3efee7db9478 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.604756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dd555-5aec-4daa-a39c-3efee7db9478 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.605037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dd555-5aec-4daa-a39c-3efee7db9478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.615704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d16fd50eb2412992297f88bb1d4580', 'request_id': 'req-b2acac6b-7785-4c52-912e-849f50660833'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:29.633180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d16fd50eb2412992297f88bb1d4580', 'request_id': 'req-b2acac6b-7785-4c52-912e-849f50660833'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:29.641634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5f5dd555-5aec-4daa-a39c-3efee7db9478 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:29.643154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5f5dd555-5aec-4daa-a39c-3efee7db9478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:29.644750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d16fd50eb2412992297f88bb1d4580', 'request_id': 'req-b2acac6b-7785-4c52-912e-849f50660833'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:29.664568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] The token cache is being invalidate because project 90d16fd50eb2412992297f88bb1d4580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:29.664794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:29.665579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2acac6b-7785-4c52-912e-849f50660833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:29.668772 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2420/4833] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:59:29 2021] DELETE /identity/v3/projects/90d16fd50eb2412992297f88bb1d4580 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:29.674684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27de32-04e6-4758-851f-ec187dabec63 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.675312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27de32-04e6-4758-851f-ec187dabec63 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.675824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27de32-04e6-4758-851f-ec187dabec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.709776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4c27de32-04e6-4758-851f-ec187dabec63 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:29.709776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4c27de32-04e6-4758-851f-ec187dabec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:29.735836 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2414/4834] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:29 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:59:29.742097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dd555-5aec-4daa-a39c-3efee7db9478 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:29.752149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dd555-5aec-4daa-a39c-3efee7db9478 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:29.757496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19264963-0870-4c6a-91be-bdde84210d7e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47cddaaf6a942ceaa99f23c06dd33a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d6036f118d4a8daaae5e0253609483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:29.758347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19264963-0870-4c6a-91be-bdde84210d7e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.758638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19264963-0870-4c6a-91be-bdde84210d7e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.758914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19264963-0870-4c6a-91be-bdde84210d7e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.792853 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2421/4835] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:59:29.802553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a946-95ba-42c9-a07d-d22b0929ad2b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.803096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a946-95ba-42c9-a07d-d22b0929ad2b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.803526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a946-95ba-42c9-a07d-d22b0929ad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.813202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-19264963-0870-4c6a-91be-bdde84210d7e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:29.829812 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2415/4836] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:59:29 2021] POST /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:29.832376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b2c3a946-95ba-42c9-a07d-d22b0929ad2b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:29.833730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b2c3a946-95ba-42c9-a07d-d22b0929ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:29.843656 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2422/4837] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:59:29.848317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19264963-0870-4c6a-91be-bdde84210d7e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:29.860743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19264963-0870-4c6a-91be-bdde84210d7e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:29.865767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea43532-7055-4d9e-9af7-96d082287d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:29.866420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43532-7055-4d9e-9af7-96d082287d46 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.866703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43532-7055-4d9e-9af7-96d082287d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.866980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43532-7055-4d9e-9af7-96d082287d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.867787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea43532-7055-4d9e-9af7-96d082287d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:59:29.868098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea43532-7055-4d9e-9af7-96d082287d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:29.869860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea43532-7055-4d9e-9af7-96d082287d46 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:29.884205 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2416/4838] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:59:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 20:59:29.888541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3a946-95ba-42c9-a07d-d22b0929ad2b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:29.898854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3a946-95ba-42c9-a07d-d22b0929ad2b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:29.904388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4beb46-3835-474b-a79a-455cda02ab3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:29.905053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4beb46-3835-474b-a79a-455cda02ab3b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:29.905326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4beb46-3835-474b-a79a-455cda02ab3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:29.905603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4beb46-3835-474b-a79a-455cda02ab3b admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:29.906704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4beb46-3835-474b-a79a-455cda02ab3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:29.910711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4beb46-3835-474b-a79a-455cda02ab3b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:29.942002 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2423/4839] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:59:29 2021] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 20:59:29.946857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea43532-7055-4d9e-9af7-96d082287d46 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:29.958887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea43532-7055-4d9e-9af7-96d082287d46 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:30.024767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cceadbd-6b0b-40e2-af9b-1e2d54ec7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:30.025481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cceadbd-6b0b-40e2-af9b-1e2d54ec7e1b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:30.025740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cceadbd-6b0b-40e2-af9b-1e2d54ec7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:30.026011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cceadbd-6b0b-40e2-af9b-1e2d54ec7e1b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:30.026777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cceadbd-6b0b-40e2-af9b-1e2d54ec7e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:30.028755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cceadbd-6b0b-40e2-af9b-1e2d54ec7e1b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:30.050908 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2417/4840] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:59:29 2021] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:30.054868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4beb46-3835-474b-a79a-455cda02ab3b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:30.068821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4beb46-3835-474b-a79a-455cda02ab3b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:30.074705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ded8c-7970-43c3-b64f-10c2f9d57350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:30.075515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ded8c-7970-43c3-b64f-10c2f9d57350 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:30.075864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ded8c-7970-43c3-b64f-10c2f9d57350 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:30.076127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ded8c-7970-43c3-b64f-10c2f9d57350 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:30.076932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ded8c-7970-43c3-b64f-10c2f9d57350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:30.078681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ded8c-7970-43c3-b64f-10c2f9d57350 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:30.092710 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2424/4841] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:30 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:30.096570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cceadbd-6b0b-40e2-af9b-1e2d54ec7e1b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:30.117151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cceadbd-6b0b-40e2-af9b-1e2d54ec7e1b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:30.122972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392b8f8-f851-420a-b499-4bac7ee7a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:30.123695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b8f8-f851-420a-b499-4bac7ee7a723 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:30.123984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b8f8-f851-420a-b499-4bac7ee7a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:30.124262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392b8f8-f851-420a-b499-4bac7ee7a723 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:30.125003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392b8f8-f851-420a-b499-4bac7ee7a723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:30.127366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392b8f8-f851-420a-b499-4bac7ee7a723 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:30.142477 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2418/4842] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:30 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:30.144620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ded8c-7970-43c3-b64f-10c2f9d57350 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:30.156009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ded8c-7970-43c3-b64f-10c2f9d57350 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:30.161780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe862a6-8f76-4532-82a2-bf8b3748abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:30.162693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe862a6-8f76-4532-82a2-bf8b3748abc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:30.163193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe862a6-8f76-4532-82a2-bf8b3748abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:30.163353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe862a6-8f76-4532-82a2-bf8b3748abc0 admin admin] PATH_INFO: `/v3/projects/5399873bca254683bedebb5102a1b6e5/users/95f97f2e1958406b9dc0f258aa5a3f42/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:30.179766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe862a6-8f76-4532-82a2-bf8b3748abc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5399873bca254683bedebb5102a1b6e5, user_id=95f97f2e1958406b9dc0f258aa5a3f42, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:30.182422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe862a6-8f76-4532-82a2-bf8b3748abc0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:30.202594 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2425/4843] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:30 2021] PUT /identity/v3/projects/5399873bca254683bedebb5102a1b6e5/users/95f97f2e1958406b9dc0f258aa5a3f42/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:30.204309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f78b1-2e46-42dd-a586-ea9902711a54 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:30.204607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f78b1-2e46-42dd-a586-ea9902711a54 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:30.204944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f78b1-2e46-42dd-a586-ea9902711a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:30.225234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9a4f78b1-2e46-42dd-a586-ea9902711a54 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:30.226455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9a4f78b1-2e46-42dd-a586-ea9902711a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:30.294665 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2419/4844] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:30.306475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe862a6-8f76-4532-82a2-bf8b3748abc0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:30.309467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fbe862a6-8f76-4532-82a2-bf8b3748abc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:30.390060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe862a6-8f76-4532-82a2-bf8b3748abc0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:30.395160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6626d-c387-47a4-adff-ac18e57fda35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:30.397036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6626d-c387-47a4-adff-ac18e57fda35 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:30.397036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6626d-c387-47a4-adff-ac18e57fda35 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:30.397284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6626d-c387-47a4-adff-ac18e57fda35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:30.412355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6626d-c387-47a4-adff-ac18e57fda35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:30.413992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6626d-c387-47a4-adff-ac18e57fda35 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:30.440007 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2426/4845] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:59:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:59:30.836886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a255c0-551a-4d69-9d70-7239863be75c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:30.837441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a255c0-551a-4d69-9d70-7239863be75c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:30.837441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a255c0-551a-4d69-9d70-7239863be75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:30.874813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b7a255c0-551a-4d69-9d70-7239863be75c None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:30.884101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b7a255c0-551a-4d69-9d70-7239863be75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:30.898502 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2420/4846] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:30 2021] POST /identity/v3/auth/tokens => generated 353 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:30.905039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903aa8b-72c3-4adb-97a6-495780330d91 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:30.905603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903aa8b-72c3-4adb-97a6-495780330d91 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:30.905882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903aa8b-72c3-4adb-97a6-495780330d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:30.938776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1903aa8b-72c3-4adb-97a6-495780330d91 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:30.941672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1903aa8b-72c3-4adb-97a6-495780330d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:31.058306 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2427/4847] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:30 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:31.059477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a255c0-551a-4d69-9d70-7239863be75c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:31.074618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a255c0-551a-4d69-9d70-7239863be75c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:31.082458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542ec41-b1c9-4b19-b047-1da9de2942d0 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47cddaaf6a942ceaa99f23c06dd33a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d6036f118d4a8daaae5e0253609483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:31.083745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ec41-b1c9-4b19-b047-1da9de2942d0 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:31.084241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ec41-b1c9-4b19-b047-1da9de2942d0 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:31.084898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542ec41-b1c9-4b19-b047-1da9de2942d0 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:31.144790 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-1542ec41-b1c9-4b19-b047-1da9de2942d0 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Nov 27 20:59:31.152975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903aa8b-72c3-4adb-97a6-495780330d91 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:31.163480 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2421/4848] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:59:31 2021] POST /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password => generated 188 bytes in 92 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 27 20:59:31.164580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903aa8b-72c3-4adb-97a6-495780330d91 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:31.171822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b7d22-6312-4a29-a691-dc76ada62259 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47cddaaf6a942ceaa99f23c06dd33a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d6036f118d4a8daaae5e0253609483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:31.173100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b7d22-6312-4a29-a691-dc76ada62259 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:31.173994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b7d22-6312-4a29-a691-dc76ada62259 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:31.174605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b7d22-6312-4a29-a691-dc76ada62259 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:31.229570 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-7c7b7d22-6312-4a29-a691-dc76ada62259 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Nov 27 20:59:31.236738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542ec41-b1c9-4b19-b047-1da9de2942d0 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:31.237437 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2428/4849] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:59:31 2021] POST /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password => generated 188 bytes in 84 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 27 20:59:31.251499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542ec41-b1c9-4b19-b047-1da9de2942d0 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:31.258504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8747e7-017c-40d6-8406-b4ce3a14cb4b tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47cddaaf6a942ceaa99f23c06dd33a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d6036f118d4a8daaae5e0253609483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:31.259810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8747e7-017c-40d6-8406-b4ce3a14cb4b tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:31.260323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8747e7-017c-40d6-8406-b4ce3a14cb4b tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:31.260873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8747e7-017c-40d6-8406-b4ce3a14cb4b tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:31.329609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1b8747e7-017c-40d6-8406-b4ce3a14cb4b tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:31.352234 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2422/4850] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:59:31 2021] POST /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:59:31.425256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99efa2-8952-4aec-9060-f1d5425ff53e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:31.431381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99efa2-8952-4aec-9060-f1d5425ff53e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:31.431867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99efa2-8952-4aec-9060-f1d5425ff53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:31.491934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0d99efa2-8952-4aec-9060-f1d5425ff53e None None] MFA Rules not processed for user `95f97f2e1958406b9dc0f258aa5a3f42`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:31.495800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0d99efa2-8952-4aec-9060-f1d5425ff53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:31.695057 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2429/4851] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:31 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:31.707100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4effa98-d71b-4546-8110-f587bc48e770 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:31.707415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4effa98-d71b-4546-8110-f587bc48e770 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:31.707855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4effa98-d71b-4546-8110-f587bc48e770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:31.738366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a4effa98-d71b-4546-8110-f587bc48e770 None None] MFA Rules not processed for user `95f97f2e1958406b9dc0f258aa5a3f42`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:31.739737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a4effa98-d71b-4546-8110-f587bc48e770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:31.769461 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2423/4852] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:31 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:31.819587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99efa2-8952-4aec-9060-f1d5425ff53e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:31.821530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0d99efa2-8952-4aec-9060-f1d5425ff53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:32.083139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99efa2-8952-4aec-9060-f1d5425ff53e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:32.105305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f25d42-055f-44ef-9d3e-8cdd01b7dd6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:32.108929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25d42-055f-44ef-9d3e-8cdd01b7dd6f service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:32.109242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25d42-055f-44ef-9d3e-8cdd01b7dd6f service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:32.110161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f25d42-055f-44ef-9d3e-8cdd01b7dd6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:32.136567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f25d42-055f-44ef-9d3e-8cdd01b7dd6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:32.143802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f25d42-055f-44ef-9d3e-8cdd01b7dd6f service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:32.186809 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2430/4853] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:59:31 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:59:32.357909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d299-f530-4a44-8f47-6e25bf299ca4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:32.358481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d299-f530-4a44-8f47-6e25bf299ca4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:32.358481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d299-f530-4a44-8f47-6e25bf299ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:32.397822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7835d299-f530-4a44-8f47-6e25bf299ca4 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:32.399087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7835d299-f530-4a44-8f47-6e25bf299ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:32.415755 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2424/4854] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:32 2021] POST /identity/v3/auth/tokens => generated 353 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:32.421054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4c4ba-38ac-43c0-bed0-e57a4ba43487 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:32.421344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4c4ba-38ac-43c0-bed0-e57a4ba43487 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:32.421624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4c4ba-38ac-43c0-bed0-e57a4ba43487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:32.445919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6ee4c4ba-38ac-43c0-bed0-e57a4ba43487 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:32.447533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6ee4c4ba-38ac-43c0-bed0-e57a4ba43487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:32.455573 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2431/4855] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:32 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:32.460032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835d299-f530-4a44-8f47-6e25bf299ca4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:32.478930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835d299-f530-4a44-8f47-6e25bf299ca4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:32.483627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33cd9e-3fc0-4ef2-873d-238a9a160853 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47cddaaf6a942ceaa99f23c06dd33a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d6036f118d4a8daaae5e0253609483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:32.484769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33cd9e-3fc0-4ef2-873d-238a9a160853 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:32.485096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33cd9e-3fc0-4ef2-873d-238a9a160853 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:32.485307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33cd9e-3fc0-4ef2-873d-238a9a160853 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:32.581792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3f33cd9e-3fc0-4ef2-873d-238a9a160853 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:32.612198 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2425/4856] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:59:32 2021] POST /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:33.617347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e28987-50ef-4067-bb62-c998f42e13ef None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:33.618750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e28987-50ef-4067-bb62-c998f42e13ef None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:33.619337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e28987-50ef-4067-bb62-c998f42e13ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:33.664593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d7e28987-50ef-4067-bb62-c998f42e13ef None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:33.706257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d7e28987-50ef-4067-bb62-c998f42e13ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:33.723192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d7958-b60c-4f7a-bcfc-ed0b50f36bf9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:33.724445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d7958-b60c-4f7a-bcfc-ed0b50f36bf9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:33.725590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d7958-b60c-4f7a-bcfc-ed0b50f36bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:33.732153 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2432/4857] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:33 2021] POST /identity/v3/auth/tokens => generated 353 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:33.755946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-989d7958-b60c-4f7a-bcfc-ed0b50f36bf9 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:33.757446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-989d7958-b60c-4f7a-bcfc-ed0b50f36bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:33.770685 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2426/4858] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:33 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:33.775646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e28987-50ef-4067-bb62-c998f42e13ef None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:33.794708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e28987-50ef-4067-bb62-c998f42e13ef None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:33.820424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7d200-d8e5-436b-aecf-4244cceac0e2 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47cddaaf6a942ceaa99f23c06dd33a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d6036f118d4a8daaae5e0253609483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:33.825082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d200-d8e5-436b-aecf-4244cceac0e2 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:33.825662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d200-d8e5-436b-aecf-4244cceac0e2 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:33.825957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d200-d8e5-436b-aecf-4244cceac0e2 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:33.906570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3db7d200-d8e5-436b-aecf-4244cceac0e2 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:33.937129 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2433/4859] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:59:33 2021] POST /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:34.941721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ce64-f67a-4b06-8d65-f816505d4278 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:34.942195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ce64-f67a-4b06-8d65-f816505d4278 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:34.942333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5ce64-f67a-4b06-8d65-f816505d4278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:34.998061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e4f5ce64-f67a-4b06-8d65-f816505d4278 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:34.999367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e4f5ce64-f67a-4b06-8d65-f816505d4278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:35.008255 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2427/4860] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:34 2021] POST /identity/v3/auth/tokens => generated 353 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:35.012642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855106f-1e08-4590-b721-4d57455351a9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:35.013148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855106f-1e08-4590-b721-4d57455351a9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:35.013484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855106f-1e08-4590-b721-4d57455351a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:35.051473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d855106f-1e08-4590-b721-4d57455351a9 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:35.055527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d855106f-1e08-4590-b721-4d57455351a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:35.085532 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2434/4861] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:35 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:35.091480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5ce64-f67a-4b06-8d65-f816505d4278 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:35.113666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5ce64-f67a-4b06-8d65-f816505d4278 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:35.127307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab170ff7-6c0d-44eb-b038-004d93d8d10e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47cddaaf6a942ceaa99f23c06dd33a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d6036f118d4a8daaae5e0253609483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:35.128924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170ff7-6c0d-44eb-b038-004d93d8d10e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:35.129325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170ff7-6c0d-44eb-b038-004d93d8d10e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:35.130821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab170ff7-6c0d-44eb-b038-004d93d8d10e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:35.237677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ab170ff7-6c0d-44eb-b038-004d93d8d10e tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:35.262484 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2428/4862] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:59:35 2021] POST /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:36.267463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58b02-dbed-4cca-90c2-58e465ce2cf0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:36.269381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58b02-dbed-4cca-90c2-58e465ce2cf0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:36.269989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58b02-dbed-4cca-90c2-58e465ce2cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:36.315224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-47a58b02-dbed-4cca-90c2-58e465ce2cf0 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:36.317416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-47a58b02-dbed-4cca-90c2-58e465ce2cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:36.321915 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2435/4863] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:36 2021] POST /identity/v3/auth/tokens => generated 353 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:37.327967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f898-77a9-46a0-affc-51a477c1b9a2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:37.328904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f898-77a9-46a0-affc-51a477c1b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:37.329605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f898-77a9-46a0-affc-51a477c1b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:37.404170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7c07f898-77a9-46a0-affc-51a477c1b9a2 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:37.405431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7c07f898-77a9-46a0-affc-51a477c1b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:37.420528 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2429/4864] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:37.423148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2f10-436f-41ff-954f-23e3035b1599 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:37.424080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2f10-436f-41ff-954f-23e3035b1599 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:37.424558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2f10-436f-41ff-954f-23e3035b1599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:37.445253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6fcf2f10-436f-41ff-954f-23e3035b1599 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:37.447012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6fcf2f10-436f-41ff-954f-23e3035b1599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:37.451679 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2436/4865] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:37 2021] POST /identity/v3/auth/tokens => generated 353 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 27 20:59:37.457403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8326359-e994-4ff3-be89-c9dea86fe26a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:37.457866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8326359-e994-4ff3-be89-c9dea86fe26a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:37.458326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8326359-e994-4ff3-be89-c9dea86fe26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:37.528032 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-f8326359-e994-4ff3-be89-c9dea86fe26a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.21: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 27 20:59:37.530859 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2430/4866] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:37 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 75 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 27 20:59:37.536485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d48b18-9104-48cf-9687-ccbbb616e64d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:37.537331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d48b18-9104-48cf-9687-ccbbb616e64d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:37.538250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d48b18-9104-48cf-9687-ccbbb616e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:37.610505 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-03d48b18-9104-48cf-9687-ccbbb616e64d None None] Authorization failed. The request you have made requires authentication. from 10.222.0.21: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 27 20:59:37.612625 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2437/4867] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:37 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 78 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 27 20:59:37.617159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d207f3-2e6b-4779-808e-47a7bc32deb1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:37.617752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d207f3-2e6b-4779-808e-47a7bc32deb1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:37.618370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d207f3-2e6b-4779-808e-47a7bc32deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:37.649803 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-95d207f3-2e6b-4779-808e-47a7bc32deb1 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.21: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 27 20:59:37.652062 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2431/4868] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:37 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 36 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 27 20:59:48.666190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f01c8-3482-4b87-853c-d22fd7472fac None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:48.667090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f01c8-3482-4b87-853c-d22fd7472fac None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:48.667598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f01c8-3482-4b87-853c-d22fd7472fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:48.760709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b48f01c8-3482-4b87-853c-d22fd7472fac None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:48.762202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b48f01c8-3482-4b87-853c-d22fd7472fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:48.774220 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2438/4869] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:48 2021] POST /identity/v3/auth/tokens => generated 353 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:48.783047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d207f3-2e6b-4779-808e-47a7bc32deb1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:48.799994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d207f3-2e6b-4779-808e-47a7bc32deb1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:48.805057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77110469-98ea-4818-922e-23ef97650931 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47cddaaf6a942ceaa99f23c06dd33a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d6036f118d4a8daaae5e0253609483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:48.806615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77110469-98ea-4818-922e-23ef97650931 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:48.808263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77110469-98ea-4818-922e-23ef97650931 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:48.809062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77110469-98ea-4818-922e-23ef97650931 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:48.889315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-77110469-98ea-4818-922e-23ef97650931 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:48.905550 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2432/4870] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:59:48 2021] POST /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:49.912415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85280d90-dcb1-46d8-bfc4-a912079d6a13 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:49.913423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85280d90-dcb1-46d8-bfc4-a912079d6a13 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:49.913920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85280d90-dcb1-46d8-bfc4-a912079d6a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:49.938952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-85280d90-dcb1-46d8-bfc4-a912079d6a13 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:49.940606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-85280d90-dcb1-46d8-bfc4-a912079d6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:49.945172 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2439/4871] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:49 2021] POST /identity/v3/auth/tokens => generated 353 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:49.949690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3392f6-5dc8-4e99-9f09-0c4f72dd7c02 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:49.950592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3392f6-5dc8-4e99-9f09-0c4f72dd7c02 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:49.951056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3392f6-5dc8-4e99-9f09-0c4f72dd7c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:49.965542 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-5f3392f6-5dc8-4e99-9f09-0c4f72dd7c02 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Nov 27 20:59:49.966960 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2433/4872] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:49 2021] POST /identity/v3/auth/tokens => generated 80 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 20:59:49.972618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a8aab-bed9-4e78-bf95-be9449df8817 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:49.972973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a8aab-bed9-4e78-bf95-be9449df8817 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:49.973354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a8aab-bed9-4e78-bf95-be9449df8817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:50.033341 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-b09a8aab-bed9-4e78-bf95-be9449df8817 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.21: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 27 20:59:50.040820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904eb6-9d2c-4aaa-905a-2b92fa0a8b73 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:50.041376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904eb6-9d2c-4aaa-905a-2b92fa0a8b73 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:50.041699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904eb6-9d2c-4aaa-905a-2b92fa0a8b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:50.045935 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2440/4873] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:49 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 75 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Nov 27 20:59:50.083772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0b904eb6-9d2c-4aaa-905a-2b92fa0a8b73 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:50.085378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0b904eb6-9d2c-4aaa-905a-2b92fa0a8b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:50.110895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a8aab-bed9-4e78-bf95-be9449df8817 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:50.114457 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2434/4874] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:50 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:50.130650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a8aab-bed9-4e78-bf95-be9449df8817 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:50.148739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e5af5-7d20-4897-a42f-cfbd257f218c tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47cddaaf6a942ceaa99f23c06dd33a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d6036f118d4a8daaae5e0253609483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:50.149617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e5af5-7d20-4897-a42f-cfbd257f218c tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:50.149903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e5af5-7d20-4897-a42f-cfbd257f218c tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:50.150182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e5af5-7d20-4897-a42f-cfbd257f218c tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:50.202877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f77e5af5-7d20-4897-a42f-cfbd257f218c tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:50.218578 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2441/4875] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:59:50 2021] POST /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:59:51.222276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10ab00-e8aa-4080-b614-67042a5baeca None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:51.223148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10ab00-e8aa-4080-b614-67042a5baeca None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:51.223474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10ab00-e8aa-4080-b614-67042a5baeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:51.242253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7d10ab00-e8aa-4080-b614-67042a5baeca None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:51.243756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7d10ab00-e8aa-4080-b614-67042a5baeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:51.247904 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2435/4876] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:51 2021] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:51.253090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c4b9f-abf9-4089-91e7-e6311df0165d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:51.253961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c4b9f-abf9-4089-91e7-e6311df0165d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:51.254447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c4b9f-abf9-4089-91e7-e6311df0165d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:51.280987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-134c4b9f-abf9-4089-91e7-e6311df0165d None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:51.282156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-134c4b9f-abf9-4089-91e7-e6311df0165d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:51.301476 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2442/4877] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:51 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:59:51.302181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10ab00-e8aa-4080-b614-67042a5baeca None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:51.317844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10ab00-e8aa-4080-b614-67042a5baeca None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:51.323075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18f855-c0d3-4bbf-b240-b6ab5f88ef55 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47cddaaf6a942ceaa99f23c06dd33a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d6036f118d4a8daaae5e0253609483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:51.324438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18f855-c0d3-4bbf-b240-b6ab5f88ef55 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:51.324954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18f855-c0d3-4bbf-b240-b6ab5f88ef55 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:51.325285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18f855-c0d3-4bbf-b240-b6ab5f88ef55 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:51.383085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c18f855-c0d3-4bbf-b240-b6ab5f88ef55 tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:51.396493 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2436/4878] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:59:51 2021] POST /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:52.401964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065b88c-95c0-4a70-831e-d5272f61a561 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:52.402958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065b88c-95c0-4a70-831e-d5272f61a561 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:52.403600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065b88c-95c0-4a70-831e-d5272f61a561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:52.430343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7065b88c-95c0-4a70-831e-d5272f61a561 None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:52.432204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7065b88c-95c0-4a70-831e-d5272f61a561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:52.436114 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2443/4879] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:52 2021] POST /identity/v3/auth/tokens => generated 353 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:52.440978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe572107-e611-4bb4-86e0-b8ada2dce08c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:52.441503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe572107-e611-4bb4-86e0-b8ada2dce08c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:52.449334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe572107-e611-4bb4-86e0-b8ada2dce08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:52.469233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fe572107-e611-4bb4-86e0-b8ada2dce08c None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:52.470587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fe572107-e611-4bb4-86e0-b8ada2dce08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:52.480975 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2437/4880] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:52 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:52.485398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065b88c-95c0-4a70-831e-d5272f61a561 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:52.496818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065b88c-95c0-4a70-831e-d5272f61a561 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:52.501441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453d251-6d72-4415-9a91-a9066255579b tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a47cddaaf6a942ceaa99f23c06dd33a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0d6036f118d4a8daaae5e0253609483', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:52.503037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453d251-6d72-4415-9a91-a9066255579b tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:52.503550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453d251-6d72-4415-9a91-a9066255579b tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:52.504041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453d251-6d72-4415-9a91-a9066255579b tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:52.566683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c453d251-6d72-4415-9a91-a9066255579b tempest-IdentityV3UsersTest-1615969367 tempest-IdentityV3UsersTest-1615969367-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:52.580497 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2444/4881] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 20:59:52 2021] POST /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3/password => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:53.584967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4709ce-ba32-4670-9123-7468fe05faab None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:53.585846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4709ce-ba32-4670-9123-7468fe05faab None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:53.586285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4709ce-ba32-4670-9123-7468fe05faab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:53.616764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-dc4709ce-ba32-4670-9123-7468fe05faab None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:53.620399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dc4709ce-ba32-4670-9123-7468fe05faab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:53.628458 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2438/4882] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:53 2021] POST /identity/v3/auth/tokens => generated 353 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 27 20:59:54.631269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c18e1e-adf2-4e4f-bf35-a581a4f0300f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:54.633181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c18e1e-adf2-4e4f-bf35-a581a4f0300f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:54.633732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c18e1e-adf2-4e4f-bf35-a581a4f0300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:54.668272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b4c18e1e-adf2-4e4f-bf35-a581a4f0300f None None] MFA Rules not processed for user `a47cddaaf6a942ceaa99f23c06dd33a3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:54.670362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b4c18e1e-adf2-4e4f-bf35-a581a4f0300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:54.692012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4709ce-ba32-4670-9123-7468fe05faab None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:54.692743 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2445/4883] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:54 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:54.698098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dc4709ce-ba32-4670-9123-7468fe05faab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:54.744773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4709ce-ba32-4670-9123-7468fe05faab None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:54.750935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:54.752028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:54.752509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:54.752959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] PATH_INFO: `/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:54.755074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47cddaaf6a942ceaa99f23c06dd33a3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:54.757227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:54.894197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:54.895682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:54.923731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:54.924435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:54.931915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47cddaaf6a942ceaa99f23c06dd33a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:54.950900 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2439/4884] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:54 2021] DELETE /identity/v3/users/a47cddaaf6a942ceaa99f23c06dd33a3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:54.955944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a47ab-1a70-4774-96d4-f4f5dd0583d5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:54.956930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a47ab-1a70-4774-96d4-f4f5dd0583d5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:54.957209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a47ab-1a70-4774-96d4-f4f5dd0583d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:54.977402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-562a47ab-1a70-4774-96d4-f4f5dd0583d5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:54.979661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-562a47ab-1a70-4774-96d4-f4f5dd0583d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:55.071330 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2446/4885] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:59:55.100646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:55.102206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:55.168995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a935b-81ac-45cf-a6d2-1acb5960af7d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:55.191989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda575ff-fccd-4235-ac1f-99d9ae558708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:55.192739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda575ff-fccd-4235-ac1f-99d9ae558708 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:55.193843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda575ff-fccd-4235-ac1f-99d9ae558708 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:55.194466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda575ff-fccd-4235-ac1f-99d9ae558708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:55.234964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda575ff-fccd-4235-ac1f-99d9ae558708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:55.240859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda575ff-fccd-4235-ac1f-99d9ae558708 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:55.280575 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2440/4886] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:59:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 20:59:56.817923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a47ab-1a70-4774-96d4-f4f5dd0583d5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:56.819613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-562a47ab-1a70-4774-96d4-f4f5dd0583d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:56.844934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a47ab-1a70-4774-96d4-f4f5dd0583d5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:56.853660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:56.864058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:56.864612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:56.865782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] PATH_INFO: `/v3/projects/a0d6036f118d4a8daaae5e0253609483` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:56.868994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d6036f118d4a8daaae5e0253609483)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:56.873263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:56.954859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d6036f118d4a8daaae5e0253609483', 'request_id': 'req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:56.967961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d6036f118d4a8daaae5e0253609483', 'request_id': 'req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:56.977685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d6036f118d4a8daaae5e0253609483', 'request_id': 'req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:57.002548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] The token cache is being invalidate because project a0d6036f118d4a8daaae5e0253609483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:57.003299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:57.004387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c966ab73-6cee-4adc-8a05-f8cd1c91c4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:57.007413 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2447/4887] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:59:56 2021] DELETE /identity/v3/projects/a0d6036f118d4a8daaae5e0253609483 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:57.013087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4194-46bb-4d04-a06b-9950b109367a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:57.014071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4194-46bb-4d04-a06b-9950b109367a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:57.014071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4194-46bb-4d04-a06b-9950b109367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:57.057961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e3df4194-46bb-4d04-a06b-9950b109367a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:57.060164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e3df4194-46bb-4d04-a06b-9950b109367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:57.155309 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2441/4888] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:57.158327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fd5a3-809a-4030-af43-5b5e339b9ce0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:57.160027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fd5a3-809a-4030-af43-5b5e339b9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:57.160499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fd5a3-809a-4030-af43-5b5e339b9ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:57.185888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d30fd5a3-809a-4030-af43-5b5e339b9ce0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:57.188802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d30fd5a3-809a-4030-af43-5b5e339b9ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:57.206930 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2448/4889] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:57.207157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4194-46bb-4d04-a06b-9950b109367a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:57.223168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4194-46bb-4d04-a06b-9950b109367a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:57.244289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81e7b-0a99-4a09-8951-3ca8c29e07ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:57.246454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81e7b-0a99-4a09-8951-3ca8c29e07ea admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:57.246943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81e7b-0a99-4a09-8951-3ca8c29e07ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:57.248298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81e7b-0a99-4a09-8951-3ca8c29e07ea admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:57.249446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb81e7b-0a99-4a09-8951-3ca8c29e07ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 20:59:57.250186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb81e7b-0a99-4a09-8951-3ca8c29e07ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:57.254137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb81e7b-0a99-4a09-8951-3ca8c29e07ea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:57.280034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fd5a3-809a-4030-af43-5b5e339b9ce0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:57.297470 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2442/4890] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 20:59:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 20:59:57.301937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fd5a3-809a-4030-af43-5b5e339b9ce0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:57.309195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe6ea0-faa7-42c7-b393-4137fc975a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:57.310255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6ea0-faa7-42c7-b393-4137fc975a46 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:57.310782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6ea0-faa7-42c7-b393-4137fc975a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:57.311332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6ea0-faa7-42c7-b393-4137fc975a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:57.316234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe6ea0-faa7-42c7-b393-4137fc975a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:57.318750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe6ea0-faa7-42c7-b393-4137fc975a46 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:57.365824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81e7b-0a99-4a09-8951-3ca8c29e07ea admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:57.382825 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2449/4891] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:59:57 2021] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:57.388013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81e7b-0a99-4a09-8951-3ca8c29e07ea admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:57.516942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92481abc-a030-45ae-8f0b-48464120a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:57.517715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92481abc-a030-45ae-8f0b-48464120a1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:57.518659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92481abc-a030-45ae-8f0b-48464120a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:57.519036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92481abc-a030-45ae-8f0b-48464120a1e7 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:57.519903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92481abc-a030-45ae-8f0b-48464120a1e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:57.522202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92481abc-a030-45ae-8f0b-48464120a1e7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:57.560936 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2443/4892] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:59:57 2021] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:57.565907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe6ea0-faa7-42c7-b393-4137fc975a46 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:57.577344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe6ea0-faa7-42c7-b393-4137fc975a46 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:57.586029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7af3cf-b2b0-4f08-a0ab-648a28c34744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:57.590433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7af3cf-b2b0-4f08-a0ab-648a28c34744 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:57.590943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7af3cf-b2b0-4f08-a0ab-648a28c34744 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:57.591434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7af3cf-b2b0-4f08-a0ab-648a28c34744 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:57.592535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7af3cf-b2b0-4f08-a0ab-648a28c34744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:57.595348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7af3cf-b2b0-4f08-a0ab-648a28c34744 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:57.636175 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2450/4893] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:57 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:57.637054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92481abc-a030-45ae-8f0b-48464120a1e7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:57.653890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92481abc-a030-45ae-8f0b-48464120a1e7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:57.667319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93be32-a78c-4808-9dff-b31054c3ac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:57.668505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93be32-a78c-4808-9dff-b31054c3ac55 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:57.668940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93be32-a78c-4808-9dff-b31054c3ac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:57.669640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93be32-a78c-4808-9dff-b31054c3ac55 admin admin] PATH_INFO: `/v3/projects/4a46ee35a93a40b9ab6db92b329733d9/users/d106a034d2664f6e8be3ab6c0b5ada0d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:57.716120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93be32-a78c-4808-9dff-b31054c3ac55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a46ee35a93a40b9ab6db92b329733d9, user_id=d106a034d2664f6e8be3ab6c0b5ada0d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:57.719202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93be32-a78c-4808-9dff-b31054c3ac55 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:57.746039 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2444/4894] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:57 2021] PUT /identity/v3/projects/4a46ee35a93a40b9ab6db92b329733d9/users/d106a034d2664f6e8be3ab6c0b5ada0d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:59:57.751126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7af3cf-b2b0-4f08-a0ab-648a28c34744 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:57.766795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7af3cf-b2b0-4f08-a0ab-648a28c34744 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:57.922028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dab39-4ef8-436e-8901-40e263b58434 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:57.922315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dab39-4ef8-436e-8901-40e263b58434 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:57.922603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dab39-4ef8-436e-8901-40e263b58434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:57.955516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-724dab39-4ef8-436e-8901-40e263b58434 None None] MFA Rules not processed for user `95f97f2e1958406b9dc0f258aa5a3f42`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:57.956973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-724dab39-4ef8-436e-8901-40e263b58434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:57.958999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbb8d7-ca52-4734-b09e-6253d37e70ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:57.963396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbb8d7-ca52-4734-b09e-6253d37e70ce admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:57.963687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbb8d7-ca52-4734-b09e-6253d37e70ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:57.964149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbb8d7-ca52-4734-b09e-6253d37e70ce admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:57.964914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbb8d7-ca52-4734-b09e-6253d37e70ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:57.969136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbb8d7-ca52-4734-b09e-6253d37e70ce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:57.995403 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2451/4895] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:57 2021] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:57.997786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbb8d7-ca52-4734-b09e-6253d37e70ce admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:58.021076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbb8d7-ca52-4734-b09e-6253d37e70ce admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:58.041095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b0923-1039-4b58-b42a-469bb6e7ebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:58.042003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b0923-1039-4b58-b42a-469bb6e7ebc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:58.042277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b0923-1039-4b58-b42a-469bb6e7ebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:58.042731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b0923-1039-4b58-b42a-469bb6e7ebc4 admin admin] PATH_INFO: `/v3/projects/4a46ee35a93a40b9ab6db92b329733d9/users/d106a034d2664f6e8be3ab6c0b5ada0d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:58.048435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b0923-1039-4b58-b42a-469bb6e7ebc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a46ee35a93a40b9ab6db92b329733d9, user_id=d106a034d2664f6e8be3ab6c0b5ada0d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:58.052274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b0923-1039-4b58-b42a-469bb6e7ebc4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:58.070569 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2445/4896] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:57 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 20:59:58.103911 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2452/4897] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:57 2021] PUT /identity/v3/projects/4a46ee35a93a40b9ab6db92b329733d9/users/d106a034d2664f6e8be3ab6c0b5ada0d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:58.120773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8841b0-8b98-47e7-ae24-d859bc333441 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:58.121360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8841b0-8b98-47e7-ae24-d859bc333441 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:58.123432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8841b0-8b98-47e7-ae24-d859bc333441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:58.220686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7d8841b0-8b98-47e7-ae24-d859bc333441 None None] MFA Rules not processed for user `d106a034d2664f6e8be3ab6c0b5ada0d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:58.224069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7d8841b0-8b98-47e7-ae24-d859bc333441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:58.433476 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2446/4898] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:58 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:58.437971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b0923-1039-4b58-b42a-469bb6e7ebc4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:58.518554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b0923-1039-4b58-b42a-469bb6e7ebc4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:58.525119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f3394-b667-45cd-ae67-4a1bff358ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:58.526049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f3394-b667-45cd-ae67-4a1bff358ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:58.526550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f3394-b667-45cd-ae67-4a1bff358ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:58.527005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f3394-b667-45cd-ae67-4a1bff358ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:58.527996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f3394-b667-45cd-ae67-4a1bff358ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:58.530094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f3394-b667-45cd-ae67-4a1bff358ec5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:58.590187 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2453/4899] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 20:59:58 2021] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:58.594796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8841b0-8b98-47e7-ae24-d859bc333441 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:58.606199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8841b0-8b98-47e7-ae24-d859bc333441 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:58.712048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131edcb3-ab78-4f1f-8c8c-d2607bb52f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:58.713053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131edcb3-ab78-4f1f-8c8c-d2607bb52f92 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:58.713518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131edcb3-ab78-4f1f-8c8c-d2607bb52f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:58.714472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131edcb3-ab78-4f1f-8c8c-d2607bb52f92 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:58.715616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131edcb3-ab78-4f1f-8c8c-d2607bb52f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:58.718482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131edcb3-ab78-4f1f-8c8c-d2607bb52f92 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:58.722693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f3394-b667-45cd-ae67-4a1bff358ec5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:58.724707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6b2f3394-b667-45cd-ae67-4a1bff358ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:58.759170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f3394-b667-45cd-ae67-4a1bff358ec5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:58.777965 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2447/4900] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 20:59:58 2021] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 20:59:58.792823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131edcb3-ab78-4f1f-8c8c-d2607bb52f92 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:58.793997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:58.795590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:58.796147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:58.796663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] PATH_INFO: `/v3/users/dcb3f0e11efd43278f9c4c34f7eda52d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:58.801591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb3f0e11efd43278f9c4c34f7eda52d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:58.805786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131edcb3-ab78-4f1f-8c8c-d2607bb52f92 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:58.807458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:58.814994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be850f7e-7910-4c84-9352-3be094d9bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:58.816291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be850f7e-7910-4c84-9352-3be094d9bdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:58.816888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be850f7e-7910-4c84-9352-3be094d9bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:58.817596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be850f7e-7910-4c84-9352-3be094d9bdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:58.818749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be850f7e-7910-4c84-9352-3be094d9bdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:58.821329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be850f7e-7910-4c84-9352-3be094d9bdd5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:58.844700 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2448/4901] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:58 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:58.847043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be850f7e-7910-4c84-9352-3be094d9bdd5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:58.861384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be850f7e-7910-4c84-9352-3be094d9bdd5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:58.869995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d612f-65a7-4326-842f-2671dc40def3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:58.871391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d612f-65a7-4326-842f-2671dc40def3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:58.871391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d612f-65a7-4326-842f-2671dc40def3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:58.871620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d612f-65a7-4326-842f-2671dc40def3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:58.872488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d612f-65a7-4326-842f-2671dc40def3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:58.874919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d612f-65a7-4326-842f-2671dc40def3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:58.894869 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2449/4902] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 20:59:58 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 20:59:58.897002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d612f-65a7-4326-842f-2671dc40def3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:58.915946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d612f-65a7-4326-842f-2671dc40def3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:58.923438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa7126-03fe-4b89-8d37-bdce8fd2f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:58.924615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa7126-03fe-4b89-8d37-bdce8fd2f074 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:58.925983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa7126-03fe-4b89-8d37-bdce8fd2f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:58.926340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa7126-03fe-4b89-8d37-bdce8fd2f074 admin admin] PATH_INFO: `/v3/projects/ea46f65fbd29496587ead16f614f601b/users/d29c9af753fd4c23a482d1742d482c83/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:58.938137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb3f0e11efd43278f9c4c34f7eda52d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:58.957802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb3f0e11efd43278f9c4c34f7eda52d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:58.958905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb3f0e11efd43278f9c4c34f7eda52d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:58.965252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa7126-03fe-4b89-8d37-bdce8fd2f074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea46f65fbd29496587ead16f614f601b, user_id=d29c9af753fd4c23a482d1742d482c83, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:58.971316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa7126-03fe-4b89-8d37-bdce8fd2f074 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:58.977650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb3f0e11efd43278f9c4c34f7eda52d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:59.003313 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2450/4903] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 20:59:58 2021] PUT /identity/v3/projects/ea46f65fbd29496587ead16f614f601b/users/d29c9af753fd4c23a482d1742d482c83/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:59:59.011674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99720f69-850b-43e1-980e-6b796326ca56 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:59.011963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99720f69-850b-43e1-980e-6b796326ca56 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:59.012245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99720f69-850b-43e1-980e-6b796326ca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:59.014529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb3f0e11efd43278f9c4c34f7eda52d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:59.035678 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2454/4904] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:58 2021] DELETE /identity/v3/users/dcb3f0e11efd43278f9c4c34f7eda52d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 20:59:59.045074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-99720f69-850b-43e1-980e-6b796326ca56 None None] MFA Rules not processed for user `d29c9af753fd4c23a482d1742d482c83`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:59.046475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-99720f69-850b-43e1-980e-6b796326ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:59.163904 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2451/4905] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:59 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 20:59:59.177162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:59.179231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:59.284252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1506d9-8068-475b-a7ee-63cba398a956 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:59.288484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338307-744f-4f11-9c96-d5f860e07c9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:59.289141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338307-744f-4f11-9c96-d5f860e07c9f service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:59.289418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338307-744f-4f11-9c96-d5f860e07c9f service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:59.289846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338307-744f-4f11-9c96-d5f860e07c9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:59.291747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-48338307-744f-4f11-9c96-d5f860e07c9f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:59.415310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48338307-744f-4f11-9c96-d5f860e07c9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:59.417421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48338307-744f-4f11-9c96-d5f860e07c9f service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:59.437797 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2455/4906] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 20:59:59 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 20:59:59.521227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99720f69-850b-43e1-980e-6b796326ca56 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:59.522783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-99720f69-850b-43e1-980e-6b796326ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:59.655586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99720f69-850b-43e1-980e-6b796326ca56 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:59.665469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:59.665469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:59.665469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:59.665469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] PATH_INFO: `/v3/projects/7860bb78a8bc43fd80d4c01ce057e5ef` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:59.665995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7860bb78a8bc43fd80d4c01ce057e5ef)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:59.672341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 20:59:59.746210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7860bb78a8bc43fd80d4c01ce057e5ef', 'request_id': 'req-6bbd9318-cd80-4c2b-b4a0-da80a9018489'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:59.755841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7860bb78a8bc43fd80d4c01ce057e5ef', 'request_id': 'req-6bbd9318-cd80-4c2b-b4a0-da80a9018489'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:59.789812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7860bb78a8bc43fd80d4c01ce057e5ef', 'request_id': 'req-6bbd9318-cd80-4c2b-b4a0-da80a9018489'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:59.821653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338307-744f-4f11-9c96-d5f860e07c9f service glance] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 20:59:59.823489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-48338307-744f-4f11-9c96-d5f860e07c9f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:59.831155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] The token cache is being invalidate because project 7860bb78a8bc43fd80d4c01ce057e5ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 20:59:59.831479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:59.835514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6bbd9318-cd80-4c2b-b4a0-da80a9018489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 20:59:59.839130 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2452/4907] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 20:59:59 2021] DELETE /identity/v3/projects/7860bb78a8bc43fd80d4c01ce057e5ef => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 20:59:59.841648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338307-744f-4f11-9c96-d5f860e07c9f service glance] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 20:59:59.848037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b2cb-4093-420a-b89c-0b7de4b4ee24 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:59.849199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b2cb-4093-420a-b89c-0b7de4b4ee24 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:59.849493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b2cb-4093-420a-b89c-0b7de4b4ee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:59.897447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2dd2b2cb-4093-420a-b89c-0b7de4b4ee24 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 20:59:59.901081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2dd2b2cb-4093-420a-b89c-0b7de4b4ee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 20:59:59.925993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ae555-73ff-4e7a-aea5-6e019ecb9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 20:59:59.927592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ae555-73ff-4e7a-aea5-6e019ecb9cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 20:59:59.928061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ae555-73ff-4e7a-aea5-6e019ecb9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 20:59:59.928490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ae555-73ff-4e7a-aea5-6e019ecb9cde admin admin] PATH_INFO: `/v3/users/d106a034d2664f6e8be3ab6c0b5ada0d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 20:59:59.930124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ae555-73ff-4e7a-aea5-6e019ecb9cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=d106a034d2664f6e8be3ab6c0b5ada0d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 20:59:59.932780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ae555-73ff-4e7a-aea5-6e019ecb9cde admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:00.037113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4f5ae555-73ff-4e7a-aea5-6e019ecb9cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd106a034d2664f6e8be3ab6c0b5ada0d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:00.056450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4f5ae555-73ff-4e7a-aea5-6e019ecb9cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd106a034d2664f6e8be3ab6c0b5ada0d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:00.058304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4f5ae555-73ff-4e7a-aea5-6e019ecb9cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd106a034d2664f6e8be3ab6c0b5ada0d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:00.081993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4f5ae555-73ff-4e7a-aea5-6e019ecb9cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd106a034d2664f6e8be3ab6c0b5ada0d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:00.120985 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2453/4908] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 20:59:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:00:00.138942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4f5ae555-73ff-4e7a-aea5-6e019ecb9cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd106a034d2664f6e8be3ab6c0b5ada0d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:00.143620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a6ddc-9df6-4c40-9e0d-81993645c772 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:00.143893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a6ddc-9df6-4c40-9e0d-81993645c772 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:00.144163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a6ddc-9df6-4c40-9e0d-81993645c772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:00.166052 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2456/4909] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 20:59:59 2021] DELETE /identity/v3/users/d106a034d2664f6e8be3ab6c0b5ada0d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:00.175198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268814a8-81d4-4aee-a75e-3b9fffc7d1e7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:00.175641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268814a8-81d4-4aee-a75e-3b9fffc7d1e7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:00.175928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268814a8-81d4-4aee-a75e-3b9fffc7d1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:00.193769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5a3a6ddc-9df6-4c40-9e0d-81993645c772 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:00.198293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5a3a6ddc-9df6-4c40-9e0d-81993645c772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:00.209462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-268814a8-81d4-4aee-a75e-3b9fffc7d1e7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:00.210688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-268814a8-81d4-4aee-a75e-3b9fffc7d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:00.364406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2454/4910] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:00.367436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a6ddc-9df6-4c40-9e0d-81993645c772 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:00.380851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a6ddc-9df6-4c40-9e0d-81993645c772 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:00.387444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f9a22-aa0b-460a-944b-2579f2544ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:00.388784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f9a22-aa0b-460a-944b-2579f2544ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:00.389599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f9a22-aa0b-460a-944b-2579f2544ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:00.390170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f9a22-aa0b-460a-944b-2579f2544ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:00.391123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f9a22-aa0b-460a-944b-2579f2544ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:00.391561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f9a22-aa0b-460a-944b-2579f2544ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:00.394839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f9a22-aa0b-460a-944b-2579f2544ed6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:00.414343 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2455/4911] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:00.433942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f9a22-aa0b-460a-944b-2579f2544ed6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:00.443413 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2457/4912] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:00:00.462145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f9a22-aa0b-460a-944b-2579f2544ed6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:00.472286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1bb46-b76a-45dd-a57f-700356950775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:00.473026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1bb46-b76a-45dd-a57f-700356950775 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:00.473249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1bb46-b76a-45dd-a57f-700356950775 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:00.473524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1bb46-b76a-45dd-a57f-700356950775 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:00.474232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1bb46-b76a-45dd-a57f-700356950775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:00.479530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1bb46-b76a-45dd-a57f-700356950775 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:00.508762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268814a8-81d4-4aee-a75e-3b9fffc7d1e7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:00.513080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-268814a8-81d4-4aee-a75e-3b9fffc7d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:00.537800 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2456/4913] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:00 2021] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:00.550136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1bb46-b76a-45dd-a57f-700356950775 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:00.636921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268814a8-81d4-4aee-a75e-3b9fffc7d1e7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:00.646987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1bb46-b76a-45dd-a57f-700356950775 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:00.655912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79b24e-c555-42a0-919b-5ff727c88581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:00.656707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b24e-c555-42a0-919b-5ff727c88581 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:00.659299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b24e-c555-42a0-919b-5ff727c88581 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:00.659651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79b24e-c555-42a0-919b-5ff727c88581 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:00.660750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79b24e-c555-42a0-919b-5ff727c88581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:00.664858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79b24e-c555-42a0-919b-5ff727c88581 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:00.717340 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2457/4914] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:00 2021] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:00.728646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79b24e-c555-42a0-919b-5ff727c88581 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:00.743095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79b24e-c555-42a0-919b-5ff727c88581 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:00.750978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451f6b-eaf3-4c32-b161-778ec5af7460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:00.752191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451f6b-eaf3-4c32-b161-778ec5af7460 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:00.752843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451f6b-eaf3-4c32-b161-778ec5af7460 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:00.753127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1451f6b-eaf3-4c32-b161-778ec5af7460 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:00.754034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451f6b-eaf3-4c32-b161-778ec5af7460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:00.755769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1451f6b-eaf3-4c32-b161-778ec5af7460 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:00.763672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2844d-7330-4f95-bb95-f6f039301589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:00.765796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2844d-7330-4f95-bb95-f6f039301589 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:00.767565 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2458/4915] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:00 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:00.769020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2844d-7330-4f95-bb95-f6f039301589 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:00.769749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2844d-7330-4f95-bb95-f6f039301589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:00.771779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451f6b-eaf3-4c32-b161-778ec5af7460 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:00.791031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1451f6b-eaf3-4c32-b161-778ec5af7460 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:00.801918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcace70-b596-4e78-8b4f-147ef0cb4d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:00.802597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcace70-b596-4e78-8b4f-147ef0cb4d6d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:00.802875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcace70-b596-4e78-8b4f-147ef0cb4d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:00.803295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcace70-b596-4e78-8b4f-147ef0cb4d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:00.804043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcace70-b596-4e78-8b4f-147ef0cb4d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:00.805653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcace70-b596-4e78-8b4f-147ef0cb4d6d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:00.806708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2844d-7330-4f95-bb95-f6f039301589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:00.814503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2844d-7330-4f95-bb95-f6f039301589 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:00.822186 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2459/4916] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:00 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:00.823444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcace70-b596-4e78-8b4f-147ef0cb4d6d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:00.837925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcace70-b596-4e78-8b4f-147ef0cb4d6d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:00.843129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ae21-e331-42aa-8a4d-18567047001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:00.844533 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2458/4917] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:00.845328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ae21-e331-42aa-8a4d-18567047001f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:00.845663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ae21-e331-42aa-8a4d-18567047001f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:00.846593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ae21-e331-42aa-8a4d-18567047001f admin admin] PATH_INFO: `/v3/projects/dc5da228c74444d99bbd83366a9438ba/users/7be26c3cb58b4e9c96ad44105b5fe28a/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:00.880830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14ae21-e331-42aa-8a4d-18567047001f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5da228c74444d99bbd83366a9438ba, user_id=7be26c3cb58b4e9c96ad44105b5fe28a, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:00.897707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14ae21-e331-42aa-8a4d-18567047001f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:00.929913 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2460/4918] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:00 2021] PUT /identity/v3/projects/dc5da228c74444d99bbd83366a9438ba/users/7be26c3cb58b4e9c96ad44105b5fe28a/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:00.932127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f012e0f-d961-458c-bb2c-bcfd814137a0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:00.932449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f012e0f-d961-458c-bb2c-bcfd814137a0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:00.933149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f012e0f-d961-458c-bb2c-bcfd814137a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:00.959668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5f012e0f-d961-458c-bb2c-bcfd814137a0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:00.962161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f012e0f-d961-458c-bb2c-bcfd814137a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:01.072692 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2459/4919] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:01.123871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ae21-e331-42aa-8a4d-18567047001f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:01.258858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ae21-e331-42aa-8a4d-18567047001f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:01.271990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b852a5-23cb-4c75-952b-db440d6787a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:01.272729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b852a5-23cb-4c75-952b-db440d6787a1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:01.273005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b852a5-23cb-4c75-952b-db440d6787a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:01.274093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b852a5-23cb-4c75-952b-db440d6787a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:01.300495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b852a5-23cb-4c75-952b-db440d6787a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:01.302024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b852a5-23cb-4c75-952b-db440d6787a1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:01.330351 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2461/4920] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:01.439907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f012e0f-d961-458c-bb2c-bcfd814137a0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:01.450521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f012e0f-d961-458c-bb2c-bcfd814137a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:01.581151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f012e0f-d961-458c-bb2c-bcfd814137a0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:01.591468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1be14-2509-4de2-9807-2f848f8524d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:01.592189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1be14-2509-4de2-9807-2f848f8524d0 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:01.592475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1be14-2509-4de2-9807-2f848f8524d0 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:01.592766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1be14-2509-4de2-9807-2f848f8524d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:01.602247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0ac1be14-2509-4de2-9807-2f848f8524d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:01.689395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1be14-2509-4de2-9807-2f848f8524d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:01.691039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1be14-2509-4de2-9807-2f848f8524d0 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:01.712084 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2460/4921] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:01 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:02.478624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b852a5-23cb-4c75-952b-db440d6787a1 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:02.480243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-60b852a5-23cb-4c75-952b-db440d6787a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:02.495700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b852a5-23cb-4c75-952b-db440d6787a1 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:02.501110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:02.502896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:02.503474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:02.503987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] PATH_INFO: `/v3/projects/4a46ee35a93a40b9ab6db92b329733d9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:02.506094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a46ee35a93a40b9ab6db92b329733d9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:02.509029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:02.578915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a46ee35a93a40b9ab6db92b329733d9', 'request_id': 'req-8b6d638e-57b9-4858-8ec8-c43c6956c432'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:02.588188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a46ee35a93a40b9ab6db92b329733d9', 'request_id': 'req-8b6d638e-57b9-4858-8ec8-c43c6956c432'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:02.598685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a46ee35a93a40b9ab6db92b329733d9', 'request_id': 'req-8b6d638e-57b9-4858-8ec8-c43c6956c432'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:02.616668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] The token cache is being invalidate because project 4a46ee35a93a40b9ab6db92b329733d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:02.617454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:02.619648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:02.622466 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2462/4922] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:02 2021] DELETE /identity/v3/projects/4a46ee35a93a40b9ab6db92b329733d9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:02.626987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1be14-2509-4de2-9807-2f848f8524d0 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:02.642778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1be14-2509-4de2-9807-2f848f8524d0 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:02.729786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d9e48-48ac-45f2-8457-12952649e97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:02.730719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d9e48-48ac-45f2-8457-12952649e97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:02.731055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d9e48-48ac-45f2-8457-12952649e97b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:02.731378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d9e48-48ac-45f2-8457-12952649e97b admin admin] PATH_INFO: `/v3/users/d29c9af753fd4c23a482d1742d482c83` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:02.732736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d9e48-48ac-45f2-8457-12952649e97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d29c9af753fd4c23a482d1742d482c83)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:02.734955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d9e48-48ac-45f2-8457-12952649e97b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:02.833962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd4d9e48-48ac-45f2-8457-12952649e97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd29c9af753fd4c23a482d1742d482c83'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:02.846864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd4d9e48-48ac-45f2-8457-12952649e97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd29c9af753fd4c23a482d1742d482c83'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:02.847797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd4d9e48-48ac-45f2-8457-12952649e97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd29c9af753fd4c23a482d1742d482c83'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:02.867526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd4d9e48-48ac-45f2-8457-12952649e97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd29c9af753fd4c23a482d1742d482c83'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:02.889374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd4d9e48-48ac-45f2-8457-12952649e97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd29c9af753fd4c23a482d1742d482c83'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:02.911789 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2461/4923] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:02 2021] DELETE /identity/v3/users/d29c9af753fd4c23a482d1742d482c83 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:03.955688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:03.957765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:03.980316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d638e-57b9-4858-8ec8-c43c6956c432 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:04.165076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:04.167957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:04.174929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:04.175223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] PATH_INFO: `/v3/projects/ea46f65fbd29496587ead16f614f601b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:04.180353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea46f65fbd29496587ead16f614f601b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:04.182298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:04.270506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea46f65fbd29496587ead16f614f601b', 'request_id': 'req-4fdaa506-1ee5-45f6-9644-7056caab3174'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:04.278785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea46f65fbd29496587ead16f614f601b', 'request_id': 'req-4fdaa506-1ee5-45f6-9644-7056caab3174'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:04.294470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea46f65fbd29496587ead16f614f601b', 'request_id': 'req-4fdaa506-1ee5-45f6-9644-7056caab3174'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:04.309666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] The token cache is being invalidate because project ea46f65fbd29496587ead16f614f601b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:04.310250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:04.311689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4fdaa506-1ee5-45f6-9644-7056caab3174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:04.319586 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2463/4924] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:03 2021] DELETE /identity/v3/projects/ea46f65fbd29496587ead16f614f601b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:04.320068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021db67-3645-41c6-97c4-770497c7e796 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:04.320534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021db67-3645-41c6-97c4-770497c7e796 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:04.320723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021db67-3645-41c6-97c4-770497c7e796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:04.343748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0021db67-3645-41c6-97c4-770497c7e796 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:04.345118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0021db67-3645-41c6-97c4-770497c7e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:04.437701 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2462/4925] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:00:04.450816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9e18-6521-460d-baa5-97b2251e1fb9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:04.452641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9e18-6521-460d-baa5-97b2251e1fb9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:04.453089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9e18-6521-460d-baa5-97b2251e1fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:04.483025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-33fb9e18-6521-460d-baa5-97b2251e1fb9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:04.484467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-33fb9e18-6521-460d-baa5-97b2251e1fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:04.501469 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2464/4926] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:04.502754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021db67-3645-41c6-97c4-770497c7e796 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:04.513133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021db67-3645-41c6-97c4-770497c7e796 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:04.532073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d92451-668c-4a9d-a672-05c95e0fdc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:04.532941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92451-668c-4a9d-a672-05c95e0fdc22 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:04.533782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92451-668c-4a9d-a672-05c95e0fdc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:04.534091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92451-668c-4a9d-a672-05c95e0fdc22 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:04.534858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d92451-668c-4a9d-a672-05c95e0fdc22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:04.535410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d92451-668c-4a9d-a672-05c95e0fdc22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:04.537250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d92451-668c-4a9d-a672-05c95e0fdc22 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:04.551910 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2463/4927] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:04.556346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb9e18-6521-460d-baa5-97b2251e1fb9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:04.567953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb9e18-6521-460d-baa5-97b2251e1fb9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:04.588894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34af3d-d1ef-434e-bd5d-4e6a4be44a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:04.590391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34af3d-d1ef-434e-bd5d-4e6a4be44a25 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:04.591469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34af3d-d1ef-434e-bd5d-4e6a4be44a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:04.592574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34af3d-d1ef-434e-bd5d-4e6a4be44a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:04.594530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34af3d-d1ef-434e-bd5d-4e6a4be44a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:04.601784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34af3d-d1ef-434e-bd5d-4e6a4be44a25 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:04.653608 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2465/4928] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:04 2021] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:04.657889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86aaec-9513-4bca-8bae-c82b4a88f429 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:04.658244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86aaec-9513-4bca-8bae-c82b4a88f429 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:04.659046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86aaec-9513-4bca-8bae-c82b4a88f429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:04.663030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34af3d-d1ef-434e-bd5d-4e6a4be44a25 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:04.723031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fc86aaec-9513-4bca-8bae-c82b4a88f429 None None] MFA Rules not processed for user `7be26c3cb58b4e9c96ad44105b5fe28a`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:04.724897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fc86aaec-9513-4bca-8bae-c82b4a88f429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:04.779231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34af3d-d1ef-434e-bd5d-4e6a4be44a25 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:04.785693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb55379-c154-4dff-8a65-2be97caa01d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:04.786370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55379-c154-4dff-8a65-2be97caa01d9 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:04.786842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55379-c154-4dff-8a65-2be97caa01d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:04.787341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55379-c154-4dff-8a65-2be97caa01d9 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:04.788262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb55379-c154-4dff-8a65-2be97caa01d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:04.790469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb55379-c154-4dff-8a65-2be97caa01d9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:04.820209 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2464/4929] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:04 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:04.822007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fafa6-6b13-46c3-a674-090c778400d8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:04.823602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fafa6-6b13-46c3-a674-090c778400d8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:04.824062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fafa6-6b13-46c3-a674-090c778400d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:04.827920 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2466/4930] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:04 2021] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:04.828966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb55379-c154-4dff-8a65-2be97caa01d9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:04.848379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb55379-c154-4dff-8a65-2be97caa01d9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:04.850282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a82fafa6-6b13-46c3-a674-090c778400d8 None None] MFA Rules not processed for user `7be26c3cb58b4e9c96ad44105b5fe28a`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:04.851870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a82fafa6-6b13-46c3-a674-090c778400d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:04.855898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d396f-1883-429e-9613-91318c42db3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:04.857403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d396f-1883-429e-9613-91318c42db3c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:04.858331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d396f-1883-429e-9613-91318c42db3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:04.858752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d396f-1883-429e-9613-91318c42db3c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:04.859575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d396f-1883-429e-9613-91318c42db3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:04.861514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d396f-1883-429e-9613-91318c42db3c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:04.866201 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2465/4931] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:04 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:04.877587 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2467/4932] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:04 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:04.883136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fafa6-6b13-46c3-a674-090c778400d8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:04.895197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fafa6-6b13-46c3-a674-090c778400d8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:04.900111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933080-a094-44a7-9b3c-731cbaf5a36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:04.900791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933080-a094-44a7-9b3c-731cbaf5a36c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:04.901076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933080-a094-44a7-9b3c-731cbaf5a36c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:04.902252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7933080-a094-44a7-9b3c-731cbaf5a36c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:04.902428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7933080-a094-44a7-9b3c-731cbaf5a36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:04.903982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7933080-a094-44a7-9b3c-731cbaf5a36c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:04.920370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d396f-1883-429e-9613-91318c42db3c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:04.920799 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2466/4933] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:04 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:04.932117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d396f-1883-429e-9613-91318c42db3c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:04.938304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2047b3-466b-4c45-b846-2fe4b1fbb3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:04.939198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2047b3-466b-4c45-b846-2fe4b1fbb3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:04.940041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2047b3-466b-4c45-b846-2fe4b1fbb3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:04.940378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2047b3-466b-4c45-b846-2fe4b1fbb3fe admin admin] PATH_INFO: `/v3/projects/949c01cdb13640c5b158718e48170cba/users/950a7890c57443408008ce6e4006526f/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:04.958037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933080-a094-44a7-9b3c-731cbaf5a36c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:04.959958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c7933080-a094-44a7-9b3c-731cbaf5a36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:04.970886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2047b3-466b-4c45-b846-2fe4b1fbb3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=949c01cdb13640c5b158718e48170cba, user_id=950a7890c57443408008ce6e4006526f, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:04.975691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2047b3-466b-4c45-b846-2fe4b1fbb3fe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:05.016666 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2468/4934] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:04 2021] PUT /identity/v3/projects/949c01cdb13640c5b158718e48170cba/users/950a7890c57443408008ce6e4006526f/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:05.019092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15865d24-5860-4d92-bd6d-064f622469a1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:05.019516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15865d24-5860-4d92-bd6d-064f622469a1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:05.019884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15865d24-5860-4d92-bd6d-064f622469a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:05.049861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-15865d24-5860-4d92-bd6d-064f622469a1 None None] MFA Rules not processed for user `950a7890c57443408008ce6e4006526f`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:05.051810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-15865d24-5860-4d92-bd6d-064f622469a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:05.106587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7933080-a094-44a7-9b3c-731cbaf5a36c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:05.134222 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2469/4935] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:05 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:05.148214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15865d24-5860-4d92-bd6d-064f622469a1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:05.149858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-15865d24-5860-4d92-bd6d-064f622469a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:05.236423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1637-639a-444d-b4e6-98899620e00c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:05.238667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1637-639a-444d-b4e6-98899620e00c service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:05.238667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1637-639a-444d-b4e6-98899620e00c service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:05.238667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d1637-639a-444d-b4e6-98899620e00c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:05.266221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15865d24-5860-4d92-bd6d-064f622469a1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:05.274322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c6ef6-2f8b-431f-8d45-b8f82a21e4b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:05.274979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c6ef6-2f8b-431f-8d45-b8f82a21e4b0 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:05.275276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c6ef6-2f8b-431f-8d45-b8f82a21e4b0 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:05.275558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c6ef6-2f8b-431f-8d45-b8f82a21e4b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:05.297198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c6ef6-2f8b-431f-8d45-b8f82a21e4b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:05.298667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c6ef6-2f8b-431f-8d45-b8f82a21e4b0 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:05.324726 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2470/4936] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:05 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:00:05.339575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d1637-639a-444d-b4e6-98899620e00c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:05.343024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d1637-639a-444d-b4e6-98899620e00c service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:05.354361 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2467/4937] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:04 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:05.520549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7ff4-c1c3-479f-b541-4ef7d17c3ea4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:05.521328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7ff4-c1c3-479f-b541-4ef7d17c3ea4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:05.521806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7ff4-c1c3-479f-b541-4ef7d17c3ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:05.541175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-78cc7ff4-c1c3-479f-b541-4ef7d17c3ea4 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:05.542948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-78cc7ff4-c1c3-479f-b541-4ef7d17c3ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:05.659367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1637-639a-444d-b4e6-98899620e00c service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:05.659550 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2471/4938] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:00:05 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:05.660868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4f0d1637-639a-444d-b4e6-98899620e00c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:05.777099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d1637-639a-444d-b4e6-98899620e00c service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:05.785230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adbe3a-8bb8-4782-85f5-cd951be08ce3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:05.787087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adbe3a-8bb8-4782-85f5-cd951be08ce3 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:05.787507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adbe3a-8bb8-4782-85f5-cd951be08ce3 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:05.787885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adbe3a-8bb8-4782-85f5-cd951be08ce3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:05.801452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adbe3a-8bb8-4782-85f5-cd951be08ce3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:05.803837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adbe3a-8bb8-4782-85f5-cd951be08ce3 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:05.819980 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2468/4939] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:00:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:00:06.589294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b61378-d5f7-4643-85cb-381097e24bc4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:06.590441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b61378-d5f7-4643-85cb-381097e24bc4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:06.591030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b61378-d5f7-4643-85cb-381097e24bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:06.616853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-02b61378-d5f7-4643-85cb-381097e24bc4 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:06.619481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-02b61378-d5f7-4643-85cb-381097e24bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:06.646030 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2472/4940] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:00:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:06.656773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adbe3a-8bb8-4782-85f5-cd951be08ce3 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:06.669813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adbe3a-8bb8-4782-85f5-cd951be08ce3 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:06.676541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a8d35-3643-4b70-8e2e-29cb17d2d025 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:06.677487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a8d35-3643-4b70-8e2e-29cb17d2d025 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:06.678010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a8d35-3643-4b70-8e2e-29cb17d2d025 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:06.678519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a8d35-3643-4b70-8e2e-29cb17d2d025 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:06.688317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a8d35-3643-4b70-8e2e-29cb17d2d025 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:06.691058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a8d35-3643-4b70-8e2e-29cb17d2d025 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:06.709080 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2469/4941] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:00:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:07.161929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907d26-73de-49ac-9f48-4df1adaec551 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:07.162218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907d26-73de-49ac-9f48-4df1adaec551 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:07.162996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907d26-73de-49ac-9f48-4df1adaec551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:07.189475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6c907d26-73de-49ac-9f48-4df1adaec551 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:07.192232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6c907d26-73de-49ac-9f48-4df1adaec551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:07.204100 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2473/4942] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:00:07 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:07.220349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a8d35-3643-4b70-8e2e-29cb17d2d025 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:07.242799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a8d35-3643-4b70-8e2e-29cb17d2d025 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:07.253840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bbe83-a359-4d6b-9825-c268f397cb3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:07.255404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bbe83-a359-4d6b-9825-c268f397cb3f service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:07.256702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bbe83-a359-4d6b-9825-c268f397cb3f service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:07.257782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bbe83-a359-4d6b-9825-c268f397cb3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:07.272366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bbe83-a359-4d6b-9825-c268f397cb3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:07.276320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76bbe83-a359-4d6b-9825-c268f397cb3f service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:07.291724 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2470/4943] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:00:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:07.598433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b1455-f4de-44c4-9043-64a931e3f34f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:07.599310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b1455-f4de-44c4-9043-64a931e3f34f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:07.599869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b1455-f4de-44c4-9043-64a931e3f34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:07.621371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c32b1455-f4de-44c4-9043-64a931e3f34f None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:07.624600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c32b1455-f4de-44c4-9043-64a931e3f34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:07.634623 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2474/4944] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:00:07 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:07.650863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bbe83-a359-4d6b-9825-c268f397cb3f service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:07.670286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bbe83-a359-4d6b-9825-c268f397cb3f service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:07.683894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89131868-3159-4e0e-8803-0c047d7d7535 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:07.686284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89131868-3159-4e0e-8803-0c047d7d7535 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:07.688240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89131868-3159-4e0e-8803-0c047d7d7535 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:07.693339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89131868-3159-4e0e-8803-0c047d7d7535 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:07.720294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89131868-3159-4e0e-8803-0c047d7d7535 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:07.723307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89131868-3159-4e0e-8803-0c047d7d7535 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:07.758891 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2471/4945] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:00:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:08.248941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f7cb-0ec2-4d96-87b3-881018097289 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:08.249712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f7cb-0ec2-4d96-87b3-881018097289 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:08.250233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f7cb-0ec2-4d96-87b3-881018097289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:08.273330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-18d4f7cb-0ec2-4d96-87b3-881018097289 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:08.276275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-18d4f7cb-0ec2-4d96-87b3-881018097289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:08.347502 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2475/4946] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:00:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:00:08.369101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89131868-3159-4e0e-8803-0c047d7d7535 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:08.396019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89131868-3159-4e0e-8803-0c047d7d7535 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:08.415473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b84656-04c9-41bf-ba37-565c99c829a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:08.416398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b84656-04c9-41bf-ba37-565c99c829a0 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:08.416683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b84656-04c9-41bf-ba37-565c99c829a0 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:08.416957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b84656-04c9-41bf-ba37-565c99c829a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:08.430829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b84656-04c9-41bf-ba37-565c99c829a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:08.444259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b84656-04c9-41bf-ba37-565c99c829a0 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:08.459984 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2472/4947] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:00:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:08.844430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6918-3f4b-4cf8-bf95-c794b11f1e00 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:08.845052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6918-3f4b-4cf8-bf95-c794b11f1e00 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:08.845166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6918-3f4b-4cf8-bf95-c794b11f1e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:08.879379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-972a6918-3f4b-4cf8-bf95-c794b11f1e00 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:08.881701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-972a6918-3f4b-4cf8-bf95-c794b11f1e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:08.903342 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2476/4948] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:00:08 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:08.913466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b84656-04c9-41bf-ba37-565c99c829a0 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:08.931788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b84656-04c9-41bf-ba37-565c99c829a0 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:08.943633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14979122-e64a-44c9-8a2b-697e888af922 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:08.951246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14979122-e64a-44c9-8a2b-697e888af922 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:08.952139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14979122-e64a-44c9-8a2b-697e888af922 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:08.953040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14979122-e64a-44c9-8a2b-697e888af922 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:08.965273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14979122-e64a-44c9-8a2b-697e888af922 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:08.968924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14979122-e64a-44c9-8a2b-697e888af922 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:08.986162 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2473/4949] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:00:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:00:09.192972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a6918-3f4b-4cf8-bf95-c794b11f1e00 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:09.322682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a6918-3f4b-4cf8-bf95-c794b11f1e00 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:09.327299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:09.328173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:09.328476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:09.328864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] PATH_INFO: `/v3/users/950a7890c57443408008ce6e4006526f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:09.330837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950a7890c57443408008ce6e4006526f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:09.333334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:09.434689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950a7890c57443408008ce6e4006526f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:09.435430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950a7890c57443408008ce6e4006526f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:09.452199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950a7890c57443408008ce6e4006526f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:09.453000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950a7890c57443408008ce6e4006526f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:09.467508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950a7890c57443408008ce6e4006526f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:09.499093 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2477/4950] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:09 2021] DELETE /identity/v3/users/950a7890c57443408008ce6e4006526f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:09.500591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cf463-39e6-491a-bbd4-4b9ba9b2b48f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:09.500891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cf463-39e6-491a-bbd4-4b9ba9b2b48f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:09.501172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cf463-39e6-491a-bbd4-4b9ba9b2b48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:09.532652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-546cf463-39e6-491a-bbd4-4b9ba9b2b48f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:09.534543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-546cf463-39e6-491a-bbd4-4b9ba9b2b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:09.645386 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2474/4951] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:09.670834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:09.672548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:09.772417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8867b3-ea93-450b-bc7f-8072e1a64cf1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:09.778413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6c76-2d90-4424-b4b4-16a52221e71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:09.779511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6c76-2d90-4424-b4b4-16a52221e71e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:09.779964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6c76-2d90-4424-b4b4-16a52221e71e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:09.780481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6c76-2d90-4424-b4b4-16a52221e71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:09.796227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea6c76-2d90-4424-b4b4-16a52221e71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:09.799081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea6c76-2d90-4424-b4b4-16a52221e71e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:09.812591 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2478/4952] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:11.315722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cf463-39e6-491a-bbd4-4b9ba9b2b48f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:11.317762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-546cf463-39e6-491a-bbd4-4b9ba9b2b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:11.331412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cf463-39e6-491a-bbd4-4b9ba9b2b48f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:11.338277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:11.340442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:11.340906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:11.341346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] PATH_INFO: `/v3/projects/949c01cdb13640c5b158718e48170cba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:11.342811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] RBAC: Authorizing `identity:delete_project(project_id=949c01cdb13640c5b158718e48170cba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:11.345104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:11.433959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949c01cdb13640c5b158718e48170cba', 'request_id': 'req-4138b411-613c-4027-b7ad-584eca3b037e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:11.448977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949c01cdb13640c5b158718e48170cba', 'request_id': 'req-4138b411-613c-4027-b7ad-584eca3b037e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:11.462659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949c01cdb13640c5b158718e48170cba', 'request_id': 'req-4138b411-613c-4027-b7ad-584eca3b037e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:11.476500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] The token cache is being invalidate because project 949c01cdb13640c5b158718e48170cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:11.477369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:11.478524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4138b411-613c-4027-b7ad-584eca3b037e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:11.481040 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2475/4953] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:11 2021] DELETE /identity/v3/projects/949c01cdb13640c5b158718e48170cba => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:11.487375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9e26-f8a4-4a5e-a39e-aa0ebe6b7843 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:11.487799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9e26-f8a4-4a5e-a39e-aa0ebe6b7843 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:11.487910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9e26-f8a4-4a5e-a39e-aa0ebe6b7843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:11.520391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b4dd9e26-f8a4-4a5e-a39e-aa0ebe6b7843 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:11.522248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b4dd9e26-f8a4-4a5e-a39e-aa0ebe6b7843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:11.637188 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2479/4954] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:11.644309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962f1f3-087f-4808-a481-11427fb864e5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:11.644855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962f1f3-087f-4808-a481-11427fb864e5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:11.645299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962f1f3-087f-4808-a481-11427fb864e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:11.682504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1962f1f3-087f-4808-a481-11427fb864e5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:11.684338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1962f1f3-087f-4808-a481-11427fb864e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:11.705612 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2476/4955] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:11.709715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9e26-f8a4-4a5e-a39e-aa0ebe6b7843 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:11.720176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9e26-f8a4-4a5e-a39e-aa0ebe6b7843 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:11.725936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b47d4-e4ca-4683-aac8-b74038f4b590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:11.726807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b47d4-e4ca-4683-aac8-b74038f4b590 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:11.727282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b47d4-e4ca-4683-aac8-b74038f4b590 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:11.727736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b47d4-e4ca-4683-aac8-b74038f4b590 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:11.728788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b47d4-e4ca-4683-aac8-b74038f4b590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:11.729256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b47d4-e4ca-4683-aac8-b74038f4b590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:11.731029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b47d4-e4ca-4683-aac8-b74038f4b590 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:11.748626 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2480/4956] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:11.754547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962f1f3-087f-4808-a481-11427fb864e5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:11.767102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962f1f3-087f-4808-a481-11427fb864e5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:11.773596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec10abd-f17c-47a9-be03-55fe0100fe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:11.774817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10abd-f17c-47a9-be03-55fe0100fe1e admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:11.775410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10abd-f17c-47a9-be03-55fe0100fe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:11.776099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10abd-f17c-47a9-be03-55fe0100fe1e admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:11.777218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec10abd-f17c-47a9-be03-55fe0100fe1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:11.779633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec10abd-f17c-47a9-be03-55fe0100fe1e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:11.830963 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2477/4957] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:11 2021] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:11.834685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b47d4-e4ca-4683-aac8-b74038f4b590 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:11.860705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b47d4-e4ca-4683-aac8-b74038f4b590 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:11.957928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283b124-4fa3-4e97-ba2c-949f634822fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:11.958990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283b124-4fa3-4e97-ba2c-949f634822fd admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:11.959417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283b124-4fa3-4e97-ba2c-949f634822fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:11.959839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283b124-4fa3-4e97-ba2c-949f634822fd admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:11.960950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283b124-4fa3-4e97-ba2c-949f634822fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:11.963507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283b124-4fa3-4e97-ba2c-949f634822fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:12.026903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec10abd-f17c-47a9-be03-55fe0100fe1e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:12.040438 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2481/4958] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:11 2021] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:12.044825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec10abd-f17c-47a9-be03-55fe0100fe1e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:12.052326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e92ad-55eb-4ec0-9d26-c9e18f2274fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:12.053605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e92ad-55eb-4ec0-9d26-c9e18f2274fe admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:12.054699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e92ad-55eb-4ec0-9d26-c9e18f2274fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:12.055735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e92ad-55eb-4ec0-9d26-c9e18f2274fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:12.056856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e92ad-55eb-4ec0-9d26-c9e18f2274fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:12.059889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e92ad-55eb-4ec0-9d26-c9e18f2274fe admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:12.092956 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2478/4959] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:12 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:12.097809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283b124-4fa3-4e97-ba2c-949f634822fd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:12.113444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283b124-4fa3-4e97-ba2c-949f634822fd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:12.123428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a82159-b7b0-445d-905f-22306b72fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:12.126025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82159-b7b0-445d-905f-22306b72fc46 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:12.127010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82159-b7b0-445d-905f-22306b72fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:12.128182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82159-b7b0-445d-905f-22306b72fc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:12.129429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a82159-b7b0-445d-905f-22306b72fc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:12.132059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a82159-b7b0-445d-905f-22306b72fc46 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:12.150659 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2482/4960] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:12 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:12.153066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e92ad-55eb-4ec0-9d26-c9e18f2274fe admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:12.179480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e92ad-55eb-4ec0-9d26-c9e18f2274fe admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:12.185514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e018cf-5817-4f09-a8e8-fbf5f01ee440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:12.188078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e018cf-5817-4f09-a8e8-fbf5f01ee440 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:12.188524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e018cf-5817-4f09-a8e8-fbf5f01ee440 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:12.188957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e018cf-5817-4f09-a8e8-fbf5f01ee440 admin admin] PATH_INFO: `/v3/projects/d82a8ba38cc14a60a7f31da27fbe51c5/users/a7529c001446490f9f567cad2a5cc8b8/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:12.215644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e018cf-5817-4f09-a8e8-fbf5f01ee440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82a8ba38cc14a60a7f31da27fbe51c5, user_id=a7529c001446490f9f567cad2a5cc8b8, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:12.222103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e018cf-5817-4f09-a8e8-fbf5f01ee440 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:12.256713 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2479/4961] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:12 2021] PUT /identity/v3/projects/d82a8ba38cc14a60a7f31da27fbe51c5/users/a7529c001446490f9f567cad2a5cc8b8/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:12.270573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab522d2-e3c1-4204-9862-c8b1b76b38dd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:12.272679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab522d2-e3c1-4204-9862-c8b1b76b38dd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:12.273193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab522d2-e3c1-4204-9862-c8b1b76b38dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:12.385390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3ab522d2-e3c1-4204-9862-c8b1b76b38dd None None] MFA Rules not processed for user `a7529c001446490f9f567cad2a5cc8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:12.390730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3ab522d2-e3c1-4204-9862-c8b1b76b38dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:12.552110 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2483/4962] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:12 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:12.561976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e018cf-5817-4f09-a8e8-fbf5f01ee440 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:12.563898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b5e018cf-5817-4f09-a8e8-fbf5f01ee440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:12.655813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e018cf-5817-4f09-a8e8-fbf5f01ee440 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:12.661129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c80eb-f688-41a6-8de1-fe16cd426422 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:12.661785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c80eb-f688-41a6-8de1-fe16cd426422 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:12.662071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c80eb-f688-41a6-8de1-fe16cd426422 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:12.662492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c80eb-f688-41a6-8de1-fe16cd426422 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:12.674414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c80eb-f688-41a6-8de1-fe16cd426422 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:12.677303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c80eb-f688-41a6-8de1-fe16cd426422 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:12.691647 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2480/4963] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:12 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:13.085400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab522d2-e3c1-4204-9862-c8b1b76b38dd None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:13.211020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab522d2-e3c1-4204-9862-c8b1b76b38dd None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:13.216822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:13.218649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:13.219132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:13.219529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] PATH_INFO: `/v3/users/a7529c001446490f9f567cad2a5cc8b8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:13.222003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7529c001446490f9f567cad2a5cc8b8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:13.224826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:13.300901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7529c001446490f9f567cad2a5cc8b8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:13.302820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7529c001446490f9f567cad2a5cc8b8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:13.313686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7529c001446490f9f567cad2a5cc8b8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:13.315312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7529c001446490f9f567cad2a5cc8b8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:13.329471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7529c001446490f9f567cad2a5cc8b8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:13.360516 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2484/4964] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:13 2021] DELETE /identity/v3/users/a7529c001446490f9f567cad2a5cc8b8 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:13.365531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3872e-7fd1-4fe1-aca4-c9e98f5cac96 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:13.365850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3872e-7fd1-4fe1-aca4-c9e98f5cac96 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:13.366279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3872e-7fd1-4fe1-aca4-c9e98f5cac96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:13.426448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-dda3872e-7fd1-4fe1-aca4-c9e98f5cac96 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:13.430210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dda3872e-7fd1-4fe1-aca4-c9e98f5cac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:13.550869 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2481/4965] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:13.563386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:13.565404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:13.665247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bb118-ab23-4321-bce3-6d31686df9a9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:13.672518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc081d-052d-4b72-b460-bc62894a625f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:13.673240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc081d-052d-4b72-b460-bc62894a625f service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:13.674089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc081d-052d-4b72-b460-bc62894a625f service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:13.674304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc081d-052d-4b72-b460-bc62894a625f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:13.688631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc081d-052d-4b72-b460-bc62894a625f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:13.691711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc081d-052d-4b72-b460-bc62894a625f service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:13.709676 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2485/4966] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:14.256628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3872e-7fd1-4fe1-aca4-c9e98f5cac96 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:14.258056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dda3872e-7fd1-4fe1-aca4-c9e98f5cac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:14.271829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3872e-7fd1-4fe1-aca4-c9e98f5cac96 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:14.278932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:14.280266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:14.280761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:14.281411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] PATH_INFO: `/v3/projects/d82a8ba38cc14a60a7f31da27fbe51c5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:14.284082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82a8ba38cc14a60a7f31da27fbe51c5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:14.286091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:14.342546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82a8ba38cc14a60a7f31da27fbe51c5', 'request_id': 'req-4a6fe98a-c63d-4abd-b6dc-45b88a960964'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:14.355751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82a8ba38cc14a60a7f31da27fbe51c5', 'request_id': 'req-4a6fe98a-c63d-4abd-b6dc-45b88a960964'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:14.373434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82a8ba38cc14a60a7f31da27fbe51c5', 'request_id': 'req-4a6fe98a-c63d-4abd-b6dc-45b88a960964'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:14.394250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] The token cache is being invalidate because project d82a8ba38cc14a60a7f31da27fbe51c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:14.394548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:14.395220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4a6fe98a-c63d-4abd-b6dc-45b88a960964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:14.398218 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2482/4967] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:14 2021] DELETE /identity/v3/projects/d82a8ba38cc14a60a7f31da27fbe51c5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:14.403976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8025-dccf-4a4e-88ea-744606769b4a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:14.404488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8025-dccf-4a4e-88ea-744606769b4a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:14.404956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c8025-dccf-4a4e-88ea-744606769b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:14.465345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cc0c8025-dccf-4a4e-88ea-744606769b4a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:14.467413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cc0c8025-dccf-4a4e-88ea-744606769b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:14.583672 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2486/4968] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:00:14.586917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf187c-c5b6-4120-91a1-74061e05586b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:14.587162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf187c-c5b6-4120-91a1-74061e05586b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:14.587454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf187c-c5b6-4120-91a1-74061e05586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:14.629591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3fdf187c-c5b6-4120-91a1-74061e05586b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:14.630839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3fdf187c-c5b6-4120-91a1-74061e05586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:14.648788 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2483/4969] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:14.653819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c8025-dccf-4a4e-88ea-744606769b4a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:14.673069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c8025-dccf-4a4e-88ea-744606769b4a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:14.680856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769395a4-1a83-467e-a1d4-8422abff1ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:14.682030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769395a4-1a83-467e-a1d4-8422abff1ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:14.683728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769395a4-1a83-467e-a1d4-8422abff1ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:14.684288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769395a4-1a83-467e-a1d4-8422abff1ff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:14.686066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769395a4-1a83-467e-a1d4-8422abff1ff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:14.686543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769395a4-1a83-467e-a1d4-8422abff1ff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:14.688288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769395a4-1a83-467e-a1d4-8422abff1ff4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:14.704607 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2487/4970] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:00:14.709490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf187c-c5b6-4120-91a1-74061e05586b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:14.732239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf187c-c5b6-4120-91a1-74061e05586b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:14.740064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675e086-172f-4361-a4cb-79a27eecf068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:14.741088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e086-172f-4361-a4cb-79a27eecf068 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:14.741580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e086-172f-4361-a4cb-79a27eecf068 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:14.742035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e086-172f-4361-a4cb-79a27eecf068 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:14.743119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675e086-172f-4361-a4cb-79a27eecf068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:14.745467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675e086-172f-4361-a4cb-79a27eecf068 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:14.785164 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2484/4971] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:14 2021] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:14.789962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769395a4-1a83-467e-a1d4-8422abff1ff4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:14.803709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769395a4-1a83-467e-a1d4-8422abff1ff4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:14.878714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678a002-ca4e-4c1e-b6c5-0111966d96ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:14.879459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678a002-ca4e-4c1e-b6c5-0111966d96ff admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:14.879939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678a002-ca4e-4c1e-b6c5-0111966d96ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:14.880216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678a002-ca4e-4c1e-b6c5-0111966d96ff admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:14.880924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678a002-ca4e-4c1e-b6c5-0111966d96ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:14.883544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678a002-ca4e-4c1e-b6c5-0111966d96ff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:14.905146 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2488/4972] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:14 2021] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:14.909484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675e086-172f-4361-a4cb-79a27eecf068 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:14.920149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675e086-172f-4361-a4cb-79a27eecf068 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:14.925215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86085189-1525-4c81-a324-74441750eba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:14.925916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085189-1525-4c81-a324-74441750eba2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:14.926524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085189-1525-4c81-a324-74441750eba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:14.926670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085189-1525-4c81-a324-74441750eba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:14.927684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86085189-1525-4c81-a324-74441750eba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:14.929332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86085189-1525-4c81-a324-74441750eba2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:14.951855 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2485/4973] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:14 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:14.952844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678a002-ca4e-4c1e-b6c5-0111966d96ff admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:14.967477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678a002-ca4e-4c1e-b6c5-0111966d96ff admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:14.976123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b3f9c-f9dd-4090-ab18-e66026970083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:14.977258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3f9c-f9dd-4090-ab18-e66026970083 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:14.977867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3f9c-f9dd-4090-ab18-e66026970083 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:14.978900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3f9c-f9dd-4090-ab18-e66026970083 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:14.979989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3f9c-f9dd-4090-ab18-e66026970083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:14.982178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3f9c-f9dd-4090-ab18-e66026970083 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:14.995855 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2489/4974] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:14 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:15.000668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86085189-1525-4c81-a324-74441750eba2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:15.015611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86085189-1525-4c81-a324-74441750eba2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:15.024654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b011e-7145-48f0-850b-dde5c22e4b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:15.025632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b011e-7145-48f0-850b-dde5c22e4b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:15.025987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b011e-7145-48f0-850b-dde5c22e4b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:15.026357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b011e-7145-48f0-850b-dde5c22e4b6f admin admin] PATH_INFO: `/v3/projects/688483094d4e4ec5b516f785f99bec1a/users/c90dc3bf411843aa88c422b9c5568eea/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:15.043455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b011e-7145-48f0-850b-dde5c22e4b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=688483094d4e4ec5b516f785f99bec1a, user_id=c90dc3bf411843aa88c422b9c5568eea, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:15.046198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b011e-7145-48f0-850b-dde5c22e4b6f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:15.062004 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2486/4975] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:14 2021] PUT /identity/v3/projects/688483094d4e4ec5b516f785f99bec1a/users/c90dc3bf411843aa88c422b9c5568eea/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:15.075206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd497d-496c-4c98-8a97-cc060748385e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:15.075731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd497d-496c-4c98-8a97-cc060748385e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:15.075884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd497d-496c-4c98-8a97-cc060748385e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:15.106717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d9fd497d-496c-4c98-8a97-cc060748385e None None] MFA Rules not processed for user `c90dc3bf411843aa88c422b9c5568eea`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:15.108151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d9fd497d-496c-4c98-8a97-cc060748385e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:15.179330 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2490/4976] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:15 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:15.190631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b011e-7145-48f0-850b-dde5c22e4b6f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:15.193146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ce2b011e-7145-48f0-850b-dde5c22e4b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:15.255597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b011e-7145-48f0-850b-dde5c22e4b6f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:15.259698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e34236-4081-44ce-94f7-332bf441363b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:15.260465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e34236-4081-44ce-94f7-332bf441363b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:15.260608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e34236-4081-44ce-94f7-332bf441363b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:15.260882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e34236-4081-44ce-94f7-332bf441363b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:15.270927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e34236-4081-44ce-94f7-332bf441363b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:15.272500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e34236-4081-44ce-94f7-332bf441363b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:15.283822 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2487/4977] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:15 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:22.993343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ea2b-1cb6-43d9-a4db-e6ba458563b8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:22.993941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ea2b-1cb6-43d9-a4db-e6ba458563b8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:22.993941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0ea2b-1cb6-43d9-a4db-e6ba458563b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:23.024252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-68e0ea2b-1cb6-43d9-a4db-e6ba458563b8 None None] MFA Rules not processed for user `ed87ef17973a49f2a9108bdfbff65415`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:23.025490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-68e0ea2b-1cb6-43d9-a4db-e6ba458563b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:23.095889 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2491/4978] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:22 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:27.300223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e34236-4081-44ce-94f7-332bf441363b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:27.305813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-60e34236-4081-44ce-94f7-332bf441363b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:27.387213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e34236-4081-44ce-94f7-332bf441363b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:27.395217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:27.396648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:27.398028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:27.398335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] PATH_INFO: `/v3/users/a210268fa0e8425399936ee0d3eea7a4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:27.401807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a210268fa0e8425399936ee0d3eea7a4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:27.404274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:27.511282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a210268fa0e8425399936ee0d3eea7a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:27.522281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a210268fa0e8425399936ee0d3eea7a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:27.523012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a210268fa0e8425399936ee0d3eea7a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:27.532897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a210268fa0e8425399936ee0d3eea7a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:27.547725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a210268fa0e8425399936ee0d3eea7a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:27.561215 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2488/4979] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:27 2021] DELETE /identity/v3/users/a210268fa0e8425399936ee0d3eea7a4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:27.566133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd66b22-2999-47c9-abae-15bb17db3f49 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:27.566613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd66b22-2999-47c9-abae-15bb17db3f49 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:27.566702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd66b22-2999-47c9-abae-15bb17db3f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:27.604374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9dd66b22-2999-47c9-abae-15bb17db3f49 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:27.606812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9dd66b22-2999-47c9-abae-15bb17db3f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:27.715846 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2492/4980] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:27.737919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:27.739515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:27.764424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd66b22-2999-47c9-abae-15bb17db3f49 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:27.766383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9dd66b22-2999-47c9-abae-15bb17db3f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:27.780590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd66b22-2999-47c9-abae-15bb17db3f49 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:27.785961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:27.786823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:27.787105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:27.787412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] PATH_INFO: `/v3/users/c90dc3bf411843aa88c422b9c5568eea` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:27.788686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90dc3bf411843aa88c422b9c5568eea)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:27.790627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:27.827203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1442a8-a4c4-4131-96a6-ea85f47fa4c6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:27.833661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3bed7-68e8-4135-bb10-f41a5500f1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:27.834769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3bed7-68e8-4135-bb10-f41a5500f1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:27.835439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3bed7-68e8-4135-bb10-f41a5500f1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:27.835938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3bed7-68e8-4135-bb10-f41a5500f1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:27.843018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90dc3bf411843aa88c422b9c5568eea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:27.843992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90dc3bf411843aa88c422b9c5568eea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:27.849080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3bed7-68e8-4135-bb10-f41a5500f1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:27.851754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3bed7-68e8-4135-bb10-f41a5500f1c8 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:27.858085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90dc3bf411843aa88c422b9c5568eea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:27.859120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90dc3bf411843aa88c422b9c5568eea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:27.867996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90dc3bf411843aa88c422b9c5568eea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:27.872480 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2489/4981] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:27.889477 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2493/4982] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:27 2021] DELETE /identity/v3/users/c90dc3bf411843aa88c422b9c5568eea => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:27.894803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d3a8-f8ba-4085-9906-521cf51e8ab9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:27.895355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d3a8-f8ba-4085-9906-521cf51e8ab9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:27.895740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5d3a8-f8ba-4085-9906-521cf51e8ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:27.915826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cff5d3a8-f8ba-4085-9906-521cf51e8ab9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:27.917185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cff5d3a8-f8ba-4085-9906-521cf51e8ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:27.993050 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2490/4983] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:00:28.004019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:28.006059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:28.146661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25418b-a71b-423e-a7fd-6117264417bc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:28.165184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac48c5-1066-4517-8338-6d18c74af816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:28.166077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac48c5-1066-4517-8338-6d18c74af816 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:28.166416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac48c5-1066-4517-8338-6d18c74af816 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:28.166789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac48c5-1066-4517-8338-6d18c74af816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:28.187594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac48c5-1066-4517-8338-6d18c74af816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:28.192153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac48c5-1066-4517-8338-6d18c74af816 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:28.216904 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2494/4984] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:28.413872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5d3a8-f8ba-4085-9906-521cf51e8ab9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:28.416104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cff5d3a8-f8ba-4085-9906-521cf51e8ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:28.433376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5d3a8-f8ba-4085-9906-521cf51e8ab9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:28.439848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:28.452218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:28.453971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:28.455386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] PATH_INFO: `/v3/projects/ff57a16edd1243ee81deda551a2c5e5a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:28.462467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff57a16edd1243ee81deda551a2c5e5a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:28.471667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:28.581397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff57a16edd1243ee81deda551a2c5e5a', 'request_id': 'req-f25beecb-473a-4f01-acc7-490df2289b4c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:28.593077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff57a16edd1243ee81deda551a2c5e5a', 'request_id': 'req-f25beecb-473a-4f01-acc7-490df2289b4c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:28.615827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff57a16edd1243ee81deda551a2c5e5a', 'request_id': 'req-f25beecb-473a-4f01-acc7-490df2289b4c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:28.640297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] The token cache is being invalidate because project ff57a16edd1243ee81deda551a2c5e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:28.640867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:28.642990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:28.654435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1d386-4622-4266-97d5-014b8fae4645 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:28.655204 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2491/4985] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:28 2021] DELETE /identity/v3/projects/ff57a16edd1243ee81deda551a2c5e5a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:28.655356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1d386-4622-4266-97d5-014b8fae4645 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:28.655356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1d386-4622-4266-97d5-014b8fae4645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:28.693764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4cd1d386-4622-4266-97d5-014b8fae4645 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:28.695388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4cd1d386-4622-4266-97d5-014b8fae4645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:28.747466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:28.757765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:28.808388 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2495/4986] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:00:28.817404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ee3df-89db-4bb4-82e1-366890f46303 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:28.818005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ee3df-89db-4bb4-82e1-366890f46303 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:28.821178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ee3df-89db-4bb4-82e1-366890f46303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:28.868061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8e8ee3df-89db-4bb4-82e1-366890f46303 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:28.869366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8e8ee3df-89db-4bb4-82e1-366890f46303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:28.880115 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2496/4987] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:28.883859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ee3df-89db-4bb4-82e1-366890f46303 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:28.895667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ee3df-89db-4bb4-82e1-366890f46303 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:28.901329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6183e0-ff70-48b8-b895-ea5651c8028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:28.902157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6183e0-ff70-48b8-b895-ea5651c8028a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:28.902397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25beecb-473a-4f01-acc7-490df2289b4c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:28.902530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6183e0-ff70-48b8-b895-ea5651c8028a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:28.902806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6183e0-ff70-48b8-b895-ea5651c8028a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:28.903596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6183e0-ff70-48b8-b895-ea5651c8028a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:28.904083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6183e0-ff70-48b8-b895-ea5651c8028a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:28.906172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6183e0-ff70-48b8-b895-ea5651c8028a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:28.909730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:28.910797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:28.911342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:28.911838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] PATH_INFO: `/v3/projects/688483094d4e4ec5b516f785f99bec1a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:28.914002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688483094d4e4ec5b516f785f99bec1a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:28.916278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:28.921732 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2497/4988] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:28.928168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6183e0-ff70-48b8-b895-ea5651c8028a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:28.949986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6183e0-ff70-48b8-b895-ea5651c8028a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:28.958275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cda4a0-9f3d-490b-90e3-73b41f463cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:28.959144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda4a0-9f3d-490b-90e3-73b41f463cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:28.959461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda4a0-9f3d-490b-90e3-73b41f463cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:28.959793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cda4a0-9f3d-490b-90e3-73b41f463cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:28.962071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cda4a0-9f3d-490b-90e3-73b41f463cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:28.965397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cda4a0-9f3d-490b-90e3-73b41f463cf1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:28.982752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688483094d4e4ec5b516f785f99bec1a', 'request_id': 'req-6364632a-c237-41db-9fd2-ccfe124d7ac5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:28.997634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688483094d4e4ec5b516f785f99bec1a', 'request_id': 'req-6364632a-c237-41db-9fd2-ccfe124d7ac5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:29.007949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688483094d4e4ec5b516f785f99bec1a', 'request_id': 'req-6364632a-c237-41db-9fd2-ccfe124d7ac5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:29.023496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] The token cache is being invalidate because project 688483094d4e4ec5b516f785f99bec1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:29.023901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:29.024677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6364632a-c237-41db-9fd2-ccfe124d7ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:29.032900 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2492/4989] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:28 2021] DELETE /identity/v3/projects/688483094d4e4ec5b516f785f99bec1a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:29.034965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1bb0-8b17-4562-a826-5e695270581c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.035564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1bb0-8b17-4562-a826-5e695270581c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.036074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1bb0-8b17-4562-a826-5e695270581c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.054311 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2498/4990] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:28 2021] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:29.055380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cda4a0-9f3d-490b-90e3-73b41f463cf1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:29.058393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-73cda4a0-9f3d-490b-90e3-73b41f463cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:29.091918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cffa1bb0-8b17-4562-a826-5e695270581c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:29.093491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cffa1bb0-8b17-4562-a826-5e695270581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:29.227478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cda4a0-9f3d-490b-90e3-73b41f463cf1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:29.235048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad9c21-b2e7-4de4-a45e-cbff28f72833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:29.236478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad9c21-b2e7-4de4-a45e-cbff28f72833 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.236758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad9c21-b2e7-4de4-a45e-cbff28f72833 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.237030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad9c21-b2e7-4de4-a45e-cbff28f72833 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.243321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad9c21-b2e7-4de4-a45e-cbff28f72833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:29.243543 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2493/4991] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:29.243543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1bb0-8b17-4562-a826-5e695270581c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:29.243730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad9c21-b2e7-4de4-a45e-cbff28f72833 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:29.246935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cffa1bb0-8b17-4562-a826-5e695270581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:29.264323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1bb0-8b17-4562-a826-5e695270581c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:29.270045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:29.270908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.271186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.271487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] PATH_INFO: `/v3/users/95f97f2e1958406b9dc0f258aa5a3f42` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.273021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f97f2e1958406b9dc0f258aa5a3f42)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:29.274992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:29.286955 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2499/4992] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:29 2021] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:29.289401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d03c-6018-4a29-a84c-50731d4721d7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.290002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d03c-6018-4a29-a84c-50731d4721d7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.290291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d03c-6018-4a29-a84c-50731d4721d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.332922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c1e0d03c-6018-4a29-a84c-50731d4721d7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:29.335292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c1e0d03c-6018-4a29-a84c-50731d4721d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:29.360086 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2500/4993] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:29.362967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0d03c-6018-4a29-a84c-50731d4721d7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:29.363541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f97f2e1958406b9dc0f258aa5a3f42'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:29.382067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f97f2e1958406b9dc0f258aa5a3f42'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:29.383154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f97f2e1958406b9dc0f258aa5a3f42'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:29.386248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0d03c-6018-4a29-a84c-50731d4721d7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:29.397526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f97f2e1958406b9dc0f258aa5a3f42'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:29.401276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccc049-b93b-4e86-9e68-737e8ce008b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:29.401276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccc049-b93b-4e86-9e68-737e8ce008b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.401276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccc049-b93b-4e86-9e68-737e8ce008b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.401276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccc049-b93b-4e86-9e68-737e8ce008b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.401947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccc049-b93b-4e86-9e68-737e8ce008b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:29.404567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ccc049-b93b-4e86-9e68-737e8ce008b3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:29.423816 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2501/4994] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:29 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:29.423816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccc049-b93b-4e86-9e68-737e8ce008b3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:29.426376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-84ccc049-b93b-4e86-9e68-737e8ce008b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:29.428143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f97f2e1958406b9dc0f258aa5a3f42'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:29.439481 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2494/4995] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:29 2021] DELETE /identity/v3/users/95f97f2e1958406b9dc0f258aa5a3f42 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:29.440853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:29.443786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:29.455989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ccc049-b93b-4e86-9e68-737e8ce008b3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:29.531597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06ce20-c15d-463d-b615-3984a7bc0bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:29.533185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06ce20-c15d-463d-b615-3984a7bc0bca admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.533576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06ce20-c15d-463d-b615-3984a7bc0bca admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.534609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06ce20-c15d-463d-b615-3984a7bc0bca admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.535634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06ce20-c15d-463d-b615-3984a7bc0bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:29.536855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06ce20-c15d-463d-b615-3984a7bc0bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:29.539300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06ce20-c15d-463d-b615-3984a7bc0bca admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:29.546376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4109f97-3ef4-4019-a158-5bb5f775c6f2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:29.556868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2af2d-16e6-4f7c-a675-3dc352f87b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:29.557825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2af2d-16e6-4f7c-a675-3dc352f87b2e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.558315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2af2d-16e6-4f7c-a675-3dc352f87b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.558982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2af2d-16e6-4f7c-a675-3dc352f87b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.560229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2af2d-16e6-4f7c-a675-3dc352f87b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:29.560854 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2502/4996] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:29.562018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06ce20-c15d-463d-b615-3984a7bc0bca admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:29.562635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2af2d-16e6-4f7c-a675-3dc352f87b2e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:29.564245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9c06ce20-c15d-463d-b615-3984a7bc0bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:29.589349 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2495/4997] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:29 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:29.589349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2af2d-16e6-4f7c-a675-3dc352f87b2e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:29.615019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2af2d-16e6-4f7c-a675-3dc352f87b2e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:29.628585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ade393-8e62-4e2a-9ea7-d919f597373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:29.628959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade393-8e62-4e2a-9ea7-d919f597373d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.629500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade393-8e62-4e2a-9ea7-d919f597373d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.629500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ade393-8e62-4e2a-9ea7-d919f597373d admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.632085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ade393-8e62-4e2a-9ea7-d919f597373d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:29.636768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ade393-8e62-4e2a-9ea7-d919f597373d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:29.695832 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2496/4998] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:29 2021] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:29.701284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ade393-8e62-4e2a-9ea7-d919f597373d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:29.702787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06ce20-c15d-463d-b615-3984a7bc0bca admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:29.825181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d07dc-6331-42a1-b136-cf5d06528818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:29.826195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d07dc-6331-42a1-b136-cf5d06528818 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.826551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d07dc-6331-42a1-b136-cf5d06528818 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.826995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d07dc-6331-42a1-b136-cf5d06528818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.831010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-213d07dc-6331-42a1-b136-cf5d06528818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:29.840579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ade393-8e62-4e2a-9ea7-d919f597373d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:29.846425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645b58a-00de-45aa-ac94-ca4b6355a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:29.847396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b58a-00de-45aa-ac94-ca4b6355a0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.847682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b58a-00de-45aa-ac94-ca4b6355a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.847957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b58a-00de-45aa-ac94-ca4b6355a0b4 admin admin] PATH_INFO: `/v3/projects/b6a3bed9e5a446f8be1cc46379c8d6cf/users/35ea265617514acf975eabf53058c19f/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.864780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645b58a-00de-45aa-ac94-ca4b6355a0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a3bed9e5a446f8be1cc46379c8d6cf, user_id=35ea265617514acf975eabf53058c19f, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:29.867355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645b58a-00de-45aa-ac94-ca4b6355a0b4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:29.885729 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2497/4999] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:29 2021] PUT /identity/v3/projects/b6a3bed9e5a446f8be1cc46379c8d6cf/users/35ea265617514acf975eabf53058c19f/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:29.886642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645b58a-00de-45aa-ac94-ca4b6355a0b4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:29.930604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d07dc-6331-42a1-b136-cf5d06528818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:29.932698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d07dc-6331-42a1-b136-cf5d06528818 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:29.948989 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2503/5000] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:29.950245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d07dc-6331-42a1-b136-cf5d06528818 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:29.952490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-213d07dc-6331-42a1-b136-cf5d06528818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:29.958944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645b58a-00de-45aa-ac94-ca4b6355a0b4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:29.966236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70aa5f3-646c-438c-a80d-d0d6c4de6e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:29.967081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aa5f3-646c-438c-a80d-d0d6c4de6e6c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.967518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aa5f3-646c-438c-a80d-d0d6c4de6e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.967876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70aa5f3-646c-438c-a80d-d0d6c4de6e6c admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.968679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70aa5f3-646c-438c-a80d-d0d6c4de6e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:29.970810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70aa5f3-646c-438c-a80d-d0d6c4de6e6c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:29.976962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d07dc-6331-42a1-b136-cf5d06528818 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:29.984237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:29.985540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:29.985994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:29.986500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] PATH_INFO: `/v3/projects/5399873bca254683bedebb5102a1b6e5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:29.987974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5399873bca254683bedebb5102a1b6e5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:29.990070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:30.000473 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2498/5001] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:29 2021] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:30.002801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ced9c8-dd24-4c60-ab21-963672029b9c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.003165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ced9c8-dd24-4c60-ab21-963672029b9c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.003874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ced9c8-dd24-4c60-ab21-963672029b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.042124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-61ced9c8-dd24-4c60-ab21-963672029b9c None None] MFA Rules not processed for user `35ea265617514acf975eabf53058c19f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:30.044460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-61ced9c8-dd24-4c60-ab21-963672029b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:30.074661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5399873bca254683bedebb5102a1b6e5', 'request_id': 'req-201d1270-110c-4876-95da-03a373bac21c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:30.082318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5399873bca254683bedebb5102a1b6e5', 'request_id': 'req-201d1270-110c-4876-95da-03a373bac21c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:30.104685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5399873bca254683bedebb5102a1b6e5', 'request_id': 'req-201d1270-110c-4876-95da-03a373bac21c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:30.119491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] The token cache is being invalidate because project 5399873bca254683bedebb5102a1b6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:30.120041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:30.120968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:30.130474 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2504/5002] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:29 2021] DELETE /identity/v3/projects/5399873bca254683bedebb5102a1b6e5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:30.131973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:30.139100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:30.141191 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2499/5003] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:30 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:30.143022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4358a-0139-4e43-855a-cf84357e4ac0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.143353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4358a-0139-4e43-855a-cf84357e4ac0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.143636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4358a-0139-4e43-855a-cf84357e4ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.167987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-88f4358a-0139-4e43-855a-cf84357e4ac0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:30.169702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-88f4358a-0139-4e43-855a-cf84357e4ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:30.263504 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2500/5004] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:30.269054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d1270-110c-4876-95da-03a373bac21c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:30.269510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4358a-0139-4e43-855a-cf84357e4ac0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:30.273722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-88f4358a-0139-4e43-855a-cf84357e4ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:30.280633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98f2b3-6a92-46ac-bc6a-c3366ca06aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:30.281940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98f2b3-6a92-46ac-bc6a-c3366ca06aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.282704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98f2b3-6a92-46ac-bc6a-c3366ca06aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.283202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98f2b3-6a92-46ac-bc6a-c3366ca06aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.284211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98f2b3-6a92-46ac-bc6a-c3366ca06aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:30.287260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98f2b3-6a92-46ac-bc6a-c3366ca06aa1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:30.315556 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2505/5005] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:30 2021] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:30.317295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1ce2-10bd-4be9-add5-8560f8f39f74 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.317582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1ce2-10bd-4be9-add5-8560f8f39f74 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.317862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a1ce2-10bd-4be9-add5-8560f8f39f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.352201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e18a1ce2-10bd-4be9-add5-8560f8f39f74 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:30.354372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e18a1ce2-10bd-4be9-add5-8560f8f39f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:30.365955 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2506/5006] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:30.367179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a1ce2-10bd-4be9-add5-8560f8f39f74 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:30.381294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a1ce2-10bd-4be9-add5-8560f8f39f74 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:30.389460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e13e86-6f3b-406f-b79f-e13082f3e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:30.390567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e13e86-6f3b-406f-b79f-e13082f3e943 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.391109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e13e86-6f3b-406f-b79f-e13082f3e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.391739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e13e86-6f3b-406f-b79f-e13082f3e943 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.392862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e13e86-6f3b-406f-b79f-e13082f3e943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:30.393030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4358a-0139-4e43-855a-cf84357e4ac0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:30.395726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e13e86-6f3b-406f-b79f-e13082f3e943 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:30.404396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afd341-62da-4e8a-9399-e1701061b952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:30.405159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afd341-62da-4e8a-9399-e1701061b952 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.406387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afd341-62da-4e8a-9399-e1701061b952 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.406763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afd341-62da-4e8a-9399-e1701061b952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.409705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-46afd341-62da-4e8a-9399-e1701061b952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:30.423554 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2507/5007] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:30 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:30.423554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e13e86-6f3b-406f-b79f-e13082f3e943 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:30.439078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e13e86-6f3b-406f-b79f-e13082f3e943 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:30.466482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71324b5-7e97-4956-ac5b-de4182cf1a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:30.467279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71324b5-7e97-4956-ac5b-de4182cf1a2b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.468256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71324b5-7e97-4956-ac5b-de4182cf1a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.468721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71324b5-7e97-4956-ac5b-de4182cf1a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.469571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71324b5-7e97-4956-ac5b-de4182cf1a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:30.471707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71324b5-7e97-4956-ac5b-de4182cf1a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:30.473439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71324b5-7e97-4956-ac5b-de4182cf1a2b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:30.495296 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2508/5008] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:30.502105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71324b5-7e97-4956-ac5b-de4182cf1a2b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:30.513706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afd341-62da-4e8a-9399-e1701061b952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:30.515577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afd341-62da-4e8a-9399-e1701061b952 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:30.518297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71324b5-7e97-4956-ac5b-de4182cf1a2b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:30.526103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ce6a-7308-4788-86a2-809d2c3b6656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:30.527063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ce6a-7308-4788-86a2-809d2c3b6656 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.527373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ce6a-7308-4788-86a2-809d2c3b6656 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.527654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ce6a-7308-4788-86a2-809d2c3b6656 admin admin] PATH_INFO: `/v3/projects/0244f189ab184335836dff9b74a0fcb6/users/90cfe912b1b841d8afa7c51dc387fc59/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.528193 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2501/5009] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:30 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:30.529254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afd341-62da-4e8a-9399-e1701061b952 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:30.543236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afd341-62da-4e8a-9399-e1701061b952 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:30.549831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a81a1f-e4cf-49c8-ab4e-a5782d2d7b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:30.550831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a81a1f-e4cf-49c8-ab4e-a5782d2d7b5c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.551415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a81a1f-e4cf-49c8-ab4e-a5782d2d7b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.551916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a81a1f-e4cf-49c8-ab4e-a5782d2d7b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.552933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a81a1f-e4cf-49c8-ab4e-a5782d2d7b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:30.555111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a81a1f-e4cf-49c8-ab4e-a5782d2d7b5c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:30.555637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298ce6a-7308-4788-86a2-809d2c3b6656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0244f189ab184335836dff9b74a0fcb6, user_id=90cfe912b1b841d8afa7c51dc387fc59, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:30.560753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298ce6a-7308-4788-86a2-809d2c3b6656 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:30.579835 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2509/5010] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:30 2021] PUT /identity/v3/projects/0244f189ab184335836dff9b74a0fcb6/users/90cfe912b1b841d8afa7c51dc387fc59/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:30.580997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ce6a-7308-4788-86a2-809d2c3b6656 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:30.596321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f298ce6a-7308-4788-86a2-809d2c3b6656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:30.609587 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2502/5011] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:30 2021] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:30.612037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01c96b-4ce4-4054-908a-8755cd7d2db0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.612480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01c96b-4ce4-4054-908a-8755cd7d2db0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.612941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01c96b-4ce4-4054-908a-8755cd7d2db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.643613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-eb01c96b-4ce4-4054-908a-8755cd7d2db0 None None] MFA Rules not processed for user `90cfe912b1b841d8afa7c51dc387fc59`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:30.645472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-eb01c96b-4ce4-4054-908a-8755cd7d2db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:30.682238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ce6a-7308-4788-86a2-809d2c3b6656 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:30.779220 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2503/5012] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:30 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:30.780392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01c96b-4ce4-4054-908a-8755cd7d2db0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:30.814493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:30.815504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.815793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.816066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] PATH_INFO: `/v3/users/35ea265617514acf975eabf53058c19f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.817411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ea265617514acf975eabf53058c19f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:30.819523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:30.874023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01c96b-4ce4-4054-908a-8755cd7d2db0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:30.878480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ea265617514acf975eabf53058c19f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:30.879157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ea265617514acf975eabf53058c19f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:30.882307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7409-2132-436c-b913-c37a933542fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:30.882915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7409-2132-436c-b913-c37a933542fd admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:30.883423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7409-2132-436c-b913-c37a933542fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:30.883561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7409-2132-436c-b913-c37a933542fd admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:30.884346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f7409-2132-436c-b913-c37a933542fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:30.887493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f7409-2132-436c-b913-c37a933542fd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:30.888527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ea265617514acf975eabf53058c19f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:30.889193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ea265617514acf975eabf53058c19f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:30.899843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ea265617514acf975eabf53058c19f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:30.920017 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2504/5013] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:30 2021] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:30.921796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7409-2132-436c-b913-c37a933542fd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:30.924669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-408f7409-2132-436c-b913-c37a933542fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:30.928808 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2510/5014] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:30 2021] DELETE /identity/v3/users/35ea265617514acf975eabf53058c19f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:30.929687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:30.931196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:31.012208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb180f6-dc56-43b8-9e10-25eb5c8c64c0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:31.017819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ede41-4e5c-4d5b-a12b-5ba0388d4273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:31.018503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ede41-4e5c-4d5b-a12b-5ba0388d4273 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:31.018786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ede41-4e5c-4d5b-a12b-5ba0388d4273 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:31.019172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ede41-4e5c-4d5b-a12b-5ba0388d4273 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:31.019326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7409-2132-436c-b913-c37a933542fd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:31.019946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ede41-4e5c-4d5b-a12b-5ba0388d4273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:31.022637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ede41-4e5c-4d5b-a12b-5ba0388d4273 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:31.038712 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2511/5015] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:30 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:31.038712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0fa5-b619-4611-b8ba-9f9920a0a42e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:31.038712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0fa5-b619-4611-b8ba-9f9920a0a42e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:31.038712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0fa5-b619-4611-b8ba-9f9920a0a42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:31.077746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6deb0fa5-b619-4611-b8ba-9f9920a0a42e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:31.079037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6deb0fa5-b619-4611-b8ba-9f9920a0a42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:31.101516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086756f-2283-4eeb-a189-dcca2cc28aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:31.102179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086756f-2283-4eeb-a189-dcca2cc28aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:31.102562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086756f-2283-4eeb-a189-dcca2cc28aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:31.103752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086756f-2283-4eeb-a189-dcca2cc28aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:31.103963 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2512/5016] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:31.104911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0fa5-b619-4611-b8ba-9f9920a0a42e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:31.106394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e086756f-2283-4eeb-a189-dcca2cc28aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:31.126051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb0fa5-b619-4611-b8ba-9f9920a0a42e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:31.134941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35f3b2-bb74-4678-88de-c209b05f9384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:31.135709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f3b2-bb74-4678-88de-c209b05f9384 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:31.136742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f3b2-bb74-4678-88de-c209b05f9384 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:31.136742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35f3b2-bb74-4678-88de-c209b05f9384 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:31.137118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35f3b2-bb74-4678-88de-c209b05f9384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:31.138869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35f3b2-bb74-4678-88de-c209b05f9384 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:31.159297 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2513/5017] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:31 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:31.160151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35f3b2-bb74-4678-88de-c209b05f9384 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:31.175127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35f3b2-bb74-4678-88de-c209b05f9384 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:31.179822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a263f1-6e81-4232-982f-17c7c822bdb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:31.180479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a263f1-6e81-4232-982f-17c7c822bdb3 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:31.180763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a263f1-6e81-4232-982f-17c7c822bdb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:31.181340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a263f1-6e81-4232-982f-17c7c822bdb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:31.193368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a263f1-6e81-4232-982f-17c7c822bdb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:31.195335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a263f1-6e81-4232-982f-17c7c822bdb3 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:31.206028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086756f-2283-4eeb-a189-dcca2cc28aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:31.208948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086756f-2283-4eeb-a189-dcca2cc28aa7 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:31.210655 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2514/5018] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:31.211519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a263f1-6e81-4232-982f-17c7c822bdb3 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:31.221583 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2505/5019] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:30 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:31.223691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a263f1-6e81-4232-982f-17c7c822bdb3 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:31.228905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061a22-c7ab-4556-8ca7-5957d77830d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:31.229795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061a22-c7ab-4556-8ca7-5957d77830d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:31.230163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061a22-c7ab-4556-8ca7-5957d77830d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:31.230338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061a22-c7ab-4556-8ca7-5957d77830d3 admin admin] PATH_INFO: `/v3/projects/5c6154b95627486fabf56181b0677854/users/8219c1813be141278d0693f04aec1fdd/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:31.251833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e061a22-c7ab-4556-8ca7-5957d77830d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6154b95627486fabf56181b0677854, user_id=8219c1813be141278d0693f04aec1fdd, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:31.255316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e061a22-c7ab-4556-8ca7-5957d77830d3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:31.272520 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2515/5020] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:31 2021] PUT /identity/v3/projects/5c6154b95627486fabf56181b0677854/users/8219c1813be141278d0693f04aec1fdd/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:31.283622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76bdaa-e567-47e6-9af3-b3056860a4d0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:31.284411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76bdaa-e567-47e6-9af3-b3056860a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:31.284784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76bdaa-e567-47e6-9af3-b3056860a4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:31.321990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cf76bdaa-e567-47e6-9af3-b3056860a4d0 None None] MFA Rules not processed for user `8219c1813be141278d0693f04aec1fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:31.324087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cf76bdaa-e567-47e6-9af3-b3056860a4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:31.416622 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2506/5021] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:31 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:00:31.421853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061a22-c7ab-4556-8ca7-5957d77830d3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:31.534876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061a22-c7ab-4556-8ca7-5957d77830d3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:31.539663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d73f33-a480-410d-bfcd-dc816039071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:31.540348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73f33-a480-410d-bfcd-dc816039071d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:31.540673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73f33-a480-410d-bfcd-dc816039071d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:31.541391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73f33-a480-410d-bfcd-dc816039071d admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:31.541673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d73f33-a480-410d-bfcd-dc816039071d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:31.543657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d73f33-a480-410d-bfcd-dc816039071d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:31.585557 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2516/5022] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:31 2021] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:31.589657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76bdaa-e567-47e6-9af3-b3056860a4d0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:31.615791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76bdaa-e567-47e6-9af3-b3056860a4d0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:31.729612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e306d-de3d-4ef6-a8c6-f9634ea134f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:31.730552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e306d-de3d-4ef6-a8c6-f9634ea134f5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:31.731137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e306d-de3d-4ef6-a8c6-f9634ea134f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:31.731620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e306d-de3d-4ef6-a8c6-f9634ea134f5 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:31.732356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e306d-de3d-4ef6-a8c6-f9634ea134f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:31.735778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e306d-de3d-4ef6-a8c6-f9634ea134f5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:31.839740 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2507/5023] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:31 2021] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:31.843012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d73f33-a480-410d-bfcd-dc816039071d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:31.870347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d73f33-a480-410d-bfcd-dc816039071d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:31.922175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bd10b-38f1-4545-be70-2275c92ba35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:31.922863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd10b-38f1-4545-be70-2275c92ba35c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:31.923151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd10b-38f1-4545-be70-2275c92ba35c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:31.925603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd10b-38f1-4545-be70-2275c92ba35c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:31.926383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bd10b-38f1-4545-be70-2275c92ba35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:31.934232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bd10b-38f1-4545-be70-2275c92ba35c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:31.984569 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2517/5024] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:31 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:31.989161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e306d-de3d-4ef6-a8c6-f9634ea134f5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:32.024705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e306d-de3d-4ef6-a8c6-f9634ea134f5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:32.039218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c56556-cfac-496a-bc01-364350990a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:32.040418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56556-cfac-496a-bc01-364350990a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:32.041584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56556-cfac-496a-bc01-364350990a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:32.042583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c56556-cfac-496a-bc01-364350990a91 admin admin] PATH_INFO: `/v3/projects/c3b5a4bb8bbe45418e21240263324dce/users/55271dce23624e51bb764471b094475b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:32.082929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c56556-cfac-496a-bc01-364350990a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b5a4bb8bbe45418e21240263324dce, user_id=55271dce23624e51bb764471b094475b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:32.089634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c56556-cfac-496a-bc01-364350990a91 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:32.123724 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2508/5025] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:31 2021] PUT /identity/v3/projects/c3b5a4bb8bbe45418e21240263324dce/users/55271dce23624e51bb764471b094475b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:32.127093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bd10b-38f1-4545-be70-2275c92ba35c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:32.140173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bd10b-38f1-4545-be70-2275c92ba35c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:32.214754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c56556-cfac-496a-bc01-364350990a91 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:32.216761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a0c56556-cfac-496a-bc01-364350990a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:32.279918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf621b-1135-4a99-9531-9ae9cbf40207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:32.280076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf621b-1135-4a99-9531-9ae9cbf40207 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:32.280333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf621b-1135-4a99-9531-9ae9cbf40207 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:32.280598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf621b-1135-4a99-9531-9ae9cbf40207 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:32.281499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf621b-1135-4a99-9531-9ae9cbf40207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:32.298888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf621b-1135-4a99-9531-9ae9cbf40207 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:32.310391 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2518/5026] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:32 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:32.315780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf621b-1135-4a99-9531-9ae9cbf40207 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:32.328215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf621b-1135-4a99-9531-9ae9cbf40207 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:32.333246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c56556-cfac-496a-bc01-364350990a91 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:32.338960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670db333-026b-4147-8663-0486120109ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:32.340399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670db333-026b-4147-8663-0486120109ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:32.340399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670db333-026b-4147-8663-0486120109ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:32.340917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670db333-026b-4147-8663-0486120109ac admin admin] PATH_INFO: `/v3/projects/b6a3bed9e5a446f8be1cc46379c8d6cf` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:32.342432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670db333-026b-4147-8663-0486120109ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a3bed9e5a446f8be1cc46379c8d6cf)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:32.344502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670db333-026b-4147-8663-0486120109ac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:32.345634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829b8f6-524a-4e61-93fd-c3bcc2c67792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:32.346617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829b8f6-524a-4e61-93fd-c3bcc2c67792 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:32.347319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829b8f6-524a-4e61-93fd-c3bcc2c67792 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:32.347319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829b8f6-524a-4e61-93fd-c3bcc2c67792 admin admin] PATH_INFO: `/v3/projects/c3b5a4bb8bbe45418e21240263324dce/users/55271dce23624e51bb764471b094475b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:32.350714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829b8f6-524a-4e61-93fd-c3bcc2c67792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b5a4bb8bbe45418e21240263324dce, user_id=55271dce23624e51bb764471b094475b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:32.353454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829b8f6-524a-4e61-93fd-c3bcc2c67792 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:32.370145 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2519/5027] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:32 2021] PUT /identity/v3/projects/c3b5a4bb8bbe45418e21240263324dce/users/55271dce23624e51bb764471b094475b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:32.392533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e7240-a66e-4ba5-84cd-d05ffcfea353 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:32.392916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e7240-a66e-4ba5-84cd-d05ffcfea353 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:32.393213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e7240-a66e-4ba5-84cd-d05ffcfea353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:32.463029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670db333-026b-4147-8663-0486120109ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a3bed9e5a446f8be1cc46379c8d6cf', 'request_id': 'req-670db333-026b-4147-8663-0486120109ac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:32.482437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-864e7240-a66e-4ba5-84cd-d05ffcfea353 None None] MFA Rules not processed for user `55271dce23624e51bb764471b094475b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:32.483362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670db333-026b-4147-8663-0486120109ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a3bed9e5a446f8be1cc46379c8d6cf', 'request_id': 'req-670db333-026b-4147-8663-0486120109ac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:32.486344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-864e7240-a66e-4ba5-84cd-d05ffcfea353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:32.502548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670db333-026b-4147-8663-0486120109ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a3bed9e5a446f8be1cc46379c8d6cf', 'request_id': 'req-670db333-026b-4147-8663-0486120109ac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:32.528161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670db333-026b-4147-8663-0486120109ac admin admin] The token cache is being invalidate because project b6a3bed9e5a446f8be1cc46379c8d6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:32.531553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670db333-026b-4147-8663-0486120109ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:32.533843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670db333-026b-4147-8663-0486120109ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:32.544913 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2509/5028] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:32 2021] DELETE /identity/v3/projects/b6a3bed9e5a446f8be1cc46379c8d6cf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:32.548151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfa85-74c5-4927-a204-9b3cbc87e915 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:32.549143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfa85-74c5-4927-a204-9b3cbc87e915 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:32.549971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfa85-74c5-4927-a204-9b3cbc87e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:32.665514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-79ccfa85-74c5-4927-a204-9b3cbc87e915 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:32.673396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-79ccfa85-74c5-4927-a204-9b3cbc87e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:32.676954 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2520/5029] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:32 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:32.682785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e7240-a66e-4ba5-84cd-d05ffcfea353 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:32.754406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e7240-a66e-4ba5-84cd-d05ffcfea353 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:32.772581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d09d9-c25d-4ac7-8e2e-8e52065a8742 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55271dce23624e51bb764471b094475b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b5a4bb8bbe45418e21240263324dce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:32.773365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d09d9-c25d-4ac7-8e2e-8e52065a8742 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:32.773559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d09d9-c25d-4ac7-8e2e-8e52065a8742 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:32.773841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d09d9-c25d-4ac7-8e2e-8e52065a8742 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:32.774608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d09d9-c25d-4ac7-8e2e-8e52065a8742 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:32.784026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d09d9-c25d-4ac7-8e2e-8e52065a8742 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:32.831102 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2521/5030] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 21:00:32 2021] POST /identity/v3/domains => generated 246 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:32.832656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d09d9-c25d-4ac7-8e2e-8e52065a8742 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:32.847229 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2510/5031] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:32.850698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3c42e-1470-47ab-85cc-401ef809c571 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:32.851610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3c42e-1470-47ab-85cc-401ef809c571 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:32.852705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3c42e-1470-47ab-85cc-401ef809c571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:32.893742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-efd3c42e-1470-47ab-85cc-401ef809c571 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:32.896386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-efd3c42e-1470-47ab-85cc-401ef809c571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:32.931791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d09d9-c25d-4ac7-8e2e-8e52065a8742 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:32.938253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954a273-27e8-437b-995a-3daf550b4c7f tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55271dce23624e51bb764471b094475b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b5a4bb8bbe45418e21240263324dce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:32.939454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954a273-27e8-437b-995a-3daf550b4c7f tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:32.940261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954a273-27e8-437b-995a-3daf550b4c7f tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:32.940543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954a273-27e8-437b-995a-3daf550b4c7f tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:32.941339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954a273-27e8-437b-995a-3daf550b4c7f tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:32.944118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954a273-27e8-437b-995a-3daf550b4c7f tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:32.998962 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2522/5032] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:32 2021] POST /identity/v3/projects => generated 408 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:33.006057 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2511/5033] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:33.006275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954a273-27e8-437b-995a-3daf550b4c7f tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.007168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3c42e-1470-47ab-85cc-401ef809c571 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.020048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3c42e-1470-47ab-85cc-401ef809c571 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:33.107922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954a273-27e8-437b-995a-3daf550b4c7f tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:33.115675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8e75e-f63d-4cea-827d-24c94d22b84b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55271dce23624e51bb764471b094475b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b5a4bb8bbe45418e21240263324dce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:33.116514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e75e-f63d-4cea-827d-24c94d22b84b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.117201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e75e-f63d-4cea-827d-24c94d22b84b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.117671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e75e-f63d-4cea-827d-24c94d22b84b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.121396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8e75e-f63d-4cea-827d-24c94d22b84b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:33.121900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8e75e-f63d-4cea-827d-24c94d22b84b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:33.124493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb68e9d-36a5-4c6b-8e19-4cfd7d3c1778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:33.125580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb68e9d-36a5-4c6b-8e19-4cfd7d3c1778 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.126737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb68e9d-36a5-4c6b-8e19-4cfd7d3c1778 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.127376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb68e9d-36a5-4c6b-8e19-4cfd7d3c1778 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.128331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb68e9d-36a5-4c6b-8e19-4cfd7d3c1778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:33.128805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb68e9d-36a5-4c6b-8e19-4cfd7d3c1778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:33.130716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb68e9d-36a5-4c6b-8e19-4cfd7d3c1778 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:33.147932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2512/5034] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:33.157886 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2523/5035] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:33 2021] POST /identity/v3/users => generated 347 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:33.174580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb68e9d-36a5-4c6b-8e19-4cfd7d3c1778 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.183540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8e75e-f63d-4cea-827d-24c94d22b84b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.204412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8e75e-f63d-4cea-827d-24c94d22b84b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:33.213907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb68e9d-36a5-4c6b-8e19-4cfd7d3c1778 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:33.227495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67998a27-1dbc-4a48-a06a-6f108ee8b17b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55271dce23624e51bb764471b094475b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b5a4bb8bbe45418e21240263324dce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:33.228176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998a27-1dbc-4a48-a06a-6f108ee8b17b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.228463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998a27-1dbc-4a48-a06a-6f108ee8b17b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.228745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67998a27-1dbc-4a48-a06a-6f108ee8b17b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.229492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67998a27-1dbc-4a48-a06a-6f108ee8b17b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:33.232150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7248260-aa52-4308-b524-90c8458bb20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:33.232818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7248260-aa52-4308-b524-90c8458bb20d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.233101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7248260-aa52-4308-b524-90c8458bb20d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.233618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7248260-aa52-4308-b524-90c8458bb20d admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.234081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7248260-aa52-4308-b524-90c8458bb20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:33.237430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67998a27-1dbc-4a48-a06a-6f108ee8b17b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:33.239782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7248260-aa52-4308-b524-90c8458bb20d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:33.267626 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2524/5036] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:33 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:33.269646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67998a27-1dbc-4a48-a06a-6f108ee8b17b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.288243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67998a27-1dbc-4a48-a06a-6f108ee8b17b tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:33.294180 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2513/5037] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:33 2021] POST /identity/v3/projects => generated 403 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:33.296766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7248260-aa52-4308-b524-90c8458bb20d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.393464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f50f3-ff07-4df5-9435-885297a897ed tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55271dce23624e51bb764471b094475b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b5a4bb8bbe45418e21240263324dce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:33.394715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f50f3-ff07-4df5-9435-885297a897ed tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.398420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7248260-aa52-4308-b524-90c8458bb20d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:33.399738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f50f3-ff07-4df5-9435-885297a897ed tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.400749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f50f3-ff07-4df5-9435-885297a897ed tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] PATH_INFO: `/v3/projects/fffad46efbc94ace9de27307238028cc/users/5c0dbef964b54115a72c27ff5305535b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.406903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69173d-d2f4-40f5-869a-a9e38e3084b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:33.411495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69173d-d2f4-40f5-869a-a9e38e3084b9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.411804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69173d-d2f4-40f5-869a-a9e38e3084b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.412055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69173d-d2f4-40f5-869a-a9e38e3084b9 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.413216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69173d-d2f4-40f5-869a-a9e38e3084b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:33.415233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69173d-d2f4-40f5-869a-a9e38e3084b9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:33.422287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f50f3-ff07-4df5-9435-885297a897ed tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fffad46efbc94ace9de27307238028cc, user_id=5c0dbef964b54115a72c27ff5305535b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:33.427454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f50f3-ff07-4df5-9435-885297a897ed tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:33.452432 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2525/5038] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:33 2021] PUT /identity/v3/projects/fffad46efbc94ace9de27307238028cc/users/5c0dbef964b54115a72c27ff5305535b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:33.454396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf651fa-68ac-425d-afd5-8f399284a477 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.454760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf651fa-68ac-425d-afd5-8f399284a477 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.455146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf651fa-68ac-425d-afd5-8f399284a477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.459459 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2514/5039] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:33 2021] POST /identity/v3/users => generated 302 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:33.460661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69173d-d2f4-40f5-869a-a9e38e3084b9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.474437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69173d-d2f4-40f5-869a-a9e38e3084b9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:33.557275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef646-491a-4f94-b7b9-7309afb09387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:33.558291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef646-491a-4f94-b7b9-7309afb09387 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.558925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef646-491a-4f94-b7b9-7309afb09387 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.559447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ef646-491a-4f94-b7b9-7309afb09387 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.560392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ef646-491a-4f94-b7b9-7309afb09387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:33.562284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ef646-491a-4f94-b7b9-7309afb09387 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:33.575841 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2515/5040] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:33 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:33.582369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef646-491a-4f94-b7b9-7309afb09387 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.599641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ef646-491a-4f94-b7b9-7309afb09387 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:33.600098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-aaf651fa-68ac-425d-afd5-8f399284a477 None None] MFA Rules not processed for user `5c0dbef964b54115a72c27ff5305535b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:33.601413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aaf651fa-68ac-425d-afd5-8f399284a477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:33.636407 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2526/5041] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:33 2021] POST /identity/v3/auth/tokens => generated 3352 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:33.640525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69980a7d-fbaf-45d3-8ab3-8a6996c93920 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.641700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69980a7d-fbaf-45d3-8ab3-8a6996c93920 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.643070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69980a7d-fbaf-45d3-8ab3-8a6996c93920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.647991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abe75-01c9-460c-a100-b0eee32b5caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:33.648679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abe75-01c9-460c-a100-b0eee32b5caa admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.648965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abe75-01c9-460c-a100-b0eee32b5caa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.649242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7abe75-01c9-460c-a100-b0eee32b5caa admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.649984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7abe75-01c9-460c-a100-b0eee32b5caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:33.656902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7abe75-01c9-460c-a100-b0eee32b5caa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:33.668813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-69980a7d-fbaf-45d3-8ab3-8a6996c93920 None None] MFA Rules not processed for user `5c0dbef964b54115a72c27ff5305535b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:33.670178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-69980a7d-fbaf-45d3-8ab3-8a6996c93920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:33.686161 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2516/5043] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:33 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:33.686785 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2527/5043] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:33 2021] POST /identity/v3/auth/tokens => generated 3352 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:33.688258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69980a7d-fbaf-45d3-8ab3-8a6996c93920 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.688612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abe75-01c9-460c-a100-b0eee32b5caa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.699943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69980a7d-fbaf-45d3-8ab3-8a6996c93920 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:33.706559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471927ab-779e-4a79-9cf9-99b647e700b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:33.707761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471927ab-779e-4a79-9cf9-99b647e700b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.708913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471927ab-779e-4a79-9cf9-99b647e700b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.709194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471927ab-779e-4a79-9cf9-99b647e700b0 admin admin] PATH_INFO: `/v3/projects/cff35596309b4b038ea9f8ddc36824d8/users/fe5f5427da10474fb1eaffa7469c5841/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.715422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7abe75-01c9-460c-a100-b0eee32b5caa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:33.728033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471927ab-779e-4a79-9cf9-99b647e700b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff35596309b4b038ea9f8ddc36824d8, user_id=fe5f5427da10474fb1eaffa7469c5841, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:33.731203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b947-391a-4997-9766-13893d9d3b00 tempest-test_project-1832341739 tempest-user-357042977] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c0dbef964b54115a72c27ff5305535b', 'user_domain_id': '840d54e9269c4e6c84afb2a8f3f720e4', 'system_scope': None, 'project_id': 'fffad46efbc94ace9de27307238028cc', 'project_domain_id': '840d54e9269c4e6c84afb2a8f3f720e4', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:33.732472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b947-391a-4997-9766-13893d9d3b00 tempest-test_project-1832341739 tempest-user-357042977] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.732627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471927ab-779e-4a79-9cf9-99b647e700b0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:33.734661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b947-391a-4997-9766-13893d9d3b00 tempest-test_project-1832341739 tempest-user-357042977] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.735975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b947-391a-4997-9766-13893d9d3b00 tempest-test_project-1832341739 tempest-user-357042977] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.750914 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2528/5044] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:33 2021] PUT /identity/v3/projects/cff35596309b4b038ea9f8ddc36824d8/users/fe5f5427da10474fb1eaffa7469c5841/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:33.756827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad464e9-2dac-4ef7-91c1-a2ff7e28fb7b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:33.757192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad464e9-2dac-4ef7-91c1-a2ff7e28fb7b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:33.757476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad464e9-2dac-4ef7-91c1-a2ff7e28fb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:33.763586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b947-391a-4997-9766-13893d9d3b00 tempest-test_project-1832341739 tempest-user-357042977] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:33.766973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b947-391a-4997-9766-13893d9d3b00 tempest-test_project-1832341739 tempest-user-357042977] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:33.785988 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2517/5045] 10.222.0.21 () {56 vars in 1283 bytes} [Sat Nov 27 21:00:33 2021] GET /identity/v3/auth/tokens => generated 3352 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:33.789453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cad464e9-2dac-4ef7-91c1-a2ff7e28fb7b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:33.790995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cad464e9-2dac-4ef7-91c1-a2ff7e28fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:33.792562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b947-391a-4997-9766-13893d9d3b00 tempest-test_project-1832341739 tempest-user-357042977] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.875067 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2529/5046] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:33.908974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b947-391a-4997-9766-13893d9d3b00 tempest-test_project-1832341739 tempest-user-357042977] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:33.975371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad464e9-2dac-4ef7-91c1-a2ff7e28fb7b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:33.978628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cad464e9-2dac-4ef7-91c1-a2ff7e28fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:34.004943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55271dce23624e51bb764471b094475b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b5a4bb8bbe45418e21240263324dce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:34.005912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:34.006262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:34.006672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] PATH_INFO: `/v3/users/5c0dbef964b54115a72c27ff5305535b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:34.008340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5c0dbef964b54115a72c27ff5305535b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:34.010462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:34.112504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad464e9-2dac-4ef7-91c1-a2ff7e28fb7b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:34.119190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0213664-241b-4dea-a3ab-f4bae3cf3c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:34.121533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213664-241b-4dea-a3ab-f4bae3cf3c6b service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:34.122944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213664-241b-4dea-a3ab-f4bae3cf3c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:34.124721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213664-241b-4dea-a3ab-f4bae3cf3c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:34.138607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c0dbef964b54115a72c27ff5305535b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.153862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0213664-241b-4dea-a3ab-f4bae3cf3c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:34.158372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c0dbef964b54115a72c27ff5305535b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.159222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c0dbef964b54115a72c27ff5305535b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.159618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0213664-241b-4dea-a3ab-f4bae3cf3c6b service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:34.179681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c0dbef964b54115a72c27ff5305535b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.185633 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2530/5047] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:34.204962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c0dbef964b54115a72c27ff5305535b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.211569 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2518/5048] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:33 2021] DELETE /identity/v3/users/5c0dbef964b54115a72c27ff5305535b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:34.215585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0213664-241b-4dea-a3ab-f4bae3cf3c6b service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:34.235027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0213664-241b-4dea-a3ab-f4bae3cf3c6b service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:34.308681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55271dce23624e51bb764471b094475b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b5a4bb8bbe45418e21240263324dce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:34.310729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:34.311281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:34.311810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] PATH_INFO: `/v3/projects/fffad46efbc94ace9de27307238028cc` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:34.313980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fffad46efbc94ace9de27307238028cc)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:34.316357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:34.386666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fffad46efbc94ace9de27307238028cc', 'request_id': 'req-7a221bbf-89dd-457a-8ad2-b6c6c3634374'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.395633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fffad46efbc94ace9de27307238028cc', 'request_id': 'req-7a221bbf-89dd-457a-8ad2-b6c6c3634374'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.408319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fffad46efbc94ace9de27307238028cc', 'request_id': 'req-7a221bbf-89dd-457a-8ad2-b6c6c3634374'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.432136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] The token cache is being invalidate because project fffad46efbc94ace9de27307238028cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:34.432964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.434962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.440111 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2531/5049] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:34 2021] DELETE /identity/v3/projects/fffad46efbc94ace9de27307238028cc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:34.446894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:34.448383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:34.462987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb24c2-86f7-4ee1-b83f-2e9d151ebc60 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:34.544418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55271dce23624e51bb764471b094475b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b5a4bb8bbe45418e21240263324dce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:34.545459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:34.546123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:34.546815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] PATH_INFO: `/v3/domains/840d54e9269c4e6c84afb2a8f3f720e4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:34.549152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=840d54e9269c4e6c84afb2a8f3f720e4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:34.551056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:34.577441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.578199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.605940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.606567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.613568 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2519/5050] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:00:34 2021] PATCH /identity/v3/domains/840d54e9269c4e6c84afb2a8f3f720e4 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:34.614762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:34.616199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:34.635950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a221bbf-89dd-457a-8ad2-b6c6c3634374 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:34.705440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55271dce23624e51bb764471b094475b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b5a4bb8bbe45418e21240263324dce', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:34.707199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:34.707753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:34.708185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] PATH_INFO: `/v3/domains/840d54e9269c4e6c84afb2a8f3f720e4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:34.722594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=840d54e9269c4e6c84afb2a8f3f720e4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:34.724812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:34.757364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.774350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.840405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4', 'request_id': 'req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.848078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4', 'request_id': 'req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.857461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4', 'request_id': 'req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.870581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] The token cache is being invalidate because project 840d54e9269c4e6c84afb2a8f3f720e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:34.870882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.871602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.880625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4', 'request_id': 'req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.881321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4', 'request_id': 'req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.887638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '840d54e9269c4e6c84afb2a8f3f720e4', 'request_id': 'req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:34.894438 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2532/5051] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:00:34 2021] DELETE /identity/v3/domains/840d54e9269c4e6c84afb2a8f3f720e4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:34.900474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:34.902286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:35.045558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7b1ec-029d-4402-b5eb-fedef8fee79e tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:35.098968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:35.102144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:35.127816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddac3f4-228e-4958-a87b-99feccf50a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:35.128971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac3f4-228e-4958-a87b-99feccf50a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:35.129445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac3f4-228e-4958-a87b-99feccf50a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:35.129878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac3f4-228e-4958-a87b-99feccf50a74 admin admin] PATH_INFO: `/v3/users/8219c1813be141278d0693f04aec1fdd` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:35.131349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddac3f4-228e-4958-a87b-99feccf50a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8219c1813be141278d0693f04aec1fdd)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:35.134562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddac3f4-228e-4958-a87b-99feccf50a74 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:35.197948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eddac3f4-228e-4958-a87b-99feccf50a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8219c1813be141278d0693f04aec1fdd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:35.217311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eddac3f4-228e-4958-a87b-99feccf50a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8219c1813be141278d0693f04aec1fdd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:35.220010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eddac3f4-228e-4958-a87b-99feccf50a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8219c1813be141278d0693f04aec1fdd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:35.243681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eddac3f4-228e-4958-a87b-99feccf50a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8219c1813be141278d0693f04aec1fdd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:35.264443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eddac3f4-228e-4958-a87b-99feccf50a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8219c1813be141278d0693f04aec1fdd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:35.280059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9b5fa-f520-4139-af98-bbbe3d8b1b82 tempest-TestDefaultProjectId-950263398 tempest-TestDefaultProjectId-950263398-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:35.281395 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2520/5052] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:34 2021] DELETE /identity/v3/users/8219c1813be141278d0693f04aec1fdd => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:35.284983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d598e-5f0c-4a53-831c-d8d2ac7d689b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:35.285338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d598e-5f0c-4a53-831c-d8d2ac7d689b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:35.285679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d598e-5f0c-4a53-831c-d8d2ac7d689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:35.314493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ac3d598e-5f0c-4a53-831c-d8d2ac7d689b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:35.318218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ac3d598e-5f0c-4a53-831c-d8d2ac7d689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:35.394185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459e5ac-8347-4246-a718-1d587693c526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:35.395169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459e5ac-8347-4246-a718-1d587693c526 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:35.395478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459e5ac-8347-4246-a718-1d587693c526 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:35.395758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459e5ac-8347-4246-a718-1d587693c526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:35.402642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e459e5ac-8347-4246-a718-1d587693c526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:35.473087 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2521/5053] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:35.518757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459e5ac-8347-4246-a718-1d587693c526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:35.520532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459e5ac-8347-4246-a718-1d587693c526 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:35.535532 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2533/5054] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:35.580876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d598e-5f0c-4a53-831c-d8d2ac7d689b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:35.582763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ac3d598e-5f0c-4a53-831c-d8d2ac7d689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:35.599878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d598e-5f0c-4a53-831c-d8d2ac7d689b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:35.605739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bbdb3-39b2-4fa3-bef3-462ce5ffdacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:35.606510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bbdb3-39b2-4fa3-bef3-462ce5ffdacd service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:35.606875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bbdb3-39b2-4fa3-bef3-462ce5ffdacd service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:35.607207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bbdb3-39b2-4fa3-bef3-462ce5ffdacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:35.619734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bbdb3-39b2-4fa3-bef3-462ce5ffdacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:35.621936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bbdb3-39b2-4fa3-bef3-462ce5ffdacd service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:35.636324 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2522/5055] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:35.718344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459e5ac-8347-4246-a718-1d587693c526 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:35.720158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e459e5ac-8347-4246-a718-1d587693c526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:35.735428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459e5ac-8347-4246-a718-1d587693c526 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:35.740391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:35.741408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:35.741787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:35.742168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] PATH_INFO: `/v3/users/7be26c3cb58b4e9c96ad44105b5fe28a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:35.743524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be26c3cb58b4e9c96ad44105b5fe28a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:35.745662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:35.811962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be26c3cb58b4e9c96ad44105b5fe28a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:35.812793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be26c3cb58b4e9c96ad44105b5fe28a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:35.822417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be26c3cb58b4e9c96ad44105b5fe28a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:35.823232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be26c3cb58b4e9c96ad44105b5fe28a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:35.831313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be26c3cb58b4e9c96ad44105b5fe28a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:35.851159 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2534/5056] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:35 2021] DELETE /identity/v3/users/7be26c3cb58b4e9c96ad44105b5fe28a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:36.521230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a85cd4-fce9-4910-990b-96501fb71f79 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:36.521798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a85cd4-fce9-4910-990b-96501fb71f79 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:36.521798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a85cd4-fce9-4910-990b-96501fb71f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:36.538233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:36.539750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:36.560159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e4a85cd4-fce9-4910-990b-96501fb71f79 None None] MFA Rules not processed for user `fe5f5427da10474fb1eaffa7469c5841`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:36.561873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e4a85cd4-fce9-4910-990b-96501fb71f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:36.662069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50013c8-12dc-4a2d-ad43-f2b960bc8a87 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:36.663636 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2523/5057] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:36 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:36.669969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a85cd4-fce9-4910-990b-96501fb71f79 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:36.673484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e4a85cd4-fce9-4910-990b-96501fb71f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:36.678576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:36.681494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:36.687236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:36.687920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] PATH_INFO: `/v3/projects/dc5da228c74444d99bbd83366a9438ba` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:36.692254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5da228c74444d99bbd83366a9438ba)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:36.699462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:36.713707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a85cd4-fce9-4910-990b-96501fb71f79 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:36.724077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed531b68-c44e-4513-a9bb-c705ca26ff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:36.726595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed531b68-c44e-4513-a9bb-c705ca26ff47 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:36.726900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed531b68-c44e-4513-a9bb-c705ca26ff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:36.727185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed531b68-c44e-4513-a9bb-c705ca26ff47 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:36.729016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed531b68-c44e-4513-a9bb-c705ca26ff47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:36.733376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed531b68-c44e-4513-a9bb-c705ca26ff47 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:36.783759 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2524/5058] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:36 2021] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:36.784767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed531b68-c44e-4513-a9bb-c705ca26ff47 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:36.787464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ed531b68-c44e-4513-a9bb-c705ca26ff47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:36.801690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5da228c74444d99bbd83366a9438ba', 'request_id': 'req-426b7b18-3796-41dc-8af3-c099ee2b2daa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:36.812416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5da228c74444d99bbd83366a9438ba', 'request_id': 'req-426b7b18-3796-41dc-8af3-c099ee2b2daa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:36.833130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5da228c74444d99bbd83366a9438ba', 'request_id': 'req-426b7b18-3796-41dc-8af3-c099ee2b2daa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:36.859727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] The token cache is being invalidate because project dc5da228c74444d99bbd83366a9438ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:36.860818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:36.862700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:36.864728 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2535/5059] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:36 2021] DELETE /identity/v3/projects/dc5da228c74444d99bbd83366a9438ba => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:36.865691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:36.876325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:36.893041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed531b68-c44e-4513-a9bb-c705ca26ff47 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:36.900423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:36.901400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:36.901692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:36.901973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] PATH_INFO: `/v3/projects/5c6154b95627486fabf56181b0677854` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:36.903639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6154b95627486fabf56181b0677854)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:36.906665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:36.985854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6154b95627486fabf56181b0677854', 'request_id': 'req-5b79a8e2-3f01-47ae-ba20-edef56332921'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:36.992497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b7b18-3796-41dc-8af3-c099ee2b2daa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.007070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6154b95627486fabf56181b0677854', 'request_id': 'req-5b79a8e2-3f01-47ae-ba20-edef56332921'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:37.019233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6154b95627486fabf56181b0677854', 'request_id': 'req-5b79a8e2-3f01-47ae-ba20-edef56332921'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:37.033779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] The token cache is being invalidate because project 5c6154b95627486fabf56181b0677854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:37.034329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:37.035209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5b79a8e2-3f01-47ae-ba20-edef56332921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:37.037297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2525/5060] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:36 2021] DELETE /identity/v3/projects/5c6154b95627486fabf56181b0677854 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:37.042861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd596429-cc6a-4978-a24d-75492b27dd17 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.043412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd596429-cc6a-4978-a24d-75492b27dd17 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.043890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd596429-cc6a-4978-a24d-75492b27dd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.056270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b45237-df4c-447a-a086-00841c666ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.057254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45237-df4c-447a-a086-00841c666ceb admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.057638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45237-df4c-447a-a086-00841c666ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.058015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45237-df4c-447a-a086-00841c666ceb admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.058826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b45237-df4c-447a-a086-00841c666ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:37.060922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b45237-df4c-447a-a086-00841c666ceb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:37.072419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bd596429-cc6a-4978-a24d-75492b27dd17 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:37.074571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bd596429-cc6a-4978-a24d-75492b27dd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:37.091379 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2526/5061] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:37.093761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd596429-cc6a-4978-a24d-75492b27dd17 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:37.095411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bd596429-cc6a-4978-a24d-75492b27dd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:37.098154 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2536/5062] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:36 2021] POST /identity/v3/users => generated 309 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:37.099842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ae620-f233-43df-8b41-7168abb0b25e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.100130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ae620-f233-43df-8b41-7168abb0b25e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.100405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ae620-f233-43df-8b41-7168abb0b25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.119523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd596429-cc6a-4978-a24d-75492b27dd17 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.128215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.129442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.129861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.130245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] PATH_INFO: `/v3/users/55271dce23624e51bb764471b094475b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.131932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55271dce23624e51bb764471b094475b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:37.135289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:37.164628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-375ae620-f233-43df-8b41-7168abb0b25e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:37.167836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-375ae620-f233-43df-8b41-7168abb0b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:37.194741 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2537/5063] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:37.199853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ae620-f233-43df-8b41-7168abb0b25e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:37.207422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-375ae620-f233-43df-8b41-7168abb0b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:37.218939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55271dce23624e51bb764471b094475b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:37.232920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ae620-f233-43df-8b41-7168abb0b25e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.248767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d285d1-f5d3-4c52-8bde-5a192121c85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.249392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d285d1-f5d3-4c52-8bde-5a192121c85b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.249674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d285d1-f5d3-4c52-8bde-5a192121c85b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.249973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d285d1-f5d3-4c52-8bde-5a192121c85b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.251832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55271dce23624e51bb764471b094475b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:37.251998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d285d1-f5d3-4c52-8bde-5a192121c85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:37.252833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55271dce23624e51bb764471b094475b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:37.253793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d285d1-f5d3-4c52-8bde-5a192121c85b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:37.269624 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2538/5064] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:37 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:37.270681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d285d1-f5d3-4c52-8bde-5a192121c85b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:37.274919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55271dce23624e51bb764471b094475b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:37.276922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-09d285d1-f5d3-4c52-8bde-5a192121c85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:37.300730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d285d1-f5d3-4c52-8bde-5a192121c85b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.308582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55271dce23624e51bb764471b094475b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:37.308828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ffb57-672e-4b3d-b0f7-5995a6925f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.310528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ffb57-672e-4b3d-b0f7-5995a6925f58 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.310889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ffb57-672e-4b3d-b0f7-5995a6925f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.311174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ffb57-672e-4b3d-b0f7-5995a6925f58 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.312241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ffb57-672e-4b3d-b0f7-5995a6925f58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:37.312621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ffb57-672e-4b3d-b0f7-5995a6925f58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:37.314703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ffb57-672e-4b3d-b0f7-5995a6925f58 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:37.319925 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2527/5065] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:37 2021] DELETE /identity/v3/users/55271dce23624e51bb764471b094475b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:37.320972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:37.322490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:37.337466 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2539/5066] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:37.338637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ffb57-672e-4b3d-b0f7-5995a6925f58 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:37.350354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ffb57-672e-4b3d-b0f7-5995a6925f58 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.459934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797cc25-1e55-40f3-975e-1092bbcea715 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.462268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649faf5-de03-4e2d-bbf4-a823857a8fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.463186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649faf5-de03-4e2d-bbf4-a823857a8fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.463892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649faf5-de03-4e2d-bbf4-a823857a8fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.464332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649faf5-de03-4e2d-bbf4-a823857a8fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.465425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649faf5-de03-4e2d-bbf4-a823857a8fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:37.467014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301bed-41a2-4aa5-b337-2bc81945d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.467877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649faf5-de03-4e2d-bbf4-a823857a8fc7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:37.469351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301bed-41a2-4aa5-b337-2bc81945d8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.470464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301bed-41a2-4aa5-b337-2bc81945d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.470993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301bed-41a2-4aa5-b337-2bc81945d8dc admin admin] PATH_INFO: `/v3/projects/64a22d416fda4b5e8c668a1ba24ef12a/users/e730c44027c84bbe97abd9f98f4c8b9a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.500891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73301bed-41a2-4aa5-b337-2bc81945d8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a22d416fda4b5e8c668a1ba24ef12a, user_id=e730c44027c84bbe97abd9f98f4c8b9a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:37.504830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73301bed-41a2-4aa5-b337-2bc81945d8dc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:37.509300 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2540/5067] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:37 2021] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:37.510624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649faf5-de03-4e2d-bbf4-a823857a8fc7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:37.531941 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2528/5068] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:37 2021] PUT /identity/v3/projects/64a22d416fda4b5e8c668a1ba24ef12a/users/e730c44027c84bbe97abd9f98f4c8b9a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:37.536723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301bed-41a2-4aa5-b337-2bc81945d8dc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:37.586526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649faf5-de03-4e2d-bbf4-a823857a8fc7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.646337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301bed-41a2-4aa5-b337-2bc81945d8dc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.659335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff31c8-2240-4a9a-8504-1da8e8b041ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.660282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff31c8-2240-4a9a-8504-1da8e8b041ed admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.660677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff31c8-2240-4a9a-8504-1da8e8b041ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.661091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff31c8-2240-4a9a-8504-1da8e8b041ed admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.663105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff31c8-2240-4a9a-8504-1da8e8b041ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:37.666325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff31c8-2240-4a9a-8504-1da8e8b041ed admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:37.697762 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2529/5069] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:37 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:37.702852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff31c8-2240-4a9a-8504-1da8e8b041ed admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:37.723562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f46c5-310b-406e-be51-0760091b5386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.724531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f46c5-310b-406e-be51-0760091b5386 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.724925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f46c5-310b-406e-be51-0760091b5386 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.725899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f46c5-310b-406e-be51-0760091b5386 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.726294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff31c8-2240-4a9a-8504-1da8e8b041ed admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.726957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f46c5-310b-406e-be51-0760091b5386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:37.731636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f46c5-310b-406e-be51-0760091b5386 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:37.738592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1687f7-a3c5-4ac5-b2dd-df6528ee802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.739536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1687f7-a3c5-4ac5-b2dd-df6528ee802f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.739817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1687f7-a3c5-4ac5-b2dd-df6528ee802f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.740189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1687f7-a3c5-4ac5-b2dd-df6528ee802f admin admin] PATH_INFO: `/v3/projects/64a22d416fda4b5e8c668a1ba24ef12a/users/e730c44027c84bbe97abd9f98f4c8b9a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.747614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1687f7-a3c5-4ac5-b2dd-df6528ee802f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a22d416fda4b5e8c668a1ba24ef12a, user_id=e730c44027c84bbe97abd9f98f4c8b9a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:37.756568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1687f7-a3c5-4ac5-b2dd-df6528ee802f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:37.767762 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2541/5070] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:37 2021] POST /identity/v3/users => generated 296 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:37.772092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f46c5-310b-406e-be51-0760091b5386 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:37.789145 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2530/5071] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:37 2021] PUT /identity/v3/projects/64a22d416fda4b5e8c668a1ba24ef12a/users/e730c44027c84bbe97abd9f98f4c8b9a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:37.800991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f46c5-310b-406e-be51-0760091b5386 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.883588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740660f4-fe8f-4f54-a067-121808738dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.884392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740660f4-fe8f-4f54-a067-121808738dbd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.884740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740660f4-fe8f-4f54-a067-121808738dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.885117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740660f4-fe8f-4f54-a067-121808738dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.885921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740660f4-fe8f-4f54-a067-121808738dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:37.887916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740660f4-fe8f-4f54-a067-121808738dbd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:37.901265 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2542/5072] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:37 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:00:37.905085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1687f7-a3c5-4ac5-b2dd-df6528ee802f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:37.919926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1687f7-a3c5-4ac5-b2dd-df6528ee802f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.928000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d326bf-231f-4eb4-96ea-5ccc12350480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.928931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d326bf-231f-4eb4-96ea-5ccc12350480 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.929332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d326bf-231f-4eb4-96ea-5ccc12350480 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.929707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d326bf-231f-4eb4-96ea-5ccc12350480 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.930600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d326bf-231f-4eb4-96ea-5ccc12350480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:37.932977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d326bf-231f-4eb4-96ea-5ccc12350480 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:37.946790 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2531/5073] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:37 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:00:37.953144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740660f4-fe8f-4f54-a067-121808738dbd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:37.969095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740660f4-fe8f-4f54-a067-121808738dbd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:37.974808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acbcdf-6273-486f-9a41-82707704a7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:37.976008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acbcdf-6273-486f-9a41-82707704a7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:37.976388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acbcdf-6273-486f-9a41-82707704a7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:37.976761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acbcdf-6273-486f-9a41-82707704a7fb admin admin] PATH_INFO: `/v3/projects/57166f6505f544e38ae55d9360c4f40a/users/ff6493e665b046a1863572bcc9553866/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:37.996012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acbcdf-6273-486f-9a41-82707704a7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=57166f6505f544e38ae55d9360c4f40a, user_id=ff6493e665b046a1863572bcc9553866, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:38.000589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acbcdf-6273-486f-9a41-82707704a7fb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:38.019322 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2543/5074] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:37 2021] PUT /identity/v3/projects/57166f6505f544e38ae55d9360c4f40a/users/ff6493e665b046a1863572bcc9553866/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:38.023468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019214c-181f-4531-9c04-736c1d0a94e5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:38.023824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019214c-181f-4531-9c04-736c1d0a94e5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:38.024246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019214c-181f-4531-9c04-736c1d0a94e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:38.046259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b019214c-181f-4531-9c04-736c1d0a94e5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:38.048150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b019214c-181f-4531-9c04-736c1d0a94e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:38.132411 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2532/5075] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:00:38.166114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acbcdf-6273-486f-9a41-82707704a7fb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:38.168269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b8acbcdf-6273-486f-9a41-82707704a7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:38.258402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acbcdf-6273-486f-9a41-82707704a7fb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:38.263183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b13da2-24ba-40dd-a931-f302373461f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:38.265484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13da2-24ba-40dd-a931-f302373461f1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:38.265912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13da2-24ba-40dd-a931-f302373461f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:38.266945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13da2-24ba-40dd-a931-f302373461f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:38.280650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b13da2-24ba-40dd-a931-f302373461f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:38.283534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b13da2-24ba-40dd-a931-f302373461f1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:38.296770 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2544/5076] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:38.572445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019214c-181f-4531-9c04-736c1d0a94e5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:38.574160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b019214c-181f-4531-9c04-736c1d0a94e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:38.587800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019214c-181f-4531-9c04-736c1d0a94e5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:38.593896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:38.595710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:38.596000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:38.596278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] PATH_INFO: `/v3/projects/c3b5a4bb8bbe45418e21240263324dce` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:38.598098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b5a4bb8bbe45418e21240263324dce)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:38.613160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:38.729591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b5a4bb8bbe45418e21240263324dce', 'request_id': 'req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:38.749248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b5a4bb8bbe45418e21240263324dce', 'request_id': 'req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:38.759817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b5a4bb8bbe45418e21240263324dce', 'request_id': 'req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:38.784674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] The token cache is being invalidate because project c3b5a4bb8bbe45418e21240263324dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:38.784973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:38.797401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0cb6fd8c-0f4b-423b-ba15-b1376a7a1d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:38.802563 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2533/5077] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:38 2021] DELETE /identity/v3/projects/c3b5a4bb8bbe45418e21240263324dce => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:38.812077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434eebc-4c65-47ed-b6ab-04a82782a9b1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:38.814493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434eebc-4c65-47ed-b6ab-04a82782a9b1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:38.816164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434eebc-4c65-47ed-b6ab-04a82782a9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:38.859120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7434eebc-4c65-47ed-b6ab-04a82782a9b1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:38.861177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7434eebc-4c65-47ed-b6ab-04a82782a9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:39.012710 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2545/5078] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:39.020799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aae88-3315-4275-95aa-6a0bf32717fd None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:39.021846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aae88-3315-4275-95aa-6a0bf32717fd None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:39.022473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aae88-3315-4275-95aa-6a0bf32717fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:39.074339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d02aae88-3315-4275-95aa-6a0bf32717fd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:39.080547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d02aae88-3315-4275-95aa-6a0bf32717fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:39.129988 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2534/5079] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:39.134409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434eebc-4c65-47ed-b6ab-04a82782a9b1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:39.167476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434eebc-4c65-47ed-b6ab-04a82782a9b1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:39.189592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9362f-b617-4187-9a97-f0fcea7481ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:39.192526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9362f-b617-4187-9a97-f0fcea7481ef admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:39.193060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9362f-b617-4187-9a97-f0fcea7481ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:39.194181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9362f-b617-4187-9a97-f0fcea7481ef admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:39.195295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9362f-b617-4187-9a97-f0fcea7481ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:39.200741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9362f-b617-4187-9a97-f0fcea7481ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:39.202716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9362f-b617-4187-9a97-f0fcea7481ef admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:39.221733 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2546/5080] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:39.225737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02aae88-3315-4275-95aa-6a0bf32717fd None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:39.239245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02aae88-3315-4275-95aa-6a0bf32717fd None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:39.249767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc917c-a1ff-4d6f-a4ae-8d084cb3dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:39.250759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc917c-a1ff-4d6f-a4ae-8d084cb3dc20 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:39.252595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc917c-a1ff-4d6f-a4ae-8d084cb3dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:39.253013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc917c-a1ff-4d6f-a4ae-8d084cb3dc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:39.254179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc917c-a1ff-4d6f-a4ae-8d084cb3dc20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:39.256882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc917c-a1ff-4d6f-a4ae-8d084cb3dc20 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:39.329721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9362f-b617-4187-9a97-f0fcea7481ef admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:39.334185 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2535/5081] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:39 2021] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:39.357341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9362f-b617-4187-9a97-f0fcea7481ef admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:39.519852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69617e60-fbdf-4218-8ca4-80bf39110e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:39.520677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69617e60-fbdf-4218-8ca4-80bf39110e10 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:39.521032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69617e60-fbdf-4218-8ca4-80bf39110e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:39.521452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69617e60-fbdf-4218-8ca4-80bf39110e10 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:39.522160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69617e60-fbdf-4218-8ca4-80bf39110e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:39.525193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69617e60-fbdf-4218-8ca4-80bf39110e10 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:39.557108 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2547/5082] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:39 2021] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:39.561500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc917c-a1ff-4d6f-a4ae-8d084cb3dc20 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:39.574024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc917c-a1ff-4d6f-a4ae-8d084cb3dc20 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:39.579911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288faeb5-edf4-4d1a-9731-2fecd50471cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:39.580717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288faeb5-edf4-4d1a-9731-2fecd50471cd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:39.581108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288faeb5-edf4-4d1a-9731-2fecd50471cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:39.581501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288faeb5-edf4-4d1a-9731-2fecd50471cd admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:39.583408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288faeb5-edf4-4d1a-9731-2fecd50471cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:39.584390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288faeb5-edf4-4d1a-9731-2fecd50471cd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:39.600359 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2536/5083] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:39 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:39.602556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69617e60-fbdf-4218-8ca4-80bf39110e10 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:39.626407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69617e60-fbdf-4218-8ca4-80bf39110e10 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:39.633289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681b9e-6bf7-48e4-bf8d-0d97b8fde3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:39.639781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681b9e-6bf7-48e4-bf8d-0d97b8fde3aa admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:39.639781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681b9e-6bf7-48e4-bf8d-0d97b8fde3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:39.639781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681b9e-6bf7-48e4-bf8d-0d97b8fde3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:39.639781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681b9e-6bf7-48e4-bf8d-0d97b8fde3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:39.640562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681b9e-6bf7-48e4-bf8d-0d97b8fde3aa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:39.660390 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2548/5084] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:39 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:39.665833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288faeb5-edf4-4d1a-9731-2fecd50471cd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:39.679719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288faeb5-edf4-4d1a-9731-2fecd50471cd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:39.685650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ccad4-a126-48a7-b31d-47c722e28f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:39.687402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ccad4-a126-48a7-b31d-47c722e28f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:39.687802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ccad4-a126-48a7-b31d-47c722e28f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:39.688896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ccad4-a126-48a7-b31d-47c722e28f42 admin admin] PATH_INFO: `/v3/projects/ff0c5ffa7ffe48c98f9fe4896176ba3a/users/2f48b644fc1b4c8b81e6d1ad37122d3a/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:39.710102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ccad4-a126-48a7-b31d-47c722e28f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0c5ffa7ffe48c98f9fe4896176ba3a, user_id=2f48b644fc1b4c8b81e6d1ad37122d3a, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:39.714301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ccad4-a126-48a7-b31d-47c722e28f42 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:39.743712 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2537/5085] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:39 2021] PUT /identity/v3/projects/ff0c5ffa7ffe48c98f9fe4896176ba3a/users/2f48b644fc1b4c8b81e6d1ad37122d3a/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:39.754677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390ef4-9ccb-4cfc-9404-c6037e29e712 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:39.755075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390ef4-9ccb-4cfc-9404-c6037e29e712 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:39.755503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390ef4-9ccb-4cfc-9404-c6037e29e712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:39.803154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d1390ef4-9ccb-4cfc-9404-c6037e29e712 None None] MFA Rules not processed for user `2f48b644fc1b4c8b81e6d1ad37122d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:39.804518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d1390ef4-9ccb-4cfc-9404-c6037e29e712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:39.898339 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2549/5086] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:39 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:39.901739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ccad4-a126-48a7-b31d-47c722e28f42 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:40.017248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ccad4-a126-48a7-b31d-47c722e28f42 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:40.027664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1839c-3031-4d11-8997-d1974f2aed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:40.028552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1839c-3031-4d11-8997-d1974f2aed49 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:40.029105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1839c-3031-4d11-8997-d1974f2aed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:40.029913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1839c-3031-4d11-8997-d1974f2aed49 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:40.030997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1839c-3031-4d11-8997-d1974f2aed49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:40.034402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1839c-3031-4d11-8997-d1974f2aed49 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:40.077770 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2538/5087] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:39 2021] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:40.082794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390ef4-9ccb-4cfc-9404-c6037e29e712 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:40.126886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390ef4-9ccb-4cfc-9404-c6037e29e712 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:40.219409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879b937-ab7b-4c21-85db-2abc0edc079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:40.220347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879b937-ab7b-4c21-85db-2abc0edc079d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:40.220826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879b937-ab7b-4c21-85db-2abc0edc079d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:40.221542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879b937-ab7b-4c21-85db-2abc0edc079d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:40.222274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879b937-ab7b-4c21-85db-2abc0edc079d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:40.224751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879b937-ab7b-4c21-85db-2abc0edc079d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:40.257139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332553-ff40-4018-960f-445afc9a8b69 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:40.257139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332553-ff40-4018-960f-445afc9a8b69 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:40.257538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84332553-ff40-4018-960f-445afc9a8b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:40.292305 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2550/5088] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:40 2021] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:40.294796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db590f80-0aa9-4645-8059-29529d0e475a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:40.297624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db590f80-0aa9-4645-8059-29529d0e475a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:40.298202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db590f80-0aa9-4645-8059-29529d0e475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:40.326963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-84332553-ff40-4018-960f-445afc9a8b69 None None] MFA Rules not processed for user `e730c44027c84bbe97abd9f98f4c8b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:40.328567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-84332553-ff40-4018-960f-445afc9a8b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:40.376904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-db590f80-0aa9-4645-8059-29529d0e475a None None] MFA Rules not processed for user `ff6493e665b046a1863572bcc9553866`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:40.378305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-db590f80-0aa9-4645-8059-29529d0e475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:40.518229 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2539/5089] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:40 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:40.519358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84332553-ff40-4018-960f-445afc9a8b69 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:40.541648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84332553-ff40-4018-960f-445afc9a8b69 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:40.542319 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2551/5090] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:40 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:40.558736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692414f8-35e1-4c57-8c6b-eafec36a7b67 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:40.561131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692414f8-35e1-4c57-8c6b-eafec36a7b67 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:40.561643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692414f8-35e1-4c57-8c6b-eafec36a7b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:40.565294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d02411-49c1-4162-afe5-bf989a7dada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:40.568422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d02411-49c1-4162-afe5-bf989a7dada4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:40.573096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d02411-49c1-4162-afe5-bf989a7dada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:40.573096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d02411-49c1-4162-afe5-bf989a7dada4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:40.573096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d02411-49c1-4162-afe5-bf989a7dada4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:40.578524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d02411-49c1-4162-afe5-bf989a7dada4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:40.608876 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2540/5091] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:40 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:40.609854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-692414f8-35e1-4c57-8c6b-eafec36a7b67 None None] MFA Rules not processed for user `ff6493e665b046a1863572bcc9553866`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:40.612849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d02411-49c1-4162-afe5-bf989a7dada4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:40.613664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-692414f8-35e1-4c57-8c6b-eafec36a7b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:40.642826 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2552/5092] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:40 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:40.643033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d02411-49c1-4162-afe5-bf989a7dada4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:40.646109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dce8a2-84dd-44e9-9bac-dfee099442db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:40.647292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce8a2-84dd-44e9-9bac-dfee099442db admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:40.647684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce8a2-84dd-44e9-9bac-dfee099442db admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:40.648206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce8a2-84dd-44e9-9bac-dfee099442db admin admin] PATH_INFO: `/v3/projects/ab0c3c79eb494a89af6a933e56b4981b/users/377b7dac1543407cb71fcedeac61b78b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:40.664874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dce8a2-84dd-44e9-9bac-dfee099442db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0c3c79eb494a89af6a933e56b4981b, user_id=377b7dac1543407cb71fcedeac61b78b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:40.667732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dce8a2-84dd-44e9-9bac-dfee099442db admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:40.690639 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2541/5093] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:40 2021] PUT /identity/v3/projects/ab0c3c79eb494a89af6a933e56b4981b/users/377b7dac1543407cb71fcedeac61b78b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:40.695970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692414f8-35e1-4c57-8c6b-eafec36a7b67 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:40.711185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dce8a2-84dd-44e9-9bac-dfee099442db admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:40.716011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b0dce8a2-84dd-44e9-9bac-dfee099442db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:40.717165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692414f8-35e1-4c57-8c6b-eafec36a7b67 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:40.896346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f93e3-8114-4027-8351-29d61a9c368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:40.897270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f93e3-8114-4027-8351-29d61a9c368f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:40.898824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f93e3-8114-4027-8351-29d61a9c368f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:40.899410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f93e3-8114-4027-8351-29d61a9c368f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:40.901626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f93e3-8114-4027-8351-29d61a9c368f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:40.904928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f93e3-8114-4027-8351-29d61a9c368f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:40.945556 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2553/5094] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:40 2021] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:40.952299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f93e3-8114-4027-8351-29d61a9c368f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:40.955958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dce8a2-84dd-44e9-9bac-dfee099442db admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:40.965065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edecc6a-9f32-402d-a214-3f71217187b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:40.966157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edecc6a-9f32-402d-a214-3f71217187b8 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:40.966814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edecc6a-9f32-402d-a214-3f71217187b8 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:40.967388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edecc6a-9f32-402d-a214-3f71217187b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:40.972719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f93e3-8114-4027-8351-29d61a9c368f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:40.986487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0b1aa-b8f8-4e4d-856a-e3e1f5f930a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:40.989612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0b1aa-b8f8-4e4d-856a-e3e1f5f930a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:40.989776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0b1aa-b8f8-4e4d-856a-e3e1f5f930a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:40.990029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0b1aa-b8f8-4e4d-856a-e3e1f5f930a3 admin admin] PATH_INFO: `/v3/projects/ab0c3c79eb494a89af6a933e56b4981b/users/377b7dac1543407cb71fcedeac61b78b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:40.998624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0b1aa-b8f8-4e4d-856a-e3e1f5f930a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0c3c79eb494a89af6a933e56b4981b, user_id=377b7dac1543407cb71fcedeac61b78b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:41.007367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0b1aa-b8f8-4e4d-856a-e3e1f5f930a3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:41.034623 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2554/5095] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:40 2021] PUT /identity/v3/projects/ab0c3c79eb494a89af6a933e56b4981b/users/377b7dac1543407cb71fcedeac61b78b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:41.046232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0d90e-4915-430b-b6ba-5e6d42eb7888 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:41.046855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0d90e-4915-430b-b6ba-5e6d42eb7888 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:41.047151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0d90e-4915-430b-b6ba-5e6d42eb7888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:41.085534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edecc6a-9f32-402d-a214-3f71217187b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:41.087538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edecc6a-9f32-402d-a214-3f71217187b8 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:41.104787 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2542/5096] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:40 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:41.127320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-95c0d90e-4915-430b-b6ba-5e6d42eb7888 None None] MFA Rules not processed for user `377b7dac1543407cb71fcedeac61b78b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:41.129331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-95c0d90e-4915-430b-b6ba-5e6d42eb7888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:41.253943 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2555/5097] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:41 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:41.258041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edecc6a-9f32-402d-a214-3f71217187b8 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:41.358478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edecc6a-9f32-402d-a214-3f71217187b8 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:41.366661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2668ed-350f-484e-851f-ec6e2f9a53bd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:41.367627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2668ed-350f-484e-851f-ec6e2f9a53bd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:41.368041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2668ed-350f-484e-851f-ec6e2f9a53bd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:41.368651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2668ed-350f-484e-851f-ec6e2f9a53bd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:41.370377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2668ed-350f-484e-851f-ec6e2f9a53bd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:41.373133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2668ed-350f-484e-851f-ec6e2f9a53bd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:41.407810 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2543/5098] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:00:41 2021] POST /identity/v3/roles => generated 235 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:41.413129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0d90e-4915-430b-b6ba-5e6d42eb7888 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:41.429645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0d90e-4915-430b-b6ba-5e6d42eb7888 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:41.441163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f424c-fa0e-4acf-9993-1d5290088da7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:41.442680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f424c-fa0e-4acf-9993-1d5290088da7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:41.443547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f424c-fa0e-4acf-9993-1d5290088da7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:41.444227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f424c-fa0e-4acf-9993-1d5290088da7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:41.445228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f424c-fa0e-4acf-9993-1d5290088da7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:41.447497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f424c-fa0e-4acf-9993-1d5290088da7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:41.481373 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2556/5099] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:00:41 2021] POST /identity/v3/roles => generated 235 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:41.491829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2668ed-350f-484e-851f-ec6e2f9a53bd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:41.505590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2668ed-350f-484e-851f-ec6e2f9a53bd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:41.514488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f1d84-50cc-4360-b5be-92f00a358267 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:41.514488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f1d84-50cc-4360-b5be-92f00a358267 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:41.514813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f1d84-50cc-4360-b5be-92f00a358267 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:41.515568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f1d84-50cc-4360-b5be-92f00a358267 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:41.516086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f1d84-50cc-4360-b5be-92f00a358267 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:41.520257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f1d84-50cc-4360-b5be-92f00a358267 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:41.539295 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2544/5100] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:00:41 2021] POST /identity/v3/roles => generated 235 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:41.542054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f424c-fa0e-4acf-9993-1d5290088da7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:41.553754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f424c-fa0e-4acf-9993-1d5290088da7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:41.558306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce13e86-54dc-46d1-bd68-a805b69eaf99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:41.559144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13e86-54dc-46d1-bd68-a805b69eaf99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:41.559849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13e86-54dc-46d1-bd68-a805b69eaf99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:41.560205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13e86-54dc-46d1-bd68-a805b69eaf99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:41.561338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce13e86-54dc-46d1-bd68-a805b69eaf99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:41.562902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce13e86-54dc-46d1-bd68-a805b69eaf99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:41.600874 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2557/5101] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 21:00:41 2021] POST /identity/v3/domains => generated 276 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:41.604875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f1d84-50cc-4360-b5be-92f00a358267 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:41.619688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f1d84-50cc-4360-b5be-92f00a358267 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:41.685798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88726443-8b42-4e33-9aca-023855589805 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:41.686704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726443-8b42-4e33-9aca-023855589805 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:41.686996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726443-8b42-4e33-9aca-023855589805 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:41.687608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726443-8b42-4e33-9aca-023855589805 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:41.689150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88726443-8b42-4e33-9aca-023855589805 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:41.692336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88726443-8b42-4e33-9aca-023855589805 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:41.769010 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2545/5102] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:41 2021] POST /identity/v3/projects => generated 400 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:41.770368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce13e86-54dc-46d1-bd68-a805b69eaf99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:41.787936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce13e86-54dc-46d1-bd68-a805b69eaf99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:41.861653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02cc5e-788f-4dc0-b983-9272acd54892 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:41.862346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02cc5e-788f-4dc0-b983-9272acd54892 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:41.862952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02cc5e-788f-4dc0-b983-9272acd54892 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:41.863593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02cc5e-788f-4dc0-b983-9272acd54892 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/groups` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:41.864935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02cc5e-788f-4dc0-b983-9272acd54892 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:41.867197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02cc5e-788f-4dc0-b983-9272acd54892 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:41.884686 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2558/5103] 10.222.0.21 () {60 vars in 1146 bytes} [Sat Nov 27 21:00:41 2021] POST /identity/v3/groups => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:41.888832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88726443-8b42-4e33-9aca-023855589805 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:41.902037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88726443-8b42-4e33-9aca-023855589805 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:41.906917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1dcd-41b4-4872-ab9b-b3a191c77957 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:41.907639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1dcd-41b4-4872-ab9b-b3a191c77957 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:41.907932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1dcd-41b4-4872-ab9b-b3a191c77957 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:41.908339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1dcd-41b4-4872-ab9b-b3a191c77957 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:41.909135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb1dcd-41b4-4872-ab9b-b3a191c77957 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:41.910758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb1dcd-41b4-4872-ab9b-b3a191c77957 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:41.931689 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2546/5104] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:00:41 2021] POST /identity/v3/roles => generated 235 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:41.933502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02cc5e-788f-4dc0-b983-9272acd54892 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:41.954589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02cc5e-788f-4dc0-b983-9272acd54892 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:41.959678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69fb2-be0f-45b7-8ae1-1e9976c18fb3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:41.960555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69fb2-be0f-45b7-8ae1-1e9976c18fb3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:41.960896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69fb2-be0f-45b7-8ae1-1e9976c18fb3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:41.961323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a69fb2-be0f-45b7-8ae1-1e9976c18fb3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:41.962061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a69fb2-be0f-45b7-8ae1-1e9976c18fb3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:41.964064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a69fb2-be0f-45b7-8ae1-1e9976c18fb3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:41.986232 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2559/5105] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:41 2021] POST /identity/v3/users => generated 442 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:41.991804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1dcd-41b4-4872-ab9b-b3a191c77957 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:42.003797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1dcd-41b4-4872-ab9b-b3a191c77957 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:42.008951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76042ca-3f2a-45cd-a4c1-3abd6d13a954 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:42.009615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76042ca-3f2a-45cd-a4c1-3abd6d13a954 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:42.009897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76042ca-3f2a-45cd-a4c1-3abd6d13a954 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:42.010646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76042ca-3f2a-45cd-a4c1-3abd6d13a954 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:42.010963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76042ca-3f2a-45cd-a4c1-3abd6d13a954 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:42.012790 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-b76042ca-3f2a-45cd-a4c1-3abd6d13a954 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:42.012790 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:00:42.012790 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:00:42.014322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76042ca-3f2a-45cd-a4c1-3abd6d13a954 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:42.046257 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2547/5106] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:00:41 2021] POST /identity/v3/roles => generated 270 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:42.046936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69fb2-be0f-45b7-8ae1-1e9976c18fb3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:42.077272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a69fb2-be0f-45b7-8ae1-1e9976c18fb3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:42.087545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cd7e4-ed12-4205-ab8f-a2364757c331 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:42.089173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cd7e4-ed12-4205-ab8f-a2364757c331 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:42.090921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cd7e4-ed12-4205-ab8f-a2364757c331 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:42.091189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cd7e4-ed12-4205-ab8f-a2364757c331 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/738c3da7610d419588feb2e963b77e13` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:42.116185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cd7e4-ed12-4205-ab8f-a2364757c331 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=738c3da7610d419588feb2e963b77e13)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:42.119949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cd7e4-ed12-4205-ab8f-a2364757c331 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:42.153557 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2560/5107] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:42 2021] PUT /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/738c3da7610d419588feb2e963b77e13 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:42.160963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76042ca-3f2a-45cd-a4c1-3abd6d13a954 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:42.180355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76042ca-3f2a-45cd-a4c1-3abd6d13a954 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:42.286461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d18f-c8e6-4284-a947-b1521f8ea7aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:42.286939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d18f-c8e6-4284-a947-b1521f8ea7aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:42.287355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d18f-c8e6-4284-a947-b1521f8ea7aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:42.287729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d18f-c8e6-4284-a947-b1521f8ea7aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:42.288749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51d18f-c8e6-4284-a947-b1521f8ea7aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Adding query filter params (scope.project.id=d5666232ad764d609fcb7bf3e4ce7f8d, user.id=f2ec3be4079d4ac088bab28e8d9795e7) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:42.289160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51d18f-c8e6-4284-a947-b1521f8ea7aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:42.292464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51d18f-c8e6-4284-a947-b1521f8ea7aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:42.377786 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2548/5108] 10.222.0.21 () {58 vars in 1355 bytes} [Sat Nov 27 21:00:42 2021] GET /identity/v3/role_assignments?scope.project.id=d5666232ad764d609fcb7bf3e4ce7f8d&user.id=f2ec3be4079d4ac088bab28e8d9795e7&effective => generated 228 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:42.382780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cd7e4-ed12-4205-ab8f-a2364757c331 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:42.394641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cd7e4-ed12-4205-ab8f-a2364757c331 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:42.403767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:42.405133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:42.406166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:42.407202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/738c3da7610d419588feb2e963b77e13` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:42.411827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=738c3da7610d419588feb2e963b77e13)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:42.414838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:42.429620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role 738c3da7610d419588feb2e963b77e13 was removed from user f2ec3be4079d4ac088bab28e8d9795e7 on project d5666232ad764d609fcb7bf3e4ce7f8d. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:42.429620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:42.438987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:42.477257 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2561/5109] 10.222.0.21 () {58 vars in 1466 bytes} [Sat Nov 27 21:00:42 2021] DELETE /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/738c3da7610d419588feb2e963b77e13 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:42.481246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d18f-c8e6-4284-a947-b1521f8ea7aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:42.485729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bc51d18f-c8e6-4284-a947-b1521f8ea7aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:42.504957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d18f-c8e6-4284-a947-b1521f8ea7aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:42.670303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:42.674701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:42.674902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:42.679345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/738c3da7610d419588feb2e963b77e13` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:42.685041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=738c3da7610d419588feb2e963b77e13)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:42.687430 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_domain_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:42.687430 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:00:42.687430 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:00:42.688684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:42.714691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:42.716514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:42.790932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role 738c3da7610d419588feb2e963b77e13 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:42.793092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:42.794586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:42.797932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2549/5110] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:42 2021] DELETE /identity/v3/roles/738c3da7610d419588feb2e963b77e13 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:42.806224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:42.810766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:42.927823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873ed6f-70cd-44e0-8016-70e473a2854a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:42.964933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c874d6-066f-49ca-bb54-9ffd06a997d3 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:42.971790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da5dff-a5fd-422c-8aaf-de3c7585a872 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:42.973227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da5dff-a5fd-422c-8aaf-de3c7585a872 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:42.973411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da5dff-a5fd-422c-8aaf-de3c7585a872 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:42.973864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da5dff-a5fd-422c-8aaf-de3c7585a872 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/f18e3b12b5f648d39d3950d5323ad4b3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:42.977502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da5dff-a5fd-422c-8aaf-de3c7585a872 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=f18e3b12b5f648d39d3950d5323ad4b3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:42.981979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da5dff-a5fd-422c-8aaf-de3c7585a872 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:43.003949 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2550/5111] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:42 2021] PUT /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/f18e3b12b5f648d39d3950d5323ad4b3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:43.005269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:43.006567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:43.007107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:43.007577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] PATH_INFO: `/v3/users/fe5f5427da10474fb1eaffa7469c5841` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:43.007738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da5dff-a5fd-422c-8aaf-de3c7585a872 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:43.010508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5f5427da10474fb1eaffa7469c5841)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:43.013064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:43.126777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5f5427da10474fb1eaffa7469c5841'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:43.127705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5f5427da10474fb1eaffa7469c5841'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:43.132824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da5dff-a5fd-422c-8aaf-de3c7585a872 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:43.140698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749d69c-89b0-4eec-8c1c-1467b5de2dc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:43.143730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749d69c-89b0-4eec-8c1c-1467b5de2dc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:43.150078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749d69c-89b0-4eec-8c1c-1467b5de2dc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:43.150678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749d69c-89b0-4eec-8c1c-1467b5de2dc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:43.153168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749d69c-89b0-4eec-8c1c-1467b5de2dc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:43.154825 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-7749d69c-89b0-4eec-8c1c-1467b5de2dc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:43.154825 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:00:43.154825 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:00:43.156190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749d69c-89b0-4eec-8c1c-1467b5de2dc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:43.165669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5f5427da10474fb1eaffa7469c5841'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:43.179565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5f5427da10474fb1eaffa7469c5841'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:43.212433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5f5427da10474fb1eaffa7469c5841'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:43.240821 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2551/5112] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:43 2021] PUT /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 521 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:43.245773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749d69c-89b0-4eec-8c1c-1467b5de2dc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:43.280764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7749d69c-89b0-4eec-8c1c-1467b5de2dc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:43.359335 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2562/5113] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:42 2021] DELETE /identity/v3/users/fe5f5427da10474fb1eaffa7469c5841 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:43.517389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749d69c-89b0-4eec-8c1c-1467b5de2dc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:43.637867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b754cb-07ed-4bb0-a5f1-8181fa0e7471 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:43.638540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b754cb-07ed-4bb0-a5f1-8181fa0e7471 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:43.638996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b754cb-07ed-4bb0-a5f1-8181fa0e7471 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:43.639321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b754cb-07ed-4bb0-a5f1-8181fa0e7471 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:43.642362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b754cb-07ed-4bb0-a5f1-8181fa0e7471 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Adding query filter params (scope.project.id=d5666232ad764d609fcb7bf3e4ce7f8d, user.id=f2ec3be4079d4ac088bab28e8d9795e7) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:43.642524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b754cb-07ed-4bb0-a5f1-8181fa0e7471 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:43.644998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b754cb-07ed-4bb0-a5f1-8181fa0e7471 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:43.774433 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2552/5114] 10.222.0.21 () {58 vars in 1355 bytes} [Sat Nov 27 21:00:43 2021] GET /identity/v3/role_assignments?scope.project.id=d5666232ad764d609fcb7bf3e4ce7f8d&user.id=f2ec3be4079d4ac088bab28e8d9795e7&effective => generated 1061 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:43.775088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:43.792143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596090ba-a3bc-462d-8e83-5bcc753c28b2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:43.802962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca792f-21ca-452c-9257-6ded846ebc64 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:43.806378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca792f-21ca-452c-9257-6ded846ebc64 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:43.806805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca792f-21ca-452c-9257-6ded846ebc64 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:43.807127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca792f-21ca-452c-9257-6ded846ebc64 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:43.813455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca792f-21ca-452c-9257-6ded846ebc64 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:43.817470 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-74ca792f-21ca-452c-9257-6ded846ebc64 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:43.817470 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:43.817470 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:43.822410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca792f-21ca-452c-9257-6ded846ebc64 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:43.855798 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2563/5115] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:43 2021] DELETE /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:43.860779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b754cb-07ed-4bb0-a5f1-8181fa0e7471 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:43.879021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b754cb-07ed-4bb0-a5f1-8181fa0e7471 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:44.039762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa7f14-b54f-461f-9a78-ac29374c2ce4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:44.040479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa7f14-b54f-461f-9a78-ac29374c2ce4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:44.040906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa7f14-b54f-461f-9a78-ac29374c2ce4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:44.041309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa7f14-b54f-461f-9a78-ac29374c2ce4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:44.050159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa7f14-b54f-461f-9a78-ac29374c2ce4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Adding query filter params (scope.project.id=d5666232ad764d609fcb7bf3e4ce7f8d, user.id=f2ec3be4079d4ac088bab28e8d9795e7) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:44.051406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa7f14-b54f-461f-9a78-ac29374c2ce4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:44.057639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa7f14-b54f-461f-9a78-ac29374c2ce4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:44.193608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca792f-21ca-452c-9257-6ded846ebc64 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:44.196353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-74ca792f-21ca-452c-9257-6ded846ebc64 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:44.246951 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2553/5116] 10.222.0.21 () {58 vars in 1355 bytes} [Sat Nov 27 21:00:43 2021] GET /identity/v3/role_assignments?scope.project.id=d5666232ad764d609fcb7bf3e4ce7f8d&user.id=f2ec3be4079d4ac088bab28e8d9795e7&effective => generated 577 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:00:44.255370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa7f14-b54f-461f-9a78-ac29374c2ce4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:44.287968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa7f14-b54f-461f-9a78-ac29374c2ce4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:44.321526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8cd3-39fa-4dac-bf5c-5e044f6f1e86 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:44.330802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8cd3-39fa-4dac-bf5c-5e044f6f1e86 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:44.331154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8cd3-39fa-4dac-bf5c-5e044f6f1e86 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:44.331412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8cd3-39fa-4dac-bf5c-5e044f6f1e86 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:44.342755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf8cd3-39fa-4dac-bf5c-5e044f6f1e86 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:44.345181 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-e8bf8cd3-39fa-4dac-bf5c-5e044f6f1e86 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:44.345181 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:00:44.345181 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:00:44.349234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf8cd3-39fa-4dac-bf5c-5e044f6f1e86 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:44.428084 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-e8bf8cd3-39fa-4dac-bf5c-5e044f6f1e86 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] f18e3b12b5f648d39d3950d5323ad4b3 does not imply 371ec2aa26b042a2a7c90d0ec0612bc1.: keystone.exception.ImpliedRoleNotFound: f18e3b12b5f648d39d3950d5323ad4b3 does not imply 371ec2aa26b042a2a7c90d0ec0612bc1. Nov 27 21:00:44.429420 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2554/5117] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:44 2021] DELETE /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 137 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:00:44.434788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8cd3-39fa-4dac-bf5c-5e044f6f1e86 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:44.473446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf8cd3-39fa-4dac-bf5c-5e044f6f1e86 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:44.487290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca792f-21ca-452c-9257-6ded846ebc64 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:44.489089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:44.489993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:44.490281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:44.491695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/f18e3b12b5f648d39d3950d5323ad4b3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:44.494650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=f18e3b12b5f648d39d3950d5323ad4b3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:44.499909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:44.501480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:44.501900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:44.502187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] PATH_INFO: `/v3/projects/cff35596309b4b038ea9f8ddc36824d8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:44.503568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:44.507081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff35596309b4b038ea9f8ddc36824d8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:44.509128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:44.517390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role f18e3b12b5f648d39d3950d5323ad4b3 was removed from user f2ec3be4079d4ac088bab28e8d9795e7 on project d5666232ad764d609fcb7bf3e4ce7f8d. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:44.517883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:44.521037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:44.544698 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2555/5118] 10.222.0.21 () {58 vars in 1466 bytes} [Sat Nov 27 21:00:44 2021] DELETE /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/f18e3b12b5f648d39d3950d5323ad4b3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:44.550630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:44.552081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:44.630444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff35596309b4b038ea9f8ddc36824d8', 'request_id': 'req-820787d9-f799-45fc-ba21-57255201a968'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:44.643793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff35596309b4b038ea9f8ddc36824d8', 'request_id': 'req-820787d9-f799-45fc-ba21-57255201a968'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:44.658990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff35596309b4b038ea9f8ddc36824d8', 'request_id': 'req-820787d9-f799-45fc-ba21-57255201a968'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:44.698101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6efcf-3484-4ad5-bd1d-378014e82b99 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:44.699361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] The token cache is being invalidate because project cff35596309b4b038ea9f8ddc36824d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:44.700034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:44.701366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:44.706305 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2564/5119] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:44 2021] DELETE /identity/v3/projects/cff35596309b4b038ea9f8ddc36824d8 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:44.713939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:44.718989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:44.853868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc1321-689b-4042-b4b4-57658c8a1884 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:44.854593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc1321-689b-4042-b4b4-57658c8a1884 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:44.854837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc1321-689b-4042-b4b4-57658c8a1884 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:44.855120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc1321-689b-4042-b4b4-57658c8a1884 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:44.855922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc1321-689b-4042-b4b4-57658c8a1884 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:44.862225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc1321-689b-4042-b4b4-57658c8a1884 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:44.880980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820787d9-f799-45fc-ba21-57255201a968 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:44.888444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:44.889867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:44.890524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:44.891195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] PATH_INFO: `/v3/users/e730c44027c84bbe97abd9f98f4c8b9a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:44.893687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e730c44027c84bbe97abd9f98f4c8b9a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:44.894395 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2556/5120] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:44 2021] POST /identity/v3/roles => generated 271 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:44.895365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc1321-689b-4042-b4b4-57658c8a1884 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:44.897679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b7fc1321-689b-4042-b4b4-57658c8a1884 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:44.911397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:44.924611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc1321-689b-4042-b4b4-57658c8a1884 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:44.943389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec56c-2806-4deb-b669-b196947d418d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:44.945623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec56c-2806-4deb-b669-b196947d418d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:44.946004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec56c-2806-4deb-b669-b196947d418d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:44.946419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec56c-2806-4deb-b669-b196947d418d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:44.949572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ec56c-2806-4deb-b669-b196947d418d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Adding query filter params (domain_id=a66e64e81ec440658d5efb2e32746906) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:44.950057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ec56c-2806-4deb-b669-b196947d418d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:44.951286 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-2b5ec56c-2806-4deb-b669-b196947d418d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domain_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:44.951286 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:00:44.951286 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:00:44.956390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ec56c-2806-4deb-b669-b196947d418d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:44.990105 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2557/5121] 10.222.0.21 () {58 vars in 1206 bytes} [Sat Nov 27 21:00:44 2021] GET /identity/v3/roles?domain_id=a66e64e81ec440658d5efb2e32746906 => generated 408 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:44.994326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec56c-2806-4deb-b669-b196947d418d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:45.001359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e730c44027c84bbe97abd9f98f4c8b9a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:45.003047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e730c44027c84bbe97abd9f98f4c8b9a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:45.053139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec56c-2806-4deb-b669-b196947d418d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:45.064724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e730c44027c84bbe97abd9f98f4c8b9a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:45.068948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e730c44027c84bbe97abd9f98f4c8b9a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:45.076125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:45.077626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:45.079415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:45.079938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/38a2d9ee937f4074bc6d57a365d01a93` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:45.083888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=38a2d9ee937f4074bc6d57a365d01a93)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:45.089458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:45.091559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e730c44027c84bbe97abd9f98f4c8b9a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:45.138528 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2565/5122] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:44 2021] DELETE /identity/v3/users/e730c44027c84bbe97abd9f98f4c8b9a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:45.220946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role 38a2d9ee937f4074bc6d57a365d01a93 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:45.221408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:45.224423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:45.228880 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2558/5123] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:44 2021] DELETE /identity/v3/roles/38a2d9ee937f4074bc6d57a365d01a93 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:45.232880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:45.235180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:45.434999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eff85-02ef-41dc-a7fb-bf5751adc3b1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:45.564136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65a37e-062c-4861-bb53-666bcfbd3983 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:45.565153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65a37e-062c-4861-bb53-666bcfbd3983 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:45.566761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65a37e-062c-4861-bb53-666bcfbd3983 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:45.568161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65a37e-062c-4861-bb53-666bcfbd3983 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:45.569264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65a37e-062c-4861-bb53-666bcfbd3983 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Adding query filter params (domain_id=a66e64e81ec440658d5efb2e32746906) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:45.570081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65a37e-062c-4861-bb53-666bcfbd3983 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:45.573182 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-fe65a37e-062c-4861-bb53-666bcfbd3983 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domain_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:45.573182 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:45.573182 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:45.579670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65a37e-062c-4861-bb53-666bcfbd3983 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:45.595630 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2566/5124] 10.222.0.21 () {58 vars in 1206 bytes} [Sat Nov 27 21:00:45 2021] GET /identity/v3/roles?domain_id=a66e64e81ec440658d5efb2e32746906 => generated 148 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:45.599695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:45.601267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:45.624665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da811c6-06ce-41db-889e-9165d6cf2e77 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:45.639556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b605b81-a912-4918-af51-c813a75928df tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:45.640593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605b81-a912-4918-af51-c813a75928df tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:45.641561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605b81-a912-4918-af51-c813a75928df tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:45.641949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605b81-a912-4918-af51-c813a75928df tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/38a2d9ee937f4074bc6d57a365d01a93` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:45.667879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b605b81-a912-4918-af51-c813a75928df tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 21:00:45.684696 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-7b605b81-a912-4918-af51-c813a75928df tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Could not find role: 38a2d9ee937f4074bc6d57a365d01a93.: keystone.exception.RoleNotFound: Could not find role: 38a2d9ee937f4074bc6d57a365d01a93. Nov 27 21:00:45.690093 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2559/5125] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:45 2021] DELETE /identity/v3/roles/38a2d9ee937f4074bc6d57a365d01a93 => generated 110 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:00:45.695426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65a37e-062c-4861-bb53-666bcfbd3983 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:45.717244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65a37e-062c-4861-bb53-666bcfbd3983 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:45.723864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f8334-6f87-435f-afa6-97a0d1e859e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:45.725227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8334-6f87-435f-afa6-97a0d1e859e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:45.725637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8334-6f87-435f-afa6-97a0d1e859e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:45.726015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8334-6f87-435f-afa6-97a0d1e859e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/a66e64e81ec440658d5efb2e32746906/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:45.734064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f8334-6f87-435f-afa6-97a0d1e859e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a66e64e81ec440658d5efb2e32746906, group_id=0283fc14b5d1418a99c128119d7b4b67, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:45.736761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f8334-6f87-435f-afa6-97a0d1e859e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:45.763415 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2567/5126] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:45 2021] PUT /identity/v3/domains/a66e64e81ec440658d5efb2e32746906/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:45.768620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b605b81-a912-4918-af51-c813a75928df tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:45.792652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b605b81-a912-4918-af51-c813a75928df tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:45.943852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340ea9c-ccd5-4cdf-8f22-29edd126de42 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:45.947704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340ea9c-ccd5-4cdf-8f22-29edd126de42 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:45.948270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340ea9c-ccd5-4cdf-8f22-29edd126de42 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:45.948770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340ea9c-ccd5-4cdf-8f22-29edd126de42 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/a66e64e81ec440658d5efb2e32746906/groups/0283fc14b5d1418a99c128119d7b4b67/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:45.953277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340ea9c-ccd5-4cdf-8f22-29edd126de42 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a66e64e81ec440658d5efb2e32746906, group_id=0283fc14b5d1418a99c128119d7b4b67)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:45.957670 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-9340ea9c-ccd5-4cdf-8f22-29edd126de42 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_grants failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:45.957670 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:00:45.957670 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:00:45.960907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340ea9c-ccd5-4cdf-8f22-29edd126de42 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:45.998859 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2560/5127] 10.222.0.21 () {58 vars in 1364 bytes} [Sat Nov 27 21:00:45 2021] GET /identity/v3/domains/a66e64e81ec440658d5efb2e32746906/groups/0283fc14b5d1418a99c128119d7b4b67/roles => generated 410 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:46.002671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f8334-6f87-435f-afa6-97a0d1e859e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:46.019739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f8334-6f87-435f-afa6-97a0d1e859e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:46.028364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f585ee-bdbd-40fa-b4ec-d9ca9dd5cd68 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:46.030149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f585ee-bdbd-40fa-b4ec-d9ca9dd5cd68 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:46.030740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f585ee-bdbd-40fa-b4ec-d9ca9dd5cd68 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:46.031510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f585ee-bdbd-40fa-b4ec-d9ca9dd5cd68 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/a66e64e81ec440658d5efb2e32746906/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:46.036293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f585ee-bdbd-40fa-b4ec-d9ca9dd5cd68 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a66e64e81ec440658d5efb2e32746906, group_id=0283fc14b5d1418a99c128119d7b4b67, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:46.039735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f585ee-bdbd-40fa-b4ec-d9ca9dd5cd68 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:46.052591 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2568/5128] 10.222.0.21 () {58 vars in 1464 bytes} [Sat Nov 27 21:00:46 2021] HEAD /identity/v3/domains/a66e64e81ec440658d5efb2e32746906/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:46.057198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340ea9c-ccd5-4cdf-8f22-29edd126de42 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:46.085020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340ea9c-ccd5-4cdf-8f22-29edd126de42 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:46.091863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875faac-4345-4b1d-8fcf-c887739c9253 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:46.093281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875faac-4345-4b1d-8fcf-c887739c9253 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:46.094324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875faac-4345-4b1d-8fcf-c887739c9253 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:46.095346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875faac-4345-4b1d-8fcf-c887739c9253 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/a66e64e81ec440658d5efb2e32746906/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:46.099450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875faac-4345-4b1d-8fcf-c887739c9253 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a66e64e81ec440658d5efb2e32746906, group_id=0283fc14b5d1418a99c128119d7b4b67, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:46.104616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875faac-4345-4b1d-8fcf-c887739c9253 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:46.113491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3875faac-4345-4b1d-8fcf-c887739c9253 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role d23755780ff0440199fe8d4ed2204af0 was removed from group 0283fc14b5d1418a99c128119d7b4b67 on domain a66e64e81ec440658d5efb2e32746906. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:46.113799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3875faac-4345-4b1d-8fcf-c887739c9253 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:46.114733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3875faac-4345-4b1d-8fcf-c887739c9253 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:46.139872 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2561/5129] 10.222.0.21 () {58 vars in 1466 bytes} [Sat Nov 27 21:00:46 2021] DELETE /identity/v3/domains/a66e64e81ec440658d5efb2e32746906/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:46.144460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f585ee-bdbd-40fa-b4ec-d9ca9dd5cd68 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:46.147560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d5f585ee-bdbd-40fa-b4ec-d9ca9dd5cd68 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:46.168575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f585ee-bdbd-40fa-b4ec-d9ca9dd5cd68 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:46.269390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80176f-e98f-4121-a2b5-8cc4cda7cbe6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:46.271783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80176f-e98f-4121-a2b5-8cc4cda7cbe6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:46.273430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80176f-e98f-4121-a2b5-8cc4cda7cbe6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:46.274076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80176f-e98f-4121-a2b5-8cc4cda7cbe6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:46.281361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80176f-e98f-4121-a2b5-8cc4cda7cbe6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, group_id=0283fc14b5d1418a99c128119d7b4b67, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:46.287660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80176f-e98f-4121-a2b5-8cc4cda7cbe6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:46.322690 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2569/5130] 10.222.0.21 () {60 vars in 1485 bytes} [Sat Nov 27 21:00:46 2021] PUT /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:46.326773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875faac-4345-4b1d-8fcf-c887739c9253 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:46.353263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80176f-e98f-4121-a2b5-8cc4cda7cbe6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:46.357773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0c80176f-e98f-4121-a2b5-8cc4cda7cbe6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:46.365110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875faac-4345-4b1d-8fcf-c887739c9253 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:46.587053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cad2e-2528-461b-a14a-3fce1b69a7f1 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:46.587381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80176f-e98f-4121-a2b5-8cc4cda7cbe6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:46.589050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cad2e-2528-461b-a14a-3fce1b69a7f1 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:46.589542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cad2e-2528-461b-a14a-3fce1b69a7f1 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:46.589847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023cad2e-2528-461b-a14a-3fce1b69a7f1 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/groups/0283fc14b5d1418a99c128119d7b4b67/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:46.592687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cad2e-2528-461b-a14a-3fce1b69a7f1 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_grants(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, group_id=0283fc14b5d1418a99c128119d7b4b67)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:46.593026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:46.593889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:46.594705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:46.594985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] PATH_INFO: `/v3/projects/64a22d416fda4b5e8c668a1ba24ef12a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:46.596562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a22d416fda4b5e8c668a1ba24ef12a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:46.596691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023cad2e-2528-461b-a14a-3fce1b69a7f1 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:46.598493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:46.617705 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2562/5131] 10.222.0.21 () {58 vars in 1367 bytes} [Sat Nov 27 21:00:46 2021] GET /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/groups/0283fc14b5d1418a99c128119d7b4b67/roles => generated 411 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:00:46.619420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cad2e-2528-461b-a14a-3fce1b69a7f1 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:46.635500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023cad2e-2528-461b-a14a-3fce1b69a7f1 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:46.645527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614dbbe-5e42-4321-b7d5-8dea8690cd7c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:46.646889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614dbbe-5e42-4321-b7d5-8dea8690cd7c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:46.647230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614dbbe-5e42-4321-b7d5-8dea8690cd7c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:46.648440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614dbbe-5e42-4321-b7d5-8dea8690cd7c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/groups/0283fc14b5d1418a99c128119d7b4b67/users/f2ec3be4079d4ac088bab28e8d9795e7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:46.650747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614dbbe-5e42-4321-b7d5-8dea8690cd7c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0283fc14b5d1418a99c128119d7b4b67, user_id=f2ec3be4079d4ac088bab28e8d9795e7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:46.654115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614dbbe-5e42-4321-b7d5-8dea8690cd7c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:46.658716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a22d416fda4b5e8c668a1ba24ef12a', 'request_id': 'req-5e4e1a33-e40f-4ce3-855c-83782428a59e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:46.666931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a22d416fda4b5e8c668a1ba24ef12a', 'request_id': 'req-5e4e1a33-e40f-4ce3-855c-83782428a59e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:46.682090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a22d416fda4b5e8c668a1ba24ef12a', 'request_id': 'req-5e4e1a33-e40f-4ce3-855c-83782428a59e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:46.697872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] The token cache is being invalidate because project 64a22d416fda4b5e8c668a1ba24ef12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:46.698406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:46.701041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e4e1a33-e40f-4ce3-855c-83782428a59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:46.704725 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2563/5132] 10.222.0.21 () {60 vars in 1359 bytes} [Sat Nov 27 21:00:46 2021] PUT /identity/v3/groups/0283fc14b5d1418a99c128119d7b4b67/users/f2ec3be4079d4ac088bab28e8d9795e7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:46.704873 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2570/5133] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:46 2021] DELETE /identity/v3/projects/64a22d416fda4b5e8c668a1ba24ef12a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:46.715170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa74be-17ec-462a-8316-131cfade0259 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:46.715760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d594d-0e92-4862-8506-de82bacfb7c7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:46.716326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa74be-17ec-462a-8316-131cfade0259 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:46.718851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d594d-0e92-4862-8506-de82bacfb7c7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:46.721127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d594d-0e92-4862-8506-de82bacfb7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:46.722428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa74be-17ec-462a-8316-131cfade0259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:46.750892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8f2d594d-0e92-4862-8506-de82bacfb7c7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:46.753558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8f2d594d-0e92-4862-8506-de82bacfb7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:46.787556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-65fa74be-17ec-462a-8316-131cfade0259 None None] MFA Rules not processed for user `f2ec3be4079d4ac088bab28e8d9795e7`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:46.788846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-65fa74be-17ec-462a-8316-131cfade0259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:46.852001 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2571/5134] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:46.865596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6960e-e6b5-4f7d-a977-65848c920292 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:46.866030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6960e-e6b5-4f7d-a977-65848c920292 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:46.867734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6960e-e6b5-4f7d-a977-65848c920292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:46.902834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-66e6960e-e6b5-4f7d-a977-65848c920292 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:46.903836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-66e6960e-e6b5-4f7d-a977-65848c920292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:46.923358 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2572/5135] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:46.925201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6960e-e6b5-4f7d-a977-65848c920292 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:46.947708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6960e-e6b5-4f7d-a977-65848c920292 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:46.963592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22414-e6b6-4da9-8f53-af562f813d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:46.967240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22414-e6b6-4da9-8f53-af562f813d80 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:46.967899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22414-e6b6-4da9-8f53-af562f813d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:46.968375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b22414-e6b6-4da9-8f53-af562f813d80 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:46.969599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b22414-e6b6-4da9-8f53-af562f813d80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:46.970133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b22414-e6b6-4da9-8f53-af562f813d80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:46.972071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b22414-e6b6-4da9-8f53-af562f813d80 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:46.975045 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2564/5136] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:46 2021] POST /identity/v3/auth/tokens => generated 3255 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:46.978569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa74be-17ec-462a-8316-131cfade0259 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:46.980721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-65fa74be-17ec-462a-8316-131cfade0259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:47.016805 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2573/5137] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:00:47.026899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22414-e6b6-4da9-8f53-af562f813d80 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:47.049813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b22414-e6b6-4da9-8f53-af562f813d80 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:47.059176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa7bbd-de50-4801-a7a9-12c4fc6ceb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:47.060316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa7bbd-de50-4801-a7a9-12c4fc6ceb9a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.061017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa7bbd-de50-4801-a7a9-12c4fc6ceb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.061571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa7bbd-de50-4801-a7a9-12c4fc6ceb9a admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.063981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa7bbd-de50-4801-a7a9-12c4fc6ceb9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:47.067620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa7bbd-de50-4801-a7a9-12c4fc6ceb9a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:47.106138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa74be-17ec-462a-8316-131cfade0259 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:47.113957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac075a-6ba8-4586-8914-e817954ba3a0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:47.115347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac075a-6ba8-4586-8914-e817954ba3a0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.115347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac075a-6ba8-4586-8914-e817954ba3a0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.115884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac075a-6ba8-4586-8914-e817954ba3a0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.120091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac075a-6ba8-4586-8914-e817954ba3a0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, group_id=0283fc14b5d1418a99c128119d7b4b67, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:47.123693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac075a-6ba8-4586-8914-e817954ba3a0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:47.134874 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2565/5138] 10.222.0.21 () {58 vars in 1467 bytes} [Sat Nov 27 21:00:46 2021] HEAD /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:47.135080 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2574/5139] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:47 2021] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:47.139433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa7bbd-de50-4801-a7a9-12c4fc6ceb9a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:47.139919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac075a-6ba8-4586-8914-e817954ba3a0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:47.157339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac075a-6ba8-4586-8914-e817954ba3a0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:47.234454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa7bbd-de50-4801-a7a9-12c4fc6ceb9a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:47.241237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:47.242203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.242537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.243005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.246064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, group_id=0283fc14b5d1418a99c128119d7b4b67, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:47.246746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f927db0-fd2a-4de5-bd02-f14f2886ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:47.248071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f927db0-fd2a-4de5-bd02-f14f2886ec8b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.248863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f927db0-fd2a-4de5-bd02-f14f2886ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.249414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:47.249977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f927db0-fd2a-4de5-bd02-f14f2886ec8b admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.252051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f927db0-fd2a-4de5-bd02-f14f2886ec8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:47.255604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f927db0-fd2a-4de5-bd02-f14f2886ec8b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:47.257211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role d23755780ff0440199fe8d4ed2204af0 was removed from group 0283fc14b5d1418a99c128119d7b4b67 on project d5666232ad764d609fcb7bf3e4ce7f8d. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:47.257512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:47.259089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:47.280752 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2575/5140] 10.222.0.21 () {58 vars in 1469 bytes} [Sat Nov 27 21:00:47 2021] DELETE /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:47.285677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:47.287470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:47.289993 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2566/5141] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:47 2021] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:47.295644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f927db0-fd2a-4de5-bd02-f14f2886ec8b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:47.300082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9f927db0-fd2a-4de5-bd02-f14f2886ec8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:47.322555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f927db0-fd2a-4de5-bd02-f14f2886ec8b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:47.423626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ecd8e-6b5f-4fa0-b28a-e138392eef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:47.424372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ecd8e-6b5f-4fa0-b28a-e138392eef60 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.424715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ecd8e-6b5f-4fa0-b28a-e138392eef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.425956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ecd8e-6b5f-4fa0-b28a-e138392eef60 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.425956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ecd8e-6b5f-4fa0-b28a-e138392eef60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:47.428885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ecd8e-6b5f-4fa0-b28a-e138392eef60 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:47.445292 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2567/5142] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:47 2021] GET /identity/v3/roles => generated 2324 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:47.451410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ecd8e-6b5f-4fa0-b28a-e138392eef60 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:47.458907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f2c7c-f604-4cd1-a3e2-557630b7b9f2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:47.473834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0b943-df19-42c2-8dc5-05e28372267c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:47.475870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0b943-df19-42c2-8dc5-05e28372267c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.476324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0b943-df19-42c2-8dc5-05e28372267c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.476548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ecd8e-6b5f-4fa0-b28a-e138392eef60 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:47.477753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0b943-df19-42c2-8dc5-05e28372267c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/groups/0283fc14b5d1418a99c128119d7b4b67/users/f2ec3be4079d4ac088bab28e8d9795e7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.482761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0b943-df19-42c2-8dc5-05e28372267c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=0283fc14b5d1418a99c128119d7b4b67, user_id=f2ec3be4079d4ac088bab28e8d9795e7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:47.483032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c104f8-f64d-44e4-baeb-228e8457aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:47.483794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c104f8-f64d-44e4-baeb-228e8457aa1a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.484081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c104f8-f64d-44e4-baeb-228e8457aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.484448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c104f8-f64d-44e4-baeb-228e8457aa1a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.485789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c104f8-f64d-44e4-baeb-228e8457aa1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:47.487459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c104f8-f64d-44e4-baeb-228e8457aa1a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:47.488925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0b943-df19-42c2-8dc5-05e28372267c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:47.504303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-abd0b943-df19-42c2-8dc5-05e28372267c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f2ec3be4079d4ac088bab28e8d9795e7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:47.523329 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2568/5143] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:47 2021] GET /identity/v3/roles => generated 2324 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:47.524970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c104f8-f64d-44e4-baeb-228e8457aa1a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:47.539399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c104f8-f64d-44e4-baeb-228e8457aa1a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:47.543500 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2576/5144] 10.222.0.21 () {58 vars in 1343 bytes} [Sat Nov 27 21:00:47 2021] DELETE /identity/v3/groups/0283fc14b5d1418a99c128119d7b4b67/users/f2ec3be4079d4ac088bab28e8d9795e7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:47.545548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0b943-df19-42c2-8dc5-05e28372267c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:47.641334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fce25-49bf-40ea-b4e3-2cf8213dd55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:47.642299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fce25-49bf-40ea-b4e3-2cf8213dd55d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.642584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fce25-49bf-40ea-b4e3-2cf8213dd55d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.642868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fce25-49bf-40ea-b4e3-2cf8213dd55d admin admin] PATH_INFO: `/v3/projects/903ef22f2af54bfb88e2bb2c17166a70/users/6110ae1426b14de5a68130329ced30f3/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.677133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fce25-49bf-40ea-b4e3-2cf8213dd55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=903ef22f2af54bfb88e2bb2c17166a70, user_id=6110ae1426b14de5a68130329ced30f3, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:47.677493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0b943-df19-42c2-8dc5-05e28372267c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:47.684990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fce25-49bf-40ea-b4e3-2cf8213dd55d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:47.714079 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2569/5145] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:47 2021] PUT /identity/v3/projects/903ef22f2af54bfb88e2bb2c17166a70/users/6110ae1426b14de5a68130329ced30f3/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:47.725659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955d9a1-0c8c-491c-885d-74792424de1c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:47.733353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e7c35-e3a5-42c3-a516-b71e37680043 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.735925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955d9a1-0c8c-491c-885d-74792424de1c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.736564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955d9a1-0c8c-491c-885d-74792424de1c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.737016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e7c35-e3a5-42c3-a516-b71e37680043 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.737334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955d9a1-0c8c-491c-885d-74792424de1c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/system/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.737504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e7c35-e3a5-42c3-a516-b71e37680043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.740234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955d9a1-0c8c-491c-885d-74792424de1c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=0283fc14b5d1418a99c128119d7b4b67, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:47.741704 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-a955d9a1-0c8c-491c-885d-74792424de1c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:47.741704 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:47.741704 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:47.743173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955d9a1-0c8c-491c-885d-74792424de1c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:47.758073 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2577/5146] 10.222.0.21 () {60 vars in 1380 bytes} [Sat Nov 27 21:00:47 2021] PUT /identity/v3/system/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:47.762531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955d9a1-0c8c-491c-885d-74792424de1c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:47.778970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955d9a1-0c8c-491c-885d-74792424de1c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:47.792456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7b2e7c35-e3a5-42c3-a516-b71e37680043 None None] MFA Rules not processed for user `6110ae1426b14de5a68130329ced30f3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:47.794185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7b2e7c35-e3a5-42c3-a516-b71e37680043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:47.903420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a0a8f-f56a-4b85-97c0-5bfbbded4027 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:47.904322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a0a8f-f56a-4b85-97c0-5bfbbded4027 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.904965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a0a8f-f56a-4b85-97c0-5bfbbded4027 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.905321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a0a8f-f56a-4b85-97c0-5bfbbded4027 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/system/groups/0283fc14b5d1418a99c128119d7b4b67/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.906653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a0a8f-f56a-4b85-97c0-5bfbbded4027 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=0283fc14b5d1418a99c128119d7b4b67)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:47.907976 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-a57a0a8f-f56a-4b85-97c0-5bfbbded4027 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_system_grants_for_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:47.907976 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:47.907976 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:47.909100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a0a8f-f56a-4b85-97c0-5bfbbded4027 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:47.929895 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2578/5147] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 21:00:47 2021] GET /identity/v3/system/groups/0283fc14b5d1418a99c128119d7b4b67/roles => generated 376 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:47.931979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a0a8f-f56a-4b85-97c0-5bfbbded4027 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:47.936155 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2570/5148] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:47 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:47.942292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e7c35-e3a5-42c3-a516-b71e37680043 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:47.951014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a0a8f-f56a-4b85-97c0-5bfbbded4027 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:47.959329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dab957-a55f-41e2-91b9-c0fcef0fa4b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:47.960916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dab957-a55f-41e2-91b9-c0fcef0fa4b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:47.961313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dab957-a55f-41e2-91b9-c0fcef0fa4b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:47.961785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dab957-a55f-41e2-91b9-c0fcef0fa4b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/system/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:47.965227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dab957-a55f-41e2-91b9-c0fcef0fa4b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=0283fc14b5d1418a99c128119d7b4b67, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:47.966737 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-c5dab957-a55f-41e2-91b9-c0fcef0fa4b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_system_grant_for_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:47.966737 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:47.966737 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:47.969142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dab957-a55f-41e2-91b9-c0fcef0fa4b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:47.982624 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2579/5149] 10.222.0.21 () {58 vars in 1362 bytes} [Sat Nov 27 21:00:47 2021] HEAD /identity/v3/system/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:47.985182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dab957-a55f-41e2-91b9-c0fcef0fa4b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:48.002543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dab957-a55f-41e2-91b9-c0fcef0fa4b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:48.010116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe08277-b18a-457e-91a7-6cd9638721ea tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:48.011348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe08277-b18a-457e-91a7-6cd9638721ea tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:48.011949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe08277-b18a-457e-91a7-6cd9638721ea tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:48.012402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe08277-b18a-457e-91a7-6cd9638721ea tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/system/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:48.033673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe08277-b18a-457e-91a7-6cd9638721ea tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=0283fc14b5d1418a99c128119d7b4b67, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:48.033673 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-1fe08277-b18a-457e-91a7-6cd9638721ea tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:revoke_system_grant_for_group failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:48.033673 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:48.033673 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:48.037101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe08277-b18a-457e-91a7-6cd9638721ea tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:48.078500 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2580/5150] 10.222.0.21 () {58 vars in 1364 bytes} [Sat Nov 27 21:00:47 2021] DELETE /identity/v3/system/groups/0283fc14b5d1418a99c128119d7b4b67/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:48.079769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe08277-b18a-457e-91a7-6cd9638721ea tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:48.113107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe08277-b18a-457e-91a7-6cd9638721ea tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:48.136310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde1f7-04ae-4be4-bd36-3a3bca844976 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:48.137623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde1f7-04ae-4be4-bd36-3a3bca844976 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:48.138015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde1f7-04ae-4be4-bd36-3a3bca844976 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:48.139709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fde1f7-04ae-4be4-bd36-3a3bca844976 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/a66e64e81ec440658d5efb2e32746906/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:48.143509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fde1f7-04ae-4be4-bd36-3a3bca844976 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a66e64e81ec440658d5efb2e32746906, user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:48.148214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fde1f7-04ae-4be4-bd36-3a3bca844976 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:48.149621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e7c35-e3a5-42c3-a516-b71e37680043 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:48.178413 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2581/5151] 10.222.0.21 () {60 vars in 1479 bytes} [Sat Nov 27 21:00:48 2021] PUT /identity/v3/domains/a66e64e81ec440658d5efb2e32746906/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:48.183401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde1f7-04ae-4be4-bd36-3a3bca844976 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:48.206450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc8b56-1250-4e4b-b73d-5a619249b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:48.207124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc8b56-1250-4e4b-b73d-5a619249b303 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:48.207459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc8b56-1250-4e4b-b73d-5a619249b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:48.207735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc8b56-1250-4e4b-b73d-5a619249b303 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:48.208457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc8b56-1250-4e4b-b73d-5a619249b303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:48.211024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc8b56-1250-4e4b-b73d-5a619249b303 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:48.308418 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2571/5152] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:47 2021] POST /identity/v3/projects => generated 379 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:48.313426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc8b56-1250-4e4b-b73d-5a619249b303 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:48.358832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fde1f7-04ae-4be4-bd36-3a3bca844976 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:48.466049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc8b56-1250-4e4b-b73d-5a619249b303 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:48.479427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c678d-d0c5-4a54-88bb-c9ff8daeb1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:48.480553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c678d-d0c5-4a54-88bb-c9ff8daeb1ee admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:48.480843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c678d-d0c5-4a54-88bb-c9ff8daeb1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:48.481123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c678d-d0c5-4a54-88bb-c9ff8daeb1ee admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:48.481843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c678d-d0c5-4a54-88bb-c9ff8daeb1ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:48.485832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c678d-d0c5-4a54-88bb-c9ff8daeb1ee admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:48.487825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a58a7-df1b-449b-a91c-06977e4936b7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:48.489209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a58a7-df1b-449b-a91c-06977e4936b7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:48.489509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a58a7-df1b-449b-a91c-06977e4936b7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:48.490159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a58a7-df1b-449b-a91c-06977e4936b7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/a66e64e81ec440658d5efb2e32746906/users/f2ec3be4079d4ac088bab28e8d9795e7/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:48.496330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a58a7-df1b-449b-a91c-06977e4936b7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=a66e64e81ec440658d5efb2e32746906, user_id=f2ec3be4079d4ac088bab28e8d9795e7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:48.506573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a58a7-df1b-449b-a91c-06977e4936b7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:48.523579 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2572/5153] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:48 2021] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:48.524048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c678d-d0c5-4a54-88bb-c9ff8daeb1ee admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:48.538529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c678d-d0c5-4a54-88bb-c9ff8daeb1ee admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:48.545693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946b454-8761-460a-9ea4-b3f2d77072d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:48.546578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946b454-8761-460a-9ea4-b3f2d77072d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:48.549890 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2582/5154] 10.222.0.21 () {58 vars in 1361 bytes} [Sat Nov 27 21:00:48 2021] GET /identity/v3/domains/a66e64e81ec440658d5efb2e32746906/users/f2ec3be4079d4ac088bab28e8d9795e7/roles => generated 409 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:48.551967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946b454-8761-460a-9ea4-b3f2d77072d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:48.552127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a58a7-df1b-449b-a91c-06977e4936b7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:48.553227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946b454-8761-460a-9ea4-b3f2d77072d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:48.554401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946b454-8761-460a-9ea4-b3f2d77072d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:48.575597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946b454-8761-460a-9ea4-b3f2d77072d3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:48.578642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a58a7-df1b-449b-a91c-06977e4936b7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:48.592218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778813dd-3f6d-4d60-986e-dfae2eb72cdd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:48.593293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778813dd-3f6d-4d60-986e-dfae2eb72cdd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:48.593638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778813dd-3f6d-4d60-986e-dfae2eb72cdd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:48.594522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778813dd-3f6d-4d60-986e-dfae2eb72cdd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/a66e64e81ec440658d5efb2e32746906/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:48.598475 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2573/5155] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:48 2021] GET /identity/v3/roles => generated 2324 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:48.599737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946b454-8761-460a-9ea4-b3f2d77072d3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:48.602357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778813dd-3f6d-4d60-986e-dfae2eb72cdd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=a66e64e81ec440658d5efb2e32746906, user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:48.612900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778813dd-3f6d-4d60-986e-dfae2eb72cdd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:48.624836 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2583/5156] 10.222.0.21 () {58 vars in 1461 bytes} [Sat Nov 27 21:00:48 2021] HEAD /identity/v3/domains/a66e64e81ec440658d5efb2e32746906/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:48.628976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778813dd-3f6d-4d60-986e-dfae2eb72cdd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:48.629154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946b454-8761-460a-9ea4-b3f2d77072d3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:48.658159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778813dd-3f6d-4d60-986e-dfae2eb72cdd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:48.661990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800de18-e648-4a72-a13a-118da606a1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:48.664372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800de18-e648-4a72-a13a-118da606a1ad admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:48.666111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800de18-e648-4a72-a13a-118da606a1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:48.667729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800de18-e648-4a72-a13a-118da606a1ad admin admin] PATH_INFO: `/v3/projects/ed51b0be674f4b678a4c751f1fc5a4cb/users/72d7042cabe34309b6348b479bb94956/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:48.668925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:48.670621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:48.670915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:48.671220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/a66e64e81ec440658d5efb2e32746906/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:48.679892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a66e64e81ec440658d5efb2e32746906, user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:48.685541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:48.700908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role d23755780ff0440199fe8d4ed2204af0 was removed from user f2ec3be4079d4ac088bab28e8d9795e7 on domain a66e64e81ec440658d5efb2e32746906. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:48.701212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:48.703785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:48.748800 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2584/5157] 10.222.0.21 () {58 vars in 1463 bytes} [Sat Nov 27 21:00:48 2021] DELETE /identity/v3/domains/a66e64e81ec440658d5efb2e32746906/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:48.755321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:48.759637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:48.762176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800de18-e648-4a72-a13a-118da606a1ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed51b0be674f4b678a4c751f1fc5a4cb, user_id=72d7042cabe34309b6348b479bb94956, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:48.768428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800de18-e648-4a72-a13a-118da606a1ad admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:48.789467 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2574/5158] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:48 2021] PUT /identity/v3/projects/ed51b0be674f4b678a4c751f1fc5a4cb/users/72d7042cabe34309b6348b479bb94956/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:48.793813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800de18-e648-4a72-a13a-118da606a1ad admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:48.796842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8800de18-e648-4a72-a13a-118da606a1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:48.942571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800de18-e648-4a72-a13a-118da606a1ad admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:48.959434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08e8f4-475c-47ce-8c69-341d5587bcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:48.960900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e8f4-475c-47ce-8c69-341d5587bcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:48.961923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e8f4-475c-47ce-8c69-341d5587bcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:48.961923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e8f4-475c-47ce-8c69-341d5587bcc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:48.963805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08e8f4-475c-47ce-8c69-341d5587bcc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:48.966751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08e8f4-475c-47ce-8c69-341d5587bcc2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:48.994423 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2575/5159] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:48 2021] GET /identity/v3/roles => generated 2324 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:48.996340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08e8f4-475c-47ce-8c69-341d5587bcc2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:49.001142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28394d8d-57b4-460b-82fb-981065f2da5b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:49.002168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8b08e8f4-475c-47ce-8c69-341d5587bcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:49.123459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06ef81-b4f1-4444-b94c-69a33629ee13 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:49.124495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06ef81-b4f1-4444-b94c-69a33629ee13 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.128303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06ef81-b4f1-4444-b94c-69a33629ee13 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.128303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06ef81-b4f1-4444-b94c-69a33629ee13 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.132764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06ef81-b4f1-4444-b94c-69a33629ee13 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:49.135951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06ef81-b4f1-4444-b94c-69a33629ee13 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:49.153023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08e8f4-475c-47ce-8c69-341d5587bcc2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:49.155969 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2585/5160] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:48 2021] PUT /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:49.157622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06ef81-b4f1-4444-b94c-69a33629ee13 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:49.245714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06ef81-b4f1-4444-b94c-69a33629ee13 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:49.253317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea46a20-3b26-483e-a0ff-7abcaec3c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:49.254264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea46a20-3b26-483e-a0ff-7abcaec3c768 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.254550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea46a20-3b26-483e-a0ff-7abcaec3c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.254917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea46a20-3b26-483e-a0ff-7abcaec3c768 admin admin] PATH_INFO: `/v3/projects/ed51b0be674f4b678a4c751f1fc5a4cb/users/72d7042cabe34309b6348b479bb94956/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.257596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea46a20-3b26-483e-a0ff-7abcaec3c768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed51b0be674f4b678a4c751f1fc5a4cb, user_id=72d7042cabe34309b6348b479bb94956, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:49.260824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea46a20-3b26-483e-a0ff-7abcaec3c768 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:49.270658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c1020-6cae-4dae-9497-39129d332f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:49.271415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1020-6cae-4dae-9497-39129d332f95 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.271740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1020-6cae-4dae-9497-39129d332f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.272222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c1020-6cae-4dae-9497-39129d332f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.275203 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2586/5161] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:49 2021] PUT /identity/v3/projects/ed51b0be674f4b678a4c751f1fc5a4cb/users/72d7042cabe34309b6348b479bb94956/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:49.276178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea46a20-3b26-483e-a0ff-7abcaec3c768 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:49.279801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-223c1020-6cae-4dae-9497-39129d332f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:49.305357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c1020-6cae-4dae-9497-39129d332f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:49.306872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c1020-6cae-4dae-9497-39129d332f95 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:49.321041 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2576/5162] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:48 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:49.322103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c1020-6cae-4dae-9497-39129d332f95 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:49.324167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-223c1020-6cae-4dae-9497-39129d332f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:49.344589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c1020-6cae-4dae-9497-39129d332f95 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:49.415531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea46a20-3b26-483e-a0ff-7abcaec3c768 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:49.422556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7649a-ee8f-4967-a2b8-b474e9deb451 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:49.423483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7649a-ee8f-4967-a2b8-b474e9deb451 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.423897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7649a-ee8f-4967-a2b8-b474e9deb451 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.424187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7649a-ee8f-4967-a2b8-b474e9deb451 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.426848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7649a-ee8f-4967-a2b8-b474e9deb451 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_grants(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, user_id=f2ec3be4079d4ac088bab28e8d9795e7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:49.430772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7649a-ee8f-4967-a2b8-b474e9deb451 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:49.450246 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2587/5163] 10.222.0.21 () {58 vars in 1364 bytes} [Sat Nov 27 21:00:49 2021] GET /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles => generated 410 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:49.452073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fab62-5afb-4a11-ab70-5385e9fdef91 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.452482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fab62-5afb-4a11-ab70-5385e9fdef91 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.453241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fab62-5afb-4a11-ab70-5385e9fdef91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.482673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df7e2b-d7ac-4d04-afcd-0bef8605a7da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:49.483472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df7e2b-d7ac-4d04-afcd-0bef8605a7da service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.483824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df7e2b-d7ac-4d04-afcd-0bef8605a7da service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.484134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df7e2b-d7ac-4d04-afcd-0bef8605a7da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.495382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-807fab62-5afb-4a11-ab70-5385e9fdef91 None None] MFA Rules not processed for user `72d7042cabe34309b6348b479bb94956`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:49.495973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df7e2b-d7ac-4d04-afcd-0bef8605a7da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:49.497423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-807fab62-5afb-4a11-ab70-5385e9fdef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:49.497917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df7e2b-d7ac-4d04-afcd-0bef8605a7da service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:49.513502 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2577/5164] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:49 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:49.516939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df7e2b-d7ac-4d04-afcd-0bef8605a7da service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:49.532422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df7e2b-d7ac-4d04-afcd-0bef8605a7da service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:49.540787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a0d20-53d1-4679-951e-700e33e1c4e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:49.542166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a0d20-53d1-4679-951e-700e33e1c4e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.542540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a0d20-53d1-4679-951e-700e33e1c4e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.543071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a0d20-53d1-4679-951e-700e33e1c4e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.546134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a0d20-53d1-4679-951e-700e33e1c4e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:49.550510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a0d20-53d1-4679-951e-700e33e1c4e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:49.560638 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2578/5165] 10.222.0.21 () {58 vars in 1464 bytes} [Sat Nov 27 21:00:49 2021] HEAD /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:49.565118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a0d20-53d1-4679-951e-700e33e1c4e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:49.578011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a0d20-53d1-4679-951e-700e33e1c4e4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:49.586288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:49.587419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.587709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.588047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.591271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d5666232ad764d609fcb7bf3e4ce7f8d, user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:49.596270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:49.603742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role d23755780ff0440199fe8d4ed2204af0 was removed from user f2ec3be4079d4ac088bab28e8d9795e7 on project d5666232ad764d609fcb7bf3e4ce7f8d. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:49.604829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:49.605862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:49.608031 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2588/5166] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:49 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:49.615221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fab62-5afb-4a11-ab70-5385e9fdef91 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:49.639543 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2579/5167] 10.222.0.21 () {58 vars in 1466 bytes} [Sat Nov 27 21:00:49 2021] DELETE /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:49.641596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:49.647513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:49.767835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fab62-5afb-4a11-ab70-5385e9fdef91 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:49.768127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d88c0b-3823-4916-a89a-3d10762f678d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:49.775234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46f559-f1fd-47b3-b020-be5f8514277b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:49.776555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46f559-f1fd-47b3-b020-be5f8514277b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.776941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46f559-f1fd-47b3-b020-be5f8514277b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.777232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46f559-f1fd-47b3-b020-be5f8514277b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/system/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.780946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46f559-f1fd-47b3-b020-be5f8514277b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:49.784989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46f559-f1fd-47b3-b020-be5f8514277b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:49.800214 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2580/5168] 10.222.0.21 () {60 vars in 1377 bytes} [Sat Nov 27 21:00:49 2021] PUT /identity/v3/system/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:49.804738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46f559-f1fd-47b3-b020-be5f8514277b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:49.822760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46f559-f1fd-47b3-b020-be5f8514277b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:49.829113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd393a4b-fe4a-49b5-ad20-7330b41de4e6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:49.829957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393a4b-fe4a-49b5-ad20-7330b41de4e6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.830297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393a4b-fe4a-49b5-ad20-7330b41de4e6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.830791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd393a4b-fe4a-49b5-ad20-7330b41de4e6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/system/users/f2ec3be4079d4ac088bab28e8d9795e7/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.834296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd393a4b-fe4a-49b5-ad20-7330b41de4e6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=f2ec3be4079d4ac088bab28e8d9795e7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:49.837013 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-dd393a4b-fe4a-49b5-ad20-7330b41de4e6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_system_grants_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:49.837013 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:00:49.837013 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:00:49.839457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd393a4b-fe4a-49b5-ad20-7330b41de4e6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:49.884394 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2581/5169] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 21:00:49 2021] GET /identity/v3/system/users/f2ec3be4079d4ac088bab28e8d9795e7/roles => generated 375 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:49.889696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd393a4b-fe4a-49b5-ad20-7330b41de4e6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:49.928824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd393a4b-fe4a-49b5-ad20-7330b41de4e6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:49.935418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e020988-7c8d-4e62-9764-7c30f2eab5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:49.936671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e020988-7c8d-4e62-9764-7c30f2eab5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.936957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e020988-7c8d-4e62-9764-7c30f2eab5be admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.937231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e020988-7c8d-4e62-9764-7c30f2eab5be admin admin] PATH_INFO: `/v3/users/6110ae1426b14de5a68130329ced30f3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.941673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e020988-7c8d-4e62-9764-7c30f2eab5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=6110ae1426b14de5a68130329ced30f3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:49.945536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e020988-7c8d-4e62-9764-7c30f2eab5be admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:49.962717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e102-0350-4f02-aee9-0a4dde88e82f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:49.965296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e102-0350-4f02-aee9-0a4dde88e82f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:49.968210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e102-0350-4f02-aee9-0a4dde88e82f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:49.968506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e102-0350-4f02-aee9-0a4dde88e82f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/system/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:49.978116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4e102-0350-4f02-aee9-0a4dde88e82f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:49.979164 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-19d4e102-0350-4f02-aee9-0a4dde88e82f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:49.979164 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:00:49.979164 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:00:49.980155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4e102-0350-4f02-aee9-0a4dde88e82f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:49.996909 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2582/5170] 10.222.0.21 () {58 vars in 1359 bytes} [Sat Nov 27 21:00:49 2021] HEAD /identity/v3/system/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:50.001656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e102-0350-4f02-aee9-0a4dde88e82f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:50.025563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e102-0350-4f02-aee9-0a4dde88e82f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:50.046945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534b26c-8efc-4072-8603-72bcd4dca504 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:50.051037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534b26c-8efc-4072-8603-72bcd4dca504 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:50.051371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534b26c-8efc-4072-8603-72bcd4dca504 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:50.054896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534b26c-8efc-4072-8603-72bcd4dca504 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/system/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:50.060597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534b26c-8efc-4072-8603-72bcd4dca504 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=f2ec3be4079d4ac088bab28e8d9795e7, role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:50.064908 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-d534b26c-8efc-4072-8603-72bcd4dca504 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:revoke_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:50.064908 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:00:50.064908 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:00:50.065889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534b26c-8efc-4072-8603-72bcd4dca504 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:50.069179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e020988-7c8d-4e62-9764-7c30f2eab5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6110ae1426b14de5a68130329ced30f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:50.070502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e020988-7c8d-4e62-9764-7c30f2eab5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6110ae1426b14de5a68130329ced30f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:50.087653 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2583/5171] 10.222.0.21 () {58 vars in 1361 bytes} [Sat Nov 27 21:00:50 2021] DELETE /identity/v3/system/users/f2ec3be4079d4ac088bab28e8d9795e7/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:50.091047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e020988-7c8d-4e62-9764-7c30f2eab5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6110ae1426b14de5a68130329ced30f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:50.091047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e020988-7c8d-4e62-9764-7c30f2eab5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6110ae1426b14de5a68130329ced30f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:50.094841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534b26c-8efc-4072-8603-72bcd4dca504 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:50.098654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d534b26c-8efc-4072-8603-72bcd4dca504 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:50.107768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e020988-7c8d-4e62-9764-7c30f2eab5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6110ae1426b14de5a68130329ced30f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:50.119436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534b26c-8efc-4072-8603-72bcd4dca504 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:50.127140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996c465-252f-4e02-a91e-07a8f8994c3a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:50.128470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996c465-252f-4e02-a91e-07a8f8994c3a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:50.129127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996c465-252f-4e02-a91e-07a8f8994c3a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:50.129826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996c465-252f-4e02-a91e-07a8f8994c3a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:50.139395 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2589/5172] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:49 2021] DELETE /identity/v3/users/6110ae1426b14de5a68130329ced30f3 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:50.139926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996c465-252f-4e02-a91e-07a8f8994c3a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:50.141461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb819-b515-4364-afdb-bce8d1e6619a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:50.141850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb819-b515-4364-afdb-bce8d1e6619a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:50.142227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb819-b515-4364-afdb-bce8d1e6619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:50.143436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996c465-252f-4e02-a91e-07a8f8994c3a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:50.174037 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2584/5173] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:00:50 2021] POST /identity/v3/roles => generated 269 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:50.176830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996c465-252f-4e02-a91e-07a8f8994c3a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:50.185048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3ccbb819-b515-4364-afdb-bce8d1e6619a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:50.186282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3ccbb819-b515-4364-afdb-bce8d1e6619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:50.190979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996c465-252f-4e02-a91e-07a8f8994c3a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:50.281281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe6dcc-bf7f-4397-8f77-6663b7cef10d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:50.283412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe6dcc-bf7f-4397-8f77-6663b7cef10d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:50.283594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe6dcc-bf7f-4397-8f77-6663b7cef10d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:50.288104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe6dcc-bf7f-4397-8f77-6663b7cef10d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:50.289337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe6dcc-bf7f-4397-8f77-6663b7cef10d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:50.291101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe6dcc-bf7f-4397-8f77-6663b7cef10d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:50.330799 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2585/5174] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:00:50 2021] POST /identity/v3/roles => generated 270 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:50.335685 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2590/5175] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:50.350207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe6dcc-bf7f-4397-8f77-6663b7cef10d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:50.350432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbb819-b515-4364-afdb-bce8d1e6619a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:50.354878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3ccbb819-b515-4364-afdb-bce8d1e6619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:50.362524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe6dcc-bf7f-4397-8f77-6663b7cef10d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:50.369167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6c935-14c8-4c0a-90c7-0d125bc80744 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:50.370310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6c935-14c8-4c0a-90c7-0d125bc80744 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:50.370820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6c935-14c8-4c0a-90c7-0d125bc80744 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:50.371378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6c935-14c8-4c0a-90c7-0d125bc80744 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/aef21df1dec5405c9150b9e9a760ec11` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:50.374408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6c935-14c8-4c0a-90c7-0d125bc80744 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8e2ffbb4084445d8963852b044b3290c, implied_role_id=aef21df1dec5405c9150b9e9a760ec11)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:50.376511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6c935-14c8-4c0a-90c7-0d125bc80744 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:50.419622 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2586/5176] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:50 2021] PUT /identity/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/aef21df1dec5405c9150b9e9a760ec11 => generated 530 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:50.422739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6c935-14c8-4c0a-90c7-0d125bc80744 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:50.542150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbb819-b515-4364-afdb-bce8d1e6619a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:50.568085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6c935-14c8-4c0a-90c7-0d125bc80744 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:50.582553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bae501-76c2-4120-893e-6e48d78e0e4f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:50.583161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bae501-76c2-4120-893e-6e48d78e0e4f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:50.583462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bae501-76c2-4120-893e-6e48d78e0e4f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:50.583736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bae501-76c2-4120-893e-6e48d78e0e4f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:50.584496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bae501-76c2-4120-893e-6e48d78e0e4f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:50.586311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bae501-76c2-4120-893e-6e48d78e0e4f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:50.613842 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2587/5177] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 21:00:50 2021] POST /identity/v3/domains => generated 277 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:50.614926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bae501-76c2-4120-893e-6e48d78e0e4f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:50.654781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcabed-bce9-4109-a197-1b4d34045f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:50.655922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcabed-bce9-4109-a197-1b4d34045f47 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:50.655922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcabed-bce9-4109-a197-1b4d34045f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:50.656221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcabed-bce9-4109-a197-1b4d34045f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:50.775630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bae501-76c2-4120-893e-6e48d78e0e4f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:50.785877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e7324-d934-400a-9ecc-aad7eaa82dc2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:50.786791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e7324-d934-400a-9ecc-aad7eaa82dc2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:50.787243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e7324-d934-400a-9ecc-aad7eaa82dc2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:50.787642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e7324-d934-400a-9ecc-aad7eaa82dc2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:50.790125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e7324-d934-400a-9ecc-aad7eaa82dc2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:50.791942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e7324-d934-400a-9ecc-aad7eaa82dc2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:50.823896 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2588/5178] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:00:50 2021] POST /identity/v3/roles => generated 270 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:50.827923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcabed-bce9-4109-a197-1b4d34045f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:50.828143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e7324-d934-400a-9ecc-aad7eaa82dc2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:50.829546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcabed-bce9-4109-a197-1b4d34045f47 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:50.843062 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2591/5179] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:50.846921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e7324-d934-400a-9ecc-aad7eaa82dc2 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:50.858372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925eced-6b31-4eed-9c29-616ed79539b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:50.859613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925eced-6b31-4eed-9c29-616ed79539b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:50.860539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925eced-6b31-4eed-9c29-616ed79539b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:50.860824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925eced-6b31-4eed-9c29-616ed79539b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/f1d87419bd5d4366b82becf7ee3ea66b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:50.863038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925eced-6b31-4eed-9c29-616ed79539b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8e2ffbb4084445d8963852b044b3290c, implied_role_id=f1d87419bd5d4366b82becf7ee3ea66b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:50.865668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925eced-6b31-4eed-9c29-616ed79539b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:50.924273 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2589/5180] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:50 2021] PUT /identity/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/f1d87419bd5d4366b82becf7ee3ea66b => generated 530 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:50.929635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcabed-bce9-4109-a197-1b4d34045f47 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:50.965222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcabed-bce9-4109-a197-1b4d34045f47 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:51.178343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff644b16-8e0c-4e2e-8848-9c9edf9a9772 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:51.189760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff644b16-8e0c-4e2e-8848-9c9edf9a9772 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:51.190358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff644b16-8e0c-4e2e-8848-9c9edf9a9772 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:51.190870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff644b16-8e0c-4e2e-8848-9c9edf9a9772 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:51.197269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff644b16-8e0c-4e2e-8848-9c9edf9a9772 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8e2ffbb4084445d8963852b044b3290c, implied_role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:51.199918 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-ff644b16-8e0c-4e2e-8848-9c9edf9a9772 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:51.199918 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:51.199918 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:51.201282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff644b16-8e0c-4e2e-8848-9c9edf9a9772 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:51.251100 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2592/5181] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:50 2021] PUT /identity/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/d23755780ff0440199fe8d4ed2204af0 => generated 525 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:51.257032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925eced-6b31-4eed-9c29-616ed79539b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:51.280024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925eced-6b31-4eed-9c29-616ed79539b6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:51.381684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88991-9fba-41bf-85e7-688e215c1752 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:51.382739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88991-9fba-41bf-85e7-688e215c1752 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:51.383070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88991-9fba-41bf-85e7-688e215c1752 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:51.383555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88991-9fba-41bf-85e7-688e215c1752 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/d23755780ff0440199fe8d4ed2204af0/implies/8e2ffbb4084445d8963852b044b3290c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:51.386301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da88991-9fba-41bf-85e7-688e215c1752 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=d23755780ff0440199fe8d4ed2204af0, implied_role_id=8e2ffbb4084445d8963852b044b3290c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:51.388063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da88991-9fba-41bf-85e7-688e215c1752 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:51.429345 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-3da88991-9fba-41bf-85e7-688e215c1752 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] 8e2ffbb4084445d8963852b044b3290c cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 8e2ffbb4084445d8963852b044b3290c cannot be an implied roles. Nov 27 21:00:51.436701 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2590/5182] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:51 2021] PUT /identity/v3/roles/d23755780ff0440199fe8d4ed2204af0/implies/8e2ffbb4084445d8963852b044b3290c => generated 116 bytes in 178 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Nov 27 21:00:51.438926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff644b16-8e0c-4e2e-8848-9c9edf9a9772 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:51.462354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff644b16-8e0c-4e2e-8848-9c9edf9a9772 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:51.480830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713c505-b92e-4cc4-b139-93f30f9ee58f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:51.482340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c505-b92e-4cc4-b139-93f30f9ee58f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:51.482340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c505-b92e-4cc4-b139-93f30f9ee58f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:51.482597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c505-b92e-4cc4-b139-93f30f9ee58f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:51.488742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713c505-b92e-4cc4-b139-93f30f9ee58f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8e2ffbb4084445d8963852b044b3290c, implied_role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:51.494131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713c505-b92e-4cc4-b139-93f30f9ee58f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:51.533816 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2593/5183] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:51 2021] DELETE /identity/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:51.538339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88991-9fba-41bf-85e7-688e215c1752 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:51.558779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88991-9fba-41bf-85e7-688e215c1752 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:51.730935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67766da6-d9ec-4a32-8dfe-b179bc9176d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:51.733038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67766da6-d9ec-4a32-8dfe-b179bc9176d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:51.733299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67766da6-d9ec-4a32-8dfe-b179bc9176d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:51.733575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67766da6-d9ec-4a32-8dfe-b179bc9176d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/f1d87419bd5d4366b82becf7ee3ea66b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:51.736535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67766da6-d9ec-4a32-8dfe-b179bc9176d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8e2ffbb4084445d8963852b044b3290c, implied_role_id=f1d87419bd5d4366b82becf7ee3ea66b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:51.738600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67766da6-d9ec-4a32-8dfe-b179bc9176d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:51.754624 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2591/5184] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:51 2021] DELETE /identity/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/f1d87419bd5d4366b82becf7ee3ea66b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:51.759183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713c505-b92e-4cc4-b139-93f30f9ee58f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:51.772471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713c505-b92e-4cc4-b139-93f30f9ee58f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:51.908697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:51.909597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:51.910689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:51.911327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f1d87419bd5d4366b82becf7ee3ea66b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:51.912691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=f1d87419bd5d4366b82becf7ee3ea66b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:51.914558 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_domain_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:51.914558 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:51.914558 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:51.916993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:52.014243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role f1d87419bd5d4366b82becf7ee3ea66b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:52.015364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:52.019513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:52.023551 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2594/5185] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:51 2021] DELETE /identity/v3/roles/f1d87419bd5d4366b82becf7ee3ea66b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:52.028097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67766da6-d9ec-4a32-8dfe-b179bc9176d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:52.030175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-67766da6-d9ec-4a32-8dfe-b179bc9176d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:52.059523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67766da6-d9ec-4a32-8dfe-b179bc9176d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:52.235403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:52.236460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:52.236793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:52.238893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/79eb09a1a0ae4acb9e1476007b8b6672` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:52.298560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=79eb09a1a0ae4acb9e1476007b8b6672)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:52.300344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:52.387981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:52.389415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:52.466460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:52.468487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:52.475536 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2592/5186] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:00:52 2021] PATCH /identity/v3/domains/79eb09a1a0ae4acb9e1476007b8b6672 => generated 278 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:52.481352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:52.499487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0b750-72c8-4771-8ba4-93c7569c559f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:52.573373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:52.575220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:52.711626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:52.711868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:52.714815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:52.716860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/79eb09a1a0ae4acb9e1476007b8b6672` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:52.779779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=79eb09a1a0ae4acb9e1476007b8b6672)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:52.787030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:52.817400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fea974-63da-4fb9-8276-a5e9db0108a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:52.832969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:52.834790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:52.835338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:52.836104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] PATH_INFO: `/v3/projects/903ef22f2af54bfb88e2bb2c17166a70` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:52.841148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903ef22f2af54bfb88e2bb2c17166a70)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:52.845929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:52.858119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:52.920689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.027663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903ef22f2af54bfb88e2bb2c17166a70', 'request_id': 'req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.043876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903ef22f2af54bfb88e2bb2c17166a70', 'request_id': 'req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.049035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672', 'request_id': 'req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.063592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903ef22f2af54bfb88e2bb2c17166a70', 'request_id': 'req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.064876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672', 'request_id': 'req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.079640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672', 'request_id': 'req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.086199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] The token cache is being invalidate because project 903ef22f2af54bfb88e2bb2c17166a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:53.086842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.088008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.090709 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2593/5187] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:52 2021] DELETE /identity/v3/projects/903ef22f2af54bfb88e2bb2c17166a70 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:53.097769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:53.100885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:53.118432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] The token cache is being invalidate because project 79eb09a1a0ae4acb9e1476007b8b6672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:53.119060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.121300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.134878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672', 'request_id': 'req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.135922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672', 'request_id': 'req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.141938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '79eb09a1a0ae4acb9e1476007b8b6672', 'request_id': 'req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.155458 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2595/5188] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:00:52 2021] DELETE /identity/v3/domains/79eb09a1a0ae4acb9e1476007b8b6672 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:53.157511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:53.159535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:53.268730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333a31f-1dd6-46b2-a57a-2ed34ab756c8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:53.269398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4a499-d6f5-4424-9f79-b192e4eaf7c6 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:53.276479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982bfd0-28c0-42b0-a975-0765a1a1aa1b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:53.277637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982bfd0-28c0-42b0-a975-0765a1a1aa1b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:53.277923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982bfd0-28c0-42b0-a975-0765a1a1aa1b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:53.278749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982bfd0-28c0-42b0-a975-0765a1a1aa1b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/aef21df1dec5405c9150b9e9a760ec11` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:53.283782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982bfd0-28c0-42b0-a975-0765a1a1aa1b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8e2ffbb4084445d8963852b044b3290c, implied_role_id=aef21df1dec5405c9150b9e9a760ec11)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:53.285778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982bfd0-28c0-42b0-a975-0765a1a1aa1b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:53.301003 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2596/5189] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:53 2021] DELETE /identity/v3/roles/8e2ffbb4084445d8963852b044b3290c/implies/aef21df1dec5405c9150b9e9a760ec11 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:53.307830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982bfd0-28c0-42b0-a975-0765a1a1aa1b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:53.402105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982bfd0-28c0-42b0-a975-0765a1a1aa1b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:53.410675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:53.411625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:53.411855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:53.412316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/aef21df1dec5405c9150b9e9a760ec11` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:53.414133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=aef21df1dec5405c9150b9e9a760ec11)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:53.416575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:53.418731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:53.419731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:53.419990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:53.420278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] PATH_INFO: `/v3/users/72d7042cabe34309b6348b479bb94956` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:53.426712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72d7042cabe34309b6348b479bb94956)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:53.428522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:53.496425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role aef21df1dec5405c9150b9e9a760ec11 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:53.496753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.497961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.507425 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2597/5190] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:53 2021] DELETE /identity/v3/roles/aef21df1dec5405c9150b9e9a760ec11 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:53.512488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:53.514613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:53.645112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72d7042cabe34309b6348b479bb94956'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.665615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72d7042cabe34309b6348b479bb94956'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.666838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72d7042cabe34309b6348b479bb94956'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.669361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b2fa9-3218-47d9-8684-a47ce487835d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:53.679726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72d7042cabe34309b6348b479bb94956'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.682855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:53.683784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:53.684061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:53.684433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/8e2ffbb4084445d8963852b044b3290c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:53.687056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8e2ffbb4084445d8963852b044b3290c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:53.691507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:53.714009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72d7042cabe34309b6348b479bb94956'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.726772 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2594/5191] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:53 2021] DELETE /identity/v3/users/72d7042cabe34309b6348b479bb94956 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:53.746467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role 8e2ffbb4084445d8963852b044b3290c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:53.748033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.751310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:53.761199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:53.763969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:53.764329 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2598/5192] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:53 2021] DELETE /identity/v3/roles/8e2ffbb4084445d8963852b044b3290c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:53.863465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119a409-abeb-4a36-bdd5-775d342f9668 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:53.970198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6de0-e934-4459-a131-9b7e95282b46 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:53.971301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6de0-e934-4459-a131-9b7e95282b46 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:53.971639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6de0-e934-4459-a131-9b7e95282b46 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:53.971977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6de0-e934-4459-a131-9b7e95282b46 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:53.974273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe6de0-e934-4459-a131-9b7e95282b46 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:53.976327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe6de0-e934-4459-a131-9b7e95282b46 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:54.018431 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2595/5193] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:53 2021] PUT /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 521 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:00:54.022874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:54.030301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:54.052090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c53ad-474b-4379-87c4-1152ec8d8ed8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:54.138185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:54.139622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `HEAD` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:54.140073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:54.140721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:54.146110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:54.148011 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:check_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:54.148011 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:54.148011 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:54.151267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:54.154205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:54.156081 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:54.156081 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:54.156081 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:54.158249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:54.174088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6de0-e934-4459-a131-9b7e95282b46 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:54.185691 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2599/5194] 10.222.0.21 () {58 vars in 1344 bytes} [Sat Nov 27 21:00:54 2021] HEAD /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:54.187629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6de0-e934-4459-a131-9b7e95282b46 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:54.192916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b610f-6d4c-4e79-81f0-6baf76e0a54d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:54.195105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b610f-6d4c-4e79-81f0-6baf76e0a54d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:54.195756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b610f-6d4c-4e79-81f0-6baf76e0a54d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:54.196262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b610f-6d4c-4e79-81f0-6baf76e0a54d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:54.198497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b610f-6d4c-4e79-81f0-6baf76e0a54d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:54.199773 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-550b610f-6d4c-4e79-81f0-6baf76e0a54d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_implied_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:54.199773 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:00:54.199773 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:00:54.201040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b610f-6d4c-4e79-81f0-6baf76e0a54d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:54.212897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:54.222225 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2596/5195] 10.222.0.21 () {58 vars in 1343 bytes} [Sat Nov 27 21:00:54 2021] GET /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 521 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:54.239547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1450b88-f0ff-4ead-840a-15b460846d3e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:54.249032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac53a1-0471-4333-9daf-40eaf9ca5586 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:54.250638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac53a1-0471-4333-9daf-40eaf9ca5586 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:54.251165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac53a1-0471-4333-9daf-40eaf9ca5586 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:54.251645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac53a1-0471-4333-9daf-40eaf9ca5586 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:54.253874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac53a1-0471-4333-9daf-40eaf9ca5586 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:54.267075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac53a1-0471-4333-9daf-40eaf9ca5586 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:54.280089 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2600/5196] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:54 2021] DELETE /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:54.284443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b610f-6d4c-4e79-81f0-6baf76e0a54d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:54.304315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b610f-6d4c-4e79-81f0-6baf76e0a54d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:54.402626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f383425-3111-4277-80a8-42be3700ba59 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:54.403607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f383425-3111-4277-80a8-42be3700ba59 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:54.403892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f383425-3111-4277-80a8-42be3700ba59 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:54.405962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f383425-3111-4277-80a8-42be3700ba59 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:54.412100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f383425-3111-4277-80a8-42be3700ba59 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:54.415741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f383425-3111-4277-80a8-42be3700ba59 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:54.458629 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-9f383425-3111-4277-80a8-42be3700ba59 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] f18e3b12b5f648d39d3950d5323ad4b3 does not imply 371ec2aa26b042a2a7c90d0ec0612bc1.: keystone.exception.ImpliedRoleNotFound: f18e3b12b5f648d39d3950d5323ad4b3 does not imply 371ec2aa26b042a2a7c90d0ec0612bc1. Nov 27 21:00:54.462466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac53a1-0471-4333-9daf-40eaf9ca5586 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:54.473212 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2597/5197] 10.222.0.21 () {58 vars in 1343 bytes} [Sat Nov 27 21:00:54 2021] GET /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 137 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 21:00:54.478201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac53a1-0471-4333-9daf-40eaf9ca5586 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:54.490443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfe5d0-f86e-40bd-a9d0-9f80cbb3ed81 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:54.491493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe5d0-f86e-40bd-a9d0-9f80cbb3ed81 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:54.496366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe5d0-f86e-40bd-a9d0-9f80cbb3ed81 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:54.497593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe5d0-f86e-40bd-a9d0-9f80cbb3ed81 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:54.502365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfe5d0-f86e-40bd-a9d0-9f80cbb3ed81 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:54.507340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfe5d0-f86e-40bd-a9d0-9f80cbb3ed81 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:54.567528 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-59bfe5d0-f86e-40bd-a9d0-9f80cbb3ed81 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] f18e3b12b5f648d39d3950d5323ad4b3 does not imply 371ec2aa26b042a2a7c90d0ec0612bc1.: keystone.exception.ImpliedRoleNotFound: f18e3b12b5f648d39d3950d5323ad4b3 does not imply 371ec2aa26b042a2a7c90d0ec0612bc1. Nov 27 21:00:54.570447 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2601/5198] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:54 2021] DELETE /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 137 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:00:54.583086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f383425-3111-4277-80a8-42be3700ba59 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:54.596706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f383425-3111-4277-80a8-42be3700ba59 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:54.611509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff3201-506b-4acf-9404-9be1f15000f0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:54.612815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3201-506b-4acf-9404-9be1f15000f0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:54.613110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3201-506b-4acf-9404-9be1f15000f0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:54.613599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff3201-506b-4acf-9404-9be1f15000f0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:54.616689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff3201-506b-4acf-9404-9be1f15000f0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:54.619679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff3201-506b-4acf-9404-9be1f15000f0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:54.661744 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2598/5199] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:54 2021] PUT /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 521 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:54.668101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfe5d0-f86e-40bd-a9d0-9f80cbb3ed81 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:54.693639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfe5d0-f86e-40bd-a9d0-9f80cbb3ed81 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:54.829552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1205b5-9f0e-433d-8e80-44fab625b01b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:54.830492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1205b5-9f0e-433d-8e80-44fab625b01b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:54.830777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1205b5-9f0e-433d-8e80-44fab625b01b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:54.831054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1205b5-9f0e-433d-8e80-44fab625b01b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/9aac185ff4ee44aa927ef0573b19b6f4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:54.833244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1205b5-9f0e-433d-8e80-44fab625b01b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=9aac185ff4ee44aa927ef0573b19b6f4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:54.836295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1205b5-9f0e-433d-8e80-44fab625b01b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:54.880725 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2602/5200] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:54 2021] PUT /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/9aac185ff4ee44aa927ef0573b19b6f4 => generated 521 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:54.884741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff3201-506b-4acf-9404-9be1f15000f0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:54.902614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff3201-506b-4acf-9404-9be1f15000f0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:54.991311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558979d3-f0f8-470e-af95-a791b9317d4c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:54.992768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558979d3-f0f8-470e-af95-a791b9317d4c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:54.993162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558979d3-f0f8-470e-af95-a791b9317d4c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:54.993517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558979d3-f0f8-470e-af95-a791b9317d4c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4/implies/d23755780ff0440199fe8d4ed2204af0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:54.996501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558979d3-f0f8-470e-af95-a791b9317d4c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9aac185ff4ee44aa927ef0573b19b6f4, implied_role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:54.997784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558979d3-f0f8-470e-af95-a791b9317d4c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:55.033560 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2599/5201] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:54 2021] PUT /identity/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4/implies/d23755780ff0440199fe8d4ed2204af0 => generated 521 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:55.036034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1205b5-9f0e-433d-8e80-44fab625b01b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:55.050247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1205b5-9f0e-433d-8e80-44fab625b01b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:55.142882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95a14c-0e50-4928-bef1-57b2eb22985d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:55.143623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95a14c-0e50-4928-bef1-57b2eb22985d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:55.143915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95a14c-0e50-4928-bef1-57b2eb22985d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:55.144199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95a14c-0e50-4928-bef1-57b2eb22985d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:55.145486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95a14c-0e50-4928-bef1-57b2eb22985d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:55.147297 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-7e95a14c-0e50-4928-bef1-57b2eb22985d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_inference_rules failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:55.147297 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:55.147297 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:55.148302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95a14c-0e50-4928-bef1-57b2eb22985d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:55.168788 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2603/5202] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 21:00:55 2021] GET /identity/v3/role_inferences => generated 1608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:55.173722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558979d3-f0f8-470e-af95-a791b9317d4c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:55.186102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558979d3-f0f8-470e-af95-a791b9317d4c tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:55.194583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8d839-5faf-486e-90ed-630cd7b975a7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:55.195562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8d839-5faf-486e-90ed-630cd7b975a7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:55.195853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8d839-5faf-486e-90ed-630cd7b975a7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:55.196137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8d839-5faf-486e-90ed-630cd7b975a7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4/implies/d23755780ff0440199fe8d4ed2204af0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:55.198492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8d839-5faf-486e-90ed-630cd7b975a7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9aac185ff4ee44aa927ef0573b19b6f4, implied_role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:55.200576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8d839-5faf-486e-90ed-630cd7b975a7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:55.215626 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2600/5203] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:55 2021] DELETE /identity/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4/implies/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:55.220442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95a14c-0e50-4928-bef1-57b2eb22985d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:55.234244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95a14c-0e50-4928-bef1-57b2eb22985d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:55.309424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8323f-0938-45d0-8d86-6c36795562d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:55.311241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8323f-0938-45d0-8d86-6c36795562d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:55.311241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8323f-0938-45d0-8d86-6c36795562d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:55.311241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8323f-0938-45d0-8d86-6c36795562d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/9aac185ff4ee44aa927ef0573b19b6f4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:55.314304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8323f-0938-45d0-8d86-6c36795562d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=9aac185ff4ee44aa927ef0573b19b6f4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:55.316406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8323f-0938-45d0-8d86-6c36795562d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:55.330635 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2604/5204] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:55 2021] DELETE /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/9aac185ff4ee44aa927ef0573b19b6f4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:55.334653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8d839-5faf-486e-90ed-630cd7b975a7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:55.348608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8d839-5faf-486e-90ed-630cd7b975a7 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:55.470843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227c5b-3b13-4b04-881d-a6b6e74d190b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:55.472999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227c5b-3b13-4b04-881d-a6b6e74d190b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:55.473457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227c5b-3b13-4b04-881d-a6b6e74d190b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:55.473913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227c5b-3b13-4b04-881d-a6b6e74d190b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:55.476221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a227c5b-3b13-4b04-881d-a6b6e74d190b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:55.478177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a227c5b-3b13-4b04-881d-a6b6e74d190b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:55.502028 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2601/5205] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:55 2021] DELETE /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:55.506899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8323f-0938-45d0-8d86-6c36795562d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:55.525225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8323f-0938-45d0-8d86-6c36795562d4 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:55.617315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d5cff-c7ef-442c-9a0c-e3a89abf9798 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:55.620997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d5cff-c7ef-442c-9a0c-e3a89abf9798 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:55.621644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d5cff-c7ef-442c-9a0c-e3a89abf9798 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:55.622536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d5cff-c7ef-442c-9a0c-e3a89abf9798 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:55.623905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d5cff-c7ef-442c-9a0c-e3a89abf9798 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:55.631083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d5cff-c7ef-442c-9a0c-e3a89abf9798 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:55.666395 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2605/5206] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:55 2021] GET /identity/v3/roles => generated 2324 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:55.671131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227c5b-3b13-4b04-881d-a6b6e74d190b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:55.694279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227c5b-3b13-4b04-881d-a6b6e74d190b tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:55.709101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c344d21-c77a-4e1d-84e9-63580d5356dd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:55.710100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c344d21-c77a-4e1d-84e9-63580d5356dd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:55.710394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c344d21-c77a-4e1d-84e9-63580d5356dd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:55.710669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c344d21-c77a-4e1d-84e9-63580d5356dd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:55.711484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c344d21-c77a-4e1d-84e9-63580d5356dd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:55.719780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c344d21-c77a-4e1d-84e9-63580d5356dd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:55.757340 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2602/5207] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:00:55 2021] POST /identity/v3/roles => generated 235 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:55.763756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d5cff-c7ef-442c-9a0c-e3a89abf9798 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:55.775444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d5cff-c7ef-442c-9a0c-e3a89abf9798 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:55.780800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a604594-0509-4c67-aae5-8621bf39d095 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:55.781684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604594-0509-4c67-aae5-8621bf39d095 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:55.781970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604594-0509-4c67-aae5-8621bf39d095 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:55.782471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a604594-0509-4c67-aae5-8621bf39d095 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/447255ca4a1540a1bb39ab8bd12965b5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:55.784362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a604594-0509-4c67-aae5-8621bf39d095 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:update_role(role_id=447255ca4a1540a1bb39ab8bd12965b5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:55.789266 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-4a604594-0509-4c67-aae5-8621bf39d095 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:55.789266 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:00:55.789266 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:00:55.790170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a604594-0509-4c67-aae5-8621bf39d095 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:55.852939 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2606/5208] 10.222.0.21 () {60 vars in 1242 bytes} [Sat Nov 27 21:00:55 2021] PATCH /identity/v3/roles/447255ca4a1540a1bb39ab8bd12965b5 => generated 238 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:55.853394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c344d21-c77a-4e1d-84e9-63580d5356dd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:55.871345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c344d21-c77a-4e1d-84e9-63580d5356dd tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:55.882040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e176ed-da50-462d-8d02-6776b5449c34 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:55.883005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e176ed-da50-462d-8d02-6776b5449c34 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:55.883536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e176ed-da50-462d-8d02-6776b5449c34 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:55.883975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e176ed-da50-462d-8d02-6776b5449c34 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/447255ca4a1540a1bb39ab8bd12965b5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:55.895880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e176ed-da50-462d-8d02-6776b5449c34 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:get_role(role_id=447255ca4a1540a1bb39ab8bd12965b5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:55.898019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e176ed-da50-462d-8d02-6776b5449c34 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:55.903708 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2603/5209] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 21:00:55 2021] GET /identity/v3/roles/447255ca4a1540a1bb39ab8bd12965b5 => generated 238 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:55.905005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a604594-0509-4c67-aae5-8621bf39d095 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:55.920667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a604594-0509-4c67-aae5-8621bf39d095 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:55.931918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70da8-08d2-47b3-b3fb-7f861641628a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:55.933278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70da8-08d2-47b3-b3fb-7f861641628a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:55.933841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70da8-08d2-47b3-b3fb-7f861641628a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:55.934584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70da8-08d2-47b3-b3fb-7f861641628a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:55.935554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b70da8-08d2-47b3-b3fb-7f861641628a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:55.940870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b70da8-08d2-47b3-b3fb-7f861641628a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:55.960047 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2607/5210] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:55 2021] GET /identity/v3/roles => generated 2553 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:00:55.963804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e176ed-da50-462d-8d02-6776b5449c34 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:55.983180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e176ed-da50-462d-8d02-6776b5449c34 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:55.991675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37008391-f9e2-4405-9710-29d7de3b2d82 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:55.993243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37008391-f9e2-4405-9710-29d7de3b2d82 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:55.993759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37008391-f9e2-4405-9710-29d7de3b2d82 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:55.994283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37008391-f9e2-4405-9710-29d7de3b2d82 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/447255ca4a1540a1bb39ab8bd12965b5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:55.996877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37008391-f9e2-4405-9710-29d7de3b2d82 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_role(role_id=447255ca4a1540a1bb39ab8bd12965b5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:56.002036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37008391-f9e2-4405-9710-29d7de3b2d82 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:56.083835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-37008391-f9e2-4405-9710-29d7de3b2d82 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role 447255ca4a1540a1bb39ab8bd12965b5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:56.084127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-37008391-f9e2-4405-9710-29d7de3b2d82 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:56.084967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-37008391-f9e2-4405-9710-29d7de3b2d82 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:56.088241 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2604/5211] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:55 2021] DELETE /identity/v3/roles/447255ca4a1540a1bb39ab8bd12965b5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:56.093336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70da8-08d2-47b3-b3fb-7f861641628a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:56.095702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b0b70da8-08d2-47b3-b3fb-7f861641628a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:56.112027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70da8-08d2-47b3-b3fb-7f861641628a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:56.181894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c4fc1-1f37-4d58-ae14-7b40484ffa6e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:56.182904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c4fc1-1f37-4d58-ae14-7b40484ffa6e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:56.183196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c4fc1-1f37-4d58-ae14-7b40484ffa6e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:56.183510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c4fc1-1f37-4d58-ae14-7b40484ffa6e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:56.185668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c4fc1-1f37-4d58-ae14-7b40484ffa6e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:56.187433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c4fc1-1f37-4d58-ae14-7b40484ffa6e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:56.228070 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2608/5212] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:56 2021] PUT /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 521 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:56.233458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37008391-f9e2-4405-9710-29d7de3b2d82 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:56.252806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37008391-f9e2-4405-9710-29d7de3b2d82 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:56.333671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c4fc1-1f37-4d58-ae14-7b40484ffa6e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:56.336836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c69c4fc1-1f37-4d58-ae14-7b40484ffa6e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:56.346178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b1713-d474-4444-863e-ea89ea8f8369 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:56.348308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1713-d474-4444-863e-ea89ea8f8369 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:56.348890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1713-d474-4444-863e-ea89ea8f8369 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:56.349657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1713-d474-4444-863e-ea89ea8f8369 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/9aac185ff4ee44aa927ef0573b19b6f4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:56.352187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b1713-d474-4444-863e-ea89ea8f8369 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=9aac185ff4ee44aa927ef0573b19b6f4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:56.354426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b1713-d474-4444-863e-ea89ea8f8369 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:56.394766 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2605/5213] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:56 2021] PUT /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/9aac185ff4ee44aa927ef0573b19b6f4 => generated 521 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:56.396282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b1713-d474-4444-863e-ea89ea8f8369 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:56.441965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c4fc1-1f37-4d58-ae14-7b40484ffa6e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:56.604361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b1713-d474-4444-863e-ea89ea8f8369 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:56.604987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:56.605544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:56.605832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:56.606162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] PATH_INFO: `/v3/projects/ed51b0be674f4b678a4c751f1fc5a4cb` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:56.608458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed51b0be674f4b678a4c751f1fc5a4cb)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:56.611562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:56.614210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba594bba-0497-4553-9199-4851e03dbc2d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:56.616369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba594bba-0497-4553-9199-4851e03dbc2d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:56.616923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba594bba-0497-4553-9199-4851e03dbc2d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:56.617584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba594bba-0497-4553-9199-4851e03dbc2d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4/implies/d23755780ff0440199fe8d4ed2204af0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:56.619928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba594bba-0497-4553-9199-4851e03dbc2d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9aac185ff4ee44aa927ef0573b19b6f4, implied_role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:56.626101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba594bba-0497-4553-9199-4851e03dbc2d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:56.673345 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2606/5214] 10.222.0.21 () {60 vars in 1362 bytes} [Sat Nov 27 21:00:56 2021] PUT /identity/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4/implies/d23755780ff0440199fe8d4ed2204af0 => generated 521 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:56.674843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba594bba-0497-4553-9199-4851e03dbc2d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:56.737310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed51b0be674f4b678a4c751f1fc5a4cb', 'request_id': 'req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:56.751950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed51b0be674f4b678a4c751f1fc5a4cb', 'request_id': 'req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:56.774793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed51b0be674f4b678a4c751f1fc5a4cb', 'request_id': 'req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:56.793256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] The token cache is being invalidate because project ed51b0be674f4b678a4c751f1fc5a4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:56.794457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:56.795770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3460a4cd-a4fa-444c-8a38-8aec4fb7489a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:56.804155 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2609/5215] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:56 2021] DELETE /identity/v3/projects/ed51b0be674f4b678a4c751f1fc5a4cb => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:56.806349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d627e24-1449-4f7f-bd57-967ea27e7cf7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:56.806729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d627e24-1449-4f7f-bd57-967ea27e7cf7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:56.807291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d627e24-1449-4f7f-bd57-967ea27e7cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:56.812129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba594bba-0497-4553-9199-4851e03dbc2d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:56.839226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0d627e24-1449-4f7f-bd57-967ea27e7cf7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:56.840812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0d627e24-1449-4f7f-bd57-967ea27e7cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:56.932746 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2610/5216] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:56.933469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d627e24-1449-4f7f-bd57-967ea27e7cf7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:56.934904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0d627e24-1449-4f7f-bd57-967ea27e7cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:56.957448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d627e24-1449-4f7f-bd57-967ea27e7cf7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:56.971735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf2e21-bd70-4724-886b-53caa5103934 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:56.972621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:56.973416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf2e21-bd70-4724-886b-53caa5103934 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:56.973555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:56.973866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:56.974153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] PATH_INFO: `/v3/users/ed87ef17973a49f2a9108bdfbff65415` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:56.974600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf2e21-bd70-4724-886b-53caa5103934 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:56.975226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf2e21-bd70-4724-886b-53caa5103934 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4/implies` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:56.976372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed87ef17973a49f2a9108bdfbff65415)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:56.977852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf2e21-bd70-4724-886b-53caa5103934 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=9aac185ff4ee44aa927ef0573b19b6f4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:56.979392 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-2cdf2e21-bd70-4724-886b-53caa5103934 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_implied_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:00:56.979392 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:00:56.979392 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:00:56.980951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf2e21-bd70-4724-886b-53caa5103934 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:56.983350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:56.990182 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2607/5217] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:00:56 2021] GET /identity/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4/implies => generated 490 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:56.995068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51737-0d07-41eb-97f7-bf6cf87d4ccf None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:56.995743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51737-0d07-41eb-97f7-bf6cf87d4ccf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:56.996326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51737-0d07-41eb-97f7-bf6cf87d4ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:57.022631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-31f51737-0d07-41eb-97f7-bf6cf87d4ccf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:57.026140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-31f51737-0d07-41eb-97f7-bf6cf87d4ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:57.039753 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2608/5218] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:57.042282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f51737-0d07-41eb-97f7-bf6cf87d4ccf None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:57.045859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-31f51737-0d07-41eb-97f7-bf6cf87d4ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:57.094546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f51737-0d07-41eb-97f7-bf6cf87d4ccf None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:57.103930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed87ef17973a49f2a9108bdfbff65415'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:57.106618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed87ef17973a49f2a9108bdfbff65415'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:57.110820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0c7fa-9299-4741-8c01-8f18b811020f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:57.113175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0c7fa-9299-4741-8c01-8f18b811020f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:57.114739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0c7fa-9299-4741-8c01-8f18b811020f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:57.116982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0c7fa-9299-4741-8c01-8f18b811020f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:57.119117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0c7fa-9299-4741-8c01-8f18b811020f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:57.122354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0c7fa-9299-4741-8c01-8f18b811020f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:57.127010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed87ef17973a49f2a9108bdfbff65415'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:57.128837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed87ef17973a49f2a9108bdfbff65415'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:57.143437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed87ef17973a49f2a9108bdfbff65415'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:57.144319 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2609/5219] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:00:57 2021] GET /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies => generated 661 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:57.151621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0c7fa-9299-4741-8c01-8f18b811020f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:57.157982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-21d0c7fa-9299-4741-8c01-8f18b811020f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:57.180067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0c7fa-9299-4741-8c01-8f18b811020f tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:57.190817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbc645-9d67-4199-806d-5cee91ebe144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:57.192752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbc645-9d67-4199-806d-5cee91ebe144 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:57.194120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbc645-9d67-4199-806d-5cee91ebe144 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:57.194774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbc645-9d67-4199-806d-5cee91ebe144 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:57.195923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbc645-9d67-4199-806d-5cee91ebe144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:57.196383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbc645-9d67-4199-806d-5cee91ebe144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:57.198172 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2611/5220] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:56 2021] DELETE /identity/v3/users/ed87ef17973a49f2a9108bdfbff65415 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:57.199035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbc645-9d67-4199-806d-5cee91ebe144 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:57.199602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:57.202210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:57.217296 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2610/5221] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:57.232493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbc645-9d67-4199-806d-5cee91ebe144 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:57.261133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbc645-9d67-4199-806d-5cee91ebe144 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:57.391612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aaa6f-fdc2-4df7-ad10-3124a2abc4be admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:57.397439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b183-a08a-45b3-acee-efebcf99ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:57.398109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b183-a08a-45b3-acee-efebcf99ac5e admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:57.398472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b183-a08a-45b3-acee-efebcf99ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:57.398818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc2508-3c50-4c5b-8feb-f12fd12b801d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:57.399733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b183-a08a-45b3-acee-efebcf99ac5e admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:57.400500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6b183-a08a-45b3-acee-efebcf99ac5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:57.401955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2508-3c50-4c5b-8feb-f12fd12b801d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:57.402896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2508-3c50-4c5b-8feb-f12fd12b801d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:57.403890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2508-3c50-4c5b-8feb-f12fd12b801d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4/implies/d23755780ff0440199fe8d4ed2204af0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:57.404035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6b183-a08a-45b3-acee-efebcf99ac5e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:57.408547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc2508-3c50-4c5b-8feb-f12fd12b801d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9aac185ff4ee44aa927ef0573b19b6f4, implied_role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:57.414406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc2508-3c50-4c5b-8feb-f12fd12b801d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:57.449348 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2612/5222] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:57 2021] DELETE /identity/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4/implies/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:57.450654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc2508-3c50-4c5b-8feb-f12fd12b801d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:57.462399 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2611/5223] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:57 2021] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:57.464678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b183-a08a-45b3-acee-efebcf99ac5e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:57.583441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc2508-3c50-4c5b-8feb-f12fd12b801d tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:57.599536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b183-a08a-45b3-acee-efebcf99ac5e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:57.610835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ce1e5-a7db-4052-9b26-19eb3c92e349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:57.615477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce1e5-a7db-4052-9b26-19eb3c92e349 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:57.616268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce1e5-a7db-4052-9b26-19eb3c92e349 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:57.617053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ce1e5-a7db-4052-9b26-19eb3c92e349 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:57.618045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ce1e5-a7db-4052-9b26-19eb3c92e349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:57.620390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ce1e5-a7db-4052-9b26-19eb3c92e349 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:57.654774 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2612/5224] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:57 2021] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:57.659002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ce1e5-a7db-4052-9b26-19eb3c92e349 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:57.681651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ce1e5-a7db-4052-9b26-19eb3c92e349 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:57.690629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c9f9b-67ad-44c0-9a06-8fa6573d7540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:57.692330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c9f9b-67ad-44c0-9a06-8fa6573d7540 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:57.692690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c9f9b-67ad-44c0-9a06-8fa6573d7540 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:57.693116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c9f9b-67ad-44c0-9a06-8fa6573d7540 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:57.694449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c9f9b-67ad-44c0-9a06-8fa6573d7540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:57.697797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c9f9b-67ad-44c0-9a06-8fa6573d7540 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:57.713391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e769-ce4c-454d-941a-5933d2b8067e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:57.714701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e769-ce4c-454d-941a-5933d2b8067e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:57.714923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e769-ce4c-454d-941a-5933d2b8067e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:57.715340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e769-ce4c-454d-941a-5933d2b8067e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/9aac185ff4ee44aa927ef0573b19b6f4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:57.717738 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2613/5225] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:57 2021] GET /identity/v3/roles => generated 2324 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:57.722051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223e769-ce4c-454d-941a-5933d2b8067e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=9aac185ff4ee44aa927ef0573b19b6f4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:57.724121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c9f9b-67ad-44c0-9a06-8fa6573d7540 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:57.724763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223e769-ce4c-454d-941a-5933d2b8067e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:57.738851 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2613/5226] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:57 2021] DELETE /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/9aac185ff4ee44aa927ef0573b19b6f4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:57.743432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e769-ce4c-454d-941a-5933d2b8067e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:57.764773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c9f9b-67ad-44c0-9a06-8fa6573d7540 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:57.838347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e769-ce4c-454d-941a-5933d2b8067e tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:57.846726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af5840-a78c-474e-9c42-f16b3e6c9ce0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:57.849273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af5840-a78c-474e-9c42-f16b3e6c9ce0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:57.849560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af5840-a78c-474e-9c42-f16b3e6c9ce0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:57.850073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af5840-a78c-474e-9c42-f16b3e6c9ce0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:57.855166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af5840-a78c-474e-9c42-f16b3e6c9ce0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=f18e3b12b5f648d39d3950d5323ad4b3, implied_role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:57.857518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af5840-a78c-474e-9c42-f16b3e6c9ce0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:57.872588 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2614/5227] 10.222.0.21 () {58 vars in 1346 bytes} [Sat Nov 27 21:00:57 2021] DELETE /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3/implies/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:00:57.875545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af5840-a78c-474e-9c42-f16b3e6c9ce0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:57.876901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-60af5840-a78c-474e-9c42-f16b3e6c9ce0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:57.908464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca364ed-c33d-47e9-8c7f-54116009e923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:57.909335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca364ed-c33d-47e9-8c7f-54116009e923 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:57.909783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca364ed-c33d-47e9-8c7f-54116009e923 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:57.910406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca364ed-c33d-47e9-8c7f-54116009e923 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:57.910989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca364ed-c33d-47e9-8c7f-54116009e923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:57.913137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca364ed-c33d-47e9-8c7f-54116009e923 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:57.932775 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2614/5228] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:57 2021] GET /identity/v3/roles => generated 2324 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:57.937728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca364ed-c33d-47e9-8c7f-54116009e923 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:57.952176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca364ed-c33d-47e9-8c7f-54116009e923 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:58.018325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af5840-a78c-474e-9c42-f16b3e6c9ce0 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:58.031980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:58.033839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:58.034144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:58.034424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] PATH_INFO: `/v3/projects/376670c463284dec902268e55ba60b72` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:58.038779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=376670c463284dec902268e55ba60b72)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:58.045496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:58.067216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01013826-a64a-4e8c-a9be-9ba3eb02a0aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:58.068206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01013826-a64a-4e8c-a9be-9ba3eb02a0aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:58.068529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01013826-a64a-4e8c-a9be-9ba3eb02a0aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:58.068852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01013826-a64a-4e8c-a9be-9ba3eb02a0aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/79eb09a1a0ae4acb9e1476007b8b6672` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:58.089118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01013826-a64a-4e8c-a9be-9ba3eb02a0aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 21:00:58.104644 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-01013826-a64a-4e8c-a9be-9ba3eb02a0aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Could not find domain: 79eb09a1a0ae4acb9e1476007b8b6672.: keystone.exception.DomainNotFound: Could not find domain: 79eb09a1a0ae4acb9e1476007b8b6672. Nov 27 21:00:58.107395 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2615/5229] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:00:57 2021] PATCH /identity/v3/domains/79eb09a1a0ae4acb9e1476007b8b6672 => generated 112 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:00:58.108527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01013826-a64a-4e8c-a9be-9ba3eb02a0aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:58.125720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01013826-a64a-4e8c-a9be-9ba3eb02a0aa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:58.128999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376670c463284dec902268e55ba60b72', 'request_id': 'req-536712b5-1817-4b43-92c2-695343ea3b52'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.143730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376670c463284dec902268e55ba60b72', 'request_id': 'req-536712b5-1817-4b43-92c2-695343ea3b52'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.162449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376670c463284dec902268e55ba60b72', 'request_id': 'req-536712b5-1817-4b43-92c2-695343ea3b52'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.180929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] The token cache is being invalidate because project 376670c463284dec902268e55ba60b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:58.181241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.181978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.183888 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2615/5230] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:57 2021] DELETE /identity/v3/projects/376670c463284dec902268e55ba60b72 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:58.189619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:58.194137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:58.253432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3621ea8-9d8d-4c2c-806e-6e6169aa2a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:58.258157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621ea8-9d8d-4c2c-806e-6e6169aa2a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:58.258931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621ea8-9d8d-4c2c-806e-6e6169aa2a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:58.259481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621ea8-9d8d-4c2c-806e-6e6169aa2a00 admin admin] PATH_INFO: `/v3/projects/f19d8aeeda0a4c2db52a980daa542a6e/users/93681e22fe044deabb09dee1c32b9699/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:58.286643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3621ea8-9d8d-4c2c-806e-6e6169aa2a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19d8aeeda0a4c2db52a980daa542a6e, user_id=93681e22fe044deabb09dee1c32b9699, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:58.289954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3621ea8-9d8d-4c2c-806e-6e6169aa2a00 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:58.302362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536712b5-1817-4b43-92c2-695343ea3b52 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:58.323758 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2616/5231] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:58 2021] PUT /identity/v3/projects/f19d8aeeda0a4c2db52a980daa542a6e/users/93681e22fe044deabb09dee1c32b9699/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:58.325476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab972b-7cfd-4726-a3f3-b4e9c408cbeb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:58.325765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab972b-7cfd-4726-a3f3-b4e9c408cbeb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:58.326044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab972b-7cfd-4726-a3f3-b4e9c408cbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:58.432078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43412395-ceb4-446c-83e1-ec0318d3a6a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:58.433307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412395-ceb4-446c-83e1-ec0318d3a6a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:58.433591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412395-ceb4-446c-83e1-ec0318d3a6a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:58.433893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412395-ceb4-446c-83e1-ec0318d3a6a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/users/f2ec3be4079d4ac088bab28e8d9795e7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:58.435508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-88ab972b-7cfd-4726-a3f3-b4e9c408cbeb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:58.441840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43412395-ceb4-446c-83e1-ec0318d3a6a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f2ec3be4079d4ac088bab28e8d9795e7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:58.444215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43412395-ceb4-446c-83e1-ec0318d3a6a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:58.445413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-88ab972b-7cfd-4726-a3f3-b4e9c408cbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:58.513411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-43412395-ceb4-446c-83e1-ec0318d3a6a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ec3be4079d4ac088bab28e8d9795e7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.514102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-43412395-ceb4-446c-83e1-ec0318d3a6a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ec3be4079d4ac088bab28e8d9795e7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.529380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-43412395-ceb4-446c-83e1-ec0318d3a6a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ec3be4079d4ac088bab28e8d9795e7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.530523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-43412395-ceb4-446c-83e1-ec0318d3a6a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ec3be4079d4ac088bab28e8d9795e7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.544644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-43412395-ceb4-446c-83e1-ec0318d3a6a5 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ec3be4079d4ac088bab28e8d9795e7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.577209 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2616/5232] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:58 2021] DELETE /identity/v3/users/f2ec3be4079d4ac088bab28e8d9795e7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:58.577209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeee116-2f45-4674-922d-b5da7cf461c0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:58.577209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeee116-2f45-4674-922d-b5da7cf461c0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:58.578133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeee116-2f45-4674-922d-b5da7cf461c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:58.579764 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2617/5233] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:58.587778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab972b-7cfd-4726-a3f3-b4e9c408cbeb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:58.589694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-88ab972b-7cfd-4726-a3f3-b4e9c408cbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:58.604920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab972b-7cfd-4726-a3f3-b4e9c408cbeb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:58.614566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6aeee116-2f45-4674-922d-b5da7cf461c0 None None] MFA Rules not processed for user `93681e22fe044deabb09dee1c32b9699`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:58.616390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6aeee116-2f45-4674-922d-b5da7cf461c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:58.693182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:58.694675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:58.695111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:58.695470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/d23755780ff0440199fe8d4ed2204af0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:58.699161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d23755780ff0440199fe8d4ed2204af0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:58.704032 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2617/5234] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:58 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:58.704032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2936ee9-7224-43d4-ba23-3cbca356c7b6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:58.704335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:58.704436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2936ee9-7224-43d4-ba23-3cbca356c7b6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:58.704436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2936ee9-7224-43d4-ba23-3cbca356c7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:58.728391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c2936ee9-7224-43d4-ba23-3cbca356c7b6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:00:58.729928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c2936ee9-7224-43d4-ba23-3cbca356c7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:58.754342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role d23755780ff0440199fe8d4ed2204af0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:58.754639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.755442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:58.760333 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2618/5235] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:58 2021] DELETE /identity/v3/roles/d23755780ff0440199fe8d4ed2204af0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:58.763496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:58.764722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:58.847292 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2618/5236] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:00:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:00:58.849565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2936ee9-7224-43d4-ba23-3cbca356c7b6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:58.851435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c2936ee9-7224-43d4-ba23-3cbca356c7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:58.886493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2936ee9-7224-43d4-ba23-3cbca356c7b6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:58.918741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9a5d5-e06e-4cb1-884a-159e46e37fc8 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:58.926710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94732b-13e3-412c-a5c4-a15f206bafa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:58.927793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94732b-13e3-412c-a5c4-a15f206bafa0 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:58.928237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94732b-13e3-412c-a5c4-a15f206bafa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:58.928726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94732b-13e3-412c-a5c4-a15f206bafa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:58.929947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94732b-13e3-412c-a5c4-a15f206bafa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:58.933540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94732b-13e3-412c-a5c4-a15f206bafa0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:58.994806 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2619/5237] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:58 2021] POST /identity/v3/projects => generated 381 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:58.996671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94732b-13e3-412c-a5c4-a15f206bafa0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:59.008832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105eac-316a-4d55-8204-cb71c16c4c8a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:59.009822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105eac-316a-4d55-8204-cb71c16c4c8a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:59.010108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105eac-316a-4d55-8204-cb71c16c4c8a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:59.010484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105eac-316a-4d55-8204-cb71c16c4c8a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/groups/0283fc14b5d1418a99c128119d7b4b67` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:59.013939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52105eac-316a-4d55-8204-cb71c16c4c8a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0283fc14b5d1418a99c128119d7b4b67)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:59.016088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52105eac-316a-4d55-8204-cb71c16c4c8a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:59.106003 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2619/5238] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 21:00:58 2021] DELETE /identity/v3/groups/0283fc14b5d1418a99c128119d7b4b67 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:59.107043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105eac-316a-4d55-8204-cb71c16c4c8a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:59.164618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94732b-13e3-412c-a5c4-a15f206bafa0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:59.245751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105eac-316a-4d55-8204-cb71c16c4c8a tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:59.254314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55bc91-ba52-44b1-8056-6a64ab4faa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:59.254671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a288f-b15c-4934-a834-741aed1aad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:59.255124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55bc91-ba52-44b1-8056-6a64ab4faa99 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:59.255643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a288f-b15c-4934-a834-741aed1aad8c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:59.255773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55bc91-ba52-44b1-8056-6a64ab4faa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:59.256198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55bc91-ba52-44b1-8056-6a64ab4faa99 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:59.256934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a288f-b15c-4934-a834-741aed1aad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:59.257153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55bc91-ba52-44b1-8056-6a64ab4faa99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:59.257419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a288f-b15c-4934-a834-741aed1aad8c admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:59.259209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a288f-b15c-4934-a834-741aed1aad8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:00:59.259681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a288f-b15c-4934-a834-741aed1aad8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:59.259895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55bc91-ba52-44b1-8056-6a64ab4faa99 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:59.262334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a288f-b15c-4934-a834-741aed1aad8c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:59.290802 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2620/5239] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:00:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:59.290802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a288f-b15c-4934-a834-741aed1aad8c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:59.300035 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2620/5240] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:59 2021] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:59.300035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55bc91-ba52-44b1-8056-6a64ab4faa99 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:59.305264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8b55bc91-ba52-44b1-8056-6a64ab4faa99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:59.368675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a288f-b15c-4934-a834-741aed1aad8c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:59.376685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:59.378219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:59.378800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:59.379405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:59.382186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5666232ad764d609fcb7bf3e4ce7f8d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:59.384645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:59.451142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5666232ad764d609fcb7bf3e4ce7f8d', 'request_id': 'req-234ff132-bed4-4739-a267-327d6fb8ec21'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.458109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55bc91-ba52-44b1-8056-6a64ab4faa99 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:59.462880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5666232ad764d609fcb7bf3e4ce7f8d', 'request_id': 'req-234ff132-bed4-4739-a267-327d6fb8ec21'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.471019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5666232ad764d609fcb7bf3e4ce7f8d', 'request_id': 'req-234ff132-bed4-4739-a267-327d6fb8ec21'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.489858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] The token cache is being invalidate because project d5666232ad764d609fcb7bf3e4ce7f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:00:59.490168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.491902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.494060 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2621/5241] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:00:59 2021] DELETE /identity/v3/projects/d5666232ad764d609fcb7bf3e4ce7f8d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:59.495186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:59.496632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:59.550036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9635c9-80f4-47d1-8fdc-1c675883ac57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:59.550761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9635c9-80f4-47d1-8fdc-1c675883ac57 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:59.551049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9635c9-80f4-47d1-8fdc-1c675883ac57 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:59.551452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9635c9-80f4-47d1-8fdc-1c675883ac57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:59.554619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5c9635c9-80f4-47d1-8fdc-1c675883ac57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:59.573185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9635c9-80f4-47d1-8fdc-1c675883ac57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:59.575062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9635c9-80f4-47d1-8fdc-1c675883ac57 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:59.595857 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2621/5242] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:00:59.597976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9635c9-80f4-47d1-8fdc-1c675883ac57 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:59.599498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5c9635c9-80f4-47d1-8fdc-1c675883ac57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:59.605871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ff132-bed4-4739-a267-327d6fb8ec21 tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:59.613086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aa02f-d1c2-40f0-8a23-bd8296b6cb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:59.613790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aa02f-d1c2-40f0-8a23-bd8296b6cb82 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:59.614080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aa02f-d1c2-40f0-8a23-bd8296b6cb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:59.614359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aa02f-d1c2-40f0-8a23-bd8296b6cb82 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:59.615076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4aa02f-d1c2-40f0-8a23-bd8296b6cb82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:59.616466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9635c9-80f4-47d1-8fdc-1c675883ac57 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:59.617405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4aa02f-d1c2-40f0-8a23-bd8296b6cb82 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:59.622950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec98a82-f78f-49dd-82f0-2fb7ca88d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:59.624038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec98a82-f78f-49dd-82f0-2fb7ca88d5ef admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:59.624447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec98a82-f78f-49dd-82f0-2fb7ca88d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:59.625035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec98a82-f78f-49dd-82f0-2fb7ca88d5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:59.626333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec98a82-f78f-49dd-82f0-2fb7ca88d5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:59.628596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec98a82-f78f-49dd-82f0-2fb7ca88d5ef admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:59.644057 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2622/5243] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:00:59 2021] GET /identity/v3/roles => generated 2098 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:00:59.649051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec98a82-f78f-49dd-82f0-2fb7ca88d5ef admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:59.651365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aec98a82-f78f-49dd-82f0-2fb7ca88d5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:59.664193 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2622/5244] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:00:59 2021] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:59.666378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aa02f-d1c2-40f0-8a23-bd8296b6cb82 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:59.667802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec98a82-f78f-49dd-82f0-2fb7ca88d5ef admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:59.671125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8f4aa02f-d1c2-40f0-8a23-bd8296b6cb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:59.748485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:59.749394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:59.749852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:59.750420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] PATH_INFO: `/v3/users/90cfe912b1b841d8afa7c51dc387fc59` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:59.751836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] RBAC: Authorizing `identity:delete_user(user_id=90cfe912b1b841d8afa7c51dc387fc59)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:59.754007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:59.764447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aa02f-d1c2-40f0-8a23-bd8296b6cb82 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:59.773054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:59.774343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:59.774805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:59.775237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/a66e64e81ec440658d5efb2e32746906` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:59.778885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a66e64e81ec440658d5efb2e32746906)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:59.781951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:59.806895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a66e64e81ec440658d5efb2e32746906'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.807699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a66e64e81ec440658d5efb2e32746906'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.813814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90cfe912b1b841d8afa7c51dc387fc59'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.814614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90cfe912b1b841d8afa7c51dc387fc59'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.825135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90cfe912b1b841d8afa7c51dc387fc59'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.826054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90cfe912b1b841d8afa7c51dc387fc59'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.835988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90cfe912b1b841d8afa7c51dc387fc59'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.844486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a66e64e81ec440658d5efb2e32746906'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.845426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a66e64e81ec440658d5efb2e32746906'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:00:59.850470 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2623/5245] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:00:59 2021] PATCH /identity/v3/domains/a66e64e81ec440658d5efb2e32746906 => generated 277 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:00:59.851886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:59.854295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:59.865096 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2623/5246] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:00:59 2021] DELETE /identity/v3/users/90cfe912b1b841d8afa7c51dc387fc59 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:59.865096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:59.865096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:59.939442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b669a9-2cff-4796-afcd-50ce2c38e3bb tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:59.945356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce561142-1695-48a9-be92-cd5ce43e5014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:59.945625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adbe5f-ffa2-4f12-8790-9534c89087df admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:00:59.946241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce561142-1695-48a9-be92-cd5ce43e5014 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:59.946521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce561142-1695-48a9-be92-cd5ce43e5014 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:59.946792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce561142-1695-48a9-be92-cd5ce43e5014 admin admin] PATH_INFO: `/v3/projects/f3a66efa157240ae9223f1f3e57fb9dc/users/038261d3bbe3408ea2ea07d6731c8942/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:59.952414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0535b0-4210-4a99-974d-7195268c65fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:00:59.953387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0535b0-4210-4a99-974d-7195268c65fc admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:00:59.953753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0535b0-4210-4a99-974d-7195268c65fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:00:59.954023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0535b0-4210-4a99-974d-7195268c65fc admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:00:59.954723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0535b0-4210-4a99-974d-7195268c65fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:59.957193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0535b0-4210-4a99-974d-7195268c65fc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:59.969201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce561142-1695-48a9-be92-cd5ce43e5014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a66efa157240ae9223f1f3e57fb9dc, user_id=038261d3bbe3408ea2ea07d6731c8942, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:00:59.972679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce561142-1695-48a9-be92-cd5ce43e5014 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:00:59.981970 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2624/5247] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:00:59 2021] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:00:59.983280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0535b0-4210-4a99-974d-7195268c65fc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:00:59.985750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-be0535b0-4210-4a99-974d-7195268c65fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:00:59.996691 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2624/5248] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:00:59 2021] PUT /identity/v3/projects/f3a66efa157240ae9223f1f3e57fb9dc/users/038261d3bbe3408ea2ea07d6731c8942/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:00:59.998623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce561142-1695-48a9-be92-cd5ce43e5014 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:00.000673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ce561142-1695-48a9-be92-cd5ce43e5014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.059712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0535b0-4210-4a99-974d-7195268c65fc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:00.115040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce561142-1695-48a9-be92-cd5ce43e5014 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:00.121116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:00.122341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:00.122977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:00.123563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/domains/a66e64e81ec440658d5efb2e32746906` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:00.138109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a66e64e81ec440658d5efb2e32746906)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:00.138909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e6504-1382-43e3-bb40-daeab3d0db0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:00.140054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:00.141926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e6504-1382-43e3-bb40-daeab3d0db0d service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:00.142411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e6504-1382-43e3-bb40-daeab3d0db0d service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:00.143010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e6504-1382-43e3-bb40-daeab3d0db0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:00.146095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-129e6504-1382-43e3-bb40-daeab3d0db0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.182514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a66e64e81ec440658d5efb2e32746906'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.189004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e6504-1382-43e3-bb40-daeab3d0db0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:00.192658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e6504-1382-43e3-bb40-daeab3d0db0d service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:00.205143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a66e64e81ec440658d5efb2e32746906'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.219651 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2625/5249] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:00:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:00.221491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89a5ab-9d36-4c02-97a7-262f5ec3e7f4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:00.225062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89a5ab-9d36-4c02-97a7-262f5ec3e7f4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:00.225560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89a5ab-9d36-4c02-97a7-262f5ec3e7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:00.269695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0f89a5ab-9d36-4c02-97a7-262f5ec3e7f4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:00.271981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0f89a5ab-9d36-4c02-97a7-262f5ec3e7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.307570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66e64e81ec440658d5efb2e32746906', 'request_id': 'req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.324096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66e64e81ec440658d5efb2e32746906', 'request_id': 'req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.338880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66e64e81ec440658d5efb2e32746906', 'request_id': 'req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.357826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] The token cache is being invalidate because project a66e64e81ec440658d5efb2e32746906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:00.358298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.359297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.366343 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2626/5250] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:00.368563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89a5ab-9d36-4c02-97a7-262f5ec3e7f4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:00.370384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0f89a5ab-9d36-4c02-97a7-262f5ec3e7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.398141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89a5ab-9d36-4c02-97a7-262f5ec3e7f4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:00.401245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a66e64e81ec440658d5efb2e32746906', 'request_id': 'req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.404239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a66e64e81ec440658d5efb2e32746906', 'request_id': 'req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.405208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a66e64e81ec440658d5efb2e32746906', 'request_id': 'req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.414809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700240e-5c19-481c-9719-929505883b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:00.415845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700240e-5c19-481c-9719-929505883b50 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:00.416384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700240e-5c19-481c-9719-929505883b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:00.416780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700240e-5c19-481c-9719-929505883b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:00.417742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700240e-5c19-481c-9719-929505883b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:00.420895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700240e-5c19-481c-9719-929505883b50 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:00.425650 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2625/5251] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:00:59 2021] DELETE /identity/v3/domains/a66e64e81ec440658d5efb2e32746906 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:00.426892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:00.429475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.456212 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2627/5252] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:00 2021] GET /identity/v3/roles => generated 2098 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:00.456212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700240e-5c19-481c-9719-929505883b50 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:00.457157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeda8d2-40bf-4333-9499-13ec8cd4c4ae tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:00.458465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2700240e-5c19-481c-9719-929505883b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.464809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21e453-68ad-402c-8d71-8d8d974d0b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:00.466443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e453-68ad-402c-8d71-8d8d974d0b30 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:00.467202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e453-68ad-402c-8d71-8d8d974d0b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:00.467720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21e453-68ad-402c-8d71-8d8d974d0b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:00.469582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21e453-68ad-402c-8d71-8d8d974d0b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:00.472759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21e453-68ad-402c-8d71-8d8d974d0b30 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:00.490080 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2626/5253] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:00 2021] GET /identity/v3/roles => generated 2098 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:00.492012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21e453-68ad-402c-8d71-8d8d974d0b30 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:00.494213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ef21e453-68ad-402c-8d71-8d8d974d0b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.556524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700240e-5c19-481c-9719-929505883b50 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:00.561817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f242-40e8-4446-bd02-e9988826cac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:00.563074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f242-40e8-4446-bd02-e9988826cac6 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:00.563277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f242-40e8-4446-bd02-e9988826cac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:00.563514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f242-40e8-4446-bd02-e9988826cac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:00.568007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e799f242-40e8-4446-bd02-e9988826cac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.584210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799f242-40e8-4446-bd02-e9988826cac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:00.585829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799f242-40e8-4446-bd02-e9988826cac6 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:00.598943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21e453-68ad-402c-8d71-8d8d974d0b30 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:00.611415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:00.615697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:00.615697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:00.615697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:00.615697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9aac185ff4ee44aa927ef0573b19b6f4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:00.616419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:00.634954 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2628/5254] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:00.639010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f242-40e8-4446-bd02-e9988826cac6 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:00.644018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e799f242-40e8-4446-bd02-e9988826cac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.677974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f242-40e8-4446-bd02-e9988826cac6 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:00.692458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d80e-1454-4062-9b2b-e2012f4481da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:00.694719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d80e-1454-4062-9b2b-e2012f4481da admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:00.697371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d80e-1454-4062-9b2b-e2012f4481da admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:00.697371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d80e-1454-4062-9b2b-e2012f4481da admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:00.698126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055d80e-1454-4062-9b2b-e2012f4481da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:00.702797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055d80e-1454-4062-9b2b-e2012f4481da admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:00.707815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role 9aac185ff4ee44aa927ef0573b19b6f4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:00.708116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.711449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.723885 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2627/5255] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:00 2021] DELETE /identity/v3/roles/9aac185ff4ee44aa927ef0573b19b6f4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:00.724821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:00.729812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.758805 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2629/5256] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:00 2021] GET /identity/v3/roles => generated 1872 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:00.758805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d80e-1454-4062-9b2b-e2012f4481da admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:00.761888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7055d80e-1454-4062-9b2b-e2012f4481da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.797563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d80e-1454-4062-9b2b-e2012f4481da admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:00.884499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870fb94-bcaf-4620-b5bc-c0154dafe7ab tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:00.901776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b210fa-7dc3-427b-99d7-eca9cb0f6c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:00.904901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b210fa-7dc3-427b-99d7-eca9cb0f6c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:00.907244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b210fa-7dc3-427b-99d7-eca9cb0f6c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:00.907524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:00.908606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b210fa-7dc3-427b-99d7-eca9cb0f6c19 admin admin] PATH_INFO: `/v3/projects/f3a66efa157240ae9223f1f3e57fb9dc/users/038261d3bbe3408ea2ea07d6731c8942/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:00.908742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:00.908923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:00.909564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/371ec2aa26b042a2a7c90d0ec0612bc1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:00.911241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_role(role_id=371ec2aa26b042a2a7c90d0ec0612bc1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:00.913364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:00.913907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b210fa-7dc3-427b-99d7-eca9cb0f6c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a66efa157240ae9223f1f3e57fb9dc, user_id=038261d3bbe3408ea2ea07d6731c8942, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:00.922909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b210fa-7dc3-427b-99d7-eca9cb0f6c19 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:00.956520 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2628/5257] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:00 2021] PUT /identity/v3/projects/f3a66efa157240ae9223f1f3e57fb9dc/users/038261d3bbe3408ea2ea07d6731c8942/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:00.957516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b210fa-7dc3-427b-99d7-eca9cb0f6c19 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:00.965361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-63b210fa-7dc3-427b-99d7-eca9cb0f6c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:00.979474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role 371ec2aa26b042a2a7c90d0ec0612bc1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:00.979794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.980797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:00.986571 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2630/5258] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:00 2021] DELETE /identity/v3/roles/371ec2aa26b042a2a7c90d0ec0612bc1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:00.987796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:00.989800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.072432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b210fa-7dc3-427b-99d7-eca9cb0f6c19 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:01.079554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b7611-f67a-421b-84c4-18f735735b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:01.080716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b7611-f67a-421b-84c4-18f735735b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:01.081034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b7611-f67a-421b-84c4-18f735735b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:01.081491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b7611-f67a-421b-84c4-18f735735b4a admin admin] PATH_INFO: `/v3/projects/2a621d68a46c42269f2eea4bc56c671f/users/1ca08ebddb1742d18951633bf019d743/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:01.081966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ca247-48c6-4c80-a128-9f69a02d8efa tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:01.097970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:01.098995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:01.099878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:01.100236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] PATH_INFO: `/v3/projects/0244f189ab184335836dff9b74a0fcb6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:01.102853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0244f189ab184335836dff9b74a0fcb6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:01.104728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b7611-f67a-421b-84c4-18f735735b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a621d68a46c42269f2eea4bc56c671f, user_id=1ca08ebddb1742d18951633bf019d743, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:01.105428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:01.108785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b7611-f67a-421b-84c4-18f735735b4a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:01.128299 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2629/5259] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:00 2021] PUT /identity/v3/projects/2a621d68a46c42269f2eea4bc56c671f/users/1ca08ebddb1742d18951633bf019d743/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:01.130320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6ac56-2327-4cc8-914b-54596ecff421 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:01.130834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6ac56-2327-4cc8-914b-54596ecff421 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:01.131338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6ac56-2327-4cc8-914b-54596ecff421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:01.181496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0244f189ab184335836dff9b74a0fcb6', 'request_id': 'req-33319e91-1e03-42cc-bbac-031f4c15b9e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.183431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-24e6ac56-2327-4cc8-914b-54596ecff421 None None] MFA Rules not processed for user `038261d3bbe3408ea2ea07d6731c8942`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:01.185191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-24e6ac56-2327-4cc8-914b-54596ecff421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.196427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0244f189ab184335836dff9b74a0fcb6', 'request_id': 'req-33319e91-1e03-42cc-bbac-031f4c15b9e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.210982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0244f189ab184335836dff9b74a0fcb6', 'request_id': 'req-33319e91-1e03-42cc-bbac-031f4c15b9e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.227439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] The token cache is being invalidate because project 0244f189ab184335836dff9b74a0fcb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:01.228338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.229054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.230832 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2631/5260] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:00 2021] DELETE /identity/v3/projects/0244f189ab184335836dff9b74a0fcb6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:01.233398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:01.234789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.295626 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2630/5261] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:01 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:01.297572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373da92-9aad-46aa-b0ac-e35214e535f0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:01.297879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373da92-9aad-46aa-b0ac-e35214e535f0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:01.298536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373da92-9aad-46aa-b0ac-e35214e535f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:01.321041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5373da92-9aad-46aa-b0ac-e35214e535f0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:01.322683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5373da92-9aad-46aa-b0ac-e35214e535f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.344836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33319e91-1e03-42cc-bbac-031f4c15b9e4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:01.354424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '377b7dac1543407cb71fcedeac61b78b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab0c3c79eb494a89af6a933e56b4981b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:01.355606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:01.356014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:01.356540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] PATH_INFO: `/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:01.359045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f18e3b12b5f648d39d3950d5323ad4b3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:01.360933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:01.404341 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2631/5262] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:01.407007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde229-3d9d-40a0-9f5d-103d7ee94917 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:01.407415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde229-3d9d-40a0-9f5d-103d7ee94917 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:01.407703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde229-3d9d-40a0-9f5d-103d7ee94917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:01.439557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invalidating the token cache because role f18e3b12b5f648d39d3950d5323ad4b3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:01.439909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-69fde229-3d9d-40a0-9f5d-103d7ee94917 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:01.440713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.441630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-69fde229-3d9d-40a0-9f5d-103d7ee94917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.445257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.448513 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2632/5263] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:01 2021] DELETE /identity/v3/roles/f18e3b12b5f648d39d3950d5323ad4b3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:01.449815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:01.455754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.457207 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2632/5264] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:01.458249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fde229-3d9d-40a0-9f5d-103d7ee94917 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:01.459844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-69fde229-3d9d-40a0-9f5d-103d7ee94917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.539377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fde229-3d9d-40a0-9f5d-103d7ee94917 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:01.576291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0612b5-580f-438d-9391-4ff0db22eadc tempest-RolesV3TestJSON-337822569 tempest-RolesV3TestJSON-337822569-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:01.581491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf76c87-d6d2-4053-af84-ae7e7e1df68d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:01.582368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76c87-d6d2-4053-af84-ae7e7e1df68d service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:01.582690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76c87-d6d2-4053-af84-ae7e7e1df68d service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:01.582936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76c87-d6d2-4053-af84-ae7e7e1df68d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:01.585534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1bf76c87-d6d2-4053-af84-ae7e7e1df68d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.613139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22bc57-9377-4d1a-bfa4-80824a93b9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:01.614029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22bc57-9377-4d1a-bfa4-80824a93b9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:01.614180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22bc57-9377-4d1a-bfa4-80824a93b9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:01.614377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22bc57-9377-4d1a-bfa4-80824a93b9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:01.616669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9b22bc57-9377-4d1a-bfa4-80824a93b9c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.691192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf76c87-d6d2-4053-af84-ae7e7e1df68d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:01.693602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf76c87-d6d2-4053-af84-ae7e7e1df68d service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:01.716765 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2633/5265] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:01 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:01.719232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf76c87-d6d2-4053-af84-ae7e7e1df68d service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:01.720995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1bf76c87-d6d2-4053-af84-ae7e7e1df68d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.737907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22bc57-9377-4d1a-bfa4-80824a93b9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:01.739727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22bc57-9377-4d1a-bfa4-80824a93b9c5 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:01.754640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf76c87-d6d2-4053-af84-ae7e7e1df68d service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:01.766695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:01.769018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:01.769529 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2633/5266] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:01.769875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:01.770732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] PATH_INFO: `/v3/users/2f48b644fc1b4c8b81e6d1ad37122d3a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:01.772617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeed56b-8aae-459e-bfac-ca8fd09f4b0d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:01.773672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f48b644fc1b4c8b81e6d1ad37122d3a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:01.773959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeed56b-8aae-459e-bfac-ca8fd09f4b0d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:01.774472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeed56b-8aae-459e-bfac-ca8fd09f4b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:01.779300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:01.820441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cdeed56b-8aae-459e-bfac-ca8fd09f4b0d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:01.825728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cdeed56b-8aae-459e-bfac-ca8fd09f4b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.853956 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2634/5267] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:01.858440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeed56b-8aae-459e-bfac-ca8fd09f4b0d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:01.895456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f48b644fc1b4c8b81e6d1ad37122d3a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.897170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f48b644fc1b4c8b81e6d1ad37122d3a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.916818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeed56b-8aae-459e-bfac-ca8fd09f4b0d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:01.927998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6131638-f984-4013-96f3-2958bd6132af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:01.929431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6131638-f984-4013-96f3-2958bd6132af admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:01.929770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6131638-f984-4013-96f3-2958bd6132af admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:01.930176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6131638-f984-4013-96f3-2958bd6132af admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:01.931138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6131638-f984-4013-96f3-2958bd6132af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:01.931730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6131638-f984-4013-96f3-2958bd6132af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:01.934976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6131638-f984-4013-96f3-2958bd6132af admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:01.939848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f48b644fc1b4c8b81e6d1ad37122d3a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.940757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f48b644fc1b4c8b81e6d1ad37122d3a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.966370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f48b644fc1b4c8b81e6d1ad37122d3a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:01.969827 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2635/5268] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:01.970994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6131638-f984-4013-96f3-2958bd6132af admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:01.974516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b6131638-f984-4013-96f3-2958bd6132af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:01.994411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6131638-f984-4013-96f3-2958bd6132af admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:01.999927 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2634/5269] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:01 2021] DELETE /identity/v3/users/2f48b644fc1b4c8b81e6d1ad37122d3a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:01.999927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:02.000242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:02.071060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe1b7b-cc4d-464e-bf17-7ace64854311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:02.071865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe1b7b-cc4d-464e-bf17-7ace64854311 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:02.072178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe1b7b-cc4d-464e-bf17-7ace64854311 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:02.072512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe1b7b-cc4d-464e-bf17-7ace64854311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:02.075187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2afe1b7b-cc4d-464e-bf17-7ace64854311 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:02.120748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803a5c5-77fb-40d7-b383-0c4136f3c938 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:02.147354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfab9a-9baf-4d83-9859-391ed3d3071c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:02.148778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfab9a-9baf-4d83-9859-391ed3d3071c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:02.149739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfab9a-9baf-4d83-9859-391ed3d3071c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:02.150206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfab9a-9baf-4d83-9859-391ed3d3071c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:02.151299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfab9a-9baf-4d83-9859-391ed3d3071c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:02.154176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfab9a-9baf-4d83-9859-391ed3d3071c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:02.171395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe1b7b-cc4d-464e-bf17-7ace64854311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:02.175661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe1b7b-cc4d-464e-bf17-7ace64854311 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:02.193196 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2636/5270] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:01 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:02.194998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150baa0-e022-4ad4-90f1-c17a44a1315b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:02.195505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150baa0-e022-4ad4-90f1-c17a44a1315b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:02.196236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150baa0-e022-4ad4-90f1-c17a44a1315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:02.200162 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2635/5271] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:01 2021] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:02.205978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfab9a-9baf-4d83-9859-391ed3d3071c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:02.220684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7150baa0-e022-4ad4-90f1-c17a44a1315b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:02.221973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7150baa0-e022-4ad4-90f1-c17a44a1315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:02.308065 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2637/5272] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:02.322962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfab9a-9baf-4d83-9859-391ed3d3071c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:02.329748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb009-9f19-4a2b-8e24-a729a9e3b44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:02.330724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb009-9f19-4a2b-8e24-a729a9e3b44a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:02.331172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb009-9f19-4a2b-8e24-a729a9e3b44a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:02.332001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cb009-9f19-4a2b-8e24-a729a9e3b44a admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:02.332490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cb009-9f19-4a2b-8e24-a729a9e3b44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:02.335245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cb009-9f19-4a2b-8e24-a729a9e3b44a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:02.339791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150baa0-e022-4ad4-90f1-c17a44a1315b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:02.341689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7150baa0-e022-4ad4-90f1-c17a44a1315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:02.385476 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2636/5273] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:02 2021] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:02.389640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb009-9f19-4a2b-8e24-a729a9e3b44a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:02.415496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cb009-9f19-4a2b-8e24-a729a9e3b44a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:02.438058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d7dc0-f10c-4b6f-a791-467fcea75c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:02.440842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d7dc0-f10c-4b6f-a791-467fcea75c84 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:02.442150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d7dc0-f10c-4b6f-a791-467fcea75c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:02.442447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d7dc0-f10c-4b6f-a791-467fcea75c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:02.445960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d7dc0-f10c-4b6f-a791-467fcea75c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:02.454698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d7dc0-f10c-4b6f-a791-467fcea75c84 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:02.490563 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2637/5274] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:02 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:02.494077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d7dc0-f10c-4b6f-a791-467fcea75c84 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:02.505230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150baa0-e022-4ad4-90f1-c17a44a1315b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:02.520712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66080c90-53e2-4012-8ead-2d4214b22c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:02.521504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66080c90-53e2-4012-8ead-2d4214b22c0e service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:02.522980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66080c90-53e2-4012-8ead-2d4214b22c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:02.523331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66080c90-53e2-4012-8ead-2d4214b22c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:02.529386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d7dc0-f10c-4b6f-a791-467fcea75c84 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:02.544344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66080c90-53e2-4012-8ead-2d4214b22c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:02.546112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66080c90-53e2-4012-8ead-2d4214b22c0e service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:02.547480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06966d7d-7f7d-46c6-8760-841830da2f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:02.550282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06966d7d-7f7d-46c6-8760-841830da2f1e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:02.551503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06966d7d-7f7d-46c6-8760-841830da2f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:02.551837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06966d7d-7f7d-46c6-8760-841830da2f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:02.554378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06966d7d-7f7d-46c6-8760-841830da2f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:02.559553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06966d7d-7f7d-46c6-8760-841830da2f1e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:02.559727 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2638/5275] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:01:02.591776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66080c90-53e2-4012-8ead-2d4214b22c0e service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:02.594131 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2638/5276] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:02 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:02.606186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66080c90-53e2-4012-8ead-2d4214b22c0e service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:02.613939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1319cc-a7a1-42c8-998d-c327699ed423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:02.615350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1319cc-a7a1-42c8-998d-c327699ed423 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:02.615770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1319cc-a7a1-42c8-998d-c327699ed423 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:02.616164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1319cc-a7a1-42c8-998d-c327699ed423 admin admin] PATH_INFO: `/v3/projects/a8761cec323f4d3883ea4df20f06cdd4/users/9a8a86b7e4714090b9e3f1a0876a646c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:02.640812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1319cc-a7a1-42c8-998d-c327699ed423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8761cec323f4d3883ea4df20f06cdd4, user_id=9a8a86b7e4714090b9e3f1a0876a646c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:02.668579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1319cc-a7a1-42c8-998d-c327699ed423 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:02.716575 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2639/5277] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:02 2021] PUT /identity/v3/projects/a8761cec323f4d3883ea4df20f06cdd4/users/9a8a86b7e4714090b9e3f1a0876a646c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:02.721658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afb634-2e85-4a88-9c3b-704ba0dc67ff None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:02.722597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afb634-2e85-4a88-9c3b-704ba0dc67ff None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:02.723032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afb634-2e85-4a88-9c3b-704ba0dc67ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:02.792624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-90afb634-2e85-4a88-9c3b-704ba0dc67ff None None] MFA Rules not processed for user `9a8a86b7e4714090b9e3f1a0876a646c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:02.793911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-90afb634-2e85-4a88-9c3b-704ba0dc67ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:02.944542 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2639/5278] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:02 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:02.954763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1319cc-a7a1-42c8-998d-c327699ed423 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:03.081226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1319cc-a7a1-42c8-998d-c327699ed423 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:03.087231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddf6ab-d1f1-4493-b72b-25ac3f6fa0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:03.088156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf6ab-d1f1-4493-b72b-25ac3f6fa0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:03.088514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf6ab-d1f1-4493-b72b-25ac3f6fa0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:03.089022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddf6ab-d1f1-4493-b72b-25ac3f6fa0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:03.102792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddf6ab-d1f1-4493-b72b-25ac3f6fa0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:03.104561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddf6ab-d1f1-4493-b72b-25ac3f6fa0e4 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:03.120576 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2640/5279] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:02 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:03.548361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afb634-2e85-4a88-9c3b-704ba0dc67ff None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:03.550657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-90afb634-2e85-4a88-9c3b-704ba0dc67ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:03.699320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afb634-2e85-4a88-9c3b-704ba0dc67ff None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:03.716695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:03.717591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:03.717916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:03.718146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] PATH_INFO: `/v3/projects/ff0c5ffa7ffe48c98f9fe4896176ba3a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:03.723432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddf6ab-d1f1-4493-b72b-25ac3f6fa0e4 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:03.732937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0c5ffa7ffe48c98f9fe4896176ba3a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:03.739578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:03.742471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddf6ab-d1f1-4493-b72b-25ac3f6fa0e4 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:03.753532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e50cd-53ee-4111-97ae-89baca58b0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:03.754378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e50cd-53ee-4111-97ae-89baca58b0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:03.754725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e50cd-53ee-4111-97ae-89baca58b0af admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:03.755005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e50cd-53ee-4111-97ae-89baca58b0af admin admin] PATH_INFO: `/v3/users/9a8a86b7e4714090b9e3f1a0876a646c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:03.757766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e50cd-53ee-4111-97ae-89baca58b0af admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8a86b7e4714090b9e3f1a0876a646c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:03.759748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e50cd-53ee-4111-97ae-89baca58b0af admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:03.839227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0c5ffa7ffe48c98f9fe4896176ba3a', 'request_id': 'req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:03.848967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b72e50cd-53ee-4111-97ae-89baca58b0af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8a86b7e4714090b9e3f1a0876a646c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:03.849139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0c5ffa7ffe48c98f9fe4896176ba3a', 'request_id': 'req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:03.860673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0c5ffa7ffe48c98f9fe4896176ba3a', 'request_id': 'req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:03.868904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b72e50cd-53ee-4111-97ae-89baca58b0af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8a86b7e4714090b9e3f1a0876a646c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:03.869904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b72e50cd-53ee-4111-97ae-89baca58b0af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8a86b7e4714090b9e3f1a0876a646c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:03.883442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] The token cache is being invalidate because project ff0c5ffa7ffe48c98f9fe4896176ba3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:03.883442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:03.884058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b72e50cd-53ee-4111-97ae-89baca58b0af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8a86b7e4714090b9e3f1a0876a646c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:03.885880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:03.889412 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2640/5280] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:03 2021] DELETE /identity/v3/projects/ff0c5ffa7ffe48c98f9fe4896176ba3a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:03.899981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:03.901695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:03.905271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b72e50cd-53ee-4111-97ae-89baca58b0af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8a86b7e4714090b9e3f1a0876a646c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:03.921247 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2641/5281] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:03 2021] DELETE /identity/v3/users/9a8a86b7e4714090b9e3f1a0876a646c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:03.926735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6914d40-c99c-4078-8690-611f07824979 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:03.927029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6914d40-c99c-4078-8690-611f07824979 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:03.927335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6914d40-c99c-4078-8690-611f07824979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:03.955019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b6914d40-c99c-4078-8690-611f07824979 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:03.957025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b6914d40-c99c-4078-8690-611f07824979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:03.988829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db15dc-b70e-46bb-a8fb-90b3b3ed2990 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:04.131914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea682f9-8c02-4c23-801a-8a89b6668048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:04.133603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea682f9-8c02-4c23-801a-8a89b6668048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:04.133893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea682f9-8c02-4c23-801a-8a89b6668048 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:04.134180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea682f9-8c02-4c23-801a-8a89b6668048 admin admin] PATH_INFO: `/v3/users/377b7dac1543407cb71fcedeac61b78b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:04.140451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea682f9-8c02-4c23-801a-8a89b6668048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=377b7dac1543407cb71fcedeac61b78b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:04.149287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea682f9-8c02-4c23-801a-8a89b6668048 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:04.157117 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2642/5282] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:04.170058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6914d40-c99c-4078-8690-611f07824979 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:04.173012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b6914d40-c99c-4078-8690-611f07824979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:04.205050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6914d40-c99c-4078-8690-611f07824979 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:04.217714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:04.217714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:04.217714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:04.217714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] PATH_INFO: `/v3/users/a40da6fadf6c4e8bbeb5a4d5fc4cc1fd` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:04.218114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40da6fadf6c4e8bbeb5a4d5fc4cc1fd)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:04.218114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:04.278371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8ea682f9-8c02-4c23-801a-8a89b6668048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377b7dac1543407cb71fcedeac61b78b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:04.279162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8ea682f9-8c02-4c23-801a-8a89b6668048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377b7dac1543407cb71fcedeac61b78b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:04.292852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8ea682f9-8c02-4c23-801a-8a89b6668048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377b7dac1543407cb71fcedeac61b78b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:04.293625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8ea682f9-8c02-4c23-801a-8a89b6668048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377b7dac1543407cb71fcedeac61b78b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:04.322828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40da6fadf6c4e8bbeb5a4d5fc4cc1fd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:04.327432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8ea682f9-8c02-4c23-801a-8a89b6668048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377b7dac1543407cb71fcedeac61b78b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:04.342427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40da6fadf6c4e8bbeb5a4d5fc4cc1fd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:04.344046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40da6fadf6c4e8bbeb5a4d5fc4cc1fd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:04.356193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40da6fadf6c4e8bbeb5a4d5fc4cc1fd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:04.381286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40da6fadf6c4e8bbeb5a4d5fc4cc1fd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:04.394512 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2643/5283] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:04 2021] DELETE /identity/v3/users/a40da6fadf6c4e8bbeb5a4d5fc4cc1fd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:04.394512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:04.395651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:04.416294 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2641/5284] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:03 2021] DELETE /identity/v3/users/377b7dac1543407cb71fcedeac61b78b => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:04.417786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a953f72-d282-4c19-b50b-4e880f76507c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:04.418235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a953f72-d282-4c19-b50b-4e880f76507c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:04.418361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a953f72-d282-4c19-b50b-4e880f76507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:04.459232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4a953f72-d282-4c19-b50b-4e880f76507c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:04.462454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4a953f72-d282-4c19-b50b-4e880f76507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:04.517876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1452067-ba89-4a5e-9d5f-61573a7c3cec admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:04.622355 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2642/5285] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:04.649985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a953f72-d282-4c19-b50b-4e880f76507c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:04.673270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7838f-5969-4754-ae4a-00362d71f1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:04.674162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7838f-5969-4754-ae4a-00362d71f1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:04.674517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7838f-5969-4754-ae4a-00362d71f1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:04.675108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7838f-5969-4754-ae4a-00362d71f1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:04.678675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-39e7838f-5969-4754-ae4a-00362d71f1b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:04.724832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7838f-5969-4754-ae4a-00362d71f1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:04.727397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7838f-5969-4754-ae4a-00362d71f1b7 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:04.755270 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2644/5286] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:04.770879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a953f72-d282-4c19-b50b-4e880f76507c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:04.776169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a9e61-f428-4650-a0f8-47614be1ec8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:04.777624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a9e61-f428-4650-a0f8-47614be1ec8a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:04.778005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a9e61-f428-4650-a0f8-47614be1ec8a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:04.778419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a9e61-f428-4650-a0f8-47614be1ec8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:04.793151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a9e61-f428-4650-a0f8-47614be1ec8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:04.794855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a9e61-f428-4650-a0f8-47614be1ec8a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:04.811696 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2643/5287] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:05.256366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7838f-5969-4754-ae4a-00362d71f1b7 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:05.258370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-39e7838f-5969-4754-ae4a-00362d71f1b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:05.276745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7838f-5969-4754-ae4a-00362d71f1b7 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:05.286132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2c82-238f-409d-a112-52a371123991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:05.287199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2c82-238f-409d-a112-52a371123991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:05.287908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2c82-238f-409d-a112-52a371123991 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:05.288957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2c82-238f-409d-a112-52a371123991 admin admin] PATH_INFO: `/v3/users/93681e22fe044deabb09dee1c32b9699` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:05.293679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af2c82-238f-409d-a112-52a371123991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93681e22fe044deabb09dee1c32b9699)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:05.297378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af2c82-238f-409d-a112-52a371123991 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:05.371799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-12af2c82-238f-409d-a112-52a371123991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93681e22fe044deabb09dee1c32b9699'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.384968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-12af2c82-238f-409d-a112-52a371123991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93681e22fe044deabb09dee1c32b9699'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.386130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-12af2c82-238f-409d-a112-52a371123991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93681e22fe044deabb09dee1c32b9699'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.401110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-12af2c82-238f-409d-a112-52a371123991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93681e22fe044deabb09dee1c32b9699'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.411569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a9e61-f428-4650-a0f8-47614be1ec8a service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:05.417756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-580a9e61-f428-4650-a0f8-47614be1ec8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:05.420926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-12af2c82-238f-409d-a112-52a371123991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93681e22fe044deabb09dee1c32b9699'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.439840 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2645/5288] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:05 2021] DELETE /identity/v3/users/93681e22fe044deabb09dee1c32b9699 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:05.444685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a9e61-f428-4650-a0f8-47614be1ec8a service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:05.449361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51a10-3de3-4b9a-970b-3ee9a3eb3c5f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:05.449769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51a10-3de3-4b9a-970b-3ee9a3eb3c5f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:05.450696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51a10-3de3-4b9a-970b-3ee9a3eb3c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:05.474746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-88e51a10-3de3-4b9a-970b-3ee9a3eb3c5f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:05.476162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-88e51a10-3de3-4b9a-970b-3ee9a3eb3c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:05.530259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:05.531728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:05.532307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:05.532835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] PATH_INFO: `/v3/projects/ab0c3c79eb494a89af6a933e56b4981b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:05.535019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0c3c79eb494a89af6a933e56b4981b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:05.547083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:05.569435 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2646/5289] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:05.572725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51a10-3de3-4b9a-970b-3ee9a3eb3c5f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:05.575052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-88e51a10-3de3-4b9a-970b-3ee9a3eb3c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:05.590248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51a10-3de3-4b9a-970b-3ee9a3eb3c5f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:05.596273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:05.597191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:05.597480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:05.597780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] PATH_INFO: `/v3/projects/ca0593ed63ef4485bdc237459cf2f12e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:05.599155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0593ed63ef4485bdc237459cf2f12e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:05.601505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:05.627533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0c3c79eb494a89af6a933e56b4981b', 'request_id': 'req-f04a6ea7-8fd6-4615-b415-0d42b8b93312'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.636568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0c3c79eb494a89af6a933e56b4981b', 'request_id': 'req-f04a6ea7-8fd6-4615-b415-0d42b8b93312'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.648576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0c3c79eb494a89af6a933e56b4981b', 'request_id': 'req-f04a6ea7-8fd6-4615-b415-0d42b8b93312'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.660405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] The token cache is being invalidate because project ab0c3c79eb494a89af6a933e56b4981b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:05.660678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.661412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.663212 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2644/5290] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:05 2021] DELETE /identity/v3/projects/ab0c3c79eb494a89af6a933e56b4981b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:05.663828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:05.665457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:05.694038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0593ed63ef4485bdc237459cf2f12e', 'request_id': 'req-0884001f-5a63-4266-836e-79f697546ade'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.702257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0593ed63ef4485bdc237459cf2f12e', 'request_id': 'req-0884001f-5a63-4266-836e-79f697546ade'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.710584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0593ed63ef4485bdc237459cf2f12e', 'request_id': 'req-0884001f-5a63-4266-836e-79f697546ade'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.722467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] The token cache is being invalidate because project ca0593ed63ef4485bdc237459cf2f12e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:05.722765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.724736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.729466 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2647/5291] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:05 2021] DELETE /identity/v3/projects/ca0593ed63ef4485bdc237459cf2f12e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:05.729466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:05.730156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:05.731235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a6ea7-8fd6-4615-b415-0d42b8b93312 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:05.792577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd597c-09cd-4d3f-84bd-b7ca169a3ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:05.793233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd597c-09cd-4d3f-84bd-b7ca169a3ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:05.793512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd597c-09cd-4d3f-84bd-b7ca169a3ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:05.793918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd597c-09cd-4d3f-84bd-b7ca169a3ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:05.795765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1bcd597c-09cd-4d3f-84bd-b7ca169a3ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:05.806619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884001f-5a63-4266-836e-79f697546ade admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:05.808576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd597c-09cd-4d3f-84bd-b7ca169a3ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:05.809963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd597c-09cd-4d3f-84bd-b7ca169a3ce2 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:05.811482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:05.812366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:05.812645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:05.812915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] PATH_INFO: `/v3/projects/a8761cec323f4d3883ea4df20f06cdd4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:05.814157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8761cec323f4d3883ea4df20f06cdd4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:05.816811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:05.821482 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2645/5292] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:05.822907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618764-0259-4512-a587-823377b2c023 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:05.823197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618764-0259-4512-a587-823377b2c023 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:05.823639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618764-0259-4512-a587-823377b2c023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:05.856760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-55618764-0259-4512-a587-823377b2c023 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:05.862156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-55618764-0259-4512-a587-823377b2c023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:05.890002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8761cec323f4d3883ea4df20f06cdd4', 'request_id': 'req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.902539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8761cec323f4d3883ea4df20f06cdd4', 'request_id': 'req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.917883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8761cec323f4d3883ea4df20f06cdd4', 'request_id': 'req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.932715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] The token cache is being invalidate because project a8761cec323f4d3883ea4df20f06cdd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:05.933267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.934141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0fe173de-ef7b-4cfd-80ac-386a7a9b33a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:05.936945 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2648/5293] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:05 2021] DELETE /identity/v3/projects/a8761cec323f4d3883ea4df20f06cdd4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:05.938488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6cf4-27ed-4c39-a0b9-e68688810caa None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:05.938787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6cf4-27ed-4c39-a0b9-e68688810caa None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:05.939065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6cf4-27ed-4c39-a0b9-e68688810caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:05.961438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-970f6cf4-27ed-4c39-a0b9-e68688810caa None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:05.963327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-970f6cf4-27ed-4c39-a0b9-e68688810caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:05.971230 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2646/5294] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:05.972370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09eff-0509-44fd-be35-aa4c190cbe85 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:05.972668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09eff-0509-44fd-be35-aa4c190cbe85 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:05.972932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09eff-0509-44fd-be35-aa4c190cbe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:05.986521 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2649/5295] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:05.988612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af63e0-73be-4a4f-a16a-a5d6dda955b1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:05.989211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af63e0-73be-4a4f-a16a-a5d6dda955b1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:05.989883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af63e0-73be-4a4f-a16a-a5d6dda955b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.002239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-dbb09eff-0509-44fd-be35-aa4c190cbe85 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:06.003478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dbb09eff-0509-44fd-be35-aa4c190cbe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:06.016385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-79af63e0-73be-4a4f-a16a-a5d6dda955b1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:06.019869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-79af63e0-73be-4a4f-a16a-a5d6dda955b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:06.030004 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2650/5296] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:06.032113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba354-dbbe-469d-8c8b-a016e700f4a1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.032984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba354-dbbe-469d-8c8b-a016e700f4a1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.032984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba354-dbbe-469d-8c8b-a016e700f4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.036069 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2647/5297] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:06.046946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb09eff-0509-44fd-be35-aa4c190cbe85 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.053374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-444ba354-dbbe-469d-8c8b-a016e700f4a1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:06.055172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-444ba354-dbbe-469d-8c8b-a016e700f4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:06.059040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb09eff-0509-44fd-be35-aa4c190cbe85 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.065717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bcf67-c909-44bd-a130-13cd9923853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.066470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bcf67-c909-44bd-a130-13cd9923853a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.066765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bcf67-c909-44bd-a130-13cd9923853a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.067034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bcf67-c909-44bd-a130-13cd9923853a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.068275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bcf67-c909-44bd-a130-13cd9923853a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:06.068275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bcf67-c909-44bd-a130-13cd9923853a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.070357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bcf67-c909-44bd-a130-13cd9923853a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.074238 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2651/5298] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:06.079043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c1b66-56d0-4ab3-b1da-b8065ba0bae7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.079472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c1b66-56d0-4ab3-b1da-b8065ba0bae7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.079652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c1b66-56d0-4ab3-b1da-b8065ba0bae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.086440 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2648/5299] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:06.087524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bcf67-c909-44bd-a130-13cd9923853a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.100364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bcf67-c909-44bd-a130-13cd9923853a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.105942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567a926-9a55-4b1b-8eae-f9cc695d62e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.106604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567a926-9a55-4b1b-8eae-f9cc695d62e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.106892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567a926-9a55-4b1b-8eae-f9cc695d62e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.107168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567a926-9a55-4b1b-8eae-f9cc695d62e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.107583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d75c1b66-56d0-4ab3-b1da-b8065ba0bae7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:06.107934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567a926-9a55-4b1b-8eae-f9cc695d62e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:06.108342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567a926-9a55-4b1b-8eae-f9cc695d62e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.108853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d75c1b66-56d0-4ab3-b1da-b8065ba0bae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:06.109985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567a926-9a55-4b1b-8eae-f9cc695d62e5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.117892 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2652/5300] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:06.118997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c1b66-56d0-4ab3-b1da-b8065ba0bae7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.128479 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2649/5301] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:06.129116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c1b66-56d0-4ab3-b1da-b8065ba0bae7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.129243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567a926-9a55-4b1b-8eae-f9cc695d62e5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.134459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae16d1f-3725-4b4c-b285-e4b4a762b7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.135120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16d1f-3725-4b4c-b285-e4b4a762b7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.135463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16d1f-3725-4b4c-b285-e4b4a762b7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.135744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae16d1f-3725-4b4c-b285-e4b4a762b7c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.136452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae16d1f-3725-4b4c-b285-e4b4a762b7c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.138367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae16d1f-3725-4b4c-b285-e4b4a762b7c5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.153712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567a926-9a55-4b1b-8eae-f9cc695d62e5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.164878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98b4d0-bb10-43a1-a04f-f68bbc373cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.166066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b4d0-bb10-43a1-a04f-f68bbc373cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.166362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b4d0-bb10-43a1-a04f-f68bbc373cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.166638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98b4d0-bb10-43a1-a04f-f68bbc373cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.167442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98b4d0-bb10-43a1-a04f-f68bbc373cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:06.167755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98b4d0-bb10-43a1-a04f-f68bbc373cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.169396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98b4d0-bb10-43a1-a04f-f68bbc373cc9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.191307 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2650/5302] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:06.191612 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2653/5303] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:06 2021] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:06.191612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae16d1f-3725-4b4c-b285-e4b4a762b7c5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.191788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98b4d0-bb10-43a1-a04f-f68bbc373cc9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.206448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98b4d0-bb10-43a1-a04f-f68bbc373cc9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.324232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae16d1f-3725-4b4c-b285-e4b4a762b7c5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.329135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bfe17-b06d-4c93-871d-aced91bbc3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.330051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bfe17-b06d-4c93-871d-aced91bbc3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.330433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bfe17-b06d-4c93-871d-aced91bbc3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.330888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bfe17-b06d-4c93-871d-aced91bbc3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.331737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bfe17-b06d-4c93-871d-aced91bbc3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.333091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc537b-c7b9-4541-9c02-2a931264ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.333758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc537b-c7b9-4541-9c02-2a931264ac2c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.334403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc537b-c7b9-4541-9c02-2a931264ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.334654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc537b-c7b9-4541-9c02-2a931264ac2c admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.335210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bfe17-b06d-4c93-871d-aced91bbc3c6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.335440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc537b-c7b9-4541-9c02-2a931264ac2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.337808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc537b-c7b9-4541-9c02-2a931264ac2c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.397305 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2651/5304] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:06 2021] POST /identity/v3/projects => generated 357 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:06.399420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bfe17-b06d-4c93-871d-aced91bbc3c6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.426056 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2654/5305] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:06 2021] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:06.426693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc537b-c7b9-4541-9c02-2a931264ac2c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.435138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-17fc537b-c7b9-4541-9c02-2a931264ac2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:06.529069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bfe17-b06d-4c93-871d-aced91bbc3c6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.546996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc537b-c7b9-4541-9c02-2a931264ac2c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.554021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.555356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.555824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.556337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] PATH_INFO: `/v3/projects/f19d8aeeda0a4c2db52a980daa542a6e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.557665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19d8aeeda0a4c2db52a980daa542a6e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.559763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.630117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abe82a-c755-494d-b299-44e358e9ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.630956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abe82a-c755-494d-b299-44e358e9ffc1 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.631246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abe82a-c755-494d-b299-44e358e9ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.632028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abe82a-c755-494d-b299-44e358e9ffc1 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.633114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abe82a-c755-494d-b299-44e358e9ffc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.636043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abe82a-c755-494d-b299-44e358e9ffc1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.666301 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2652/5306] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:06 2021] POST /identity/v3/users => generated 285 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:06.667740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abe82a-c755-494d-b299-44e358e9ffc1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.681664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19d8aeeda0a4c2db52a980daa542a6e', 'request_id': 'req-246f7f69-d682-47e3-8e30-db2a0b33ff16'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:06.683741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abe82a-c755-494d-b299-44e358e9ffc1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.693313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19d8aeeda0a4c2db52a980daa542a6e', 'request_id': 'req-246f7f69-d682-47e3-8e30-db2a0b33ff16'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:06.708268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19d8aeeda0a4c2db52a980daa542a6e', 'request_id': 'req-246f7f69-d682-47e3-8e30-db2a0b33ff16'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:06.721170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] The token cache is being invalidate because project f19d8aeeda0a4c2db52a980daa542a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:06.721640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:06.722539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:06.724458 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2655/5307] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:06 2021] DELETE /identity/v3/projects/f19d8aeeda0a4c2db52a980daa542a6e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:06.726218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.726724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:06.765924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064660ed-55cb-4a76-a924-17b7f5273324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.766615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064660ed-55cb-4a76-a924-17b7f5273324 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.767160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064660ed-55cb-4a76-a924-17b7f5273324 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.767475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064660ed-55cb-4a76-a924-17b7f5273324 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.769383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064660ed-55cb-4a76-a924-17b7f5273324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.774231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064660ed-55cb-4a76-a924-17b7f5273324 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.815312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7f69-d682-47e3-8e30-db2a0b33ff16 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.815533 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2653/5308] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:06 2021] POST /identity/v3/users => generated 279 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:06.816288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064660ed-55cb-4a76-a924-17b7f5273324 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.818538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-064660ed-55cb-4a76-a924-17b7f5273324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:06.821256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc06a2-603a-420d-a021-d8ece1b9266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.822107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc06a2-603a-420d-a021-d8ece1b9266a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.822545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc06a2-603a-420d-a021-d8ece1b9266a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.822905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc06a2-603a-420d-a021-d8ece1b9266a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.825344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc06a2-603a-420d-a021-d8ece1b9266a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.830393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc06a2-603a-420d-a021-d8ece1b9266a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.832868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064660ed-55cb-4a76-a924-17b7f5273324 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.844749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea137e77-fd7b-4379-8001-8a6b9fb516c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.845463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea137e77-fd7b-4379-8001-8a6b9fb516c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.846284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea137e77-fd7b-4379-8001-8a6b9fb516c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.846617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea137e77-fd7b-4379-8001-8a6b9fb516c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.847433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea137e77-fd7b-4379-8001-8a6b9fb516c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.849739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea137e77-fd7b-4379-8001-8a6b9fb516c6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.866887 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2654/5309] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:06 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:06.867805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea137e77-fd7b-4379-8001-8a6b9fb516c6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.870286 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2656/5310] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:06 2021] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:06.871035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ea137e77-fd7b-4379-8001-8a6b9fb516c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:06.871418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc06a2-603a-420d-a021-d8ece1b9266a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.875156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e8bc06a2-603a-420d-a021-d8ece1b9266a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:06.889076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc06a2-603a-420d-a021-d8ece1b9266a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.889401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea137e77-fd7b-4379-8001-8a6b9fb516c6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.896065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e24d3c-2218-43d4-a876-1b55c94b5b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.896289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.896753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e24d3c-2218-43d4-a876-1b55c94b5b2f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.897045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e24d3c-2218-43d4-a876-1b55c94b5b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.897327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e24d3c-2218-43d4-a876-1b55c94b5b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.897507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.897775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.898055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] PATH_INFO: `/v3/users/038261d3bbe3408ea2ea07d6731c8942` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.899327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038261d3bbe3408ea2ea07d6731c8942)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.899834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e24d3c-2218-43d4-a876-1b55c94b5b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.901357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.902003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e24d3c-2218-43d4-a876-1b55c94b5b2f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.919835 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2657/5311] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:06 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:06.921040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e24d3c-2218-43d4-a876-1b55c94b5b2f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.939036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e24d3c-2218-43d4-a876-1b55c94b5b2f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:06.952092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba54cce-88e1-4000-b27a-1ae44d4ac739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:06.954095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba54cce-88e1-4000-b27a-1ae44d4ac739 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:06.954821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba54cce-88e1-4000-b27a-1ae44d4ac739 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:06.955060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba54cce-88e1-4000-b27a-1ae44d4ac739 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:06.956575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba54cce-88e1-4000-b27a-1ae44d4ac739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:06.958932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba54cce-88e1-4000-b27a-1ae44d4ac739 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:06.975003 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2658/5312] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:06 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:06.976522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba54cce-88e1-4000-b27a-1ae44d4ac739 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:06.993037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba54cce-88e1-4000-b27a-1ae44d4ac739 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:07.000530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e29a64-6e8d-4157-975a-dbcb0e699336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:07.001974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e29a64-6e8d-4157-975a-dbcb0e699336 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:07.002485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e29a64-6e8d-4157-975a-dbcb0e699336 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:07.005191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e29a64-6e8d-4157-975a-dbcb0e699336 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:07.006179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e29a64-6e8d-4157-975a-dbcb0e699336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:07.008738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e29a64-6e8d-4157-975a-dbcb0e699336 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:07.022449 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2659/5313] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:06 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:07.024238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e29a64-6e8d-4157-975a-dbcb0e699336 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:07.034040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038261d3bbe3408ea2ea07d6731c8942'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:07.034801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038261d3bbe3408ea2ea07d6731c8942'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:07.042825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e29a64-6e8d-4157-975a-dbcb0e699336 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:07.052220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038261d3bbe3408ea2ea07d6731c8942'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:07.052771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038261d3bbe3408ea2ea07d6731c8942'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:07.062728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169ef8-278a-48ca-8b42-6941f325a53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:07.063985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169ef8-278a-48ca-8b42-6941f325a53c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:07.064529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169ef8-278a-48ca-8b42-6941f325a53c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:07.065121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169ef8-278a-48ca-8b42-6941f325a53c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:07.065610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038261d3bbe3408ea2ea07d6731c8942'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:07.065939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8169ef8-278a-48ca-8b42-6941f325a53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:07.068476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8169ef8-278a-48ca-8b42-6941f325a53c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:07.082271 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2660/5314] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:07 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:07.083372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169ef8-278a-48ca-8b42-6941f325a53c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:07.087025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e8169ef8-278a-48ca-8b42-6941f325a53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:07.099434 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2655/5315] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:06 2021] DELETE /identity/v3/users/038261d3bbe3408ea2ea07d6731c8942 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:07.100349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:07.101831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:07.107500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169ef8-278a-48ca-8b42-6941f325a53c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:07.227136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d614cef-8640-4bca-8310-b71e65cb7dd3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:07.232970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15d5d9-36fb-4fe3-b730-d8b00597f9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:07.233904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d5d9-36fb-4fe3-b730-d8b00597f9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:07.234186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d5d9-36fb-4fe3-b730-d8b00597f9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:07.234455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d5d9-36fb-4fe3-b730-d8b00597f9d7 admin admin] PATH_INFO: `/v3/projects/f7f01a7daa6048a1a1a5c840c014683d/users/fbd65b63d5e046dc9f75fb56fd96966c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:07.251293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00316297-e3fd-46cb-8276-be9c58570713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:07.253148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00316297-e3fd-46cb-8276-be9c58570713 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:07.254316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00316297-e3fd-46cb-8276-be9c58570713 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:07.255583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00316297-e3fd-46cb-8276-be9c58570713 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:07.256381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00316297-e3fd-46cb-8276-be9c58570713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:07.258653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00316297-e3fd-46cb-8276-be9c58570713 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:07.276570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15d5d9-36fb-4fe3-b730-d8b00597f9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f01a7daa6048a1a1a5c840c014683d, user_id=fbd65b63d5e046dc9f75fb56fd96966c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:07.277933 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2656/5316] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:07 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:07.279867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00316297-e3fd-46cb-8276-be9c58570713 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:07.280040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15d5d9-36fb-4fe3-b730-d8b00597f9d7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:07.282607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-00316297-e3fd-46cb-8276-be9c58570713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:07.301374 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2661/5317] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:07 2021] PUT /identity/v3/projects/f7f01a7daa6048a1a1a5c840c014683d/users/fbd65b63d5e046dc9f75fb56fd96966c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:07.302449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15d5d9-36fb-4fe3-b730-d8b00597f9d7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:07.327062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00316297-e3fd-46cb-8276-be9c58570713 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:07.443468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e1296-7fdd-4f75-93a7-a5d0686bdfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:07.444766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e1296-7fdd-4f75-93a7-a5d0686bdfac admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:07.446089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e1296-7fdd-4f75-93a7-a5d0686bdfac admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:07.446584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e1296-7fdd-4f75-93a7-a5d0686bdfac admin admin] PATH_INFO: `/v3/projects/ff80d36c8f2d41869c259369e9d107e0/users/60c6f5cb617f448585d371437a4df374/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:07.473001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e1296-7fdd-4f75-93a7-a5d0686bdfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff80d36c8f2d41869c259369e9d107e0, user_id=60c6f5cb617f448585d371437a4df374, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:07.475114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15d5d9-36fb-4fe3-b730-d8b00597f9d7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:07.477227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e1296-7fdd-4f75-93a7-a5d0686bdfac admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:07.498574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f6057-0ffd-470b-bc56-be26f9956b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:07.500609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f6057-0ffd-470b-bc56-be26f9956b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:07.500900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f6057-0ffd-470b-bc56-be26f9956b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:07.504427 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2657/5318] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:07 2021] PUT /identity/v3/projects/ff80d36c8f2d41869c259369e9d107e0/users/60c6f5cb617f448585d371437a4df374/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:07.505522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce27a43-6ac0-49ce-a48e-fcae3c44cd71 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:07.506396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f6057-0ffd-470b-bc56-be26f9956b61 admin admin] PATH_INFO: `/v3/projects/9228698a8c5b4bf99ebfd370603045f4/users/a46b9bd96c834b85b57f9fc0be51d4b7/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:07.508138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce27a43-6ac0-49ce-a48e-fcae3c44cd71 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:07.508428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce27a43-6ac0-49ce-a48e-fcae3c44cd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:07.559492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f6057-0ffd-470b-bc56-be26f9956b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9228698a8c5b4bf99ebfd370603045f4, user_id=a46b9bd96c834b85b57f9fc0be51d4b7, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:07.565472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f6057-0ffd-470b-bc56-be26f9956b61 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:07.586565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-dce27a43-6ac0-49ce-a48e-fcae3c44cd71 None None] MFA Rules not processed for user `fbd65b63d5e046dc9f75fb56fd96966c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:07.588103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dce27a43-6ac0-49ce-a48e-fcae3c44cd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:07.605652 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2662/5319] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:07 2021] PUT /identity/v3/projects/9228698a8c5b4bf99ebfd370603045f4/users/a46b9bd96c834b85b57f9fc0be51d4b7/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:07.605652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2cd8f-ca15-4f82-a5d3-51e988a2eb55 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:07.605652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2cd8f-ca15-4f82-a5d3-51e988a2eb55 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:07.605652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2cd8f-ca15-4f82-a5d3-51e988a2eb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:07.668826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4aa2cd8f-ca15-4f82-a5d3-51e988a2eb55 None None] MFA Rules not processed for user `60c6f5cb617f448585d371437a4df374`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:07.670340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4aa2cd8f-ca15-4f82-a5d3-51e988a2eb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:07.717892 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2658/5320] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:07 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:07.719580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629cafb-7bd5-40f7-9601-1dc16f44e06c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:07.719939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629cafb-7bd5-40f7-9601-1dc16f44e06c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:07.720301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629cafb-7bd5-40f7-9601-1dc16f44e06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:07.781616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8629cafb-7bd5-40f7-9601-1dc16f44e06c None None] MFA Rules not processed for user `a46b9bd96c834b85b57f9fc0be51d4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:07.783909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8629cafb-7bd5-40f7-9601-1dc16f44e06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:07.814303 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2663/5321] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:07 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:07.818719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2cd8f-ca15-4f82-a5d3-51e988a2eb55 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:07.951205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2cd8f-ca15-4f82-a5d3-51e988a2eb55 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:07.953591 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2659/5322] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:07 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:07.954580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629cafb-7bd5-40f7-9601-1dc16f44e06c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:07.956417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f08d9-da82-433b-9000-6dfd9ebb98b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:07.956566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8629cafb-7bd5-40f7-9601-1dc16f44e06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:07.957441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f08d9-da82-433b-9000-6dfd9ebb98b8 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:07.958093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f08d9-da82-433b-9000-6dfd9ebb98b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:07.958846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f08d9-da82-433b-9000-6dfd9ebb98b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:07.959799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f08d9-da82-433b-9000-6dfd9ebb98b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:07.962461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f08d9-da82-433b-9000-6dfd9ebb98b8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:08.004914 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2664/5323] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:07 2021] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:08.006160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f08d9-da82-433b-9000-6dfd9ebb98b8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:08.007959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d96f08d9-da82-433b-9000-6dfd9ebb98b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:08.073404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629cafb-7bd5-40f7-9601-1dc16f44e06c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:08.104584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f08d9-da82-433b-9000-6dfd9ebb98b8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:08.120450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2ebee-fb39-4dac-8f26-9c354ca79cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:08.121432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ebee-fb39-4dac-8f26-9c354ca79cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:08.121917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ebee-fb39-4dac-8f26-9c354ca79cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:08.122612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2ebee-fb39-4dac-8f26-9c354ca79cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:08.176697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf36798-4c63-40c9-bc81-1f79235b364f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:08.177364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf36798-4c63-40c9-bc81-1f79235b364f service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:08.177653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf36798-4c63-40c9-bc81-1f79235b364f service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:08.178131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf36798-4c63-40c9-bc81-1f79235b364f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:08.211168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2ebee-fb39-4dac-8f26-9c354ca79cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:08.214619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2ebee-fb39-4dac-8f26-9c354ca79cf5 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:08.232127 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2665/5324] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:08 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:08.233551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2ebee-fb39-4dac-8f26-9c354ca79cf5 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:08.235875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-22c2ebee-fb39-4dac-8f26-9c354ca79cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:08.254580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf36798-4c63-40c9-bc81-1f79235b364f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:08.255051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf36798-4c63-40c9-bc81-1f79235b364f service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:08.282190 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2660/5325] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:07 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:08.283222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf36798-4c63-40c9-bc81-1f79235b364f service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:08.344707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2ebee-fb39-4dac-8f26-9c354ca79cf5 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:08.353168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:08.354147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:08.354474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:08.354734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] PATH_INFO: `/v3/projects/f3a66efa157240ae9223f1f3e57fb9dc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:08.356339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a66efa157240ae9223f1f3e57fb9dc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:08.361126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:08.408980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf36798-4c63-40c9-bc81-1f79235b364f service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:08.420443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db930b-3c23-4ab5-b470-bcc08a646158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:08.421153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db930b-3c23-4ab5-b470-bcc08a646158 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:08.421489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db930b-3c23-4ab5-b470-bcc08a646158 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:08.421771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db930b-3c23-4ab5-b470-bcc08a646158 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:08.429604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db930b-3c23-4ab5-b470-bcc08a646158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:08.429604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db930b-3c23-4ab5-b470-bcc08a646158 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:08.465803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a66efa157240ae9223f1f3e57fb9dc', 'request_id': 'req-73f54dba-2d1f-4fa2-baed-4b713f39ccce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:08.482121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a66efa157240ae9223f1f3e57fb9dc', 'request_id': 'req-73f54dba-2d1f-4fa2-baed-4b713f39ccce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:08.486483 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2661/5326] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:08 2021] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:08.487357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db930b-3c23-4ab5-b470-bcc08a646158 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:08.499738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a66efa157240ae9223f1f3e57fb9dc', 'request_id': 'req-73f54dba-2d1f-4fa2-baed-4b713f39ccce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:08.505363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db930b-3c23-4ab5-b470-bcc08a646158 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:08.529096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] The token cache is being invalidate because project f3a66efa157240ae9223f1f3e57fb9dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:08.531666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:08.532551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-73f54dba-2d1f-4fa2-baed-4b713f39ccce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:08.534735 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2666/5327] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:08 2021] DELETE /identity/v3/projects/f3a66efa157240ae9223f1f3e57fb9dc => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:08.556119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e872d19-3758-43b5-9240-be02eed7d46e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:08.557096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e872d19-3758-43b5-9240-be02eed7d46e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:08.557096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e872d19-3758-43b5-9240-be02eed7d46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:08.649655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9e872d19-3758-43b5-9240-be02eed7d46e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:08.650899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e872d19-3758-43b5-9240-be02eed7d46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:08.680952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3180e-2684-4799-9486-102646cc8814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:08.685042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3180e-2684-4799-9486-102646cc8814 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:08.685337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3180e-2684-4799-9486-102646cc8814 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:08.685620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3180e-2684-4799-9486-102646cc8814 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:08.686481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3180e-2684-4799-9486-102646cc8814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:08.689273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3180e-2684-4799-9486-102646cc8814 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:08.718920 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2662/5328] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:08 2021] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:08.719918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3180e-2684-4799-9486-102646cc8814 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:08.722295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dfa3180e-2684-4799-9486-102646cc8814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:08.754633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3180e-2684-4799-9486-102646cc8814 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:08.760521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77706c9e-4dfe-4a33-8965-a333c752dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:08.761866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77706c9e-4dfe-4a33-8965-a333c752dccf admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:08.762157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77706c9e-4dfe-4a33-8965-a333c752dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:08.762583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77706c9e-4dfe-4a33-8965-a333c752dccf admin admin] PATH_INFO: `/v3/projects/b30205455bd6404f8449b9a8f6735ca6/users/36568976da1148d2835149ce648f715a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:08.802492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77706c9e-4dfe-4a33-8965-a333c752dccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30205455bd6404f8449b9a8f6735ca6, user_id=36568976da1148d2835149ce648f715a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:08.808068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77706c9e-4dfe-4a33-8965-a333c752dccf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:08.832070 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2667/5329] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:08.832543 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2663/5330] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:08 2021] PUT /identity/v3/projects/b30205455bd6404f8449b9a8f6735ca6/users/36568976da1148d2835149ce648f715a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:08.836239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77706c9e-4dfe-4a33-8965-a333c752dccf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:08.841269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc34a6-0fff-4758-816a-9946dbf3bd79 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:08.841852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc34a6-0fff-4758-816a-9946dbf3bd79 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:08.842460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc34a6-0fff-4758-816a-9946dbf3bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:08.889489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-27bc34a6-0fff-4758-816a-9946dbf3bd79 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:08.891779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-27bc34a6-0fff-4758-816a-9946dbf3bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:08.972561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77706c9e-4dfe-4a33-8965-a333c752dccf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:08.978931 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2668/5331] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:01:08.983415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc34a6-0fff-4758-816a-9946dbf3bd79 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:09.002124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc34a6-0fff-4758-816a-9946dbf3bd79 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:09.013495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02181ace-6b68-4a1d-9ed2-98731702aae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:09.014409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02181ace-6b68-4a1d-9ed2-98731702aae9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.015908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02181ace-6b68-4a1d-9ed2-98731702aae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.016364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02181ace-6b68-4a1d-9ed2-98731702aae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.016791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c61fe-5a95-4abe-aef5-29182c06ad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:09.017581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02181ace-6b68-4a1d-9ed2-98731702aae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:09.017987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02181ace-6b68-4a1d-9ed2-98731702aae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:09.018238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c61fe-5a95-4abe-aef5-29182c06ad5a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.020167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02181ace-6b68-4a1d-9ed2-98731702aae9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:09.022134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c61fe-5a95-4abe-aef5-29182c06ad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.022615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c61fe-5a95-4abe-aef5-29182c06ad5a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.024925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c61fe-5a95-4abe-aef5-29182c06ad5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:09.032292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c61fe-5a95-4abe-aef5-29182c06ad5a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:09.054153 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2669/5332] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:01:09.060772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02181ace-6b68-4a1d-9ed2-98731702aae9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:09.075274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02181ace-6b68-4a1d-9ed2-98731702aae9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:09.079632 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2664/5333] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:08 2021] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:01:09.080552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c61fe-5a95-4abe-aef5-29182c06ad5a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:09.091504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe228bd-65f5-4f5e-ad9b-0e92ddd3bae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:09.092368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe228bd-65f5-4f5e-ad9b-0e92ddd3bae5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.092715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe228bd-65f5-4f5e-ad9b-0e92ddd3bae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.093002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe228bd-65f5-4f5e-ad9b-0e92ddd3bae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.094067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe228bd-65f5-4f5e-ad9b-0e92ddd3bae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:09.097634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe228bd-65f5-4f5e-ad9b-0e92ddd3bae5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:09.107533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c61fe-5a95-4abe-aef5-29182c06ad5a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:09.120065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d4199-03a1-474e-9db8-a594440b9fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:09.122921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4199-03a1-474e-9db8-a594440b9fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.125305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4199-03a1-474e-9db8-a594440b9fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.125610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4199-03a1-474e-9db8-a594440b9fdf admin admin] PATH_INFO: `/v3/projects/b30205455bd6404f8449b9a8f6735ca6/users/36568976da1148d2835149ce648f715a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.131321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d4199-03a1-474e-9db8-a594440b9fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30205455bd6404f8449b9a8f6735ca6, user_id=36568976da1148d2835149ce648f715a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:09.141899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d4199-03a1-474e-9db8-a594440b9fdf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:09.168432 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2665/5334] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:09 2021] PUT /identity/v3/projects/b30205455bd6404f8449b9a8f6735ca6/users/36568976da1148d2835149ce648f715a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:09.189139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea092b-91d0-4b29-b328-440e0b8bc323 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.190307 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2670/5335] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:09 2021] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:09.191088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea092b-91d0-4b29-b328-440e0b8bc323 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.191421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea092b-91d0-4b29-b328-440e0b8bc323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.192335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe228bd-65f5-4f5e-ad9b-0e92ddd3bae5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:09.287708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-25ea092b-91d0-4b29-b328-440e0b8bc323 None None] MFA Rules not processed for user `36568976da1148d2835149ce648f715a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:09.290117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-25ea092b-91d0-4b29-b328-440e0b8bc323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:09.346600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe228bd-65f5-4f5e-ad9b-0e92ddd3bae5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:09.352877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c935c-b80d-40fc-9332-4b97a071da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:09.356704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c935c-b80d-40fc-9332-4b97a071da46 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.357349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c935c-b80d-40fc-9332-4b97a071da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.357745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c935c-b80d-40fc-9332-4b97a071da46 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.359992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c935c-b80d-40fc-9332-4b97a071da46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:09.363032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c935c-b80d-40fc-9332-4b97a071da46 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:09.421015 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2666/5337] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:09 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:09.421295 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2671/5337] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:09 2021] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:09.422876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea092b-91d0-4b29-b328-440e0b8bc323 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:09.425422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8400-fec8-4ea0-9dfd-94ca097904ba None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.425973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8400-fec8-4ea0-9dfd-94ca097904ba None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.426525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8400-fec8-4ea0-9dfd-94ca097904ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.470298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea092b-91d0-4b29-b328-440e0b8bc323 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:09.488995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8e829-7a7a-42b2-b9da-7df8e69c46f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:09.493297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e829-7a7a-42b2-b9da-7df8e69c46f4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.494948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e829-7a7a-42b2-b9da-7df8e69c46f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.495369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e829-7a7a-42b2-b9da-7df8e69c46f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.498740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8e829-7a7a-42b2-b9da-7df8e69c46f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:09.505022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8e829-7a7a-42b2-b9da-7df8e69c46f4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:09.522845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-58ed8400-fec8-4ea0-9dfd-94ca097904ba None None] MFA Rules not processed for user `1ca08ebddb1742d18951633bf019d743`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:09.530034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-58ed8400-fec8-4ea0-9dfd-94ca097904ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:09.544636 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2667/5338] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:09 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:09.549859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8e829-7a7a-42b2-b9da-7df8e69c46f4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:09.573185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8e829-7a7a-42b2-b9da-7df8e69c46f4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:09.588174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee01a1-67e2-4842-b29a-dc6686564c98 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:09.589007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee01a1-67e2-4842-b29a-dc6686564c98 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.589403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee01a1-67e2-4842-b29a-dc6686564c98 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.589838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee01a1-67e2-4842-b29a-dc6686564c98 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.590664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee01a1-67e2-4842-b29a-dc6686564c98 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:09.592775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee01a1-67e2-4842-b29a-dc6686564c98 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:09.663237 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2668/5339] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:01:09 2021] POST /identity/v3/projects => generated 329 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:09.665077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee01a1-67e2-4842-b29a-dc6686564c98 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:09.707309 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2672/5340] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:09 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:09.708843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed8400-fec8-4ea0-9dfd-94ca097904ba None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:09.723692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed8400-fec8-4ea0-9dfd-94ca097904ba None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:09.807209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80858e88-1442-4a61-83eb-a474daae00bd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:09.811971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80858e88-1442-4a61-83eb-a474daae00bd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.812790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80858e88-1442-4a61-83eb-a474daae00bd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.813327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80858e88-1442-4a61-83eb-a474daae00bd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.814367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80858e88-1442-4a61-83eb-a474daae00bd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:09.816716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80858e88-1442-4a61-83eb-a474daae00bd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:09.891322 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2673/5341] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:09 2021] POST /identity/v3/users => generated 416 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:09.891322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0df236-1633-4e2e-b21c-027aa506d26a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.891322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0df236-1633-4e2e-b21c-027aa506d26a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.891322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0df236-1633-4e2e-b21c-027aa506d26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.904370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee01a1-67e2-4842-b29a-dc6686564c98 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:09.912948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-af0df236-1633-4e2e-b21c-027aa506d26a None None] MFA Rules not processed for user `1ca08ebddb1742d18951633bf019d743`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:09.914212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-af0df236-1633-4e2e-b21c-027aa506d26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:09.918930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff191c5-af5f-417f-a265-2500c21d1fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:09.919796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff191c5-af5f-417f-a265-2500c21d1fff admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.920222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff191c5-af5f-417f-a265-2500c21d1fff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.920582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff191c5-af5f-417f-a265-2500c21d1fff admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.921459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff191c5-af5f-417f-a265-2500c21d1fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:09.923949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff191c5-af5f-417f-a265-2500c21d1fff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:09.941191 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2669/5342] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:09 2021] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:09.948006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff191c5-af5f-417f-a265-2500c21d1fff admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:09.961564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff191c5-af5f-417f-a265-2500c21d1fff admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:09.966970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726edd7e-ae21-4fd0-a8d7-d54ea03e69f5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:09.967822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726edd7e-ae21-4fd0-a8d7-d54ea03e69f5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:09.968144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726edd7e-ae21-4fd0-a8d7-d54ea03e69f5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:09.969001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726edd7e-ae21-4fd0-a8d7-d54ea03e69f5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:09.970342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726edd7e-ae21-4fd0-a8d7-d54ea03e69f5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:09.971804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726edd7e-ae21-4fd0-a8d7-d54ea03e69f5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:09.996612 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2670/5343] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:09 2021] POST /identity/v3/roles => generated 243 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:09.996612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726edd7e-ae21-4fd0-a8d7-d54ea03e69f5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:10.008588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726edd7e-ae21-4fd0-a8d7-d54ea03e69f5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:10.013450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00771ca2-cadb-4457-ac71-3decd0df9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:10.014373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771ca2-cadb-4457-ac71-3decd0df9a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:10.014581 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2674/5344] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:09 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:10.014714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771ca2-cadb-4457-ac71-3decd0df9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:10.015530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771ca2-cadb-4457-ac71-3decd0df9a92 admin admin] PATH_INFO: `/v3/projects/22347a0c4e094edda17e12040a9bb14f/users/5e74d6ad2a5c49218955e0c5dd7f1729/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:10.016496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0df236-1633-4e2e-b21c-027aa506d26a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:10.036138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0df236-1633-4e2e-b21c-027aa506d26a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:10.038565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00771ca2-cadb-4457-ac71-3decd0df9a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22347a0c4e094edda17e12040a9bb14f, user_id=5e74d6ad2a5c49218955e0c5dd7f1729, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:10.042251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00771ca2-cadb-4457-ac71-3decd0df9a92 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:10.042848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9964e6-f00b-4f19-955b-38c94a0195fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:10.043934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9964e6-f00b-4f19-955b-38c94a0195fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:10.044284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9964e6-f00b-4f19-955b-38c94a0195fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:10.044566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9964e6-f00b-4f19-955b-38c94a0195fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:10.045980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9964e6-f00b-4f19-955b-38c94a0195fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:10.049983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9964e6-f00b-4f19-955b-38c94a0195fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:10.071311 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2675/5346] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:10 2021] POST /identity/v3/roles => generated 247 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:10.071311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9964e6-f00b-4f19-955b-38c94a0195fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:10.074428 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2671/5346] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:09 2021] PUT /identity/v3/projects/22347a0c4e094edda17e12040a9bb14f/users/5e74d6ad2a5c49218955e0c5dd7f1729/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:10.075843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1b9964e6-f00b-4f19-955b-38c94a0195fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:10.075998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00771ca2-cadb-4457-ac71-3decd0df9a92 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:10.192051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00771ca2-cadb-4457-ac71-3decd0df9a92 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:10.198180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d74c1a-ca57-4c22-95a8-0de42fc56b16 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:10.199126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d74c1a-ca57-4c22-95a8-0de42fc56b16 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:10.199585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d74c1a-ca57-4c22-95a8-0de42fc56b16 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:10.200661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d74c1a-ca57-4c22-95a8-0de42fc56b16 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/9331319f7beb4e8fae50e2f61142e1b0/users/71029afbe3554fc7a06bef9a92333087/roles/888173b74a3240548f6cea5ba255ec38` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:10.230876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9964e6-f00b-4f19-955b-38c94a0195fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:10.232671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d74c1a-ca57-4c22-95a8-0de42fc56b16 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9331319f7beb4e8fae50e2f61142e1b0, user_id=71029afbe3554fc7a06bef9a92333087, role_id=888173b74a3240548f6cea5ba255ec38)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:10.235831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d74c1a-ca57-4c22-95a8-0de42fc56b16 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:10.260885 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2672/5347] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:10 2021] PUT /identity/v3/projects/9331319f7beb4e8fae50e2f61142e1b0/users/71029afbe3554fc7a06bef9a92333087/roles/888173b74a3240548f6cea5ba255ec38 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:10.263672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6503d-0646-4509-a360-5812013df12a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:10.263926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6503d-0646-4509-a360-5812013df12a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:10.264207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6503d-0646-4509-a360-5812013df12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:10.320344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-98b6503d-0646-4509-a360-5812013df12a None None] MFA Rules not processed for user `5e74d6ad2a5c49218955e0c5dd7f1729`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:10.322476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-98b6503d-0646-4509-a360-5812013df12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:10.367201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85410c49-54a1-4726-85a0-744cefb328f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:10.370132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85410c49-54a1-4726-85a0-744cefb328f7 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:10.370132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85410c49-54a1-4726-85a0-744cefb328f7 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:10.370332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85410c49-54a1-4726-85a0-744cefb328f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:10.553023 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2673/5348] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:10 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:10.557803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6503d-0646-4509-a360-5812013df12a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:10.585200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85410c49-54a1-4726-85a0-744cefb328f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:10.586838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85410c49-54a1-4726-85a0-744cefb328f7 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:10.624288 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2676/5349] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:10 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:10.627120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85410c49-54a1-4726-85a0-744cefb328f7 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:10.713127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6503d-0646-4509-a360-5812013df12a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:10.737212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26523c1-20f3-4539-b82a-fce064f2c86e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:10.738131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26523c1-20f3-4539-b82a-fce064f2c86e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:10.738422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26523c1-20f3-4539-b82a-fce064f2c86e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:10.745243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26523c1-20f3-4539-b82a-fce064f2c86e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/9331319f7beb4e8fae50e2f61142e1b0/users/71029afbe3554fc7a06bef9a92333087/roles/a724b23a2dce491f9db0eab6baa0cc50` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:10.771861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26523c1-20f3-4539-b82a-fce064f2c86e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9331319f7beb4e8fae50e2f61142e1b0, user_id=71029afbe3554fc7a06bef9a92333087, role_id=a724b23a2dce491f9db0eab6baa0cc50)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:10.780221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85410c49-54a1-4726-85a0-744cefb328f7 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:10.789057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26523c1-20f3-4539-b82a-fce064f2c86e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:10.829448 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2674/5350] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:10 2021] PUT /identity/v3/projects/9331319f7beb4e8fae50e2f61142e1b0/users/71029afbe3554fc7a06bef9a92333087/roles/a724b23a2dce491f9db0eab6baa0cc50 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:10.832619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26523c1-20f3-4539-b82a-fce064f2c86e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:10.836944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b26523c1-20f3-4539-b82a-fce064f2c86e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:10.909632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fe856-d2b8-4986-b67b-3b45e58f2641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:10.911614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fe856-d2b8-4986-b67b-3b45e58f2641 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:10.912076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fe856-d2b8-4986-b67b-3b45e58f2641 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:10.912530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fe856-d2b8-4986-b67b-3b45e58f2641 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:10.915207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fe856-d2b8-4986-b67b-3b45e58f2641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:10.919451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fe856-d2b8-4986-b67b-3b45e58f2641 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:10.976642 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2677/5351] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:10 2021] POST /identity/v3/projects => generated 383 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:10.976642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fe856-d2b8-4986-b67b-3b45e58f2641 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:11.066225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26523c1-20f3-4539-b82a-fce064f2c86e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:11.105869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fe856-d2b8-4986-b67b-3b45e58f2641 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:11.120324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c088c-b315-4ebf-b973-980aa7f49d39 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:11.121069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c088c-b315-4ebf-b973-980aa7f49d39 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.121361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c088c-b315-4ebf-b973-980aa7f49d39 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.121645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c088c-b315-4ebf-b973-980aa7f49d39 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.122739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c088c-b315-4ebf-b973-980aa7f49d39 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:11.129915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c088c-b315-4ebf-b973-980aa7f49d39 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:11.195787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3096c-cf4a-43ee-9081-d33471550eff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:11.196460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3096c-cf4a-43ee-9081-d33471550eff service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.196867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3096c-cf4a-43ee-9081-d33471550eff service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.197022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3096c-cf4a-43ee-9081-d33471550eff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.198981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a4e3096c-cf4a-43ee-9081-d33471550eff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:11.214385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3096c-cf4a-43ee-9081-d33471550eff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:11.216075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3096c-cf4a-43ee-9081-d33471550eff service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:11.231987 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2678/5352] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:10 2021] GET /identity/v3/users => generated 8620 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:11.233445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c088c-b315-4ebf-b973-980aa7f49d39 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:11.242507 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2675/5353] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:11.244086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04bbd4-44c5-4c98-9c12-0caea1b4f194 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.244386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04bbd4-44c5-4c98-9c12-0caea1b4f194 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.244667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04bbd4-44c5-4c98-9c12-0caea1b4f194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.339882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c088c-b315-4ebf-b973-980aa7f49d39 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:11.343168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3d04bbd4-44c5-4c98-9c12-0caea1b4f194 None None] MFA Rules not processed for user `71029afbe3554fc7a06bef9a92333087`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:11.345289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3d04bbd4-44c5-4c98-9c12-0caea1b4f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:11.346352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f128-1d46-4b41-af46-d754323eb5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:11.347244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f128-1d46-4b41-af46-d754323eb5cb admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.347670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f128-1d46-4b41-af46-d754323eb5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.348048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f128-1d46-4b41-af46-d754323eb5cb admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.349167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f128-1d46-4b41-af46-d754323eb5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:11.351220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f128-1d46-4b41-af46-d754323eb5cb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:11.382848 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2679/5354] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:11 2021] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:11.383534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f128-1d46-4b41-af46-d754323eb5cb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:11.397777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f128-1d46-4b41-af46-d754323eb5cb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:11.416250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1c0a7-060c-4507-ab91-412ffa54c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:11.417337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1c0a7-060c-4507-ab91-412ffa54c969 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.418385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1c0a7-060c-4507-ab91-412ffa54c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.419054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1c0a7-060c-4507-ab91-412ffa54c969 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.420564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1c0a7-060c-4507-ab91-412ffa54c969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:11.422724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1c0a7-060c-4507-ab91-412ffa54c969 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:11.437504 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2676/5355] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:11 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:11.439582 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2680/5356] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:11 2021] GET /identity/v3/roles => generated 1892 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:11.443489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04bbd4-44c5-4c98-9c12-0caea1b4f194 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:11.447266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311fc7-87c7-448f-a4f7-cfe25ad6e44c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.449052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311fc7-87c7-448f-a4f7-cfe25ad6e44c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.449420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97311fc7-87c7-448f-a4f7-cfe25ad6e44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.462262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04bbd4-44c5-4c98-9c12-0caea1b4f194 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:11.473401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5fbe1-625d-4222-b864-242394e6391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:11.474181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5fbe1-625d-4222-b864-242394e6391d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.474527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5fbe1-625d-4222-b864-242394e6391d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.474817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5fbe1-625d-4222-b864-242394e6391d admin admin] PATH_INFO: `/v3/projects/f026172adca44265a96e22ce4aa14936/users/9cb3c38f5e7e49b59300e96cd93bce3b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.474965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-97311fc7-87c7-448f-a4f7-cfe25ad6e44c None None] MFA Rules not processed for user `71029afbe3554fc7a06bef9a92333087`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:11.476348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-97311fc7-87c7-448f-a4f7-cfe25ad6e44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:11.487297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2681/5357] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:11 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:11.491134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311fc7-87c7-448f-a4f7-cfe25ad6e44c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:11.499140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5fbe1-625d-4222-b864-242394e6391d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f026172adca44265a96e22ce4aa14936, user_id=9cb3c38f5e7e49b59300e96cd93bce3b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:11.501311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97311fc7-87c7-448f-a4f7-cfe25ad6e44c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:11.504117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5fbe1-625d-4222-b864-242394e6391d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:11.506905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2af0e-96b7-4855-81a5-b1d1a8780617 tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71029afbe3554fc7a06bef9a92333087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9331319f7beb4e8fae50e2f61142e1b0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1735189974', 'tempest-DelegatedRole-999358490'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:11.508402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2af0e-96b7-4855-81a5-b1d1a8780617 tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.508808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2af0e-96b7-4855-81a5-b1d1a8780617 tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.509435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2af0e-96b7-4855-81a5-b1d1a8780617 tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.511087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2af0e-96b7-4855-81a5-b1d1a8780617 tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] RBAC: Authorizing `identity:create_trust()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:11.512487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2af0e-96b7-4855-81a5-b1d1a8780617 tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:11.526648 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2677/5358] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:11 2021] PUT /identity/v3/projects/f026172adca44265a96e22ce4aa14936/users/9cb3c38f5e7e49b59300e96cd93bce3b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:11.528513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5fbe1-625d-4222-b864-242394e6391d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:11.645688 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2682/5359] 10.222.0.21 () {60 vars in 1173 bytes} [Sat Nov 27 21:01:11 2021] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:11.651608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2af0e-96b7-4855-81a5-b1d1a8780617 tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:11.670994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5fbe1-625d-4222-b864-242394e6391d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:11.692855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce3e38-47d5-4cfa-ba00-263beb0c2bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:11.693148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2af0e-96b7-4855-81a5-b1d1a8780617 tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:11.694050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce3e38-47d5-4cfa-ba00-263beb0c2bec admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.694465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce3e38-47d5-4cfa-ba00-263beb0c2bec admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.694933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce3e38-47d5-4cfa-ba00-263beb0c2bec admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.696387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce3e38-47d5-4cfa-ba00-263beb0c2bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:11.705510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce3e38-47d5-4cfa-ba00-263beb0c2bec admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:11.726803 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2678/5360] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:11 2021] GET /identity/v3/roles => generated 1892 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:11.729195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce3e38-47d5-4cfa-ba00-263beb0c2bec admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:11.757553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce3e38-47d5-4cfa-ba00-263beb0c2bec admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:11.777721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d589d-ae2f-4fa2-accb-c7384a80ab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:11.778782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d589d-ae2f-4fa2-accb-c7384a80ab15 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.779187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d589d-ae2f-4fa2-accb-c7384a80ab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.779671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d589d-ae2f-4fa2-accb-c7384a80ab15 admin admin] PATH_INFO: `/v3/projects/f026172adca44265a96e22ce4aa14936/users/9cb3c38f5e7e49b59300e96cd93bce3b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.783894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d589d-ae2f-4fa2-accb-c7384a80ab15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f026172adca44265a96e22ce4aa14936, user_id=9cb3c38f5e7e49b59300e96cd93bce3b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:11.787110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d589d-ae2f-4fa2-accb-c7384a80ab15 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:11.812652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c95b5f-d681-4404-9e3c-2454dbe36fae tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:11.813440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c95b5f-d681-4404-9e3c-2454dbe36fae tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.813849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c95b5f-d681-4404-9e3c-2454dbe36fae tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.814209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c95b5f-d681-4404-9e3c-2454dbe36fae tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.815023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c95b5f-d681-4404-9e3c-2454dbe36fae tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:11.815654 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2679/5361] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:11 2021] PUT /identity/v3/projects/f026172adca44265a96e22ce4aa14936/users/9cb3c38f5e7e49b59300e96cd93bce3b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:11.824282 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-f7c95b5f-d681-4404-9e3c-2454dbe36fae tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_trusts failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:01:11.824282 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:01:11.824282 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:01:11.824282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c95b5f-d681-4404-9e3c-2454dbe36fae tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:11.828484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7addf9f-089b-42aa-bced-62ed150f45c7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:11.829049 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2683/5362] 10.222.0.21 () {58 vars in 1154 bytes} [Sat Nov 27 21:01:11 2021] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:11.832536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7addf9f-089b-42aa-bced-62ed150f45c7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:11.833009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7addf9f-089b-42aa-bced-62ed150f45c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:11.833512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c95b5f-d681-4404-9e3c-2454dbe36fae tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:11.885235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f7addf9f-089b-42aa-bced-62ed150f45c7 None None] MFA Rules not processed for user `9cb3c38f5e7e49b59300e96cd93bce3b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:11.886992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f7addf9f-089b-42aa-bced-62ed150f45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:11.947652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c95b5f-d681-4404-9e3c-2454dbe36fae tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:11.987480 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2680/5363] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:11 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:11.995618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7addf9f-089b-42aa-bced-62ed150f45c7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:11.997575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f7addf9f-089b-42aa-bced-62ed150f45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:12.052502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71029afbe3554fc7a06bef9a92333087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9331319f7beb4e8fae50e2f61142e1b0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1735189974', 'tempest-DelegatedRole-999358490'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:12.053369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:12.053639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:12.054178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] PATH_INFO: `/v3/OS-TRUST/trusts/294c8cc08b28437ab6b5ff4aab64e75c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:12.090993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] RBAC: Authorizing `identity:delete_trust(trust_id=294c8cc08b28437ab6b5ff4aab64e75c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:12.095533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:12.113589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7addf9f-089b-42aa-bced-62ed150f45c7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:12.118348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9a9d3-c9cf-428e-b2b4-f950a20b7dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:12.119421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9a9d3-c9cf-428e-b2b4-f950a20b7dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:12.119992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9a9d3-c9cf-428e-b2b4-f950a20b7dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:12.120517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9a9d3-c9cf-428e-b2b4-f950a20b7dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:12.133809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9a9d3-c9cf-428e-b2b4-f950a20b7dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:12.135732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9a9d3-c9cf-428e-b2b4-f950a20b7dc2 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:12.144272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '294c8cc08b28437ab6b5ff4aab64e75c', 'request_id': 'req-5055fff5-e9f9-4741-8671-2becde7fe8ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:12.145256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '294c8cc08b28437ab6b5ff4aab64e75c', 'request_id': 'req-5055fff5-e9f9-4741-8671-2becde7fe8ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:12.150499 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2681/5364] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:11 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:01:12.205618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '294c8cc08b28437ab6b5ff4aab64e75c', 'request_id': 'req-5055fff5-e9f9-4741-8671-2becde7fe8ce'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:12.229001 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2684/5365] 10.222.0.21 () {58 vars in 1253 bytes} [Sat Nov 27 21:01:11 2021] DELETE /identity/v3/OS-TRUST/trusts/294c8cc08b28437ab6b5ff4aab64e75c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:12.229244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9a9d3-c9cf-428e-b2b4-f950a20b7dc2 service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:12.244668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9a9d3-c9cf-428e-b2b4-f950a20b7dc2 service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:12.257825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78258c95-4c49-4654-8b3e-1868cba42b8d tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71029afbe3554fc7a06bef9a92333087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9331319f7beb4e8fae50e2f61142e1b0', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1735189974', 'tempest-DelegatedRole-999358490'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:12.258680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258c95-4c49-4654-8b3e-1868cba42b8d tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:12.258966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258c95-4c49-4654-8b3e-1868cba42b8d tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:12.259317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258c95-4c49-4654-8b3e-1868cba42b8d tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] PATH_INFO: `/v3/OS-TRUST/trusts/294c8cc08b28437ab6b5ff4aab64e75c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:12.291986 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-78258c95-4c49-4654-8b3e-1868cba42b8d tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Could not find trust: 294c8cc08b28437ab6b5ff4aab64e75c.: keystone.exception.TrustNotFound: Could not find trust: 294c8cc08b28437ab6b5ff4aab64e75c. Nov 27 21:01:12.294545 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2682/5366] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:01:12 2021] GET /identity/v3/OS-TRUST/trusts/294c8cc08b28437ab6b5ff4aab64e75c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 21:01:12.302006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:12.306591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:12.363800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78258c95-4c49-4654-8b3e-1868cba42b8d tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:12.365554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-78258c95-4c49-4654-8b3e-1868cba42b8d tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:12.394273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78258c95-4c49-4654-8b3e-1868cba42b8d tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:12.406649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a0cc-3432-449b-9292-c1627390ef7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:12.413926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a0cc-3432-449b-9292-c1627390ef7f service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:12.414279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a0cc-3432-449b-9292-c1627390ef7f service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:12.414565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7a0cc-3432-449b-9292-c1627390ef7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:12.417229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-67a7a0cc-3432-449b-9292-c1627390ef7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:12.488659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055fff5-e9f9-4741-8671-2becde7fe8ce tempest-TrustsV3TestJSON-1814495134 tempest-user-1860855107] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:12.503350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:12.505749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:12.506198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:12.507906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/a724b23a2dce491f9db0eab6baa0cc50` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:12.515366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a724b23a2dce491f9db0eab6baa0cc50)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:12.517762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:12.522110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7a0cc-3432-449b-9292-c1627390ef7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:12.526684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7a0cc-3432-449b-9292-c1627390ef7f service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:12.542180 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2683/5367] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:12 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:12.614616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role a724b23a2dce491f9db0eab6baa0cc50 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:12.615235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:12.617532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:12.620596 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2685/5368] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:12 2021] DELETE /identity/v3/roles/a724b23a2dce491f9db0eab6baa0cc50 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:12.625430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a0cc-3432-449b-9292-c1627390ef7f service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:12.638893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7a0cc-3432-449b-9292-c1627390ef7f service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:12.766303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:12.767391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:12.767809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:12.768094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/888173b74a3240548f6cea5ba255ec38` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:12.772087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=888173b74a3240548f6cea5ba255ec38)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:12.773752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:12.875843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role 888173b74a3240548f6cea5ba255ec38 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:12.876526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:12.877624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:12.881227 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2684/5369] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:12 2021] DELETE /identity/v3/roles/888173b74a3240548f6cea5ba255ec38 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:12.885361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:12.887086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:12.913205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc176023-432b-4e1a-ba42-8909b43c2803 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:12.973353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:12.975749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:13.080752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:13.081931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:13.082320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:13.082679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users/71029afbe3554fc7a06bef9a92333087` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:13.084251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=71029afbe3554fc7a06bef9a92333087)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:13.086326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:13.114496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3c1c3-2b21-4891-892f-4d175226b29d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:13.122999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ed6d8-68da-448f-8586-b027fa32c09f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:13.124032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed6d8-68da-448f-8586-b027fa32c09f service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:13.129369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed6d8-68da-448f-8586-b027fa32c09f service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:13.129369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed6d8-68da-448f-8586-b027fa32c09f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:13.158250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-156ed6d8-68da-448f-8586-b027fa32c09f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:13.187664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ed6d8-68da-448f-8586-b027fa32c09f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:13.189281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71029afbe3554fc7a06bef9a92333087'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.194380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ed6d8-68da-448f-8586-b027fa32c09f service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:13.202399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71029afbe3554fc7a06bef9a92333087'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.204646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71029afbe3554fc7a06bef9a92333087'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.222551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71029afbe3554fc7a06bef9a92333087'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.232822 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2685/5370] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:13.235640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ed6d8-68da-448f-8586-b027fa32c09f service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:13.240255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-156ed6d8-68da-448f-8586-b027fa32c09f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:13.255216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71029afbe3554fc7a06bef9a92333087'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.276936 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2686/5371] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:12 2021] DELETE /identity/v3/users/71029afbe3554fc7a06bef9a92333087 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:13.278976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:13.281295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:13.376515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fa3eb-e1f4-4bc7-bd98-0523502201c4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:13.384683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:13.385553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:13.386275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:13.386518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/9331319f7beb4e8fae50e2f61142e1b0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:13.396433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9331319f7beb4e8fae50e2f61142e1b0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:13.398465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:13.481873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ed6d8-68da-448f-8586-b027fa32c09f service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:13.544471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9331319f7beb4e8fae50e2f61142e1b0', 'request_id': 'req-69f2ff5f-e796-45fc-acea-1dbf4843561b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.560492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9331319f7beb4e8fae50e2f61142e1b0', 'request_id': 'req-69f2ff5f-e796-45fc-acea-1dbf4843561b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.568762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9331319f7beb4e8fae50e2f61142e1b0', 'request_id': 'req-69f2ff5f-e796-45fc-acea-1dbf4843561b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.590978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] The token cache is being invalidate because project 9331319f7beb4e8fae50e2f61142e1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:13.591305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.594353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.598669 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2687/5372] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:13 2021] DELETE /identity/v3/projects/9331319f7beb4e8fae50e2f61142e1b0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:13.604700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:13.606969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:13.623810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:13.626222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:13.626625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:13.628279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] PATH_INFO: `/v3/users/5e74d6ad2a5c49218955e0c5dd7f1729` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:13.633013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e74d6ad2a5c49218955e0c5dd7f1729)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:13.682987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:13.815470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2ff5f-e796-45fc-acea-1dbf4843561b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:13.836893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20042419-97f6-48b0-a5ae-5456fbccbc7f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:13.837631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042419-97f6-48b0-a5ae-5456fbccbc7f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:13.838545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042419-97f6-48b0-a5ae-5456fbccbc7f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:13.838837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042419-97f6-48b0-a5ae-5456fbccbc7f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:13.839590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20042419-97f6-48b0-a5ae-5456fbccbc7f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:13.844478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20042419-97f6-48b0-a5ae-5456fbccbc7f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:13.848823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e74d6ad2a5c49218955e0c5dd7f1729'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.849986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e74d6ad2a5c49218955e0c5dd7f1729'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.862505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e74d6ad2a5c49218955e0c5dd7f1729'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.863525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e74d6ad2a5c49218955e0c5dd7f1729'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.873807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e74d6ad2a5c49218955e0c5dd7f1729'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:13.902054 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2686/5374] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:13 2021] DELETE /identity/v3/users/5e74d6ad2a5c49218955e0c5dd7f1729 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:13.902296 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2688/5374] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:01:13 2021] POST /identity/v3/projects => generated 329 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:13.903040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:13.904698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:13.905227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00045f-5f6d-4d18-9f8d-3d34cb3ebaeb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:13.906202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00045f-5f6d-4d18-9f8d-3d34cb3ebaeb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:13.908321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00045f-5f6d-4d18-9f8d-3d34cb3ebaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:13.968736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9e00045f-5f6d-4d18-9f8d-3d34cb3ebaeb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:13.973041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e00045f-5f6d-4d18-9f8d-3d34cb3ebaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:14.017201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb37bf-2c61-47ad-a09f-9e6db74f4df5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:14.024279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d483e-9127-4419-85e7-18473a78b216 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:14.025378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d483e-9127-4419-85e7-18473a78b216 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:14.025973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d483e-9127-4419-85e7-18473a78b216 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:14.026520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d483e-9127-4419-85e7-18473a78b216 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:14.028437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d483e-9127-4419-85e7-18473a78b216 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:14.031716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d483e-9127-4419-85e7-18473a78b216 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:14.081954 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2687/5375] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:13 2021] POST /identity/v3/users => generated 416 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:14.087363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d483e-9127-4419-85e7-18473a78b216 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:14.113079 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2689/5376] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:14.117860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d483e-9127-4419-85e7-18473a78b216 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:14.125339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67f85a-dc49-4507-bec7-806be9872141 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:14.126121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67f85a-dc49-4507-bec7-806be9872141 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:14.126438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67f85a-dc49-4507-bec7-806be9872141 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:14.127919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67f85a-dc49-4507-bec7-806be9872141 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:14.128064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67f85a-dc49-4507-bec7-806be9872141 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:14.131067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67f85a-dc49-4507-bec7-806be9872141 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:14.147238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00045f-5f6d-4d18-9f8d-3d34cb3ebaeb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:14.151530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e00045f-5f6d-4d18-9f8d-3d34cb3ebaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:14.152002 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2688/5377] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:14 2021] POST /identity/v3/roles => generated 244 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:14.155405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67f85a-dc49-4507-bec7-806be9872141 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:14.192230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67f85a-dc49-4507-bec7-806be9872141 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:14.212101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec1d4-840b-4023-ac0c-875d68a2d27c tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:14.213055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec1d4-840b-4023-ac0c-875d68a2d27c tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:14.213447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec1d4-840b-4023-ac0c-875d68a2d27c tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:14.213834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec1d4-840b-4023-ac0c-875d68a2d27c tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:14.217573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ec1d4-840b-4023-ac0c-875d68a2d27c tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:14.221114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ec1d4-840b-4023-ac0c-875d68a2d27c tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:14.260680 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2689/5378] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:14 2021] POST /identity/v3/roles => generated 246 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:14.265753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec1d4-840b-4023-ac0c-875d68a2d27c tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:14.293618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ec1d4-840b-4023-ac0c-875d68a2d27c tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:14.312146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de14e8-10be-4aa0-93d7-9b6a1e71353a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:14.313238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de14e8-10be-4aa0-93d7-9b6a1e71353a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:14.313531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de14e8-10be-4aa0-93d7-9b6a1e71353a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:14.313841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de14e8-10be-4aa0-93d7-9b6a1e71353a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/4e66e28fd6504174ae6f7d7ff4f1a865/users/aafa0ecb8dd84d09bcfc4097ed1e15f3/roles/298fc6d9169248bd87a9b19c4199c0ee` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:14.317794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00045f-5f6d-4d18-9f8d-3d34cb3ebaeb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:14.329142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab9499-94a4-4d19-a471-9f434b234f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:14.329917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab9499-94a4-4d19-a471-9f434b234f83 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:14.330203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab9499-94a4-4d19-a471-9f434b234f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:14.330499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab9499-94a4-4d19-a471-9f434b234f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:14.350860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de14e8-10be-4aa0-93d7-9b6a1e71353a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4e66e28fd6504174ae6f7d7ff4f1a865, user_id=aafa0ecb8dd84d09bcfc4097ed1e15f3, role_id=298fc6d9169248bd87a9b19c4199c0ee)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:14.357609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab9499-94a4-4d19-a471-9f434b234f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:14.360583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de14e8-10be-4aa0-93d7-9b6a1e71353a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:14.362172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab9499-94a4-4d19-a471-9f434b234f83 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:14.379647 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2690/5379] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:14.393780 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2690/5380] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:14 2021] PUT /identity/v3/projects/4e66e28fd6504174ae6f7d7ff4f1a865/users/aafa0ecb8dd84d09bcfc4097ed1e15f3/roles/298fc6d9169248bd87a9b19c4199c0ee => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:14.398189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab9499-94a4-4d19-a471-9f434b234f83 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:14.423835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab9499-94a4-4d19-a471-9f434b234f83 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:14.536459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aadfbb-93c7-415a-a89a-2295eed1fa01 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:14.537514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aadfbb-93c7-415a-a89a-2295eed1fa01 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:14.537899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aadfbb-93c7-415a-a89a-2295eed1fa01 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:14.538298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aadfbb-93c7-415a-a89a-2295eed1fa01 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/4e66e28fd6504174ae6f7d7ff4f1a865/users/aafa0ecb8dd84d09bcfc4097ed1e15f3/roles/d2650e42e76241e7a08f774f04715652` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:14.541064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aadfbb-93c7-415a-a89a-2295eed1fa01 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4e66e28fd6504174ae6f7d7ff4f1a865, user_id=aafa0ecb8dd84d09bcfc4097ed1e15f3, role_id=d2650e42e76241e7a08f774f04715652)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:14.545954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aadfbb-93c7-415a-a89a-2295eed1fa01 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:14.595344 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2691/5381] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:14 2021] PUT /identity/v3/projects/4e66e28fd6504174ae6f7d7ff4f1a865/users/aafa0ecb8dd84d09bcfc4097ed1e15f3/roles/d2650e42e76241e7a08f774f04715652 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:14.598656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de14e8-10be-4aa0-93d7-9b6a1e71353a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:14.620181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de14e8-10be-4aa0-93d7-9b6a1e71353a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:14.712041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5e02a-7628-466d-b0c6-0165d43f085e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:14.712929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5e02a-7628-466d-b0c6-0165d43f085e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:14.715283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5e02a-7628-466d-b0c6-0165d43f085e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:14.715283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5e02a-7628-466d-b0c6-0165d43f085e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:14.716600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5e02a-7628-466d-b0c6-0165d43f085e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:14.721016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5e02a-7628-466d-b0c6-0165d43f085e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:14.770548 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2691/5382] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:14 2021] GET /identity/v3/users => generated 8626 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:14.775551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8439971-da85-4e2d-a084-2a9e4c88eb48 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:14.777387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8439971-da85-4e2d-a084-2a9e4c88eb48 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:14.777520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8439971-da85-4e2d-a084-2a9e4c88eb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:14.849418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e8439971-da85-4e2d-a084-2a9e4c88eb48 None None] MFA Rules not processed for user `aafa0ecb8dd84d09bcfc4097ed1e15f3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:14.851036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e8439971-da85-4e2d-a084-2a9e4c88eb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:14.966018 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2692/5383] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:14 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:15.080500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9421e-1c6c-4145-a86d-a7df0c5e763e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:15.081845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9421e-1c6c-4145-a86d-a7df0c5e763e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:15.082153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9421e-1c6c-4145-a86d-a7df0c5e763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:15.128555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fff9421e-1c6c-4145-a86d-a7df0c5e763e None None] MFA Rules not processed for user `aafa0ecb8dd84d09bcfc4097ed1e15f3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:15.131718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fff9421e-1c6c-4145-a86d-a7df0c5e763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:15.142471 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2692/5384] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:15 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:15.149099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8439971-da85-4e2d-a084-2a9e4c88eb48 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:15.169883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8439971-da85-4e2d-a084-2a9e4c88eb48 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:15.184678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6a8ce-b65b-4018-8296-25c775f896f5 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aafa0ecb8dd84d09bcfc4097ed1e15f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e66e28fd6504174ae6f7d7ff4f1a865', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1876977242', 'tempest-NotDelegatedRole-542087460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:15.184916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6a8ce-b65b-4018-8296-25c775f896f5 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:15.185296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6a8ce-b65b-4018-8296-25c775f896f5 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:15.185418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6a8ce-b65b-4018-8296-25c775f896f5 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:15.187492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6a8ce-b65b-4018-8296-25c775f896f5 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] RBAC: Authorizing `identity:create_trust()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:15.189682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6a8ce-b65b-4018-8296-25c775f896f5 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:15.445812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9421e-1c6c-4145-a86d-a7df0c5e763e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:15.451940 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2693/5385] 10.222.0.21 () {60 vars in 1173 bytes} [Sat Nov 27 21:01:15 2021] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:15.459280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9421e-1c6c-4145-a86d-a7df0c5e763e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:15.466183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b57e32-48b6-4c25-87a6-e394d273480d tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aafa0ecb8dd84d09bcfc4097ed1e15f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e66e28fd6504174ae6f7d7ff4f1a865', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1876977242', 'tempest-NotDelegatedRole-542087460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:15.467591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b57e32-48b6-4c25-87a6-e394d273480d tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:15.469262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b57e32-48b6-4c25-87a6-e394d273480d tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:15.469762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b57e32-48b6-4c25-87a6-e394d273480d tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:15.470812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b57e32-48b6-4c25-87a6-e394d273480d tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:15.480515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b57e32-48b6-4c25-87a6-e394d273480d tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:15.499947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6a8ce-b65b-4018-8296-25c775f896f5 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:15.508065 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2693/5386] 10.222.0.21 () {58 vars in 1251 bytes} [Sat Nov 27 21:01:15 2021] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=aafa0ecb8dd84d09bcfc4097ed1e15f3 => generated 611 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:01:15.513030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6a8ce-b65b-4018-8296-25c775f896f5 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:15.518639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aafa0ecb8dd84d09bcfc4097ed1e15f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e66e28fd6504174ae6f7d7ff4f1a865', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1876977242', 'tempest-NotDelegatedRole-542087460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:15.520093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:15.520687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:15.522152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] PATH_INFO: `/v3/OS-TRUST/trusts/5e121b654a554b93b224cd6483e46e60` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:15.530289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] RBAC: Authorizing `identity:delete_trust(trust_id=5e121b654a554b93b224cd6483e46e60)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:15.533190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:15.556118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b57e32-48b6-4c25-87a6-e394d273480d tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:15.557983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b9b57e32-48b6-4c25-87a6-e394d273480d tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:15.561997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5e121b654a554b93b224cd6483e46e60', 'request_id': 'req-bfb19fd7-26c7-429f-8220-46539c1885a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:15.563989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '5e121b654a554b93b224cd6483e46e60', 'request_id': 'req-bfb19fd7-26c7-429f-8220-46539c1885a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:15.580709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '5e121b654a554b93b224cd6483e46e60', 'request_id': 'req-bfb19fd7-26c7-429f-8220-46539c1885a4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:15.605770 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2694/5387] 10.222.0.21 () {58 vars in 1253 bytes} [Sat Nov 27 21:01:15 2021] DELETE /identity/v3/OS-TRUST/trusts/5e121b654a554b93b224cd6483e46e60 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:15.613116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:15.616444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:15.666935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb19fd7-26c7-429f-8220-46539c1885a4 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:15.679909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b57e32-48b6-4c25-87a6-e394d273480d tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:15.682975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bcd8f-5654-42c2-97f6-ec09f14a62e2 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aafa0ecb8dd84d09bcfc4097ed1e15f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e66e28fd6504174ae6f7d7ff4f1a865', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1876977242', 'tempest-NotDelegatedRole-542087460'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:15.687731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:15.688036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bcd8f-5654-42c2-97f6-ec09f14a62e2 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:15.688787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:15.689104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:15.689225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bcd8f-5654-42c2-97f6-ec09f14a62e2 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:15.689873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] PATH_INFO: `/v3/projects/22347a0c4e094edda17e12040a9bb14f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:15.691172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bcd8f-5654-42c2-97f6-ec09f14a62e2 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] PATH_INFO: `/v3/OS-TRUST/trusts/5e121b654a554b93b224cd6483e46e60` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:15.692121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=22347a0c4e094edda17e12040a9bb14f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:15.694366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:15.730770 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-464bcd8f-5654-42c2-97f6-ec09f14a62e2 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Could not find trust: 5e121b654a554b93b224cd6483e46e60.: keystone.exception.TrustNotFound: Could not find trust: 5e121b654a554b93b224cd6483e46e60. Nov 27 21:01:15.735056 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2695/5388] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:01:15 2021] GET /identity/v3/OS-TRUST/trusts/5e121b654a554b93b224cd6483e46e60 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:01:15.739981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bcd8f-5654-42c2-97f6-ec09f14a62e2 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:15.742550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-464bcd8f-5654-42c2-97f6-ec09f14a62e2 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:15.794118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bcd8f-5654-42c2-97f6-ec09f14a62e2 tempest-TrustsV3TestJSON-1077942953 tempest-user-2126438493] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:15.814589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22347a0c4e094edda17e12040a9bb14f', 'request_id': 'req-3735346d-987c-45c4-b24c-fb96e7c558ff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:15.828442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22347a0c4e094edda17e12040a9bb14f', 'request_id': 'req-3735346d-987c-45c4-b24c-fb96e7c558ff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:15.847875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22347a0c4e094edda17e12040a9bb14f', 'request_id': 'req-3735346d-987c-45c4-b24c-fb96e7c558ff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:15.872209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] The token cache is being invalidate because project 22347a0c4e094edda17e12040a9bb14f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:15.872625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:15.873584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:15.876584 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2694/5389] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:15 2021] DELETE /identity/v3/projects/22347a0c4e094edda17e12040a9bb14f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:15.882401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:15.884223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:15.993814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:15.996496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:15.997611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:15.998128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/d2650e42e76241e7a08f774f04715652` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:16.002083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d2650e42e76241e7a08f774f04715652)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:16.004873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:16.045815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735346d-987c-45c4-b24c-fb96e7c558ff admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:16.061889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:16.062782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:16.063069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:16.063449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] PATH_INFO: `/v3/users/9cb3c38f5e7e49b59300e96cd93bce3b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:16.065558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb3c38f5e7e49b59300e96cd93bce3b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:16.071323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:16.084810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role d2650e42e76241e7a08f774f04715652 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:16.085795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.087581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.092213 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2696/5390] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:15 2021] DELETE /identity/v3/roles/d2650e42e76241e7a08f774f04715652 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:16.101121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:16.109481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:16.182081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb3c38f5e7e49b59300e96cd93bce3b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.188145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb3c38f5e7e49b59300e96cd93bce3b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.209683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb3c38f5e7e49b59300e96cd93bce3b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.210701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb3c38f5e7e49b59300e96cd93bce3b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.223170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb3c38f5e7e49b59300e96cd93bce3b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.292523 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2695/5391] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:15 2021] DELETE /identity/v3/users/9cb3c38f5e7e49b59300e96cd93bce3b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:16.308961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb524f-972b-4ee0-bd80-8bd520dcc446 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:16.431232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:16.431763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:16.432210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:16.432498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/298fc6d9169248bd87a9b19c4199c0ee` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:16.434930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=298fc6d9169248bd87a9b19c4199c0ee)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:16.438127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:16.547411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role 298fc6d9169248bd87a9b19c4199c0ee has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:16.547859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.548781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.552867 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2697/5392] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:16 2021] DELETE /identity/v3/roles/298fc6d9169248bd87a9b19c4199c0ee => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:16.557613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:16.559545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:16.589499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac2cb3-28cf-4edc-9baf-a07116887806 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:16.764256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:16.765373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:16.765722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:16.766004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users/aafa0ecb8dd84d09bcfc4097ed1e15f3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:16.770626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=aafa0ecb8dd84d09bcfc4097ed1e15f3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:16.774052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:16.855017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aafa0ecb8dd84d09bcfc4097ed1e15f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.855899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aafa0ecb8dd84d09bcfc4097ed1e15f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.898631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aafa0ecb8dd84d09bcfc4097ed1e15f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.900197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aafa0ecb8dd84d09bcfc4097ed1e15f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.936951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aafa0ecb8dd84d09bcfc4097ed1e15f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:16.980609 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2696/5393] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:16 2021] DELETE /identity/v3/users/aafa0ecb8dd84d09bcfc4097ed1e15f3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:16.982589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:16.984296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:17.008985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5630b5-9538-40ee-b949-5625edd46823 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:17.158430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:17.159725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:17.160207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:17.160714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/4e66e28fd6504174ae6f7d7ff4f1a865` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:17.163780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4e66e28fd6504174ae6f7d7ff4f1a865)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:17.169694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:17.350735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e66e28fd6504174ae6f7d7ff4f1a865', 'request_id': 'req-33346364-076b-40d9-b5ed-a3fd66598f23'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:17.363528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e66e28fd6504174ae6f7d7ff4f1a865', 'request_id': 'req-33346364-076b-40d9-b5ed-a3fd66598f23'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:17.389261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e66e28fd6504174ae6f7d7ff4f1a865', 'request_id': 'req-33346364-076b-40d9-b5ed-a3fd66598f23'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:17.433964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] The token cache is being invalidate because project 4e66e28fd6504174ae6f7d7ff4f1a865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:17.445867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:17.448481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:17.453641 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2698/5394] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:16 2021] DELETE /identity/v3/projects/4e66e28fd6504174ae6f7d7ff4f1a865 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:17.460969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:17.462771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:17.499396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563ed45-206d-4ade-8ce1-ab0548785bbd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:17.723069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4dc5c-9409-4ce0-a998-f200b6bd77d6 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:17.724728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4dc5c-9409-4ce0-a998-f200b6bd77d6 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:17.726007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4dc5c-9409-4ce0-a998-f200b6bd77d6 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:17.727075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4dc5c-9409-4ce0-a998-f200b6bd77d6 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:17.733876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4dc5c-9409-4ce0-a998-f200b6bd77d6 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:17.739375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4dc5c-9409-4ce0-a998-f200b6bd77d6 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:17.800886 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2697/5395] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:01:17 2021] POST /identity/v3/projects => generated 328 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:17.802546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:17.803474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:17.832720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346364-076b-40d9-b5ed-a3fd66598f23 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:17.990164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996d04e-35c7-4fdf-994e-57873c722cef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:17.991159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996d04e-35c7-4fdf-994e-57873c722cef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:17.991634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996d04e-35c7-4fdf-994e-57873c722cef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:17.992012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996d04e-35c7-4fdf-994e-57873c722cef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:17.993344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996d04e-35c7-4fdf-994e-57873c722cef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:17.996028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996d04e-35c7-4fdf-994e-57873c722cef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:18.047008 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2699/5396] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:17 2021] POST /identity/v3/users => generated 416 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:18.049635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4dc5c-9409-4ce0-a998-f200b6bd77d6 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:18.064203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4dc5c-9409-4ce0-a998-f200b6bd77d6 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:18.079758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4c67e-3950-4467-bfd6-e7715fa58719 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:18.081450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4c67e-3950-4467-bfd6-e7715fa58719 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:18.081732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4c67e-3950-4467-bfd6-e7715fa58719 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:18.082024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4c67e-3950-4467-bfd6-e7715fa58719 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:18.083996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4c67e-3950-4467-bfd6-e7715fa58719 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:18.088919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4c67e-3950-4467-bfd6-e7715fa58719 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:18.124729 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2698/5397] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:18 2021] POST /identity/v3/roles => generated 243 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:18.128972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996d04e-35c7-4fdf-994e-57873c722cef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:18.147411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996d04e-35c7-4fdf-994e-57873c722cef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:18.162569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab0897-2471-4011-bd08-44469db4ced7 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:18.163410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab0897-2471-4011-bd08-44469db4ced7 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:18.163736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab0897-2471-4011-bd08-44469db4ced7 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:18.164024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab0897-2471-4011-bd08-44469db4ced7 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:18.165055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab0897-2471-4011-bd08-44469db4ced7 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:18.170357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab0897-2471-4011-bd08-44469db4ced7 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:18.203912 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2700/5398] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:18 2021] POST /identity/v3/roles => generated 246 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:18.208797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4c67e-3950-4467-bfd6-e7715fa58719 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:18.228029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4c67e-3950-4467-bfd6-e7715fa58719 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:18.245482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fac2c-d58a-4ac2-b8e7-a381a18ebc7d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:18.247626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fac2c-d58a-4ac2-b8e7-a381a18ebc7d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:18.248228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fac2c-d58a-4ac2-b8e7-a381a18ebc7d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:18.248744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fac2c-d58a-4ac2-b8e7-a381a18ebc7d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/8bccc2644725433e8aafd252194bd93b/users/ebb89d73acf8441ab933d188c82de95f/roles/3e29cdeca7ac4b0498acf79558ead672` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:18.294491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab0897-2471-4011-bd08-44469db4ced7 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:18.297228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-09ab0897-2471-4011-bd08-44469db4ced7 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:18.317608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fac2c-d58a-4ac2-b8e7-a381a18ebc7d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8bccc2644725433e8aafd252194bd93b, user_id=ebb89d73acf8441ab933d188c82de95f, role_id=3e29cdeca7ac4b0498acf79558ead672)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:18.321900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fac2c-d58a-4ac2-b8e7-a381a18ebc7d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:18.373788 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2699/5399] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:18 2021] PUT /identity/v3/projects/8bccc2644725433e8aafd252194bd93b/users/ebb89d73acf8441ab933d188c82de95f/roles/3e29cdeca7ac4b0498acf79558ead672 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:18.402905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fac2c-d58a-4ac2-b8e7-a381a18ebc7d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:18.484818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab0897-2471-4011-bd08-44469db4ced7 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:18.601318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:18.602103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:18.602483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:18.602866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] PATH_INFO: `/v3/projects/f026172adca44265a96e22ce4aa14936` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:18.604340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f026172adca44265a96e22ce4aa14936)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:18.606512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:18.771375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f026172adca44265a96e22ce4aa14936', 'request_id': 'req-c3cdd60b-a57e-46ab-9f00-709d6d475685'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:18.790739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f026172adca44265a96e22ce4aa14936', 'request_id': 'req-c3cdd60b-a57e-46ab-9f00-709d6d475685'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:18.805654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fac2c-d58a-4ac2-b8e7-a381a18ebc7d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:18.860091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f026172adca44265a96e22ce4aa14936', 'request_id': 'req-c3cdd60b-a57e-46ab-9f00-709d6d475685'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:18.950377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] The token cache is being invalidate because project f026172adca44265a96e22ce4aa14936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:18.950863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:18.953596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c3cdd60b-a57e-46ab-9f00-709d6d475685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:18.971726 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2701/5400] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:18 2021] DELETE /identity/v3/projects/f026172adca44265a96e22ce4aa14936 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:19.002601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5dc96-32e6-41e5-b017-83ec4f3eaa2f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:19.006647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5dc96-32e6-41e5-b017-83ec4f3eaa2f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:19.007925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5dc96-32e6-41e5-b017-83ec4f3eaa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:19.110758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b0d5dc96-32e6-41e5-b017-83ec4f3eaa2f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:19.112019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b0d5dc96-32e6-41e5-b017-83ec4f3eaa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:19.172621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0631cde-4767-4eba-ad2b-dafc06f42686 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:19.177886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0631cde-4767-4eba-ad2b-dafc06f42686 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:19.178741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0631cde-4767-4eba-ad2b-dafc06f42686 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:19.179574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0631cde-4767-4eba-ad2b-dafc06f42686 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/8bccc2644725433e8aafd252194bd93b/users/ebb89d73acf8441ab933d188c82de95f/roles/41e636b6b84447d4b2fdfff48f2706a3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:19.188118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0631cde-4767-4eba-ad2b-dafc06f42686 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8bccc2644725433e8aafd252194bd93b, user_id=ebb89d73acf8441ab933d188c82de95f, role_id=41e636b6b84447d4b2fdfff48f2706a3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:19.203064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0631cde-4767-4eba-ad2b-dafc06f42686 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:19.254020 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2700/5401] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:18 2021] PUT /identity/v3/projects/8bccc2644725433e8aafd252194bd93b/users/ebb89d73acf8441ab933d188c82de95f/roles/41e636b6b84447d4b2fdfff48f2706a3 => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:19.260022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0631cde-4767-4eba-ad2b-dafc06f42686 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:19.264817 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2702/5402] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:19.266402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41465-54ab-4940-90e0-575bc79f4fb7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:19.266701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41465-54ab-4940-90e0-575bc79f4fb7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:19.268439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e0631cde-4767-4eba-ad2b-dafc06f42686 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:19.268999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41465-54ab-4940-90e0-575bc79f4fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:19.316547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-40c41465-54ab-4940-90e0-575bc79f4fb7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:19.318350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-40c41465-54ab-4940-90e0-575bc79f4fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:19.413005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0631cde-4767-4eba-ad2b-dafc06f42686 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:19.430483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857859d-592a-4824-abde-e748fd16ae21 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:19.431297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857859d-592a-4824-abde-e748fd16ae21 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:19.432325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857859d-592a-4824-abde-e748fd16ae21 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:19.432624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857859d-592a-4824-abde-e748fd16ae21 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:19.434336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857859d-592a-4824-abde-e748fd16ae21 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:19.440224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857859d-592a-4824-abde-e748fd16ae21 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:19.463587 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2703/5403] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:19.464620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41465-54ab-4940-90e0-575bc79f4fb7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:19.490186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41465-54ab-4940-90e0-575bc79f4fb7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:19.506982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd372d-75c8-402b-81e7-73df907169c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:19.507911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd372d-75c8-402b-81e7-73df907169c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:19.508231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd372d-75c8-402b-81e7-73df907169c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:19.508695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd372d-75c8-402b-81e7-73df907169c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:19.509658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd372d-75c8-402b-81e7-73df907169c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:19.510010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd372d-75c8-402b-81e7-73df907169c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:19.514579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd372d-75c8-402b-81e7-73df907169c6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:19.517018 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2701/5404] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:19 2021] GET /identity/v3/users => generated 8337 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:19.522356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e943dc-89c4-4e90-8395-64d6a57d1794 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:19.522699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e943dc-89c4-4e90-8395-64d6a57d1794 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:19.523014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e943dc-89c4-4e90-8395-64d6a57d1794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:19.550661 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2704/5405] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:19.554888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd372d-75c8-402b-81e7-73df907169c6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:19.571733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd372d-75c8-402b-81e7-73df907169c6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:19.588622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e8e98-52af-450c-ac95-eaced130a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:19.590011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e8e98-52af-450c-ac95-eaced130a343 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:19.599577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e8e98-52af-450c-ac95-eaced130a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:19.600300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e8e98-52af-450c-ac95-eaced130a343 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:19.601386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e8e98-52af-450c-ac95-eaced130a343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:19.616741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e8e98-52af-450c-ac95-eaced130a343 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:19.637347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a1e943dc-89c4-4e90-8395-64d6a57d1794 None None] MFA Rules not processed for user `ebb89d73acf8441ab933d188c82de95f`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:19.643058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a1e943dc-89c4-4e90-8395-64d6a57d1794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:19.722547 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2705/5406] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:19 2021] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:19.725825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e8e98-52af-450c-ac95-eaced130a343 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:19.812232 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2702/5407] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:19 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:19.821254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e47e-d250-4bd7-9be8-1735a6befb83 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:19.821797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e47e-d250-4bd7-9be8-1735a6befb83 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:19.822230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e47e-d250-4bd7-9be8-1735a6befb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:19.863509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e8e98-52af-450c-ac95-eaced130a343 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:19.890684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7d53e47e-d250-4bd7-9be8-1735a6befb83 None None] MFA Rules not processed for user `ebb89d73acf8441ab933d188c82de95f`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:19.892360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7d53e47e-d250-4bd7-9be8-1735a6befb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:19.895225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccebc51-0e40-4261-8d5f-3ab56d7e90b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:19.895986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccebc51-0e40-4261-8d5f-3ab56d7e90b0 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:19.896274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccebc51-0e40-4261-8d5f-3ab56d7e90b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:19.896652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccebc51-0e40-4261-8d5f-3ab56d7e90b0 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:19.897258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccebc51-0e40-4261-8d5f-3ab56d7e90b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:19.912079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccebc51-0e40-4261-8d5f-3ab56d7e90b0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:20.002250 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2706/5408] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:19 2021] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:20.007176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccebc51-0e40-4261-8d5f-3ab56d7e90b0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:20.047142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccebc51-0e40-4261-8d5f-3ab56d7e90b0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:20.057302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6190bcf-afef-49ab-8497-5738251dd235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:20.058597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6190bcf-afef-49ab-8497-5738251dd235 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:20.059445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6190bcf-afef-49ab-8497-5738251dd235 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:20.060263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6190bcf-afef-49ab-8497-5738251dd235 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:20.061239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6190bcf-afef-49ab-8497-5738251dd235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:20.064789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6190bcf-afef-49ab-8497-5738251dd235 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:20.079608 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2703/5409] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:19 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:20.084192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e47e-d250-4bd7-9be8-1735a6befb83 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:20.100147 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2707/5410] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:20 2021] GET /identity/v3/roles => generated 1891 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:20.105950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6190bcf-afef-49ab-8497-5738251dd235 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:20.111739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e47e-d250-4bd7-9be8-1735a6befb83 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:20.130110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7fbfd-6a80-464a-b08c-b88a3510efd2 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebb89d73acf8441ab933d188c82de95f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bccc2644725433e8aafd252194bd93b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-505684415', 'tempest-DelegatedRole-985925809'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:20.130774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7fbfd-6a80-464a-b08c-b88a3510efd2 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:20.131059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7fbfd-6a80-464a-b08c-b88a3510efd2 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:20.131364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7fbfd-6a80-464a-b08c-b88a3510efd2 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:20.132188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7fbfd-6a80-464a-b08c-b88a3510efd2 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorizing `identity:create_trust()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:20.134836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7fbfd-6a80-464a-b08c-b88a3510efd2 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:20.137640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6190bcf-afef-49ab-8497-5738251dd235 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:20.147245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a9e0d-b0b4-41d7-bfd8-c9477d55dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:20.148095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a9e0d-b0b4-41d7-bfd8-c9477d55dc16 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:20.148686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a9e0d-b0b4-41d7-bfd8-c9477d55dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:20.149221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a9e0d-b0b4-41d7-bfd8-c9477d55dc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:20.150729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a9e0d-b0b4-41d7-bfd8-c9477d55dc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:20.153254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a9e0d-b0b4-41d7-bfd8-c9477d55dc16 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:20.175646 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2708/5411] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:20 2021] GET /identity/v3/roles => generated 1891 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:20.181033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a9e0d-b0b4-41d7-bfd8-c9477d55dc16 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:20.221462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a9e0d-b0b4-41d7-bfd8-c9477d55dc16 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:20.231981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f2824-cb61-433b-96d4-37b0597e6d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:20.236182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2824-cb61-433b-96d4-37b0597e6d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:20.236600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2824-cb61-433b-96d4-37b0597e6d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:20.237368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2824-cb61-433b-96d4-37b0597e6d96 admin admin] PATH_INFO: `/v3/projects/22cbe9c9e7934de8b8ef807c135e69e2/users/faed6b4fee944522a19b4721fa335af5/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:20.293993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2824-cb61-433b-96d4-37b0597e6d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cbe9c9e7934de8b8ef807c135e69e2, user_id=faed6b4fee944522a19b4721fa335af5, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:20.300581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2824-cb61-433b-96d4-37b0597e6d96 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:20.333610 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2709/5412] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:20 2021] PUT /identity/v3/projects/22cbe9c9e7934de8b8ef807c135e69e2/users/faed6b4fee944522a19b4721fa335af5/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:20.339005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dc8a1-d94e-4d9a-8b42-b678af91cd9a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:20.341190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dc8a1-d94e-4d9a-8b42-b678af91cd9a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:20.341512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dc8a1-d94e-4d9a-8b42-b678af91cd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:20.436153 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2704/5413] 10.222.0.21 () {60 vars in 1173 bytes} [Sat Nov 27 21:01:20 2021] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:20.438610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7fbfd-6a80-464a-b08c-b88a3510efd2 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:20.471553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7fbfd-6a80-464a-b08c-b88a3510efd2 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:20.482257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9e1dc8a1-d94e-4d9a-8b42-b678af91cd9a None None] MFA Rules not processed for user `faed6b4fee944522a19b4721fa335af5`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:20.499952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e1dc8a1-d94e-4d9a-8b42-b678af91cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:20.741748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d2030-2749-44b0-80ac-0cb8b728cb06 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebb89d73acf8441ab933d188c82de95f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bccc2644725433e8aafd252194bd93b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-505684415', 'tempest-DelegatedRole-985925809'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:20.743625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d2030-2749-44b0-80ac-0cb8b728cb06 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:20.745786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d2030-2749-44b0-80ac-0cb8b728cb06 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:20.747600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d2030-2749-44b0-80ac-0cb8b728cb06 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] PATH_INFO: `/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:20.785422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d2030-2749-44b0-80ac-0cb8b728cb06 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorizing `identity:get_trust(trust_id=d56f6d91d355403597fc9aa1e84f2dd1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:20.793855 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2710/5414] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:20 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:20.805544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d2030-2749-44b0-80ac-0cb8b728cb06 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:20.805783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dc8a1-d94e-4d9a-8b42-b678af91cd9a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:20.807758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e1dc8a1-d94e-4d9a-8b42-b678af91cd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:20.840142 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2705/5415] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:01:20 2021] GET /identity/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1 => generated 858 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:20.842007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d2030-2749-44b0-80ac-0cb8b728cb06 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:20.863187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d2030-2749-44b0-80ac-0cb8b728cb06 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:20.868668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65367fa-3ac4-4400-9ad2-85f87e1f097a tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebb89d73acf8441ab933d188c82de95f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bccc2644725433e8aafd252194bd93b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-505684415', 'tempest-DelegatedRole-985925809'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:20.870079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65367fa-3ac4-4400-9ad2-85f87e1f097a tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:20.870580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65367fa-3ac4-4400-9ad2-85f87e1f097a tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:20.871327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65367fa-3ac4-4400-9ad2-85f87e1f097a tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] PATH_INFO: `/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:20.893774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dc8a1-d94e-4d9a-8b42-b678af91cd9a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:20.898360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7dfbe-b05c-452b-8a8c-7270ac9c5b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:20.899663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7dfbe-b05c-452b-8a8c-7270ac9c5b88 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:20.899663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7dfbe-b05c-452b-8a8c-7270ac9c5b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:20.900057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7dfbe-b05c-452b-8a8c-7270ac9c5b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:20.902561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65367fa-3ac4-4400-9ad2-85f87e1f097a tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=d56f6d91d355403597fc9aa1e84f2dd1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:20.904264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65367fa-3ac4-4400-9ad2-85f87e1f097a tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:20.921532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7dfbe-b05c-452b-8a8c-7270ac9c5b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:20.930920 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2706/5416] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 21:01:20 2021] GET /identity/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1/roles => generated 370 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:20.934335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65367fa-3ac4-4400-9ad2-85f87e1f097a tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:20.934750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7dfbe-b05c-452b-8a8c-7270ac9c5b88 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:20.950479 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2711/5417] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:20 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:01:20.957447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65367fa-3ac4-4400-9ad2-85f87e1f097a tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:20.964652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab30e1-1823-40c8-a5ff-adb053b5d86d tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebb89d73acf8441ab933d188c82de95f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bccc2644725433e8aafd252194bd93b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-505684415', 'tempest-DelegatedRole-985925809'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:20.967478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab30e1-1823-40c8-a5ff-adb053b5d86d tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:20.967980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab30e1-1823-40c8-a5ff-adb053b5d86d tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:20.968800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab30e1-1823-40c8-a5ff-adb053b5d86d tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] PATH_INFO: `/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1/roles/3e29cdeca7ac4b0498acf79558ead672` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:20.983325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab30e1-1823-40c8-a5ff-adb053b5d86d tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d56f6d91d355403597fc9aa1e84f2dd1, role_id=3e29cdeca7ac4b0498acf79558ead672)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:20.985210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab30e1-1823-40c8-a5ff-adb053b5d86d tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:21.010965 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2707/5418] 10.222.0.21 () {58 vars in 1367 bytes} [Sat Nov 27 21:01:20 2021] GET /identity/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1/roles/3e29cdeca7ac4b0498acf79558ead672 => generated 243 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:21.013050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7dfbe-b05c-452b-8a8c-7270ac9c5b88 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:21.031544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7dfbe-b05c-452b-8a8c-7270ac9c5b88 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:21.037918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415694b-f843-484a-a797-bb111c11261c tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebb89d73acf8441ab933d188c82de95f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bccc2644725433e8aafd252194bd93b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-505684415', 'tempest-DelegatedRole-985925809'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:21.038930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415694b-f843-484a-a797-bb111c11261c tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:21.039329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415694b-f843-484a-a797-bb111c11261c tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:21.040395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415694b-f843-484a-a797-bb111c11261c tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] PATH_INFO: `/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1/roles/3e29cdeca7ac4b0498acf79558ead672` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:21.050482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415694b-f843-484a-a797-bb111c11261c tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d56f6d91d355403597fc9aa1e84f2dd1, role_id=3e29cdeca7ac4b0498acf79558ead672)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:21.052880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415694b-f843-484a-a797-bb111c11261c tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:21.068242 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2712/5419] 10.222.0.21 () {58 vars in 1368 bytes} [Sat Nov 27 21:01:21 2021] HEAD /identity/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1/roles/3e29cdeca7ac4b0498acf79558ead672 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Nov 27 21:01:21.069435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab30e1-1823-40c8-a5ff-adb053b5d86d tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:21.084945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab30e1-1823-40c8-a5ff-adb053b5d86d tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:21.099301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad3cca-c4c8-451d-ad0d-019c920f43b3 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebb89d73acf8441ab933d188c82de95f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bccc2644725433e8aafd252194bd93b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-505684415', 'tempest-DelegatedRole-985925809'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:21.101943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad3cca-c4c8-451d-ad0d-019c920f43b3 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:21.102684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad3cca-c4c8-451d-ad0d-019c920f43b3 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:21.104207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad3cca-c4c8-451d-ad0d-019c920f43b3 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] PATH_INFO: `/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1/roles/41e636b6b84447d4b2fdfff48f2706a3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:21.121038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad3cca-c4c8-451d-ad0d-019c920f43b3 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d56f6d91d355403597fc9aa1e84f2dd1, role_id=41e636b6b84447d4b2fdfff48f2706a3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:21.122837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad3cca-c4c8-451d-ad0d-019c920f43b3 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:21.140881 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-15ad3cca-c4c8-451d-ad0d-019c920f43b3 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Could not find role: 41e636b6b84447d4b2fdfff48f2706a3.: keystone.exception.RoleNotFound: Could not find role: 41e636b6b84447d4b2fdfff48f2706a3. Nov 27 21:01:21.142343 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2708/5420] 10.222.0.21 () {58 vars in 1367 bytes} [Sat Nov 27 21:01:21 2021] GET /identity/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1/roles/41e636b6b84447d4b2fdfff48f2706a3 => generated 110 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 21:01:21.147357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415694b-f843-484a-a797-bb111c11261c tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:21.159669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415694b-f843-484a-a797-bb111c11261c tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:21.165098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c8cd4-304e-4a21-b7c4-60a8700c633e tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebb89d73acf8441ab933d188c82de95f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bccc2644725433e8aafd252194bd93b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-505684415', 'tempest-DelegatedRole-985925809'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:21.166199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c8cd4-304e-4a21-b7c4-60a8700c633e tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:21.166605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c8cd4-304e-4a21-b7c4-60a8700c633e tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:21.166987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c8cd4-304e-4a21-b7c4-60a8700c633e tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] PATH_INFO: `/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1/roles/41e636b6b84447d4b2fdfff48f2706a3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:21.175178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c8cd4-304e-4a21-b7c4-60a8700c633e tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d56f6d91d355403597fc9aa1e84f2dd1, role_id=41e636b6b84447d4b2fdfff48f2706a3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:21.177909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c8cd4-304e-4a21-b7c4-60a8700c633e tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:21.196374 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-720c8cd4-304e-4a21-b7c4-60a8700c633e tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Could not find role: 41e636b6b84447d4b2fdfff48f2706a3.: keystone.exception.RoleNotFound: Could not find role: 41e636b6b84447d4b2fdfff48f2706a3. Nov 27 21:01:21.209175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad3cca-c4c8-451d-ad0d-019c920f43b3 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:21.209790 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2713/5421] 10.222.0.21 () {58 vars in 1368 bytes} [Sat Nov 27 21:01:21 2021] HEAD /identity/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1/roles/41e636b6b84447d4b2fdfff48f2706a3 => generated 0 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Nov 27 21:01:21.222856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad3cca-c4c8-451d-ad0d-019c920f43b3 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:21.232219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebb89d73acf8441ab933d188c82de95f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bccc2644725433e8aafd252194bd93b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-505684415', 'tempest-DelegatedRole-985925809'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:21.232219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:21.232219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:21.232706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] PATH_INFO: `/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:21.240430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorizing `identity:delete_trust(trust_id=d56f6d91d355403597fc9aa1e84f2dd1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:21.244884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:21.300870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd56f6d91d355403597fc9aa1e84f2dd1', 'request_id': 'req-56def92a-d8f9-459e-b034-def10595bf99'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:21.302384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd56f6d91d355403597fc9aa1e84f2dd1', 'request_id': 'req-56def92a-d8f9-459e-b034-def10595bf99'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:21.304181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd56f6d91d355403597fc9aa1e84f2dd1', 'request_id': 'req-56def92a-d8f9-459e-b034-def10595bf99'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:21.371856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c8cd4-304e-4a21-b7c4-60a8700c633e tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:21.373055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-720c8cd4-304e-4a21-b7c4-60a8700c633e tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:21.382043 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2709/5422] 10.222.0.21 () {58 vars in 1253 bytes} [Sat Nov 27 21:01:21 2021] DELETE /identity/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:21.404028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c8cd4-304e-4a21-b7c4-60a8700c633e tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:21.421636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e81a3-5f4a-41e1-b8a1-5bbc86aeaaa7 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebb89d73acf8441ab933d188c82de95f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bccc2644725433e8aafd252194bd93b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-505684415', 'tempest-DelegatedRole-985925809'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:21.429644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e81a3-5f4a-41e1-b8a1-5bbc86aeaaa7 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:21.430360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e81a3-5f4a-41e1-b8a1-5bbc86aeaaa7 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:21.431018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e81a3-5f4a-41e1-b8a1-5bbc86aeaaa7 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] PATH_INFO: `/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:21.492639 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-247e81a3-5f4a-41e1-b8a1-5bbc86aeaaa7 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Could not find trust: d56f6d91d355403597fc9aa1e84f2dd1.: keystone.exception.TrustNotFound: Could not find trust: d56f6d91d355403597fc9aa1e84f2dd1. Nov 27 21:01:21.498035 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2714/5423] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:01:21 2021] GET /identity/v3/OS-TRUST/trusts/d56f6d91d355403597fc9aa1e84f2dd1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:01:21.505850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:21.507628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:21.689107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56def92a-d8f9-459e-b034-def10595bf99 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:21.696384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fb9e9-16c0-4a9f-b6ca-7f326bb72544 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:21.698039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb9e9-16c0-4a9f-b6ca-7f326bb72544 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:21.698592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb9e9-16c0-4a9f-b6ca-7f326bb72544 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:21.699438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb9e9-16c0-4a9f-b6ca-7f326bb72544 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/41e636b6b84447d4b2fdfff48f2706a3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:21.701902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fb9e9-16c0-4a9f-b6ca-7f326bb72544 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=41e636b6b84447d4b2fdfff48f2706a3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:21.704535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fb9e9-16c0-4a9f-b6ca-7f326bb72544 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:21.814029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f98fb9e9-16c0-4a9f-b6ca-7f326bb72544 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role 41e636b6b84447d4b2fdfff48f2706a3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:21.815980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f98fb9e9-16c0-4a9f-b6ca-7f326bb72544 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:21.821043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f98fb9e9-16c0-4a9f-b6ca-7f326bb72544 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:21.825765 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2710/5424] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:21 2021] DELETE /identity/v3/roles/41e636b6b84447d4b2fdfff48f2706a3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:21.830371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e81a3-5f4a-41e1-b8a1-5bbc86aeaaa7 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:21.832693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-247e81a3-5f4a-41e1-b8a1-5bbc86aeaaa7 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:21.889809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e81a3-5f4a-41e1-b8a1-5bbc86aeaaa7 tempest-TrustsV3TestJSON-253998998 tempest-user-1352755488] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:22.066215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:22.067835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:22.068125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:22.069727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/3e29cdeca7ac4b0498acf79558ead672` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:22.078416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3e29cdeca7ac4b0498acf79558ead672)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:22.082833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:22.181667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role 3e29cdeca7ac4b0498acf79558ead672 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:22.182409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:22.182828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:22.190643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fb9e9-16c0-4a9f-b6ca-7f326bb72544 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:22.209444 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2715/5425] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:21 2021] DELETE /identity/v3/roles/3e29cdeca7ac4b0498acf79558ead672 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:22.212964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fb9e9-16c0-4a9f-b6ca-7f326bb72544 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:22.466931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:22.468724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:22.469192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:22.469797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users/ebb89d73acf8441ab933d188c82de95f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:22.472302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ebb89d73acf8441ab933d188c82de95f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:22.477031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:22.682895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb89d73acf8441ab933d188c82de95f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:22.686195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb89d73acf8441ab933d188c82de95f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:22.715042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb89d73acf8441ab933d188c82de95f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:22.717724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb89d73acf8441ab933d188c82de95f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:22.742821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb89d73acf8441ab933d188c82de95f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:22.785460 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2711/5426] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:22 2021] DELETE /identity/v3/users/ebb89d73acf8441ab933d188c82de95f => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:22.789680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:22.795106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:22.889971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5462c-2d5d-4987-a76f-aef407a5255e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:23.107245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:23.109343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:23.109928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:23.110545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/8bccc2644725433e8aafd252194bd93b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:23.116100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8bccc2644725433e8aafd252194bd93b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:23.121169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:23.259661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bccc2644725433e8aafd252194bd93b', 'request_id': 'req-e23aaaac-8af2-40db-853f-75cc49d9f1c9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:23.291862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bccc2644725433e8aafd252194bd93b', 'request_id': 'req-e23aaaac-8af2-40db-853f-75cc49d9f1c9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:23.312619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bccc2644725433e8aafd252194bd93b', 'request_id': 'req-e23aaaac-8af2-40db-853f-75cc49d9f1c9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:23.365277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] The token cache is being invalidate because project 8bccc2644725433e8aafd252194bd93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:23.365722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:23.373302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:23.386818 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2716/5427] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:22 2021] DELETE /identity/v3/projects/8bccc2644725433e8aafd252194bd93b => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:23.390049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:23.392071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:23.435585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7e736-9e16-47ba-b19a-8043d44c9519 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:23.798732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d32ff-af75-4c53-a026-acde29843f9b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:23.799450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d32ff-af75-4c53-a026-acde29843f9b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:23.799739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d32ff-af75-4c53-a026-acde29843f9b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:23.800016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d32ff-af75-4c53-a026-acde29843f9b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:23.800750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d32ff-af75-4c53-a026-acde29843f9b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:23.816273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d32ff-af75-4c53-a026-acde29843f9b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:23.900044 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2712/5428] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:01:23 2021] POST /identity/v3/projects => generated 329 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:23.904213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:23.905730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:23.949224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aaaac-8af2-40db-853f-75cc49d9f1c9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:24.133609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8dd55-547e-47ce-8708-0c536224f28f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:24.134860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8dd55-547e-47ce-8708-0c536224f28f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:24.135846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8dd55-547e-47ce-8708-0c536224f28f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:24.137995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8dd55-547e-47ce-8708-0c536224f28f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:24.140065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8dd55-547e-47ce-8708-0c536224f28f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:24.142842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8dd55-547e-47ce-8708-0c536224f28f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:24.200192 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2717/5429] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:23 2021] POST /identity/v3/users => generated 416 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:24.203927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d32ff-af75-4c53-a026-acde29843f9b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:24.226645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d32ff-af75-4c53-a026-acde29843f9b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:24.242953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae759c1-7fba-415e-aaa8-4d109ed9ea78 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:24.243965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae759c1-7fba-415e-aaa8-4d109ed9ea78 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:24.245272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae759c1-7fba-415e-aaa8-4d109ed9ea78 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:24.245828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae759c1-7fba-415e-aaa8-4d109ed9ea78 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:24.249820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae759c1-7fba-415e-aaa8-4d109ed9ea78 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:24.256646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae759c1-7fba-415e-aaa8-4d109ed9ea78 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:24.297690 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2713/5430] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:24 2021] POST /identity/v3/roles => generated 243 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:01:24.301643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8dd55-547e-47ce-8708-0c536224f28f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:24.324233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8dd55-547e-47ce-8708-0c536224f28f tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:24.341833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ee37e-9b48-4360-84d1-c3e717a4c3a9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:24.343294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ee37e-9b48-4360-84d1-c3e717a4c3a9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:24.343809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ee37e-9b48-4360-84d1-c3e717a4c3a9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:24.344910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ee37e-9b48-4360-84d1-c3e717a4c3a9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:24.345707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ee37e-9b48-4360-84d1-c3e717a4c3a9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:24.348025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ee37e-9b48-4360-84d1-c3e717a4c3a9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:24.417747 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2718/5431] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:24 2021] POST /identity/v3/roles => generated 246 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:24.421985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae759c1-7fba-415e-aaa8-4d109ed9ea78 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:24.448458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae759c1-7fba-415e-aaa8-4d109ed9ea78 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:24.475359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4b1b9-0234-45dd-b683-08ff63870524 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:24.476628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4b1b9-0234-45dd-b683-08ff63870524 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:24.477918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4b1b9-0234-45dd-b683-08ff63870524 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:24.491822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4b1b9-0234-45dd-b683-08ff63870524 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/9ba098162c4f46489685e26da83f0768/users/3b152387313949588dc179c8cfdb3925/roles/74f9feb5a6cf470c89e96cfcd5778730` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:24.543238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4b1b9-0234-45dd-b683-08ff63870524 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9ba098162c4f46489685e26da83f0768, user_id=3b152387313949588dc179c8cfdb3925, role_id=74f9feb5a6cf470c89e96cfcd5778730)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:24.547486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4b1b9-0234-45dd-b683-08ff63870524 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:24.578184 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2714/5432] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:24 2021] PUT /identity/v3/projects/9ba098162c4f46489685e26da83f0768/users/3b152387313949588dc179c8cfdb3925/roles/74f9feb5a6cf470c89e96cfcd5778730 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:24.583928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ee37e-9b48-4360-84d1-c3e717a4c3a9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:24.590181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4b1b9-0234-45dd-b683-08ff63870524 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:24.592413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8ff4b1b9-0234-45dd-b683-08ff63870524 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:24.627812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ee37e-9b48-4360-84d1-c3e717a4c3a9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:24.781682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18aefc-eab6-4834-9b6f-e46222d54464 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:24.783752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18aefc-eab6-4834-9b6f-e46222d54464 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:24.784346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18aefc-eab6-4834-9b6f-e46222d54464 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:24.784924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18aefc-eab6-4834-9b6f-e46222d54464 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/9ba098162c4f46489685e26da83f0768/users/3b152387313949588dc179c8cfdb3925/roles/2dcfeae50099447ab7c94f7f6001faae` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:24.788519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18aefc-eab6-4834-9b6f-e46222d54464 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9ba098162c4f46489685e26da83f0768, user_id=3b152387313949588dc179c8cfdb3925, role_id=2dcfeae50099447ab7c94f7f6001faae)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:24.798931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4b1b9-0234-45dd-b683-08ff63870524 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:24.809537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0aa55-64e1-4753-bf73-4aae0a8e0907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:24.810183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18aefc-eab6-4834-9b6f-e46222d54464 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:24.810986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0aa55-64e1-4753-bf73-4aae0a8e0907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:24.812004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0aa55-64e1-4753-bf73-4aae0a8e0907 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:24.812809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0aa55-64e1-4753-bf73-4aae0a8e0907 admin admin] PATH_INFO: `/v3/users/ff6493e665b046a1863572bcc9553866` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:24.814806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0aa55-64e1-4753-bf73-4aae0a8e0907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6493e665b046a1863572bcc9553866)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:24.817504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0aa55-64e1-4753-bf73-4aae0a8e0907 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:24.875445 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2719/5433] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:24 2021] PUT /identity/v3/projects/9ba098162c4f46489685e26da83f0768/users/3b152387313949588dc179c8cfdb3925/roles/2dcfeae50099447ab7c94f7f6001faae => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:24.890309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18aefc-eab6-4834-9b6f-e46222d54464 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:24.956133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78c0aa55-64e1-4753-bf73-4aae0a8e0907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6493e665b046a1863572bcc9553866'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:24.957141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78c0aa55-64e1-4753-bf73-4aae0a8e0907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6493e665b046a1863572bcc9553866'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:24.971056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78c0aa55-64e1-4753-bf73-4aae0a8e0907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6493e665b046a1863572bcc9553866'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:24.973990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78c0aa55-64e1-4753-bf73-4aae0a8e0907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6493e665b046a1863572bcc9553866'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:24.994382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-78c0aa55-64e1-4753-bf73-4aae0a8e0907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6493e665b046a1863572bcc9553866'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:25.050397 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2715/5434] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:24 2021] DELETE /identity/v3/users/ff6493e665b046a1863572bcc9553866 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:25.094504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18aefc-eab6-4834-9b6f-e46222d54464 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:25.197032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec285cb-fd13-4941-82ce-9ae7487a44d8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:25.203669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec285cb-fd13-4941-82ce-9ae7487a44d8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:25.204970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec285cb-fd13-4941-82ce-9ae7487a44d8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:25.205307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec285cb-fd13-4941-82ce-9ae7487a44d8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:25.207315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec285cb-fd13-4941-82ce-9ae7487a44d8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:25.212498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec285cb-fd13-4941-82ce-9ae7487a44d8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:25.277943 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2720/5435] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:24 2021] GET /identity/v3/users => generated 8330 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:25.284566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ff60e-7bec-41e7-a20d-8a3bf86f6319 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:25.284859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ff60e-7bec-41e7-a20d-8a3bf86f6319 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:25.285420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ff60e-7bec-41e7-a20d-8a3bf86f6319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:25.376060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-269ff60e-7bec-41e7-a20d-8a3bf86f6319 None None] MFA Rules not processed for user `3b152387313949588dc179c8cfdb3925`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:25.378060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-269ff60e-7bec-41e7-a20d-8a3bf86f6319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:25.544302 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2716/5436] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:25 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:25.558240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d70f8f-7a7d-4bb8-9aa5-036fcd9da4b8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:25.559615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d70f8f-7a7d-4bb8-9aa5-036fcd9da4b8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:25.560067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d70f8f-7a7d-4bb8-9aa5-036fcd9da4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:25.611563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-95d70f8f-7a7d-4bb8-9aa5-036fcd9da4b8 None None] MFA Rules not processed for user `3b152387313949588dc179c8cfdb3925`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:25.612837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-95d70f8f-7a7d-4bb8-9aa5-036fcd9da4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:25.654233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ff60e-7bec-41e7-a20d-8a3bf86f6319 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:25.662630 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2721/5437] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:25 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:25.670535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ff60e-7bec-41e7-a20d-8a3bf86f6319 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:25.678622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e77402-f395-4c67-b972-91c3b943a91b tempest-TrustsV3TestJSON-1906871776 tempest-user-1227503593] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b152387313949588dc179c8cfdb3925', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba098162c4f46489685e26da83f0768', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-205177283', 'tempest-DelegatedRole-916483210'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:25.679883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e77402-f395-4c67-b972-91c3b943a91b tempest-TrustsV3TestJSON-1906871776 tempest-user-1227503593] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:25.680451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e77402-f395-4c67-b972-91c3b943a91b tempest-TrustsV3TestJSON-1906871776 tempest-user-1227503593] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:25.681308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e77402-f395-4c67-b972-91c3b943a91b tempest-TrustsV3TestJSON-1906871776 tempest-user-1227503593] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:25.683225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e77402-f395-4c67-b972-91c3b943a91b tempest-TrustsV3TestJSON-1906871776 tempest-user-1227503593] RBAC: Authorizing `identity:create_trust()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:25.685146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e77402-f395-4c67-b972-91c3b943a91b tempest-TrustsV3TestJSON-1906871776 tempest-user-1227503593] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:25.892254 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-26e77402-f395-4c67-b972-91c3b943a91b tempest-TrustsV3TestJSON-1906871776 tempest-user-1227503593] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 27 21:01:25.896996 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2717/5438] 10.222.0.21 () {60 vars in 1173 bytes} [Sat Nov 27 21:01:25 2021] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 243 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 27 21:01:25.900492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d70f8f-7a7d-4bb8-9aa5-036fcd9da4b8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:25.903278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-95d70f8f-7a7d-4bb8-9aa5-036fcd9da4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:25.964998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d70f8f-7a7d-4bb8-9aa5-036fcd9da4b8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:25.975461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:25.976854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:25.977476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:25.978032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/2dcfeae50099447ab7c94f7f6001faae` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:25.979971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2dcfeae50099447ab7c94f7f6001faae)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:25.982528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:26.055040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role 2dcfeae50099447ab7c94f7f6001faae has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:26.055640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.056717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.060074 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2722/5439] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:25 2021] DELETE /identity/v3/roles/2dcfeae50099447ab7c94f7f6001faae => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:26.064114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e77402-f395-4c67-b972-91c3b943a91b tempest-TrustsV3TestJSON-1906871776 tempest-user-1227503593] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:26.066286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-26e77402-f395-4c67-b972-91c3b943a91b tempest-TrustsV3TestJSON-1906871776 tempest-user-1227503593] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:26.104797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e77402-f395-4c67-b972-91c3b943a91b tempest-TrustsV3TestJSON-1906871776 tempest-user-1227503593] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:26.225832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:26.227018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:26.227801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:26.228333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/74f9feb5a6cf470c89e96cfcd5778730` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:26.236088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=74f9feb5a6cf470c89e96cfcd5778730)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:26.238190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:26.302074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:26.304669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:26.325649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role 74f9feb5a6cf470c89e96cfcd5778730 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:26.326471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.330432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.333503 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2718/5440] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:26 2021] DELETE /identity/v3/roles/74f9feb5a6cf470c89e96cfcd5778730 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:26.337554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:26.340249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:26.506579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958fb3-96b2-4f54-92bb-08d8071808b1 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:26.540187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b712af-f598-4089-9b30-e5fce4d6aae9 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:26.564370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:26.565765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:26.566145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:26.566492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users/3b152387313949588dc179c8cfdb3925` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:26.568333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3b152387313949588dc179c8cfdb3925)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:26.571607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:26.676954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b152387313949588dc179c8cfdb3925'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.677993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b152387313949588dc179c8cfdb3925'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.690522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:26.691830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b152387313949588dc179c8cfdb3925'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.692411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:26.692783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:26.693612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b152387313949588dc179c8cfdb3925'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.695906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] PATH_INFO: `/v3/projects/57166f6505f544e38ae55d9360c4f40a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:26.699100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57166f6505f544e38ae55d9360c4f40a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:26.706588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:26.708973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b152387313949588dc179c8cfdb3925'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.747493 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2719/5441] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:26 2021] DELETE /identity/v3/users/3b152387313949588dc179c8cfdb3925 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:26.749839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:26.751557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:26.843521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57166f6505f544e38ae55d9360c4f40a', 'request_id': 'req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.854893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2e6e5-0727-4e72-93b1-9fe75aa03260 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:26.865582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57166f6505f544e38ae55d9360c4f40a', 'request_id': 'req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.886198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57166f6505f544e38ae55d9360c4f40a', 'request_id': 'req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.922731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] The token cache is being invalidate because project 57166f6505f544e38ae55d9360c4f40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:26.923133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.926221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d2083ba9-e7d6-400e-8fc1-dbffc3c27a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:26.935852 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2723/5442] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:26 2021] DELETE /identity/v3/projects/57166f6505f544e38ae55d9360c4f40a => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:26.938418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694fd3-9436-4504-a2fb-2df52a872181 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:26.938749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694fd3-9436-4504-a2fb-2df52a872181 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:26.939033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98694fd3-9436-4504-a2fb-2df52a872181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:27.007201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-98694fd3-9436-4504-a2fb-2df52a872181 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:27.011568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-98694fd3-9436-4504-a2fb-2df52a872181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:27.023667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:27.027233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:27.027939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:27.029164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/9ba098162c4f46489685e26da83f0768` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:27.033518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9ba098162c4f46489685e26da83f0768)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:27.040040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:27.159131 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2724/5443] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:27.167405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a501c-7a02-4d3f-9da4-73f3c75f1fa1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:27.167964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a501c-7a02-4d3f-9da4-73f3c75f1fa1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:27.168498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a501c-7a02-4d3f-9da4-73f3c75f1fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:27.178617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba098162c4f46489685e26da83f0768', 'request_id': 'req-35d47779-316d-481b-a813-ad30dab9e1fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:27.192251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba098162c4f46489685e26da83f0768', 'request_id': 'req-35d47779-316d-481b-a813-ad30dab9e1fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:27.204699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5a1a501c-7a02-4d3f-9da4-73f3c75f1fa1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:27.205089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba098162c4f46489685e26da83f0768', 'request_id': 'req-35d47779-316d-481b-a813-ad30dab9e1fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:27.205943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5a1a501c-7a02-4d3f-9da4-73f3c75f1fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:27.231073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] The token cache is being invalidate because project 9ba098162c4f46489685e26da83f0768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:27.231781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:27.232874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:27.236334 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2720/5444] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:26 2021] DELETE /identity/v3/projects/9ba098162c4f46489685e26da83f0768 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:27.245410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:27.250393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:27.349038 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2725/5445] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:01:27.354578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a501c-7a02-4d3f-9da4-73f3c75f1fa1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:27.381747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a501c-7a02-4d3f-9da4-73f3c75f1fa1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:27.397550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d47779-316d-481b-a813-ad30dab9e1fc tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:27.401403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae61032-0f35-4099-ab01-14980944a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:27.405508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61032-0f35-4099-ab01-14980944a2fd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:27.406226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d176e3-92d7-4004-9d16-f1805ac078e5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:27.407365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d176e3-92d7-4004-9d16-f1805ac078e5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:27.407848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d176e3-92d7-4004-9d16-f1805ac078e5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:27.409565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d176e3-92d7-4004-9d16-f1805ac078e5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:27.410515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61032-0f35-4099-ab01-14980944a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:27.411173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d176e3-92d7-4004-9d16-f1805ac078e5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:27.411778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61032-0f35-4099-ab01-14980944a2fd admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:27.412696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae61032-0f35-4099-ab01-14980944a2fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:27.414124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d176e3-92d7-4004-9d16-f1805ac078e5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:27.415341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae61032-0f35-4099-ab01-14980944a2fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:27.418122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae61032-0f35-4099-ab01-14980944a2fd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:27.473054 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2726/5446] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:27.474273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae61032-0f35-4099-ab01-14980944a2fd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:27.481096 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2721/5447] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:01:27 2021] POST /identity/v3/projects => generated 328 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:01:27.482356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d176e3-92d7-4004-9d16-f1805ac078e5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:27.499708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae61032-0f35-4099-ab01-14980944a2fd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:27.613662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3dc22-d7a0-4f5e-9feb-181e4dbf787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:27.626379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3dc22-d7a0-4f5e-9feb-181e4dbf787e admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:27.626807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3dc22-d7a0-4f5e-9feb-181e4dbf787e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:27.629962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3dc22-d7a0-4f5e-9feb-181e4dbf787e admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:27.630363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3dc22-d7a0-4f5e-9feb-181e4dbf787e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:27.636306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3dc22-d7a0-4f5e-9feb-181e4dbf787e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:27.678169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d176e3-92d7-4004-9d16-f1805ac078e5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:27.705712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd328a23-3a59-4b7e-8ae6-d37eadc3752b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:27.706419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd328a23-3a59-4b7e-8ae6-d37eadc3752b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:27.706783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd328a23-3a59-4b7e-8ae6-d37eadc3752b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:27.707435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd328a23-3a59-4b7e-8ae6-d37eadc3752b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:27.711653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd328a23-3a59-4b7e-8ae6-d37eadc3752b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:27.727718 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2727/5448] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:27 2021] POST /identity/v3/projects => generated 397 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:27.732619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd328a23-3a59-4b7e-8ae6-d37eadc3752b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:27.732778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3dc22-d7a0-4f5e-9feb-181e4dbf787e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:27.789846 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2722/5449] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:27 2021] POST /identity/v3/users => generated 416 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:27.792632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd328a23-3a59-4b7e-8ae6-d37eadc3752b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:27.829161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd328a23-3a59-4b7e-8ae6-d37eadc3752b tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:27.887979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3dc22-d7a0-4f5e-9feb-181e4dbf787e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:27.896428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f496ad-88d0-47b2-a9cc-6c6e1a474e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:27.898058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f496ad-88d0-47b2-a9cc-6c6e1a474e91 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:27.898543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f496ad-88d0-47b2-a9cc-6c6e1a474e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:27.898831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f496ad-88d0-47b2-a9cc-6c6e1a474e91 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:27.900963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f496ad-88d0-47b2-a9cc-6c6e1a474e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:27.904050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f496ad-88d0-47b2-a9cc-6c6e1a474e91 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:27.943679 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2728/5450] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:27 2021] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:27.946506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f496ad-88d0-47b2-a9cc-6c6e1a474e91 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:27.969111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f496ad-88d0-47b2-a9cc-6c6e1a474e91 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:27.990674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567bc36-7482-4715-9d19-56c903fd9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:27.993347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567bc36-7482-4715-9d19-56c903fd9949 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:27.996077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567bc36-7482-4715-9d19-56c903fd9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:27.996388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567bc36-7482-4715-9d19-56c903fd9949 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:28.004112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567bc36-7482-4715-9d19-56c903fd9949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:28.009017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567bc36-7482-4715-9d19-56c903fd9949 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:28.013878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a48e4f-73b8-42ae-bda3-7a5901c1c48a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:28.014726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a48e4f-73b8-42ae-bda3-7a5901c1c48a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:28.015080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a48e4f-73b8-42ae-bda3-7a5901c1c48a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:28.018402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a48e4f-73b8-42ae-bda3-7a5901c1c48a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:28.028578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a48e4f-73b8-42ae-bda3-7a5901c1c48a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:28.030809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a48e4f-73b8-42ae-bda3-7a5901c1c48a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:28.047682 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2729/5451] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:27 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:01:28.050053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567bc36-7482-4715-9d19-56c903fd9949 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:28.067222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567bc36-7482-4715-9d19-56c903fd9949 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:28.068061 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2723/5452] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:27 2021] POST /identity/v3/roles => generated 244 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:28.073493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a48e4f-73b8-42ae-bda3-7a5901c1c48a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:28.090776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a4400-0e83-4a9c-ac7d-1f9db5bdad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:28.092574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a48e4f-73b8-42ae-bda3-7a5901c1c48a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:28.093587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a4400-0e83-4a9c-ac7d-1f9db5bdad8f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:28.094104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a4400-0e83-4a9c-ac7d-1f9db5bdad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:28.094399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a4400-0e83-4a9c-ac7d-1f9db5bdad8f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:28.095824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a4400-0e83-4a9c-ac7d-1f9db5bdad8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:28.104456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a4400-0e83-4a9c-ac7d-1f9db5bdad8f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:28.106813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a65d2e-2f47-4484-8e45-423b98c2bb93 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:28.107563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a65d2e-2f47-4484-8e45-423b98c2bb93 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:28.107836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a65d2e-2f47-4484-8e45-423b98c2bb93 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:28.108651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a65d2e-2f47-4484-8e45-423b98c2bb93 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:28.111040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a65d2e-2f47-4484-8e45-423b98c2bb93 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:28.114748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a65d2e-2f47-4484-8e45-423b98c2bb93 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:28.146793 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2724/5453] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:28 2021] POST /identity/v3/roles => generated 246 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:01:28.147752 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2730/5454] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:28 2021] GET /identity/v3/roles => generated 1655 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:28.148159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a65d2e-2f47-4484-8e45-423b98c2bb93 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:28.148783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a4400-0e83-4a9c-ac7d-1f9db5bdad8f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:28.174325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a4400-0e83-4a9c-ac7d-1f9db5bdad8f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:28.182247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a65d2e-2f47-4484-8e45-423b98c2bb93 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:28.186823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4423b-8cea-4fd6-9098-1846a230e1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:28.187932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4423b-8cea-4fd6-9098-1846a230e1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:28.188259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4423b-8cea-4fd6-9098-1846a230e1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:28.189267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4423b-8cea-4fd6-9098-1846a230e1d4 admin admin] PATH_INFO: `/v3/projects/e12dbac98b4e44de93ff1312141c8f82/users/0e9aac2599124a7cb45e96d741683b05/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:28.194669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb53eeb-ef3f-421a-a37a-4ada09caef69 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:28.195834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb53eeb-ef3f-421a-a37a-4ada09caef69 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:28.196064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb53eeb-ef3f-421a-a37a-4ada09caef69 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:28.196157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb53eeb-ef3f-421a-a37a-4ada09caef69 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/3cd9fa12ba7e4ac6bedb1e9638e520ab/users/27b8e9d30a8844e780f03f32717980bf/roles/b2796b0b50e445c4ad4aa548b7285b53` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:28.227222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4423b-8cea-4fd6-9098-1846a230e1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e12dbac98b4e44de93ff1312141c8f82, user_id=0e9aac2599124a7cb45e96d741683b05, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:28.231895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4423b-8cea-4fd6-9098-1846a230e1d4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:28.232107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb53eeb-ef3f-421a-a37a-4ada09caef69 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3cd9fa12ba7e4ac6bedb1e9638e520ab, user_id=27b8e9d30a8844e780f03f32717980bf, role_id=b2796b0b50e445c4ad4aa548b7285b53)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:28.237451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb53eeb-ef3f-421a-a37a-4ada09caef69 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:28.262702 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2731/5456] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:28 2021] PUT /identity/v3/projects/e12dbac98b4e44de93ff1312141c8f82/users/0e9aac2599124a7cb45e96d741683b05/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:28.264366 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2725/5456] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:28 2021] PUT /identity/v3/projects/3cd9fa12ba7e4ac6bedb1e9638e520ab/users/27b8e9d30a8844e780f03f32717980bf/roles/b2796b0b50e445c4ad4aa548b7285b53 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:28.283098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4423b-8cea-4fd6-9098-1846a230e1d4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:28.288812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29196-dab1-4cb8-a154-69c14ef8ba4f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:28.289125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29196-dab1-4cb8-a154-69c14ef8ba4f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:28.289901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29196-dab1-4cb8-a154-69c14ef8ba4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:28.353027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8cc29196-dab1-4cb8-a154-69c14ef8ba4f None None] MFA Rules not processed for user `0e9aac2599124a7cb45e96d741683b05`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:28.356176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8cc29196-dab1-4cb8-a154-69c14ef8ba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:28.414113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4423b-8cea-4fd6-9098-1846a230e1d4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:28.542890 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2726/5457] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:28 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:28.564649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce5509-1ba7-41bd-bab0-e3b72121079e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:28.566006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce5509-1ba7-41bd-bab0-e3b72121079e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:28.566618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce5509-1ba7-41bd-bab0-e3b72121079e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:28.567076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce5509-1ba7-41bd-bab0-e3b72121079e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/3cd9fa12ba7e4ac6bedb1e9638e520ab/users/27b8e9d30a8844e780f03f32717980bf/roles/b08e8d2c98a24646997d98ccbe40a11b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:28.573885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce5509-1ba7-41bd-bab0-e3b72121079e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3cd9fa12ba7e4ac6bedb1e9638e520ab, user_id=27b8e9d30a8844e780f03f32717980bf, role_id=b08e8d2c98a24646997d98ccbe40a11b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:28.579965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce5509-1ba7-41bd-bab0-e3b72121079e tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:28.619288 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2732/5458] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:28 2021] PUT /identity/v3/projects/3cd9fa12ba7e4ac6bedb1e9638e520ab/users/27b8e9d30a8844e780f03f32717980bf/roles/b08e8d2c98a24646997d98ccbe40a11b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:28.623950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29196-dab1-4cb8-a154-69c14ef8ba4f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:28.625589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15305d8c-7a2f-462d-a8b1-59f68b0bb23d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:28.625877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15305d8c-7a2f-462d-a8b1-59f68b0bb23d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:28.626183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15305d8c-7a2f-462d-a8b1-59f68b0bb23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:28.645880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29196-dab1-4cb8-a154-69c14ef8ba4f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:28.692753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-15305d8c-7a2f-462d-a8b1-59f68b0bb23d None None] MFA Rules not processed for user `0e9aac2599124a7cb45e96d741683b05`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:28.697523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-15305d8c-7a2f-462d-a8b1-59f68b0bb23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:28.791625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf1e0c-4f75-49c7-9a6d-5479f2efd74a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:28.792553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf1e0c-4f75-49c7-9a6d-5479f2efd74a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:28.793032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf1e0c-4f75-49c7-9a6d-5479f2efd74a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:28.794282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf1e0c-4f75-49c7-9a6d-5479f2efd74a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:28.795425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf1e0c-4f75-49c7-9a6d-5479f2efd74a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:28.798603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf1e0c-4f75-49c7-9a6d-5479f2efd74a tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:28.839881 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2733/5459] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:28 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:28.875168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15305d8c-7a2f-462d-a8b1-59f68b0bb23d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:28.877311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-15305d8c-7a2f-462d-a8b1-59f68b0bb23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:28.919298 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2727/5460] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:28 2021] GET /identity/v3/users => generated 8620 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:01:28.925205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ae853-a2e8-4425-a313-9365f641921f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:28.925513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ae853-a2e8-4425-a313-9365f641921f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:28.925784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ae853-a2e8-4425-a313-9365f641921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:28.991578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15305d8c-7a2f-462d-a8b1-59f68b0bb23d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:28.995129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b77ae853-a2e8-4425-a313-9365f641921f None None] MFA Rules not processed for user `27b8e9d30a8844e780f03f32717980bf`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:28.996542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b77ae853-a2e8-4425-a313-9365f641921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:28.998157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60815e45-d9bb-4f46-aa3e-8d9aa9c7495f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:29.002932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815e45-d9bb-4f46-aa3e-8d9aa9c7495f service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.002932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815e45-d9bb-4f46-aa3e-8d9aa9c7495f service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.002932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815e45-d9bb-4f46-aa3e-8d9aa9c7495f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.018340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60815e45-d9bb-4f46-aa3e-8d9aa9c7495f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:29.020180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60815e45-d9bb-4f46-aa3e-8d9aa9c7495f service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:29.036398 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2734/5461] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:28 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:01:29.058084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977c83b-124e-445d-b2f0-f5ec877c3293 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.058370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977c83b-124e-445d-b2f0-f5ec877c3293 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.058659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977c83b-124e-445d-b2f0-f5ec877c3293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.090620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f977c83b-124e-445d-b2f0-f5ec877c3293 None None] MFA Rules not processed for user `0e9aac2599124a7cb45e96d741683b05`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:29.092133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f977c83b-124e-445d-b2f0-f5ec877c3293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:29.102025 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2735/5462] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:29 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:29.114111 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2728/5463] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:28 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:01:29.115804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34dc7b-8733-4e7a-9486-e72cf8dda205 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.117944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34dc7b-8733-4e7a-9486-e72cf8dda205 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.119594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34dc7b-8733-4e7a-9486-e72cf8dda205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.138209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2f16-ff89-4ef0-bf7d-e95d653fc1b2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.138548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2f16-ff89-4ef0-bf7d-e95d653fc1b2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.138765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2f16-ff89-4ef0-bf7d-e95d653fc1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.154975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5c34dc7b-8733-4e7a-9486-e72cf8dda205 None None] MFA Rules not processed for user `27b8e9d30a8844e780f03f32717980bf`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:29.156393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5c34dc7b-8733-4e7a-9486-e72cf8dda205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:29.160283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-16ae2f16-ff89-4ef0-bf7d-e95d653fc1b2 None None] MFA Rules not processed for user `0e9aac2599124a7cb45e96d741683b05`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:29.160946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-16ae2f16-ff89-4ef0-bf7d-e95d653fc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:29.169336 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2729/5464] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:29 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:01:29.175128 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2736/5465] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:29 2021] POST /identity/v3/auth/tokens => generated 3269 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:29.180331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae2f16-ff89-4ef0-bf7d-e95d653fc1b2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:29.208021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3288de-75ee-4186-a690-e233ce855824 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.209402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3288de-75ee-4186-a690-e233ce855824 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.209691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3288de-75ee-4186-a690-e233ce855824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.217005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae2f16-ff89-4ef0-bf7d-e95d653fc1b2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:29.233274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6c2d-e663-413d-a802-66e38f2f7987 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b8e9d30a8844e780f03f32717980bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-949425768', 'tempest-DelegatedRole-1409776728'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:29.233899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6c2d-e663-413d-a802-66e38f2f7987 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.234185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6c2d-e663-413d-a802-66e38f2f7987 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.234464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a6c2d-e663-413d-a802-66e38f2f7987 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.235231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a6c2d-e663-413d-a802-66e38f2f7987 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorizing `identity:create_trust()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:29.236432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a6c2d-e663-413d-a802-66e38f2f7987 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:29.244395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1f3288de-75ee-4186-a690-e233ce855824 None None] MFA Rules not processed for user `0e9aac2599124a7cb45e96d741683b05`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:29.245558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1f3288de-75ee-4186-a690-e233ce855824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:29.283149 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2737/5466] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:29 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:29.307141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920599ca-fc27-4a33-91de-b01e0fd6dda1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.307524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920599ca-fc27-4a33-91de-b01e0fd6dda1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.307806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920599ca-fc27-4a33-91de-b01e0fd6dda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.344599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-920599ca-fc27-4a33-91de-b01e0fd6dda1 None None] MFA Rules not processed for user `0e9aac2599124a7cb45e96d741683b05`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:29.348621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-920599ca-fc27-4a33-91de-b01e0fd6dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:29.376484 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2738/5467] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:29 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:29.393463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920599ca-fc27-4a33-91de-b01e0fd6dda1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:29.447689 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2730/5468] 10.222.0.21 () {60 vars in 1173 bytes} [Sat Nov 27 21:01:29 2021] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:29.448462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6c2d-e663-413d-a802-66e38f2f7987 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:29.464548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a6c2d-e663-413d-a802-66e38f2f7987 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:29.489788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee92072-25a8-4658-bbf8-fe9ad90728b9 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b8e9d30a8844e780f03f32717980bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-949425768', 'tempest-DelegatedRole-1409776728'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:29.490751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee92072-25a8-4658-bbf8-fe9ad90728b9 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.491020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee92072-25a8-4658-bbf8-fe9ad90728b9 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.491321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee92072-25a8-4658-bbf8-fe9ad90728b9 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] PATH_INFO: `/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.503925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee92072-25a8-4658-bbf8-fe9ad90728b9 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorizing `identity:get_trust(trust_id=153d4e9b14194e81a6aeb83065c25a67)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:29.505762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee92072-25a8-4658-bbf8-fe9ad90728b9 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:29.513043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920599ca-fc27-4a33-91de-b01e0fd6dda1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:29.527884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bb49e-42cc-42a3-8821-74821f123690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:29.531230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bb49e-42cc-42a3-8821-74821f123690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.531627 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2731/5469] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:01:29 2021] GET /identity/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67 => generated 834 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:29.531765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bb49e-42cc-42a3-8821-74821f123690 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.534027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bb49e-42cc-42a3-8821-74821f123690 admin admin] PATH_INFO: `/v3/users/0e9aac2599124a7cb45e96d741683b05` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.535698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee92072-25a8-4658-bbf8-fe9ad90728b9 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:29.537971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bb49e-42cc-42a3-8821-74821f123690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e9aac2599124a7cb45e96d741683b05)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:29.542846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bb49e-42cc-42a3-8821-74821f123690 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:29.556822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee92072-25a8-4658-bbf8-fe9ad90728b9 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:29.571745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c7da0-c30c-4cfc-9688-d5496c80fe2b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b8e9d30a8844e780f03f32717980bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-949425768', 'tempest-DelegatedRole-1409776728'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:29.572850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7da0-c30c-4cfc-9688-d5496c80fe2b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.573359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7da0-c30c-4cfc-9688-d5496c80fe2b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.573807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c7da0-c30c-4cfc-9688-d5496c80fe2b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] PATH_INFO: `/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.587934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c7da0-c30c-4cfc-9688-d5496c80fe2b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=153d4e9b14194e81a6aeb83065c25a67)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:29.596204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c7da0-c30c-4cfc-9688-d5496c80fe2b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:29.607363 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2732/5470] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 21:01:29 2021] GET /identity/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67/roles => generated 371 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:29.612870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c7da0-c30c-4cfc-9688-d5496c80fe2b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:29.632047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c7da0-c30c-4cfc-9688-d5496c80fe2b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:29.640022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a271720-4f35-470f-9944-c9f6565f3ad2 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b8e9d30a8844e780f03f32717980bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-949425768', 'tempest-DelegatedRole-1409776728'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:29.647063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a271720-4f35-470f-9944-c9f6565f3ad2 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.647063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a271720-4f35-470f-9944-c9f6565f3ad2 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.647063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a271720-4f35-470f-9944-c9f6565f3ad2 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] PATH_INFO: `/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67/roles/b2796b0b50e445c4ad4aa548b7285b53` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.665703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a271720-4f35-470f-9944-c9f6565f3ad2 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorizing `identity:get_role_for_trust(trust_id=153d4e9b14194e81a6aeb83065c25a67, role_id=b2796b0b50e445c4ad4aa548b7285b53)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:29.666002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-443bb49e-42cc-42a3-8821-74821f123690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e9aac2599124a7cb45e96d741683b05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:29.667805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a271720-4f35-470f-9944-c9f6565f3ad2 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:29.678704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-443bb49e-42cc-42a3-8821-74821f123690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e9aac2599124a7cb45e96d741683b05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:29.679484 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2733/5471] 10.222.0.21 () {58 vars in 1367 bytes} [Sat Nov 27 21:01:29 2021] GET /identity/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67/roles/b2796b0b50e445c4ad4aa548b7285b53 => generated 244 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:29.683003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-443bb49e-42cc-42a3-8821-74821f123690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e9aac2599124a7cb45e96d741683b05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:29.685331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a271720-4f35-470f-9944-c9f6565f3ad2 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:29.688284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2a271720-4f35-470f-9944-c9f6565f3ad2 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:29.692428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-443bb49e-42cc-42a3-8821-74821f123690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e9aac2599124a7cb45e96d741683b05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:29.705482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a271720-4f35-470f-9944-c9f6565f3ad2 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:29.710835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec838a5-b2d1-48d4-b417-54f845c83882 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b8e9d30a8844e780f03f32717980bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-949425768', 'tempest-DelegatedRole-1409776728'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:29.712456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec838a5-b2d1-48d4-b417-54f845c83882 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] REQUEST_METHOD: `HEAD` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.712951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec838a5-b2d1-48d4-b417-54f845c83882 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.713380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec838a5-b2d1-48d4-b417-54f845c83882 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] PATH_INFO: `/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67/roles/b2796b0b50e445c4ad4aa548b7285b53` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.717010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-443bb49e-42cc-42a3-8821-74821f123690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e9aac2599124a7cb45e96d741683b05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:29.726113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec838a5-b2d1-48d4-b417-54f845c83882 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorizing `identity:get_role_for_trust(trust_id=153d4e9b14194e81a6aeb83065c25a67, role_id=b2796b0b50e445c4ad4aa548b7285b53)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:29.728144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec838a5-b2d1-48d4-b417-54f845c83882 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:29.731676 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2739/5472] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:29 2021] DELETE /identity/v3/users/0e9aac2599124a7cb45e96d741683b05 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:29.734386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3002c4-4093-495e-a0e5-6ece07b9cee6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.734810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3002c4-4093-495e-a0e5-6ece07b9cee6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.735448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3002c4-4093-495e-a0e5-6ece07b9cee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.743443 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2734/5473] 10.222.0.21 () {58 vars in 1368 bytes} [Sat Nov 27 21:01:29 2021] HEAD /identity/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67/roles/b2796b0b50e445c4ad4aa548b7285b53 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Nov 27 21:01:29.751155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec838a5-b2d1-48d4-b417-54f845c83882 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:29.768877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec838a5-b2d1-48d4-b417-54f845c83882 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:29.772828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1d3002c4-4093-495e-a0e5-6ece07b9cee6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:29.774263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1d3002c4-4093-495e-a0e5-6ece07b9cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:29.834803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299861a4-5bdf-49ad-893d-e7eb7a04b346 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b8e9d30a8844e780f03f32717980bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-949425768', 'tempest-DelegatedRole-1409776728'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:29.835897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299861a4-5bdf-49ad-893d-e7eb7a04b346 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.836520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299861a4-5bdf-49ad-893d-e7eb7a04b346 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.836903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299861a4-5bdf-49ad-893d-e7eb7a04b346 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] PATH_INFO: `/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67/roles/b08e8d2c98a24646997d98ccbe40a11b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.850617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299861a4-5bdf-49ad-893d-e7eb7a04b346 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorizing `identity:get_role_for_trust(trust_id=153d4e9b14194e81a6aeb83065c25a67, role_id=b08e8d2c98a24646997d98ccbe40a11b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:29.850617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299861a4-5bdf-49ad-893d-e7eb7a04b346 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:29.862126 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-299861a4-5bdf-49ad-893d-e7eb7a04b346 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Could not find role: b08e8d2c98a24646997d98ccbe40a11b.: keystone.exception.RoleNotFound: Could not find role: b08e8d2c98a24646997d98ccbe40a11b. Nov 27 21:01:29.864416 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2735/5474] 10.222.0.21 () {58 vars in 1367 bytes} [Sat Nov 27 21:01:29 2021] GET /identity/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67/roles/b08e8d2c98a24646997d98ccbe40a11b => generated 110 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:01:29.868214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299861a4-5bdf-49ad-893d-e7eb7a04b346 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:29.885709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299861a4-5bdf-49ad-893d-e7eb7a04b346 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:29.892109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81376ba-e771-4f71-93b3-384d3a293868 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b8e9d30a8844e780f03f32717980bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-949425768', 'tempest-DelegatedRole-1409776728'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:29.892296 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2740/5475] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:29.892987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81376ba-e771-4f71-93b3-384d3a293868 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] REQUEST_METHOD: `HEAD` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.893291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81376ba-e771-4f71-93b3-384d3a293868 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.893568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81376ba-e771-4f71-93b3-384d3a293868 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] PATH_INFO: `/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67/roles/b08e8d2c98a24646997d98ccbe40a11b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.903804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3002c4-4093-495e-a0e5-6ece07b9cee6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:29.907894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1d3002c4-4093-495e-a0e5-6ece07b9cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:29.908184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81376ba-e771-4f71-93b3-384d3a293868 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorizing `identity:get_role_for_trust(trust_id=153d4e9b14194e81a6aeb83065c25a67, role_id=b08e8d2c98a24646997d98ccbe40a11b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:29.917888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81376ba-e771-4f71-93b3-384d3a293868 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:29.935842 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-b81376ba-e771-4f71-93b3-384d3a293868 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Could not find role: b08e8d2c98a24646997d98ccbe40a11b.: keystone.exception.RoleNotFound: Could not find role: b08e8d2c98a24646997d98ccbe40a11b. Nov 27 21:01:29.937496 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2736/5476] 10.222.0.21 () {58 vars in 1368 bytes} [Sat Nov 27 21:01:29 2021] HEAD /identity/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67/roles/b08e8d2c98a24646997d98ccbe40a11b => generated 0 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Nov 27 21:01:29.942662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81376ba-e771-4f71-93b3-384d3a293868 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:29.955405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81376ba-e771-4f71-93b3-384d3a293868 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:29.961692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b8e9d30a8844e780f03f32717980bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-949425768', 'tempest-DelegatedRole-1409776728'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:29.963698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.964077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.964848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] PATH_INFO: `/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:29.978511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorizing `identity:delete_trust(trust_id=153d4e9b14194e81a6aeb83065c25a67)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:29.982752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:29.987847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3002c4-4093-495e-a0e5-6ece07b9cee6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:29.993809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f07e-bd29-4326-be23-cb7e2744b68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:29.995102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f07e-bd29-4326-be23-cb7e2744b68b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:29.995610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f07e-bd29-4326-be23-cb7e2744b68b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:29.995731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f07e-bd29-4326-be23-cb7e2744b68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:30.014186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '153d4e9b14194e81a6aeb83065c25a67', 'request_id': 'req-b6a3d0d7-30ac-4f50-a745-de051026ed47'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.020966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '153d4e9b14194e81a6aeb83065c25a67', 'request_id': 'req-b6a3d0d7-30ac-4f50-a745-de051026ed47'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.021765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '153d4e9b14194e81a6aeb83065c25a67', 'request_id': 'req-b6a3d0d7-30ac-4f50-a745-de051026ed47'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.031668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168f07e-bd29-4326-be23-cb7e2744b68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:30.033460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168f07e-bd29-4326-be23-cb7e2744b68b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:30.046674 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2737/5477] 10.222.0.21 () {58 vars in 1253 bytes} [Sat Nov 27 21:01:29 2021] DELETE /identity/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:30.051101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:30.053030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:30.060980 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2741/5478] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:01:30.069818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3d0d7-30ac-4f50-a745-de051026ed47 tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:30.075770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fd98b-7774-46e7-82ca-6a7a2f9c159b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27b8e9d30a8844e780f03f32717980bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-949425768', 'tempest-DelegatedRole-1409776728'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:30.077900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fd98b-7774-46e7-82ca-6a7a2f9c159b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:30.078195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fd98b-7774-46e7-82ca-6a7a2f9c159b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:30.078474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fd98b-7774-46e7-82ca-6a7a2f9c159b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] PATH_INFO: `/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:30.099865 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-b72fd98b-7774-46e7-82ca-6a7a2f9c159b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Could not find trust: 153d4e9b14194e81a6aeb83065c25a67.: keystone.exception.TrustNotFound: Could not find trust: 153d4e9b14194e81a6aeb83065c25a67. Nov 27 21:01:30.102015 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2738/5479] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:01:30 2021] GET /identity/v3/OS-TRUST/trusts/153d4e9b14194e81a6aeb83065c25a67 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:01:30.106829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f07e-bd29-4326-be23-cb7e2744b68b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:30.109123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8168f07e-bd29-4326-be23-cb7e2744b68b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:30.314931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f07e-bd29-4326-be23-cb7e2744b68b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:30.325988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:30.325988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:30.326328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:30.326328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/b08e8d2c98a24646997d98ccbe40a11b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:30.331741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b08e8d2c98a24646997d98ccbe40a11b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:30.333466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:30.393208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role b08e8d2c98a24646997d98ccbe40a11b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:30.394107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.395650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.398396 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2742/5480] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:30 2021] DELETE /identity/v3/roles/b08e8d2c98a24646997d98ccbe40a11b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:30.402817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fd98b-7774-46e7-82ca-6a7a2f9c159b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:30.405859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b72fd98b-7774-46e7-82ca-6a7a2f9c159b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:30.437981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fd98b-7774-46e7-82ca-6a7a2f9c159b tempest-TrustsV3TestJSON-156733518 tempest-user-2079667276] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:30.491798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:30.493547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:30.541279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:30.542847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:30.542847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:30.543278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/b2796b0b50e445c4ad4aa548b7285b53` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:30.545184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b2796b0b50e445c4ad4aa548b7285b53)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:30.547746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:30.600709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role b2796b0b50e445c4ad4aa548b7285b53 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:30.601262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.601737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.604244 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2739/5481] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:30 2021] DELETE /identity/v3/roles/b2796b0b50e445c4ad4aa548b7285b53 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:30.611297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:30.615395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:30.620569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f349e01-523d-417d-82b6-73a87bd70dfb tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:30.701229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:30.703488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:30.704630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:30.705073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] PATH_INFO: `/v3/projects/e12dbac98b4e44de93ff1312141c8f82` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:30.708515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e12dbac98b4e44de93ff1312141c8f82)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:30.710996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:30.725618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a7164-87d3-45ac-9787-2364c1f0ffef tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:30.744974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:30.747629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:30.748607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:30.749301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users/27b8e9d30a8844e780f03f32717980bf` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:30.751459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=27b8e9d30a8844e780f03f32717980bf)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:30.754290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:30.807492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e12dbac98b4e44de93ff1312141c8f82', 'request_id': 'req-2487c10d-f348-4a96-bee3-92c7343b9dea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.818345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e12dbac98b4e44de93ff1312141c8f82', 'request_id': 'req-2487c10d-f348-4a96-bee3-92c7343b9dea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.828046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e12dbac98b4e44de93ff1312141c8f82', 'request_id': 'req-2487c10d-f348-4a96-bee3-92c7343b9dea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.830383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b8e9d30a8844e780f03f32717980bf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.831340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b8e9d30a8844e780f03f32717980bf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.848972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b8e9d30a8844e780f03f32717980bf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.849768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b8e9d30a8844e780f03f32717980bf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.859704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] The token cache is being invalidate because project e12dbac98b4e44de93ff1312141c8f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:30.860009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.865224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2487c10d-f348-4a96-bee3-92c7343b9dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.873928 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2743/5482] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:30 2021] DELETE /identity/v3/projects/e12dbac98b4e44de93ff1312141c8f82 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:30.877175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ecdc7-3e40-4b0a-8fdd-d61f57ea4227 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:30.877476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ecdc7-3e40-4b0a-8fdd-d61f57ea4227 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:30.878007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ecdc7-3e40-4b0a-8fdd-d61f57ea4227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:30.878910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b8e9d30a8844e780f03f32717980bf'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:30.925838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a20ecdc7-3e40-4b0a-8fdd-d61f57ea4227 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:30.929654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a20ecdc7-3e40-4b0a-8fdd-d61f57ea4227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:30.943565 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2740/5483] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:30 2021] DELETE /identity/v3/users/27b8e9d30a8844e780f03f32717980bf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:30.944813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:30.946483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:31.056758 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2744/5484] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:31.073410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267c00f-46ea-4de2-b3b1-ce2624a31ba4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:31.073536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267c00f-46ea-4de2-b3b1-ce2624a31ba4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:31.074045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267c00f-46ea-4de2-b3b1-ce2624a31ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:31.120604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cd2b1-e33d-4023-8c57-5f917da637f8 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:31.129358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5267c00f-46ea-4de2-b3b1-ce2624a31ba4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:31.131372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:31.132472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:31.132768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:31.133094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/3cd9fa12ba7e4ac6bedb1e9638e520ab` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:31.134519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3cd9fa12ba7e4ac6bedb1e9638e520ab)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:31.136946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:31.137127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5267c00f-46ea-4de2-b3b1-ce2624a31ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:31.231422 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2745/5485] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:31.235410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267c00f-46ea-4de2-b3b1-ce2624a31ba4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:31.246783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267c00f-46ea-4de2-b3b1-ce2624a31ba4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:31.255152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d35763-e461-4e07-82f8-698921b3811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:31.256027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d35763-e461-4e07-82f8-698921b3811c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:31.256313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d35763-e461-4e07-82f8-698921b3811c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:31.256595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d35763-e461-4e07-82f8-698921b3811c admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:31.258217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d35763-e461-4e07-82f8-698921b3811c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:31.258654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d35763-e461-4e07-82f8-698921b3811c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:31.260871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d35763-e461-4e07-82f8-698921b3811c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:31.277051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'request_id': 'req-fb507dfb-ef16-477d-b1d1-cb5381a751a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:31.281399 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2746/5486] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:31.281399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d35763-e461-4e07-82f8-698921b3811c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:31.281399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-60d35763-e461-4e07-82f8-698921b3811c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:31.291518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'request_id': 'req-fb507dfb-ef16-477d-b1d1-cb5381a751a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:31.297244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d35763-e461-4e07-82f8-698921b3811c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:31.303196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd9fa12ba7e4ac6bedb1e9638e520ab', 'request_id': 'req-fb507dfb-ef16-477d-b1d1-cb5381a751a3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:31.319652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] The token cache is being invalidate because project 3cd9fa12ba7e4ac6bedb1e9638e520ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:31.320022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:31.320974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:31.329801 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2741/5487] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:30 2021] DELETE /identity/v3/projects/3cd9fa12ba7e4ac6bedb1e9638e520ab => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:31.331146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:31.332984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:31.374318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:31.374862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:31.375209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:31.375552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] PATH_INFO: `/v3/users/faed6b4fee944522a19b4721fa335af5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:31.377979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faed6b4fee944522a19b4721fa335af5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:31.380224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:31.445291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb507dfb-ef16-477d-b1d1-cb5381a751a3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:31.454642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89250e6b-7830-480d-b52a-2c66234cfb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:31.455761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89250e6b-7830-480d-b52a-2c66234cfb0d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:31.456220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89250e6b-7830-480d-b52a-2c66234cfb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:31.456741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89250e6b-7830-480d-b52a-2c66234cfb0d admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:31.457666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89250e6b-7830-480d-b52a-2c66234cfb0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:31.460532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89250e6b-7830-480d-b52a-2c66234cfb0d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:31.507020 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2742/5488] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:31 2021] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:31.507020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89250e6b-7830-480d-b52a-2c66234cfb0d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:31.514267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-89250e6b-7830-480d-b52a-2c66234cfb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:31.656612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89250e6b-7830-480d-b52a-2c66234cfb0d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:31.662557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d46ab0-7c27-449a-ad18-90f4e23f5527 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:31.663140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46ab0-7c27-449a-ad18-90f4e23f5527 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:31.663474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46ab0-7c27-449a-ad18-90f4e23f5527 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:31.663826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46ab0-7c27-449a-ad18-90f4e23f5527 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:31.664778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d46ab0-7c27-449a-ad18-90f4e23f5527 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:31.667705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d46ab0-7c27-449a-ad18-90f4e23f5527 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:31.693770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faed6b4fee944522a19b4721fa335af5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:31.705541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faed6b4fee944522a19b4721fa335af5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:31.706447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faed6b4fee944522a19b4721fa335af5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:31.715586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faed6b4fee944522a19b4721fa335af5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:31.722396 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2743/5489] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:01:31 2021] POST /identity/v3/projects => generated 329 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:31.723580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d46ab0-7c27-449a-ad18-90f4e23f5527 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:31.727359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c3d46ab0-7c27-449a-ad18-90f4e23f5527 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:31.745151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faed6b4fee944522a19b4721fa335af5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:31.755372 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2747/5490] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:31 2021] DELETE /identity/v3/users/faed6b4fee944522a19b4721fa335af5 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:31.761346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:31.763625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:31.827603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d46ab0-7c27-449a-ad18-90f4e23f5527 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:31.851537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c7ef-6661-4239-9d60-0b09264575c1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:31.857701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2347d-06af-40f7-9d06-7df93dab0c6d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:31.859107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2347d-06af-40f7-9d06-7df93dab0c6d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:31.860133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2347d-06af-40f7-9d06-7df93dab0c6d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:31.860133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2347d-06af-40f7-9d06-7df93dab0c6d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:31.861400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2347d-06af-40f7-9d06-7df93dab0c6d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:31.863827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2347d-06af-40f7-9d06-7df93dab0c6d tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:31.890860 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2748/5491] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:31 2021] POST /identity/v3/users => generated 413 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:31.892235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1cf82-07dc-4ab4-9c80-43686593379b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:31.892525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1cf82-07dc-4ab4-9c80-43686593379b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:31.892802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1cf82-07dc-4ab4-9c80-43686593379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:31.914032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9cd1cf82-07dc-4ab4-9c80-43686593379b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:31.915919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9cd1cf82-07dc-4ab4-9c80-43686593379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:31.921732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d4ffe-3ad0-4d44-b332-e048667336ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:31.923288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d4ffe-3ad0-4d44-b332-e048667336ca admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:31.923725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d4ffe-3ad0-4d44-b332-e048667336ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:31.924154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d4ffe-3ad0-4d44-b332-e048667336ca admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:31.925103 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2749/5492] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:31.925847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1cf82-07dc-4ab4-9c80-43686593379b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:31.927603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d4ffe-3ad0-4d44-b332-e048667336ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:31.930074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d4ffe-3ad0-4d44-b332-e048667336ca admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:31.938847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1cf82-07dc-4ab4-9c80-43686593379b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:31.944449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddfd42-ce53-4807-afb8-e7f6109ffcca tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:31.945150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddfd42-ce53-4807-afb8-e7f6109ffcca tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:31.945377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddfd42-ce53-4807-afb8-e7f6109ffcca tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:31.945637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ddfd42-ce53-4807-afb8-e7f6109ffcca tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:31.946418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddfd42-ce53-4807-afb8-e7f6109ffcca tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:31.948259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ddfd42-ce53-4807-afb8-e7f6109ffcca tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:31.958796 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2744/5493] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:31 2021] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:31.960516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d4ffe-3ad0-4d44-b332-e048667336ca admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:31.963740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d56d4ffe-3ad0-4d44-b332-e048667336ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:31.964469 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2750/5494] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:31 2021] POST /identity/v3/roles => generated 244 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:31.965299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddfd42-ce53-4807-afb8-e7f6109ffcca tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:31.979588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ddfd42-ce53-4807-afb8-e7f6109ffcca tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:31.986506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c095dd-11f5-4339-ad96-57db0946fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:31.987198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c095dd-11f5-4339-ad96-57db0946fe7a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:31.987515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c095dd-11f5-4339-ad96-57db0946fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:31.987797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c095dd-11f5-4339-ad96-57db0946fe7a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:31.989020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c095dd-11f5-4339-ad96-57db0946fe7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:31.990968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c095dd-11f5-4339-ad96-57db0946fe7a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:32.004826 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2751/5495] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:31 2021] GET /identity/v3/roles => generated 1655 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:32.005570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c095dd-11f5-4339-ad96-57db0946fe7a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:32.022465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c095dd-11f5-4339-ad96-57db0946fe7a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:32.028720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4892cb-6c1f-4866-91f4-5526e3a15302 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:32.031914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4892cb-6c1f-4866-91f4-5526e3a15302 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.032454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4892cb-6c1f-4866-91f4-5526e3a15302 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.032832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4892cb-6c1f-4866-91f4-5526e3a15302 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.034190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4892cb-6c1f-4866-91f4-5526e3a15302 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:32.036298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4892cb-6c1f-4866-91f4-5526e3a15302 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:32.058305 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2752/5496] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:01:32 2021] POST /identity/v3/roles => generated 247 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:32.058305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4892cb-6c1f-4866-91f4-5526e3a15302 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:32.061276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d4ffe-3ad0-4d44-b332-e048667336ca admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:32.069605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda874-3458-46ff-a415-021befdcda25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:32.071869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda874-3458-46ff-a415-021befdcda25 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.071869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda874-3458-46ff-a415-021befdcda25 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.072135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cda874-3458-46ff-a415-021befdcda25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.073087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4892cb-6c1f-4866-91f4-5526e3a15302 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:32.084895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa53f22-0909-4417-abe7-a9ee1db0bc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:32.086889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cda874-3458-46ff-a415-021befdcda25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:32.087287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53f22-0909-4417-abe7-a9ee1db0bc68 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.087819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53f22-0909-4417-abe7-a9ee1db0bc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.088527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53f22-0909-4417-abe7-a9ee1db0bc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.089297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa53f22-0909-4417-abe7-a9ee1db0bc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:32.091410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa53f22-0909-4417-abe7-a9ee1db0bc68 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:32.093033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cda874-3458-46ff-a415-021befdcda25 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:32.106617 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2745/5497] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:32.106617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda874-3458-46ff-a415-021befdcda25 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:32.111745 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2753/5498] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:32 2021] GET /identity/v3/roles => generated 1893 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:32.113518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa53f22-0909-4417-abe7-a9ee1db0bc68 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:32.121103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cda874-3458-46ff-a415-021befdcda25 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:32.128281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51df28-42bc-41c9-b218-9b55f2a404dd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:32.129719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa53f22-0909-4417-abe7-a9ee1db0bc68 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:32.129857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51df28-42bc-41c9-b218-9b55f2a404dd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.129857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51df28-42bc-41c9-b218-9b55f2a404dd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.130052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51df28-42bc-41c9-b218-9b55f2a404dd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/382a843721c54f47b20bbaf4b2f8b079/users/e7e989184e244163b2ae6aeebf39814b/roles/f045ae219dea4ab498e107dfea420b30` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.137446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ed651-71f4-4b67-9fb7-4537a567c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:32.139454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ed651-71f4-4b67-9fb7-4537a567c166 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.139454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ed651-71f4-4b67-9fb7-4537a567c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.139454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ed651-71f4-4b67-9fb7-4537a567c166 admin admin] PATH_INFO: `/v3/projects/998295c106db4d7b82c3c10f09fbe182/users/ab09c8b68a1545fb8733dd571bc9db4b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.161584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ed651-71f4-4b67-9fb7-4537a567c166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998295c106db4d7b82c3c10f09fbe182, user_id=ab09c8b68a1545fb8733dd571bc9db4b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:32.161866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51df28-42bc-41c9-b218-9b55f2a404dd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=382a843721c54f47b20bbaf4b2f8b079, user_id=e7e989184e244163b2ae6aeebf39814b, role_id=f045ae219dea4ab498e107dfea420b30)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:32.165028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ed651-71f4-4b67-9fb7-4537a567c166 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:32.166109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51df28-42bc-41c9-b218-9b55f2a404dd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:32.194438 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2754/5499] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:32 2021] PUT /identity/v3/projects/998295c106db4d7b82c3c10f09fbe182/users/ab09c8b68a1545fb8733dd571bc9db4b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:32.194651 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2746/5500] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:32 2021] PUT /identity/v3/projects/382a843721c54f47b20bbaf4b2f8b079/users/e7e989184e244163b2ae6aeebf39814b/roles/f045ae219dea4ab498e107dfea420b30 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:32.196560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1e1c-0b28-4330-bd50-90391904a374 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.196912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1e1c-0b28-4330-bd50-90391904a374 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.197195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1e1c-0b28-4330-bd50-90391904a374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.199413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51df28-42bc-41c9-b218-9b55f2a404dd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:32.238079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1b9e1e1c-0b28-4330-bd50-90391904a374 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:32.239577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1b9e1e1c-0b28-4330-bd50-90391904a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:32.343084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51df28-42bc-41c9-b218-9b55f2a404dd tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:32.350469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80d30-20c6-4287-a94d-5c2714f9cac4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:32.351673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80d30-20c6-4287-a94d-5c2714f9cac4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.352133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80d30-20c6-4287-a94d-5c2714f9cac4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.352570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80d30-20c6-4287-a94d-5c2714f9cac4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/382a843721c54f47b20bbaf4b2f8b079/users/e7e989184e244163b2ae6aeebf39814b/roles/1b9757e3f04c4ba9b2683f334b3f0347` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.355339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e80d30-20c6-4287-a94d-5c2714f9cac4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:create_grant(project_id=382a843721c54f47b20bbaf4b2f8b079, user_id=e7e989184e244163b2ae6aeebf39814b, role_id=1b9757e3f04c4ba9b2683f334b3f0347)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:32.359782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e80d30-20c6-4287-a94d-5c2714f9cac4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:32.360993 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2755/5501] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:32.374971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e1e1c-0b28-4330-bd50-90391904a374 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:32.388042 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2747/5502] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:32 2021] PUT /identity/v3/projects/382a843721c54f47b20bbaf4b2f8b079/users/e7e989184e244163b2ae6aeebf39814b/roles/1b9757e3f04c4ba9b2683f334b3f0347 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:32.394606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80d30-20c6-4287-a94d-5c2714f9cac4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:32.502524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e1e1c-0b28-4330-bd50-90391904a374 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:32.519183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80d30-20c6-4287-a94d-5c2714f9cac4 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:32.528295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0fd84-6bfc-4ccf-a6cd-1bec196ff134 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:32.529425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0fd84-6bfc-4ccf-a6cd-1bec196ff134 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.531716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0fd84-6bfc-4ccf-a6cd-1bec196ff134 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.532307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0fd84-6bfc-4ccf-a6cd-1bec196ff134 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.533297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0fd84-6bfc-4ccf-a6cd-1bec196ff134 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:32.536127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0fd84-6bfc-4ccf-a6cd-1bec196ff134 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:32.583415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c06134-f5d8-432f-967c-4c6c12c21f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:32.584868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c06134-f5d8-432f-967c-4c6c12c21f76 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.585421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c06134-f5d8-432f-967c-4c6c12c21f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.585713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c06134-f5d8-432f-967c-4c6c12c21f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.587865 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2748/5503] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:32 2021] GET /identity/v3/users => generated 8330 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:32.590023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4c5e1-2783-434e-8131-36baf96c5125 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.590303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4c5e1-2783-434e-8131-36baf96c5125 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.590588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4c5e1-2783-434e-8131-36baf96c5125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.667489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-83b4c5e1-2783-434e-8131-36baf96c5125 None None] MFA Rules not processed for user `e7e989184e244163b2ae6aeebf39814b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:32.669092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-83b4c5e1-2783-434e-8131-36baf96c5125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:32.756100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c06134-f5d8-432f-967c-4c6c12c21f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:32.762006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c06134-f5d8-432f-967c-4c6c12c21f76 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:32.765422 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2749/5504] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:32 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:32.779346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4c5e1-2783-434e-8131-36baf96c5125 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:32.781185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-83b4c5e1-2783-434e-8131-36baf96c5125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:32.786842 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2756/5505] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:01:32.788929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414b92-62b5-448d-a653-24edfe68b63e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.789519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414b92-62b5-448d-a653-24edfe68b63e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.789972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414b92-62b5-448d-a653-24edfe68b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.815908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5e414b92-62b5-448d-a653-24edfe68b63e None None] MFA Rules not processed for user `e7e989184e244163b2ae6aeebf39814b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:32.817804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5e414b92-62b5-448d-a653-24edfe68b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:32.818485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4c5e1-2783-434e-8131-36baf96c5125 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:32.825800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:32.826408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.826570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.828075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] PATH_INFO: `/v3/projects/22cbe9c9e7934de8b8ef807c135e69e2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.829589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22cbe9c9e7934de8b8ef807c135e69e2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:32.832723 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2757/5506] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:32 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:32.836908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:32.837999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e414b92-62b5-448d-a653-24edfe68b63e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:32.854718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e414b92-62b5-448d-a653-24edfe68b63e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:32.864925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58f655-4e5f-4f8a-a225-1adf71afc3a7 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e989184e244163b2ae6aeebf39814b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '382a843721c54f47b20bbaf4b2f8b079', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1939397961', 'tempest-NotDelegatedRole-1589479319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:32.865523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58f655-4e5f-4f8a-a225-1adf71afc3a7 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.866129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58f655-4e5f-4f8a-a225-1adf71afc3a7 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.866420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58f655-4e5f-4f8a-a225-1adf71afc3a7 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:32.868546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58f655-4e5f-4f8a-a225-1adf71afc3a7 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorizing `identity:create_trust()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:32.869815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58f655-4e5f-4f8a-a225-1adf71afc3a7 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:32.925001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22cbe9c9e7934de8b8ef807c135e69e2', 'request_id': 'req-ed7fcb94-20dd-43f8-bca3-8ac244612c58'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:32.941035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22cbe9c9e7934de8b8ef807c135e69e2', 'request_id': 'req-ed7fcb94-20dd-43f8-bca3-8ac244612c58'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:32.963505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22cbe9c9e7934de8b8ef807c135e69e2', 'request_id': 'req-ed7fcb94-20dd-43f8-bca3-8ac244612c58'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:32.985914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] The token cache is being invalidate because project 22cbe9c9e7934de8b8ef807c135e69e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:32.986292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:32.988727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed7fcb94-20dd-43f8-bca3-8ac244612c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:32.995107 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2750/5507] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:32 2021] DELETE /identity/v3/projects/22cbe9c9e7934de8b8ef807c135e69e2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:32.997529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b90692-1278-40e1-8f6b-120a269397ca None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:32.997825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b90692-1278-40e1-8f6b-120a269397ca None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:32.998175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b90692-1278-40e1-8f6b-120a269397ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.001511 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2758/5508] 10.222.0.21 () {60 vars in 1173 bytes} [Sat Nov 27 21:01:32 2021] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:33.004486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58f655-4e5f-4f8a-a225-1adf71afc3a7 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.007739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3a58f655-4e5f-4f8a-a225-1adf71afc3a7 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:33.037253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58f655-4e5f-4f8a-a225-1adf71afc3a7 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.039107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-76b90692-1278-40e1-8f6b-120a269397ca None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:33.040409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-76b90692-1278-40e1-8f6b-120a269397ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:33.147128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8fc35-e9ad-4f0c-b5e0-55e51f49a082 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e989184e244163b2ae6aeebf39814b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '382a843721c54f47b20bbaf4b2f8b079', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1939397961', 'tempest-NotDelegatedRole-1589479319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.149631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8fc35-e9ad-4f0c-b5e0-55e51f49a082 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.149973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8fc35-e9ad-4f0c-b5e0-55e51f49a082 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.151043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8fc35-e9ad-4f0c-b5e0-55e51f49a082 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] PATH_INFO: `/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.179138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8fc35-e9ad-4f0c-b5e0-55e51f49a082 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorizing `identity:get_trust(trust_id=ef976c75232b4ac0a95425810f029aeb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.180953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8fc35-e9ad-4f0c-b5e0-55e51f49a082 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.196034 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2759/5509] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:01:33 2021] GET /identity/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb => generated 835 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:33.199218 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2751/5510] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:01:33.201323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8fc35-e9ad-4f0c-b5e0-55e51f49a082 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.209199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65122-d40a-4385-b551-a446e143e4c8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.209554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65122-d40a-4385-b551-a446e143e4c8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.209843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65122-d40a-4385-b551-a446e143e4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.214821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8fc35-e9ad-4f0c-b5e0-55e51f49a082 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.229252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f29fae-cc93-4c51-99a4-6a4550be198f tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e989184e244163b2ae6aeebf39814b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '382a843721c54f47b20bbaf4b2f8b079', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1939397961', 'tempest-NotDelegatedRole-1589479319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.230270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f29fae-cc93-4c51-99a4-6a4550be198f tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.230724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f29fae-cc93-4c51-99a4-6a4550be198f tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.231167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f29fae-cc93-4c51-99a4-6a4550be198f tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] PATH_INFO: `/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.241456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f29fae-cc93-4c51-99a4-6a4550be198f tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=ef976c75232b4ac0a95425810f029aeb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.244004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f29fae-cc93-4c51-99a4-6a4550be198f tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.244616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-49b65122-d40a-4385-b551-a446e143e4c8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:33.246148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49b65122-d40a-4385-b551-a446e143e4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:33.253789 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2760/5511] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 21:01:33 2021] GET /identity/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb/roles => generated 371 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:33.259213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f29fae-cc93-4c51-99a4-6a4550be198f tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.265393 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2752/5512] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:33.269662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b65122-d40a-4385-b551-a446e143e4c8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.272870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f29fae-cc93-4c51-99a4-6a4550be198f tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.277695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742dc71-ebc0-407f-acc3-32e65d105c15 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e989184e244163b2ae6aeebf39814b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '382a843721c54f47b20bbaf4b2f8b079', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1939397961', 'tempest-NotDelegatedRole-1589479319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.278715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742dc71-ebc0-407f-acc3-32e65d105c15 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.278989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742dc71-ebc0-407f-acc3-32e65d105c15 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.279518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742dc71-ebc0-407f-acc3-32e65d105c15 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] PATH_INFO: `/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb/roles/f045ae219dea4ab498e107dfea420b30` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.287016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742dc71-ebc0-407f-acc3-32e65d105c15 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ef976c75232b4ac0a95425810f029aeb, role_id=f045ae219dea4ab498e107dfea420b30)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.288358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742dc71-ebc0-407f-acc3-32e65d105c15 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.290761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b65122-d40a-4385-b551-a446e143e4c8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.300775 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2761/5513] 10.222.0.21 () {58 vars in 1367 bytes} [Sat Nov 27 21:01:33 2021] GET /identity/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb/roles/f045ae219dea4ab498e107dfea420b30 => generated 244 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:33.301544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742dc71-ebc0-407f-acc3-32e65d105c15 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.303116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846df328-81e3-475d-ade8-820a575103a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.304135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846df328-81e3-475d-ade8-820a575103a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.304710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846df328-81e3-475d-ade8-820a575103a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.305184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846df328-81e3-475d-ade8-820a575103a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.307420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846df328-81e3-475d-ade8-820a575103a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:33.308619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846df328-81e3-475d-ade8-820a575103a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.310211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846df328-81e3-475d-ade8-820a575103a6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.313668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742dc71-ebc0-407f-acc3-32e65d105c15 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.319231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1288d-146f-4d5b-8dac-273812f5586b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e989184e244163b2ae6aeebf39814b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '382a843721c54f47b20bbaf4b2f8b079', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1939397961', 'tempest-NotDelegatedRole-1589479319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.320286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1288d-146f-4d5b-8dac-273812f5586b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.320974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1288d-146f-4d5b-8dac-273812f5586b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.320974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1288d-146f-4d5b-8dac-273812f5586b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] PATH_INFO: `/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb/roles/f045ae219dea4ab498e107dfea420b30` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.327847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1288d-146f-4d5b-8dac-273812f5586b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ef976c75232b4ac0a95425810f029aeb, role_id=f045ae219dea4ab498e107dfea420b30)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.329330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1288d-146f-4d5b-8dac-273812f5586b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.334562 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2753/5514] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:33.338184 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2762/5515] 10.222.0.21 () {58 vars in 1368 bytes} [Sat Nov 27 21:01:33 2021] HEAD /identity/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb/roles/f045ae219dea4ab498e107dfea420b30 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:33.342653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1288d-146f-4d5b-8dac-273812f5586b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.346136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846df328-81e3-475d-ade8-820a575103a6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.360594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1288d-146f-4d5b-8dac-273812f5586b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.367617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84204b0a-388f-48bb-9d8b-43db3d0f422d tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e989184e244163b2ae6aeebf39814b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '382a843721c54f47b20bbaf4b2f8b079', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1939397961', 'tempest-NotDelegatedRole-1589479319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.368397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204b0a-388f-48bb-9d8b-43db3d0f422d tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.368731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204b0a-388f-48bb-9d8b-43db3d0f422d tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.368965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204b0a-388f-48bb-9d8b-43db3d0f422d tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] PATH_INFO: `/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb/roles/1b9757e3f04c4ba9b2683f334b3f0347` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.374741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846df328-81e3-475d-ade8-820a575103a6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.378062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84204b0a-388f-48bb-9d8b-43db3d0f422d tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ef976c75232b4ac0a95425810f029aeb, role_id=1b9757e3f04c4ba9b2683f334b3f0347)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.380262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84204b0a-388f-48bb-9d8b-43db3d0f422d tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.385151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1940ece-deab-4772-ac2a-e1a1746ed708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.387289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1940ece-deab-4772-ac2a-e1a1746ed708 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.387289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1940ece-deab-4772-ac2a-e1a1746ed708 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.387680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1940ece-deab-4772-ac2a-e1a1746ed708 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.390231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1940ece-deab-4772-ac2a-e1a1746ed708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.392398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1940ece-deab-4772-ac2a-e1a1746ed708 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.397573 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-84204b0a-388f-48bb-9d8b-43db3d0f422d tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Could not find role: 1b9757e3f04c4ba9b2683f334b3f0347.: keystone.exception.RoleNotFound: Could not find role: 1b9757e3f04c4ba9b2683f334b3f0347. Nov 27 21:01:33.400714 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2763/5516] 10.222.0.21 () {58 vars in 1367 bytes} [Sat Nov 27 21:01:33 2021] GET /identity/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb/roles/1b9757e3f04c4ba9b2683f334b3f0347 => generated 110 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:01:33.405562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84204b0a-388f-48bb-9d8b-43db3d0f422d tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.421436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84204b0a-388f-48bb-9d8b-43db3d0f422d tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.438014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a3afc-360e-4912-bf2b-74eba6e0bda2 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e989184e244163b2ae6aeebf39814b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '382a843721c54f47b20bbaf4b2f8b079', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1939397961', 'tempest-NotDelegatedRole-1589479319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.440796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a3afc-360e-4912-bf2b-74eba6e0bda2 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] REQUEST_METHOD: `HEAD` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.454956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a3afc-360e-4912-bf2b-74eba6e0bda2 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.456132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a3afc-360e-4912-bf2b-74eba6e0bda2 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] PATH_INFO: `/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb/roles/1b9757e3f04c4ba9b2683f334b3f0347` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.462012 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2754/5517] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:33 2021] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:33.466702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1940ece-deab-4772-ac2a-e1a1746ed708 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.470146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a3afc-360e-4912-bf2b-74eba6e0bda2 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ef976c75232b4ac0a95425810f029aeb, role_id=1b9757e3f04c4ba9b2683f334b3f0347)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.472640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a3afc-360e-4912-bf2b-74eba6e0bda2 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.502235 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-6b0a3afc-360e-4912-bf2b-74eba6e0bda2 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Could not find role: 1b9757e3f04c4ba9b2683f334b3f0347.: keystone.exception.RoleNotFound: Could not find role: 1b9757e3f04c4ba9b2683f334b3f0347. Nov 27 21:01:33.503965 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2764/5518] 10.222.0.21 () {58 vars in 1368 bytes} [Sat Nov 27 21:01:33 2021] HEAD /identity/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb/roles/1b9757e3f04c4ba9b2683f334b3f0347 => generated 0 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Nov 27 21:01:33.508820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a3afc-360e-4912-bf2b-74eba6e0bda2 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.531986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a3afc-360e-4912-bf2b-74eba6e0bda2 tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.590520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1940ece-deab-4772-ac2a-e1a1746ed708 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.598620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e823a8-22e3-4e7f-912e-f2d6f800f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.599077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e823a8-22e3-4e7f-912e-f2d6f800f5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.599369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e823a8-22e3-4e7f-912e-f2d6f800f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.599769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e823a8-22e3-4e7f-912e-f2d6f800f5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.600421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e823a8-22e3-4e7f-912e-f2d6f800f5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.602751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e823a8-22e3-4e7f-912e-f2d6f800f5d9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.625930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e989184e244163b2ae6aeebf39814b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '382a843721c54f47b20bbaf4b2f8b079', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1939397961', 'tempest-NotDelegatedRole-1589479319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.626817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.627120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.627427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] PATH_INFO: `/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.631406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2755/5519] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:33 2021] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:01:33.633488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e823a8-22e3-4e7f-912e-f2d6f800f5d9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.637237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorizing `identity:delete_trust(trust_id=ef976c75232b4ac0a95425810f029aeb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.639722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.645405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e823a8-22e3-4e7f-912e-f2d6f800f5d9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.651763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b0037-d920-421e-8f94-9c53c77fd89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.652436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b0037-d920-421e-8f94-9c53c77fd89e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.652723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b0037-d920-421e-8f94-9c53c77fd89e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.653298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b0037-d920-421e-8f94-9c53c77fd89e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.654051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b0037-d920-421e-8f94-9c53c77fd89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.656326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b0037-d920-421e-8f94-9c53c77fd89e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.670936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ef976c75232b4ac0a95425810f029aeb', 'request_id': 'req-8ec65c24-bc50-49fe-95c9-21243b5f90cd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:33.672134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'ef976c75232b4ac0a95425810f029aeb', 'request_id': 'req-8ec65c24-bc50-49fe-95c9-21243b5f90cd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:33.678667 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2756/5520] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:33 2021] GET /identity/v3/roles => generated 1893 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:33.685973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b0037-d920-421e-8f94-9c53c77fd89e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.686169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ef976c75232b4ac0a95425810f029aeb', 'request_id': 'req-8ec65c24-bc50-49fe-95c9-21243b5f90cd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:33.687177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1e0b0037-d920-421e-8f94-9c53c77fd89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:33.694079 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2765/5521] 10.222.0.21 () {58 vars in 1253 bytes} [Sat Nov 27 21:01:33 2021] DELETE /identity/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:33.698927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.701244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:33.702200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b0037-d920-421e-8f94-9c53c77fd89e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.712904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22618c3-a016-4e26-9873-f914a3a42847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.713633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22618c3-a016-4e26-9873-f914a3a42847 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.713926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22618c3-a016-4e26-9873-f914a3a42847 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.714210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22618c3-a016-4e26-9873-f914a3a42847 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.714955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22618c3-a016-4e26-9873-f914a3a42847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.718247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22618c3-a016-4e26-9873-f914a3a42847 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.721704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec65c24-bc50-49fe-95c9-21243b5f90cd tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.727880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d547-6825-410e-a4f3-9a3cf7ede87b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e989184e244163b2ae6aeebf39814b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '382a843721c54f47b20bbaf4b2f8b079', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1939397961', 'tempest-NotDelegatedRole-1589479319'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.729032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d547-6825-410e-a4f3-9a3cf7ede87b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.729813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d547-6825-410e-a4f3-9a3cf7ede87b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.730238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d547-6825-410e-a4f3-9a3cf7ede87b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] PATH_INFO: `/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.737567 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2757/5522] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:33 2021] GET /identity/v3/roles => generated 1893 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:33.738874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22618c3-a016-4e26-9873-f914a3a42847 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.753227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22618c3-a016-4e26-9873-f914a3a42847 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.753723 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-e3c8d547-6825-410e-a4f3-9a3cf7ede87b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Could not find trust: ef976c75232b4ac0a95425810f029aeb.: keystone.exception.TrustNotFound: Could not find trust: ef976c75232b4ac0a95425810f029aeb. Nov 27 21:01:33.759300 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2766/5523] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:01:33 2021] GET /identity/v3/OS-TRUST/trusts/ef976c75232b4ac0a95425810f029aeb => generated 111 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 21:01:33.759662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d5eb0-247f-4aa8-b7e6-29985106ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.762124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d547-6825-410e-a4f3-9a3cf7ede87b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:33.765193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5eb0-247f-4aa8-b7e6-29985106ec38 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.765193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5eb0-247f-4aa8-b7e6-29985106ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.765193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5eb0-247f-4aa8-b7e6-29985106ec38 admin admin] PATH_INFO: `/v3/projects/58285bdf2f7f42828b92f58257662c9e/users/40318ccb06044be792566a1f518427ed/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.766705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e3c8d547-6825-410e-a4f3-9a3cf7ede87b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:33.815824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d5eb0-247f-4aa8-b7e6-29985106ec38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58285bdf2f7f42828b92f58257662c9e, user_id=40318ccb06044be792566a1f518427ed, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.821029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d5eb0-247f-4aa8-b7e6-29985106ec38 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:33.843644 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2758/5524] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:33 2021] PUT /identity/v3/projects/58285bdf2f7f42828b92f58257662c9e/users/40318ccb06044be792566a1f518427ed/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:33.850968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947efa4-0364-4e48-961c-064f0d1e6906 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.851371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947efa4-0364-4e48-961c-064f0d1e6906 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.851727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947efa4-0364-4e48-961c-064f0d1e6906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.862973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d547-6825-410e-a4f3-9a3cf7ede87b tempest-TrustsV3TestJSON-1934241643 tempest-user-834884676] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:33.899402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c947efa4-0364-4e48-961c-064f0d1e6906 None None] MFA Rules not processed for user `40318ccb06044be792566a1f518427ed`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:33.900640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c947efa4-0364-4e48-961c-064f0d1e6906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:33.936927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:33.937940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:33.938139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:33.938379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/1b9757e3f04c4ba9b2683f334b3f0347` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:33.939949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1b9757e3f04c4ba9b2683f334b3f0347)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:33.941659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:34.017046 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2759/5525] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:33 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:01:34.028838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947efa4-0364-4e48-961c-064f0d1e6906 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:34.029484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role 1b9757e3f04c4ba9b2683f334b3f0347 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:34.031306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.032819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c947efa4-0364-4e48-961c-064f0d1e6906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:34.033415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.038516 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2767/5526] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:33 2021] DELETE /identity/v3/roles/1b9757e3f04c4ba9b2683f334b3f0347 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:34.040303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:34.041887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:34.125584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947efa4-0364-4e48-961c-064f0d1e6906 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:34.149060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c94638-5fab-4fa6-b5d9-1bd706f7f514 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:34.156817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:34.158386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:34.158562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:34.158785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/roles/f045ae219dea4ab498e107dfea420b30` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:34.161600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f045ae219dea4ab498e107dfea420b30)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:34.163469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:34.202991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dae5dc-7dff-44db-a760-5f7d917395ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:34.204032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae5dc-7dff-44db-a760-5f7d917395ee service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:34.204240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae5dc-7dff-44db-a760-5f7d917395ee service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:34.204574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae5dc-7dff-44db-a760-5f7d917395ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:34.207816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-94dae5dc-7dff-44db-a760-5f7d917395ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:34.225863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invalidating the token cache because role f045ae219dea4ab498e107dfea420b30 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:34.227343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.228530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.232021 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2768/5527] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:34 2021] DELETE /identity/v3/roles/f045ae219dea4ab498e107dfea420b30 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:34.238523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:34.241057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:34.286871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dae5dc-7dff-44db-a760-5f7d917395ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:34.288535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dae5dc-7dff-44db-a760-5f7d917395ee service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:34.313007 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2760/5528] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:34 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:34.411051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357a307-b1e8-4022-84c1-c1480fc87310 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:34.418151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66157a99-fab6-4d72-90a5-f53583e06bd5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:34.420170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66157a99-fab6-4d72-90a5-f53583e06bd5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:34.420878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66157a99-fab6-4d72-90a5-f53583e06bd5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:34.421386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66157a99-fab6-4d72-90a5-f53583e06bd5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/users/e7e989184e244163b2ae6aeebf39814b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:34.423178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66157a99-fab6-4d72-90a5-f53583e06bd5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e7e989184e244163b2ae6aeebf39814b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:34.425883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66157a99-fab6-4d72-90a5-f53583e06bd5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:34.496613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-66157a99-fab6-4d72-90a5-f53583e06bd5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e989184e244163b2ae6aeebf39814b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.510018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-66157a99-fab6-4d72-90a5-f53583e06bd5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e989184e244163b2ae6aeebf39814b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.510647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-66157a99-fab6-4d72-90a5-f53583e06bd5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e989184e244163b2ae6aeebf39814b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.523837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-66157a99-fab6-4d72-90a5-f53583e06bd5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e989184e244163b2ae6aeebf39814b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.543987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-66157a99-fab6-4d72-90a5-f53583e06bd5 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e989184e244163b2ae6aeebf39814b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.560851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dae5dc-7dff-44db-a760-5f7d917395ee service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:34.562091 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2769/5529] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:34 2021] DELETE /identity/v3/users/e7e989184e244163b2ae6aeebf39814b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:34.577511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dae5dc-7dff-44db-a760-5f7d917395ee service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:34.668393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bbdf9-9edf-43de-9a79-d22db4e66527 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:34.672471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bbdf9-9edf-43de-9a79-d22db4e66527 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:34.672824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bbdf9-9edf-43de-9a79-d22db4e66527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:34.698669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36568976da1148d2835149ce648f715a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b30205455bd6404f8449b9a8f6735ca6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:34.699576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:34.699866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:34.700221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] PATH_INFO: `/v3/projects/382a843721c54f47b20bbaf4b2f8b079` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:34.704853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorizing `identity:delete_project(project_id=382a843721c54f47b20bbaf4b2f8b079)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:34.706809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:34.750081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-308bbdf9-9edf-43de-9a79-d22db4e66527 None None] MFA Rules not processed for user `ab09c8b68a1545fb8733dd571bc9db4b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:34.758709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-308bbdf9-9edf-43de-9a79-d22db4e66527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:34.836068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382a843721c54f47b20bbaf4b2f8b079', 'request_id': 'req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.847161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382a843721c54f47b20bbaf4b2f8b079', 'request_id': 'req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.860506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382a843721c54f47b20bbaf4b2f8b079', 'request_id': 'req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.875087 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2770/5530] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:34 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:34.877387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7da14d-0c49-4385-b250-1b707c8895a8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:34.877778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7da14d-0c49-4385-b250-1b707c8895a8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:34.878081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7da14d-0c49-4385-b250-1b707c8895a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:34.892783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] The token cache is being invalidate because project 382a843721c54f47b20bbaf4b2f8b079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:34.892783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.894233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:34.897420 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2761/5531] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:34 2021] DELETE /identity/v3/projects/382a843721c54f47b20bbaf4b2f8b079 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:34.902739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:34.908123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:34.919427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3e7da14d-0c49-4385-b250-1b707c8895a8 None None] MFA Rules not processed for user `ab09c8b68a1545fb8733dd571bc9db4b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:34.924878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3e7da14d-0c49-4385-b250-1b707c8895a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:35.043295 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2771/5532] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:34 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:35.063154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7da14d-0c49-4385-b250-1b707c8895a8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:35.064978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3e7da14d-0c49-4385-b250-1b707c8895a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:35.081285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8663cfc-1e7b-48ac-9e15-ed0500a717e3 tempest-TrustsV3TestJSON-936426575 tempest-TrustsV3TestJSON-936426575-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:35.089601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:35.090011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:35.090496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:35.090727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] PATH_INFO: `/v3/users/fbd65b63d5e046dc9f75fb56fd96966c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:35.093447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd65b63d5e046dc9f75fb56fd96966c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:35.095425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:35.178066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd65b63d5e046dc9f75fb56fd96966c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:35.180266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd65b63d5e046dc9f75fb56fd96966c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:35.200826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7da14d-0c49-4385-b250-1b707c8895a8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:35.208078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734cfa-c445-4690-9009-1f890ab8c04d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:35.209440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734cfa-c445-4690-9009-1f890ab8c04d service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:35.209737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734cfa-c445-4690-9009-1f890ab8c04d service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:35.210117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734cfa-c445-4690-9009-1f890ab8c04d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:35.212249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6a734cfa-c445-4690-9009-1f890ab8c04d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:35.226426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734cfa-c445-4690-9009-1f890ab8c04d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:35.229604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734cfa-c445-4690-9009-1f890ab8c04d service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:35.233469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd65b63d5e046dc9f75fb56fd96966c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:35.235870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd65b63d5e046dc9f75fb56fd96966c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:35.247314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd65b63d5e046dc9f75fb56fd96966c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:35.263083 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2772/5533] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:35 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:01:35.275820 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2762/5534] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:34 2021] DELETE /identity/v3/users/fbd65b63d5e046dc9f75fb56fd96966c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:35.283205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9622-7228-424e-ad0b-07025438276c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:35.283677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9622-7228-424e-ad0b-07025438276c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:35.284060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9622-7228-424e-ad0b-07025438276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:35.307028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b65e9622-7228-424e-ad0b-07025438276c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:35.308455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b65e9622-7228-424e-ad0b-07025438276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:35.410610 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2773/5535] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:35.458286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:35.461483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:35.618678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd9ef9-2919-4c8a-b1a1-589fa79176f2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:35.626471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae8564-a0ad-48ac-8b26-fed52af93988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:35.627281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae8564-a0ad-48ac-8b26-fed52af93988 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:35.627720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae8564-a0ad-48ac-8b26-fed52af93988 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:35.628040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae8564-a0ad-48ac-8b26-fed52af93988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:35.645418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae8564-a0ad-48ac-8b26-fed52af93988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:35.647376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae8564-a0ad-48ac-8b26-fed52af93988 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:35.701538 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2763/5536] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:37.209118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e9622-7228-424e-ad0b-07025438276c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:37.212163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b65e9622-7228-424e-ad0b-07025438276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:37.240972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e9622-7228-424e-ad0b-07025438276c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:37.259980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:37.262464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:37.267799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:37.270573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] PATH_INFO: `/v3/projects/f7f01a7daa6048a1a1a5c840c014683d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:37.276251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f01a7daa6048a1a1a5c840c014683d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:37.292617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:37.482245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f01a7daa6048a1a1a5c840c014683d', 'request_id': 'req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:37.497533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f01a7daa6048a1a1a5c840c014683d', 'request_id': 'req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:37.519062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f01a7daa6048a1a1a5c840c014683d', 'request_id': 'req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:37.550828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] The token cache is being invalidate because project f7f01a7daa6048a1a1a5c840c014683d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:37.552447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:37.554429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:37.564151 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2774/5537] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:37 2021] DELETE /identity/v3/projects/f7f01a7daa6048a1a1a5c840c014683d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:37.569628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae8564-a0ad-48ac-8b26-fed52af93988 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:37.590456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae8564-a0ad-48ac-8b26-fed52af93988 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:37.711989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:37.713251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:37.727374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:37.728061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] PATH_INFO: `/v3/users/36568976da1148d2835149ce648f715a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:37.730524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36568976da1148d2835149ce648f715a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:37.735761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:37.832598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36568976da1148d2835149ce648f715a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:37.833881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36568976da1148d2835149ce648f715a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:37.847788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36568976da1148d2835149ce648f715a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:37.849398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36568976da1148d2835149ce648f715a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:37.866295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36568976da1148d2835149ce648f715a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:37.892026 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2764/5538] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:37 2021] DELETE /identity/v3/users/36568976da1148d2835149ce648f715a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:38.523640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:38.525409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:38.539942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c37d49-b77d-4001-aa7b-ffce7a32d8a3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:38.622954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:38.626063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:38.692255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03f52e-c929-4612-b5f7-968a140ace89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:38.693149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03f52e-c929-4612-b5f7-968a140ace89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:38.693429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03f52e-c929-4612-b5f7-968a140ace89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:38.693702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03f52e-c929-4612-b5f7-968a140ace89 admin admin] PATH_INFO: `/v3/users/40318ccb06044be792566a1f518427ed` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:38.700033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03f52e-c929-4612-b5f7-968a140ace89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40318ccb06044be792566a1f518427ed)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:38.702190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03f52e-c929-4612-b5f7-968a140ace89 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:38.725486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277d949-9852-4012-98b5-d47746e51051 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:38.750211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:38.751812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:38.752882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:38.753538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] PATH_INFO: `/v3/projects/b30205455bd6404f8449b9a8f6735ca6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:38.761354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30205455bd6404f8449b9a8f6735ca6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:38.768525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:38.856727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4f03f52e-c929-4612-b5f7-968a140ace89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40318ccb06044be792566a1f518427ed'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:38.872465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4f03f52e-c929-4612-b5f7-968a140ace89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40318ccb06044be792566a1f518427ed'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:38.873579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4f03f52e-c929-4612-b5f7-968a140ace89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40318ccb06044be792566a1f518427ed'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:38.906585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30205455bd6404f8449b9a8f6735ca6', 'request_id': 'req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:38.906765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4f03f52e-c929-4612-b5f7-968a140ace89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40318ccb06044be792566a1f518427ed'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:38.916014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30205455bd6404f8449b9a8f6735ca6', 'request_id': 'req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:38.935783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30205455bd6404f8449b9a8f6735ca6', 'request_id': 'req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:38.954269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4f03f52e-c929-4612-b5f7-968a140ace89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40318ccb06044be792566a1f518427ed'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:38.960552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] The token cache is being invalidate because project b30205455bd6404f8449b9a8f6735ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:38.960850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:38.961491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4adc1d1d-1295-41e6-81fa-cc750d28b1e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:38.969653 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2765/5539] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:38 2021] DELETE /identity/v3/projects/b30205455bd6404f8449b9a8f6735ca6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:38.976882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d241d5-da8b-4643-b490-83674aae5bd0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:38.976882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d241d5-da8b-4643-b490-83674aae5bd0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:38.976882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d241d5-da8b-4643-b490-83674aae5bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:38.977257 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2775/5540] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:38 2021] DELETE /identity/v3/users/40318ccb06044be792566a1f518427ed => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:38.978309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a21ee-169a-4271-9fa7-7fb48fb99568 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:38.978599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a21ee-169a-4271-9fa7-7fb48fb99568 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:38.978872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a21ee-169a-4271-9fa7-7fb48fb99568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:39.010644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a1d241d5-da8b-4643-b490-83674aae5bd0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:39.012226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a1d241d5-da8b-4643-b490-83674aae5bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:39.027031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1e9a21ee-169a-4271-9fa7-7fb48fb99568 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:39.032082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1e9a21ee-169a-4271-9fa7-7fb48fb99568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:39.082228 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2766/5541] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:39.090158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57949620-7d04-47e1-a3c6-2ebbbacccbef None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:39.090490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57949620-7d04-47e1-a3c6-2ebbbacccbef None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:39.090885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57949620-7d04-47e1-a3c6-2ebbbacccbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:39.123067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-57949620-7d04-47e1-a3c6-2ebbbacccbef None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:39.126849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-57949620-7d04-47e1-a3c6-2ebbbacccbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:39.140996 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2776/5542] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:39.152078 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2767/5543] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:01:39.153982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a21ee-169a-4271-9fa7-7fb48fb99568 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:39.156785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57949620-7d04-47e1-a3c6-2ebbbacccbef None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:39.158479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-57949620-7d04-47e1-a3c6-2ebbbacccbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:39.172718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a21ee-169a-4271-9fa7-7fb48fb99568 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:39.183067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc65b6-aab0-4700-b5e9-1c1a836fbee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:39.184806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc65b6-aab0-4700-b5e9-1c1a836fbee1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:39.185575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc65b6-aab0-4700-b5e9-1c1a836fbee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:39.208275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc65b6-aab0-4700-b5e9-1c1a836fbee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:39.212359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc65b6-aab0-4700-b5e9-1c1a836fbee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:39.213612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc65b6-aab0-4700-b5e9-1c1a836fbee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:39.218026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc65b6-aab0-4700-b5e9-1c1a836fbee1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:39.266248 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2777/5544] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:39.267476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc65b6-aab0-4700-b5e9-1c1a836fbee1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:39.287960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc65b6-aab0-4700-b5e9-1c1a836fbee1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:39.296874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6cbd4-6a7d-4658-be8c-8f81f739ae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:39.299043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6cbd4-6a7d-4658-be8c-8f81f739ae61 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:39.299829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6cbd4-6a7d-4658-be8c-8f81f739ae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:39.300339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6cbd4-6a7d-4658-be8c-8f81f739ae61 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:39.302590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6cbd4-6a7d-4658-be8c-8f81f739ae61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:39.305295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57949620-7d04-47e1-a3c6-2ebbbacccbef None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:39.305571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6cbd4-6a7d-4658-be8c-8f81f739ae61 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:39.331495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e02e0-b2b2-4d95-9964-b96b365f40c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:39.331648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e02e0-b2b2-4d95-9964-b96b365f40c5 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:39.331978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e02e0-b2b2-4d95-9964-b96b365f40c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:39.332112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e02e0-b2b2-4d95-9964-b96b365f40c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:39.347469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e02e0-b2b2-4d95-9964-b96b365f40c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:39.348948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e02e0-b2b2-4d95-9964-b96b365f40c5 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:39.363093 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2768/5545] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:01:39.402226 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2778/5546] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:39 2021] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:39.408606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e02e0-b2b2-4d95-9964-b96b365f40c5 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:39.426021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e02e0-b2b2-4d95-9964-b96b365f40c5 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:39.560367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959cf9-f5aa-49cf-81bc-440d919f1b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:39.562055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959cf9-f5aa-49cf-81bc-440d919f1b3f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:39.562611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959cf9-f5aa-49cf-81bc-440d919f1b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:39.564615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959cf9-f5aa-49cf-81bc-440d919f1b3f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:39.565283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959cf9-f5aa-49cf-81bc-440d919f1b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:39.567711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959cf9-f5aa-49cf-81bc-440d919f1b3f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:39.612617 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2769/5547] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:39 2021] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:39.612847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6cbd4-6a7d-4658-be8c-8f81f739ae61 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:39.630123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6cbd4-6a7d-4658-be8c-8f81f739ae61 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:39.636682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33307249-7439-4576-bc02-642c0a35a548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:39.637499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33307249-7439-4576-bc02-642c0a35a548 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:39.637846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33307249-7439-4576-bc02-642c0a35a548 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:39.638185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33307249-7439-4576-bc02-642c0a35a548 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:39.639652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33307249-7439-4576-bc02-642c0a35a548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:39.641464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33307249-7439-4576-bc02-642c0a35a548 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:39.663559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959cf9-f5aa-49cf-81bc-440d919f1b3f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:39.664923 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2779/5548] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:39 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:01:39.689464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959cf9-f5aa-49cf-81bc-440d919f1b3f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:39.695535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3656e-3e3a-4158-8523-10cd142e35ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:39.696287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3656e-3e3a-4158-8523-10cd142e35ff admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:39.697044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3656e-3e3a-4158-8523-10cd142e35ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:39.697379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3656e-3e3a-4158-8523-10cd142e35ff admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:39.698349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3656e-3e3a-4158-8523-10cd142e35ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:39.701088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3656e-3e3a-4158-8523-10cd142e35ff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:39.722664 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2770/5549] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:39 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:39.727153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33307249-7439-4576-bc02-642c0a35a548 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:39.744450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33307249-7439-4576-bc02-642c0a35a548 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:39.758380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb48308-2079-41c2-b4f6-549f3791ee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:39.760550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48308-2079-41c2-b4f6-549f3791ee6f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:39.760990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48308-2079-41c2-b4f6-549f3791ee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:39.761856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb48308-2079-41c2-b4f6-549f3791ee6f admin admin] PATH_INFO: `/v3/projects/997971373f33420cba3c351386c093aa/users/998eb0fa0b804e3881a68bc68cd6e7fc/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:39.838801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb48308-2079-41c2-b4f6-549f3791ee6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=997971373f33420cba3c351386c093aa, user_id=998eb0fa0b804e3881a68bc68cd6e7fc, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:39.845211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb48308-2079-41c2-b4f6-549f3791ee6f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:39.874210 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2780/5550] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:39 2021] PUT /identity/v3/projects/997971373f33420cba3c351386c093aa/users/998eb0fa0b804e3881a68bc68cd6e7fc/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:39.886063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f728-152d-4c62-b8f4-c343fa85c225 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:39.886493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f728-152d-4c62-b8f4-c343fa85c225 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:39.886826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f728-152d-4c62-b8f4-c343fa85c225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:39.937150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e6a0f728-152d-4c62-b8f4-c343fa85c225 None None] MFA Rules not processed for user `998eb0fa0b804e3881a68bc68cd6e7fc`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:39.941623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e6a0f728-152d-4c62-b8f4-c343fa85c225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:39.991005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb48308-2079-41c2-b4f6-549f3791ee6f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:39.993717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fcb48308-2079-41c2-b4f6-549f3791ee6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:40.054557 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2771/5551] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:39 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:40.060144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f728-152d-4c62-b8f4-c343fa85c225 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:40.070686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f728-152d-4c62-b8f4-c343fa85c225 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:40.077371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d3a5d-db96-4952-b329-0151a9193f86 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998eb0fa0b804e3881a68bc68cd6e7fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '997971373f33420cba3c351386c093aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:40.079656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d3a5d-db96-4952-b329-0151a9193f86 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:40.080025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d3a5d-db96-4952-b329-0151a9193f86 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:40.080378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d3a5d-db96-4952-b329-0151a9193f86 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] PATH_INFO: `/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/application_credentials` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:40.081241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d3a5d-db96-4952-b329-0151a9193f86 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorizing `identity:create_application_credential(user_id=998eb0fa0b804e3881a68bc68cd6e7fc)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:40.083423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d3a5d-db96-4952-b329-0151a9193f86 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:40.244643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb48308-2079-41c2-b4f6-549f3791ee6f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:40.262096 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2772/5552] 10.222.0.21 () {60 vars in 1314 bytes} [Sat Nov 27 21:01:40 2021] POST /identity/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/application_credentials => generated 921 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:40.268204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d3a5d-db96-4952-b329-0151a9193f86 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:40.268572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:40.273828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:40.289239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:40.290085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] PATH_INFO: `/v3/projects/58285bdf2f7f42828b92f58257662c9e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:40.291360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d3a5d-db96-4952-b329-0151a9193f86 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:40.296781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58285bdf2f7f42828b92f58257662c9e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:40.306530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:40.309060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eff4d-070e-44f2-b304-60eac0335961 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998eb0fa0b804e3881a68bc68cd6e7fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '997971373f33420cba3c351386c093aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:40.315396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eff4d-070e-44f2-b304-60eac0335961 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:40.316837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eff4d-070e-44f2-b304-60eac0335961 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:40.319165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eff4d-070e-44f2-b304-60eac0335961 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] PATH_INFO: `/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules/af3f01f7f58a4f6ba22cd5fe73ae2cde` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:40.325231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284eff4d-070e-44f2-b304-60eac0335961 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorizing `identity:delete_access_rule(user_id=998eb0fa0b804e3881a68bc68cd6e7fc, access_rule_id=af3f01f7f58a4f6ba22cd5fe73ae2cde)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:40.333742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284eff4d-070e-44f2-b304-60eac0335961 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:40.486210 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-284eff4d-070e-44f2-b304-60eac0335961 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Nov 27 21:01:40.490847 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2773/5553] 10.222.0.21 () {58 vars in 1361 bytes} [Sat Nov 27 21:01:40 2021] DELETE /identity/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules/af3f01f7f58a4f6ba22cd5fe73ae2cde => generated 89 bytes in 221 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Nov 27 21:01:40.492679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eff4d-070e-44f2-b304-60eac0335961 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:40.512622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58285bdf2f7f42828b92f58257662c9e', 'request_id': 'req-8090c07f-0884-4a30-917a-1d8df0035bd8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:40.564779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eff4d-070e-44f2-b304-60eac0335961 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:40.570969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58285bdf2f7f42828b92f58257662c9e', 'request_id': 'req-8090c07f-0884-4a30-917a-1d8df0035bd8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:40.609996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58285bdf2f7f42828b92f58257662c9e', 'request_id': 'req-8090c07f-0884-4a30-917a-1d8df0035bd8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:40.648226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] The token cache is being invalidate because project 58285bdf2f7f42828b92f58257662c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:40.648921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:40.649355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:40.657334 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2781/5554] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:39 2021] DELETE /identity/v3/projects/58285bdf2f7f42828b92f58257662c9e => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:41.080740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef347-7f42-4c3b-96c4-d51a26a3a9e3 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998eb0fa0b804e3881a68bc68cd6e7fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '997971373f33420cba3c351386c093aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:41.084289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef347-7f42-4c3b-96c4-d51a26a3a9e3 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:41.084748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef347-7f42-4c3b-96c4-d51a26a3a9e3 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:41.085321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef347-7f42-4c3b-96c4-d51a26a3a9e3 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] PATH_INFO: `/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/application_credentials/8da0f694f0a84bdf8435b0a538256cde` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:41.121350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef347-7f42-4c3b-96c4-d51a26a3a9e3 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorizing `identity:delete_application_credential(user_id=998eb0fa0b804e3881a68bc68cd6e7fc, application_credential_id=8da0f694f0a84bdf8435b0a538256cde)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:41.126264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcef347-7f42-4c3b-96c4-d51a26a3a9e3 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:41.180849 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2774/5555] 10.222.0.21 () {58 vars in 1394 bytes} [Sat Nov 27 21:01:40 2021] DELETE /identity/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/application_credentials/8da0f694f0a84bdf8435b0a538256cde => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:41.184999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:41.187894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:41.207419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090c07f-0884-4a30-917a-1d8df0035bd8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:41.214188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f1f88-e70f-4fc1-a0cb-838023802376 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998eb0fa0b804e3881a68bc68cd6e7fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '997971373f33420cba3c351386c093aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:41.214832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1f88-e70f-4fc1-a0cb-838023802376 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:41.215121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1f88-e70f-4fc1-a0cb-838023802376 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:41.215475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1f88-e70f-4fc1-a0cb-838023802376 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] PATH_INFO: `/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:41.217110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f1f88-e70f-4fc1-a0cb-838023802376 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorizing `identity:list_access_rules(user_id=998eb0fa0b804e3881a68bc68cd6e7fc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:41.218606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f1f88-e70f-4fc1-a0cb-838023802376 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:41.225270 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2782/5556] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 21:01:41 2021] GET /identity/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules => generated 369 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:41.229347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef347-7f42-4c3b-96c4-d51a26a3a9e3 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:41.240680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcef347-7f42-4c3b-96c4-d51a26a3a9e3 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:41.246592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01137734-eef1-406f-b8fe-91a68811e13f tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998eb0fa0b804e3881a68bc68cd6e7fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '997971373f33420cba3c351386c093aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:41.247959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01137734-eef1-406f-b8fe-91a68811e13f tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:41.248839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01137734-eef1-406f-b8fe-91a68811e13f tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:41.249140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01137734-eef1-406f-b8fe-91a68811e13f tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] PATH_INFO: `/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules/af3f01f7f58a4f6ba22cd5fe73ae2cde` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:41.250562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01137734-eef1-406f-b8fe-91a68811e13f tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorizing `identity:delete_access_rule(user_id=998eb0fa0b804e3881a68bc68cd6e7fc, access_rule_id=af3f01f7f58a4f6ba22cd5fe73ae2cde)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:41.253128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01137734-eef1-406f-b8fe-91a68811e13f tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:41.281718 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2775/5557] 10.222.0.21 () {58 vars in 1361 bytes} [Sat Nov 27 21:01:41 2021] DELETE /identity/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules/af3f01f7f58a4f6ba22cd5fe73ae2cde => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:41.286164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f1f88-e70f-4fc1-a0cb-838023802376 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:41.298911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f1f88-e70f-4fc1-a0cb-838023802376 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:41.307428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8f80f-99ab-45fa-9801-1ea437e49293 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998eb0fa0b804e3881a68bc68cd6e7fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '997971373f33420cba3c351386c093aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:41.308302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8f80f-99ab-45fa-9801-1ea437e49293 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:41.309082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8f80f-99ab-45fa-9801-1ea437e49293 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:41.309270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8f80f-99ab-45fa-9801-1ea437e49293 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] PATH_INFO: `/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:41.310569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8f80f-99ab-45fa-9801-1ea437e49293 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorizing `identity:list_access_rules(user_id=998eb0fa0b804e3881a68bc68cd6e7fc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:41.312788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8f80f-99ab-45fa-9801-1ea437e49293 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:41.322505 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2783/5558] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 21:01:41 2021] GET /identity/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules => generated 158 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:41.323652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01137734-eef1-406f-b8fe-91a68811e13f tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:41.335122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01137734-eef1-406f-b8fe-91a68811e13f tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:41.340328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae805642-a979-42ac-82c1-ffb97cf2bf37 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998eb0fa0b804e3881a68bc68cd6e7fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '997971373f33420cba3c351386c093aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:41.341234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae805642-a979-42ac-82c1-ffb97cf2bf37 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:41.341771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae805642-a979-42ac-82c1-ffb97cf2bf37 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:41.342084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae805642-a979-42ac-82c1-ffb97cf2bf37 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] PATH_INFO: `/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/application_credentials` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:41.342852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae805642-a979-42ac-82c1-ffb97cf2bf37 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorizing `identity:create_application_credential(user_id=998eb0fa0b804e3881a68bc68cd6e7fc)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:41.344054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae805642-a979-42ac-82c1-ffb97cf2bf37 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:41.447292 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2776/5559] 10.222.0.21 () {60 vars in 1314 bytes} [Sat Nov 27 21:01:41 2021] POST /identity/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/application_credentials => generated 921 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:41.448926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8f80f-99ab-45fa-9801-1ea437e49293 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:41.461265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8f80f-99ab-45fa-9801-1ea437e49293 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:41.466633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fefb4-e793-47b0-bd7d-a3a2e782b4da tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998eb0fa0b804e3881a68bc68cd6e7fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '997971373f33420cba3c351386c093aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:41.467858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fefb4-e793-47b0-bd7d-a3a2e782b4da tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:41.468220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fefb4-e793-47b0-bd7d-a3a2e782b4da tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:41.468694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fefb4-e793-47b0-bd7d-a3a2e782b4da tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] PATH_INFO: `/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:41.470769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fefb4-e793-47b0-bd7d-a3a2e782b4da tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorizing `identity:list_access_rules(user_id=998eb0fa0b804e3881a68bc68cd6e7fc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:41.472046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fefb4-e793-47b0-bd7d-a3a2e782b4da tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:41.479307 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2784/5560] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 21:01:41 2021] GET /identity/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules => generated 369 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:41.484690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae805642-a979-42ac-82c1-ffb97cf2bf37 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:41.499565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae805642-a979-42ac-82c1-ffb97cf2bf37 tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:41.506309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23538c-55c4-413d-9578-99ac60a8fb8a tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998eb0fa0b804e3881a68bc68cd6e7fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '997971373f33420cba3c351386c093aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:41.507703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23538c-55c4-413d-9578-99ac60a8fb8a tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:41.508432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23538c-55c4-413d-9578-99ac60a8fb8a tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:41.508962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23538c-55c4-413d-9578-99ac60a8fb8a tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] PATH_INFO: `/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/application_credentials` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:41.510014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23538c-55c4-413d-9578-99ac60a8fb8a tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorizing `identity:create_application_credential(user_id=998eb0fa0b804e3881a68bc68cd6e7fc)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:41.511819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23538c-55c4-413d-9578-99ac60a8fb8a tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:41.634356 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2777/5561] 10.222.0.21 () {60 vars in 1314 bytes} [Sat Nov 27 21:01:41 2021] POST /identity/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/application_credentials => generated 921 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:41.635710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fefb4-e793-47b0-bd7d-a3a2e782b4da tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:41.648164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fefb4-e793-47b0-bd7d-a3a2e782b4da tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:41.662977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad6bca-27ff-42a0-a1bf-850ffcad6f2c tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '998eb0fa0b804e3881a68bc68cd6e7fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '997971373f33420cba3c351386c093aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:41.665441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6bca-27ff-42a0-a1bf-850ffcad6f2c tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:41.666588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6bca-27ff-42a0-a1bf-850ffcad6f2c tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:41.667476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6bca-27ff-42a0-a1bf-850ffcad6f2c tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] PATH_INFO: `/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules/147af70932994c71a79f65938060ecd6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:41.671337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad6bca-27ff-42a0-a1bf-850ffcad6f2c tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorizing `identity:get_access_rule(user_id=998eb0fa0b804e3881a68bc68cd6e7fc, access_rule_id=147af70932994c71a79f65938060ecd6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:41.674512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad6bca-27ff-42a0-a1bf-850ffcad6f2c tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:41.694021 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2785/5562] 10.222.0.21 () {58 vars in 1358 bytes} [Sat Nov 27 21:01:41 2021] GET /identity/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc/access_rules/147af70932994c71a79f65938060ecd6 => generated 229 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:41.694287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23538c-55c4-413d-9578-99ac60a8fb8a tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:41.696175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7f23538c-55c4-413d-9578-99ac60a8fb8a tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:41.819489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23538c-55c4-413d-9578-99ac60a8fb8a tempest-AccessRulesV3Test-1583538748 tempest-AccessRulesV3Test-1583538748-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:41.826214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:41.827676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:41.828116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:41.828600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] PATH_INFO: `/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:41.829865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=998eb0fa0b804e3881a68bc68cd6e7fc)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:41.831843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:41.926911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998eb0fa0b804e3881a68bc68cd6e7fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:41.928127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998eb0fa0b804e3881a68bc68cd6e7fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:41.941571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998eb0fa0b804e3881a68bc68cd6e7fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:41.944136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998eb0fa0b804e3881a68bc68cd6e7fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:41.955893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998eb0fa0b804e3881a68bc68cd6e7fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:42.053567 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2778/5563] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:41 2021] DELETE /identity/v3/users/998eb0fa0b804e3881a68bc68cd6e7fc => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:42.057952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22922957-9be4-4be4-a0de-70c72d5b8df0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:42.058702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22922957-9be4-4be4-a0de-70c72d5b8df0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:42.059568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22922957-9be4-4be4-a0de-70c72d5b8df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:42.099509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-22922957-9be4-4be4-a0de-70c72d5b8df0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:42.101043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-22922957-9be4-4be4-a0de-70c72d5b8df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:42.248882 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2786/5564] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:01:42.305118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:42.306802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:42.457519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0be93-a5fd-49b7-8aee-96e6fc926561 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:42.462431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46697bb5-c02e-490b-a97d-dd6cb91da7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:42.463049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46697bb5-c02e-490b-a97d-dd6cb91da7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:42.463360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46697bb5-c02e-490b-a97d-dd6cb91da7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:42.463635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46697bb5-c02e-490b-a97d-dd6cb91da7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:42.475627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46697bb5-c02e-490b-a97d-dd6cb91da7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:42.476925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46697bb5-c02e-490b-a97d-dd6cb91da7e1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:42.488735 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2779/5565] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:01:43.736831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22922957-9be4-4be4-a0de-70c72d5b8df0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:43.738984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-22922957-9be4-4be4-a0de-70c72d5b8df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:43.755824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22922957-9be4-4be4-a0de-70c72d5b8df0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:43.782074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:43.783229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:43.783763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:43.784258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] PATH_INFO: `/v3/projects/997971373f33420cba3c351386c093aa` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:43.785947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=997971373f33420cba3c351386c093aa)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:43.790164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:43.950592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '997971373f33420cba3c351386c093aa', 'request_id': 'req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:43.978935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '997971373f33420cba3c351386c093aa', 'request_id': 'req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:43.986263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '997971373f33420cba3c351386c093aa', 'request_id': 'req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:44.049545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] The token cache is being invalidate because project 997971373f33420cba3c351386c093aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:44.049841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:44.072274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5c4b8e69-bbfa-409e-bfac-d39eaa7af878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:44.087624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd86e-9052-4595-9331-bc0ed07bb2b4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:44.089864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd86e-9052-4595-9331-bc0ed07bb2b4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:44.090015 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2787/5566] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:43 2021] DELETE /identity/v3/projects/997971373f33420cba3c351386c093aa => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:44.090158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd86e-9052-4595-9331-bc0ed07bb2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:44.148448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-880dd86e-9052-4595-9331-bc0ed07bb2b4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:44.150151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-880dd86e-9052-4595-9331-bc0ed07bb2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:44.258283 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2780/5567] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:44.270289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea059aa6-2868-444c-a1ce-cca8b2a56e17 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:44.270701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea059aa6-2868-444c-a1ce-cca8b2a56e17 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:44.271063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea059aa6-2868-444c-a1ce-cca8b2a56e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:44.311988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ea059aa6-2868-444c-a1ce-cca8b2a56e17 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:44.313479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ea059aa6-2868-444c-a1ce-cca8b2a56e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:44.334506 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2788/5568] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:44.340278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dd86e-9052-4595-9331-bc0ed07bb2b4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:44.366011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dd86e-9052-4595-9331-bc0ed07bb2b4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:44.377931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d115d-b54b-44d6-a5a4-32bc7e96a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:44.378817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d115d-b54b-44d6-a5a4-32bc7e96a425 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:44.380312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d115d-b54b-44d6-a5a4-32bc7e96a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:44.380312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d115d-b54b-44d6-a5a4-32bc7e96a425 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:44.380312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d115d-b54b-44d6-a5a4-32bc7e96a425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:44.380743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d115d-b54b-44d6-a5a4-32bc7e96a425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:44.382533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d115d-b54b-44d6-a5a4-32bc7e96a425 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:44.398715 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2781/5569] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:44.403938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea059aa6-2868-444c-a1ce-cca8b2a56e17 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:44.426259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea059aa6-2868-444c-a1ce-cca8b2a56e17 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:44.434359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d46af8-11f3-4956-9578-8d1acb6daa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:44.435381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d46af8-11f3-4956-9578-8d1acb6daa87 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:44.435750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d46af8-11f3-4956-9578-8d1acb6daa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:44.436019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d46af8-11f3-4956-9578-8d1acb6daa87 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:44.436924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d46af8-11f3-4956-9578-8d1acb6daa87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:44.441666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d46af8-11f3-4956-9578-8d1acb6daa87 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:44.494705 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2789/5570] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:44 2021] POST /identity/v3/projects => generated 395 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:44.496872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d115d-b54b-44d6-a5a4-32bc7e96a425 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:44.512171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d115d-b54b-44d6-a5a4-32bc7e96a425 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:44.612542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c492d-16f1-4f84-a843-4c5309675f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:44.613169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c492d-16f1-4f84-a843-4c5309675f27 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:44.614759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c492d-16f1-4f84-a843-4c5309675f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:44.617894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c492d-16f1-4f84-a843-4c5309675f27 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:44.619107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c492d-16f1-4f84-a843-4c5309675f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:44.626264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c492d-16f1-4f84-a843-4c5309675f27 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:44.659291 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2782/5571] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:44 2021] POST /identity/v3/users => generated 304 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:44.662986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d46af8-11f3-4956-9578-8d1acb6daa87 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:44.715061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d46af8-11f3-4956-9578-8d1acb6daa87 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:44.726350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f442867-8ecf-41bd-8331-823fd0e9c225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:44.727398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f442867-8ecf-41bd-8331-823fd0e9c225 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:44.727998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f442867-8ecf-41bd-8331-823fd0e9c225 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:44.728531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f442867-8ecf-41bd-8331-823fd0e9c225 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:44.731129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f442867-8ecf-41bd-8331-823fd0e9c225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:44.735396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f442867-8ecf-41bd-8331-823fd0e9c225 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:44.752818 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2790/5572] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:44 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:44.757075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c492d-16f1-4f84-a843-4c5309675f27 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:44.775186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c492d-16f1-4f84-a843-4c5309675f27 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:44.783690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794a53-b0e9-4cf2-b96f-717b608c2387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:44.785300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794a53-b0e9-4cf2-b96f-717b608c2387 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:44.785949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794a53-b0e9-4cf2-b96f-717b608c2387 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:44.786881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa794a53-b0e9-4cf2-b96f-717b608c2387 admin admin] PATH_INFO: `/v3/projects/25538cb462f746cea1d0b9f40856a309/users/c6e60d8667e74c41be6982e1c4d567ae/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:44.809914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa794a53-b0e9-4cf2-b96f-717b608c2387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25538cb462f746cea1d0b9f40856a309, user_id=c6e60d8667e74c41be6982e1c4d567ae, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:44.816207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa794a53-b0e9-4cf2-b96f-717b608c2387 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:44.851971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f442867-8ecf-41bd-8331-823fd0e9c225 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:44.852466 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2783/5573] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:44 2021] PUT /identity/v3/projects/25538cb462f746cea1d0b9f40856a309/users/c6e60d8667e74c41be6982e1c4d567ae/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:44.865058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f442867-8ecf-41bd-8331-823fd0e9c225 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:44.968894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210bfa7-3397-4a75-83c5-539b8b444f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:44.969509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210bfa7-3397-4a75-83c5-539b8b444f0a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:44.969934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210bfa7-3397-4a75-83c5-539b8b444f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:44.970537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210bfa7-3397-4a75-83c5-539b8b444f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:44.972498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210bfa7-3397-4a75-83c5-539b8b444f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:44.975328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210bfa7-3397-4a75-83c5-539b8b444f0a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:44.988899 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2791/5574] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:44 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:01:44.993472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794a53-b0e9-4cf2-b96f-717b608c2387 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:45.019498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa794a53-b0e9-4cf2-b96f-717b608c2387 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:45.031459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9aa2b9-e172-44bf-bf05-361c2c0d840b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:45.034324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aa2b9-e172-44bf-bf05-361c2c0d840b admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:45.034875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aa2b9-e172-44bf-bf05-361c2c0d840b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:45.036634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aa2b9-e172-44bf-bf05-361c2c0d840b admin admin] PATH_INFO: `/v3/projects/25538cb462f746cea1d0b9f40856a309/users/c6e60d8667e74c41be6982e1c4d567ae/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:45.043009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9aa2b9-e172-44bf-bf05-361c2c0d840b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25538cb462f746cea1d0b9f40856a309, user_id=c6e60d8667e74c41be6982e1c4d567ae, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:45.050700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9aa2b9-e172-44bf-bf05-361c2c0d840b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:45.078925 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2784/5575] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:44 2021] PUT /identity/v3/projects/25538cb462f746cea1d0b9f40856a309/users/c6e60d8667e74c41be6982e1c4d567ae/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:45.081755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ced5e-c25d-4471-8906-15ace403674c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:45.082262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ced5e-c25d-4471-8906-15ace403674c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:45.083118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ced5e-c25d-4471-8906-15ace403674c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:45.158444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-030ced5e-c25d-4471-8906-15ace403674c None None] MFA Rules not processed for user `c6e60d8667e74c41be6982e1c4d567ae`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:45.159893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-030ced5e-c25d-4471-8906-15ace403674c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:45.355517 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2792/5576] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:45 2021] POST /identity/v3/auth/tokens => generated 3329 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:45.361561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9aa2b9-e172-44bf-bf05-361c2c0d840b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:45.478550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9aa2b9-e172-44bf-bf05-361c2c0d840b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:45.485319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c88eb-73ca-4b45-aaca-d6f41eb042cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:45.486180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c88eb-73ca-4b45-aaca-d6f41eb042cf admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:45.486572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c88eb-73ca-4b45-aaca-d6f41eb042cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:45.487007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c88eb-73ca-4b45-aaca-d6f41eb042cf admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:45.487821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c88eb-73ca-4b45-aaca-d6f41eb042cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:45.490635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c88eb-73ca-4b45-aaca-d6f41eb042cf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:45.549383 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2785/5577] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:45 2021] POST /identity/v3/projects => generated 395 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:45.550667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ced5e-c25d-4471-8906-15ace403674c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:45.563448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ced5e-c25d-4471-8906-15ace403674c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:45.649685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c75cf-96af-4d5c-91fd-3574ea65cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:45.650695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c75cf-96af-4d5c-91fd-3574ea65cb59 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:45.651094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c75cf-96af-4d5c-91fd-3574ea65cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:45.651521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c75cf-96af-4d5c-91fd-3574ea65cb59 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:45.655506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c75cf-96af-4d5c-91fd-3574ea65cb59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:45.657867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c75cf-96af-4d5c-91fd-3574ea65cb59 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:45.707719 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2793/5578] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:45 2021] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:45.711809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c88eb-73ca-4b45-aaca-d6f41eb042cf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:45.727340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c88eb-73ca-4b45-aaca-d6f41eb042cf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:45.750076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f12b1-c86d-4ec7-8c45-f018e000c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:45.751136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f12b1-c86d-4ec7-8c45-f018e000c748 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:45.752289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f12b1-c86d-4ec7-8c45-f018e000c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:45.752675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f12b1-c86d-4ec7-8c45-f018e000c748 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:45.753900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f12b1-c86d-4ec7-8c45-f018e000c748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:45.756138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f12b1-c86d-4ec7-8c45-f018e000c748 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:45.776485 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2786/5579] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:45 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:45.781346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c75cf-96af-4d5c-91fd-3574ea65cb59 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:45.797991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c75cf-96af-4d5c-91fd-3574ea65cb59 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:45.808603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3fa74-7753-438f-b675-68f4477611d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:45.809548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3fa74-7753-438f-b675-68f4477611d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:45.809914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3fa74-7753-438f-b675-68f4477611d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:45.810977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3fa74-7753-438f-b675-68f4477611d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:45.811869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3fa74-7753-438f-b675-68f4477611d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:45.815410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3fa74-7753-438f-b675-68f4477611d8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:45.840091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f12b1-c86d-4ec7-8c45-f018e000c748 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:45.848575 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2794/5580] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:45 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:45.854231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f12b1-c86d-4ec7-8c45-f018e000c748 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:45.863362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf794-56cb-48a6-9c7a-ce4805e137cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:45.864528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf794-56cb-48a6-9c7a-ce4805e137cc admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:45.865191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf794-56cb-48a6-9c7a-ce4805e137cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:45.865670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf794-56cb-48a6-9c7a-ce4805e137cc admin admin] PATH_INFO: `/v3/projects/1d86d74a469744a0a1bbfa0fae8af188/users/5c2733c5fa1047dd8a86ab8db212eae8/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:45.885611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bf794-56cb-48a6-9c7a-ce4805e137cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d86d74a469744a0a1bbfa0fae8af188, user_id=5c2733c5fa1047dd8a86ab8db212eae8, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:45.890560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bf794-56cb-48a6-9c7a-ce4805e137cc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:45.923216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8410-3132-4cee-8b9c-770a42d419d1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:45.924999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8410-3132-4cee-8b9c-770a42d419d1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:45.925508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc8410-3132-4cee-8b9c-770a42d419d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:45.927619 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2787/5581] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:45 2021] PUT /identity/v3/projects/1d86d74a469744a0a1bbfa0fae8af188/users/5c2733c5fa1047dd8a86ab8db212eae8/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:45.965061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2dbc8410-3132-4cee-8b9c-770a42d419d1 None None] MFA Rules not processed for user `5c2733c5fa1047dd8a86ab8db212eae8`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:45.966722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2dbc8410-3132-4cee-8b9c-770a42d419d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:46.088092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf794-56cb-48a6-9c7a-ce4805e137cc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:46.090787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2d7bf794-56cb-48a6-9c7a-ce4805e137cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:46.100204 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2795/5582] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:45 2021] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:46.181122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf794-56cb-48a6-9c7a-ce4805e137cc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:46.186313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b7e79-619e-4079-98e8-a9399000b310 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:46.186978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b7e79-619e-4079-98e8-a9399000b310 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:46.187384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b7e79-619e-4079-98e8-a9399000b310 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:46.187667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b7e79-619e-4079-98e8-a9399000b310 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:46.264513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b7e79-619e-4079-98e8-a9399000b310 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:46.266028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b7e79-619e-4079-98e8-a9399000b310 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:46.282491 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2788/5583] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:46 2021] GET /identity/v3/auth/tokens => generated 3329 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:46.345586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc8410-3132-4cee-8b9c-770a42d419d1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:46.347410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2dbc8410-3132-4cee-8b9c-770a42d419d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:46.583208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc8410-3132-4cee-8b9c-770a42d419d1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:46.591025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d2ad9-bf81-4aae-86b2-34d02b1a3c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:46.592501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2ad9-bf81-4aae-86b2-34d02b1a3c3f service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:46.593258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2ad9-bf81-4aae-86b2-34d02b1a3c3f service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:46.593764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2ad9-bf81-4aae-86b2-34d02b1a3c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:46.595858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-151d2ad9-bf81-4aae-86b2-34d02b1a3c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:46.683062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d2ad9-bf81-4aae-86b2-34d02b1a3c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:46.685197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d2ad9-bf81-4aae-86b2-34d02b1a3c3f service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:46.722909 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2796/5584] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:46 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:46.879278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b7e79-619e-4079-98e8-a9399000b310 service glance] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:46.966357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b7e79-619e-4079-98e8-a9399000b310 service glance] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:46.971181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:46.972693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:46.972693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:46.972899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] PATH_INFO: `/v3/users/c6e60d8667e74c41be6982e1c4d567ae` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:46.974279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e60d8667e74c41be6982e1c4d567ae)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:46.976119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:47.034081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e60d8667e74c41be6982e1c4d567ae'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:47.035021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e60d8667e74c41be6982e1c4d567ae'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:47.044624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e60d8667e74c41be6982e1c4d567ae'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:47.045396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e60d8667e74c41be6982e1c4d567ae'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:47.054674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e60d8667e74c41be6982e1c4d567ae'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:47.080756 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2789/5585] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:46 2021] DELETE /identity/v3/users/c6e60d8667e74c41be6982e1c4d567ae => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:47.082864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df736d97-33eb-49b6-8343-3be28d4493cf None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:47.083528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df736d97-33eb-49b6-8343-3be28d4493cf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:47.083528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df736d97-33eb-49b6-8343-3be28d4493cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:47.112307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-df736d97-33eb-49b6-8343-3be28d4493cf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:47.113715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-df736d97-33eb-49b6-8343-3be28d4493cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:47.219817 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2797/5586] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:47.229159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:47.230624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:47.349610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae012f30-b7ba-460f-b351-47c6573b4638 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:47.358004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274dfe-934d-49b0-be89-1c49299ae84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:47.358850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274dfe-934d-49b0-be89-1c49299ae84f service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:47.359790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274dfe-934d-49b0-be89-1c49299ae84f service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:47.359790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90274dfe-934d-49b0-be89-1c49299ae84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:47.389384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274dfe-934d-49b0-be89-1c49299ae84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:47.391163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90274dfe-934d-49b0-be89-1c49299ae84f service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:47.403177 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2790/5587] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:48.269626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df736d97-33eb-49b6-8343-3be28d4493cf None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:48.274385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-df736d97-33eb-49b6-8343-3be28d4493cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:48.311513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df736d97-33eb-49b6-8343-3be28d4493cf None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:48.317647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:48.318757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:48.319230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:48.320344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] PATH_INFO: `/v3/projects/25538cb462f746cea1d0b9f40856a309` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:48.323193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25538cb462f746cea1d0b9f40856a309)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:48.326083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:48.422804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25538cb462f746cea1d0b9f40856a309', 'request_id': 'req-e0426b4a-3bc7-459d-aaf1-d947c51fb600'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:48.436114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25538cb462f746cea1d0b9f40856a309', 'request_id': 'req-e0426b4a-3bc7-459d-aaf1-d947c51fb600'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:48.443973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25538cb462f746cea1d0b9f40856a309', 'request_id': 'req-e0426b4a-3bc7-459d-aaf1-d947c51fb600'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:48.458088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] The token cache is being invalidate because project 25538cb462f746cea1d0b9f40856a309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:48.458443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:48.459479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:48.463130 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2798/5588] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:48 2021] DELETE /identity/v3/projects/25538cb462f746cea1d0b9f40856a309 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:48.467643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274dfe-934d-49b0-be89-1c49299ae84f service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:48.479045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90274dfe-934d-49b0-be89-1c49299ae84f service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:48.565592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac26817-f425-40a8-9d25-64443a55097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:48.568067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac26817-f425-40a8-9d25-64443a55097a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:48.568562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac26817-f425-40a8-9d25-64443a55097a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:48.569161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac26817-f425-40a8-9d25-64443a55097a admin admin] PATH_INFO: `/v3/users/5c2733c5fa1047dd8a86ab8db212eae8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:48.571027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac26817-f425-40a8-9d25-64443a55097a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2733c5fa1047dd8a86ab8db212eae8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:48.573926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac26817-f425-40a8-9d25-64443a55097a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:48.636200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3ac26817-f425-40a8-9d25-64443a55097a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2733c5fa1047dd8a86ab8db212eae8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:48.636870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3ac26817-f425-40a8-9d25-64443a55097a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2733c5fa1047dd8a86ab8db212eae8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:48.646213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3ac26817-f425-40a8-9d25-64443a55097a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2733c5fa1047dd8a86ab8db212eae8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:48.647844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3ac26817-f425-40a8-9d25-64443a55097a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2733c5fa1047dd8a86ab8db212eae8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:48.669495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3ac26817-f425-40a8-9d25-64443a55097a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2733c5fa1047dd8a86ab8db212eae8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:48.707711 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2791/5589] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:48 2021] DELETE /identity/v3/users/5c2733c5fa1047dd8a86ab8db212eae8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:49.203180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:49.205336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:49.229444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0426b4a-3bc7-459d-aaf1-d947c51fb600 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:49.341702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:49.343640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:49.344150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:49.344660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] PATH_INFO: `/v3/projects/1d86d74a469744a0a1bbfa0fae8af188` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:49.346889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d86d74a469744a0a1bbfa0fae8af188)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:49.349594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:49.418556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d86d74a469744a0a1bbfa0fae8af188', 'request_id': 'req-04c670b6-a0da-491e-ac65-d5fd1be6f755'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:49.429043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d86d74a469744a0a1bbfa0fae8af188', 'request_id': 'req-04c670b6-a0da-491e-ac65-d5fd1be6f755'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:49.442093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d86d74a469744a0a1bbfa0fae8af188', 'request_id': 'req-04c670b6-a0da-491e-ac65-d5fd1be6f755'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:49.462203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] The token cache is being invalidate because project 1d86d74a469744a0a1bbfa0fae8af188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:49.463824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:49.465017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-04c670b6-a0da-491e-ac65-d5fd1be6f755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:49.467398 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2799/5590] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:49 2021] DELETE /identity/v3/projects/1d86d74a469744a0a1bbfa0fae8af188 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:49.475765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb0496-502d-4bc9-b86b-a333d95a377a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:49.477175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb0496-502d-4bc9-b86b-a333d95a377a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:49.477672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb0496-502d-4bc9-b86b-a333d95a377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:49.498456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-83bb0496-502d-4bc9-b86b-a333d95a377a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:49.500764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-83bb0496-502d-4bc9-b86b-a333d95a377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:49.565917 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2792/5591] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:49.573901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341689f6-567a-4bdc-804e-260160c25e89 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:49.574233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341689f6-567a-4bdc-804e-260160c25e89 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:49.574509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341689f6-567a-4bdc-804e-260160c25e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:49.593217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-341689f6-567a-4bdc-804e-260160c25e89 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:49.594477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-341689f6-567a-4bdc-804e-260160c25e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:49.602595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2800/5592] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:01:49.606880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb0496-502d-4bc9-b86b-a333d95a377a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:49.617141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb0496-502d-4bc9-b86b-a333d95a377a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:49.631910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddad65-f333-4a2f-8855-380056425f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:49.632736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddad65-f333-4a2f-8855-380056425f3a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:49.633023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddad65-f333-4a2f-8855-380056425f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:49.633302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddad65-f333-4a2f-8855-380056425f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:49.634047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddad65-f333-4a2f-8855-380056425f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:49.634353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddad65-f333-4a2f-8855-380056425f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:49.636024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddad65-f333-4a2f-8855-380056425f3a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:49.647985 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2793/5593] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:49.652295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341689f6-567a-4bdc-804e-260160c25e89 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:49.661814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341689f6-567a-4bdc-804e-260160c25e89 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:49.666487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c6be-93e2-435d-994d-d5ec0ea6c034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:49.667137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c6be-93e2-435d-994d-d5ec0ea6c034 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:49.667452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c6be-93e2-435d-994d-d5ec0ea6c034 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:49.667730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077c6be-93e2-435d-994d-d5ec0ea6c034 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:49.668444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077c6be-93e2-435d-994d-d5ec0ea6c034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:49.670867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077c6be-93e2-435d-994d-d5ec0ea6c034 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:49.696772 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2801/5594] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:49 2021] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:49.700972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddad65-f333-4a2f-8855-380056425f3a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:49.710982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddad65-f333-4a2f-8855-380056425f3a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:49.767068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec543e-5c4a-48f7-9ebc-55a8a29bef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:49.767765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec543e-5c4a-48f7-9ebc-55a8a29bef25 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:49.768045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec543e-5c4a-48f7-9ebc-55a8a29bef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:49.768316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec543e-5c4a-48f7-9ebc-55a8a29bef25 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:49.769023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec543e-5c4a-48f7-9ebc-55a8a29bef25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:49.770940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec543e-5c4a-48f7-9ebc-55a8a29bef25 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:49.791015 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2794/5595] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:49 2021] POST /identity/v3/users => generated 306 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:49.795801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c6be-93e2-435d-994d-d5ec0ea6c034 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:49.806515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077c6be-93e2-435d-994d-d5ec0ea6c034 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:49.812313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ac949-3b86-4748-83d3-8a470ff6bd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:49.813145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ac949-3b86-4748-83d3-8a470ff6bd48 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:49.813495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ac949-3b86-4748-83d3-8a470ff6bd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:49.813841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ac949-3b86-4748-83d3-8a470ff6bd48 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:49.814698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ac949-3b86-4748-83d3-8a470ff6bd48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:49.816426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ac949-3b86-4748-83d3-8a470ff6bd48 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:49.828668 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2802/5596] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:49 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:01:49.832221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec543e-5c4a-48f7-9ebc-55a8a29bef25 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:49.842590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec543e-5c4a-48f7-9ebc-55a8a29bef25 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:49.847583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d62ac-cb11-4355-959f-7685c108c19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:49.848563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d62ac-cb11-4355-959f-7685c108c19f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:49.848918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d62ac-cb11-4355-959f-7685c108c19f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:49.849268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d62ac-cb11-4355-959f-7685c108c19f admin admin] PATH_INFO: `/v3/projects/2b7c0ecce295420ea45f3df04271f0cb/users/08bcbb42825041d9b53ff3fab9226e43/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:49.867105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d62ac-cb11-4355-959f-7685c108c19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7c0ecce295420ea45f3df04271f0cb, user_id=08bcbb42825041d9b53ff3fab9226e43, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:49.869951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d62ac-cb11-4355-959f-7685c108c19f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:49.885135 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2795/5597] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:49 2021] PUT /identity/v3/projects/2b7c0ecce295420ea45f3df04271f0cb/users/08bcbb42825041d9b53ff3fab9226e43/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:49.888900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ac949-3b86-4748-83d3-8a470ff6bd48 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:49.899005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ac949-3b86-4748-83d3-8a470ff6bd48 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:49.960580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081a85c-5d84-4a12-bdf4-30c32eee037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:49.961188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081a85c-5d84-4a12-bdf4-30c32eee037d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:49.961503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081a85c-5d84-4a12-bdf4-30c32eee037d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:49.961811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081a85c-5d84-4a12-bdf4-30c32eee037d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:49.962654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081a85c-5d84-4a12-bdf4-30c32eee037d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:49.964765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081a85c-5d84-4a12-bdf4-30c32eee037d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:49.977854 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2803/5598] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:49 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:01:49.982961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d62ac-cb11-4355-959f-7685c108c19f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:49.994401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d62ac-cb11-4355-959f-7685c108c19f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:50.000218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efe1c2-c627-450b-bc17-831a110dfb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:50.001225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe1c2-c627-450b-bc17-831a110dfb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:50.001508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe1c2-c627-450b-bc17-831a110dfb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:50.001786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe1c2-c627-450b-bc17-831a110dfb18 admin admin] PATH_INFO: `/v3/projects/2b7c0ecce295420ea45f3df04271f0cb/users/08bcbb42825041d9b53ff3fab9226e43/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:50.003866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efe1c2-c627-450b-bc17-831a110dfb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7c0ecce295420ea45f3df04271f0cb, user_id=08bcbb42825041d9b53ff3fab9226e43, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:50.006838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efe1c2-c627-450b-bc17-831a110dfb18 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:50.018899 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2796/5599] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:49 2021] PUT /identity/v3/projects/2b7c0ecce295420ea45f3df04271f0cb/users/08bcbb42825041d9b53ff3fab9226e43/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:50.031479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a9481-5ca5-4170-b1ea-0eac740f3d09 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:50.031770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a9481-5ca5-4170-b1ea-0eac740f3d09 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:50.032069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a9481-5ca5-4170-b1ea-0eac740f3d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:50.090354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-142a9481-5ca5-4170-b1ea-0eac740f3d09 None None] MFA Rules not processed for user `08bcbb42825041d9b53ff3fab9226e43`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:50.092111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-142a9481-5ca5-4170-b1ea-0eac740f3d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:50.182196 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2804/5600] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:50 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:50.183424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efe1c2-c627-450b-bc17-831a110dfb18 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:50.261304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efe1c2-c627-450b-bc17-831a110dfb18 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:50.266817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175704f-8dd1-4193-b18f-63e94272b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:50.267968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175704f-8dd1-4193-b18f-63e94272b74e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:50.267968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175704f-8dd1-4193-b18f-63e94272b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:50.268169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175704f-8dd1-4193-b18f-63e94272b74e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:50.268753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175704f-8dd1-4193-b18f-63e94272b74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:50.270719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175704f-8dd1-4193-b18f-63e94272b74e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:50.307770 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2797/5601] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:50 2021] POST /identity/v3/projects => generated 397 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:01:50.311747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a9481-5ca5-4170-b1ea-0eac740f3d09 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:50.323196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a9481-5ca5-4170-b1ea-0eac740f3d09 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:50.413773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec622e2e-32aa-4b89-8b1a-b44842b2ff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:50.415181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec622e2e-32aa-4b89-8b1a-b44842b2ff78 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:50.415490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec622e2e-32aa-4b89-8b1a-b44842b2ff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:50.415768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec622e2e-32aa-4b89-8b1a-b44842b2ff78 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:50.416658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec622e2e-32aa-4b89-8b1a-b44842b2ff78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:50.418427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec622e2e-32aa-4b89-8b1a-b44842b2ff78 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:50.468883 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2805/5602] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:50 2021] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:01:50.470651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175704f-8dd1-4193-b18f-63e94272b74e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:50.487016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175704f-8dd1-4193-b18f-63e94272b74e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:50.502380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dff25-0237-4b85-980c-c343d7482609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:50.505620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dff25-0237-4b85-980c-c343d7482609 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:50.506099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dff25-0237-4b85-980c-c343d7482609 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:50.507960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dff25-0237-4b85-980c-c343d7482609 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:50.509096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dff25-0237-4b85-980c-c343d7482609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:50.512976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dff25-0237-4b85-980c-c343d7482609 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:50.528824 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2798/5603] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:50 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:50.533767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec622e2e-32aa-4b89-8b1a-b44842b2ff78 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:50.548547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec622e2e-32aa-4b89-8b1a-b44842b2ff78 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:50.567918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc4281-7b66-4803-bd5a-19e0b3d63333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:50.569203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4281-7b66-4803-bd5a-19e0b3d63333 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:50.570536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4281-7b66-4803-bd5a-19e0b3d63333 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:50.570894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4281-7b66-4803-bd5a-19e0b3d63333 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:50.571767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc4281-7b66-4803-bd5a-19e0b3d63333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:50.575155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc4281-7b66-4803-bd5a-19e0b3d63333 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:50.601345 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2806/5604] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:50 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:50.606044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dff25-0237-4b85-980c-c343d7482609 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:50.617820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dff25-0237-4b85-980c-c343d7482609 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:50.635741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2b85-e046-4707-83cb-1284fd6db6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:50.636918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2b85-e046-4707-83cb-1284fd6db6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:50.637396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2b85-e046-4707-83cb-1284fd6db6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:50.637838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2b85-e046-4707-83cb-1284fd6db6d1 admin admin] PATH_INFO: `/v3/projects/f5dd4bca7235484b9618fa24f7a64eb2/users/e3121fe531864e0499f90bec82f823a9/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:50.667384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2b85-e046-4707-83cb-1284fd6db6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd4bca7235484b9618fa24f7a64eb2, user_id=e3121fe531864e0499f90bec82f823a9, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:50.671568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2b85-e046-4707-83cb-1284fd6db6d1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:50.714664 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2799/5605] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:50 2021] PUT /identity/v3/projects/f5dd4bca7235484b9618fa24f7a64eb2/users/e3121fe531864e0499f90bec82f823a9/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:50.725224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2194-4efd-4220-a4e7-b17296e4db30 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:50.725768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2194-4efd-4220-a4e7-b17296e4db30 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:50.726245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2194-4efd-4220-a4e7-b17296e4db30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:50.789873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fbbc2194-4efd-4220-a4e7-b17296e4db30 None None] MFA Rules not processed for user `e3121fe531864e0499f90bec82f823a9`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:50.791106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fbbc2194-4efd-4220-a4e7-b17296e4db30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:50.901328 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2807/5606] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:50 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:50.914627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2b85-e046-4707-83cb-1284fd6db6d1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:50.916736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bbba2b85-e046-4707-83cb-1284fd6db6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:51.017832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2b85-e046-4707-83cb-1284fd6db6d1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:51.023499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78a2bf-3391-4d90-8183-19ef4f31713c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:51.024181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78a2bf-3391-4d90-8183-19ef4f31713c service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:51.024854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78a2bf-3391-4d90-8183-19ef4f31713c service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:51.024854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78a2bf-3391-4d90-8183-19ef4f31713c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:51.100011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78a2bf-3391-4d90-8183-19ef4f31713c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:51.102188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78a2bf-3391-4d90-8183-19ef4f31713c service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:51.122543 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2800/5607] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:50 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:51.613474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2194-4efd-4220-a4e7-b17296e4db30 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:51.710200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2194-4efd-4220-a4e7-b17296e4db30 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:51.718788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:51.720851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:51.721550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:51.721766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] PATH_INFO: `/v3/users/08bcbb42825041d9b53ff3fab9226e43` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:51.724358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08bcbb42825041d9b53ff3fab9226e43)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:51.727530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:51.802986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08bcbb42825041d9b53ff3fab9226e43'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:51.814099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08bcbb42825041d9b53ff3fab9226e43'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:51.815480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08bcbb42825041d9b53ff3fab9226e43'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:51.831071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08bcbb42825041d9b53ff3fab9226e43'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:51.850058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08bcbb42825041d9b53ff3fab9226e43'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:51.857625 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2808/5608] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:51 2021] DELETE /identity/v3/users/08bcbb42825041d9b53ff3fab9226e43 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:51.861946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b024-b101-4ee6-9a60-964f7d10648d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:51.862489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b024-b101-4ee6-9a60-964f7d10648d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:51.862622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3b024-b101-4ee6-9a60-964f7d10648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:51.888246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-15b3b024-b101-4ee6-9a60-964f7d10648d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:51.890526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-15b3b024-b101-4ee6-9a60-964f7d10648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:51.975834 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2801/5609] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:51.990697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:51.992363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:52.104650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f43c3-6b11-4388-ada6-b10b64363676 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:52.109041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f5634-0e14-413d-a1af-d71532be8f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:52.110061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f5634-0e14-413d-a1af-d71532be8f6f service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:52.110508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f5634-0e14-413d-a1af-d71532be8f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:52.110953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f5634-0e14-413d-a1af-d71532be8f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:52.123178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f5634-0e14-413d-a1af-d71532be8f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:52.125053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f5634-0e14-413d-a1af-d71532be8f6f service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:52.138927 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2809/5610] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:53.101235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3b024-b101-4ee6-9a60-964f7d10648d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:53.103899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-15b3b024-b101-4ee6-9a60-964f7d10648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:53.119554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3b024-b101-4ee6-9a60-964f7d10648d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:53.125954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:53.126714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:53.126997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:53.127303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] PATH_INFO: `/v3/projects/2b7c0ecce295420ea45f3df04271f0cb` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:53.129207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7c0ecce295420ea45f3df04271f0cb)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:53.131604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:53.192929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7c0ecce295420ea45f3df04271f0cb', 'request_id': 'req-6d9d2bc2-53f8-4957-bcc2-984a2266419e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:53.206348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7c0ecce295420ea45f3df04271f0cb', 'request_id': 'req-6d9d2bc2-53f8-4957-bcc2-984a2266419e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:53.218107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7c0ecce295420ea45f3df04271f0cb', 'request_id': 'req-6d9d2bc2-53f8-4957-bcc2-984a2266419e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:53.233672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] The token cache is being invalidate because project 2b7c0ecce295420ea45f3df04271f0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:53.234128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:53.235244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:53.240414 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2802/5611] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:53 2021] DELETE /identity/v3/projects/2b7c0ecce295420ea45f3df04271f0cb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:53.241690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f5634-0e14-413d-a1af-d71532be8f6f service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:53.252962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f5634-0e14-413d-a1af-d71532be8f6f service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:53.353486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53a154-3fad-473f-b23f-ccf5b4046a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:53.354774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53a154-3fad-473f-b23f-ccf5b4046a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:53.355101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53a154-3fad-473f-b23f-ccf5b4046a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:53.355398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53a154-3fad-473f-b23f-ccf5b4046a88 admin admin] PATH_INFO: `/v3/users/e3121fe531864e0499f90bec82f823a9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:53.357038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53a154-3fad-473f-b23f-ccf5b4046a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3121fe531864e0499f90bec82f823a9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:53.359345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53a154-3fad-473f-b23f-ccf5b4046a88 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:53.428531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d53a154-3fad-473f-b23f-ccf5b4046a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3121fe531864e0499f90bec82f823a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:53.442530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d53a154-3fad-473f-b23f-ccf5b4046a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3121fe531864e0499f90bec82f823a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:53.443203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d53a154-3fad-473f-b23f-ccf5b4046a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3121fe531864e0499f90bec82f823a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:53.453019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d53a154-3fad-473f-b23f-ccf5b4046a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3121fe531864e0499f90bec82f823a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:53.469112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d53a154-3fad-473f-b23f-ccf5b4046a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3121fe531864e0499f90bec82f823a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:53.478720 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2810/5612] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:01:53 2021] DELETE /identity/v3/users/e3121fe531864e0499f90bec82f823a9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:01:54.044310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:54.047072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:54.070725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d2bc2-53f8-4957-bcc2-984a2266419e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:54.153890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:54.156885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:54.157371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:54.158092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] PATH_INFO: `/v3/projects/f5dd4bca7235484b9618fa24f7a64eb2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:54.159588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5dd4bca7235484b9618fa24f7a64eb2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:54.161787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:54.220714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5dd4bca7235484b9618fa24f7a64eb2', 'request_id': 'req-06daacc8-b6e6-4c83-a712-065d9b427a5d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:54.231033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5dd4bca7235484b9618fa24f7a64eb2', 'request_id': 'req-06daacc8-b6e6-4c83-a712-065d9b427a5d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:54.243209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5dd4bca7235484b9618fa24f7a64eb2', 'request_id': 'req-06daacc8-b6e6-4c83-a712-065d9b427a5d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:54.264395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] The token cache is being invalidate because project f5dd4bca7235484b9618fa24f7a64eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:01:54.265200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:54.266118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-06daacc8-b6e6-4c83-a712-065d9b427a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:01:54.268424 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2803/5613] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:01:54 2021] DELETE /identity/v3/projects/f5dd4bca7235484b9618fa24f7a64eb2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:54.274922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591bc1a-6dc5-4c53-b346-446b74d31bd6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:54.275941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591bc1a-6dc5-4c53-b346-446b74d31bd6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:54.276461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591bc1a-6dc5-4c53-b346-446b74d31bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:54.299695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6591bc1a-6dc5-4c53-b346-446b74d31bd6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:54.301609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6591bc1a-6dc5-4c53-b346-446b74d31bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:54.397690 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2811/5614] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:54.400584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91a80-6003-4a4d-883c-59867007b516 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:54.401236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91a80-6003-4a4d-883c-59867007b516 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:54.401589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf91a80-6003-4a4d-883c-59867007b516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:54.423853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4cf91a80-6003-4a4d-883c-59867007b516 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:54.425151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4cf91a80-6003-4a4d-883c-59867007b516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:54.437712 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2804/5615] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:01:54.446946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591bc1a-6dc5-4c53-b346-446b74d31bd6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:54.452586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591bc1a-6dc5-4c53-b346-446b74d31bd6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:54.457761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d3cb-f25e-4f87-ba2d-8fa7a37f4eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:54.458207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d3cb-f25e-4f87-ba2d-8fa7a37f4eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:54.458555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d3cb-f25e-4f87-ba2d-8fa7a37f4eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:54.458837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d3cb-f25e-4f87-ba2d-8fa7a37f4eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:54.459724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9d3cb-f25e-4f87-ba2d-8fa7a37f4eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:01:54.460137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9d3cb-f25e-4f87-ba2d-8fa7a37f4eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:54.461895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9d3cb-f25e-4f87-ba2d-8fa7a37f4eb0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:54.481202 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2812/5616] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:01:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:01:54.482315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf91a80-6003-4a4d-883c-59867007b516 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:54.502938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf91a80-6003-4a4d-883c-59867007b516 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:54.525065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540532c-d4e9-42e5-9bad-4c0533471b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:54.527025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540532c-d4e9-42e5-9bad-4c0533471b81 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:54.527614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540532c-d4e9-42e5-9bad-4c0533471b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:54.528473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540532c-d4e9-42e5-9bad-4c0533471b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:54.532459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540532c-d4e9-42e5-9bad-4c0533471b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:54.534922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540532c-d4e9-42e5-9bad-4c0533471b81 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:54.601445 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2805/5617] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:01:54 2021] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:54.606867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d3cb-f25e-4f87-ba2d-8fa7a37f4eb0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:54.626644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d3cb-f25e-4f87-ba2d-8fa7a37f4eb0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:54.768792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95020b05-bb07-4dd9-8d89-0904736219ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:54.772487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95020b05-bb07-4dd9-8d89-0904736219ac admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:54.772895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95020b05-bb07-4dd9-8d89-0904736219ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:54.773370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95020b05-bb07-4dd9-8d89-0904736219ac admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:54.774547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95020b05-bb07-4dd9-8d89-0904736219ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:54.778437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95020b05-bb07-4dd9-8d89-0904736219ac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:54.827680 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2813/5618] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:01:54 2021] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:01:54.834904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540532c-d4e9-42e5-9bad-4c0533471b81 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:54.860689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540532c-d4e9-42e5-9bad-4c0533471b81 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:54.881679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba8114-0f50-441c-89d0-e2f90a0235c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:54.883935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba8114-0f50-441c-89d0-e2f90a0235c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:54.884429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba8114-0f50-441c-89d0-e2f90a0235c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:54.885155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba8114-0f50-441c-89d0-e2f90a0235c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:54.888281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba8114-0f50-441c-89d0-e2f90a0235c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:54.894336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba8114-0f50-441c-89d0-e2f90a0235c9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:54.934373 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2806/5619] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:54 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:54.938089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95020b05-bb07-4dd9-8d89-0904736219ac admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:54.964964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95020b05-bb07-4dd9-8d89-0904736219ac admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:54.985673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542567f-5e9c-4e8c-9dd7-e8fe91955c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:54.987401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542567f-5e9c-4e8c-9dd7-e8fe91955c1e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:54.989085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542567f-5e9c-4e8c-9dd7-e8fe91955c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:54.989644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542567f-5e9c-4e8c-9dd7-e8fe91955c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:54.991933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542567f-5e9c-4e8c-9dd7-e8fe91955c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:54.996223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542567f-5e9c-4e8c-9dd7-e8fe91955c1e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:55.033743 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2814/5620] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:01:54 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:01:55.038024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba8114-0f50-441c-89d0-e2f90a0235c9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:55.056732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba8114-0f50-441c-89d0-e2f90a0235c9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:55.080152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9580e9d-8a02-4e4c-870b-793dbdd7ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:55.081514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9580e9d-8a02-4e4c-870b-793dbdd7ea6f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:55.082065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9580e9d-8a02-4e4c-870b-793dbdd7ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:55.083349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9580e9d-8a02-4e4c-870b-793dbdd7ea6f admin admin] PATH_INFO: `/v3/projects/500f98bb233b43cbba28562965c51ae0/users/74fa2e48f2884a4c8386dcf5b8d22c85/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:55.126123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9580e9d-8a02-4e4c-870b-793dbdd7ea6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=500f98bb233b43cbba28562965c51ae0, user_id=74fa2e48f2884a4c8386dcf5b8d22c85, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:55.130968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9580e9d-8a02-4e4c-870b-793dbdd7ea6f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:55.159015 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2807/5621] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:01:55 2021] PUT /identity/v3/projects/500f98bb233b43cbba28562965c51ae0/users/74fa2e48f2884a4c8386dcf5b8d22c85/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:01:55.172716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa783-0561-48f1-a9c7-246c77d349ff None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:55.173575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa783-0561-48f1-a9c7-246c77d349ff None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:55.173575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa783-0561-48f1-a9c7-246c77d349ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:55.263752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-91dfa783-0561-48f1-a9c7-246c77d349ff None None] MFA Rules not processed for user `74fa2e48f2884a4c8386dcf5b8d22c85`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:55.265328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-91dfa783-0561-48f1-a9c7-246c77d349ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:55.458235 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2815/5622] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:01:55 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:55.481087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9580e9d-8a02-4e4c-870b-793dbdd7ea6f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:55.485544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d9580e9d-8a02-4e4c-870b-793dbdd7ea6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:55.606602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9580e9d-8a02-4e4c-870b-793dbdd7ea6f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:55.620770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c294a-3826-46c0-8318-9ffb3405097b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:55.622108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c294a-3826-46c0-8318-9ffb3405097b service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:55.622652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c294a-3826-46c0-8318-9ffb3405097b service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:55.623506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c294a-3826-46c0-8318-9ffb3405097b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:55.635406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c294a-3826-46c0-8318-9ffb3405097b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:55.642935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c294a-3826-46c0-8318-9ffb3405097b service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:55.665332 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2808/5623] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:01:55 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:01:55.833935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e89fa-47c1-49e8-aae4-f02bfbc2b820 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:55.834385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e89fa-47c1-49e8-aae4-f02bfbc2b820 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:55.834650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e89fa-47c1-49e8-aae4-f02bfbc2b820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:55.863315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3a0e89fa-47c1-49e8-aae4-f02bfbc2b820 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:55.865665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3a0e89fa-47c1-49e8-aae4-f02bfbc2b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:55.944612 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2816/5624] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:01:55 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:56.012557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c294a-3826-46c0-8318-9ffb3405097b service glance] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:56.014728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-621c294a-3826-46c0-8318-9ffb3405097b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:56.136239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c294a-3826-46c0-8318-9ffb3405097b service glance] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:56.142618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c5931-9caf-4aee-b7a0-2d45c987d00a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:56.143353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c5931-9caf-4aee-b7a0-2d45c987d00a service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:56.143776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c5931-9caf-4aee-b7a0-2d45c987d00a service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:56.144302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c5931-9caf-4aee-b7a0-2d45c987d00a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:56.158300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c5931-9caf-4aee-b7a0-2d45c987d00a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:56.160736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c5931-9caf-4aee-b7a0-2d45c987d00a service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:56.175057 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2809/5625] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:01:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:01:56.594217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070445-9323-488b-88da-10bc3719e69a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:56.595144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070445-9323-488b-88da-10bc3719e69a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:56.595620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070445-9323-488b-88da-10bc3719e69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:56.618590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-49070445-9323-488b-88da-10bc3719e69a None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:56.620405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-49070445-9323-488b-88da-10bc3719e69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:56.632384 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2817/5626] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:01:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:56.650886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c5931-9caf-4aee-b7a0-2d45c987d00a service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:56.666504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c5931-9caf-4aee-b7a0-2d45c987d00a service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:56.673131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4b638-8e16-4bdc-8094-5a892fa8a63a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:56.674212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b638-8e16-4bdc-8094-5a892fa8a63a service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:56.674704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b638-8e16-4bdc-8094-5a892fa8a63a service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:56.674842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b638-8e16-4bdc-8094-5a892fa8a63a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:56.684822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4b638-8e16-4bdc-8094-5a892fa8a63a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:56.687152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4b638-8e16-4bdc-8094-5a892fa8a63a service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:56.698315 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2810/5627] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:01:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:01:57.054729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f71ad6-6d06-4e44-af64-9be5e01dacf4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:57.055002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f71ad6-6d06-4e44-af64-9be5e01dacf4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:57.055317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f71ad6-6d06-4e44-af64-9be5e01dacf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:57.105866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e8f71ad6-6d06-4e44-af64-9be5e01dacf4 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:57.113167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e8f71ad6-6d06-4e44-af64-9be5e01dacf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:57.136565 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2818/5628] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:01:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:57.164969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4b638-8e16-4bdc-8094-5a892fa8a63a service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:57.194948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4b638-8e16-4bdc-8094-5a892fa8a63a service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:57.201610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6e022-3d7c-4c37-96e7-f88f5f693267 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:57.202682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e022-3d7c-4c37-96e7-f88f5f693267 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:57.203555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e022-3d7c-4c37-96e7-f88f5f693267 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:57.204015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6e022-3d7c-4c37-96e7-f88f5f693267 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:57.215616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6e022-3d7c-4c37-96e7-f88f5f693267 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:57.221967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6e022-3d7c-4c37-96e7-f88f5f693267 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:57.234301 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2811/5629] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:01:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:01:57.625961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f4337-bc47-458e-bbe4-7e9947d6e547 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:57.627661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f4337-bc47-458e-bbe4-7e9947d6e547 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:57.628187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f4337-bc47-458e-bbe4-7e9947d6e547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:57.655955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-567f4337-bc47-458e-bbe4-7e9947d6e547 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:57.659521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-567f4337-bc47-458e-bbe4-7e9947d6e547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:57.679069 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2819/5630] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:01:57 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:57.691651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6e022-3d7c-4c37-96e7-f88f5f693267 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:57.710020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6e022-3d7c-4c37-96e7-f88f5f693267 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:57.717696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c0b7d-86b6-4168-9de8-3f3909d84265 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:57.718479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0b7d-86b6-4168-9de8-3f3909d84265 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:57.718777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0b7d-86b6-4168-9de8-3f3909d84265 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:57.719056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c0b7d-86b6-4168-9de8-3f3909d84265 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:57.729999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c0b7d-86b6-4168-9de8-3f3909d84265 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:57.733705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c0b7d-86b6-4168-9de8-3f3909d84265 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:57.776981 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2812/5631] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:01:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:01:58.166494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d3d1f-e682-46af-b4a3-c7c6ad24ea88 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:58.166821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d3d1f-e682-46af-b4a3-c7c6ad24ea88 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:58.167102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d3d1f-e682-46af-b4a3-c7c6ad24ea88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:58.192050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0d0d3d1f-e682-46af-b4a3-c7c6ad24ea88 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:58.193580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0d0d3d1f-e682-46af-b4a3-c7c6ad24ea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:58.202298 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2820/5632] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:01:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:58.222661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c0b7d-86b6-4168-9de8-3f3909d84265 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:58.238938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c0b7d-86b6-4168-9de8-3f3909d84265 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:58.250068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169d169-585e-4a07-810f-4554674b8edd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:58.251881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d169-585e-4a07-810f-4554674b8edd service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:58.253290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d169-585e-4a07-810f-4554674b8edd service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:58.254190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d169-585e-4a07-810f-4554674b8edd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:58.270608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169d169-585e-4a07-810f-4554674b8edd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:58.272646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169d169-585e-4a07-810f-4554674b8edd service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:58.294150 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2813/5633] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:01:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:01:58.700002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a728ad-eb0b-458f-9bb0-0a319396eb94 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:58.700571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a728ad-eb0b-458f-9bb0-0a319396eb94 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:58.701328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a728ad-eb0b-458f-9bb0-0a319396eb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:58.729901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c3a728ad-eb0b-458f-9bb0-0a319396eb94 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:01:58.731399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c3a728ad-eb0b-458f-9bb0-0a319396eb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:01:58.742128 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2821/5634] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:01:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:01:58.766521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169d169-585e-4a07-810f-4554674b8edd service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:01:58.795197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169d169-585e-4a07-810f-4554674b8edd service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:01:58.802882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137a0a8-6173-4353-8bdd-87f213e0ed23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:01:58.803871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137a0a8-6173-4353-8bdd-87f213e0ed23 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:01:58.804516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137a0a8-6173-4353-8bdd-87f213e0ed23 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:01:58.806114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137a0a8-6173-4353-8bdd-87f213e0ed23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:01:58.821106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137a0a8-6173-4353-8bdd-87f213e0ed23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:01:58.823585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137a0a8-6173-4353-8bdd-87f213e0ed23 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:01:58.869703 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2814/5635] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:01:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:02:00.111005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77479b6-d5a7-49de-8f32-ae09f7071235 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:00.111655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77479b6-d5a7-49de-8f32-ae09f7071235 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:00.111977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77479b6-d5a7-49de-8f32-ae09f7071235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:00.133272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b77479b6-d5a7-49de-8f32-ae09f7071235 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:00.134903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b77479b6-d5a7-49de-8f32-ae09f7071235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:00.144083 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2822/5636] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:02:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:00.178174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137a0a8-6173-4353-8bdd-87f213e0ed23 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:00.192455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137a0a8-6173-4353-8bdd-87f213e0ed23 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:00.200786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41defc4a-3bd7-4353-b528-e33a621d22c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:00.201528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41defc4a-3bd7-4353-b528-e33a621d22c6 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:00.201891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41defc4a-3bd7-4353-b528-e33a621d22c6 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:00.203980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41defc4a-3bd7-4353-b528-e33a621d22c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:00.218125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41defc4a-3bd7-4353-b528-e33a621d22c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:00.220338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41defc4a-3bd7-4353-b528-e33a621d22c6 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:00.231093 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2815/5637] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:02:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:02:00.442983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00d8a-62dc-414c-9b38-c4fa9e85b944 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:00.443527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00d8a-62dc-414c-9b38-c4fa9e85b944 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:00.443979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00d8a-62dc-414c-9b38-c4fa9e85b944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:00.469527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2ae00d8a-62dc-414c-9b38-c4fa9e85b944 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:00.470779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2ae00d8a-62dc-414c-9b38-c4fa9e85b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:00.480819 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2823/5638] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:02:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:02:00.497774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41defc4a-3bd7-4353-b528-e33a621d22c6 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:00.511875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41defc4a-3bd7-4353-b528-e33a621d22c6 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:00.519211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2991eb7-9065-423d-a720-a7a264dc0eed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:00.520198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2991eb7-9065-423d-a720-a7a264dc0eed service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:00.520558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2991eb7-9065-423d-a720-a7a264dc0eed service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:00.521448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2991eb7-9065-423d-a720-a7a264dc0eed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:00.532331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2991eb7-9065-423d-a720-a7a264dc0eed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:00.534975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2991eb7-9065-423d-a720-a7a264dc0eed service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:00.553315 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2816/5639] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:02:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:02:00.821799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686e8b-cbf1-4818-adb5-93458d244349 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:00.822362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686e8b-cbf1-4818-adb5-93458d244349 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:00.823073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686e8b-cbf1-4818-adb5-93458d244349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:00.851384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d7686e8b-cbf1-4818-adb5-93458d244349 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:00.852888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d7686e8b-cbf1-4818-adb5-93458d244349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:00.868028 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2824/5640] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:02:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:00.887227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2991eb7-9065-423d-a720-a7a264dc0eed service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:00.914920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2991eb7-9065-423d-a720-a7a264dc0eed service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:00.923973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3ab22-67e6-4696-8be4-778baadb0c18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:00.925355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3ab22-67e6-4696-8be4-778baadb0c18 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:00.925895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3ab22-67e6-4696-8be4-778baadb0c18 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:00.926297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3ab22-67e6-4696-8be4-778baadb0c18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:00.938095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3ab22-67e6-4696-8be4-778baadb0c18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:00.941355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3ab22-67e6-4696-8be4-778baadb0c18 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:00.971084 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2817/5641] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:02:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:02:01.253934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7474aaa-0e6f-429b-9724-469c9bb4df75 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:01.254546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7474aaa-0e6f-429b-9724-469c9bb4df75 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:01.254546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7474aaa-0e6f-429b-9724-469c9bb4df75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:01.297416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a7474aaa-0e6f-429b-9724-469c9bb4df75 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:01.302956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a7474aaa-0e6f-429b-9724-469c9bb4df75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:01.319518 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2825/5642] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:02:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:01.335848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3ab22-67e6-4696-8be4-778baadb0c18 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:01.352243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3ab22-67e6-4696-8be4-778baadb0c18 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:01.358722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b35ee-c9eb-4858-b311-d22f0d12ba9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:01.359784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b35ee-c9eb-4858-b311-d22f0d12ba9b service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:01.360306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b35ee-c9eb-4858-b311-d22f0d12ba9b service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:01.361892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b35ee-c9eb-4858-b311-d22f0d12ba9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:01.374591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b35ee-c9eb-4858-b311-d22f0d12ba9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:01.376754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b35ee-c9eb-4858-b311-d22f0d12ba9b service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:01.388059 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2818/5643] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:02:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:02:01.624213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec612a9-0708-4361-aa44-93d4c6a78d11 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:01.624768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec612a9-0708-4361-aa44-93d4c6a78d11 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:01.625336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec612a9-0708-4361-aa44-93d4c6a78d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:01.688554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2ec612a9-0708-4361-aa44-93d4c6a78d11 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:01.689781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2ec612a9-0708-4361-aa44-93d4c6a78d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:01.705427 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2826/5644] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:02:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:01.721633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b35ee-c9eb-4858-b311-d22f0d12ba9b service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:01.742269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b35ee-c9eb-4858-b311-d22f0d12ba9b service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:01.757292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82dc95-fc76-44df-87aa-b62d3d3875cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:01.758300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82dc95-fc76-44df-87aa-b62d3d3875cd service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:01.759004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82dc95-fc76-44df-87aa-b62d3d3875cd service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:01.759632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82dc95-fc76-44df-87aa-b62d3d3875cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:01.774895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82dc95-fc76-44df-87aa-b62d3d3875cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:01.777013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82dc95-fc76-44df-87aa-b62d3d3875cd service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:01.801168 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2819/5645] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:02:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:02:01.975779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e30d4a-1d78-4629-a676-33b36d39cb2d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:01.976065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e30d4a-1d78-4629-a676-33b36d39cb2d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:01.976339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e30d4a-1d78-4629-a676-33b36d39cb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:01.995472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f7e30d4a-1d78-4629-a676-33b36d39cb2d None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:01.996660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f7e30d4a-1d78-4629-a676-33b36d39cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:02.004052 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2827/5646] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:02:01 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:02.017792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82dc95-fc76-44df-87aa-b62d3d3875cd service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:02.031074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82dc95-fc76-44df-87aa-b62d3d3875cd service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:02.036295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8f821-1cdc-48e7-a7ed-8ce3bd79f6b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:02.036942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8f821-1cdc-48e7-a7ed-8ce3bd79f6b5 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:02.037224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8f821-1cdc-48e7-a7ed-8ce3bd79f6b5 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:02.037495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8f821-1cdc-48e7-a7ed-8ce3bd79f6b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:02.047614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8f821-1cdc-48e7-a7ed-8ce3bd79f6b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:02.049811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8f821-1cdc-48e7-a7ed-8ce3bd79f6b5 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:02.060913 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2820/5647] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:02:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:02:02.239203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e30d4a-1d78-4629-a676-33b36d39cb2d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:02.319079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e30d4a-1d78-4629-a676-33b36d39cb2d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:02.324937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e291de-e5ff-4c7d-8342-5316eefe6f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:02.328774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e291de-e5ff-4c7d-8342-5316eefe6f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:02.328774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e291de-e5ff-4c7d-8342-5316eefe6f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:02.328774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e291de-e5ff-4c7d-8342-5316eefe6f8c admin admin] PATH_INFO: `/v3/users/74fa2e48f2884a4c8386dcf5b8d22c85` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:02.329273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e291de-e5ff-4c7d-8342-5316eefe6f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74fa2e48f2884a4c8386dcf5b8d22c85)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:02.330235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8f821-1cdc-48e7-a7ed-8ce3bd79f6b5 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:02.331853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8df8f821-1cdc-48e7-a7ed-8ce3bd79f6b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:02.335200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e291de-e5ff-4c7d-8342-5316eefe6f8c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:02.350830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8f821-1cdc-48e7-a7ed-8ce3bd79f6b5 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:02.358679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:02.359889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:02.360448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:02.361057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] PATH_INFO: `/v3/users/ab09c8b68a1545fb8733dd571bc9db4b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:02.362865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab09c8b68a1545fb8733dd571bc9db4b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:02.365648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:02.397930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84e291de-e5ff-4c7d-8342-5316eefe6f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74fa2e48f2884a4c8386dcf5b8d22c85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:02.408131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84e291de-e5ff-4c7d-8342-5316eefe6f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74fa2e48f2884a4c8386dcf5b8d22c85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:02.409430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84e291de-e5ff-4c7d-8342-5316eefe6f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74fa2e48f2884a4c8386dcf5b8d22c85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:02.418064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84e291de-e5ff-4c7d-8342-5316eefe6f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74fa2e48f2884a4c8386dcf5b8d22c85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:02.433666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84e291de-e5ff-4c7d-8342-5316eefe6f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74fa2e48f2884a4c8386dcf5b8d22c85'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:02.440719 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2828/5648] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:02:02 2021] DELETE /identity/v3/users/74fa2e48f2884a4c8386dcf5b8d22c85 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:02:02.441257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab09c8b68a1545fb8733dd571bc9db4b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:02.442089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab09c8b68a1545fb8733dd571bc9db4b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:02.449199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e6c95-23ba-4f75-9407-0403aba3c169 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:02.450969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e6c95-23ba-4f75-9407-0403aba3c169 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:02.450969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e6c95-23ba-4f75-9407-0403aba3c169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:02.451947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab09c8b68a1545fb8733dd571bc9db4b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:02.453087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab09c8b68a1545fb8733dd571bc9db4b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:02.462475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab09c8b68a1545fb8733dd571bc9db4b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:02.472657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-513e6c95-23ba-4f75-9407-0403aba3c169 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:02.474987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-513e6c95-23ba-4f75-9407-0403aba3c169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:02.488920 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2821/5649] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:02:02 2021] DELETE /identity/v3/users/ab09c8b68a1545fb8733dd571bc9db4b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:02:02.551304 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2829/5650] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:02.562106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:02.565419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:02.640498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05508b2-40f7-4865-8655-b919488cdf6f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:02.644974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a5c4d-b036-4857-937c-45ab3e826025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:02.646182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5c4d-b036-4857-937c-45ab3e826025 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:02.646572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5c4d-b036-4857-937c-45ab3e826025 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:02.646959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5c4d-b036-4857-937c-45ab3e826025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:02.740710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a5c4d-b036-4857-937c-45ab3e826025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:02.742395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a5c4d-b036-4857-937c-45ab3e826025 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:02.755134 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2822/5651] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:02:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:02.871596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e6c95-23ba-4f75-9407-0403aba3c169 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:02.873926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-513e6c95-23ba-4f75-9407-0403aba3c169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:02.889198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e6c95-23ba-4f75-9407-0403aba3c169 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:02.894585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:02.896077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:02.896599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:02.897090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] PATH_INFO: `/v3/projects/998295c106db4d7b82c3c10f09fbe182` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:02.898993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] RBAC: Authorizing `identity:delete_project(project_id=998295c106db4d7b82c3c10f09fbe182)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:02.901571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:03.027851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998295c106db4d7b82c3c10f09fbe182', 'request_id': 'req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:03.040208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998295c106db4d7b82c3c10f09fbe182', 'request_id': 'req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:03.047819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998295c106db4d7b82c3c10f09fbe182', 'request_id': 'req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:03.060673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] The token cache is being invalidate because project 998295c106db4d7b82c3c10f09fbe182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:02:03.061047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:03.063328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1a5a7ec9-e614-40ea-b4c2-9337d3fa564f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:03.066040 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2830/5652] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:02:02 2021] DELETE /identity/v3/projects/998295c106db4d7b82c3c10f09fbe182 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:02:03.073714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e5c9-a332-4c0e-a155-1debca8e34f5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:03.074001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e5c9-a332-4c0e-a155-1debca8e34f5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:03.074275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370e5c9-a332-4c0e-a155-1debca8e34f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:03.100310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4370e5c9-a332-4c0e-a155-1debca8e34f5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:03.102388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4370e5c9-a332-4c0e-a155-1debca8e34f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:03.239417 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2823/5653] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:03.244363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658031df-de3b-4b8d-909a-f85e06121835 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:03.244852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658031df-de3b-4b8d-909a-f85e06121835 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:03.245226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658031df-de3b-4b8d-909a-f85e06121835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:03.286390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-658031df-de3b-4b8d-909a-f85e06121835 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:03.288346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-658031df-de3b-4b8d-909a-f85e06121835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:03.302021 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2831/5654] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:03.307962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e5c9-a332-4c0e-a155-1debca8e34f5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:03.331913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370e5c9-a332-4c0e-a155-1debca8e34f5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:03.342380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1dd17-2056-4f22-b94b-c8864969d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:03.343169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1dd17-2056-4f22-b94b-c8864969d6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:03.343834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1dd17-2056-4f22-b94b-c8864969d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:03.345146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1dd17-2056-4f22-b94b-c8864969d6a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:03.346506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1dd17-2056-4f22-b94b-c8864969d6a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:02:03.346851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1dd17-2056-4f22-b94b-c8864969d6a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:03.348932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1dd17-2056-4f22-b94b-c8864969d6a5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:03.374784 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2824/5655] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:02:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:02:03.376929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658031df-de3b-4b8d-909a-f85e06121835 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:03.393723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658031df-de3b-4b8d-909a-f85e06121835 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:03.399819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079b7e6-5a2d-46cf-bc6c-a3e3d3b89897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:03.400903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079b7e6-5a2d-46cf-bc6c-a3e3d3b89897 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:03.401408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079b7e6-5a2d-46cf-bc6c-a3e3d3b89897 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:03.401868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079b7e6-5a2d-46cf-bc6c-a3e3d3b89897 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:03.402975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079b7e6-5a2d-46cf-bc6c-a3e3d3b89897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:03.406231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079b7e6-5a2d-46cf-bc6c-a3e3d3b89897 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:03.458239 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2832/5656] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:02:03 2021] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:02:03.460120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1dd17-2056-4f22-b94b-c8864969d6a5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:03.474508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1dd17-2056-4f22-b94b-c8864969d6a5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:03.556640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f47ff7-d849-4b9f-93dc-a3902422c159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:03.556640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47ff7-d849-4b9f-93dc-a3902422c159 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:03.556640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47ff7-d849-4b9f-93dc-a3902422c159 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:03.556640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f47ff7-d849-4b9f-93dc-a3902422c159 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:03.557086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f47ff7-d849-4b9f-93dc-a3902422c159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:03.568159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f47ff7-d849-4b9f-93dc-a3902422c159 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:03.615329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079b7e6-5a2d-46cf-bc6c-a3e3d3b89897 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:03.617537 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2825/5657] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:02:03 2021] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:02:03.635071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079b7e6-5a2d-46cf-bc6c-a3e3d3b89897 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:03.642106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f71c21-6ce4-434c-9f8b-ce8e296d95fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:03.643390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f71c21-6ce4-434c-9f8b-ce8e296d95fc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:03.643898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f71c21-6ce4-434c-9f8b-ce8e296d95fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:03.644386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f71c21-6ce4-434c-9f8b-ce8e296d95fc admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:03.645356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f71c21-6ce4-434c-9f8b-ce8e296d95fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:03.648269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f71c21-6ce4-434c-9f8b-ce8e296d95fc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:03.663456 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2833/5658] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:02:03 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:02:03.667103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f47ff7-d849-4b9f-93dc-a3902422c159 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:03.683020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f47ff7-d849-4b9f-93dc-a3902422c159 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:03.698653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43c81e-536e-4481-bdd8-dfd8fabe6648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:03.699720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43c81e-536e-4481-bdd8-dfd8fabe6648 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:03.700771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43c81e-536e-4481-bdd8-dfd8fabe6648 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:03.701488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43c81e-536e-4481-bdd8-dfd8fabe6648 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:03.702517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43c81e-536e-4481-bdd8-dfd8fabe6648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:03.705042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43c81e-536e-4481-bdd8-dfd8fabe6648 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:03.724803 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2826/5659] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:02:03 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:02:03.725978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f71c21-6ce4-434c-9f8b-ce8e296d95fc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:03.738795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f71c21-6ce4-434c-9f8b-ce8e296d95fc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:03.744770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38cbca-4dc7-4301-9e88-9c27290b2f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:03.746491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38cbca-4dc7-4301-9e88-9c27290b2f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:03.747329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38cbca-4dc7-4301-9e88-9c27290b2f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:03.747850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38cbca-4dc7-4301-9e88-9c27290b2f45 admin admin] PATH_INFO: `/v3/projects/85c58aa2d3dd4e09a26b5265084b8493/users/9a60782e0d8945c2b99dac616fda491d/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:03.765128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38cbca-4dc7-4301-9e88-9c27290b2f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c58aa2d3dd4e09a26b5265084b8493, user_id=9a60782e0d8945c2b99dac616fda491d, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:03.768083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38cbca-4dc7-4301-9e88-9c27290b2f45 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:03.786715 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2834/5660] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:02:03 2021] PUT /identity/v3/projects/85c58aa2d3dd4e09a26b5265084b8493/users/9a60782e0d8945c2b99dac616fda491d/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:02:03.792066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2057f87-438a-4db5-888a-7773e5bb91c1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:03.792490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2057f87-438a-4db5-888a-7773e5bb91c1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:03.792847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2057f87-438a-4db5-888a-7773e5bb91c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:03.813652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a2057f87-438a-4db5-888a-7773e5bb91c1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:03.815201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a2057f87-438a-4db5-888a-7773e5bb91c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:03.909645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38cbca-4dc7-4301-9e88-9c27290b2f45 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:03.909815 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2827/5661] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:03.911828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3f38cbca-4dc7-4301-9e88-9c27290b2f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:03.941973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38cbca-4dc7-4301-9e88-9c27290b2f45 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:03.945460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2057f87-438a-4db5-888a-7773e5bb91c1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:03.946904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a2057f87-438a-4db5-888a-7773e5bb91c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:03.958137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:03.959457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:03.959825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:03.960169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] PATH_INFO: `/v3/projects/500f98bb233b43cbba28562965c51ae0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:03.962074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=500f98bb233b43cbba28562965c51ae0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:03.964361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:04.066933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2057f87-438a-4db5-888a-7773e5bb91c1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:04.109244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500f98bb233b43cbba28562965c51ae0', 'request_id': 'req-910e31eb-65fe-4072-9152-81c49cd247c6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:04.124472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500f98bb233b43cbba28562965c51ae0', 'request_id': 'req-910e31eb-65fe-4072-9152-81c49cd247c6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:04.133899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500f98bb233b43cbba28562965c51ae0', 'request_id': 'req-910e31eb-65fe-4072-9152-81c49cd247c6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:04.149057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] The token cache is being invalidate because project 500f98bb233b43cbba28562965c51ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:02:04.149656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:04.150357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-910e31eb-65fe-4072-9152-81c49cd247c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:04.152389 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2835/5662] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:02:03 2021] DELETE /identity/v3/projects/500f98bb233b43cbba28562965c51ae0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:02:04.163506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f43f9-743b-4bc1-9121-c2ae8e0d2c2a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:04.164059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f43f9-743b-4bc1-9121-c2ae8e0d2c2a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:04.164545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f43f9-743b-4bc1-9121-c2ae8e0d2c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:04.164696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d062f-36b1-4642-a56b-4fbdb8156b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:04.170527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d062f-36b1-4642-a56b-4fbdb8156b63 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:04.170957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d062f-36b1-4642-a56b-4fbdb8156b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:04.171344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d062f-36b1-4642-a56b-4fbdb8156b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:04.175366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6b7d062f-36b1-4642-a56b-4fbdb8156b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:04.188493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1d9f43f9-743b-4bc1-9121-c2ae8e0d2c2a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:04.190414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1d9f43f9-743b-4bc1-9121-c2ae8e0d2c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:04.277479 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2836/5663] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:04.286020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fa587-8151-4a24-9076-923a7628d579 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:04.286742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fa587-8151-4a24-9076-923a7628d579 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:04.287438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fa587-8151-4a24-9076-923a7628d579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:04.298027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d062f-36b1-4642-a56b-4fbdb8156b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:04.300304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d062f-36b1-4642-a56b-4fbdb8156b63 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:04.323451 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2828/5664] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:02:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:04.330500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-334fa587-8151-4a24-9076-923a7628d579 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:04.331770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-334fa587-8151-4a24-9076-923a7628d579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:04.341799 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2837/5665] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:04.345661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d062f-36b1-4642-a56b-4fbdb8156b63 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:04.356361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d062f-36b1-4642-a56b-4fbdb8156b63 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:04.362257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db707eeb-75d6-4012-a8f3-61b8207b0b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:04.362929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db707eeb-75d6-4012-a8f3-61b8207b0b77 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:04.363215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db707eeb-75d6-4012-a8f3-61b8207b0b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:04.363524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db707eeb-75d6-4012-a8f3-61b8207b0b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:04.364269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db707eeb-75d6-4012-a8f3-61b8207b0b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:02:04.364582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db707eeb-75d6-4012-a8f3-61b8207b0b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:04.366193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db707eeb-75d6-4012-a8f3-61b8207b0b77 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:04.391543 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2829/5666] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:02:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:02:04.395748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fa587-8151-4a24-9076-923a7628d579 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:04.405581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fa587-8151-4a24-9076-923a7628d579 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:04.410561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f7861-bb0b-4af7-976f-2c643571fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:04.411368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7861-bb0b-4af7-976f-2c643571fcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:04.411886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7861-bb0b-4af7-976f-2c643571fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:04.412375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f7861-bb0b-4af7-976f-2c643571fcd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:04.413155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f7861-bb0b-4af7-976f-2c643571fcd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:04.415440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f7861-bb0b-4af7-976f-2c643571fcd4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:04.454444 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2838/5667] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:02:04 2021] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:02:04.458746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db707eeb-75d6-4012-a8f3-61b8207b0b77 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:04.469726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db707eeb-75d6-4012-a8f3-61b8207b0b77 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:04.550118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb7783-6e88-4ffc-8207-c8cfc516c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:04.550995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb7783-6e88-4ffc-8207-c8cfc516c910 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:04.551450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb7783-6e88-4ffc-8207-c8cfc516c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:04.552109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb7783-6e88-4ffc-8207-c8cfc516c910 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:04.553165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb7783-6e88-4ffc-8207-c8cfc516c910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:04.554793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb7783-6e88-4ffc-8207-c8cfc516c910 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:04.583393 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2830/5668] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:02:04 2021] POST /identity/v3/users => generated 285 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:02:04.586420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f7861-bb0b-4af7-976f-2c643571fcd4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:04.601057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f7861-bb0b-4af7-976f-2c643571fcd4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:04.609557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475df45-4d57-4368-bd07-cafa548f9d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:04.610972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475df45-4d57-4368-bd07-cafa548f9d34 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:04.611369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475df45-4d57-4368-bd07-cafa548f9d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:04.611723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475df45-4d57-4368-bd07-cafa548f9d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:04.612670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475df45-4d57-4368-bd07-cafa548f9d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:04.614773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475df45-4d57-4368-bd07-cafa548f9d34 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:04.631884 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2839/5669] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:02:04 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:02:04.636378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb7783-6e88-4ffc-8207-c8cfc516c910 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:04.649271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb7783-6e88-4ffc-8207-c8cfc516c910 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:04.656877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a14f-9411-4c67-a4af-b9b2bd17c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:04.658531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a14f-9411-4c67-a4af-b9b2bd17c978 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:04.659377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a14f-9411-4c67-a4af-b9b2bd17c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:04.659853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a14f-9411-4c67-a4af-b9b2bd17c978 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:04.660998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a14f-9411-4c67-a4af-b9b2bd17c978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:04.663075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a14f-9411-4c67-a4af-b9b2bd17c978 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:04.675325 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2831/5670] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:02:04 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:02:04.679335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475df45-4d57-4368-bd07-cafa548f9d34 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:04.690891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475df45-4d57-4368-bd07-cafa548f9d34 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:04.697057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0b16-9da5-42e6-ba7b-8590b9c0f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:04.698202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0b16-9da5-42e6-ba7b-8590b9c0f646 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:04.698482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0b16-9da5-42e6-ba7b-8590b9c0f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:04.698754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff0b16-9da5-42e6-ba7b-8590b9c0f646 admin admin] PATH_INFO: `/v3/projects/f82c8ee730894aca85e246fb97cd8872/users/51bf6fc7f4ce4593bdb72506ef2614f5/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:04.714187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff0b16-9da5-42e6-ba7b-8590b9c0f646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82c8ee730894aca85e246fb97cd8872, user_id=51bf6fc7f4ce4593bdb72506ef2614f5, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:04.716974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff0b16-9da5-42e6-ba7b-8590b9c0f646 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:04.731323 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2840/5671] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:02:04 2021] PUT /identity/v3/projects/f82c8ee730894aca85e246fb97cd8872/users/51bf6fc7f4ce4593bdb72506ef2614f5/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:02:04.743228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50882e-b9fd-40be-ad99-e0751295c18f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:04.743779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50882e-b9fd-40be-ad99-e0751295c18f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:04.744168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50882e-b9fd-40be-ad99-e0751295c18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:04.774916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ac50882e-b9fd-40be-ad99-e0751295c18f None None] MFA Rules not processed for user `51bf6fc7f4ce4593bdb72506ef2614f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:04.776468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ac50882e-b9fd-40be-ad99-e0751295c18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:04.878723 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2832/5672] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:04 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:04.894324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0b16-9da5-42e6-ba7b-8590b9c0f646 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:04.896999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f9ff0b16-9da5-42e6-ba7b-8590b9c0f646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:04.993227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff0b16-9da5-42e6-ba7b-8590b9c0f646 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:04.999441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17176-0041-4181-9753-28a529aabdf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:05.000765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17176-0041-4181-9753-28a529aabdf2 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:05.001224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17176-0041-4181-9753-28a529aabdf2 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:05.001655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17176-0041-4181-9753-28a529aabdf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:05.013777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17176-0041-4181-9753-28a529aabdf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:05.015579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17176-0041-4181-9753-28a529aabdf2 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:05.044034 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2841/5673] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:02:04 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:05.677518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50882e-b9fd-40be-ad99-e0751295c18f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:05.819962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50882e-b9fd-40be-ad99-e0751295c18f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:05.826299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734047fa-f881-4764-ae32-f9a094186ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:05.828023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734047fa-f881-4764-ae32-f9a094186ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:05.828480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734047fa-f881-4764-ae32-f9a094186ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:05.828947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734047fa-f881-4764-ae32-f9a094186ed6 admin admin] PATH_INFO: `/v3/users/51bf6fc7f4ce4593bdb72506ef2614f5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:05.830751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734047fa-f881-4764-ae32-f9a094186ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51bf6fc7f4ce4593bdb72506ef2614f5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:05.834048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734047fa-f881-4764-ae32-f9a094186ed6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:05.906575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-734047fa-f881-4764-ae32-f9a094186ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51bf6fc7f4ce4593bdb72506ef2614f5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:05.907611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-734047fa-f881-4764-ae32-f9a094186ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51bf6fc7f4ce4593bdb72506ef2614f5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:05.918344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-734047fa-f881-4764-ae32-f9a094186ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51bf6fc7f4ce4593bdb72506ef2614f5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:05.921654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-734047fa-f881-4764-ae32-f9a094186ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51bf6fc7f4ce4593bdb72506ef2614f5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:05.930830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-734047fa-f881-4764-ae32-f9a094186ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51bf6fc7f4ce4593bdb72506ef2614f5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:05.954808 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2833/5674] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:02:05 2021] DELETE /identity/v3/users/51bf6fc7f4ce4593bdb72506ef2614f5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:02:05.959005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9ae8b-c5b0-4c68-b03e-410eaf2ef453 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:05.959586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9ae8b-c5b0-4c68-b03e-410eaf2ef453 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:05.959586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9ae8b-c5b0-4c68-b03e-410eaf2ef453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:05.986044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0fa9ae8b-c5b0-4c68-b03e-410eaf2ef453 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:05.987967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0fa9ae8b-c5b0-4c68-b03e-410eaf2ef453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:06.118567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f7118-007f-4285-8791-21e11642d34e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:06.118859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f7118-007f-4285-8791-21e11642d34e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:06.119137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f7118-007f-4285-8791-21e11642d34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:06.155753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-024f7118-007f-4285-8791-21e11642d34e None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:06.157712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-024f7118-007f-4285-8791-21e11642d34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:06.173503 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2842/5675] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:06.187204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9ae8b-c5b0-4c68-b03e-410eaf2ef453 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:06.188945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0fa9ae8b-c5b0-4c68-b03e-410eaf2ef453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:06.303850 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2834/5676] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:02:06.304364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9ae8b-c5b0-4c68-b03e-410eaf2ef453 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:06.314071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840491-e8ad-42ee-ace5-cce7fe5a0e6f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:06.315204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840491-e8ad-42ee-ace5-cce7fe5a0e6f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:06.315671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3840491-e8ad-42ee-ace5-cce7fe5a0e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:06.316470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4e177-bd44-4500-a959-ea5135c24d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:06.317667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e177-bd44-4500-a959-ea5135c24d60 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:06.317667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e177-bd44-4500-a959-ea5135c24d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:06.318127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e177-bd44-4500-a959-ea5135c24d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:06.339763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4e177-bd44-4500-a959-ea5135c24d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:06.342104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4e177-bd44-4500-a959-ea5135c24d60 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:06.367007 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2843/5677] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:02:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:06.377002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f3840491-e8ad-42ee-ace5-cce7fe5a0e6f None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:06.378415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f3840491-e8ad-42ee-ace5-cce7fe5a0e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:06.412784 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2835/5678] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:06.433576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4e177-bd44-4500-a959-ea5135c24d60 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:06.435819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dec4e177-bd44-4500-a959-ea5135c24d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:06.599671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4e177-bd44-4500-a959-ea5135c24d60 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:06.607397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b051d8-734f-4423-9a7c-ce8ea036835b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:06.608362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b051d8-734f-4423-9a7c-ce8ea036835b service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:06.608650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b051d8-734f-4423-9a7c-ce8ea036835b service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:06.609070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b051d8-734f-4423-9a7c-ce8ea036835b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:06.621633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b051d8-734f-4423-9a7c-ce8ea036835b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:06.624592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b051d8-734f-4423-9a7c-ce8ea036835b service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:06.638905 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2844/5679] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:02:06 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:06.743820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9c1f-f947-44fe-abf5-b8a120d008b1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:06.744426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9c1f-f947-44fe-abf5-b8a120d008b1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:06.744426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f9c1f-f947-44fe-abf5-b8a120d008b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:06.771501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-102f9c1f-f947-44fe-abf5-b8a120d008b1 None None] MFA Rules not processed for user `1ca08ebddb1742d18951633bf019d743`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:06.773187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-102f9c1f-f947-44fe-abf5-b8a120d008b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:06.895211 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2836/5680] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:07.384466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b051d8-734f-4423-9a7c-ce8ea036835b service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:07.385929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b0b051d8-734f-4423-9a7c-ce8ea036835b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:07.401394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b051d8-734f-4423-9a7c-ce8ea036835b service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:07.407491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:07.408474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:07.409036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:07.409735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] PATH_INFO: `/v3/projects/f82c8ee730894aca85e246fb97cd8872` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:07.411160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f82c8ee730894aca85e246fb97cd8872)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:07.413954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:07.502646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82c8ee730894aca85e246fb97cd8872', 'request_id': 'req-ea224f25-ae85-418a-b375-056220f6c2f2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:07.511862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82c8ee730894aca85e246fb97cd8872', 'request_id': 'req-ea224f25-ae85-418a-b375-056220f6c2f2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:07.519995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82c8ee730894aca85e246fb97cd8872', 'request_id': 'req-ea224f25-ae85-418a-b375-056220f6c2f2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:07.533443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] The token cache is being invalidate because project f82c8ee730894aca85e246fb97cd8872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:02:07.533731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:07.534573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ea224f25-ae85-418a-b375-056220f6c2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:07.536271 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2845/5681] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:02:07 2021] DELETE /identity/v3/projects/f82c8ee730894aca85e246fb97cd8872 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:02:07.541872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933428f7-84ad-4a63-8893-73a7d56563b4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:07.542170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933428f7-84ad-4a63-8893-73a7d56563b4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:07.542454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933428f7-84ad-4a63-8893-73a7d56563b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:07.566655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-933428f7-84ad-4a63-8893-73a7d56563b4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:07.568607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-933428f7-84ad-4a63-8893-73a7d56563b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:07.646592 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2837/5682] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:07.655552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca38027-3002-4fee-980e-e8478dc3299d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:07.656115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca38027-3002-4fee-980e-e8478dc3299d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:07.656396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca38027-3002-4fee-980e-e8478dc3299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:07.676822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cca38027-3002-4fee-980e-e8478dc3299d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:07.678102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cca38027-3002-4fee-980e-e8478dc3299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:07.687096 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2846/5683] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:07.691436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933428f7-84ad-4a63-8893-73a7d56563b4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:07.702463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933428f7-84ad-4a63-8893-73a7d56563b4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:07.707115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea768dd-67c7-4484-972c-6f9c1d3ddaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:07.707811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea768dd-67c7-4484-972c-6f9c1d3ddaba admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:07.708095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea768dd-67c7-4484-972c-6f9c1d3ddaba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:07.708518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea768dd-67c7-4484-972c-6f9c1d3ddaba admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:07.709273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea768dd-67c7-4484-972c-6f9c1d3ddaba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:02:07.709560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea768dd-67c7-4484-972c-6f9c1d3ddaba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:07.711143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea768dd-67c7-4484-972c-6f9c1d3ddaba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:07.724441 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2838/5684] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:02:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:02:07.729199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca38027-3002-4fee-980e-e8478dc3299d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:07.741068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca38027-3002-4fee-980e-e8478dc3299d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:07.747995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce7fbc-777e-41a9-baae-7246dde0d82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:07.749137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7fbc-777e-41a9-baae-7246dde0d82f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:07.749562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7fbc-777e-41a9-baae-7246dde0d82f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:07.750456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7fbc-777e-41a9-baae-7246dde0d82f admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:07.751054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce7fbc-777e-41a9-baae-7246dde0d82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:07.753182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce7fbc-777e-41a9-baae-7246dde0d82f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:07.806771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea768dd-67c7-4484-972c-6f9c1d3ddaba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:07.807585 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2847/5685] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:02:07 2021] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:02:07.819183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea768dd-67c7-4484-972c-6f9c1d3ddaba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:07.917788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303349-2e30-4313-a752-cfe6557e48a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:07.921507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303349-2e30-4313-a752-cfe6557e48a0 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:07.921798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303349-2e30-4313-a752-cfe6557e48a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:07.922076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303349-2e30-4313-a752-cfe6557e48a0 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:07.923857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a303349-2e30-4313-a752-cfe6557e48a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:07.928059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a303349-2e30-4313-a752-cfe6557e48a0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:07.974719 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2839/5686] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:02:07 2021] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:02:07.976587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce7fbc-777e-41a9-baae-7246dde0d82f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:07.987236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce7fbc-777e-41a9-baae-7246dde0d82f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:07.995121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d821b-1a85-4326-a8a7-b8ebf67f6bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:07.996574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d821b-1a85-4326-a8a7-b8ebf67f6bfd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:07.997745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d821b-1a85-4326-a8a7-b8ebf67f6bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:07.998947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d821b-1a85-4326-a8a7-b8ebf67f6bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:07.999979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d821b-1a85-4326-a8a7-b8ebf67f6bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:08.002437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d821b-1a85-4326-a8a7-b8ebf67f6bfd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:08.017979 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2848/5687] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:02:07 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:02:08.021697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303349-2e30-4313-a752-cfe6557e48a0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:08.061411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303349-2e30-4313-a752-cfe6557e48a0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:08.083480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d8cc0-a36d-4a1c-9ad6-e29af05f7c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:08.085606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d8cc0-a36d-4a1c-9ad6-e29af05f7c56 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:08.085877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d8cc0-a36d-4a1c-9ad6-e29af05f7c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:08.086155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d8cc0-a36d-4a1c-9ad6-e29af05f7c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:08.092898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d8cc0-a36d-4a1c-9ad6-e29af05f7c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:08.100945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d8cc0-a36d-4a1c-9ad6-e29af05f7c56 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:08.129969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d821b-1a85-4326-a8a7-b8ebf67f6bfd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:08.144962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d821b-1a85-4326-a8a7-b8ebf67f6bfd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:08.146074 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2840/5688] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:02:08 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:02:08.157671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfe48e-ed31-455b-a0dc-283d7f204155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:08.160386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfe48e-ed31-455b-a0dc-283d7f204155 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:08.161679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfe48e-ed31-455b-a0dc-283d7f204155 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:08.162136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfe48e-ed31-455b-a0dc-283d7f204155 admin admin] PATH_INFO: `/v3/projects/d9d1e6b0d61d4bcbbbe91d51cc7e9166/users/e470fd317e56435bb31eb2f31cc9ddbd/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:08.213368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edfe48e-ed31-455b-a0dc-283d7f204155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d1e6b0d61d4bcbbbe91d51cc7e9166, user_id=e470fd317e56435bb31eb2f31cc9ddbd, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:08.216568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edfe48e-ed31-455b-a0dc-283d7f204155 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:08.259036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91650-cc39-4f09-bb8b-317bcba5dfbf None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:08.259480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91650-cc39-4f09-bb8b-317bcba5dfbf None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:08.259694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb91650-cc39-4f09-bb8b-317bcba5dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:08.261048 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2849/5689] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:02:08 2021] PUT /identity/v3/projects/d9d1e6b0d61d4bcbbbe91d51cc7e9166/users/e470fd317e56435bb31eb2f31cc9ddbd/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:02:08.312986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-aeb91650-cc39-4f09-bb8b-317bcba5dfbf None None] MFA Rules not processed for user `e470fd317e56435bb31eb2f31cc9ddbd`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:08.314231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aeb91650-cc39-4f09-bb8b-317bcba5dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:08.452185 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2841/5690] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:08 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:08.456892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfe48e-ed31-455b-a0dc-283d7f204155 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:08.566227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfe48e-ed31-455b-a0dc-283d7f204155 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:08.573327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c46bab-5288-467b-aefe-b1c81deb118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:08.574345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c46bab-5288-467b-aefe-b1c81deb118b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:08.574807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c46bab-5288-467b-aefe-b1c81deb118b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:08.576082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c46bab-5288-467b-aefe-b1c81deb118b admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:08.576973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c46bab-5288-467b-aefe-b1c81deb118b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:08.580243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c46bab-5288-467b-aefe-b1c81deb118b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:08.637227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb91650-cc39-4f09-bb8b-317bcba5dfbf None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:08.638269 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2850/5691] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:02:08 2021] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:02:08.660590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb91650-cc39-4f09-bb8b-317bcba5dfbf None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:08.790289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587584dd-88b4-4f08-8fc0-c203a1a6d57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:08.791076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587584dd-88b4-4f08-8fc0-c203a1a6d57b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:08.791455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587584dd-88b4-4f08-8fc0-c203a1a6d57b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:08.791806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587584dd-88b4-4f08-8fc0-c203a1a6d57b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:08.796089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587584dd-88b4-4f08-8fc0-c203a1a6d57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:08.800664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587584dd-88b4-4f08-8fc0-c203a1a6d57b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:08.830808 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2842/5692] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:02:08 2021] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:02:08.836443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c46bab-5288-467b-aefe-b1c81deb118b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:08.848378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c46bab-5288-467b-aefe-b1c81deb118b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:08.863447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7f005-e234-4771-86ff-b91162caf659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:08.864705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7f005-e234-4771-86ff-b91162caf659 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:08.865178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7f005-e234-4771-86ff-b91162caf659 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:08.865474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7f005-e234-4771-86ff-b91162caf659 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:08.867350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7f005-e234-4771-86ff-b91162caf659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:08.870109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7f005-e234-4771-86ff-b91162caf659 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:08.900239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587584dd-88b4-4f08-8fc0-c203a1a6d57b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:08.900962 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2851/5693] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:02:08 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:02:08.912686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587584dd-88b4-4f08-8fc0-c203a1a6d57b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:08.924245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890e812-ec4f-4406-b030-9a0393769ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:08.925736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890e812-ec4f-4406-b030-9a0393769ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:08.926267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890e812-ec4f-4406-b030-9a0393769ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:08.926753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890e812-ec4f-4406-b030-9a0393769ed3 admin admin] PATH_INFO: `/v3/projects/85921763e45844afa1280d7cde0cf668/users/2e694a6a415b4df698b77d5e932eb0d3/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:08.955019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890e812-ec4f-4406-b030-9a0393769ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85921763e45844afa1280d7cde0cf668, user_id=2e694a6a415b4df698b77d5e932eb0d3, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:08.959715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890e812-ec4f-4406-b030-9a0393769ed3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:08.982135 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2843/5694] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:02:08 2021] PUT /identity/v3/projects/85921763e45844afa1280d7cde0cf668/users/2e694a6a415b4df698b77d5e932eb0d3/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:02:08.987875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7f005-e234-4771-86ff-b91162caf659 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:09.006100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7f005-e234-4771-86ff-b91162caf659 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:09.093820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f86614-71ca-44ed-b48a-32356abbb045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:09.094499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f86614-71ca-44ed-b48a-32356abbb045 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:09.095116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f86614-71ca-44ed-b48a-32356abbb045 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:09.095116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f86614-71ca-44ed-b48a-32356abbb045 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:09.095924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f86614-71ca-44ed-b48a-32356abbb045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:09.097599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f86614-71ca-44ed-b48a-32356abbb045 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:09.110022 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2852/5695] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:02:08 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:02:09.114122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890e812-ec4f-4406-b030-9a0393769ed3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:09.126010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890e812-ec4f-4406-b030-9a0393769ed3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:09.133035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e401e-8a54-42d3-b796-487af44ea5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:09.134980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e401e-8a54-42d3-b796-487af44ea5de admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:09.135472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e401e-8a54-42d3-b796-487af44ea5de admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:09.135899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e401e-8a54-42d3-b796-487af44ea5de admin admin] PATH_INFO: `/v3/projects/85921763e45844afa1280d7cde0cf668/users/2e694a6a415b4df698b77d5e932eb0d3/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:09.139765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e401e-8a54-42d3-b796-487af44ea5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=85921763e45844afa1280d7cde0cf668, user_id=2e694a6a415b4df698b77d5e932eb0d3, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:09.142646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e401e-8a54-42d3-b796-487af44ea5de admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:09.154699 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2844/5696] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:02:09 2021] PUT /identity/v3/projects/85921763e45844afa1280d7cde0cf668/users/2e694a6a415b4df698b77d5e932eb0d3/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:02:09.166496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb6e3f-ad69-4cf6-b73c-a8e515bd40c3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:09.166496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb6e3f-ad69-4cf6-b73c-a8e515bd40c3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:09.166767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb6e3f-ad69-4cf6-b73c-a8e515bd40c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:09.197774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a0eb6e3f-ad69-4cf6-b73c-a8e515bd40c3 None None] MFA Rules not processed for user `2e694a6a415b4df698b77d5e932eb0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:09.199008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a0eb6e3f-ad69-4cf6-b73c-a8e515bd40c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:09.308254 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2853/5697] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:09 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:02:09.326390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e401e-8a54-42d3-b796-487af44ea5de admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:09.328520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1a1e401e-8a54-42d3-b796-487af44ea5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:09.434085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e401e-8a54-42d3-b796-487af44ea5de admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:09.459165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9d7b0-2a5a-4e02-9006-7fde3cc83c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:09.460226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9d7b0-2a5a-4e02-9006-7fde3cc83c72 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:09.460732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9d7b0-2a5a-4e02-9006-7fde3cc83c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:09.461208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9d7b0-2a5a-4e02-9006-7fde3cc83c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:09.477526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9d7b0-2a5a-4e02-9006-7fde3cc83c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:09.484726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9d7b0-2a5a-4e02-9006-7fde3cc83c72 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:09.498506 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2845/5698] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:02:09 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:13.010933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb6e3f-ad69-4cf6-b73c-a8e515bd40c3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:13.017011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a0eb6e3f-ad69-4cf6-b73c-a8e515bd40c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:13.113235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb6e3f-ad69-4cf6-b73c-a8e515bd40c3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:13.119729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ed835-074d-49dd-97df-ccd1fdc76183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:13.121548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ed835-074d-49dd-97df-ccd1fdc76183 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:13.122101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ed835-074d-49dd-97df-ccd1fdc76183 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:13.122382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ed835-074d-49dd-97df-ccd1fdc76183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:13.124216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bc5ed835-074d-49dd-97df-ccd1fdc76183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:13.139134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ed835-074d-49dd-97df-ccd1fdc76183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:13.140753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ed835-074d-49dd-97df-ccd1fdc76183 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:13.178051 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2854/5699] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:02:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:21.461801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9d7b0-2a5a-4e02-9006-7fde3cc83c72 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:21.473644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9d7b0-2a5a-4e02-9006-7fde3cc83c72 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:21.490569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5e328-1a15-4e75-9424-d3fd4189166b tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694a6a415b4df698b77d5e932eb0d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85921763e45844afa1280d7cde0cf668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:21.491281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e328-1a15-4e75-9424-d3fd4189166b tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:21.491548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e328-1a15-4e75-9424-d3fd4189166b tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:21.492305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5e328-1a15-4e75-9424-d3fd4189166b tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:21.493219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5e328-1a15-4e75-9424-d3fd4189166b tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:02:21.493533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5e328-1a15-4e75-9424-d3fd4189166b tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:21.495152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5e328-1a15-4e75-9424-d3fd4189166b tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:21.545550 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2846/5700] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:02:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:02:21.547827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ed835-074d-49dd-97df-ccd1fdc76183 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:21.565202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ed835-074d-49dd-97df-ccd1fdc76183 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:21.575270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80c33-fb01-4194-b882-05446abafc22 tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694a6a415b4df698b77d5e932eb0d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85921763e45844afa1280d7cde0cf668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:21.575956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80c33-fb01-4194-b882-05446abafc22 tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:21.576243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80c33-fb01-4194-b882-05446abafc22 tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:21.578686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb80c33-fb01-4194-b882-05446abafc22 tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:21.579458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb80c33-fb01-4194-b882-05446abafc22 tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:21.585643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb80c33-fb01-4194-b882-05446abafc22 tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:21.651617 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2855/5701] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:02:21 2021] POST /identity/v3/projects => generated 349 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:02:21.656355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5e328-1a15-4e75-9424-d3fd4189166b tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:21.693418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5e328-1a15-4e75-9424-d3fd4189166b tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:21.963964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba614f30-9fb7-46d8-87d1-4b948d6e06ee tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694a6a415b4df698b77d5e932eb0d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85921763e45844afa1280d7cde0cf668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:21.965922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba614f30-9fb7-46d8-87d1-4b948d6e06ee tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:21.966465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba614f30-9fb7-46d8-87d1-4b948d6e06ee tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:21.967115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba614f30-9fb7-46d8-87d1-4b948d6e06ee tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:21.968159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba614f30-9fb7-46d8-87d1-4b948d6e06ee tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:02:21.968717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba614f30-9fb7-46d8-87d1-4b948d6e06ee tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:21.970757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba614f30-9fb7-46d8-87d1-4b948d6e06ee tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:21.990183 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2847/5702] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:02:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:02:23.175504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80c33-fb01-4194-b882-05446abafc22 tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:23.192620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96de472-4935-418a-a4e0-b54989e19549 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:23.193370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96de472-4935-418a-a4e0-b54989e19549 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:23.193370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96de472-4935-418a-a4e0-b54989e19549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:23.202987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb80c33-fb01-4194-b882-05446abafc22 tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:23.211539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e694a6a415b4df698b77d5e932eb0d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '85921763e45844afa1280d7cde0cf668', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:23.212428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:23.212713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:23.213837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e96de472-4935-418a-a4e0-b54989e19549 None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:23.215731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] PATH_INFO: `/v3/projects/962fc8f179994be7b75efa22a1a6d032` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:23.215941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e96de472-4935-418a-a4e0-b54989e19549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:23.217742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: Authorizing `identity:delete_project(project_id=962fc8f179994be7b75efa22a1a6d032)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:23.222847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:23.280680 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2848/5703] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:23 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:02:23.334441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962fc8f179994be7b75efa22a1a6d032', 'request_id': 'req-4577825e-1e8e-4aac-8de6-6478dad572fb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:23.348195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962fc8f179994be7b75efa22a1a6d032', 'request_id': 'req-4577825e-1e8e-4aac-8de6-6478dad572fb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:23.357605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962fc8f179994be7b75efa22a1a6d032', 'request_id': 'req-4577825e-1e8e-4aac-8de6-6478dad572fb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:23.379112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] The token cache is being invalidate because project 962fc8f179994be7b75efa22a1a6d032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:02:23.379417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:23.380369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:02:23.386168 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2856/5704] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:02:23 2021] DELETE /identity/v3/projects/962fc8f179994be7b75efa22a1a6d032 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:02:23.396798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96de472-4935-418a-a4e0-b54989e19549 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:23.488654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96de472-4935-418a-a4e0-b54989e19549 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:23.590938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45d61c-58e6-4048-93a1-6256267f89f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:23.591636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45d61c-58e6-4048-93a1-6256267f89f4 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:23.591966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45d61c-58e6-4048-93a1-6256267f89f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:23.592243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45d61c-58e6-4048-93a1-6256267f89f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:23.598104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cc45d61c-58e6-4048-93a1-6256267f89f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:23.758195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45d61c-58e6-4048-93a1-6256267f89f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:23.759866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45d61c-58e6-4048-93a1-6256267f89f4 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:23.772339 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2849/5705] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:02:23 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:23.960085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:23.961701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:23.997594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577825e-1e8e-4aac-8de6-6478dad572fb tempest-RoutersAdminTest-787650200 tempest-RoutersAdminTest-787650200-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:24.003222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b241c-c7bc-453e-b0e7-55bff22e0682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:24.005285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b241c-c7bc-453e-b0e7-55bff22e0682 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:24.006206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b241c-c7bc-453e-b0e7-55bff22e0682 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:24.006864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b241c-c7bc-453e-b0e7-55bff22e0682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:24.010705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-782b241c-c7bc-453e-b0e7-55bff22e0682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:24.035111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b241c-c7bc-453e-b0e7-55bff22e0682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:24.035111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b241c-c7bc-453e-b0e7-55bff22e0682 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:24.062695 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2857/5706] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:02:23 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:30.524310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac405b2-6bef-4cdc-a9f9-3c522c27941d None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:30.524856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac405b2-6bef-4cdc-a9f9-3c522c27941d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:30.524856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac405b2-6bef-4cdc-a9f9-3c522c27941d None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:30.527927 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2850/5707] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 21:02:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 21:02:30.538147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1141f-c15e-423e-ab84-8cfd407ed429 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:30.538749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1141f-c15e-423e-ab84-8cfd407ed429 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:30.538749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1141f-c15e-423e-ab84-8cfd407ed429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:30.589550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f0f1141f-c15e-423e-ab84-8cfd407ed429 None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:30.591807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f0f1141f-c15e-423e-ab84-8cfd407ed429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:30.600561 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2858/5708] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:02:30 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:30.626419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac405b2-6bef-4cdc-a9f9-3c522c27941d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:02:30.646583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac405b2-6bef-4cdc-a9f9-3c522c27941d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:02:30.658564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2498c-7e94-4c4a-835b-6b684efaf91a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:02:30.659822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2498c-7e94-4c4a-835b-6b684efaf91a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:30.660305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2498c-7e94-4c4a-835b-6b684efaf91a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:30.660809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2498c-7e94-4c4a-835b-6b684efaf91a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:30.670966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2498c-7e94-4c4a-835b-6b684efaf91a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:02:30.672815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2498c-7e94-4c4a-835b-6b684efaf91a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:02:30.684304 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2851/5709] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:02:30 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:02:46.087160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a283e-c08f-4e57-9985-67c3208c33f9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:46.088236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a283e-c08f-4e57-9985-67c3208c33f9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:46.088762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a283e-c08f-4e57-9985-67c3208c33f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:46.108335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-153a283e-c08f-4e57-9985-67c3208c33f9 None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:46.109936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-153a283e-c08f-4e57-9985-67c3208c33f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:46.179175 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2859/5710] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:46 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:48.762915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1d49-d5df-49b3-928e-3df84618ffbc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:48.763553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1d49-d5df-49b3-928e-3df84618ffbc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:48.763553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e1d49-d5df-49b3-928e-3df84618ffbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:48.802171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f19e1d49-d5df-49b3-928e-3df84618ffbc None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:48.810238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f19e1d49-d5df-49b3-928e-3df84618ffbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:48.823222 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2852/5711] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:48 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:51.999917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b00f0-8bbc-4549-b45b-b6deb018da67 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:52.000445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b00f0-8bbc-4549-b45b-b6deb018da67 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:52.000618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b00f0-8bbc-4549-b45b-b6deb018da67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:52.047649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d90b00f0-8bbc-4549-b45b-b6deb018da67 None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:52.049362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d90b00f0-8bbc-4549-b45b-b6deb018da67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:52.061019 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2860/5712] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:51 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:53.060942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4f894-fe8e-4f9c-b7d4-c742609ee410 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:53.061532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4f894-fe8e-4f9c-b7d4-c742609ee410 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:53.061855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4f894-fe8e-4f9c-b7d4-c742609ee410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:53.110014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-79b4f894-fe8e-4f9c-b7d4-c742609ee410 None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:53.114811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-79b4f894-fe8e-4f9c-b7d4-c742609ee410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:53.144207 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2853/5713] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:53 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:54.750097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c4223-4840-4ac2-a143-e3275375f153 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:54.750594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c4223-4840-4ac2-a143-e3275375f153 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:54.751410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c4223-4840-4ac2-a143-e3275375f153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:54.779235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e79c4223-4840-4ac2-a143-e3275375f153 None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:54.781042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e79c4223-4840-4ac2-a143-e3275375f153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:54.791847 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2861/5714] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:54 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:55.999211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec24dc-dc8e-43ea-80f3-0e3cf472fa89 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:56.000262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec24dc-dc8e-43ea-80f3-0e3cf472fa89 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:56.000725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec24dc-dc8e-43ea-80f3-0e3cf472fa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:56.029763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-bdec24dc-dc8e-43ea-80f3-0e3cf472fa89 None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:56.031698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bdec24dc-dc8e-43ea-80f3-0e3cf472fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:56.056911 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2854/5715] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:55 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:02:56.991159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779058-6377-44c7-9fa6-c5e32b72c5b6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:56.991771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779058-6377-44c7-9fa6-c5e32b72c5b6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:56.991771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779058-6377-44c7-9fa6-c5e32b72c5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:57.026641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-13779058-6377-44c7-9fa6-c5e32b72c5b6 None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:57.037707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-13779058-6377-44c7-9fa6-c5e32b72c5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:57.047743 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2862/5716] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:56 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:58.237134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf68e25-ffd6-46f2-befa-74ec9d7f6ed8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:58.237725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf68e25-ffd6-46f2-befa-74ec9d7f6ed8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:58.237725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf68e25-ffd6-46f2-befa-74ec9d7f6ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:58.258396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fdf68e25-ffd6-46f2-befa-74ec9d7f6ed8 None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:58.260101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fdf68e25-ffd6-46f2-befa-74ec9d7f6ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:58.273172 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2855/5717] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:58 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:02:59.390351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce816-b06c-4d7e-950c-ba6330bbb878 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:02:59.391278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce816-b06c-4d7e-950c-ba6330bbb878 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:02:59.391639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ce816-b06c-4d7e-950c-ba6330bbb878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:02:59.419057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-746ce816-b06c-4d7e-950c-ba6330bbb878 None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:02:59.419456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-746ce816-b06c-4d7e-950c-ba6330bbb878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:02:59.451416 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2863/5718] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:02:59 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:01.344672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11f3c-7bf6-4dbd-af38-0f72fd586cdb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:01.345279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11f3c-7bf6-4dbd-af38-0f72fd586cdb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:01.345279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11f3c-7bf6-4dbd-af38-0f72fd586cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:01.381962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f1d11f3c-7bf6-4dbd-af38-0f72fd586cdb None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:01.384353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f1d11f3c-7bf6-4dbd-af38-0f72fd586cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:01.407386 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2856/5719] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:01 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:10.943379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513315d-dd56-4e10-bc2f-837c2bfbc691 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:10.943379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513315d-dd56-4e10-bc2f-837c2bfbc691 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:10.943379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513315d-dd56-4e10-bc2f-837c2bfbc691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:10.968117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d513315d-dd56-4e10-bc2f-837c2bfbc691 None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:10.970022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d513315d-dd56-4e10-bc2f-837c2bfbc691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:10.980915 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2864/5720] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:10 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:12.173928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64611952-11bc-443e-9d28-9240c8fced25 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:12.176125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64611952-11bc-443e-9d28-9240c8fced25 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:12.177893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64611952-11bc-443e-9d28-9240c8fced25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:12.214237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-64611952-11bc-443e-9d28-9240c8fced25 None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:12.215800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-64611952-11bc-443e-9d28-9240c8fced25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:12.232903 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2857/5721] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:12 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:25.810456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513315d-dd56-4e10-bc2f-837c2bfbc691 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:25.812082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d513315d-dd56-4e10-bc2f-837c2bfbc691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:25.879677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513315d-dd56-4e10-bc2f-837c2bfbc691 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:25.884055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be440f-8577-4d3e-89c7-43c7a61c2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:25.885525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be440f-8577-4d3e-89c7-43c7a61c2097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:25.885804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be440f-8577-4d3e-89c7-43c7a61c2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:25.886080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be440f-8577-4d3e-89c7-43c7a61c2097 admin admin] PATH_INFO: `/v3/users/1ca08ebddb1742d18951633bf019d743` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:25.887407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be440f-8577-4d3e-89c7-43c7a61c2097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca08ebddb1742d18951633bf019d743)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:25.889320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be440f-8577-4d3e-89c7-43c7a61c2097 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:25.962671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-24be440f-8577-4d3e-89c7-43c7a61c2097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca08ebddb1742d18951633bf019d743'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:25.974181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-24be440f-8577-4d3e-89c7-43c7a61c2097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca08ebddb1742d18951633bf019d743'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:25.975327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-24be440f-8577-4d3e-89c7-43c7a61c2097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca08ebddb1742d18951633bf019d743'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:25.984575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-24be440f-8577-4d3e-89c7-43c7a61c2097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca08ebddb1742d18951633bf019d743'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:26.010367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-24be440f-8577-4d3e-89c7-43c7a61c2097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca08ebddb1742d18951633bf019d743'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:26.020507 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2865/5722] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:25 2021] DELETE /identity/v3/users/1ca08ebddb1742d18951633bf019d743 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:26.478226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64611952-11bc-443e-9d28-9240c8fced25 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:26.518327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64611952-11bc-443e-9d28-9240c8fced25 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:26.748032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:26.749014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:26.749149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:26.749423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] PATH_INFO: `/v3/projects/2a621d68a46c42269f2eea4bc56c671f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:26.760923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a621d68a46c42269f2eea4bc56c671f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:26.768114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:26.868372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a621d68a46c42269f2eea4bc56c671f', 'request_id': 'req-0efc7b47-e8bb-4127-af45-95787ac272f2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:26.876285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a621d68a46c42269f2eea4bc56c671f', 'request_id': 'req-0efc7b47-e8bb-4127-af45-95787ac272f2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:26.889154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a621d68a46c42269f2eea4bc56c671f', 'request_id': 'req-0efc7b47-e8bb-4127-af45-95787ac272f2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:26.907351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] The token cache is being invalidate because project 2a621d68a46c42269f2eea4bc56c671f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:03:26.907866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:26.908646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0efc7b47-e8bb-4127-af45-95787ac272f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:26.910444 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2858/5723] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:03:26 2021] DELETE /identity/v3/projects/2a621d68a46c42269f2eea4bc56c671f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:26.917191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8345-ceae-467e-8067-7720d232d477 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:26.918501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8345-ceae-467e-8067-7720d232d477 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:26.919081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8345-ceae-467e-8067-7720d232d477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:26.946652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-559e8345-ceae-467e-8067-7720d232d477 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:26.948761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-559e8345-ceae-467e-8067-7720d232d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:27.018128 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2866/5724] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:03:27.024563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb62f2b-d2ba-4a75-8600-883171fe3ca8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:27.025857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb62f2b-d2ba-4a75-8600-883171fe3ca8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:27.026618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb62f2b-d2ba-4a75-8600-883171fe3ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:27.049554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0fb62f2b-d2ba-4a75-8600-883171fe3ca8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:27.051491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0fb62f2b-d2ba-4a75-8600-883171fe3ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:27.093188 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2859/5725] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:27.098346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8345-ceae-467e-8067-7720d232d477 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:27.118014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8345-ceae-467e-8067-7720d232d477 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:27.125333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb3c54-0286-4497-a221-d8d4435b00a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:27.126212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3c54-0286-4497-a221-d8d4435b00a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:27.127352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3c54-0286-4497-a221-d8d4435b00a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:27.127833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3c54-0286-4497-a221-d8d4435b00a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:27.129391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb3c54-0286-4497-a221-d8d4435b00a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:03:27.130628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb3c54-0286-4497-a221-d8d4435b00a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:27.133286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb3c54-0286-4497-a221-d8d4435b00a8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:27.155753 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2867/5726] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:03:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:03:27.155927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb62f2b-d2ba-4a75-8600-883171fe3ca8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:27.168304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb62f2b-d2ba-4a75-8600-883171fe3ca8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:27.175208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ad8f8-204b-4b32-a5c9-e0d8b3b79bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:27.176460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ad8f8-204b-4b32-a5c9-e0d8b3b79bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:27.177042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ad8f8-204b-4b32-a5c9-e0d8b3b79bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:27.177585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ad8f8-204b-4b32-a5c9-e0d8b3b79bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:27.178466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ad8f8-204b-4b32-a5c9-e0d8b3b79bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:27.180636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ad8f8-204b-4b32-a5c9-e0d8b3b79bd1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:27.222731 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2860/5727] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:03:27 2021] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:27.227456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb3c54-0286-4497-a221-d8d4435b00a8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:27.245480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb3c54-0286-4497-a221-d8d4435b00a8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:27.351029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a21ca-f465-4166-8e12-98f01b421129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:27.354148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a21ca-f465-4166-8e12-98f01b421129 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:27.354491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a21ca-f465-4166-8e12-98f01b421129 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:27.354789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a21ca-f465-4166-8e12-98f01b421129 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:27.356649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a21ca-f465-4166-8e12-98f01b421129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:27.360321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a21ca-f465-4166-8e12-98f01b421129 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:27.416566 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2868/5728] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:03:27 2021] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:27.418979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ad8f8-204b-4b32-a5c9-e0d8b3b79bd1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:27.443074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ad8f8-204b-4b32-a5c9-e0d8b3b79bd1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:27.471473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db7787-0715-4e2e-bf3a-b2cbac9506dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:27.472252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7787-0715-4e2e-bf3a-b2cbac9506dd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:27.472544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7787-0715-4e2e-bf3a-b2cbac9506dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:27.472822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7787-0715-4e2e-bf3a-b2cbac9506dd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:27.473579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db7787-0715-4e2e-bf3a-b2cbac9506dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:27.483960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db7787-0715-4e2e-bf3a-b2cbac9506dd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:27.512817 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2861/5729] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:27 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:27.515780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a21ca-f465-4166-8e12-98f01b421129 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:27.530090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a21ca-f465-4166-8e12-98f01b421129 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:27.545635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227690fa-712a-4d75-94de-7cea9973e9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:27.546327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227690fa-712a-4d75-94de-7cea9973e9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:27.546760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227690fa-712a-4d75-94de-7cea9973e9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:27.547039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227690fa-712a-4d75-94de-7cea9973e9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:27.547811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227690fa-712a-4d75-94de-7cea9973e9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:27.553631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227690fa-712a-4d75-94de-7cea9973e9d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:27.579533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db7787-0715-4e2e-bf3a-b2cbac9506dd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:27.585583 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2869/5730] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:27 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:27.591879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db7787-0715-4e2e-bf3a-b2cbac9506dd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:27.599494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689fd58-583e-4c78-bb2b-0803d2c0c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:27.601543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689fd58-583e-4c78-bb2b-0803d2c0c081 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:27.602003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689fd58-583e-4c78-bb2b-0803d2c0c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:27.602889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689fd58-583e-4c78-bb2b-0803d2c0c081 admin admin] PATH_INFO: `/v3/projects/fbe5ff330fa94dce90ceb417549101a1/users/909441655c7c49d2b68a0a589f5c422b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:27.625918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689fd58-583e-4c78-bb2b-0803d2c0c081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe5ff330fa94dce90ceb417549101a1, user_id=909441655c7c49d2b68a0a589f5c422b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:27.636043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689fd58-583e-4c78-bb2b-0803d2c0c081 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:27.667808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981ebb3-637f-46c8-9a1f-22484368d559 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:27.669063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981ebb3-637f-46c8-9a1f-22484368d559 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:27.669546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981ebb3-637f-46c8-9a1f-22484368d559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:27.671150 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2862/5731] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:27 2021] PUT /identity/v3/projects/fbe5ff330fa94dce90ceb417549101a1/users/909441655c7c49d2b68a0a589f5c422b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:27.711465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8981ebb3-637f-46c8-9a1f-22484368d559 None None] MFA Rules not processed for user `909441655c7c49d2b68a0a589f5c422b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:27.713594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8981ebb3-637f-46c8-9a1f-22484368d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:27.828076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180977c-e6ec-49a9-8724-6504f91a4291 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:27.828628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180977c-e6ec-49a9-8724-6504f91a4291 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:27.829106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180977c-e6ec-49a9-8724-6504f91a4291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:27.831231 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2870/5732] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:27 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:27.852518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e58c37-54b9-4ca2-b9fd-b4b601460d4c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:27.855280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e58c37-54b9-4ca2-b9fd-b4b601460d4c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:27.855601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e58c37-54b9-4ca2-b9fd-b4b601460d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:27.876060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f180977c-e6ec-49a9-8724-6504f91a4291 None None] MFA Rules not processed for user `909441655c7c49d2b68a0a589f5c422b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:27.883015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f180977c-e6ec-49a9-8724-6504f91a4291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:27.908671 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2863/5733] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:27 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:27.909894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-74e58c37-54b9-4ca2-b9fd-b4b601460d4c None None] MFA Rules not processed for user `9a60782e0d8945c2b99dac616fda491d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:27.911310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-74e58c37-54b9-4ca2-b9fd-b4b601460d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:27.914641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180977c-e6ec-49a9-8724-6504f91a4291 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:27.917919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f180977c-e6ec-49a9-8724-6504f91a4291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:28.024688 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2871/5734] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:27 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:28.049057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180977c-e6ec-49a9-8724-6504f91a4291 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:28.056057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f8959-0d31-4d0d-87dc-27fcb1c464f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:28.057943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f8959-0d31-4d0d-87dc-27fcb1c464f7 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:28.058725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f8959-0d31-4d0d-87dc-27fcb1c464f7 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:28.059050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f8959-0d31-4d0d-87dc-27fcb1c464f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:28.075598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f8959-0d31-4d0d-87dc-27fcb1c464f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:28.077692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f8959-0d31-4d0d-87dc-27fcb1c464f7 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:28.097403 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2864/5735] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:27 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:03:32.119795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e58c37-54b9-4ca2-b9fd-b4b601460d4c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:32.121203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-74e58c37-54b9-4ca2-b9fd-b4b601460d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:32.223156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e58c37-54b9-4ca2-b9fd-b4b601460d4c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:32.229592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:32.230517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:32.230799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:32.231074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] PATH_INFO: `/v3/users/e470fd317e56435bb31eb2f31cc9ddbd` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:32.235048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e470fd317e56435bb31eb2f31cc9ddbd)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:32.237065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:32.291963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e470fd317e56435bb31eb2f31cc9ddbd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.300768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e470fd317e56435bb31eb2f31cc9ddbd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.301501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e470fd317e56435bb31eb2f31cc9ddbd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.310310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e470fd317e56435bb31eb2f31cc9ddbd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.326877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e470fd317e56435bb31eb2f31cc9ddbd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.336476 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2872/5736] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:32 2021] DELETE /identity/v3/users/e470fd317e56435bb31eb2f31cc9ddbd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:32.338355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad010b8-92f1-45e3-a1aa-ff7d6f02164e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:32.338829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad010b8-92f1-45e3-a1aa-ff7d6f02164e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:32.338940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad010b8-92f1-45e3-a1aa-ff7d6f02164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:32.363851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-dad010b8-92f1-45e3-a1aa-ff7d6f02164e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:32.365449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dad010b8-92f1-45e3-a1aa-ff7d6f02164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:32.444948 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2865/5737] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:32.455477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:32.456851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:32.537304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c4156-0aaa-48d2-b100-0363c123d0f3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:32.547550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff6c60-14ab-48f4-b280-095e6ac4c96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:32.548215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6c60-14ab-48f4-b280-095e6ac4c96f service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:32.548497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6c60-14ab-48f4-b280-095e6ac4c96f service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:32.548766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6c60-14ab-48f4-b280-095e6ac4c96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:32.559238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff6c60-14ab-48f4-b280-095e6ac4c96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:32.561456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff6c60-14ab-48f4-b280-095e6ac4c96f service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:32.575118 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2873/5738] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:32.629616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad010b8-92f1-45e3-a1aa-ff7d6f02164e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:32.631684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dad010b8-92f1-45e3-a1aa-ff7d6f02164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:32.651227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad010b8-92f1-45e3-a1aa-ff7d6f02164e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:32.656910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9371220-e464-4052-ae39-0fab7c8cebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:32.657980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9371220-e464-4052-ae39-0fab7c8cebc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:32.658262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9371220-e464-4052-ae39-0fab7c8cebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:32.658872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9371220-e464-4052-ae39-0fab7c8cebc9 admin admin] PATH_INFO: `/v3/users/a46b9bd96c834b85b57f9fc0be51d4b7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:32.660390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9371220-e464-4052-ae39-0fab7c8cebc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a46b9bd96c834b85b57f9fc0be51d4b7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:32.668049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9371220-e464-4052-ae39-0fab7c8cebc9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:32.702386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff6c60-14ab-48f4-b280-095e6ac4c96f service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:32.704191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4eff6c60-14ab-48f4-b280-095e6ac4c96f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:32.721525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff6c60-14ab-48f4-b280-095e6ac4c96f service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:32.743239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0345d8-050c-43a7-8932-8a3702915089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:32.746965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0345d8-050c-43a7-8932-8a3702915089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:32.747283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0345d8-050c-43a7-8932-8a3702915089 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:32.747518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c9371220-e464-4052-ae39-0fab7c8cebc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46b9bd96c834b85b57f9fc0be51d4b7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.748359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c9371220-e464-4052-ae39-0fab7c8cebc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46b9bd96c834b85b57f9fc0be51d4b7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.748671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0345d8-050c-43a7-8932-8a3702915089 admin admin] PATH_INFO: `/v3/users/60c6f5cb617f448585d371437a4df374` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:32.751124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0345d8-050c-43a7-8932-8a3702915089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c6f5cb617f448585d371437a4df374)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:32.758450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c9371220-e464-4052-ae39-0fab7c8cebc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46b9bd96c834b85b57f9fc0be51d4b7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.759481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c9371220-e464-4052-ae39-0fab7c8cebc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46b9bd96c834b85b57f9fc0be51d4b7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.764178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0345d8-050c-43a7-8932-8a3702915089 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:32.778205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c9371220-e464-4052-ae39-0fab7c8cebc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46b9bd96c834b85b57f9fc0be51d4b7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.801724 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2866/5739] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:32 2021] DELETE /identity/v3/users/a46b9bd96c834b85b57f9fc0be51d4b7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:32.807234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe3c9a-8be0-4cef-830c-53abbe858210 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:32.807639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe3c9a-8be0-4cef-830c-53abbe858210 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:32.807986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe3c9a-8be0-4cef-830c-53abbe858210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:32.820690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4a0345d8-050c-43a7-8932-8a3702915089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c6f5cb617f448585d371437a4df374'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.826762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fcbe3c9a-8be0-4cef-830c-53abbe858210 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:32.828139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fcbe3c9a-8be0-4cef-830c-53abbe858210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:32.830169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4a0345d8-050c-43a7-8932-8a3702915089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c6f5cb617f448585d371437a4df374'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.831147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4a0345d8-050c-43a7-8932-8a3702915089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c6f5cb617f448585d371437a4df374'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.843137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4a0345d8-050c-43a7-8932-8a3702915089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c6f5cb617f448585d371437a4df374'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.859435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4a0345d8-050c-43a7-8932-8a3702915089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c6f5cb617f448585d371437a4df374'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:32.870380 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2874/5740] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:32 2021] DELETE /identity/v3/users/60c6f5cb617f448585d371437a4df374 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:03:32.870928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014928a-8795-4e40-8fdf-22ab513a6673 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:32.871218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014928a-8795-4e40-8fdf-22ab513a6673 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:32.871522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014928a-8795-4e40-8fdf-22ab513a6673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:32.889902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4014928a-8795-4e40-8fdf-22ab513a6673 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:32.891110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4014928a-8795-4e40-8fdf-22ab513a6673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:32.905195 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2867/5741] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:32.915936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe3c9a-8be0-4cef-830c-53abbe858210 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:32.917429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fcbe3c9a-8be0-4cef-830c-53abbe858210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:32.956532 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2875/5742] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:32.967402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014928a-8795-4e40-8fdf-22ab513a6673 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:32.970415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4014928a-8795-4e40-8fdf-22ab513a6673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.016872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe3c9a-8be0-4cef-830c-53abbe858210 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.046830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014928a-8795-4e40-8fdf-22ab513a6673 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.051769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21d722-7955-40d6-a2ef-c566c9e9b1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.052484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21d722-7955-40d6-a2ef-c566c9e9b1ee service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.052772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21d722-7955-40d6-a2ef-c566c9e9b1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.053048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21d722-7955-40d6-a2ef-c566c9e9b1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.064177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21d722-7955-40d6-a2ef-c566c9e9b1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.065649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21d722-7955-40d6-a2ef-c566c9e9b1ee service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.070161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1907d-c8fa-40af-a9ee-17ceb064364a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.070797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1907d-c8fa-40af-a9ee-17ceb064364a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.071086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1907d-c8fa-40af-a9ee-17ceb064364a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.071412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1907d-c8fa-40af-a9ee-17ceb064364a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.075161 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2876/5743] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:33.075988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21d722-7955-40d6-a2ef-c566c9e9b1ee service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.077357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0f21d722-7955-40d6-a2ef-c566c9e9b1ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.081215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1907d-c8fa-40af-a9ee-17ceb064364a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.082879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1907d-c8fa-40af-a9ee-17ceb064364a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.090384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21d722-7955-40d6-a2ef-c566c9e9b1ee service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.093308 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2868/5744] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:03:33.095502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.096336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.096611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.096879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] PATH_INFO: `/v3/projects/d9d1e6b0d61d4bcbbbe91d51cc7e9166` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.098074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d1e6b0d61d4bcbbbe91d51cc7e9166)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.100002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.146717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d1e6b0d61d4bcbbbe91d51cc7e9166', 'request_id': 'req-7832716a-0ac0-47c7-b60b-5fd10fcb5028'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.157170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d1e6b0d61d4bcbbbe91d51cc7e9166', 'request_id': 'req-7832716a-0ac0-47c7-b60b-5fd10fcb5028'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.175592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d1e6b0d61d4bcbbbe91d51cc7e9166', 'request_id': 'req-7832716a-0ac0-47c7-b60b-5fd10fcb5028'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.201429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] The token cache is being invalidate because project d9d1e6b0d61d4bcbbbe91d51cc7e9166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:03:33.201909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.203004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.204976 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2877/5745] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:03:33 2021] DELETE /identity/v3/projects/d9d1e6b0d61d4bcbbbe91d51cc7e9166 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:33.209127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1907d-c8fa-40af-a9ee-17ceb064364a service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.221456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1907d-c8fa-40af-a9ee-17ceb064364a service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.294121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.294338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.295229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.295560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.295837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] PATH_INFO: `/v3/users/2e694a6a415b4df698b77d5e932eb0d3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.296550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.297888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e694a6a415b4df698b77d5e932eb0d3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.300635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.329219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832716a-0ac0-47c7-b60b-5fd10fcb5028 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.339218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.340472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.340957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.341414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] PATH_INFO: `/v3/projects/ff80d36c8f2d41869c259369e9d107e0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.342670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff80d36c8f2d41869c259369e9d107e0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.345491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.377382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e694a6a415b4df698b77d5e932eb0d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.378252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e694a6a415b4df698b77d5e932eb0d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.385145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e694a6a415b4df698b77d5e932eb0d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.386180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e694a6a415b4df698b77d5e932eb0d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.393190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e694a6a415b4df698b77d5e932eb0d3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.399064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff80d36c8f2d41869c259369e9d107e0', 'request_id': 'req-5ba76aec-8dce-4087-8d02-46082c0a6908'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.406812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff80d36c8f2d41869c259369e9d107e0', 'request_id': 'req-5ba76aec-8dce-4087-8d02-46082c0a6908'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.411422 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2869/5746] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:33 2021] DELETE /identity/v3/users/2e694a6a415b4df698b77d5e932eb0d3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:33.412449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.413466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff80d36c8f2d41869c259369e9d107e0', 'request_id': 'req-5ba76aec-8dce-4087-8d02-46082c0a6908'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.413966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.427770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] The token cache is being invalidate because project ff80d36c8f2d41869c259369e9d107e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:03:33.428058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.431521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ba76aec-8dce-4087-8d02-46082c0a6908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.434749 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2878/5747] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:03:33 2021] DELETE /identity/v3/projects/ff80d36c8f2d41869c259369e9d107e0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:33.441757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acaaf5-6d8f-42e2-aa50-4dfa935555b2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.442411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acaaf5-6d8f-42e2-aa50-4dfa935555b2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.442843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acaaf5-6d8f-42e2-aa50-4dfa935555b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.466840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b2acaaf5-6d8f-42e2-aa50-4dfa935555b2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:33.468148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b2acaaf5-6d8f-42e2-aa50-4dfa935555b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.506638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3634b0-6fa1-40cf-8b49-ea0acd73cc57 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.512370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.513237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.513524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.513804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] PATH_INFO: `/v3/projects/9228698a8c5b4bf99ebfd370603045f4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.515061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9228698a8c5b4bf99ebfd370603045f4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.517040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.538516 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2879/5748] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:33.539964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afc58d-ece2-4298-af25-e53972dcc3d0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.540376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afc58d-ece2-4298-af25-e53972dcc3d0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.540673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afc58d-ece2-4298-af25-e53972dcc3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.562573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-80afc58d-ece2-4298-af25-e53972dcc3d0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:33.563870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-80afc58d-ece2-4298-af25-e53972dcc3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.577732 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2880/5749] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:33.578906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afc58d-ece2-4298-af25-e53972dcc3d0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.596027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afc58d-ece2-4298-af25-e53972dcc3d0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.603459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9228698a8c5b4bf99ebfd370603045f4', 'request_id': 'req-09e859e0-3603-49a9-8347-0b3048480aba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.610699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9228698a8c5b4bf99ebfd370603045f4', 'request_id': 'req-09e859e0-3603-49a9-8347-0b3048480aba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.621098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9228698a8c5b4bf99ebfd370603045f4', 'request_id': 'req-09e859e0-3603-49a9-8347-0b3048480aba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.633193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] The token cache is being invalidate because project 9228698a8c5b4bf99ebfd370603045f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:03:33.633570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.634850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.636843 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2870/5750] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:03:33 2021] DELETE /identity/v3/projects/9228698a8c5b4bf99ebfd370603045f4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:33.637779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.639223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.674674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad435875-c423-4b22-90fd-33c59073d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.675662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435875-c423-4b22-90fd-33c59073d223 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.675952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435875-c423-4b22-90fd-33c59073d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.676286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad435875-c423-4b22-90fd-33c59073d223 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.677091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435875-c423-4b22-90fd-33c59073d223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:03:33.677425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435875-c423-4b22-90fd-33c59073d223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.679021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad435875-c423-4b22-90fd-33c59073d223 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.692417 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2881/5751] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:03:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:03:33.693462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc9ff-e1dc-401e-82e9-df7459d3c707 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.693757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc9ff-e1dc-401e-82e9-df7459d3c707 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.694116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc9ff-e1dc-401e-82e9-df7459d3c707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.709725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e859e0-3603-49a9-8347-0b3048480aba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.713042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-13bbc9ff-e1dc-401e-82e9-df7459d3c707 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:33.714245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-13bbc9ff-e1dc-401e-82e9-df7459d3c707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.715005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.715888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.716230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.716446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] PATH_INFO: `/v3/projects/85921763e45844afa1280d7cde0cf668` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.717664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=85921763e45844afa1280d7cde0cf668)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.719609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.722680 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2882/5752] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:33.724162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc9ff-e1dc-401e-82e9-df7459d3c707 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.726028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-13bbc9ff-e1dc-401e-82e9-df7459d3c707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.737886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc9ff-e1dc-401e-82e9-df7459d3c707 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.742500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ec3ad-078c-438a-913c-988dbfadeab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.743144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ec3ad-078c-438a-913c-988dbfadeab9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.743455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ec3ad-078c-438a-913c-988dbfadeab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.743959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ec3ad-078c-438a-913c-988dbfadeab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.744655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ec3ad-078c-438a-913c-988dbfadeab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.746926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ec3ad-078c-438a-913c-988dbfadeab9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.776238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85921763e45844afa1280d7cde0cf668', 'request_id': 'req-a748179a-cf57-4bbb-b677-0f05510b05ce'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.779557 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2883/5753] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:03:33 2021] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:33.780523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f8f9b-5762-4b7c-9196-731d089d13b6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.780816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f8f9b-5762-4b7c-9196-731d089d13b6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.781094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f8f9b-5762-4b7c-9196-731d089d13b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.787514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85921763e45844afa1280d7cde0cf668', 'request_id': 'req-a748179a-cf57-4bbb-b677-0f05510b05ce'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.795568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85921763e45844afa1280d7cde0cf668', 'request_id': 'req-a748179a-cf57-4bbb-b677-0f05510b05ce'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.800526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-eb9f8f9b-5762-4b7c-9196-731d089d13b6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:33.801722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-eb9f8f9b-5762-4b7c-9196-731d089d13b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.807299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] The token cache is being invalidate because project 85921763e45844afa1280d7cde0cf668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:03:33.807465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.808208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:33.811493 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2871/5754] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:03:33 2021] DELETE /identity/v3/projects/85921763e45844afa1280d7cde0cf668 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:33.811493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.812535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.875425 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2884/5755] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:33.878890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f81ee2-e909-4fd4-b1d0-dc61bdf02309 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.878890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f81ee2-e909-4fd4-b1d0-dc61bdf02309 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.878890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f81ee2-e909-4fd4-b1d0-dc61bdf02309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.885590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748179a-cf57-4bbb-b677-0f05510b05ce admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.890422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52c908-548d-4260-be2a-19cbd64c1fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.891742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c908-548d-4260-be2a-19cbd64c1fda admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.892029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c908-548d-4260-be2a-19cbd64c1fda admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.892303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c908-548d-4260-be2a-19cbd64c1fda admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.893008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52c908-548d-4260-be2a-19cbd64c1fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.894987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52c908-548d-4260-be2a-19cbd64c1fda admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.901865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-86f81ee2-e909-4fd4-b1d0-dc61bdf02309 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:33.903328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-86f81ee2-e909-4fd4-b1d0-dc61bdf02309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.913057 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2885/5756] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:33.913855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f81ee2-e909-4fd4-b1d0-dc61bdf02309 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.919729 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2872/5757] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:03:33 2021] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:33.924386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52c908-548d-4260-be2a-19cbd64c1fda admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.925037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f81ee2-e909-4fd4-b1d0-dc61bdf02309 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.930291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddef22-05f3-47f5-9f9c-cfac28c7a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.930959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddef22-05f3-47f5-9f9c-cfac28c7a9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.932326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddef22-05f3-47f5-9f9c-cfac28c7a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.932326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddef22-05f3-47f5-9f9c-cfac28c7a9f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.933001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddef22-05f3-47f5-9f9c-cfac28c7a9f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:03:33.933231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddef22-05f3-47f5-9f9c-cfac28c7a9f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.934835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddef22-05f3-47f5-9f9c-cfac28c7a9f1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.934967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52c908-548d-4260-be2a-19cbd64c1fda admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.940221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4945e-e3da-4083-8593-1b71c10a1a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.941047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4945e-e3da-4083-8593-1b71c10a1a99 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.941313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4945e-e3da-4083-8593-1b71c10a1a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.941583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4945e-e3da-4083-8593-1b71c10a1a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.942778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4945e-e3da-4083-8593-1b71c10a1a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.944413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4945e-e3da-4083-8593-1b71c10a1a99 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.947589 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2886/5758] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:03:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:03:33.948881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c389-3f3b-408f-b381-855b01a1d346 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.949173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c389-3f3b-408f-b381-855b01a1d346 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.949456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378c389-3f3b-408f-b381-855b01a1d346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.956417 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2873/5759] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:33 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:33.957060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4945e-e3da-4083-8593-1b71c10a1a99 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.971690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4945e-e3da-4083-8593-1b71c10a1a99 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.974154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3378c389-3f3b-408f-b381-855b01a1d346 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:33.975416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3378c389-3f3b-408f-b381-855b01a1d346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:33.976784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a6b3c-9348-424f-8c3b-b3926f52f372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.977586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6b3c-9348-424f-8c3b-b3926f52f372 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.978013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6b3c-9348-424f-8c3b-b3926f52f372 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.978290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6b3c-9348-424f-8c3b-b3926f52f372 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:33.979121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a6b3c-9348-424f-8c3b-b3926f52f372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:33.981072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a6b3c-9348-424f-8c3b-b3926f52f372 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:33.983486 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2887/5760] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:33.984257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378c389-3f3b-408f-b381-855b01a1d346 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:33.993313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378c389-3f3b-408f-b381-855b01a1d346 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:33.998728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d49806-4b31-4d69-9b20-ef35e8ef7d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:33.999412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d49806-4b31-4d69-9b20-ef35e8ef7d06 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:33.999698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d49806-4b31-4d69-9b20-ef35e8ef7d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:33.999971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d49806-4b31-4d69-9b20-ef35e8ef7d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.000696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d49806-4b31-4d69-9b20-ef35e8ef7d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.002277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d49806-4b31-4d69-9b20-ef35e8ef7d06 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.011196 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2874/5761] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:03:33 2021] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:34.012114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a6b3c-9348-424f-8c3b-b3926f52f372 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.016127 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2888/5762] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:33 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:34.016630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d49806-4b31-4d69-9b20-ef35e8ef7d06 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.026464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d49806-4b31-4d69-9b20-ef35e8ef7d06 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.081282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a6b3c-9348-424f-8c3b-b3926f52f372 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.084515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93353b71-199c-4eac-99f2-d15cb519e41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.085329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93353b71-199c-4eac-99f2-d15cb519e41d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.085742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93353b71-199c-4eac-99f2-d15cb519e41d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.086023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93353b71-199c-4eac-99f2-d15cb519e41d admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.086590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21191-1e0d-459a-9ffb-dcf1165a0ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.086726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93353b71-199c-4eac-99f2-d15cb519e41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.087451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21191-1e0d-459a-9ffb-dcf1165a0ffc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.087814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21191-1e0d-459a-9ffb-dcf1165a0ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.088168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21191-1e0d-459a-9ffb-dcf1165a0ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.088672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93353b71-199c-4eac-99f2-d15cb519e41d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.089049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db21191-1e0d-459a-9ffb-dcf1165a0ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:03:34.089435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db21191-1e0d-459a-9ffb-dcf1165a0ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.091098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db21191-1e0d-459a-9ffb-dcf1165a0ffc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.103999 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2875/5763] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:03:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:03:34.104907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21191-1e0d-459a-9ffb-dcf1165a0ffc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.111283 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2889/5764] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:03:34 2021] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:34.115209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93353b71-199c-4eac-99f2-d15cb519e41d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.115769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21191-1e0d-459a-9ffb-dcf1165a0ffc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.121507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408917-9a96-4ff8-b224-0dccde501df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.123357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408917-9a96-4ff8-b224-0dccde501df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.123769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408917-9a96-4ff8-b224-0dccde501df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.124052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408917-9a96-4ff8-b224-0dccde501df9 admin admin] PATH_INFO: `/v3/projects/155ea710d67e40a08ea58d08708541ca/users/8dc4e0bea5f44d00b508065b8c236f13/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.125968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93353b71-199c-4eac-99f2-d15cb519e41d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.130628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d8c4a-c98e-44bf-8b45-1f67490f50f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.131302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d8c4a-c98e-44bf-8b45-1f67490f50f3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.131594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d8c4a-c98e-44bf-8b45-1f67490f50f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.131871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d8c4a-c98e-44bf-8b45-1f67490f50f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.132567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d8c4a-c98e-44bf-8b45-1f67490f50f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.135041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d8c4a-c98e-44bf-8b45-1f67490f50f3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.139984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e408917-9a96-4ff8-b224-0dccde501df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=155ea710d67e40a08ea58d08708541ca, user_id=8dc4e0bea5f44d00b508065b8c236f13, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.142687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e408917-9a96-4ff8-b224-0dccde501df9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.165836 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2876/5765] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:34 2021] PUT /identity/v3/projects/155ea710d67e40a08ea58d08708541ca/users/8dc4e0bea5f44d00b508065b8c236f13/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:34.165836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408917-9a96-4ff8-b224-0dccde501df9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.172692 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2890/5766] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:03:34 2021] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:34.178865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c77b0c-464f-486a-8f52-768d11b28405 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.179350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c77b0c-464f-486a-8f52-768d11b28405 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.179936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c77b0c-464f-486a-8f52-768d11b28405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.210259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d9c77b0c-464f-486a-8f52-768d11b28405 None None] MFA Rules not processed for user `8dc4e0bea5f44d00b508065b8c236f13`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:34.211562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d9c77b0c-464f-486a-8f52-768d11b28405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:34.228898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408917-9a96-4ff8-b224-0dccde501df9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.288153 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2891/5767] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:34 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:34.289036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c77b0c-464f-486a-8f52-768d11b28405 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.307271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f61a8-0dcc-4123-9acc-2b64d682b0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.308054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f61a8-0dcc-4123-9acc-2b64d682b0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.308493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f61a8-0dcc-4123-9acc-2b64d682b0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.308768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f61a8-0dcc-4123-9acc-2b64d682b0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.309646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f61a8-0dcc-4123-9acc-2b64d682b0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.311725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f61a8-0dcc-4123-9acc-2b64d682b0a5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.322020 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2877/5768] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:34.322843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f61a8-0dcc-4123-9acc-2b64d682b0a5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.324739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-011f61a8-0dcc-4123-9acc-2b64d682b0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:34.376457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c77b0c-464f-486a-8f52-768d11b28405 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.382362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909275f-1332-4a60-840a-c8dcd6e62bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.383357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909275f-1332-4a60-840a-c8dcd6e62bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.383780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909275f-1332-4a60-840a-c8dcd6e62bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.384217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909275f-1332-4a60-840a-c8dcd6e62bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.385004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909275f-1332-4a60-840a-c8dcd6e62bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.388719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909275f-1332-4a60-840a-c8dcd6e62bf3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.398543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f61a8-0dcc-4123-9acc-2b64d682b0a5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.403885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb47c-82e6-416f-b917-f7eeabcbdbb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.404525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb47c-82e6-416f-b917-f7eeabcbdbb7 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.404949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb47c-82e6-416f-b917-f7eeabcbdbb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.405548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eb47c-82e6-416f-b917-f7eeabcbdbb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.410113 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2892/5769] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:03:34 2021] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:34.410951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909275f-1332-4a60-840a-c8dcd6e62bf3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.415335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eb47c-82e6-416f-b917-f7eeabcbdbb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.417324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eb47c-82e6-416f-b917-f7eeabcbdbb7 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.426915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909275f-1332-4a60-840a-c8dcd6e62bf3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.428165 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2878/5770] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:34 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:34.429404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb47c-82e6-416f-b917-f7eeabcbdbb7 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.435854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19a460-a174-4205-b30c-012fc3d25ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.436506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a460-a174-4205-b30c-012fc3d25ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.437127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a460-a174-4205-b30c-012fc3d25ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.437482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a460-a174-4205-b30c-012fc3d25ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.438307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19a460-a174-4205-b30c-012fc3d25ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.440011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19a460-a174-4205-b30c-012fc3d25ed5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.446072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eb47c-82e6-416f-b917-f7eeabcbdbb7 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.453554 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2893/5771] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:34.458167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19a460-a174-4205-b30c-012fc3d25ed5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.459144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6041a1-24d2-444a-b2c8-08c8963ac9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.460185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6041a1-24d2-444a-b2c8-08c8963ac9df admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.461181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6041a1-24d2-444a-b2c8-08c8963ac9df admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.462520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6041a1-24d2-444a-b2c8-08c8963ac9df admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.463676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6041a1-24d2-444a-b2c8-08c8963ac9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.465608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6041a1-24d2-444a-b2c8-08c8963ac9df admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.481031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19a460-a174-4205-b30c-012fc3d25ed5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.481443 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2879/5772] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:34.485721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6041a1-24d2-444a-b2c8-08c8963ac9df admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.492109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdb360-17a8-4d06-a5af-da8a23355dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.495346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdb360-17a8-4d06-a5af-da8a23355dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.496036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdb360-17a8-4d06-a5af-da8a23355dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.496827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdb360-17a8-4d06-a5af-da8a23355dd4 admin admin] PATH_INFO: `/v3/projects/7d23908fbbc746b096f47d13a44b40c4/users/9dedbea730a742b0a997aa0f6f9d4250/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.516734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6041a1-24d2-444a-b2c8-08c8963ac9df admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.523948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813977a5-bb8e-4d49-82e2-a0cb2c6f6442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.524599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdb360-17a8-4d06-a5af-da8a23355dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d23908fbbc746b096f47d13a44b40c4, user_id=9dedbea730a742b0a997aa0f6f9d4250, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.527559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdb360-17a8-4d06-a5af-da8a23355dd4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.528592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813977a5-bb8e-4d49-82e2-a0cb2c6f6442 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.529175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813977a5-bb8e-4d49-82e2-a0cb2c6f6442 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.529679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813977a5-bb8e-4d49-82e2-a0cb2c6f6442 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.530805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813977a5-bb8e-4d49-82e2-a0cb2c6f6442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.534341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813977a5-bb8e-4d49-82e2-a0cb2c6f6442 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.550066 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2880/5773] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:34 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:34.551300 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2894/5774] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:34 2021] PUT /identity/v3/projects/7d23908fbbc746b096f47d13a44b40c4/users/9dedbea730a742b0a997aa0f6f9d4250/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:03:34.560587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813977a5-bb8e-4d49-82e2-a0cb2c6f6442 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.564760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0882bf9-b800-4406-a29b-39100f43968e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.564760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0882bf9-b800-4406-a29b-39100f43968e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.566402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0882bf9-b800-4406-a29b-39100f43968e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.570870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813977a5-bb8e-4d49-82e2-a0cb2c6f6442 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.602186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e0882bf9-b800-4406-a29b-39100f43968e None None] MFA Rules not processed for user `9dedbea730a742b0a997aa0f6f9d4250`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:34.604392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e0882bf9-b800-4406-a29b-39100f43968e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:34.656229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec666c-b670-46f5-b930-cf34c9604db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.657361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec666c-b670-46f5-b930-cf34c9604db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.657743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec666c-b670-46f5-b930-cf34c9604db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.659015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec666c-b670-46f5-b930-cf34c9604db5 admin admin] PATH_INFO: `/v3/projects/24b97e6d4e2d43e0a0b4751d6a04ffcd/users/5cfbc8906c014331ae4adf04a164a7eb/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.692278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec666c-b670-46f5-b930-cf34c9604db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b97e6d4e2d43e0a0b4751d6a04ffcd, user_id=5cfbc8906c014331ae4adf04a164a7eb, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:34.695658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec666c-b670-46f5-b930-cf34c9604db5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:34.718843 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2881/5775] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:34 2021] PUT /identity/v3/projects/24b97e6d4e2d43e0a0b4751d6a04ffcd/users/5cfbc8906c014331ae4adf04a164a7eb/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:34.731635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5f15-cabc-4c80-a783-0035b42ae752 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.732002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5f15-cabc-4c80-a783-0035b42ae752 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.732425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5f15-cabc-4c80-a783-0035b42ae752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.762027 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2895/5776] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:34 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:34.767926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b96b5f15-cabc-4c80-a783-0035b42ae752 None None] MFA Rules not processed for user `5cfbc8906c014331ae4adf04a164a7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:34.769580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b96b5f15-cabc-4c80-a783-0035b42ae752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:34.787283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0882bf9-b800-4406-a29b-39100f43968e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.791465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e0882bf9-b800-4406-a29b-39100f43968e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:34.860787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0882bf9-b800-4406-a29b-39100f43968e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.888501 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2882/5777] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:34 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:03:34.901449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b5f15-cabc-4c80-a783-0035b42ae752 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:34.929932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43c53c-406e-4cfb-93eb-b2743b6df348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.930708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43c53c-406e-4cfb-93eb-b2743b6df348 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.931126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43c53c-406e-4cfb-93eb-b2743b6df348 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.932087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43c53c-406e-4cfb-93eb-b2743b6df348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:34.988106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b5f15-cabc-4c80-a783-0035b42ae752 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:34.992540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c0de0-24bb-4700-952c-e2edc16b30a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:34.993194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c0de0-24bb-4700-952c-e2edc16b30a3 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:34.993506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c0de0-24bb-4700-952c-e2edc16b30a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:34.993793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c0de0-24bb-4700-952c-e2edc16b30a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:35.003676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c0de0-24bb-4700-952c-e2edc16b30a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:35.005219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c0de0-24bb-4700-952c-e2edc16b30a3 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:35.016693 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2883/5778] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:34 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:03:35.030044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43c53c-406e-4cfb-93eb-b2743b6df348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:35.031759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43c53c-406e-4cfb-93eb-b2743b6df348 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:35.042239 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2896/5779] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:34 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:36.106534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c0de0-24bb-4700-952c-e2edc16b30a3 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:36.108202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a21c0de0-24bb-4700-952c-e2edc16b30a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:36.197957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c0de0-24bb-4700-952c-e2edc16b30a3 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:36.207950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227954c-e8ab-447b-ac71-a1087801c866 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:36.208886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227954c-e8ab-447b-ac71-a1087801c866 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:36.209278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227954c-e8ab-447b-ac71-a1087801c866 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:36.209659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227954c-e8ab-447b-ac71-a1087801c866 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:36.211693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e227954c-e8ab-447b-ac71-a1087801c866 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:36.230877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227954c-e8ab-447b-ac71-a1087801c866 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:36.235748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227954c-e8ab-447b-ac71-a1087801c866 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:36.252295 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2884/5780] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:43.533086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00670fa-dc79-4b82-bf2e-5ca0cc06f01d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:43.534748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00670fa-dc79-4b82-bf2e-5ca0cc06f01d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:43.535299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00670fa-dc79-4b82-bf2e-5ca0cc06f01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:43.562458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e00670fa-dc79-4b82-bf2e-5ca0cc06f01d None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:43.564103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e00670fa-dc79-4b82-bf2e-5ca0cc06f01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:43.644130 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2897/5781] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:03:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:43.710730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227954c-e8ab-447b-ac71-a1087801c866 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:43.713441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e227954c-e8ab-447b-ac71-a1087801c866 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:43.828169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227954c-e8ab-447b-ac71-a1087801c866 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:43.833570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6349da0-47a1-48e6-b404-4d484c74df99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:43.834449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6349da0-47a1-48e6-b404-4d484c74df99 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:43.834798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6349da0-47a1-48e6-b404-4d484c74df99 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:43.835156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6349da0-47a1-48e6-b404-4d484c74df99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:43.848150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6349da0-47a1-48e6-b404-4d484c74df99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:43.850572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6349da0-47a1-48e6-b404-4d484c74df99 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:43.875753 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2885/5782] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:03:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:03:44.465106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00670fa-dc79-4b82-bf2e-5ca0cc06f01d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:44.587521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00670fa-dc79-4b82-bf2e-5ca0cc06f01d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:44.608888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:44.609781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:44.610064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:44.610343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] PATH_INFO: `/v3/users/9dedbea730a742b0a997aa0f6f9d4250` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:44.611720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dedbea730a742b0a997aa0f6f9d4250)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:44.613874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:44.811618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dedbea730a742b0a997aa0f6f9d4250'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:44.830577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dedbea730a742b0a997aa0f6f9d4250'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:44.831757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dedbea730a742b0a997aa0f6f9d4250'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:44.843659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dedbea730a742b0a997aa0f6f9d4250'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:44.878253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dedbea730a742b0a997aa0f6f9d4250'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:44.890542 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2898/5783] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:44 2021] DELETE /identity/v3/users/9dedbea730a742b0a997aa0f6f9d4250 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:44.895436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f37a-f6d2-4b5c-9178-dcd41d954658 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:44.896395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f37a-f6d2-4b5c-9178-dcd41d954658 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:44.896912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1f37a-f6d2-4b5c-9178-dcd41d954658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:44.968204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-aaf1f37a-f6d2-4b5c-9178-dcd41d954658 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:44.969468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aaf1f37a-f6d2-4b5c-9178-dcd41d954658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:45.176005 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2886/5784] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:45.327958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:45.330200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:45.525554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595ed72-6ac0-40df-abb4-6f10203d7551 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:45.533736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b83f26-c802-4b2a-b31e-39e2bae5d2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:45.534417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b83f26-c802-4b2a-b31e-39e2bae5d2cb service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:45.534718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b83f26-c802-4b2a-b31e-39e2bae5d2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:45.534972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b83f26-c802-4b2a-b31e-39e2bae5d2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:45.559767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b83f26-c802-4b2a-b31e-39e2bae5d2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:45.561230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b83f26-c802-4b2a-b31e-39e2bae5d2cb service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:45.593309 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2899/5785] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:46.118536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1f37a-f6d2-4b5c-9178-dcd41d954658 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:46.120797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aaf1f37a-f6d2-4b5c-9178-dcd41d954658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:46.143375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1f37a-f6d2-4b5c-9178-dcd41d954658 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:46.156074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:46.157019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:46.157298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:46.157567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] PATH_INFO: `/v3/projects/7d23908fbbc746b096f47d13a44b40c4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:46.168354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d23908fbbc746b096f47d13a44b40c4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:46.170537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:46.271544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d23908fbbc746b096f47d13a44b40c4', 'request_id': 'req-52cd8eda-1fb5-433c-a160-af79d0e59640'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:46.286684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d23908fbbc746b096f47d13a44b40c4', 'request_id': 'req-52cd8eda-1fb5-433c-a160-af79d0e59640'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:46.305977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d23908fbbc746b096f47d13a44b40c4', 'request_id': 'req-52cd8eda-1fb5-433c-a160-af79d0e59640'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:46.323400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] The token cache is being invalidate because project 7d23908fbbc746b096f47d13a44b40c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:03:46.324288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:46.325238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-52cd8eda-1fb5-433c-a160-af79d0e59640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:46.328232 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2887/5786] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:03:46 2021] DELETE /identity/v3/projects/7d23908fbbc746b096f47d13a44b40c4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:46.335287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f33b4-e8ea-4d8d-b85d-ba66dbc4456b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:46.335512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f33b4-e8ea-4d8d-b85d-ba66dbc4456b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:46.336621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f33b4-e8ea-4d8d-b85d-ba66dbc4456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:46.368801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-829f33b4-e8ea-4d8d-b85d-ba66dbc4456b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:46.372859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-829f33b4-e8ea-4d8d-b85d-ba66dbc4456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:46.517849 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2900/5787] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:46.526087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dc595-66a0-424e-a118-f70afc053628 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:46.526634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dc595-66a0-424e-a118-f70afc053628 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:46.527018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dc595-66a0-424e-a118-f70afc053628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:46.594213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-397dc595-66a0-424e-a118-f70afc053628 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:46.598255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-397dc595-66a0-424e-a118-f70afc053628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:46.609721 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2888/5788] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:46.613649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f33b4-e8ea-4d8d-b85d-ba66dbc4456b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:46.627316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f33b4-e8ea-4d8d-b85d-ba66dbc4456b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:46.634548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0200ec5-92d5-4187-b243-9432fca2d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:46.637711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200ec5-92d5-4187-b243-9432fca2d3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:46.638384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200ec5-92d5-4187-b243-9432fca2d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:46.638900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200ec5-92d5-4187-b243-9432fca2d3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:46.640502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0200ec5-92d5-4187-b243-9432fca2d3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:03:46.641207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0200ec5-92d5-4187-b243-9432fca2d3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:46.644025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0200ec5-92d5-4187-b243-9432fca2d3d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:46.663297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2901/5789] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:03:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:03:46.669578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dc595-66a0-424e-a118-f70afc053628 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:46.679375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dc595-66a0-424e-a118-f70afc053628 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:46.685429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73e8e4-2ba9-41d9-a9e8-ab60af266bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:46.686100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73e8e4-2ba9-41d9-a9e8-ab60af266bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:46.686379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73e8e4-2ba9-41d9-a9e8-ab60af266bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:46.687354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73e8e4-2ba9-41d9-a9e8-ab60af266bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:46.688093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73e8e4-2ba9-41d9-a9e8-ab60af266bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:46.690220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73e8e4-2ba9-41d9-a9e8-ab60af266bc7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:46.742821 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2889/5790] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:03:46 2021] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:46.747052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0200ec5-92d5-4187-b243-9432fca2d3d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:46.762822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0200ec5-92d5-4187-b243-9432fca2d3d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:46.963611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960425f5-c758-44a6-b975-c11ac55da849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:46.964772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960425f5-c758-44a6-b975-c11ac55da849 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:46.965065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960425f5-c758-44a6-b975-c11ac55da849 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:46.965471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960425f5-c758-44a6-b975-c11ac55da849 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:46.966384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960425f5-c758-44a6-b975-c11ac55da849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:46.968356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960425f5-c758-44a6-b975-c11ac55da849 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:47.046596 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2902/5791] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:03:46 2021] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:47.050711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73e8e4-2ba9-41d9-a9e8-ab60af266bc7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:47.071984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73e8e4-2ba9-41d9-a9e8-ab60af266bc7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:47.081215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024f0e7-4cb0-4840-89e6-3a8f982ac5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:47.083218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f0e7-4cb0-4840-89e6-3a8f982ac5cf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:47.084716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f0e7-4cb0-4840-89e6-3a8f982ac5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:47.086844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f0e7-4cb0-4840-89e6-3a8f982ac5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:47.090855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024f0e7-4cb0-4840-89e6-3a8f982ac5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:47.095284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024f0e7-4cb0-4840-89e6-3a8f982ac5cf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:47.122660 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2890/5792] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:47.127859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960425f5-c758-44a6-b975-c11ac55da849 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:47.144222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960425f5-c758-44a6-b975-c11ac55da849 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:47.152072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b7536-b3e9-414f-b89a-3102f10d2035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:47.153023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7536-b3e9-414f-b89a-3102f10d2035 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:47.161421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7536-b3e9-414f-b89a-3102f10d2035 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:47.161911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b7536-b3e9-414f-b89a-3102f10d2035 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:47.163067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b7536-b3e9-414f-b89a-3102f10d2035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:47.165559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b7536-b3e9-414f-b89a-3102f10d2035 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:47.179373 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2903/5793] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:03:47.186636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024f0e7-4cb0-4840-89e6-3a8f982ac5cf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:47.202812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024f0e7-4cb0-4840-89e6-3a8f982ac5cf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:47.210272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047018f-813c-4bce-bbf1-0ddd0b2351b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:47.213508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047018f-813c-4bce-bbf1-0ddd0b2351b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:47.214118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047018f-813c-4bce-bbf1-0ddd0b2351b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:47.214661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047018f-813c-4bce-bbf1-0ddd0b2351b8 admin admin] PATH_INFO: `/v3/projects/dfe42861154a4396b0371b381e9e8943/users/c93029a5ccbc4696b21a5ba4b9256d33/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:47.241700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047018f-813c-4bce-bbf1-0ddd0b2351b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe42861154a4396b0371b381e9e8943, user_id=c93029a5ccbc4696b21a5ba4b9256d33, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:47.247036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047018f-813c-4bce-bbf1-0ddd0b2351b8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:47.306996 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2891/5794] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:47 2021] PUT /identity/v3/projects/dfe42861154a4396b0371b381e9e8943/users/c93029a5ccbc4696b21a5ba4b9256d33/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:47.317088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce4d5c-df5e-4002-8459-6c9cd0fbbc6a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:47.317884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce4d5c-df5e-4002-8459-6c9cd0fbbc6a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:47.319718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce4d5c-df5e-4002-8459-6c9cd0fbbc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:47.369087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-abce4d5c-df5e-4002-8459-6c9cd0fbbc6a None None] MFA Rules not processed for user `c93029a5ccbc4696b21a5ba4b9256d33`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:47.372343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-abce4d5c-df5e-4002-8459-6c9cd0fbbc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:47.513972 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2904/5795] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:47 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:03:47.515323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047018f-813c-4bce-bbf1-0ddd0b2351b8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:47.683914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047018f-813c-4bce-bbf1-0ddd0b2351b8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:47.698850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ab7d0-bcb2-4d4a-be47-5193c54837c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:47.703400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ab7d0-bcb2-4d4a-be47-5193c54837c5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:47.703747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ab7d0-bcb2-4d4a-be47-5193c54837c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:47.703965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ab7d0-bcb2-4d4a-be47-5193c54837c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:47.704706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ab7d0-bcb2-4d4a-be47-5193c54837c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:47.706662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ab7d0-bcb2-4d4a-be47-5193c54837c5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:47.778774 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2892/5796] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:03:47 2021] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:47.782760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce4d5c-df5e-4002-8459-6c9cd0fbbc6a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:47.798858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce4d5c-df5e-4002-8459-6c9cd0fbbc6a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:47.906631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dca45-ddc3-47e7-b0fb-eb548a89fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:47.907344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dca45-ddc3-47e7-b0fb-eb548a89fe83 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:47.907704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dca45-ddc3-47e7-b0fb-eb548a89fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:47.907961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dca45-ddc3-47e7-b0fb-eb548a89fe83 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:47.908685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073dca45-ddc3-47e7-b0fb-eb548a89fe83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:47.911755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073dca45-ddc3-47e7-b0fb-eb548a89fe83 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:47.950966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ab7d0-bcb2-4d4a-be47-5193c54837c5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:47.959302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2905/5797] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:03:47 2021] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:47.965409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ab7d0-bcb2-4d4a-be47-5193c54837c5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:47.972143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43781-ec8c-476e-a0a6-96dd7ec35f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:47.973097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43781-ec8c-476e-a0a6-96dd7ec35f1e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:47.973993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43781-ec8c-476e-a0a6-96dd7ec35f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:47.974481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43781-ec8c-476e-a0a6-96dd7ec35f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:47.975849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43781-ec8c-476e-a0a6-96dd7ec35f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:47.978362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43781-ec8c-476e-a0a6-96dd7ec35f1e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:48.003739 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2893/5798] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:47 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:48.004702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dca45-ddc3-47e7-b0fb-eb548a89fe83 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:48.020657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dca45-ddc3-47e7-b0fb-eb548a89fe83 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:48.029449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073ed0e-d7d2-4888-a555-af24ef560b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:48.043157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073ed0e-d7d2-4888-a555-af24ef560b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:48.043394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073ed0e-d7d2-4888-a555-af24ef560b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:48.043687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073ed0e-d7d2-4888-a555-af24ef560b3e admin admin] PATH_INFO: `/v3/projects/fd5e554071ac4ee580fb177e87dcea5a/users/e9df3e5ee8c64fd99734202df6216edb/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:48.077545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073ed0e-d7d2-4888-a555-af24ef560b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5e554071ac4ee580fb177e87dcea5a, user_id=e9df3e5ee8c64fd99734202df6216edb, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:48.080556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073ed0e-d7d2-4888-a555-af24ef560b3e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:48.112452 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2906/5799] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:48 2021] PUT /identity/v3/projects/fd5e554071ac4ee580fb177e87dcea5a/users/e9df3e5ee8c64fd99734202df6216edb/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:48.114003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43781-ec8c-476e-a0a6-96dd7ec35f1e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:48.141758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43781-ec8c-476e-a0a6-96dd7ec35f1e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:48.242107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35457-df58-4ffe-9e22-b1d659af9f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:48.243135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35457-df58-4ffe-9e22-b1d659af9f45 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:48.243629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35457-df58-4ffe-9e22-b1d659af9f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:48.244093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35457-df58-4ffe-9e22-b1d659af9f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:48.245004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35457-df58-4ffe-9e22-b1d659af9f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:48.247187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35457-df58-4ffe-9e22-b1d659af9f45 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:48.261743 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2894/5800] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:48 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:48.262696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073ed0e-d7d2-4888-a555-af24ef560b3e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:48.277681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073ed0e-d7d2-4888-a555-af24ef560b3e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:48.286953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f87743-5449-4860-9f69-e9faa291859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:48.288052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f87743-5449-4860-9f69-e9faa291859c admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:48.288401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f87743-5449-4860-9f69-e9faa291859c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:48.288702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f87743-5449-4860-9f69-e9faa291859c admin admin] PATH_INFO: `/v3/projects/fd5e554071ac4ee580fb177e87dcea5a/users/e9df3e5ee8c64fd99734202df6216edb/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:48.291124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f87743-5449-4860-9f69-e9faa291859c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5e554071ac4ee580fb177e87dcea5a, user_id=e9df3e5ee8c64fd99734202df6216edb, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:48.295565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f87743-5449-4860-9f69-e9faa291859c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:48.324406 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2907/5801] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:48 2021] PUT /identity/v3/projects/fd5e554071ac4ee580fb177e87dcea5a/users/e9df3e5ee8c64fd99734202df6216edb/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:48.340287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8596ff3-bb8f-4764-9c41-751f619c59d3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:48.340954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8596ff3-bb8f-4764-9c41-751f619c59d3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:48.341500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8596ff3-bb8f-4764-9c41-751f619c59d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:48.422656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a8596ff3-bb8f-4764-9c41-751f619c59d3 None None] MFA Rules not processed for user `e9df3e5ee8c64fd99734202df6216edb`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:48.423733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a8596ff3-bb8f-4764-9c41-751f619c59d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:48.588504 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2895/5802] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:48 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:48.607304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f87743-5449-4860-9f69-e9faa291859c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:48.609505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-23f87743-5449-4860-9f69-e9faa291859c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:48.756702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f87743-5449-4860-9f69-e9faa291859c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:48.769429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000fba3-7cdc-4138-8e58-960d7d7b99dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:48.777780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000fba3-7cdc-4138-8e58-960d7d7b99dc service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:48.778121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000fba3-7cdc-4138-8e58-960d7d7b99dc service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:48.778408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000fba3-7cdc-4138-8e58-960d7d7b99dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:48.800739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000fba3-7cdc-4138-8e58-960d7d7b99dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:48.807772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000fba3-7cdc-4138-8e58-960d7d7b99dc service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:48.825278 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2908/5803] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:48 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:49.113370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8596ff3-bb8f-4764-9c41-751f619c59d3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:49.190362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8596ff3-bb8f-4764-9c41-751f619c59d3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:49.198095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:49.199044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:49.200089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:49.200640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] PATH_INFO: `/v3/users/c93029a5ccbc4696b21a5ba4b9256d33` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:49.202474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93029a5ccbc4696b21a5ba4b9256d33)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:49.204742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:49.294298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93029a5ccbc4696b21a5ba4b9256d33'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:49.295418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93029a5ccbc4696b21a5ba4b9256d33'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:49.309745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93029a5ccbc4696b21a5ba4b9256d33'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:49.310868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93029a5ccbc4696b21a5ba4b9256d33'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:49.320893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93029a5ccbc4696b21a5ba4b9256d33'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:49.341738 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2896/5804] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:49 2021] DELETE /identity/v3/users/c93029a5ccbc4696b21a5ba4b9256d33 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:49.346443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24af88a-0838-40f2-9556-dadb86c6ad27 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:49.347003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24af88a-0838-40f2-9556-dadb86c6ad27 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:49.347522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24af88a-0838-40f2-9556-dadb86c6ad27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:49.410132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b24af88a-0838-40f2-9556-dadb86c6ad27 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:49.415764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b24af88a-0838-40f2-9556-dadb86c6ad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:49.578812 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2909/5805] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:49.683927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:49.685526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:49.881407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf4fc3-5f35-453a-8b11-b056754de654 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:49.887177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3986f-140c-471e-bfa0-1836b2ba61f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:49.888208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3986f-140c-471e-bfa0-1836b2ba61f6 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:49.888595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3986f-140c-471e-bfa0-1836b2ba61f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:49.889649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3986f-140c-471e-bfa0-1836b2ba61f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:49.979907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3986f-140c-471e-bfa0-1836b2ba61f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:49.981561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3986f-140c-471e-bfa0-1836b2ba61f6 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:49.990049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24af88a-0838-40f2-9556-dadb86c6ad27 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:49.991515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b24af88a-0838-40f2-9556-dadb86c6ad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:50.017403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24af88a-0838-40f2-9556-dadb86c6ad27 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:50.021824 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2897/5806] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:50.049824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:50.051883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:50.052165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:50.052441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] PATH_INFO: `/v3/users/8dc4e0bea5f44d00b508065b8c236f13` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:50.054235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc4e0bea5f44d00b508065b8c236f13)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:50.057677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:50.155703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc4e0bea5f44d00b508065b8c236f13'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:50.173969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc4e0bea5f44d00b508065b8c236f13'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:50.177179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc4e0bea5f44d00b508065b8c236f13'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:50.192590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc4e0bea5f44d00b508065b8c236f13'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:50.213671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc4e0bea5f44d00b508065b8c236f13'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:50.232990 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2910/5807] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:49 2021] DELETE /identity/v3/users/8dc4e0bea5f44d00b508065b8c236f13 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:50.234741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b5be-d5b9-474e-acf0-0b8e6e8b377b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:50.235912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b5be-d5b9-474e-acf0-0b8e6e8b377b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:50.236193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b5be-d5b9-474e-acf0-0b8e6e8b377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:50.263574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-77d1b5be-d5b9-474e-acf0-0b8e6e8b377b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:50.265799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-77d1b5be-d5b9-474e-acf0-0b8e6e8b377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:50.402134 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2898/5808] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:50.441004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:50.443071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:50.563431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5e8a-5edd-46b5-a7f2-68ef76327b9c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:50.567357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a376e51-5abc-4929-bd06-30c1a0b26b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:50.568514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376e51-5abc-4929-bd06-30c1a0b26b9c service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:50.569005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376e51-5abc-4929-bd06-30c1a0b26b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:50.569376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376e51-5abc-4929-bd06-30c1a0b26b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:50.585803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a376e51-5abc-4929-bd06-30c1a0b26b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:50.587757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a376e51-5abc-4929-bd06-30c1a0b26b9c service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:50.618950 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2911/5809] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:50.716862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1b5be-d5b9-474e-acf0-0b8e6e8b377b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:50.719151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-77d1b5be-d5b9-474e-acf0-0b8e6e8b377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:50.758030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1b5be-d5b9-474e-acf0-0b8e6e8b377b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:50.768006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:50.769838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:50.772413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:50.773062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] PATH_INFO: `/v3/projects/dfe42861154a4396b0371b381e9e8943` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:50.774907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe42861154a4396b0371b381e9e8943)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:50.777564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:50.853317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe42861154a4396b0371b381e9e8943', 'request_id': 'req-5960724c-de5b-45a6-b90e-40c915970381'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:50.860208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe42861154a4396b0371b381e9e8943', 'request_id': 'req-5960724c-de5b-45a6-b90e-40c915970381'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:50.873354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe42861154a4396b0371b381e9e8943', 'request_id': 'req-5960724c-de5b-45a6-b90e-40c915970381'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:50.895945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] The token cache is being invalidate because project dfe42861154a4396b0371b381e9e8943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:03:50.896809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:50.898100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:50.900554 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2899/5810] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:03:50 2021] DELETE /identity/v3/projects/dfe42861154a4396b0371b381e9e8943 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:50.905920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a376e51-5abc-4929-bd06-30c1a0b26b9c service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:50.918057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a376e51-5abc-4929-bd06-30c1a0b26b9c service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:51.059692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eded5a-db37-4b0c-85c6-04764577472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:51.060684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eded5a-db37-4b0c-85c6-04764577472e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:51.061103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eded5a-db37-4b0c-85c6-04764577472e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:51.061590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eded5a-db37-4b0c-85c6-04764577472e admin admin] PATH_INFO: `/v3/users/e9df3e5ee8c64fd99734202df6216edb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:51.070494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eded5a-db37-4b0c-85c6-04764577472e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9df3e5ee8c64fd99734202df6216edb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:51.075966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eded5a-db37-4b0c-85c6-04764577472e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:51.112291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:51.113770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:51.138260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960724c-de5b-45a6-b90e-40c915970381 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:51.166718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:51.167781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:51.168073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:51.168353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] PATH_INFO: `/v3/projects/155ea710d67e40a08ea58d08708541ca` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:51.172648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] RBAC: Authorizing `identity:delete_project(project_id=155ea710d67e40a08ea58d08708541ca)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:51.174587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:51.239173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0eded5a-db37-4b0c-85c6-04764577472e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9df3e5ee8c64fd99734202df6216edb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:51.252758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0eded5a-db37-4b0c-85c6-04764577472e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9df3e5ee8c64fd99734202df6216edb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:51.255088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0eded5a-db37-4b0c-85c6-04764577472e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9df3e5ee8c64fd99734202df6216edb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:51.274859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '155ea710d67e40a08ea58d08708541ca', 'request_id': 'req-22d809e9-e6fe-499d-9040-a261d8e4982f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:51.281202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0eded5a-db37-4b0c-85c6-04764577472e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9df3e5ee8c64fd99734202df6216edb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:51.290766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '155ea710d67e40a08ea58d08708541ca', 'request_id': 'req-22d809e9-e6fe-499d-9040-a261d8e4982f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:51.305132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e0eded5a-db37-4b0c-85c6-04764577472e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9df3e5ee8c64fd99734202df6216edb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:51.315192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '155ea710d67e40a08ea58d08708541ca', 'request_id': 'req-22d809e9-e6fe-499d-9040-a261d8e4982f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:51.319543 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2912/5811] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:50 2021] DELETE /identity/v3/users/e9df3e5ee8c64fd99734202df6216edb => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:51.338255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] The token cache is being invalidate because project 155ea710d67e40a08ea58d08708541ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:03:51.338546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:51.339389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22d809e9-e6fe-499d-9040-a261d8e4982f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:51.341058 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2900/5812] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:03:51 2021] DELETE /identity/v3/projects/155ea710d67e40a08ea58d08708541ca => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:03:51.347020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e990-eb20-4b63-9a18-ebdcb2eccbe4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:51.347357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e990-eb20-4b63-9a18-ebdcb2eccbe4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:51.347765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e990-eb20-4b63-9a18-ebdcb2eccbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:51.369498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-96e6e990-eb20-4b63-9a18-ebdcb2eccbe4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:51.370598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-96e6e990-eb20-4b63-9a18-ebdcb2eccbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:51.460710 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2913/5813] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:03:51.469512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e47c3c-74f5-4d22-b29c-4484b2e9cf08 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:51.469794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e47c3c-74f5-4d22-b29c-4484b2e9cf08 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:51.470066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e47c3c-74f5-4d22-b29c-4484b2e9cf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:51.497758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-37e47c3c-74f5-4d22-b29c-4484b2e9cf08 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:51.499724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-37e47c3c-74f5-4d22-b29c-4484b2e9cf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:51.520506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6e990-eb20-4b63-9a18-ebdcb2eccbe4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:51.540711 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2901/5814] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:51.544705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6e990-eb20-4b63-9a18-ebdcb2eccbe4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:51.559074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db27de9-ca16-4a95-a129-facae932b368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:51.559919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27de9-ca16-4a95-a129-facae932b368 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:51.560396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27de9-ca16-4a95-a129-facae932b368 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:51.560915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27de9-ca16-4a95-a129-facae932b368 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:51.562320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27de9-ca16-4a95-a129-facae932b368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:03:51.562812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27de9-ca16-4a95-a129-facae932b368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:51.565872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27de9-ca16-4a95-a129-facae932b368 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:51.595789 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2914/5815] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:03:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:03:51.600163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e47c3c-74f5-4d22-b29c-4484b2e9cf08 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:51.615941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e47c3c-74f5-4d22-b29c-4484b2e9cf08 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:51.634118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce9815-205d-4bfe-9744-d075304f8932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:51.635283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce9815-205d-4bfe-9744-d075304f8932 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:51.635766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce9815-205d-4bfe-9744-d075304f8932 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:51.636217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce9815-205d-4bfe-9744-d075304f8932 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:51.637473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce9815-205d-4bfe-9744-d075304f8932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:51.646133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce9815-205d-4bfe-9744-d075304f8932 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:51.712847 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2902/5816] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:03:51 2021] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:03:51.717469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db27de9-ca16-4a95-a129-facae932b368 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:51.731210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db27de9-ca16-4a95-a129-facae932b368 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:51.803843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c3c83-a055-4983-9c4c-3f4d47d1a6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:51.804538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c3c83-a055-4983-9c4c-3f4d47d1a6de admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:51.804827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c3c83-a055-4983-9c4c-3f4d47d1a6de admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:51.805107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c3c83-a055-4983-9c4c-3f4d47d1a6de admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:51.806940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c3c83-a055-4983-9c4c-3f4d47d1a6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:51.810911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c3c83-a055-4983-9c4c-3f4d47d1a6de admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:51.850124 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2915/5817] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:03:51 2021] POST /identity/v3/users => generated 281 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:51.854709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce9815-205d-4bfe-9744-d075304f8932 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:51.870500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce9815-205d-4bfe-9744-d075304f8932 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:51.883326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0f79a-9751-4abb-85d1-e5f78bb5de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:51.884066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0f79a-9751-4abb-85d1-e5f78bb5de32 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:51.884356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0f79a-9751-4abb-85d1-e5f78bb5de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:51.884636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0f79a-9751-4abb-85d1-e5f78bb5de32 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:51.885391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0f79a-9751-4abb-85d1-e5f78bb5de32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:51.890386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0f79a-9751-4abb-85d1-e5f78bb5de32 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:51.916869 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2903/5818] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:51 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:51.920847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c3c83-a055-4983-9c4c-3f4d47d1a6de admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:51.931415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c3c83-a055-4983-9c4c-3f4d47d1a6de admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:51.949217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf415a1-8ab6-481a-9212-b8c3c255c346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:51.949541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf415a1-8ab6-481a-9212-b8c3c255c346 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:51.950101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf415a1-8ab6-481a-9212-b8c3c255c346 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:51.950101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf415a1-8ab6-481a-9212-b8c3c255c346 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:51.950830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf415a1-8ab6-481a-9212-b8c3c255c346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:51.952671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf415a1-8ab6-481a-9212-b8c3c255c346 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:51.976128 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2916/5819] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:51 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:51.977233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0f79a-9751-4abb-85d1-e5f78bb5de32 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:51.994029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0f79a-9751-4abb-85d1-e5f78bb5de32 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:52.017078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a019e4-42b8-4fd0-a7ef-0efa3d79549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:52.018077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a019e4-42b8-4fd0-a7ef-0efa3d79549d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:52.018367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a019e4-42b8-4fd0-a7ef-0efa3d79549d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:52.018646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a019e4-42b8-4fd0-a7ef-0efa3d79549d admin admin] PATH_INFO: `/v3/projects/e575c71c2e6441bfa9602dfd073623a8/users/c6a13a0815f442d19ac1bf3328468e87/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:52.058464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a019e4-42b8-4fd0-a7ef-0efa3d79549d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e575c71c2e6441bfa9602dfd073623a8, user_id=c6a13a0815f442d19ac1bf3328468e87, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:52.065268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf415a1-8ab6-481a-9212-b8c3c255c346 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:52.066307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a019e4-42b8-4fd0-a7ef-0efa3d79549d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:52.069644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7cf415a1-8ab6-481a-9212-b8c3c255c346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:52.090241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf415a1-8ab6-481a-9212-b8c3c255c346 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:52.116814 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2904/5820] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:51 2021] PUT /identity/v3/projects/e575c71c2e6441bfa9602dfd073623a8/users/c6a13a0815f442d19ac1bf3328468e87/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:52.120355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abafc06-598a-422e-8584-2cb0b296efab None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:52.120696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abafc06-598a-422e-8584-2cb0b296efab None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:52.120982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abafc06-598a-422e-8584-2cb0b296efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:52.187067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4abafc06-598a-422e-8584-2cb0b296efab None None] MFA Rules not processed for user `c6a13a0815f442d19ac1bf3328468e87`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:52.188363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4abafc06-598a-422e-8584-2cb0b296efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:52.199661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:52.200849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:52.201538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:52.201989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] PATH_INFO: `/v3/projects/fd5e554071ac4ee580fb177e87dcea5a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:52.203568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5e554071ac4ee580fb177e87dcea5a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:52.205743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:52.284810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5e554071ac4ee580fb177e87dcea5a', 'request_id': 'req-c4beb918-2bec-4e37-b8a0-c034f0ede594'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:52.306277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5e554071ac4ee580fb177e87dcea5a', 'request_id': 'req-c4beb918-2bec-4e37-b8a0-c034f0ede594'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:52.326251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5e554071ac4ee580fb177e87dcea5a', 'request_id': 'req-c4beb918-2bec-4e37-b8a0-c034f0ede594'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:52.330139 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2905/5821] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:52 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:03:52.342693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abafc06-598a-422e-8584-2cb0b296efab None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:52.345330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4abafc06-598a-422e-8584-2cb0b296efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:52.378116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] The token cache is being invalidate because project fd5e554071ac4ee580fb177e87dcea5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:03:52.378315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:52.381168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c4beb918-2bec-4e37-b8a0-c034f0ede594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:52.385960 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2917/5822] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:03:52 2021] DELETE /identity/v3/projects/fd5e554071ac4ee580fb177e87dcea5a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:03:52.394007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1695f-7089-44fc-8f75-11d3a02952e5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:52.394432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1695f-7089-44fc-8f75-11d3a02952e5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:52.394716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1695f-7089-44fc-8f75-11d3a02952e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:52.442709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-13a1695f-7089-44fc-8f75-11d3a02952e5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:52.445796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-13a1695f-7089-44fc-8f75-11d3a02952e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:52.456086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abafc06-598a-422e-8584-2cb0b296efab None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:52.533555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c438354-6664-431f-ae73-db40d933dab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:52.534352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438354-6664-431f-ae73-db40d933dab9 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:52.534796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438354-6664-431f-ae73-db40d933dab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:52.535358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438354-6664-431f-ae73-db40d933dab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:52.537993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0c438354-6664-431f-ae73-db40d933dab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:52.583377 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2918/5823] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:52.594945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e72f7-e67a-44cd-a0fe-e8a914a9dac4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:52.599221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e72f7-e67a-44cd-a0fe-e8a914a9dac4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:52.599750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e72f7-e67a-44cd-a0fe-e8a914a9dac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:52.643065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c438354-6664-431f-ae73-db40d933dab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:52.645653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c438354-6664-431f-ae73-db40d933dab9 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:52.650871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6e6e72f7-e67a-44cd-a0fe-e8a914a9dac4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:52.653178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6e6e72f7-e67a-44cd-a0fe-e8a914a9dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:52.670918 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2906/5824] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:52 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:52.677556 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2919/5825] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:03:52.681973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c438354-6664-431f-ae73-db40d933dab9 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:52.702597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c438354-6664-431f-ae73-db40d933dab9 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:52.711932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda26c-bbb9-4ace-8853-092cb70530e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:52.717262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda26c-bbb9-4ace-8853-092cb70530e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:52.717851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda26c-bbb9-4ace-8853-092cb70530e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:52.718396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda26c-bbb9-4ace-8853-092cb70530e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:52.720306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeda26c-bbb9-4ace-8853-092cb70530e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:03:52.721639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeda26c-bbb9-4ace-8853-092cb70530e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:52.725757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeda26c-bbb9-4ace-8853-092cb70530e5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:52.761629 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2907/5826] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:03:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:03:52.766016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e72f7-e67a-44cd-a0fe-e8a914a9dac4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:52.789775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e72f7-e67a-44cd-a0fe-e8a914a9dac4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:52.795307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8441b7-c59d-4ac5-9d8a-233abc8fc393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:52.795975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8441b7-c59d-4ac5-9d8a-233abc8fc393 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:52.796260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8441b7-c59d-4ac5-9d8a-233abc8fc393 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:52.796537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8441b7-c59d-4ac5-9d8a-233abc8fc393 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:52.797244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8441b7-c59d-4ac5-9d8a-233abc8fc393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:52.799169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8441b7-c59d-4ac5-9d8a-233abc8fc393 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:52.855186 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2920/5827] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:03:52 2021] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:52.859426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda26c-bbb9-4ace-8853-092cb70530e5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:52.872858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda26c-bbb9-4ace-8853-092cb70530e5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:52.966141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46be08-5aaf-4f58-8cc4-8b082d2a687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:52.966817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46be08-5aaf-4f58-8cc4-8b082d2a687c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:52.967106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46be08-5aaf-4f58-8cc4-8b082d2a687c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:52.967429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46be08-5aaf-4f58-8cc4-8b082d2a687c admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:52.968795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46be08-5aaf-4f58-8cc4-8b082d2a687c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:52.971500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46be08-5aaf-4f58-8cc4-8b082d2a687c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:53.004316 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2908/5828] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:03:52 2021] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:53.007928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8441b7-c59d-4ac5-9d8a-233abc8fc393 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:53.031486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8441b7-c59d-4ac5-9d8a-233abc8fc393 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:53.046384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20fd92-7a4c-4079-a120-87e4bff20e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:53.047072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20fd92-7a4c-4079-a120-87e4bff20e5f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:53.047381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20fd92-7a4c-4079-a120-87e4bff20e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:53.047656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20fd92-7a4c-4079-a120-87e4bff20e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:53.048395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20fd92-7a4c-4079-a120-87e4bff20e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:53.049996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20fd92-7a4c-4079-a120-87e4bff20e5f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:53.072060 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2921/5829] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:53 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:53.076129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46be08-5aaf-4f58-8cc4-8b082d2a687c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:53.093876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46be08-5aaf-4f58-8cc4-8b082d2a687c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:53.101773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580507-f96b-44ed-847a-638363edea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:53.103559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580507-f96b-44ed-847a-638363edea88 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:53.103854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580507-f96b-44ed-847a-638363edea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:53.104133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580507-f96b-44ed-847a-638363edea88 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:53.104893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81580507-f96b-44ed-847a-638363edea88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:53.107130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81580507-f96b-44ed-847a-638363edea88 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:53.123315 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2909/5830] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:53 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:53.126178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20fd92-7a4c-4079-a120-87e4bff20e5f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:53.146659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20fd92-7a4c-4079-a120-87e4bff20e5f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:53.153350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd7825-023e-4ca2-979d-207bd1edb487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:53.158602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7825-023e-4ca2-979d-207bd1edb487 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:53.158602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7825-023e-4ca2-979d-207bd1edb487 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:53.158602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd7825-023e-4ca2-979d-207bd1edb487 admin admin] PATH_INFO: `/v3/projects/729d646328dc402daf431a72802e573e/users/536a498c9a2148f3bddc01e58f339e3a/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:53.178579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd7825-023e-4ca2-979d-207bd1edb487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729d646328dc402daf431a72802e573e, user_id=536a498c9a2148f3bddc01e58f339e3a, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:53.181652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd7825-023e-4ca2-979d-207bd1edb487 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:53.222284 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2922/5831] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:53 2021] PUT /identity/v3/projects/729d646328dc402daf431a72802e573e/users/536a498c9a2148f3bddc01e58f339e3a/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:03:53.224393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5ce44-12b0-4d34-be14-ff18cd2cbe53 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:53.224694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5ce44-12b0-4d34-be14-ff18cd2cbe53 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:53.224979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5ce44-12b0-4d34-be14-ff18cd2cbe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:53.335503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-30f5ce44-12b0-4d34-be14-ff18cd2cbe53 None None] MFA Rules not processed for user `536a498c9a2148f3bddc01e58f339e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:53.338566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-30f5ce44-12b0-4d34-be14-ff18cd2cbe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:53.526536 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2910/5832] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:53 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:53.534043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd7825-023e-4ca2-979d-207bd1edb487 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:53.706927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd7825-023e-4ca2-979d-207bd1edb487 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:53.712340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8b65-890b-4acd-a8d0-26d85d25c6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:53.713530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8b65-890b-4acd-a8d0-26d85d25c6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:53.714079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8b65-890b-4acd-a8d0-26d85d25c6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:53.714671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8b65-890b-4acd-a8d0-26d85d25c6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:53.716700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b8b65-890b-4acd-a8d0-26d85d25c6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:53.719150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b8b65-890b-4acd-a8d0-26d85d25c6b1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:53.765778 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2923/5833] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:03:53 2021] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:53.768116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5ce44-12b0-4d34-be14-ff18cd2cbe53 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:53.786162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5ce44-12b0-4d34-be14-ff18cd2cbe53 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:53.929691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d9c32-7025-4532-882f-20bfced8ac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:53.931435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9c32-7025-4532-882f-20bfced8ac1d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:53.931915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9c32-7025-4532-882f-20bfced8ac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:53.932376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9c32-7025-4532-882f-20bfced8ac1d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:53.935810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d9c32-7025-4532-882f-20bfced8ac1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:53.938548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d9c32-7025-4532-882f-20bfced8ac1d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:53.982495 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2911/5834] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:03:53 2021] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:53.983889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8b65-890b-4acd-a8d0-26d85d25c6b1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:53.998101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8b65-890b-4acd-a8d0-26d85d25c6b1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:54.010305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdde98-32e1-4b5a-bfc9-322870351a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:54.011144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdde98-32e1-4b5a-bfc9-322870351a58 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:54.011459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdde98-32e1-4b5a-bfc9-322870351a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:54.011734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdde98-32e1-4b5a-bfc9-322870351a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:54.012951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdde98-32e1-4b5a-bfc9-322870351a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:54.014605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdde98-32e1-4b5a-bfc9-322870351a58 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:54.047912 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2924/5835] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:53 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:54.052163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d9c32-7025-4532-882f-20bfced8ac1d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:54.074191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d9c32-7025-4532-882f-20bfced8ac1d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:54.083915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c793076-e74f-4ffb-8444-20e2fef40495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:54.085050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c793076-e74f-4ffb-8444-20e2fef40495 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:54.085378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c793076-e74f-4ffb-8444-20e2fef40495 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:54.085664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c793076-e74f-4ffb-8444-20e2fef40495 admin admin] PATH_INFO: `/v3/projects/cc35c5718c324f308ca58403f01daaed/users/917132e2e4f04022855b8ec6374efdb5/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:54.113857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c793076-e74f-4ffb-8444-20e2fef40495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc35c5718c324f308ca58403f01daaed, user_id=917132e2e4f04022855b8ec6374efdb5, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:54.118183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c793076-e74f-4ffb-8444-20e2fef40495 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:54.146094 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2912/5836] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:54 2021] PUT /identity/v3/projects/cc35c5718c324f308ca58403f01daaed/users/917132e2e4f04022855b8ec6374efdb5/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:54.149996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdde98-32e1-4b5a-bfc9-322870351a58 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:54.169975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdde98-32e1-4b5a-bfc9-322870351a58 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:54.306208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38252fe-758c-4dfe-bbf5-b328f5d9d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:54.307433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38252fe-758c-4dfe-bbf5-b328f5d9d930 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:54.307892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38252fe-758c-4dfe-bbf5-b328f5d9d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:54.308338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38252fe-758c-4dfe-bbf5-b328f5d9d930 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:54.309246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38252fe-758c-4dfe-bbf5-b328f5d9d930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:54.311061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38252fe-758c-4dfe-bbf5-b328f5d9d930 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:54.326027 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2925/5837] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:54 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:54.330963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c793076-e74f-4ffb-8444-20e2fef40495 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:54.344710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c793076-e74f-4ffb-8444-20e2fef40495 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:54.352792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2b7cb-06af-4e1c-bbf6-4794b1090897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:54.354634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2b7cb-06af-4e1c-bbf6-4794b1090897 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:54.355226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2b7cb-06af-4e1c-bbf6-4794b1090897 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:54.356025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2b7cb-06af-4e1c-bbf6-4794b1090897 admin admin] PATH_INFO: `/v3/projects/cc35c5718c324f308ca58403f01daaed/users/917132e2e4f04022855b8ec6374efdb5/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:54.358870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2b7cb-06af-4e1c-bbf6-4794b1090897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc35c5718c324f308ca58403f01daaed, user_id=917132e2e4f04022855b8ec6374efdb5, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:54.362657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2b7cb-06af-4e1c-bbf6-4794b1090897 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:54.392463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cde2a-935c-4f62-9aa8-7ca01651c5c7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:54.393664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cde2a-935c-4f62-9aa8-7ca01651c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:54.395811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cde2a-935c-4f62-9aa8-7ca01651c5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:54.407058 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2913/5838] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:54 2021] PUT /identity/v3/projects/cc35c5718c324f308ca58403f01daaed/users/917132e2e4f04022855b8ec6374efdb5/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:54.451700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c04cde2a-935c-4f62-9aa8-7ca01651c5c7 None None] MFA Rules not processed for user `917132e2e4f04022855b8ec6374efdb5`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:54.453583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c04cde2a-935c-4f62-9aa8-7ca01651c5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:54.557129 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2926/5839] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:54 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:54.567154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2b7cb-06af-4e1c-bbf6-4794b1090897 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:54.570448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1aa2b7cb-06af-4e1c-bbf6-4794b1090897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:54.700023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2b7cb-06af-4e1c-bbf6-4794b1090897 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:54.713285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153a6bc-ca56-4c37-968d-a44130c7abec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:54.714107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153a6bc-ca56-4c37-968d-a44130c7abec service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:54.714399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153a6bc-ca56-4c37-968d-a44130c7abec service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:54.714676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153a6bc-ca56-4c37-968d-a44130c7abec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:54.747037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153a6bc-ca56-4c37-968d-a44130c7abec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:54.751396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153a6bc-ca56-4c37-968d-a44130c7abec service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:54.787640 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2914/5840] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:54 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:55.856560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cde2a-935c-4f62-9aa8-7ca01651c5c7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:56.003480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cde2a-935c-4f62-9aa8-7ca01651c5c7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:56.008525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:56.010328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:56.011113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:56.012083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] PATH_INFO: `/v3/users/536a498c9a2148f3bddc01e58f339e3a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:56.013902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536a498c9a2148f3bddc01e58f339e3a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:56.016496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:56.084566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536a498c9a2148f3bddc01e58f339e3a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:56.103402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536a498c9a2148f3bddc01e58f339e3a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:56.106062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536a498c9a2148f3bddc01e58f339e3a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:56.136105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536a498c9a2148f3bddc01e58f339e3a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:56.159642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536a498c9a2148f3bddc01e58f339e3a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:56.179037 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2927/5841] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:55 2021] DELETE /identity/v3/users/536a498c9a2148f3bddc01e58f339e3a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:56.184528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496de51-957b-47c5-946e-3e6b3e63bf0d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:56.185108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496de51-957b-47c5-946e-3e6b3e63bf0d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:56.185336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496de51-957b-47c5-946e-3e6b3e63bf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:56.216261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5496de51-957b-47c5-946e-3e6b3e63bf0d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:56.217740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5496de51-957b-47c5-946e-3e6b3e63bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:56.343719 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2915/5842] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:03:56.354998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:56.356575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:56.472618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060aa07-7db9-4d2a-9041-938088d133e5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:56.478469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e252b-55b2-422e-a08d-7d1bd8f2cc48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:56.479584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e252b-55b2-422e-a08d-7d1bd8f2cc48 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:56.480127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e252b-55b2-422e-a08d-7d1bd8f2cc48 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:56.480647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e252b-55b2-422e-a08d-7d1bd8f2cc48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:56.498202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e252b-55b2-422e-a08d-7d1bd8f2cc48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:56.499847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e252b-55b2-422e-a08d-7d1bd8f2cc48 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:56.520988 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2928/5843] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:57.019592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496de51-957b-47c5-946e-3e6b3e63bf0d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:57.022591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5496de51-957b-47c5-946e-3e6b3e63bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:57.039200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496de51-957b-47c5-946e-3e6b3e63bf0d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:57.045788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:57.046657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:57.046943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:57.047220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] PATH_INFO: `/v3/projects/729d646328dc402daf431a72802e573e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:57.048573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729d646328dc402daf431a72802e573e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:57.058457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:57.129652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729d646328dc402daf431a72802e573e', 'request_id': 'req-c93e2005-2577-480f-a1f2-b7da2023f4d1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:57.138012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729d646328dc402daf431a72802e573e', 'request_id': 'req-c93e2005-2577-480f-a1f2-b7da2023f4d1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:57.150015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729d646328dc402daf431a72802e573e', 'request_id': 'req-c93e2005-2577-480f-a1f2-b7da2023f4d1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:57.177862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] The token cache is being invalidate because project 729d646328dc402daf431a72802e573e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:03:57.179869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:57.184847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:57.187630 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2916/5844] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:03:57 2021] DELETE /identity/v3/projects/729d646328dc402daf431a72802e573e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:03:57.191736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e252b-55b2-422e-a08d-7d1bd8f2cc48 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:57.223892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e252b-55b2-422e-a08d-7d1bd8f2cc48 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:57.376898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dc505-e2cf-4b0e-bd1d-c9d00f33c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:57.378336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dc505-e2cf-4b0e-bd1d-c9d00f33c412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:57.378812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dc505-e2cf-4b0e-bd1d-c9d00f33c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:57.379307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dc505-e2cf-4b0e-bd1d-c9d00f33c412 admin admin] PATH_INFO: `/v3/users/917132e2e4f04022855b8ec6374efdb5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:57.381175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dc505-e2cf-4b0e-bd1d-c9d00f33c412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917132e2e4f04022855b8ec6374efdb5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:57.383683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dc505-e2cf-4b0e-bd1d-c9d00f33c412 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:57.494176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c08dc505-e2cf-4b0e-bd1d-c9d00f33c412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917132e2e4f04022855b8ec6374efdb5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:57.523082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c08dc505-e2cf-4b0e-bd1d-c9d00f33c412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917132e2e4f04022855b8ec6374efdb5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:57.525453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c08dc505-e2cf-4b0e-bd1d-c9d00f33c412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917132e2e4f04022855b8ec6374efdb5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:57.535662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c08dc505-e2cf-4b0e-bd1d-c9d00f33c412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917132e2e4f04022855b8ec6374efdb5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:57.559648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c08dc505-e2cf-4b0e-bd1d-c9d00f33c412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917132e2e4f04022855b8ec6374efdb5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:57.589287 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2929/5845] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:57 2021] DELETE /identity/v3/users/917132e2e4f04022855b8ec6374efdb5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:58.302493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:58.304483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:58.334151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e2005-2577-480f-a1f2-b7da2023f4d1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:58.469774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:58.470962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:58.473023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:58.473605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] PATH_INFO: `/v3/projects/cc35c5718c324f308ca58403f01daaed` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:58.475732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc35c5718c324f308ca58403f01daaed)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:58.480256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:58.578939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc35c5718c324f308ca58403f01daaed', 'request_id': 'req-48c6f264-871f-47f6-a700-758dafb74c78'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:58.588174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc35c5718c324f308ca58403f01daaed', 'request_id': 'req-48c6f264-871f-47f6-a700-758dafb74c78'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:58.601360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc35c5718c324f308ca58403f01daaed', 'request_id': 'req-48c6f264-871f-47f6-a700-758dafb74c78'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:58.620633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] The token cache is being invalidate because project cc35c5718c324f308ca58403f01daaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:03:58.621292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:58.622642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-48c6f264-871f-47f6-a700-758dafb74c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:03:58.625210 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2917/5846] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:03:58 2021] DELETE /identity/v3/projects/cc35c5718c324f308ca58403f01daaed => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:58.630828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184795e-9d81-4b20-84c3-25a0e2a34b84 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:58.631755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184795e-9d81-4b20-84c3-25a0e2a34b84 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:58.632314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184795e-9d81-4b20-84c3-25a0e2a34b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:58.664250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3184795e-9d81-4b20-84c3-25a0e2a34b84 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:58.666373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3184795e-9d81-4b20-84c3-25a0e2a34b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:58.763226 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2930/5847] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:58.763579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2e09-83c4-411c-919e-97b62b0dc0e6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:58.763872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2e09-83c4-411c-919e-97b62b0dc0e6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:58.764151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c2e09-83c4-411c-919e-97b62b0dc0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:58.795193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a33c2e09-83c4-411c-919e-97b62b0dc0e6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:58.796906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a33c2e09-83c4-411c-919e-97b62b0dc0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:58.807295 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2918/5848] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:58.811016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184795e-9d81-4b20-84c3-25a0e2a34b84 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:58.823397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184795e-9d81-4b20-84c3-25a0e2a34b84 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:58.829064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb123ce-cb9f-43f3-bd25-ad30971d6697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:58.829883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb123ce-cb9f-43f3-bd25-ad30971d6697 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:58.830274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb123ce-cb9f-43f3-bd25-ad30971d6697 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:58.830654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb123ce-cb9f-43f3-bd25-ad30971d6697 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:58.831889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb123ce-cb9f-43f3-bd25-ad30971d6697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:03:58.832325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb123ce-cb9f-43f3-bd25-ad30971d6697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:58.836101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb123ce-cb9f-43f3-bd25-ad30971d6697 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:58.857861 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2931/5849] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:03:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:03:58.862733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c2e09-83c4-411c-919e-97b62b0dc0e6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:58.875185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c2e09-83c4-411c-919e-97b62b0dc0e6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:58.880787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effcc20-cfd0-4bf8-a1a6-98825607e574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:58.881574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effcc20-cfd0-4bf8-a1a6-98825607e574 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:58.881985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effcc20-cfd0-4bf8-a1a6-98825607e574 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:58.882345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effcc20-cfd0-4bf8-a1a6-98825607e574 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:58.883205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effcc20-cfd0-4bf8-a1a6-98825607e574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:58.885288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effcc20-cfd0-4bf8-a1a6-98825607e574 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:58.958873 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2919/5850] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:03:58 2021] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:58.961933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb123ce-cb9f-43f3-bd25-ad30971d6697 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:58.974791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb123ce-cb9f-43f3-bd25-ad30971d6697 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:59.096434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a125e0f-7196-4463-af9e-ffefaa3a71e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:59.097689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a125e0f-7196-4463-af9e-ffefaa3a71e2 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:59.097982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a125e0f-7196-4463-af9e-ffefaa3a71e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:59.098403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a125e0f-7196-4463-af9e-ffefaa3a71e2 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:59.099680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a125e0f-7196-4463-af9e-ffefaa3a71e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:59.102682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a125e0f-7196-4463-af9e-ffefaa3a71e2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:59.155207 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2932/5851] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:03:58 2021] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:03:59.155474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effcc20-cfd0-4bf8-a1a6-98825607e574 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:59.176602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effcc20-cfd0-4bf8-a1a6-98825607e574 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:59.187048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c35a30-4d05-4e49-ada7-7f96cc390ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:59.188042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c35a30-4d05-4e49-ada7-7f96cc390ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:59.188972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c35a30-4d05-4e49-ada7-7f96cc390ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:59.189369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c35a30-4d05-4e49-ada7-7f96cc390ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:59.190230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c35a30-4d05-4e49-ada7-7f96cc390ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:59.192936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c35a30-4d05-4e49-ada7-7f96cc390ea9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:59.228083 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2920/5852] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:59 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:59.232912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a125e0f-7196-4463-af9e-ffefaa3a71e2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:59.246942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a125e0f-7196-4463-af9e-ffefaa3a71e2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:59.254225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716a903-5a06-4c6c-8c74-c3e505065a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:59.255163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716a903-5a06-4c6c-8c74-c3e505065a4c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:59.255587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716a903-5a06-4c6c-8c74-c3e505065a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:59.255964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716a903-5a06-4c6c-8c74-c3e505065a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:59.256827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716a903-5a06-4c6c-8c74-c3e505065a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:59.258825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716a903-5a06-4c6c-8c74-c3e505065a4c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:59.282704 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2933/5853] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:03:59 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:03:59.286624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c35a30-4d05-4e49-ada7-7f96cc390ea9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:59.304818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c35a30-4d05-4e49-ada7-7f96cc390ea9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:59.316206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62c25f-938b-4cba-a6a9-e6090621c6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:59.317473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62c25f-938b-4cba-a6a9-e6090621c6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:59.319055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62c25f-938b-4cba-a6a9-e6090621c6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:59.319475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62c25f-938b-4cba-a6a9-e6090621c6d8 admin admin] PATH_INFO: `/v3/projects/dc2a93607ef34ee79159a197933e3139/users/821bf7a49f274a84a341ad6b3ec8785c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:59.356660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62c25f-938b-4cba-a6a9-e6090621c6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2a93607ef34ee79159a197933e3139, user_id=821bf7a49f274a84a341ad6b3ec8785c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:59.360540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62c25f-938b-4cba-a6a9-e6090621c6d8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:59.441747 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2921/5854] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:03:59 2021] PUT /identity/v3/projects/dc2a93607ef34ee79159a197933e3139/users/821bf7a49f274a84a341ad6b3ec8785c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:03:59.454020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a2f0a-a806-4b0d-906f-53abebc5f29e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:59.454712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a2f0a-a806-4b0d-906f-53abebc5f29e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:59.455177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a2f0a-a806-4b0d-906f-53abebc5f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:59.510206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-429a2f0a-a806-4b0d-906f-53abebc5f29e None None] MFA Rules not processed for user `821bf7a49f274a84a341ad6b3ec8785c`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:03:59.514996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-429a2f0a-a806-4b0d-906f-53abebc5f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:59.663110 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2934/5855] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:03:59 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:03:59.673545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62c25f-938b-4cba-a6a9-e6090621c6d8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:59.675491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cf62c25f-938b-4cba-a6a9-e6090621c6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:03:59.769405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62c25f-938b-4cba-a6a9-e6090621c6d8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:59.776329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689293e-02ee-40f7-a73a-3418580b7c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:59.777652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689293e-02ee-40f7-a73a-3418580b7c11 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:59.778288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689293e-02ee-40f7-a73a-3418580b7c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:59.779018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689293e-02ee-40f7-a73a-3418580b7c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:59.790765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689293e-02ee-40f7-a73a-3418580b7c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:59.792423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689293e-02ee-40f7-a73a-3418580b7c11 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:03:59.836441 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2922/5856] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:03:59 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:03:59.845199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a2f0a-a806-4b0d-906f-53abebc5f29e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:03:59.924547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a2f0a-a806-4b0d-906f-53abebc5f29e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:03:59.934173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:03:59.935123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:03:59.935441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:03:59.935722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] PATH_INFO: `/v3/users/821bf7a49f274a84a341ad6b3ec8785c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:03:59.937310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=821bf7a49f274a84a341ad6b3ec8785c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:03:59.939343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:00.019577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821bf7a49f274a84a341ad6b3ec8785c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:00.035516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821bf7a49f274a84a341ad6b3ec8785c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:00.036879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821bf7a49f274a84a341ad6b3ec8785c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:00.059675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821bf7a49f274a84a341ad6b3ec8785c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:00.099151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821bf7a49f274a84a341ad6b3ec8785c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:00.112325 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2935/5857] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:03:59 2021] DELETE /identity/v3/users/821bf7a49f274a84a341ad6b3ec8785c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:00.113836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceabb70-0f72-4890-887c-d9837c491ca0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:00.114135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceabb70-0f72-4890-887c-d9837c491ca0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:00.114420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceabb70-0f72-4890-887c-d9837c491ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:00.141645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2ceabb70-0f72-4890-887c-d9837c491ca0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:00.143912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2ceabb70-0f72-4890-887c-d9837c491ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:00.245950 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2923/5858] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:00.264495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:00.265980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:00.400014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d4b8f-7336-4c8c-9acc-b3d09a35fff4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:00.410808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb665fe-1d38-442a-88ce-cbda8262d676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:00.411515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb665fe-1d38-442a-88ce-cbda8262d676 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:00.411859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb665fe-1d38-442a-88ce-cbda8262d676 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:00.412067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb665fe-1d38-442a-88ce-cbda8262d676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:00.426826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb665fe-1d38-442a-88ce-cbda8262d676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:00.428319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb665fe-1d38-442a-88ce-cbda8262d676 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:00.457607 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2936/5859] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:04:01.057647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceabb70-0f72-4890-887c-d9837c491ca0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:01.059427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2ceabb70-0f72-4890-887c-d9837c491ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:01.081213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceabb70-0f72-4890-887c-d9837c491ca0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:01.093580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:01.094477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:01.094764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:01.095049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] PATH_INFO: `/v3/projects/dc2a93607ef34ee79159a197933e3139` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:01.096405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2a93607ef34ee79159a197933e3139)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:01.098553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:01.190549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2a93607ef34ee79159a197933e3139', 'request_id': 'req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:01.206103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2a93607ef34ee79159a197933e3139', 'request_id': 'req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:01.220535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2a93607ef34ee79159a197933e3139', 'request_id': 'req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:01.235512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] The token cache is being invalidate because project dc2a93607ef34ee79159a197933e3139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:01.235923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:01.236696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa4c5ca8-55e5-4f89-b6af-729f5a540b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:01.238569 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2924/5860] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:01 2021] DELETE /identity/v3/projects/dc2a93607ef34ee79159a197933e3139 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:01.245614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8287e-a65e-4a37-97a0-73ef2576e7a4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:01.246778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8287e-a65e-4a37-97a0-73ef2576e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:01.247350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8287e-a65e-4a37-97a0-73ef2576e7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:01.292153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-50b8287e-a65e-4a37-97a0-73ef2576e7a4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:01.296059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-50b8287e-a65e-4a37-97a0-73ef2576e7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:01.400142 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2937/5861] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:01.408304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ab395-b7c1-4d84-9bbb-7628b10fd58f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:01.408845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ab395-b7c1-4d84-9bbb-7628b10fd58f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:01.409312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ab395-b7c1-4d84-9bbb-7628b10fd58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:01.430692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f15ab395-b7c1-4d84-9bbb-7628b10fd58f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:01.432359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f15ab395-b7c1-4d84-9bbb-7628b10fd58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:01.446459 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2925/5862] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:01.451901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8287e-a65e-4a37-97a0-73ef2576e7a4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:01.463037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8287e-a65e-4a37-97a0-73ef2576e7a4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:01.477372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6e4d3-f740-46ae-a70b-f7a9c45f1465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:01.479036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6e4d3-f740-46ae-a70b-f7a9c45f1465 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:01.479707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6e4d3-f740-46ae-a70b-f7a9c45f1465 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:01.480285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6e4d3-f740-46ae-a70b-f7a9c45f1465 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:01.481981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6e4d3-f740-46ae-a70b-f7a9c45f1465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:01.482527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6e4d3-f740-46ae-a70b-f7a9c45f1465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:01.485065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6e4d3-f740-46ae-a70b-f7a9c45f1465 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:01.508732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ab395-b7c1-4d84-9bbb-7628b10fd58f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:01.513696 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2938/5863] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:04:01.521818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ab395-b7c1-4d84-9bbb-7628b10fd58f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:01.528261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ceeba-f2f5-45fb-aefe-a54378ae90ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:01.529040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ceeba-f2f5-45fb-aefe-a54378ae90ca admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:01.529440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ceeba-f2f5-45fb-aefe-a54378ae90ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:01.529734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ceeba-f2f5-45fb-aefe-a54378ae90ca admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:01.530435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ceeba-f2f5-45fb-aefe-a54378ae90ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:01.532600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ceeba-f2f5-45fb-aefe-a54378ae90ca admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:01.584540 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2926/5864] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:01 2021] POST /identity/v3/projects => generated 361 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:01.589932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6e4d3-f740-46ae-a70b-f7a9c45f1465 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:01.612216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6e4d3-f740-46ae-a70b-f7a9c45f1465 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:01.692724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257357c-0925-4e9c-8fd9-b1e07675b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:01.694008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257357c-0925-4e9c-8fd9-b1e07675b628 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:01.694491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257357c-0925-4e9c-8fd9-b1e07675b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:01.694955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257357c-0925-4e9c-8fd9-b1e07675b628 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:01.696602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257357c-0925-4e9c-8fd9-b1e07675b628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:01.698744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257357c-0925-4e9c-8fd9-b1e07675b628 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:01.732066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ceeba-f2f5-45fb-aefe-a54378ae90ca admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:01.739107 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2939/5865] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:01 2021] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:01.747965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ceeba-f2f5-45fb-aefe-a54378ae90ca admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:01.753815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cf109-130b-46c9-adfd-d52c515ea364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:01.754810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf109-130b-46c9-adfd-d52c515ea364 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:01.755551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf109-130b-46c9-adfd-d52c515ea364 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:01.756173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf109-130b-46c9-adfd-d52c515ea364 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:01.757257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cf109-130b-46c9-adfd-d52c515ea364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:01.759901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cf109-130b-46c9-adfd-d52c515ea364 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:01.780572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257357c-0925-4e9c-8fd9-b1e07675b628 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:01.792739 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2927/5866] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:01 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:01.795828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257357c-0925-4e9c-8fd9-b1e07675b628 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:01.802227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64c767-6d81-40fa-b913-cd0289926115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:01.803353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c767-6d81-40fa-b913-cd0289926115 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:01.803647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c767-6d81-40fa-b913-cd0289926115 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:01.803929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64c767-6d81-40fa-b913-cd0289926115 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:01.805449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64c767-6d81-40fa-b913-cd0289926115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:01.807435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64c767-6d81-40fa-b913-cd0289926115 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:01.828360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cf109-130b-46c9-adfd-d52c515ea364 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:01.841235 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2940/5867] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:01 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:01.849409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cf109-130b-46c9-adfd-d52c515ea364 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:01.854756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16a888-f300-4f35-8459-d486b74e782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:01.855699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16a888-f300-4f35-8459-d486b74e782c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:01.856114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16a888-f300-4f35-8459-d486b74e782c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:01.856399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16a888-f300-4f35-8459-d486b74e782c admin admin] PATH_INFO: `/v3/projects/35affc1c8c4f49a6b9007d030950a896/users/325bb208db684675bb61e4ecac12d2f9/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:01.878605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16a888-f300-4f35-8459-d486b74e782c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35affc1c8c4f49a6b9007d030950a896, user_id=325bb208db684675bb61e4ecac12d2f9, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:01.881578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16a888-f300-4f35-8459-d486b74e782c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:01.911146 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2928/5868] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:01 2021] PUT /identity/v3/projects/35affc1c8c4f49a6b9007d030950a896/users/325bb208db684675bb61e4ecac12d2f9/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:01.923636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910000a1-81ff-461c-be5c-83162ea4f145 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:01.923925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910000a1-81ff-461c-be5c-83162ea4f145 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:01.924207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910000a1-81ff-461c-be5c-83162ea4f145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:01.970394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-910000a1-81ff-461c-be5c-83162ea4f145 None None] MFA Rules not processed for user `325bb208db684675bb61e4ecac12d2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:01.971892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-910000a1-81ff-461c-be5c-83162ea4f145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:02.104173 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2941/5869] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:01 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:02.105390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16a888-f300-4f35-8459-d486b74e782c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:02.107164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0b16a888-f300-4f35-8459-d486b74e782c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:02.205054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16a888-f300-4f35-8459-d486b74e782c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:02.209720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4630be-429c-4c1f-9272-82c2231ce1e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:02.215674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4630be-429c-4c1f-9272-82c2231ce1e7 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:02.216244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4630be-429c-4c1f-9272-82c2231ce1e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:02.216704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4630be-429c-4c1f-9272-82c2231ce1e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:02.239505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4630be-429c-4c1f-9272-82c2231ce1e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:02.241785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4630be-429c-4c1f-9272-82c2231ce1e7 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:02.269395 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2929/5870] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:02 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:02.284277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910000a1-81ff-461c-be5c-83162ea4f145 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:02.421832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910000a1-81ff-461c-be5c-83162ea4f145 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:02.435966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:02.436899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:02.437179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:02.437453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] PATH_INFO: `/v3/users/325bb208db684675bb61e4ecac12d2f9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:02.439061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325bb208db684675bb61e4ecac12d2f9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:02.441384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:02.540200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325bb208db684675bb61e4ecac12d2f9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:02.554371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325bb208db684675bb61e4ecac12d2f9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:02.555101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325bb208db684675bb61e4ecac12d2f9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:02.568665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325bb208db684675bb61e4ecac12d2f9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:02.594569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325bb208db684675bb61e4ecac12d2f9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:02.605827 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2942/5871] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:02 2021] DELETE /identity/v3/users/325bb208db684675bb61e4ecac12d2f9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:02.619348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a104-306e-4d1d-a6b2-c7617cb5e60f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:02.627794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a104-306e-4d1d-a6b2-c7617cb5e60f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:02.628122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a104-306e-4d1d-a6b2-c7617cb5e60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:02.666897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-efe7a104-306e-4d1d-a6b2-c7617cb5e60f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:02.669280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-efe7a104-306e-4d1d-a6b2-c7617cb5e60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:02.760729 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2930/5872] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:02.774676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:02.776184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:02.865832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a14cb-d5ef-4249-8994-f7e1537d3749 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:02.869796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2714c3a-d999-4816-868c-058b98014811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:02.870703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714c3a-d999-4816-868c-058b98014811 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:02.871090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714c3a-d999-4816-868c-058b98014811 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:02.871767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714c3a-d999-4816-868c-058b98014811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:02.881399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2714c3a-d999-4816-868c-058b98014811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:02.882812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2714c3a-d999-4816-868c-058b98014811 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:02.897397 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2943/5873] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:03.277453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7a104-306e-4d1d-a6b2-c7617cb5e60f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:03.279091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-efe7a104-306e-4d1d-a6b2-c7617cb5e60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:03.293138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7a104-306e-4d1d-a6b2-c7617cb5e60f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:03.335025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:03.335958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:03.336273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:03.336636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] PATH_INFO: `/v3/projects/35affc1c8c4f49a6b9007d030950a896` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:03.339488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=35affc1c8c4f49a6b9007d030950a896)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:03.350303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:03.484972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35affc1c8c4f49a6b9007d030950a896', 'request_id': 'req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:03.493840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35affc1c8c4f49a6b9007d030950a896', 'request_id': 'req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:03.505975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35affc1c8c4f49a6b9007d030950a896', 'request_id': 'req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:03.541670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] The token cache is being invalidate because project 35affc1c8c4f49a6b9007d030950a896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:03.542292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:03.545779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c5a5cc51-d770-4bac-a5aa-ce2245a579bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:03.550791 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2931/5874] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:03 2021] DELETE /identity/v3/projects/35affc1c8c4f49a6b9007d030950a896 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:03.557008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff927a-ca06-47f8-831b-5305bb86cf72 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:03.557968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff927a-ca06-47f8-831b-5305bb86cf72 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:03.558523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff927a-ca06-47f8-831b-5305bb86cf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:03.609520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e0ff927a-ca06-47f8-831b-5305bb86cf72 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:03.611835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e0ff927a-ca06-47f8-831b-5305bb86cf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:03.711497 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2944/5875] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:03.719356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3ff0e-4634-4217-b853-1e71e62c25ea None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:03.720049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3ff0e-4634-4217-b853-1e71e62c25ea None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:03.720991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3ff0e-4634-4217-b853-1e71e62c25ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:03.744301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-eda3ff0e-4634-4217-b853-1e71e62c25ea None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:03.745807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eda3ff0e-4634-4217-b853-1e71e62c25ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:03.761257 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2932/5876] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:03.765211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff927a-ca06-47f8-831b-5305bb86cf72 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:03.778574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff927a-ca06-47f8-831b-5305bb86cf72 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:03.806389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9422d-7668-428d-bac8-5fc32802edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:03.806389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9422d-7668-428d-bac8-5fc32802edf8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:03.806708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9422d-7668-428d-bac8-5fc32802edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:03.806970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9422d-7668-428d-bac8-5fc32802edf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:03.807725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9422d-7668-428d-bac8-5fc32802edf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:03.808362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9422d-7668-428d-bac8-5fc32802edf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:03.810100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9422d-7668-428d-bac8-5fc32802edf8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:03.824402 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2945/5877] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:04:03.829238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3ff0e-4634-4217-b853-1e71e62c25ea None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:03.842537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3ff0e-4634-4217-b853-1e71e62c25ea None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:03.870585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa5b5d-9541-46b9-a111-c5dcd4dec4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:03.871812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa5b5d-9541-46b9-a111-c5dcd4dec4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:03.872191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa5b5d-9541-46b9-a111-c5dcd4dec4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:03.872712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa5b5d-9541-46b9-a111-c5dcd4dec4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:03.873659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa5b5d-9541-46b9-a111-c5dcd4dec4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:03.880363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa5b5d-9541-46b9-a111-c5dcd4dec4c1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:03.928340 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2933/5878] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:03 2021] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:03.930457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9422d-7668-428d-bac8-5fc32802edf8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:03.942140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9422d-7668-428d-bac8-5fc32802edf8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:03.968689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa5b5d-9541-46b9-a111-c5dcd4dec4c1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:03.971460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5daa5b5d-9541-46b9-a111-c5dcd4dec4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:04.053842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfc86b-f3f7-4514-aa85-bdb11a4b8969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:04.055182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfc86b-f3f7-4514-aa85-bdb11a4b8969 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:04.061964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfc86b-f3f7-4514-aa85-bdb11a4b8969 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:04.062704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfc86b-f3f7-4514-aa85-bdb11a4b8969 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:04.064166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfc86b-f3f7-4514-aa85-bdb11a4b8969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:04.068199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfc86b-f3f7-4514-aa85-bdb11a4b8969 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:04.093075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa5b5d-9541-46b9-a111-c5dcd4dec4c1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:04.098619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7971fe-9305-4c8d-a31d-2347819f9f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:04.099132 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2946/5879] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:03 2021] POST /identity/v3/users => generated 282 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:04.103689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfc86b-f3f7-4514-aa85-bdb11a4b8969 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:04.103891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7971fe-9305-4c8d-a31d-2347819f9f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:04.104224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7971fe-9305-4c8d-a31d-2347819f9f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:04.104451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7971fe-9305-4c8d-a31d-2347819f9f81 admin admin] PATH_INFO: `/v3/users/5cfbc8906c014331ae4adf04a164a7eb` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:04.105746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7971fe-9305-4c8d-a31d-2347819f9f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cfbc8906c014331ae4adf04a164a7eb)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:04.109152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7971fe-9305-4c8d-a31d-2347819f9f81 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:04.117047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfc86b-f3f7-4514-aa85-bdb11a4b8969 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:04.121357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0c01b-4de2-4b6b-999d-c65789534788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:04.122579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0c01b-4de2-4b6b-999d-c65789534788 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:04.123429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0c01b-4de2-4b6b-999d-c65789534788 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:04.123891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0c01b-4de2-4b6b-999d-c65789534788 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:04.124787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0c01b-4de2-4b6b-999d-c65789534788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:04.127407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0c01b-4de2-4b6b-999d-c65789534788 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:04.147148 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2947/5880] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:04 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:04.148357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0c01b-4de2-4b6b-999d-c65789534788 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:04.160588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0c01b-4de2-4b6b-999d-c65789534788 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:04.166546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ec889-594f-466f-8095-c92190c852ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:04.166745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c7971fe-9305-4c8d-a31d-2347819f9f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cfbc8906c014331ae4adf04a164a7eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:04.167328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec889-594f-466f-8095-c92190c852ce admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:04.167464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c7971fe-9305-4c8d-a31d-2347819f9f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cfbc8906c014331ae4adf04a164a7eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:04.167649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec889-594f-466f-8095-c92190c852ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:04.167901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec889-594f-466f-8095-c92190c852ce admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:04.168658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ec889-594f-466f-8095-c92190c852ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:04.170488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ec889-594f-466f-8095-c92190c852ce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:04.177326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c7971fe-9305-4c8d-a31d-2347819f9f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cfbc8906c014331ae4adf04a164a7eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:04.178003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c7971fe-9305-4c8d-a31d-2347819f9f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cfbc8906c014331ae4adf04a164a7eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:04.182792 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2948/5881] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:04 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:04.186662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ec889-594f-466f-8095-c92190c852ce admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:04.187920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c7971fe-9305-4c8d-a31d-2347819f9f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cfbc8906c014331ae4adf04a164a7eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:04.188608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-869ec889-594f-466f-8095-c92190c852ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:04.204024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ec889-594f-466f-8095-c92190c852ce admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:04.211608 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2934/5882] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:03 2021] DELETE /identity/v3/users/5cfbc8906c014331ae4adf04a164a7eb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:04.213339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386a375-e456-4f2b-9648-384a977ededf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:04.214804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386a375-e456-4f2b-9648-384a977ededf admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:04.214804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386a375-e456-4f2b-9648-384a977ededf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:04.214804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386a375-e456-4f2b-9648-384a977ededf admin admin] PATH_INFO: `/v3/projects/44b22e03c6d74976a86529d4cf57fb19/users/9fe049055ac04c0b909e9db231f692ca/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:04.215174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9b137-e70f-4be1-9438-06918b695de2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:04.215174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9b137-e70f-4be1-9438-06918b695de2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:04.215759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9b137-e70f-4be1-9438-06918b695de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:04.232074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386a375-e456-4f2b-9648-384a977ededf admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b22e03c6d74976a86529d4cf57fb19, user_id=9fe049055ac04c0b909e9db231f692ca, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:04.234987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386a375-e456-4f2b-9648-384a977ededf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:04.236144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-afd9b137-e70f-4be1-9438-06918b695de2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:04.237476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-afd9b137-e70f-4be1-9438-06918b695de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:04.263630 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2949/5883] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:04 2021] PUT /identity/v3/projects/44b22e03c6d74976a86529d4cf57fb19/users/9fe049055ac04c0b909e9db231f692ca/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:04:04.273091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18969b-b528-484e-9dbd-de434765c02c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:04.273383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18969b-b528-484e-9dbd-de434765c02c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:04.274318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18969b-b528-484e-9dbd-de434765c02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:04.313498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fc18969b-b528-484e-9dbd-de434765c02c None None] MFA Rules not processed for user `9fe049055ac04c0b909e9db231f692ca`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:04.314777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fc18969b-b528-484e-9dbd-de434765c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:04.337775 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2935/5884] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:04.352970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9b137-e70f-4be1-9438-06918b695de2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:04.357018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-afd9b137-e70f-4be1-9438-06918b695de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:04.423827 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2950/5885] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:04 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:04.436492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18969b-b528-484e-9dbd-de434765c02c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:04.438188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fc18969b-b528-484e-9dbd-de434765c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:04.464084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9b137-e70f-4be1-9438-06918b695de2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:04.501359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18969b-b528-484e-9dbd-de434765c02c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:04.505264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b74e4-3ccd-4a12-ae43-1d2a6cc95910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:04.505917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b74e4-3ccd-4a12-ae43-1d2a6cc95910 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:04.506201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b74e4-3ccd-4a12-ae43-1d2a6cc95910 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:04.506481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b74e4-3ccd-4a12-ae43-1d2a6cc95910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:04.515369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b74e4-3ccd-4a12-ae43-1d2a6cc95910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:04.516931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b74e4-3ccd-4a12-ae43-1d2a6cc95910 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:04.522853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395916a-0073-4c5a-949c-05499be2f9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:04.523520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395916a-0073-4c5a-949c-05499be2f9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:04.523816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395916a-0073-4c5a-949c-05499be2f9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:04.524089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395916a-0073-4c5a-949c-05499be2f9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:04.526375 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2951/5886] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:04 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:04:04.597614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395916a-0073-4c5a-949c-05499be2f9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:04.601497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395916a-0073-4c5a-949c-05499be2f9d4 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:04.610564 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2936/5887] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:04.949453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b74e4-3ccd-4a12-ae43-1d2a6cc95910 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:04.951294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-036b74e4-3ccd-4a12-ae43-1d2a6cc95910 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:04.993555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b74e4-3ccd-4a12-ae43-1d2a6cc95910 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:04.999706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:05.000773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.001339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.001617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] PATH_INFO: `/v3/projects/24b97e6d4e2d43e0a0b4751d6a04ffcd` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.002909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b97e6d4e2d43e0a0b4751d6a04ffcd)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:05.005477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:05.081858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b97e6d4e2d43e0a0b4751d6a04ffcd', 'request_id': 'req-46ea524c-681e-4447-9749-47ccc235e9e5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:05.090525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b97e6d4e2d43e0a0b4751d6a04ffcd', 'request_id': 'req-46ea524c-681e-4447-9749-47ccc235e9e5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:05.101021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b97e6d4e2d43e0a0b4751d6a04ffcd', 'request_id': 'req-46ea524c-681e-4447-9749-47ccc235e9e5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:05.119352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] The token cache is being invalidate because project 24b97e6d4e2d43e0a0b4751d6a04ffcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:05.119711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:05.121059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-46ea524c-681e-4447-9749-47ccc235e9e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:05.123228 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2952/5888] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:04 2021] DELETE /identity/v3/projects/24b97e6d4e2d43e0a0b4751d6a04ffcd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:05.129342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563735e-dce1-4b12-bd22-ede22b62c2a0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.129638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563735e-dce1-4b12-bd22-ede22b62c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.129985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563735e-dce1-4b12-bd22-ede22b62c2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.153047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d563735e-dce1-4b12-bd22-ede22b62c2a0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:05.154397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d563735e-dce1-4b12-bd22-ede22b62c2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:05.237352 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2937/5889] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:05.265486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cc75e-d0e7-41db-99cd-a51ebc80881d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.265486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cc75e-d0e7-41db-99cd-a51ebc80881d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.265486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187cc75e-d0e7-41db-99cd-a51ebc80881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.284850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-187cc75e-d0e7-41db-99cd-a51ebc80881d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:05.286060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-187cc75e-d0e7-41db-99cd-a51ebc80881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:05.299455 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2953/5890] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:05.303648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563735e-dce1-4b12-bd22-ede22b62c2a0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:05.315836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563735e-dce1-4b12-bd22-ede22b62c2a0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:05.320537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96861f72-6329-4d55-93d3-a35408ceb870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:05.321339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96861f72-6329-4d55-93d3-a35408ceb870 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.321623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96861f72-6329-4d55-93d3-a35408ceb870 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.321962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96861f72-6329-4d55-93d3-a35408ceb870 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.323006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96861f72-6329-4d55-93d3-a35408ceb870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:05.323405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96861f72-6329-4d55-93d3-a35408ceb870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:05.325255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96861f72-6329-4d55-93d3-a35408ceb870 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:05.339953 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2938/5891] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:04:05.344046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cc75e-d0e7-41db-99cd-a51ebc80881d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:05.357920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187cc75e-d0e7-41db-99cd-a51ebc80881d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:05.363536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03ca5-e83a-4768-8a31-335ad260e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:05.364313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03ca5-e83a-4768-8a31-335ad260e65b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.364668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03ca5-e83a-4768-8a31-335ad260e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.365358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03ca5-e83a-4768-8a31-335ad260e65b admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.365868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de03ca5-e83a-4768-8a31-335ad260e65b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:05.368457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de03ca5-e83a-4768-8a31-335ad260e65b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:05.404015 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2954/5892] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:05 2021] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:05.408462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96861f72-6329-4d55-93d3-a35408ceb870 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:05.425890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96861f72-6329-4d55-93d3-a35408ceb870 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:05.494883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6802d6-0581-4888-8411-ddbbf4e9dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:05.495908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6802d6-0581-4888-8411-ddbbf4e9dbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.496226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6802d6-0581-4888-8411-ddbbf4e9dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.496771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6802d6-0581-4888-8411-ddbbf4e9dbb3 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.497870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6802d6-0581-4888-8411-ddbbf4e9dbb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:05.501029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6802d6-0581-4888-8411-ddbbf4e9dbb3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:05.526502 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2939/5893] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:05 2021] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:05.528029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03ca5-e83a-4768-8a31-335ad260e65b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:05.539070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03ca5-e83a-4768-8a31-335ad260e65b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:05.544650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a304b-4cf3-47da-833a-b114498b843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:05.545316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a304b-4cf3-47da-833a-b114498b843c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.545601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a304b-4cf3-47da-833a-b114498b843c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.545880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a304b-4cf3-47da-833a-b114498b843c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.546614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a304b-4cf3-47da-833a-b114498b843c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:05.548231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a304b-4cf3-47da-833a-b114498b843c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:05.558993 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2955/5894] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:05 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:05.564423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6802d6-0581-4888-8411-ddbbf4e9dbb3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:05.574549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6802d6-0581-4888-8411-ddbbf4e9dbb3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:05.579938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131162b-7678-4792-88b5-23c69b921321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:05.580612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131162b-7678-4792-88b5-23c69b921321 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.580899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131162b-7678-4792-88b5-23c69b921321 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.581191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131162b-7678-4792-88b5-23c69b921321 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.581912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131162b-7678-4792-88b5-23c69b921321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:05.583573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131162b-7678-4792-88b5-23c69b921321 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:05.607137 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2940/5895] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:05 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:05.611037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a304b-4cf3-47da-833a-b114498b843c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:05.621881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a304b-4cf3-47da-833a-b114498b843c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:05.627050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cd3ba-484a-4f41-9562-b54382f6bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:05.627921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cd3ba-484a-4f41-9562-b54382f6bd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.628351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cd3ba-484a-4f41-9562-b54382f6bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.628637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cd3ba-484a-4f41-9562-b54382f6bd31 admin admin] PATH_INFO: `/v3/projects/43d96f70dd574c329276ab3646183310/users/6f916a8692ba40bba0fae64d4d9601d2/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.645475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cd3ba-484a-4f41-9562-b54382f6bd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d96f70dd574c329276ab3646183310, user_id=6f916a8692ba40bba0fae64d4d9601d2, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:05.648241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cd3ba-484a-4f41-9562-b54382f6bd31 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:05.663715 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2956/5896] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:05 2021] PUT /identity/v3/projects/43d96f70dd574c329276ab3646183310/users/6f916a8692ba40bba0fae64d4d9601d2/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:04:05.674504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad42c5-238b-4922-bb5b-16a951a4c75f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.674863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad42c5-238b-4922-bb5b-16a951a4c75f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.675218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad42c5-238b-4922-bb5b-16a951a4c75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.679738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cd3ba-484a-4f41-9562-b54382f6bd31 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:05.681366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-822cd3ba-484a-4f41-9562-b54382f6bd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:05.703463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3aad42c5-238b-4922-bb5b-16a951a4c75f None None] MFA Rules not processed for user `6f916a8692ba40bba0fae64d4d9601d2`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:05.704662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3aad42c5-238b-4922-bb5b-16a951a4c75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:05.751958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cd3ba-484a-4f41-9562-b54382f6bd31 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:05.756682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af69337-d5d9-4788-b9f9-2ccd024c7f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:05.757542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af69337-d5d9-4788-b9f9-2ccd024c7f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.758338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af69337-d5d9-4788-b9f9-2ccd024c7f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.758613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af69337-d5d9-4788-b9f9-2ccd024c7f97 admin admin] PATH_INFO: `/v3/users/c6a13a0815f442d19ac1bf3328468e87` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.759841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af69337-d5d9-4788-b9f9-2ccd024c7f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a13a0815f442d19ac1bf3328468e87)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:05.761853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af69337-d5d9-4788-b9f9-2ccd024c7f97 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:05.775351 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2941/5897] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:05 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:05.783389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad42c5-238b-4922-bb5b-16a951a4c75f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:05.784769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3aad42c5-238b-4922-bb5b-16a951a4c75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:05.810723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6af69337-d5d9-4788-b9f9-2ccd024c7f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a13a0815f442d19ac1bf3328468e87'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:05.822446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6af69337-d5d9-4788-b9f9-2ccd024c7f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a13a0815f442d19ac1bf3328468e87'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:05.823901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6af69337-d5d9-4788-b9f9-2ccd024c7f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a13a0815f442d19ac1bf3328468e87'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:05.835039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6af69337-d5d9-4788-b9f9-2ccd024c7f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a13a0815f442d19ac1bf3328468e87'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:05.848808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad42c5-238b-4922-bb5b-16a951a4c75f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:05.852138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6af69337-d5d9-4788-b9f9-2ccd024c7f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a13a0815f442d19ac1bf3328468e87'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:05.853051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d755686-2654-4091-9b59-36782462acd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:05.853701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d755686-2654-4091-9b59-36782462acd6 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.853968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d755686-2654-4091-9b59-36782462acd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.854373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d755686-2654-4091-9b59-36782462acd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.856273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8d755686-2654-4091-9b59-36782462acd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:05.859053 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2957/5898] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:05 2021] DELETE /identity/v3/users/c6a13a0815f442d19ac1bf3328468e87 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:04:05.863219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a8da9-0c11-4629-8c76-49f385de5ca8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:05.863650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a8da9-0c11-4629-8c76-49f385de5ca8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:05.863931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a8da9-0c11-4629-8c76-49f385de5ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:05.873826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d755686-2654-4091-9b59-36782462acd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:05.874076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d755686-2654-4091-9b59-36782462acd6 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:05.883544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-da5a8da9-0c11-4629-8c76-49f385de5ca8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:05.884751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-da5a8da9-0c11-4629-8c76-49f385de5ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:05.887832 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2942/5899] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:05 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:04:05.954863 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2958/5900] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:05.968179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d755686-2654-4091-9b59-36782462acd6 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:05.969804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8d755686-2654-4091-9b59-36782462acd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:05.997358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d755686-2654-4091-9b59-36782462acd6 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:06.078295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b1a46-8db4-447c-9e7f-7464fb030b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:06.078979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b1a46-8db4-447c-9e7f-7464fb030b44 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:06.079281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b1a46-8db4-447c-9e7f-7464fb030b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:06.079573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b1a46-8db4-447c-9e7f-7464fb030b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:06.092995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b1a46-8db4-447c-9e7f-7464fb030b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:06.094794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b1a46-8db4-447c-9e7f-7464fb030b44 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:06.127512 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2943/5901] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:06.550814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a8da9-0c11-4629-8c76-49f385de5ca8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:06.557105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-da5a8da9-0c11-4629-8c76-49f385de5ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:06.577373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a8da9-0c11-4629-8c76-49f385de5ca8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:06.584882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:06.586057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:06.586714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:06.587166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] PATH_INFO: `/v3/projects/e575c71c2e6441bfa9602dfd073623a8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:06.588950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e575c71c2e6441bfa9602dfd073623a8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:06.591924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:06.661551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e575c71c2e6441bfa9602dfd073623a8', 'request_id': 'req-80f07096-6824-4df9-953a-2b6fd95de311'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:06.673407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e575c71c2e6441bfa9602dfd073623a8', 'request_id': 'req-80f07096-6824-4df9-953a-2b6fd95de311'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:06.685334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e575c71c2e6441bfa9602dfd073623a8', 'request_id': 'req-80f07096-6824-4df9-953a-2b6fd95de311'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:06.709371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] The token cache is being invalidate because project e575c71c2e6441bfa9602dfd073623a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:06.709986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:06.711678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-80f07096-6824-4df9-953a-2b6fd95de311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:06.715330 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2959/5902] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:06 2021] DELETE /identity/v3/projects/e575c71c2e6441bfa9602dfd073623a8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:06.720988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b59e9-19ed-4ce1-9f0c-95357075c278 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:06.721877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b59e9-19ed-4ce1-9f0c-95357075c278 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:06.722362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b59e9-19ed-4ce1-9f0c-95357075c278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:06.754841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-033b59e9-19ed-4ce1-9f0c-95357075c278 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:06.756890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-033b59e9-19ed-4ce1-9f0c-95357075c278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:06.825404 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2944/5903] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:06.833665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe119233-3292-462c-b9a1-b418ff15b9ca None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:06.833913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe119233-3292-462c-b9a1-b418ff15b9ca None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:06.834215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe119233-3292-462c-b9a1-b418ff15b9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:06.859362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fe119233-3292-462c-b9a1-b418ff15b9ca None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:06.861291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fe119233-3292-462c-b9a1-b418ff15b9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:06.875717 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2960/5904] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:06.879727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b59e9-19ed-4ce1-9f0c-95357075c278 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:06.892814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b59e9-19ed-4ce1-9f0c-95357075c278 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:06.899017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2dc21-db37-4690-95e4-93ff4cf05fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:06.899918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2dc21-db37-4690-95e4-93ff4cf05fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:06.900248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2dc21-db37-4690-95e4-93ff4cf05fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:06.900533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2dc21-db37-4690-95e4-93ff4cf05fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:06.901556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2dc21-db37-4690-95e4-93ff4cf05fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:06.901900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2dc21-db37-4690-95e4-93ff4cf05fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:06.904544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2dc21-db37-4690-95e4-93ff4cf05fd4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:06.917271 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2945/5905] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:04:06.922285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe119233-3292-462c-b9a1-b418ff15b9ca None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:06.935014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe119233-3292-462c-b9a1-b418ff15b9ca None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:06.941176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e98ec1-bd1c-4a0e-81f3-20d01dcd84d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:06.942052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e98ec1-bd1c-4a0e-81f3-20d01dcd84d1 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:06.942347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e98ec1-bd1c-4a0e-81f3-20d01dcd84d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:06.942622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e98ec1-bd1c-4a0e-81f3-20d01dcd84d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:06.944186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e98ec1-bd1c-4a0e-81f3-20d01dcd84d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:06.951846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e98ec1-bd1c-4a0e-81f3-20d01dcd84d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:06.994409 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2961/5906] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:06 2021] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:07.000082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2dc21-db37-4690-95e4-93ff4cf05fd4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:07.014160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2dc21-db37-4690-95e4-93ff4cf05fd4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:07.125180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03786d22-2a29-451f-9b57-90da8bd00abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:07.126012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03786d22-2a29-451f-9b57-90da8bd00abe admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:07.126398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03786d22-2a29-451f-9b57-90da8bd00abe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:07.131358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03786d22-2a29-451f-9b57-90da8bd00abe admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:07.132229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03786d22-2a29-451f-9b57-90da8bd00abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:07.139047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03786d22-2a29-451f-9b57-90da8bd00abe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:07.169038 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2946/5907] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:06 2021] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:07.173289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e98ec1-bd1c-4a0e-81f3-20d01dcd84d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:07.188625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e98ec1-bd1c-4a0e-81f3-20d01dcd84d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:07.200050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae1822-310b-40bf-a36f-5657d89e8edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:07.205634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1822-310b-40bf-a36f-5657d89e8edc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:07.206842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1822-310b-40bf-a36f-5657d89e8edc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:07.207201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae1822-310b-40bf-a36f-5657d89e8edc admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:07.208624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae1822-310b-40bf-a36f-5657d89e8edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:07.213070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae1822-310b-40bf-a36f-5657d89e8edc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:07.241202 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2962/5908] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:07 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:07.245447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03786d22-2a29-451f-9b57-90da8bd00abe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:07.259968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03786d22-2a29-451f-9b57-90da8bd00abe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:07.268710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b24d70-e037-47a3-97e0-8cef3e1e21e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:07.269343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24d70-e037-47a3-97e0-8cef3e1e21e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:07.269634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24d70-e037-47a3-97e0-8cef3e1e21e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:07.269989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b24d70-e037-47a3-97e0-8cef3e1e21e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:07.270647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b24d70-e037-47a3-97e0-8cef3e1e21e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:07.272320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b24d70-e037-47a3-97e0-8cef3e1e21e7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:07.302091 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2947/5909] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:07 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:07.304655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae1822-310b-40bf-a36f-5657d89e8edc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:07.317599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae1822-310b-40bf-a36f-5657d89e8edc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:07.329633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee61422-1347-431b-8f33-23f83addb8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:07.330539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee61422-1347-431b-8f33-23f83addb8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:07.330881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee61422-1347-431b-8f33-23f83addb8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:07.331165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee61422-1347-431b-8f33-23f83addb8cd admin admin] PATH_INFO: `/v3/projects/1feb0a27f1ce419ab666e144c57a87e0/users/692f04afcb5348e28df6ac967c148e87/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:07.351798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee61422-1347-431b-8f33-23f83addb8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1feb0a27f1ce419ab666e144c57a87e0, user_id=692f04afcb5348e28df6ac967c148e87, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:07.354741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee61422-1347-431b-8f33-23f83addb8cd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:07.374134 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2963/5910] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:07 2021] PUT /identity/v3/projects/1feb0a27f1ce419ab666e144c57a87e0/users/692f04afcb5348e28df6ac967c148e87/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:07.386966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a7c1-2e38-4f76-a667-4aedca288e00 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:07.387363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a7c1-2e38-4f76-a667-4aedca288e00 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:07.387606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9a7c1-2e38-4f76-a667-4aedca288e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:07.419126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f8f9a7c1-2e38-4f76-a667-4aedca288e00 None None] MFA Rules not processed for user `692f04afcb5348e28df6ac967c148e87`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:07.420512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f8f9a7c1-2e38-4f76-a667-4aedca288e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:07.511666 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2948/5911] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:07 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:07.528627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee61422-1347-431b-8f33-23f83addb8cd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:07.530609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5ee61422-1347-431b-8f33-23f83addb8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:07.607432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee61422-1347-431b-8f33-23f83addb8cd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:07.612137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b4738-0232-4441-94ab-97508e6c4302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:07.613427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b4738-0232-4441-94ab-97508e6c4302 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:07.613817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b4738-0232-4441-94ab-97508e6c4302 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:07.614335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b4738-0232-4441-94ab-97508e6c4302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:07.625318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b4738-0232-4441-94ab-97508e6c4302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:07.626676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b4738-0232-4441-94ab-97508e6c4302 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:07.639079 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2964/5912] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:07 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:07.743821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9a7c1-2e38-4f76-a667-4aedca288e00 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:07.756899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9a7c1-2e38-4f76-a667-4aedca288e00 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:07.764073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd0982-79ee-4b77-b5a7-5fdfa690d41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:07.765045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0982-79ee-4b77-b5a7-5fdfa690d41a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:07.765389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0982-79ee-4b77-b5a7-5fdfa690d41a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:07.765873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd0982-79ee-4b77-b5a7-5fdfa690d41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:07.768180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-83dd0982-79ee-4b77-b5a7-5fdfa690d41a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:07.788761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd0982-79ee-4b77-b5a7-5fdfa690d41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:07.790686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd0982-79ee-4b77-b5a7-5fdfa690d41a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:07.823472 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2949/5913] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:07 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:07.978049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b4738-0232-4441-94ab-97508e6c4302 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:07.979754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f66b4738-0232-4441-94ab-97508e6c4302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:08.061777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b4738-0232-4441-94ab-97508e6c4302 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:08.066905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd62e1d-9eab-47dc-a4fe-a519318f818a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:08.067812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd62e1d-9eab-47dc-a4fe-a519318f818a service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:08.068289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd62e1d-9eab-47dc-a4fe-a519318f818a service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:08.068881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd62e1d-9eab-47dc-a4fe-a519318f818a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:08.071047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6bd62e1d-9eab-47dc-a4fe-a519318f818a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:08.164685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd62e1d-9eab-47dc-a4fe-a519318f818a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:08.166537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd62e1d-9eab-47dc-a4fe-a519318f818a service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:08.183667 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2965/5914] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:08.191542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd0982-79ee-4b77-b5a7-5fdfa690d41a service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:08.295365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd62e1d-9eab-47dc-a4fe-a519318f818a service glance] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:08.299077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6bd62e1d-9eab-47dc-a4fe-a519318f818a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:08.317683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd0982-79ee-4b77-b5a7-5fdfa690d41a service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:08.325249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96577ac4-7daa-4ef4-9f4e-3ae2f86f74eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:08.326201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96577ac4-7daa-4ef4-9f4e-3ae2f86f74eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:08.326500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96577ac4-7daa-4ef4-9f4e-3ae2f86f74eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:08.327455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96577ac4-7daa-4ef4-9f4e-3ae2f86f74eb admin admin] PATH_INFO: `/v3/users/692f04afcb5348e28df6ac967c148e87` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:08.328686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96577ac4-7daa-4ef4-9f4e-3ae2f86f74eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=692f04afcb5348e28df6ac967c148e87)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:08.330266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96577ac4-7daa-4ef4-9f4e-3ae2f86f74eb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:08.394696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-96577ac4-7daa-4ef4-9f4e-3ae2f86f74eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692f04afcb5348e28df6ac967c148e87'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:08.395414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-96577ac4-7daa-4ef4-9f4e-3ae2f86f74eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692f04afcb5348e28df6ac967c148e87'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:08.397795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd62e1d-9eab-47dc-a4fe-a519318f818a service glance] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:08.405283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba85ed2-94bd-4290-85ef-2d926cb5ee1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:08.406037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba85ed2-94bd-4290-85ef-2d926cb5ee1d service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:08.406362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba85ed2-94bd-4290-85ef-2d926cb5ee1d service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:08.406774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba85ed2-94bd-4290-85ef-2d926cb5ee1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:08.409434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4ba85ed2-94bd-4290-85ef-2d926cb5ee1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:08.421080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-96577ac4-7daa-4ef4-9f4e-3ae2f86f74eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692f04afcb5348e28df6ac967c148e87'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:08.424025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-96577ac4-7daa-4ef4-9f4e-3ae2f86f74eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692f04afcb5348e28df6ac967c148e87'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:08.430507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba85ed2-94bd-4290-85ef-2d926cb5ee1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:08.434431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba85ed2-94bd-4290-85ef-2d926cb5ee1d service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:08.441648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-96577ac4-7daa-4ef4-9f4e-3ae2f86f74eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692f04afcb5348e28df6ac967c148e87'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:08.464492 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2966/5915] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:08.466698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba85ed2-94bd-4290-85ef-2d926cb5ee1d service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:08.469153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4ba85ed2-94bd-4290-85ef-2d926cb5ee1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:08.486094 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2950/5916] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:08 2021] DELETE /identity/v3/users/692f04afcb5348e28df6ac967c148e87 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:08.494155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39487764-f4ec-4cf3-8db0-a494cfdf57d5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:08.494519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39487764-f4ec-4cf3-8db0-a494cfdf57d5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:08.494917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39487764-f4ec-4cf3-8db0-a494cfdf57d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:08.512345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba85ed2-94bd-4290-85ef-2d926cb5ee1d service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:08.522710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-39487764-f4ec-4cf3-8db0-a494cfdf57d5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:08.525285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-39487764-f4ec-4cf3-8db0-a494cfdf57d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:08.596940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e296d-5e86-4588-8a91-5abca1e97225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:08.597747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e296d-5e86-4588-8a91-5abca1e97225 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:08.598032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e296d-5e86-4588-8a91-5abca1e97225 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:08.598309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e296d-5e86-4588-8a91-5abca1e97225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:08.600494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-349e296d-5e86-4588-8a91-5abca1e97225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:08.615341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e296d-5e86-4588-8a91-5abca1e97225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:08.616830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e296d-5e86-4588-8a91-5abca1e97225 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:08.629624 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2967/5917] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:08 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:08.631338 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2951/5918] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:08.637394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e296d-5e86-4588-8a91-5abca1e97225 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:08.639118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-349e296d-5e86-4588-8a91-5abca1e97225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:08.652220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e296d-5e86-4588-8a91-5abca1e97225 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:08.656532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742f2ed-6dd5-4284-a2e7-28fb1d069c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:08.657207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f2ed-6dd5-4284-a2e7-28fb1d069c2f service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:08.657497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f2ed-6dd5-4284-a2e7-28fb1d069c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:08.657776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742f2ed-6dd5-4284-a2e7-28fb1d069c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:08.668544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742f2ed-6dd5-4284-a2e7-28fb1d069c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:08.669991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742f2ed-6dd5-4284-a2e7-28fb1d069c2f service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:08.680772 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2968/5919] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:09.243490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39487764-f4ec-4cf3-8db0-a494cfdf57d5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:09.245291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-39487764-f4ec-4cf3-8db0-a494cfdf57d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:09.266810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39487764-f4ec-4cf3-8db0-a494cfdf57d5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:09.281528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:09.282650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:09.282933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:09.283206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] PATH_INFO: `/v3/projects/1feb0a27f1ce419ab666e144c57a87e0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:09.285666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1feb0a27f1ce419ab666e144c57a87e0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:09.291395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:09.369656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1feb0a27f1ce419ab666e144c57a87e0', 'request_id': 'req-d4dc5527-f1d5-42c4-8248-42ec5705242d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:09.377996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1feb0a27f1ce419ab666e144c57a87e0', 'request_id': 'req-d4dc5527-f1d5-42c4-8248-42ec5705242d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:09.393041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1feb0a27f1ce419ab666e144c57a87e0', 'request_id': 'req-d4dc5527-f1d5-42c4-8248-42ec5705242d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:09.408910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] The token cache is being invalidate because project 1feb0a27f1ce419ab666e144c57a87e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:09.409181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:09.409772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d4dc5527-f1d5-42c4-8248-42ec5705242d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:09.414184 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2952/5920] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:09 2021] DELETE /identity/v3/projects/1feb0a27f1ce419ab666e144c57a87e0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:09.419673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3158b9-ce67-4dfa-bf34-22574fbef27a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:09.420322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3158b9-ce67-4dfa-bf34-22574fbef27a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:09.420322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3158b9-ce67-4dfa-bf34-22574fbef27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:09.462472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1b3158b9-ce67-4dfa-bf34-22574fbef27a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:09.466060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1b3158b9-ce67-4dfa-bf34-22574fbef27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:09.593969 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2969/5921] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:09.603074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623749d0-2756-4071-9015-50b5d20517ac None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:09.603446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623749d0-2756-4071-9015-50b5d20517ac None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:09.603727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623749d0-2756-4071-9015-50b5d20517ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:09.624452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-623749d0-2756-4071-9015-50b5d20517ac None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:09.625666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-623749d0-2756-4071-9015-50b5d20517ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:09.634244 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2953/5922] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:09.638529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3158b9-ce67-4dfa-bf34-22574fbef27a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:09.648199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3158b9-ce67-4dfa-bf34-22574fbef27a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:09.653352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90140e-a3ff-4cbf-8502-a61970bbf660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:09.654024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90140e-a3ff-4cbf-8502-a61970bbf660 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:09.654305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90140e-a3ff-4cbf-8502-a61970bbf660 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:09.654578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90140e-a3ff-4cbf-8502-a61970bbf660 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:09.655350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90140e-a3ff-4cbf-8502-a61970bbf660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:09.655657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90140e-a3ff-4cbf-8502-a61970bbf660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:09.657262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90140e-a3ff-4cbf-8502-a61970bbf660 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:09.670251 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2970/5923] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:04:09.674683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623749d0-2756-4071-9015-50b5d20517ac None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:09.686218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623749d0-2756-4071-9015-50b5d20517ac None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:09.691796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4ae8b-2a5f-420b-99b1-ec19581619de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:09.692454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4ae8b-2a5f-420b-99b1-ec19581619de admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:09.692741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4ae8b-2a5f-420b-99b1-ec19581619de admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:09.693015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4ae8b-2a5f-420b-99b1-ec19581619de admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:09.693730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4ae8b-2a5f-420b-99b1-ec19581619de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:09.695779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4ae8b-2a5f-420b-99b1-ec19581619de admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:09.729420 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2954/5924] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:09 2021] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:09.734166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90140e-a3ff-4cbf-8502-a61970bbf660 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:09.748123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90140e-a3ff-4cbf-8502-a61970bbf660 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:09.820774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74402ed5-c3f8-4d2f-9138-cf927bd3d83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:09.821557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74402ed5-c3f8-4d2f-9138-cf927bd3d83d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:09.821913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74402ed5-c3f8-4d2f-9138-cf927bd3d83d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:09.822280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74402ed5-c3f8-4d2f-9138-cf927bd3d83d admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:09.823322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74402ed5-c3f8-4d2f-9138-cf927bd3d83d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:09.825378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74402ed5-c3f8-4d2f-9138-cf927bd3d83d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:09.848257 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2971/5925] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:09 2021] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:09.853071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4ae8b-2a5f-420b-99b1-ec19581619de admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:09.864364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4ae8b-2a5f-420b-99b1-ec19581619de admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:09.869937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264a844-b973-4eec-9538-0fe53544fde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:09.870775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a844-b973-4eec-9538-0fe53544fde0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:09.871193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a844-b973-4eec-9538-0fe53544fde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:09.871921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a844-b973-4eec-9538-0fe53544fde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:09.872743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a844-b973-4eec-9538-0fe53544fde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:09.874512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a844-b973-4eec-9538-0fe53544fde0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:09.887902 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2955/5926] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:09 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:09.891985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74402ed5-c3f8-4d2f-9138-cf927bd3d83d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:09.902967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74402ed5-c3f8-4d2f-9138-cf927bd3d83d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:09.908431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264a844-b973-4eec-9538-0fe53544fde0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:09.910153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8264a844-b973-4eec-9538-0fe53544fde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:09.911561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe55b57-0db9-4e50-ab7d-271a42e6f3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:09.912340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe55b57-0db9-4e50-ab7d-271a42e6f3ae admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:09.912718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe55b57-0db9-4e50-ab7d-271a42e6f3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:09.913141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe55b57-0db9-4e50-ab7d-271a42e6f3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:09.914598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe55b57-0db9-4e50-ab7d-271a42e6f3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:09.916332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe55b57-0db9-4e50-ab7d-271a42e6f3ae admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:09.925451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264a844-b973-4eec-9538-0fe53544fde0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:09.927830 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2972/5927] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:09 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:09.930900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabb11e-1c88-4a70-9a27-7356602de2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:09.931844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabb11e-1c88-4a70-9a27-7356602de2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:09.931997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe55b57-0db9-4e50-ab7d-271a42e6f3ae admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:09.932269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabb11e-1c88-4a70-9a27-7356602de2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:09.932618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabb11e-1c88-4a70-9a27-7356602de2f7 admin admin] PATH_INFO: `/v3/users/909441655c7c49d2b68a0a589f5c422b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:09.933935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabb11e-1c88-4a70-9a27-7356602de2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909441655c7c49d2b68a0a589f5c422b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:09.936072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceabb11e-1c88-4a70-9a27-7356602de2f7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:09.942780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe55b57-0db9-4e50-ab7d-271a42e6f3ae admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:09.947890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf80b03-7cff-4e84-b239-c861721c9847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:09.948869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf80b03-7cff-4e84-b239-c861721c9847 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:09.949225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf80b03-7cff-4e84-b239-c861721c9847 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:09.949569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf80b03-7cff-4e84-b239-c861721c9847 admin admin] PATH_INFO: `/v3/projects/161065fbb6a8498bbbf8ad50c8239eaf/users/e227eea8b00e41d8bcacfed3a43063f1/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:09.969348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf80b03-7cff-4e84-b239-c861721c9847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161065fbb6a8498bbbf8ad50c8239eaf, user_id=e227eea8b00e41d8bcacfed3a43063f1, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:09.973361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf80b03-7cff-4e84-b239-c861721c9847 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:09.992785 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2973/5928] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:09 2021] PUT /identity/v3/projects/161065fbb6a8498bbbf8ad50c8239eaf/users/e227eea8b00e41d8bcacfed3a43063f1/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:09.994535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ceabb11e-1c88-4a70-9a27-7356602de2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909441655c7c49d2b68a0a589f5c422b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:09.995736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ceabb11e-1c88-4a70-9a27-7356602de2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909441655c7c49d2b68a0a589f5c422b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:10.008232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ceabb11e-1c88-4a70-9a27-7356602de2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909441655c7c49d2b68a0a589f5c422b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:10.008694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089371-79ad-47c5-a366-212f486226ed None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:10.008864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089371-79ad-47c5-a366-212f486226ed None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:10.009181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ceabb11e-1c88-4a70-9a27-7356602de2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909441655c7c49d2b68a0a589f5c422b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:10.009320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089371-79ad-47c5-a366-212f486226ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:10.017434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ceabb11e-1c88-4a70-9a27-7356602de2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909441655c7c49d2b68a0a589f5c422b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:10.037360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-db089371-79ad-47c5-a366-212f486226ed None None] MFA Rules not processed for user `e227eea8b00e41d8bcacfed3a43063f1`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:10.038630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-db089371-79ad-47c5-a366-212f486226ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:10.039719 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2956/5929] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:09 2021] DELETE /identity/v3/users/909441655c7c49d2b68a0a589f5c422b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:10.041308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aa580-f6d7-4ef6-b1a1-8adc13bb8ba8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:10.041612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aa580-f6d7-4ef6-b1a1-8adc13bb8ba8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:10.041954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aa580-f6d7-4ef6-b1a1-8adc13bb8ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:10.061725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c38aa580-f6d7-4ef6-b1a1-8adc13bb8ba8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:10.062986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c38aa580-f6d7-4ef6-b1a1-8adc13bb8ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:10.121658 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2974/5930] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:10 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:10.129743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db089371-79ad-47c5-a366-212f486226ed None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:10.135118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-db089371-79ad-47c5-a366-212f486226ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:10.150275 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2957/5931] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:10.162695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aa580-f6d7-4ef6-b1a1-8adc13bb8ba8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:10.165215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c38aa580-f6d7-4ef6-b1a1-8adc13bb8ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:10.254219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db089371-79ad-47c5-a366-212f486226ed None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:10.268881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84080a35-da0d-48f8-9986-6aab4126fa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:10.269561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84080a35-da0d-48f8-9986-6aab4126fa22 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:10.269848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84080a35-da0d-48f8-9986-6aab4126fa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:10.270127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84080a35-da0d-48f8-9986-6aab4126fa22 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:10.270942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84080a35-da0d-48f8-9986-6aab4126fa22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:10.271409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aa580-f6d7-4ef6-b1a1-8adc13bb8ba8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:10.272900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84080a35-da0d-48f8-9986-6aab4126fa22 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:10.276148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e41149-8da9-443e-8054-3a43d78ccdfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:10.276995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e41149-8da9-443e-8054-3a43d78ccdfa service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:10.277970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e41149-8da9-443e-8054-3a43d78ccdfa service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:10.278301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e41149-8da9-443e-8054-3a43d78ccdfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:10.293705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e41149-8da9-443e-8054-3a43d78ccdfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:10.296096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e41149-8da9-443e-8054-3a43d78ccdfa service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:10.318679 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2958/5932] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:04:10.341753 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2975/5933] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:10 2021] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:10.342972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e41149-8da9-443e-8054-3a43d78ccdfa service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:10.356058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e41149-8da9-443e-8054-3a43d78ccdfa service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:10.450420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7c7ba-c8c3-4446-a9be-72465ea1c21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:10.451964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7c7ba-c8c3-4446-a9be-72465ea1c21a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:10.451964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7c7ba-c8c3-4446-a9be-72465ea1c21a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:10.452212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7c7ba-c8c3-4446-a9be-72465ea1c21a admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:10.452933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7c7ba-c8c3-4446-a9be-72465ea1c21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:10.455067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7c7ba-c8c3-4446-a9be-72465ea1c21a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:10.507024 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2959/5934] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:10 2021] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:10.508842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84080a35-da0d-48f8-9986-6aab4126fa22 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:10.522696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84080a35-da0d-48f8-9986-6aab4126fa22 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:10.531627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f6b80-7ea6-4b86-b1e5-0a304a0a1ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:10.532493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f6b80-7ea6-4b86-b1e5-0a304a0a1ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:10.532863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f6b80-7ea6-4b86-b1e5-0a304a0a1ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:10.533256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f6b80-7ea6-4b86-b1e5-0a304a0a1ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:10.534364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f6b80-7ea6-4b86-b1e5-0a304a0a1ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:10.536264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f6b80-7ea6-4b86-b1e5-0a304a0a1ec9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:10.561566 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2976/5935] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:10 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:10.562097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7c7ba-c8c3-4446-a9be-72465ea1c21a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:10.566155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7c7ba-c8c3-4446-a9be-72465ea1c21a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:10.574729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaa5c7-d7e2-4ed0-9118-9033ba278236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:10.575770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaa5c7-d7e2-4ed0-9118-9033ba278236 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:10.576204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaa5c7-d7e2-4ed0-9118-9033ba278236 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:10.576492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaa5c7-d7e2-4ed0-9118-9033ba278236 admin admin] PATH_INFO: `/v3/projects/bd8be548d36a4238b9b28801ff18602a/users/360729ca85264765bd41cc5e3bebc4ef/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:10.600512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaa5c7-d7e2-4ed0-9118-9033ba278236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8be548d36a4238b9b28801ff18602a, user_id=360729ca85264765bd41cc5e3bebc4ef, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:10.602812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbaa5c7-d7e2-4ed0-9118-9033ba278236 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:10.634533 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2960/5936] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:10 2021] PUT /identity/v3/projects/bd8be548d36a4238b9b28801ff18602a/users/360729ca85264765bd41cc5e3bebc4ef/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:10.638570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f6b80-7ea6-4b86-b1e5-0a304a0a1ec9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:10.653587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f6b80-7ea6-4b86-b1e5-0a304a0a1ec9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:10.743980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b14413-ee80-4b85-a163-48c47a72ac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:10.745166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b14413-ee80-4b85-a163-48c47a72ac41 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:10.745792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b14413-ee80-4b85-a163-48c47a72ac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:10.746243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b14413-ee80-4b85-a163-48c47a72ac41 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:10.748044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b14413-ee80-4b85-a163-48c47a72ac41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:10.750593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b14413-ee80-4b85-a163-48c47a72ac41 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:10.766667 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2977/5937] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:10 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:10.770819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaa5c7-d7e2-4ed0-9118-9033ba278236 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:10.783977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaa5c7-d7e2-4ed0-9118-9033ba278236 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:10.794307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25249f8b-be1f-4d22-8062-89adc5dfd57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:10.796058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25249f8b-be1f-4d22-8062-89adc5dfd57a admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:10.796496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25249f8b-be1f-4d22-8062-89adc5dfd57a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:10.796833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25249f8b-be1f-4d22-8062-89adc5dfd57a admin admin] PATH_INFO: `/v3/projects/bd8be548d36a4238b9b28801ff18602a/users/360729ca85264765bd41cc5e3bebc4ef/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:10.799245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25249f8b-be1f-4d22-8062-89adc5dfd57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8be548d36a4238b9b28801ff18602a, user_id=360729ca85264765bd41cc5e3bebc4ef, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:10.804943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25249f8b-be1f-4d22-8062-89adc5dfd57a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:10.828396 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2961/5938] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:10 2021] PUT /identity/v3/projects/bd8be548d36a4238b9b28801ff18602a/users/360729ca85264765bd41cc5e3bebc4ef/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:10.928121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22c171-a6f5-4874-ab48-295076a749a8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:10.928412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22c171-a6f5-4874-ab48-295076a749a8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:10.928686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22c171-a6f5-4874-ab48-295076a749a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:10.966953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9f22c171-a6f5-4874-ab48-295076a749a8 None None] MFA Rules not processed for user `360729ca85264765bd41cc5e3bebc4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:10.968727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9f22c171-a6f5-4874-ab48-295076a749a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:11.061320 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2978/5939] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:10 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:11.076214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25249f8b-be1f-4d22-8062-89adc5dfd57a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:11.081097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-25249f8b-be1f-4d22-8062-89adc5dfd57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:11.167507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25249f8b-be1f-4d22-8062-89adc5dfd57a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:11.171615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9ea3d-2009-4a3d-b796-73ad5f7318e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:11.172385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9ea3d-2009-4a3d-b796-73ad5f7318e9 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:11.172768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9ea3d-2009-4a3d-b796-73ad5f7318e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:11.173140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9ea3d-2009-4a3d-b796-73ad5f7318e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:11.187889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9ea3d-2009-4a3d-b796-73ad5f7318e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:11.190900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9ea3d-2009-4a3d-b796-73ad5f7318e9 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:11.207703 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2962/5940] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:11 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:11.272469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22c171-a6f5-4874-ab48-295076a749a8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:11.276229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9f22c171-a6f5-4874-ab48-295076a749a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:11.412722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22c171-a6f5-4874-ab48-295076a749a8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:11.420736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:11.422064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:11.422356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:11.422683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] PATH_INFO: `/v3/projects/fbe5ff330fa94dce90ceb417549101a1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:11.425378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe5ff330fa94dce90ceb417549101a1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:11.431321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:11.509625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe5ff330fa94dce90ceb417549101a1', 'request_id': 'req-bb7bcead-a214-44c4-9cb5-fb5648ec3997'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:11.521448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe5ff330fa94dce90ceb417549101a1', 'request_id': 'req-bb7bcead-a214-44c4-9cb5-fb5648ec3997'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:11.530206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe5ff330fa94dce90ceb417549101a1', 'request_id': 'req-bb7bcead-a214-44c4-9cb5-fb5648ec3997'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:11.545634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] The token cache is being invalidate because project fbe5ff330fa94dce90ceb417549101a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:11.546247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:11.547157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:11.549297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2979/5941] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:11 2021] DELETE /identity/v3/projects/fbe5ff330fa94dce90ceb417549101a1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:11.555120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c6f48-7615-4e8d-80e4-2ae76848eeb5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:11.555654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c6f48-7615-4e8d-80e4-2ae76848eeb5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:11.555954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c6f48-7615-4e8d-80e4-2ae76848eeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:11.584116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9b7c6f48-7615-4e8d-80e4-2ae76848eeb5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:11.585384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9b7c6f48-7615-4e8d-80e4-2ae76848eeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:11.677143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:11.678899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:11.731043 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2963/5942] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:11.739378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49064d3e-5e18-49ac-b366-58f36df37dc8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:11.739673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49064d3e-5e18-49ac-b366-58f36df37dc8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:11.739951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49064d3e-5e18-49ac-b366-58f36df37dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:11.765298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-49064d3e-5e18-49ac-b366-58f36df37dc8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:11.766833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49064d3e-5e18-49ac-b366-58f36df37dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:11.782727 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2964/5943] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:11.787598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49064d3e-5e18-49ac-b366-58f36df37dc8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:11.808304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49064d3e-5e18-49ac-b366-58f36df37dc8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:11.818396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5069bd-8661-4139-a210-002773289572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:11.820898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bcead-a214-44c4-9cb5-fb5648ec3997 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:11.821799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5069bd-8661-4139-a210-002773289572 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:11.822094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5069bd-8661-4139-a210-002773289572 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:11.823377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5069bd-8661-4139-a210-002773289572 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:11.824149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5069bd-8661-4139-a210-002773289572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:11.825639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5069bd-8661-4139-a210-002773289572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:11.827495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5069bd-8661-4139-a210-002773289572 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:11.828023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8de8a2-81c3-4c5d-ab5f-243e63385378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:11.829132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de8a2-81c3-4c5d-ab5f-243e63385378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:11.829594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de8a2-81c3-4c5d-ab5f-243e63385378 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:11.830157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8de8a2-81c3-4c5d-ab5f-243e63385378 admin admin] PATH_INFO: `/v3/users/e227eea8b00e41d8bcacfed3a43063f1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:11.832082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8de8a2-81c3-4c5d-ab5f-243e63385378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e227eea8b00e41d8bcacfed3a43063f1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:11.834403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8de8a2-81c3-4c5d-ab5f-243e63385378 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:11.847305 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2965/5944] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:04:11.850604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5069bd-8661-4139-a210-002773289572 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:11.863156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5069bd-8661-4139-a210-002773289572 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:11.869810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf43a2-9f0a-49b9-8255-e33565d18dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:11.872212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf43a2-9f0a-49b9-8255-e33565d18dbe admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:11.872772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf43a2-9f0a-49b9-8255-e33565d18dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:11.873568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf43a2-9f0a-49b9-8255-e33565d18dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:11.874589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf43a2-9f0a-49b9-8255-e33565d18dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:11.877234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf43a2-9f0a-49b9-8255-e33565d18dbe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:11.899921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6e8de8a2-81c3-4c5d-ab5f-243e63385378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e227eea8b00e41d8bcacfed3a43063f1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:11.911985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6e8de8a2-81c3-4c5d-ab5f-243e63385378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e227eea8b00e41d8bcacfed3a43063f1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:11.913800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6e8de8a2-81c3-4c5d-ab5f-243e63385378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e227eea8b00e41d8bcacfed3a43063f1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:11.919752 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2966/5945] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:11 2021] POST /identity/v3/projects => generated 403 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:11.924053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf43a2-9f0a-49b9-8255-e33565d18dbe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:11.927104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-98bf43a2-9f0a-49b9-8255-e33565d18dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:11.933217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6e8de8a2-81c3-4c5d-ab5f-243e63385378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e227eea8b00e41d8bcacfed3a43063f1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:11.957973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6e8de8a2-81c3-4c5d-ab5f-243e63385378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e227eea8b00e41d8bcacfed3a43063f1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:11.978097 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2980/5946] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:11 2021] DELETE /identity/v3/users/e227eea8b00e41d8bcacfed3a43063f1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:04:11.982817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccb162-4473-4a1d-86e8-3405fde6eb2f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:11.983137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccb162-4473-4a1d-86e8-3405fde6eb2f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:11.983414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccb162-4473-4a1d-86e8-3405fde6eb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:12.033001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bbccb162-4473-4a1d-86e8-3405fde6eb2f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:12.034502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bbccb162-4473-4a1d-86e8-3405fde6eb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:12.073108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf43a2-9f0a-49b9-8255-e33565d18dbe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:12.205533 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2981/5947] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:12.220241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcd1bf-9ab7-4132-aa8c-da14a5c40d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:12.222368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcd1bf-9ab7-4132-aa8c-da14a5c40d19 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:12.225195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcd1bf-9ab7-4132-aa8c-da14a5c40d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:12.225635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcd1bf-9ab7-4132-aa8c-da14a5c40d19 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:12.226196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccb162-4473-4a1d-86e8-3405fde6eb2f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:12.226913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcd1bf-9ab7-4132-aa8c-da14a5c40d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:12.228404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bbccb162-4473-4a1d-86e8-3405fde6eb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:12.230339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcd1bf-9ab7-4132-aa8c-da14a5c40d19 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:12.275626 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2967/5948] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:11 2021] POST /identity/v3/users => generated 302 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:12.279347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcd1bf-9ab7-4132-aa8c-da14a5c40d19 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:12.301145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcd1bf-9ab7-4132-aa8c-da14a5c40d19 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:12.314928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895c075-d842-470d-8e0a-32d45c88e3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:12.316080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895c075-d842-470d-8e0a-32d45c88e3ca admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:12.316484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895c075-d842-470d-8e0a-32d45c88e3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:12.316862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895c075-d842-470d-8e0a-32d45c88e3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:12.317718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895c075-d842-470d-8e0a-32d45c88e3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:12.319740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895c075-d842-470d-8e0a-32d45c88e3ca admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:12.346265 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2968/5949] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:12 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:12.350441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895c075-d842-470d-8e0a-32d45c88e3ca admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:12.372838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895c075-d842-470d-8e0a-32d45c88e3ca admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:12.377234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccb162-4473-4a1d-86e8-3405fde6eb2f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:12.387521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974df91-8876-4573-a16c-b2583ab4b47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:12.388530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974df91-8876-4573-a16c-b2583ab4b47d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:12.389019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974df91-8876-4573-a16c-b2583ab4b47d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:12.389485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8352cf-8da6-4618-8475-d34b3561e609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:12.389745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974df91-8876-4573-a16c-b2583ab4b47d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:12.390287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8352cf-8da6-4618-8475-d34b3561e609 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:12.390961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974df91-8876-4573-a16c-b2583ab4b47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:12.391556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8352cf-8da6-4618-8475-d34b3561e609 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:12.391556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8352cf-8da6-4618-8475-d34b3561e609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:12.393790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974df91-8876-4573-a16c-b2583ab4b47d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:12.404821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8352cf-8da6-4618-8475-d34b3561e609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:12.406390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8352cf-8da6-4618-8475-d34b3561e609 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:12.407174 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2969/5950] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:12 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:12.416455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974df91-8876-4573-a16c-b2583ab4b47d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:12.419815 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2982/5951] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:12.432514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974df91-8876-4573-a16c-b2583ab4b47d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:12.438406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8862ea1-fdcc-4bff-953d-7e062e511a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:12.439620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8862ea1-fdcc-4bff-953d-7e062e511a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:12.440101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8862ea1-fdcc-4bff-953d-7e062e511a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:12.440333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8862ea1-fdcc-4bff-953d-7e062e511a99 admin admin] PATH_INFO: `/v3/projects/00735fb3099849649f3659ccce46780f/users/b1067ef43ad34e12b55a057f063dd099/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:12.465795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8862ea1-fdcc-4bff-953d-7e062e511a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00735fb3099849649f3659ccce46780f, user_id=b1067ef43ad34e12b55a057f063dd099, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:12.468890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8862ea1-fdcc-4bff-953d-7e062e511a99 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:12.494479 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2970/5952] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:12 2021] PUT /identity/v3/projects/00735fb3099849649f3659ccce46780f/users/b1067ef43ad34e12b55a057f063dd099/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:12.496867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005e4a-6cf6-47ad-bd04-880373cb1072 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:12.497269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005e4a-6cf6-47ad-bd04-880373cb1072 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:12.497753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005e4a-6cf6-47ad-bd04-880373cb1072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:12.534219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b2005e4a-6cf6-47ad-bd04-880373cb1072 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:12.537585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b2005e4a-6cf6-47ad-bd04-880373cb1072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:12.587237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224527-38f3-44aa-a862-1fab99052fcf None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:12.588746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224527-38f3-44aa-a862-1fab99052fcf None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:12.589249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c224527-38f3-44aa-a862-1fab99052fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:12.611897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1c224527-38f3-44aa-a862-1fab99052fcf None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:12.613429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1c224527-38f3-44aa-a862-1fab99052fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:12.621594 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2983/5953] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:12.641035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2005e4a-6cf6-47ad-bd04-880373cb1072 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:12.681182 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2971/5954] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:04:12 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:12.696691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224527-38f3-44aa-a862-1fab99052fcf None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:12.700439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1c224527-38f3-44aa-a862-1fab99052fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:12.702810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2005e4a-6cf6-47ad-bd04-880373cb1072 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:12.707021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c166e-ca99-48bc-aa48-bacccead59df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:12.707986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c166e-ca99-48bc-aa48-bacccead59df service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:12.708498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c166e-ca99-48bc-aa48-bacccead59df service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:12.708997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c166e-ca99-48bc-aa48-bacccead59df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:12.720190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c166e-ca99-48bc-aa48-bacccead59df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:12.722137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c166e-ca99-48bc-aa48-bacccead59df service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:12.734176 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2984/5955] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:04:12.799836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c224527-38f3-44aa-a862-1fab99052fcf None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:12.806889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7473fd-de09-419e-a31e-93aa821c4952 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:12.808035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7473fd-de09-419e-a31e-93aa821c4952 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:12.808960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7473fd-de09-419e-a31e-93aa821c4952 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:12.809449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7473fd-de09-419e-a31e-93aa821c4952 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:12.820242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7473fd-de09-419e-a31e-93aa821c4952 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:12.823376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7473fd-de09-419e-a31e-93aa821c4952 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:12.834796 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2972/5956] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:04:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:04:13.214647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c166e-ca99-48bc-aa48-bacccead59df service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:13.217137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f89c166e-ca99-48bc-aa48-bacccead59df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:13.243820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c166e-ca99-48bc-aa48-bacccead59df service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:13.270139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:13.271141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:13.271513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:13.271858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] PATH_INFO: `/v3/projects/161065fbb6a8498bbbf8ad50c8239eaf` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:13.277063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=161065fbb6a8498bbbf8ad50c8239eaf)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:13.279087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:13.367068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161065fbb6a8498bbbf8ad50c8239eaf', 'request_id': 'req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:13.385236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161065fbb6a8498bbbf8ad50c8239eaf', 'request_id': 'req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:13.414047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161065fbb6a8498bbbf8ad50c8239eaf', 'request_id': 'req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:13.492642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] The token cache is being invalidate because project 161065fbb6a8498bbbf8ad50c8239eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:13.493057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:13.517091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5e92a7d-7ff0-4c36-b25f-5f96c64831ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:13.533532 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2985/5957] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:13 2021] DELETE /identity/v3/projects/161065fbb6a8498bbbf8ad50c8239eaf => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:13.535342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7473fd-de09-419e-a31e-93aa821c4952 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:13.565975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7473fd-de09-419e-a31e-93aa821c4952 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:13.759079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:13.760512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:13.761146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:13.761648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] PATH_INFO: `/v3/users/360729ca85264765bd41cc5e3bebc4ef` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:13.763236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=360729ca85264765bd41cc5e3bebc4ef)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:13.766076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:13.851412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360729ca85264765bd41cc5e3bebc4ef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:13.852601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360729ca85264765bd41cc5e3bebc4ef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:13.869300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360729ca85264765bd41cc5e3bebc4ef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:13.871045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360729ca85264765bd41cc5e3bebc4ef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:13.889218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360729ca85264765bd41cc5e3bebc4ef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:13.927189 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2973/5958] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:13 2021] DELETE /identity/v3/users/360729ca85264765bd41cc5e3bebc4ef => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:14.889691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516fb9f-1360-4148-beeb-bb1ca04bcf2c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:14.890216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516fb9f-1360-4148-beeb-bb1ca04bcf2c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:14.890331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516fb9f-1360-4148-beeb-bb1ca04bcf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:14.956196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3516fb9f-1360-4148-beeb-bb1ca04bcf2c None None] MFA Rules not processed for user `b1067ef43ad34e12b55a057f063dd099`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:14.958071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3516fb9f-1360-4148-beeb-bb1ca04bcf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:15.034006 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2986/5959] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:14 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:15.039169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:15.041472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:15.151969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348f8eb-078c-47eb-a1f1-b233eb4d0778 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:15.160660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516fb9f-1360-4148-beeb-bb1ca04bcf2c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:15.163020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3516fb9f-1360-4148-beeb-bb1ca04bcf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:15.189829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850b136-cda6-4fcd-abac-d934833a45c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:15.193214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850b136-cda6-4fcd-abac-d934833a45c7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:15.194171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850b136-cda6-4fcd-abac-d934833a45c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:15.197178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850b136-cda6-4fcd-abac-d934833a45c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:15.201851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850b136-cda6-4fcd-abac-d934833a45c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:15.214092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850b136-cda6-4fcd-abac-d934833a45c7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:15.216303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516fb9f-1360-4148-beeb-bb1ca04bcf2c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:15.237262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:15.238888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:15.240682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:15.247616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] PATH_INFO: `/v3/projects/bd8be548d36a4238b9b28801ff18602a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:15.252070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8be548d36a4238b9b28801ff18602a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:15.257023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:15.313869 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2974/5960] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:15 2021] POST /identity/v3/projects => generated 405 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:15.316415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850b136-cda6-4fcd-abac-d934833a45c7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:15.462268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8be548d36a4238b9b28801ff18602a', 'request_id': 'req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:15.484885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8be548d36a4238b9b28801ff18602a', 'request_id': 'req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:15.500960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8be548d36a4238b9b28801ff18602a', 'request_id': 'req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:15.530436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] The token cache is being invalidate because project bd8be548d36a4238b9b28801ff18602a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:15.533381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:15.535884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-375cf4c4-5ba9-4e8e-8c45-397ffba55fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:15.540202 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2987/5961] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:15 2021] DELETE /identity/v3/projects/bd8be548d36a4238b9b28801ff18602a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:04:15.549429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53ba01-4d8c-4aa7-a096-a199e4e98624 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:15.550018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53ba01-4d8c-4aa7-a096-a199e4e98624 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:15.551014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53ba01-4d8c-4aa7-a096-a199e4e98624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:15.563495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850b136-cda6-4fcd-abac-d934833a45c7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:15.601084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ea53ba01-4d8c-4aa7-a096-a199e4e98624 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:15.607960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ea53ba01-4d8c-4aa7-a096-a199e4e98624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:15.707878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c202c6c-fe8f-4a9a-8f5a-35b5800bbbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:15.709240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202c6c-fe8f-4a9a-8f5a-35b5800bbbc3 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:15.710064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202c6c-fe8f-4a9a-8f5a-35b5800bbbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:15.710666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c202c6c-fe8f-4a9a-8f5a-35b5800bbbc3 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:15.711714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c202c6c-fe8f-4a9a-8f5a-35b5800bbbc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:15.716122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c202c6c-fe8f-4a9a-8f5a-35b5800bbbc3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:15.780883 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2975/5962] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:15 2021] POST /identity/v3/users => generated 303 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:15.783066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c202c6c-fe8f-4a9a-8f5a-35b5800bbbc3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:15.792484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1c202c6c-fe8f-4a9a-8f5a-35b5800bbbc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:15.822522 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2988/5963] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:15.830019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305865a-876d-4499-ab8a-7ae9a670fce0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:15.830568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305865a-876d-4499-ab8a-7ae9a670fce0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:15.831026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305865a-876d-4499-ab8a-7ae9a670fce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:15.837374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c202c6c-fe8f-4a9a-8f5a-35b5800bbbc3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:15.858970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed13cca-7dee-48df-bac5-c6870d8dd37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:15.859691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13cca-7dee-48df-bac5-c6870d8dd37e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:15.859981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13cca-7dee-48df-bac5-c6870d8dd37e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:15.860265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed13cca-7dee-48df-bac5-c6870d8dd37e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:15.861606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed13cca-7dee-48df-bac5-c6870d8dd37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:15.868368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed13cca-7dee-48df-bac5-c6870d8dd37e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:15.868526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9305865a-876d-4499-ab8a-7ae9a670fce0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:15.870263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9305865a-876d-4499-ab8a-7ae9a670fce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:15.882092 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2989/5964] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:15.887291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305865a-876d-4499-ab8a-7ae9a670fce0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:15.907238 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2976/5965] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:15 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:15.912114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed13cca-7dee-48df-bac5-c6870d8dd37e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:15.913058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305865a-876d-4499-ab8a-7ae9a670fce0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:15.930801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed13cca-7dee-48df-bac5-c6870d8dd37e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:15.933170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd745711-3d5c-451a-a89a-963728eafcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:15.933921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd745711-3d5c-451a-a89a-963728eafcab admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:15.934195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd745711-3d5c-451a-a89a-963728eafcab admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:15.934486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd745711-3d5c-451a-a89a-963728eafcab admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:15.935293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd745711-3d5c-451a-a89a-963728eafcab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:15.935847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd745711-3d5c-451a-a89a-963728eafcab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:15.936736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfecf10-ca60-4ba0-bc9b-dc53a301b191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:15.937464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfecf10-ca60-4ba0-bc9b-dc53a301b191 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:15.937801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfecf10-ca60-4ba0-bc9b-dc53a301b191 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:15.938193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfecf10-ca60-4ba0-bc9b-dc53a301b191 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:15.938937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfecf10-ca60-4ba0-bc9b-dc53a301b191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:15.939711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd745711-3d5c-451a-a89a-963728eafcab admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:15.940728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfecf10-ca60-4ba0-bc9b-dc53a301b191 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:15.953046 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2977/5966] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:15 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:15.959961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfecf10-ca60-4ba0-bc9b-dc53a301b191 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:15.977157 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2990/5967] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:04:15.981122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd745711-3d5c-451a-a89a-963728eafcab admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:15.986900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfecf10-ca60-4ba0-bc9b-dc53a301b191 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:16.000256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd745711-3d5c-451a-a89a-963728eafcab admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:16.003171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2144d-9c62-4fc2-80c9-1a96805be018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:16.004435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2144d-9c62-4fc2-80c9-1a96805be018 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:16.004918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2144d-9c62-4fc2-80c9-1a96805be018 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:16.005386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2144d-9c62-4fc2-80c9-1a96805be018 admin admin] PATH_INFO: `/v3/projects/1fc5ea29615742c5822e366a80fffc75/users/3ef9a5e156fc4ed491d049fd7c09ee0c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:16.017978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd721-c76f-4d4a-aff1-344d45e15782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:16.019666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd721-c76f-4d4a-aff1-344d45e15782 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:16.020132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd721-c76f-4d4a-aff1-344d45e15782 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:16.020660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd721-c76f-4d4a-aff1-344d45e15782 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:16.021787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dd721-c76f-4d4a-aff1-344d45e15782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:16.028630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dd721-c76f-4d4a-aff1-344d45e15782 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:16.042209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2144d-9c62-4fc2-80c9-1a96805be018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc5ea29615742c5822e366a80fffc75, user_id=3ef9a5e156fc4ed491d049fd7c09ee0c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:16.046484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2144d-9c62-4fc2-80c9-1a96805be018 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:16.081468 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2978/5968] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:15 2021] PUT /identity/v3/projects/1fc5ea29615742c5822e366a80fffc75/users/3ef9a5e156fc4ed491d049fd7c09ee0c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:16.088647 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2991/5969] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:15 2021] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:16.092624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2144d-9c62-4fc2-80c9-1a96805be018 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:16.170832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2144d-9c62-4fc2-80c9-1a96805be018 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:16.244696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c3fb1-c07f-40d0-aee0-9b09142bb957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:16.245606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c3fb1-c07f-40d0-aee0-9b09142bb957 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:16.245895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c3fb1-c07f-40d0-aee0-9b09142bb957 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:16.246270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c3fb1-c07f-40d0-aee0-9b09142bb957 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:16.247983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c3fb1-c07f-40d0-aee0-9b09142bb957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:16.253932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c3fb1-c07f-40d0-aee0-9b09142bb957 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:16.309266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd721-c76f-4d4a-aff1-344d45e15782 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:16.325117 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2979/5970] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:16 2021] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:16.333836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd721-c76f-4d4a-aff1-344d45e15782 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:16.348041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5289-7007-4cb3-bdc1-28ee5b33f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:16.350566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5289-7007-4cb3-bdc1-28ee5b33f704 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:16.350566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5289-7007-4cb3-bdc1-28ee5b33f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:16.351863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e5289-7007-4cb3-bdc1-28ee5b33f704 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:16.352734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5289-7007-4cb3-bdc1-28ee5b33f704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:16.356563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e5289-7007-4cb3-bdc1-28ee5b33f704 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:16.383006 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2992/5971] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:16 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:16.386786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c3fb1-c07f-40d0-aee0-9b09142bb957 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:16.403838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c3fb1-c07f-40d0-aee0-9b09142bb957 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:16.417117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b72fc-a42b-40cb-a64b-bf0e840968ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:16.417862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b72fc-a42b-40cb-a64b-bf0e840968ac admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:16.418150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b72fc-a42b-40cb-a64b-bf0e840968ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:16.418465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b72fc-a42b-40cb-a64b-bf0e840968ac admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:16.420861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b72fc-a42b-40cb-a64b-bf0e840968ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:16.423736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b72fc-a42b-40cb-a64b-bf0e840968ac admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:16.455322 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2980/5972] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:16 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:16.456661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5289-7007-4cb3-bdc1-28ee5b33f704 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:16.477576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e5289-7007-4cb3-bdc1-28ee5b33f704 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:16.507220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65889063-1593-45d7-9688-5b0aa15022b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:16.511478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65889063-1593-45d7-9688-5b0aa15022b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:16.513330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65889063-1593-45d7-9688-5b0aa15022b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:16.518861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65889063-1593-45d7-9688-5b0aa15022b6 admin admin] PATH_INFO: `/v3/projects/ba58e4860f44491f950630661492e3bc/users/fc32e09e8f344a3ba885fbc068c25d38/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:16.596855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65889063-1593-45d7-9688-5b0aa15022b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba58e4860f44491f950630661492e3bc, user_id=fc32e09e8f344a3ba885fbc068c25d38, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:16.605296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65889063-1593-45d7-9688-5b0aa15022b6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:16.669255 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2993/5973] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:16 2021] PUT /identity/v3/projects/ba58e4860f44491f950630661492e3bc/users/fc32e09e8f344a3ba885fbc068c25d38/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:16.670674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef893c79-3866-406c-a28b-d763890a750b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:16.670995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef893c79-3866-406c-a28b-d763890a750b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:16.671447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef893c79-3866-406c-a28b-d763890a750b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:16.815754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ef893c79-3866-406c-a28b-d763890a750b None None] MFA Rules not processed for user `fc32e09e8f344a3ba885fbc068c25d38`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:16.817012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ef893c79-3866-406c-a28b-d763890a750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:17.067574 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2981/5974] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:16 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:17.075421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65889063-1593-45d7-9688-5b0aa15022b6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:17.239682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65889063-1593-45d7-9688-5b0aa15022b6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:17.248143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a8a57-e9da-4d89-8d05-3288d8273c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:17.248856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a8a57-e9da-4d89-8d05-3288d8273c67 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:17.249404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a8a57-e9da-4d89-8d05-3288d8273c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:17.250028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a8a57-e9da-4d89-8d05-3288d8273c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:17.251237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a8a57-e9da-4d89-8d05-3288d8273c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:17.253761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a8a57-e9da-4d89-8d05-3288d8273c67 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:17.322780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef893c79-3866-406c-a28b-d763890a750b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:17.332463 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2994/5975] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:17 2021] POST /identity/v3/projects => generated 365 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:17.340768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef893c79-3866-406c-a28b-d763890a750b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:17.492569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6f48-6cbd-4bf0-9d3b-ae691f31dded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:17.493268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6f48-6cbd-4bf0-9d3b-ae691f31dded admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:17.493550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6f48-6cbd-4bf0-9d3b-ae691f31dded admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:17.493885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6f48-6cbd-4bf0-9d3b-ae691f31dded admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:17.496909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f6f48-6cbd-4bf0-9d3b-ae691f31dded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:17.503196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f6f48-6cbd-4bf0-9d3b-ae691f31dded admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:17.552796 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2982/5976] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:17 2021] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:17.561268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a8a57-e9da-4d89-8d05-3288d8273c67 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:17.576305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a8a57-e9da-4d89-8d05-3288d8273c67 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:17.586228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d723c8-b66f-41ea-851e-29a3bde476a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:17.587172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d723c8-b66f-41ea-851e-29a3bde476a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:17.588324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d723c8-b66f-41ea-851e-29a3bde476a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:17.588776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d723c8-b66f-41ea-851e-29a3bde476a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:17.591080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d723c8-b66f-41ea-851e-29a3bde476a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:17.602429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d723c8-b66f-41ea-851e-29a3bde476a1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:17.631436 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2995/5977] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:17 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:17.635017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6f48-6cbd-4bf0-9d3b-ae691f31dded admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:17.648578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f6f48-6cbd-4bf0-9d3b-ae691f31dded admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:17.654681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66205aae-5110-4c36-a5dd-c95da44dae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:17.655947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66205aae-5110-4c36-a5dd-c95da44dae16 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:17.656340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66205aae-5110-4c36-a5dd-c95da44dae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:17.656773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66205aae-5110-4c36-a5dd-c95da44dae16 admin admin] PATH_INFO: `/v3/projects/abb12df834d34b8f9878e0a87ff763c9/users/9f1ab09d0293404eb693887ad373257d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:17.685688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66205aae-5110-4c36-a5dd-c95da44dae16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb12df834d34b8f9878e0a87ff763c9, user_id=9f1ab09d0293404eb693887ad373257d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:17.700053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66205aae-5110-4c36-a5dd-c95da44dae16 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:17.734744 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2983/5978] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:17 2021] PUT /identity/v3/projects/abb12df834d34b8f9878e0a87ff763c9/users/9f1ab09d0293404eb693887ad373257d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:17.738908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d723c8-b66f-41ea-851e-29a3bde476a1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:17.762486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d723c8-b66f-41ea-851e-29a3bde476a1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:17.905920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848a8c7-08aa-4a7c-a88b-2dbbec5f7066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:17.906891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848a8c7-08aa-4a7c-a88b-2dbbec5f7066 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:17.907182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848a8c7-08aa-4a7c-a88b-2dbbec5f7066 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:17.907640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848a8c7-08aa-4a7c-a88b-2dbbec5f7066 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:17.908439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848a8c7-08aa-4a7c-a88b-2dbbec5f7066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:17.910106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848a8c7-08aa-4a7c-a88b-2dbbec5f7066 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:17.927303 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2996/5979] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:17 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:17.931814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66205aae-5110-4c36-a5dd-c95da44dae16 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:17.947915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66205aae-5110-4c36-a5dd-c95da44dae16 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:17.958697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501af175-38cd-458b-9773-c51a7437bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:17.960031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501af175-38cd-458b-9773-c51a7437bf7f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:17.960506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501af175-38cd-458b-9773-c51a7437bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:17.961333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501af175-38cd-458b-9773-c51a7437bf7f admin admin] PATH_INFO: `/v3/projects/abb12df834d34b8f9878e0a87ff763c9/users/9f1ab09d0293404eb693887ad373257d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:17.963691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501af175-38cd-458b-9773-c51a7437bf7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb12df834d34b8f9878e0a87ff763c9, user_id=9f1ab09d0293404eb693887ad373257d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:17.967596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501af175-38cd-458b-9773-c51a7437bf7f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:17.982020 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2984/5980] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:17 2021] PUT /identity/v3/projects/abb12df834d34b8f9878e0a87ff763c9/users/9f1ab09d0293404eb693887ad373257d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:17.991933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cae03c-c6e7-44c3-9136-bbd56ecb81fb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:17.992997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cae03c-c6e7-44c3-9136-bbd56ecb81fb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:17.992997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cae03c-c6e7-44c3-9136-bbd56ecb81fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:18.060952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-46cae03c-c6e7-44c3-9136-bbd56ecb81fb None None] MFA Rules not processed for user `9f1ab09d0293404eb693887ad373257d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:18.064800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-46cae03c-c6e7-44c3-9136-bbd56ecb81fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:18.266795 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2997/5981] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:17 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:18.279600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501af175-38cd-458b-9773-c51a7437bf7f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:18.286176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-501af175-38cd-458b-9773-c51a7437bf7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:18.396643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189d627-a76e-4050-af12-19f421b91436 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:18.397354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189d627-a76e-4050-af12-19f421b91436 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:18.397743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189d627-a76e-4050-af12-19f421b91436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:18.524871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3189d627-a76e-4050-af12-19f421b91436 None None] MFA Rules not processed for user `3ef9a5e156fc4ed491d049fd7c09ee0c`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:18.531834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3189d627-a76e-4050-af12-19f421b91436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:18.532886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501af175-38cd-458b-9773-c51a7437bf7f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:18.545130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0558a8d-8505-4a52-854b-3cca145a554e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:18.546534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0558a8d-8505-4a52-854b-3cca145a554e service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:18.548437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0558a8d-8505-4a52-854b-3cca145a554e service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:18.549607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0558a8d-8505-4a52-854b-3cca145a554e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:18.601377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0558a8d-8505-4a52-854b-3cca145a554e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:18.603287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0558a8d-8505-4a52-854b-3cca145a554e service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:18.630161 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2985/5982] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:18 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:18.812087 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2998/5983] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:18 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:18.819499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74b32-8bcf-420e-ab02-cd87f57ca074 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:18.821583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74b32-8bcf-420e-ab02-cd87f57ca074 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:18.822051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd74b32-8bcf-420e-ab02-cd87f57ca074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:18.849288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189d627-a76e-4050-af12-19f421b91436 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:18.884284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189d627-a76e-4050-af12-19f421b91436 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:18.906916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863b250-133c-4206-bb4d-9a129777f93a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:18.909551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863b250-133c-4206-bb4d-9a129777f93a service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:18.910174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3fd74b32-8bcf-420e-ab02-cd87f57ca074 None None] MFA Rules not processed for user `b1067ef43ad34e12b55a057f063dd099`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:18.911409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863b250-133c-4206-bb4d-9a129777f93a service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:18.913261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863b250-133c-4206-bb4d-9a129777f93a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:18.922084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3fd74b32-8bcf-420e-ab02-cd87f57ca074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:19.061559 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2986/5984] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:18 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:19.074340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd74b32-8bcf-420e-ab02-cd87f57ca074 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:19.077147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3fd74b32-8bcf-420e-ab02-cd87f57ca074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:19.081389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863b250-133c-4206-bb4d-9a129777f93a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:19.084191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863b250-133c-4206-bb4d-9a129777f93a service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:19.116085 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 2999/5985] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:18 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:19.290694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd74b32-8bcf-420e-ab02-cd87f57ca074 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:19.310061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98f7b-bfd4-4444-99c0-c9ba6f7744b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:19.312917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98f7b-bfd4-4444-99c0-c9ba6f7744b1 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:19.313462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98f7b-bfd4-4444-99c0-c9ba6f7744b1 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:19.315066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98f7b-bfd4-4444-99c0-c9ba6f7744b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:19.318963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9be98f7b-bfd4-4444-99c0-c9ba6f7744b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:19.347853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98f7b-bfd4-4444-99c0-c9ba6f7744b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:19.350179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98f7b-bfd4-4444-99c0-c9ba6f7744b1 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:19.377847 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2987/5986] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:19 2021] GET /identity/v3/auth/tokens => generated 3270 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:30.795618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863b250-133c-4206-bb4d-9a129777f93a service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:30.892353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863b250-133c-4206-bb4d-9a129777f93a service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:30.907677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:30.908759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:30.909185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:30.909662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] PATH_INFO: `/v3/users/fc32e09e8f344a3ba885fbc068c25d38` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:30.911070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc32e09e8f344a3ba885fbc068c25d38)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:30.913965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:30.983406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc32e09e8f344a3ba885fbc068c25d38'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:31.006386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc32e09e8f344a3ba885fbc068c25d38'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:31.007836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc32e09e8f344a3ba885fbc068c25d38'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:31.028945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc32e09e8f344a3ba885fbc068c25d38'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:31.048153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc32e09e8f344a3ba885fbc068c25d38'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:31.064989 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3000/5987] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:30 2021] DELETE /identity/v3/users/fc32e09e8f344a3ba885fbc068c25d38 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:31.066624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5930-485b-4f1d-b8a5-6a5125fd39ae None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:31.067147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5930-485b-4f1d-b8a5-6a5125fd39ae None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:31.067242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5930-485b-4f1d-b8a5-6a5125fd39ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:31.104270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ce4d5930-485b-4f1d-b8a5-6a5125fd39ae None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:31.106154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ce4d5930-485b-4f1d-b8a5-6a5125fd39ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:31.192537 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2988/5988] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:31.202723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:31.203738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:31.300284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5457dd-5409-43f3-86b0-7b89878c9cb5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:31.306623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027ea55-0348-4e1e-be17-5496289e96ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:31.307558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ea55-0348-4e1e-be17-5496289e96ea service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:31.308024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ea55-0348-4e1e-be17-5496289e96ea service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:31.308498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ea55-0348-4e1e-be17-5496289e96ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:31.325248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027ea55-0348-4e1e-be17-5496289e96ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:31.327945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027ea55-0348-4e1e-be17-5496289e96ea service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:31.347591 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3001/5989] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:31.942705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d5930-485b-4f1d-b8a5-6a5125fd39ae None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:31.945272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ce4d5930-485b-4f1d-b8a5-6a5125fd39ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:31.963389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d5930-485b-4f1d-b8a5-6a5125fd39ae None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:31.981665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e690164-5b22-4c73-9e89-e3f97c0c9a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:31.983010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e690164-5b22-4c73-9e89-e3f97c0c9a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:31.983414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e690164-5b22-4c73-9e89-e3f97c0c9a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:31.983863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e690164-5b22-4c73-9e89-e3f97c0c9a55 admin admin] PATH_INFO: `/v3/users/9fe049055ac04c0b909e9db231f692ca` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:31.985236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e690164-5b22-4c73-9e89-e3f97c0c9a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe049055ac04c0b909e9db231f692ca)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:31.987223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e690164-5b22-4c73-9e89-e3f97c0c9a55 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:32.024018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027ea55-0348-4e1e-be17-5496289e96ea service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:32.028248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a027ea55-0348-4e1e-be17-5496289e96ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:32.058283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027ea55-0348-4e1e-be17-5496289e96ea service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:32.065689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:32.067448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:32.078379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e690164-5b22-4c73-9e89-e3f97c0c9a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe049055ac04c0b909e9db231f692ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.079361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e690164-5b22-4c73-9e89-e3f97c0c9a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe049055ac04c0b909e9db231f692ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.082520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:32.084122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] PATH_INFO: `/v3/projects/ba58e4860f44491f950630661492e3bc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:32.087823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba58e4860f44491f950630661492e3bc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:32.090322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:32.090620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e690164-5b22-4c73-9e89-e3f97c0c9a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe049055ac04c0b909e9db231f692ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.091765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e690164-5b22-4c73-9e89-e3f97c0c9a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe049055ac04c0b909e9db231f692ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.113253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e690164-5b22-4c73-9e89-e3f97c0c9a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe049055ac04c0b909e9db231f692ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.139275 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2989/5990] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:31 2021] DELETE /identity/v3/users/9fe049055ac04c0b909e9db231f692ca => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:04:32.143804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf003e7-805d-4dff-ae52-c7010de537bb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:32.144296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf003e7-805d-4dff-ae52-c7010de537bb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:32.144579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf003e7-805d-4dff-ae52-c7010de537bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:32.161968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba58e4860f44491f950630661492e3bc', 'request_id': 'req-506c64f4-ce1d-4a66-8ca1-254e57df4b63'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.168731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0bf003e7-805d-4dff-ae52-c7010de537bb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:32.170396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0bf003e7-805d-4dff-ae52-c7010de537bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:32.172874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba58e4860f44491f950630661492e3bc', 'request_id': 'req-506c64f4-ce1d-4a66-8ca1-254e57df4b63'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.180543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba58e4860f44491f950630661492e3bc', 'request_id': 'req-506c64f4-ce1d-4a66-8ca1-254e57df4b63'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.192519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] The token cache is being invalidate because project ba58e4860f44491f950630661492e3bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:32.192808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.193486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.195463 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3002/5991] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:32 2021] DELETE /identity/v3/projects/ba58e4860f44491f950630661492e3bc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:04:32.200608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:32.202078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:32.254061 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2990/5992] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:32.266162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf003e7-805d-4dff-ae52-c7010de537bb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:32.269112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0bf003e7-805d-4dff-ae52-c7010de537bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:32.334982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c64f4-ce1d-4a66-8ca1-254e57df4b63 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:32.346078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:32.347025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:32.347311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:32.347562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] PATH_INFO: `/v3/users/9f1ab09d0293404eb693887ad373257d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:32.349030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1ab09d0293404eb693887ad373257d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:32.352999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:32.419039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf003e7-805d-4dff-ae52-c7010de537bb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:32.432116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150c90-10fe-49b3-b13f-de6a6b07ea20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:32.434505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150c90-10fe-49b3-b13f-de6a6b07ea20 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:32.435014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150c90-10fe-49b3-b13f-de6a6b07ea20 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:32.435666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150c90-10fe-49b3-b13f-de6a6b07ea20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:32.441765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1ab09d0293404eb693887ad373257d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.472357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150c90-10fe-49b3-b13f-de6a6b07ea20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:32.474937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150c90-10fe-49b3-b13f-de6a6b07ea20 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:32.482990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1ab09d0293404eb693887ad373257d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.483781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1ab09d0293404eb693887ad373257d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.493216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1ab09d0293404eb693887ad373257d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.509298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1ab09d0293404eb693887ad373257d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:32.513645 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2991/5993] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:32.518840 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3003/5994] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:32 2021] DELETE /identity/v3/users/9f1ab09d0293404eb693887ad373257d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:33.361980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150c90-10fe-49b3-b13f-de6a6b07ea20 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:33.376737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150c90-10fe-49b3-b13f-de6a6b07ea20 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:33.403085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:33.407048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:33.520122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:33.521064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:33.521352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:33.521624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] PATH_INFO: `/v3/projects/abb12df834d34b8f9878e0a87ff763c9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:33.525370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb12df834d34b8f9878e0a87ff763c9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:33.527349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:33.555025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54229e-0e83-443e-bc26-e1601b744f6f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:33.573943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:33.574861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:33.575118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:33.575443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] PATH_INFO: `/v3/projects/44b22e03c6d74976a86529d4cf57fb19` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:33.577976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b22e03c6d74976a86529d4cf57fb19)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:33.579948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:33.610941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb12df834d34b8f9878e0a87ff763c9', 'request_id': 'req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:33.618642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb12df834d34b8f9878e0a87ff763c9', 'request_id': 'req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:33.633016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb12df834d34b8f9878e0a87ff763c9', 'request_id': 'req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:33.647074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] The token cache is being invalidate because project abb12df834d34b8f9878e0a87ff763c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:33.648081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:33.649121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7c2cf688-bf7a-4416-93f0-d5bf20eaf834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:33.652448 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2992/5995] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:33 2021] DELETE /identity/v3/projects/abb12df834d34b8f9878e0a87ff763c9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:33.654017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b22e03c6d74976a86529d4cf57fb19', 'request_id': 'req-9423487c-825b-4e24-8baf-a4dc6ef5d569'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:33.662548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec50d8-a613-4d31-9b7e-511ff7f0c108 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:33.662893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec50d8-a613-4d31-9b7e-511ff7f0c108 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:33.663390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec50d8-a613-4d31-9b7e-511ff7f0c108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:33.667192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b22e03c6d74976a86529d4cf57fb19', 'request_id': 'req-9423487c-825b-4e24-8baf-a4dc6ef5d569'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:33.676686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b22e03c6d74976a86529d4cf57fb19', 'request_id': 'req-9423487c-825b-4e24-8baf-a4dc6ef5d569'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:33.691951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] The token cache is being invalidate because project 44b22e03c6d74976a86529d4cf57fb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:33.692787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:33.694037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9423487c-825b-4e24-8baf-a4dc6ef5d569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:33.704505 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3004/5996] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:33 2021] DELETE /identity/v3/projects/44b22e03c6d74976a86529d4cf57fb19 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:33.708365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6233f-1176-4f8b-9821-6525d8a7d31b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:33.708903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6233f-1176-4f8b-9821-6525d8a7d31b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:33.709448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6233f-1176-4f8b-9821-6525d8a7d31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:33.722242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-28ec50d8-a613-4d31-9b7e-511ff7f0c108 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:33.727009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-28ec50d8-a613-4d31-9b7e-511ff7f0c108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:33.759199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-dbb6233f-1176-4f8b-9821-6525d8a7d31b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:33.762067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dbb6233f-1176-4f8b-9821-6525d8a7d31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:33.848718 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2993/5997] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:33.853528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a58de-4f4c-482e-b2da-79ec93454258 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:33.853828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a58de-4f4c-482e-b2da-79ec93454258 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:33.854473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a58de-4f4c-482e-b2da-79ec93454258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:33.881122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a07a58de-4f4c-482e-b2da-79ec93454258 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:33.883367 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3005/5998] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:33.884219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a07a58de-4f4c-482e-b2da-79ec93454258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:33.890995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a59e7-8612-401a-b130-5addd8aec66d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:33.891307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a59e7-8612-401a-b130-5addd8aec66d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:33.891641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a59e7-8612-401a-b130-5addd8aec66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:33.899982 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2994/5999] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:33.904664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a58de-4f4c-482e-b2da-79ec93454258 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:33.917110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fe5a59e7-8612-401a-b130-5addd8aec66d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:33.917496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a58de-4f4c-482e-b2da-79ec93454258 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:33.918792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fe5a59e7-8612-401a-b130-5addd8aec66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:33.922501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da576c1b-f124-4cd3-a7fa-e5c0e42caae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:33.923166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576c1b-f124-4cd3-a7fa-e5c0e42caae6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:33.923491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576c1b-f124-4cd3-a7fa-e5c0e42caae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:33.923765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da576c1b-f124-4cd3-a7fa-e5c0e42caae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:33.924508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da576c1b-f124-4cd3-a7fa-e5c0e42caae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:33.924817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da576c1b-f124-4cd3-a7fa-e5c0e42caae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:33.926435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da576c1b-f124-4cd3-a7fa-e5c0e42caae6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:33.934649 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3006/6000] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:33.936006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a59e7-8612-401a-b130-5addd8aec66d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:33.939714 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2995/6001] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:04:33.943811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da576c1b-f124-4cd3-a7fa-e5c0e42caae6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:33.948121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a59e7-8612-401a-b130-5addd8aec66d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:33.954834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe8b38-3df9-4123-8529-a1729e494dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:33.955441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da576c1b-f124-4cd3-a7fa-e5c0e42caae6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:33.956626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe8b38-3df9-4123-8529-a1729e494dcb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:33.957229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe8b38-3df9-4123-8529-a1729e494dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:33.957764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe8b38-3df9-4123-8529-a1729e494dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:33.958851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe8b38-3df9-4123-8529-a1729e494dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:33.959539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe8b38-3df9-4123-8529-a1729e494dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:33.960765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eab638-572b-4595-b758-7fd3947877eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:33.961946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe8b38-3df9-4123-8529-a1729e494dcb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:33.962403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eab638-572b-4595-b758-7fd3947877eb admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:33.962697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eab638-572b-4595-b758-7fd3947877eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:33.963598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eab638-572b-4595-b758-7fd3947877eb admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:33.963838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eab638-572b-4595-b758-7fd3947877eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:33.965890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eab638-572b-4595-b758-7fd3947877eb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:33.986627 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3007/6002] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:04:33.988385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe8b38-3df9-4123-8529-a1729e494dcb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.003533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe8b38-3df9-4123-8529-a1729e494dcb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.009184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e9648-b5c4-462f-a138-02e731df2954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.010062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e9648-b5c4-462f-a138-02e731df2954 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.010241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e9648-b5c4-462f-a138-02e731df2954 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.010484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e9648-b5c4-462f-a138-02e731df2954 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.010942 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2996/6003] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:33 2021] POST /identity/v3/projects => generated 363 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:34.011304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e9648-b5c4-462f-a138-02e731df2954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.013654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e9648-b5c4-462f-a138-02e731df2954 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:34.013779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eab638-572b-4595-b758-7fd3947877eb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.048472 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3008/6004] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:33 2021] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:34.052681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e9648-b5c4-462f-a138-02e731df2954 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.094999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eab638-572b-4595-b758-7fd3947877eb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.152392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e9648-b5c4-462f-a138-02e731df2954 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.159485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d146bd-d646-43c5-83cf-b5e24a2b7013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.160548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d146bd-d646-43c5-83cf-b5e24a2b7013 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.161037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d146bd-d646-43c5-83cf-b5e24a2b7013 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.161534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d146bd-d646-43c5-83cf-b5e24a2b7013 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.162645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d146bd-d646-43c5-83cf-b5e24a2b7013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.165690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d146bd-d646-43c5-83cf-b5e24a2b7013 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:34.177338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982d680-946b-4a68-adc3-ed123381017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.179111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982d680-946b-4a68-adc3-ed123381017e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.180099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982d680-946b-4a68-adc3-ed123381017e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.180618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982d680-946b-4a68-adc3-ed123381017e admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.181428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982d680-946b-4a68-adc3-ed123381017e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.183535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982d680-946b-4a68-adc3-ed123381017e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:34.199214 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3009/6005] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:34 2021] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:34.203516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d146bd-d646-43c5-83cf-b5e24a2b7013 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.215659 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2997/6006] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:34 2021] POST /identity/v3/users => generated 282 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:34.220066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982d680-946b-4a68-adc3-ed123381017e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.224890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d146bd-d646-43c5-83cf-b5e24a2b7013 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.232628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124252c-a8fc-4e0d-9f3d-05cf93b92494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.233100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982d680-946b-4a68-adc3-ed123381017e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.234221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124252c-a8fc-4e0d-9f3d-05cf93b92494 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.234764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124252c-a8fc-4e0d-9f3d-05cf93b92494 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.235187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124252c-a8fc-4e0d-9f3d-05cf93b92494 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.236100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124252c-a8fc-4e0d-9f3d-05cf93b92494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.238179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124252c-a8fc-4e0d-9f3d-05cf93b92494 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:34.243786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651cd7-f3b7-406b-ae34-732cb9424078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.251596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651cd7-f3b7-406b-ae34-732cb9424078 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.252683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651cd7-f3b7-406b-ae34-732cb9424078 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.253293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651cd7-f3b7-406b-ae34-732cb9424078 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.254257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54651cd7-f3b7-406b-ae34-732cb9424078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.256791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54651cd7-f3b7-406b-ae34-732cb9424078 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:34.259488 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3010/6007] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:34 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:34.261324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124252c-a8fc-4e0d-9f3d-05cf93b92494 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.273726 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2998/6008] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:34 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:34.277894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651cd7-f3b7-406b-ae34-732cb9424078 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.281450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124252c-a8fc-4e0d-9f3d-05cf93b92494 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.293232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e93e4-8904-4f18-aada-68a468de187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.293361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651cd7-f3b7-406b-ae34-732cb9424078 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.294369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e93e4-8904-4f18-aada-68a468de187f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.294876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e93e4-8904-4f18-aada-68a468de187f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.295024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e93e4-8904-4f18-aada-68a468de187f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.296034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e93e4-8904-4f18-aada-68a468de187f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.298742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e93e4-8904-4f18-aada-68a468de187f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:34.300468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0af63-04d3-431b-b85a-13aea4b092cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.300896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0af63-04d3-431b-b85a-13aea4b092cb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.301315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0af63-04d3-431b-b85a-13aea4b092cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.301594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0af63-04d3-431b-b85a-13aea4b092cb admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.302348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0af63-04d3-431b-b85a-13aea4b092cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.305225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0af63-04d3-431b-b85a-13aea4b092cb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:34.315104 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3011/6009] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:34 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:34.319883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e93e4-8904-4f18-aada-68a468de187f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.326533 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 2999/6010] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:34 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:34.327791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0af63-04d3-431b-b85a-13aea4b092cb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.332500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e93e4-8904-4f18-aada-68a468de187f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.338737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196a33f-f439-44f6-b15d-1a26cc7b6f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.341968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196a33f-f439-44f6-b15d-1a26cc7b6f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.342360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196a33f-f439-44f6-b15d-1a26cc7b6f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.342708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196a33f-f439-44f6-b15d-1a26cc7b6f38 admin admin] PATH_INFO: `/v3/projects/8367cf5d4f724cabb1d4ac0a8e7a6b89/users/21a4340936c347d3b226f54f99403219/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.346534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0af63-04d3-431b-b85a-13aea4b092cb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.353566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8cc2a-598a-4300-809b-045a04a39b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.354709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8cc2a-598a-4300-809b-045a04a39b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.355276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8cc2a-598a-4300-809b-045a04a39b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.355892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8cc2a-598a-4300-809b-045a04a39b6e admin admin] PATH_INFO: `/v3/projects/9a4a2c65a731454ea501c6a4c8a382f3/users/db7a65730d824803a06005dfe1e3c683/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.364466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196a33f-f439-44f6-b15d-1a26cc7b6f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8367cf5d4f724cabb1d4ac0a8e7a6b89, user_id=21a4340936c347d3b226f54f99403219, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.367984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196a33f-f439-44f6-b15d-1a26cc7b6f38 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:34.389534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8cc2a-598a-4300-809b-045a04a39b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4a2c65a731454ea501c6a4c8a382f3, user_id=db7a65730d824803a06005dfe1e3c683, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.393857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8cc2a-598a-4300-809b-045a04a39b6e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:34.402229 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3012/6011] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:34 2021] PUT /identity/v3/projects/8367cf5d4f724cabb1d4ac0a8e7a6b89/users/21a4340936c347d3b226f54f99403219/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:34.403990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed625f-cf14-4489-980c-f5064b1f0417 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.404599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed625f-cf14-4489-980c-f5064b1f0417 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.404599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed625f-cf14-4489-980c-f5064b1f0417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.415344 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3000/6012] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:34 2021] PUT /identity/v3/projects/9a4a2c65a731454ea501c6a4c8a382f3/users/db7a65730d824803a06005dfe1e3c683/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:34.427474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf577ca-48b8-4ca9-828d-35a1cc21c9c0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.427740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf577ca-48b8-4ca9-828d-35a1cc21c9c0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.429250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf577ca-48b8-4ca9-828d-35a1cc21c9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.467231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-caf577ca-48b8-4ca9-828d-35a1cc21c9c0 None None] MFA Rules not processed for user `db7a65730d824803a06005dfe1e3c683`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:34.468536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-caf577ca-48b8-4ca9-828d-35a1cc21c9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:34.511814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-06ed625f-cf14-4489-980c-f5064b1f0417 None None] MFA Rules not processed for user `21a4340936c347d3b226f54f99403219`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:34.513237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-06ed625f-cf14-4489-980c-f5064b1f0417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:34.615299 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3001/6013] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:34 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:34.620042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf577ca-48b8-4ca9-828d-35a1cc21c9c0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.666747 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3013/6014] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:34 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:34.668235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed625f-cf14-4489-980c-f5064b1f0417 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.742914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf577ca-48b8-4ca9-828d-35a1cc21c9c0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.755081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de7ed4-a524-4c95-97a8-74dd78407742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.755768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de7ed4-a524-4c95-97a8-74dd78407742 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.756055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de7ed4-a524-4c95-97a8-74dd78407742 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.756329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de7ed4-a524-4c95-97a8-74dd78407742 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.758243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de7ed4-a524-4c95-97a8-74dd78407742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.760148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de7ed4-a524-4c95-97a8-74dd78407742 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:34.775484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed625f-cf14-4489-980c-f5064b1f0417 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.782445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1d0ca-2bd1-4c85-b032-959806266567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.783596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1d0ca-2bd1-4c85-b032-959806266567 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.784304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1d0ca-2bd1-4c85-b032-959806266567 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.784776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1d0ca-2bd1-4c85-b032-959806266567 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.785904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1d0ca-2bd1-4c85-b032-959806266567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.789334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1d0ca-2bd1-4c85-b032-959806266567 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:34.795158 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3002/6015] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:34 2021] POST /identity/v3/projects => generated 363 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:34.799775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de7ed4-a524-4c95-97a8-74dd78407742 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.831049 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3014/6016] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:34 2021] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:34.838611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1d0ca-2bd1-4c85-b032-959806266567 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:34.916483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de7ed4-a524-4c95-97a8-74dd78407742 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.952074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1d0ca-2bd1-4c85-b032-959806266567 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:34.964530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d2ce6-8981-4362-9d29-b2f43a3a595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:34.965315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2ce6-8981-4362-9d29-b2f43a3a595d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:34.965889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2ce6-8981-4362-9d29-b2f43a3a595d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:34.965992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2ce6-8981-4362-9d29-b2f43a3a595d admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:34.967113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d2ce6-8981-4362-9d29-b2f43a3a595d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:34.969432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d2ce6-8981-4362-9d29-b2f43a3a595d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.005002 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3015/6017] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:34 2021] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:35.006618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe529e-3625-4f61-b988-31c213b22e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.007912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe529e-3625-4f61-b988-31c213b22e6f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.008556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d2ce6-8981-4362-9d29-b2f43a3a595d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.009056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe529e-3625-4f61-b988-31c213b22e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.009539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe529e-3625-4f61-b988-31c213b22e6f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.010469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe529e-3625-4f61-b988-31c213b22e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.013707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe529e-3625-4f61-b988-31c213b22e6f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.022918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d2ce6-8981-4362-9d29-b2f43a3a595d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.030194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04417ba2-c3d3-4494-9dee-f3f0719d37d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.031066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04417ba2-c3d3-4494-9dee-f3f0719d37d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.031804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04417ba2-c3d3-4494-9dee-f3f0719d37d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.031804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04417ba2-c3d3-4494-9dee-f3f0719d37d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.032593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04417ba2-c3d3-4494-9dee-f3f0719d37d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.034473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04417ba2-c3d3-4494-9dee-f3f0719d37d3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.047107 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3003/6018] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:34 2021] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:35.047494 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3016/6019] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:35 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:35.050913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe529e-3625-4f61-b988-31c213b22e6f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.053446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04417ba2-c3d3-4494-9dee-f3f0719d37d3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.066277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04417ba2-c3d3-4494-9dee-f3f0719d37d3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.067898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe529e-3625-4f61-b988-31c213b22e6f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.071982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823a371-09aa-4f80-af96-054f3409055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.072802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823a371-09aa-4f80-af96-054f3409055a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.073079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823a371-09aa-4f80-af96-054f3409055a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.074042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823a371-09aa-4f80-af96-054f3409055a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.074456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d59d7e-22d4-46bc-8b1c-ab1046b028f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.075097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823a371-09aa-4f80-af96-054f3409055a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.075201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d59d7e-22d4-46bc-8b1c-ab1046b028f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.076994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823a371-09aa-4f80-af96-054f3409055a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.077473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d59d7e-22d4-46bc-8b1c-ab1046b028f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.077774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d59d7e-22d4-46bc-8b1c-ab1046b028f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.078564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d59d7e-22d4-46bc-8b1c-ab1046b028f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.080504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d59d7e-22d4-46bc-8b1c-ab1046b028f7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.099033 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3017/6020] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:35 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:35.101178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823a371-09aa-4f80-af96-054f3409055a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.116632 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3004/6021] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:35 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:35.119906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823a371-09aa-4f80-af96-054f3409055a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.123621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d59d7e-22d4-46bc-8b1c-ab1046b028f7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.129138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9991a8-6b18-4206-b68f-9c8268ce6a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.130206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9991a8-6b18-4206-b68f-9c8268ce6a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.130564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9991a8-6b18-4206-b68f-9c8268ce6a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.130914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9991a8-6b18-4206-b68f-9c8268ce6a9d admin admin] PATH_INFO: `/v3/projects/b4173c0499524a06a4c3f0d846db196d/users/15d90a869b194979bf81f715721bac96/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.137053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d59d7e-22d4-46bc-8b1c-ab1046b028f7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.143599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fddce-8de5-40fa-ab0b-b776deaa12b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.144648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fddce-8de5-40fa-ab0b-b776deaa12b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.144935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fddce-8de5-40fa-ab0b-b776deaa12b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.145213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fddce-8de5-40fa-ab0b-b776deaa12b8 admin admin] PATH_INFO: `/v3/projects/4fc8f4845a06488eb7542f9a67e999ed/users/085dcb6b7b45445e9986dfb3e5a17171/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.148096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9991a8-6b18-4206-b68f-9c8268ce6a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4173c0499524a06a4c3f0d846db196d, user_id=15d90a869b194979bf81f715721bac96, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.150879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9991a8-6b18-4206-b68f-9c8268ce6a9d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.163939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fddce-8de5-40fa-ab0b-b776deaa12b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc8f4845a06488eb7542f9a67e999ed, user_id=085dcb6b7b45445e9986dfb3e5a17171, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.166537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fddce-8de5-40fa-ab0b-b776deaa12b8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.178274 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3018/6022] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:35 2021] PUT /identity/v3/projects/b4173c0499524a06a4c3f0d846db196d/users/15d90a869b194979bf81f715721bac96/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:35.184854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9991a8-6b18-4206-b68f-9c8268ce6a9d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.189439 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3005/6023] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:35 2021] PUT /identity/v3/projects/4fc8f4845a06488eb7542f9a67e999ed/users/085dcb6b7b45445e9986dfb3e5a17171/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:35.201676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28f91a-ed36-42b1-9ecf-9b520d554350 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.201943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28f91a-ed36-42b1-9ecf-9b520d554350 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.202294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28f91a-ed36-42b1-9ecf-9b520d554350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.250097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6a28f91a-ed36-42b1-9ecf-9b520d554350 None None] MFA Rules not processed for user `085dcb6b7b45445e9986dfb3e5a17171`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:35.251539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6a28f91a-ed36-42b1-9ecf-9b520d554350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:35.281756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9991a8-6b18-4206-b68f-9c8268ce6a9d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.343965 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3006/6024] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:35 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:35.345362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28f91a-ed36-42b1-9ecf-9b520d554350 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.360935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd6cd9-51ec-474b-a537-bad24cf05d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.360935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6cd9-51ec-474b-a537-bad24cf05d6b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.361314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6cd9-51ec-474b-a537-bad24cf05d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.362659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd6cd9-51ec-474b-a537-bad24cf05d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.362659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd6cd9-51ec-474b-a537-bad24cf05d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.364424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd6cd9-51ec-474b-a537-bad24cf05d6b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.380379 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3019/6025] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:35 2021] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:35.381543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd6cd9-51ec-474b-a537-bad24cf05d6b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.392479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd6cd9-51ec-474b-a537-bad24cf05d6b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.398193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d8e93-9b25-42a6-806a-de4d56280307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.399533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d8e93-9b25-42a6-806a-de4d56280307 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.400083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d8e93-9b25-42a6-806a-de4d56280307 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.400427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d8e93-9b25-42a6-806a-de4d56280307 admin admin] PATH_INFO: `/v3/projects/b4173c0499524a06a4c3f0d846db196d/users/15d90a869b194979bf81f715721bac96/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.402710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d8e93-9b25-42a6-806a-de4d56280307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4173c0499524a06a4c3f0d846db196d, user_id=15d90a869b194979bf81f715721bac96, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.405475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d8e93-9b25-42a6-806a-de4d56280307 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.426894 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3020/6026] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:35 2021] PUT /identity/v3/projects/b4173c0499524a06a4c3f0d846db196d/users/15d90a869b194979bf81f715721bac96/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:35.433212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56ab51-187e-450d-8867-43ef6d7a89e7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.433525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56ab51-187e-450d-8867-43ef6d7a89e7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.433820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56ab51-187e-450d-8867-43ef6d7a89e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.449325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28f91a-ed36-42b1-9ecf-9b520d554350 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.473836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-af56ab51-187e-450d-8867-43ef6d7a89e7 None None] MFA Rules not processed for user `15d90a869b194979bf81f715721bac96`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:35.475060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-af56ab51-187e-450d-8867-43ef6d7a89e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:35.541598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b382-e025-4428-a328-0da6258d4594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.542279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b382-e025-4428-a328-0da6258d4594 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.542569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b382-e025-4428-a328-0da6258d4594 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.543445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b382-e025-4428-a328-0da6258d4594 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.544364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7b382-e025-4428-a328-0da6258d4594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.546310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7b382-e025-4428-a328-0da6258d4594 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.587008 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3007/6027] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:35 2021] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:35.588624 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3021/6028] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:35 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:35.590888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b382-e025-4428-a328-0da6258d4594 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.599688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56ab51-187e-450d-8867-43ef6d7a89e7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.603717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-af56ab51-187e-450d-8867-43ef6d7a89e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:35.701328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56ab51-187e-450d-8867-43ef6d7a89e7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.721466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b382-e025-4428-a328-0da6258d4594 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.733252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86d9d5-3e8c-4b65-a5b1-8b5757bb80e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.734293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86d9d5-3e8c-4b65-a5b1-8b5757bb80e7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.734799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86d9d5-3e8c-4b65-a5b1-8b5757bb80e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.735918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86d9d5-3e8c-4b65-a5b1-8b5757bb80e7 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.736956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86d9d5-3e8c-4b65-a5b1-8b5757bb80e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.740571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86d9d5-3e8c-4b65-a5b1-8b5757bb80e7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.767209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16130-1f9c-46b0-9614-4e20bc35ff47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.768078 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3008/6029] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:35 2021] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:35.771573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16130-1f9c-46b0-9614-4e20bc35ff47 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.771998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16130-1f9c-46b0-9614-4e20bc35ff47 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.773668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb16130-1f9c-46b0-9614-4e20bc35ff47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.774637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86d9d5-3e8c-4b65-a5b1-8b5757bb80e7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.788147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86d9d5-3e8c-4b65-a5b1-8b5757bb80e7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.796270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4191-af9e-44da-953e-1f5567fa1654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.797228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4191-af9e-44da-953e-1f5567fa1654 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.797765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4191-af9e-44da-953e-1f5567fa1654 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.798185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4191-af9e-44da-953e-1f5567fa1654 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.799360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd4191-af9e-44da-953e-1f5567fa1654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.801369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd4191-af9e-44da-953e-1f5567fa1654 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.816457 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3009/6030] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:35 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:35.820990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4191-af9e-44da-953e-1f5567fa1654 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.844483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4191-af9e-44da-953e-1f5567fa1654 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:35.866244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64e10-16d0-482e-86f1-391e31c4f2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:35.867153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64e10-16d0-482e-86f1-391e31c4f2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:35.867466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64e10-16d0-482e-86f1-391e31c4f2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:35.867748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64e10-16d0-482e-86f1-391e31c4f2a4 admin admin] PATH_INFO: `/v3/projects/ecf574b6fd6542ea99394a276de3ca85/users/c499043b0de54339b40aaf4db325037d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:35.912542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db64e10-16d0-482e-86f1-391e31c4f2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf574b6fd6542ea99394a276de3ca85, user_id=c499043b0de54339b40aaf4db325037d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.916065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db64e10-16d0-482e-86f1-391e31c4f2a4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.943310 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3010/6031] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:35 2021] PUT /identity/v3/projects/ecf574b6fd6542ea99394a276de3ca85/users/c499043b0de54339b40aaf4db325037d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:35.951863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64e10-16d0-482e-86f1-391e31c4f2a4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:35.958531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb16130-1f9c-46b0-9614-4e20bc35ff47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:35.960919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb16130-1f9c-46b0-9614-4e20bc35ff47 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:35.976829 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3022/6032] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:35 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:36.132541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16130-1f9c-46b0-9614-4e20bc35ff47 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:36.154543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb16130-1f9c-46b0-9614-4e20bc35ff47 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:36.164997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64e10-16d0-482e-86f1-391e31c4f2a4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:36.180961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b8613-dd27-4ccb-bafa-9c0688932345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:36.181967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b8613-dd27-4ccb-bafa-9c0688932345 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:36.182461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b8613-dd27-4ccb-bafa-9c0688932345 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:36.182921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b8613-dd27-4ccb-bafa-9c0688932345 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:36.183910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b8613-dd27-4ccb-bafa-9c0688932345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:36.188167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b8613-dd27-4ccb-bafa-9c0688932345 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:36.216829 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3011/6033] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:35 2021] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:36.220411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b8613-dd27-4ccb-bafa-9c0688932345 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:36.248290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b8613-dd27-4ccb-bafa-9c0688932345 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:36.260646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3c642-1e8e-43af-8251-dafdd5368fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:36.261922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3c642-1e8e-43af-8251-dafdd5368fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:36.262415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3c642-1e8e-43af-8251-dafdd5368fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:36.262919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3c642-1e8e-43af-8251-dafdd5368fa9 admin admin] PATH_INFO: `/v3/projects/ecf574b6fd6542ea99394a276de3ca85/users/c499043b0de54339b40aaf4db325037d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:36.265439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3c642-1e8e-43af-8251-dafdd5368fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf574b6fd6542ea99394a276de3ca85, user_id=c499043b0de54339b40aaf4db325037d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:36.268389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3c642-1e8e-43af-8251-dafdd5368fa9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:36.283634 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3012/6034] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:36 2021] PUT /identity/v3/projects/ecf574b6fd6542ea99394a276de3ca85/users/c499043b0de54339b40aaf4db325037d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:36.300708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fee5a-855e-41d2-9bc5-17f84f3f14d1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:36.301254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fee5a-855e-41d2-9bc5-17f84f3f14d1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:36.302383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fee5a-855e-41d2-9bc5-17f84f3f14d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:36.353578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d97e3-1495-4b49-b120-e94c4ef9d1f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:36.356961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d97e3-1495-4b49-b120-e94c4ef9d1f6 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:36.357258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d97e3-1495-4b49-b120-e94c4ef9d1f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:36.360667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d97e3-1495-4b49-b120-e94c4ef9d1f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:36.395185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-047fee5a-855e-41d2-9bc5-17f84f3f14d1 None None] MFA Rules not processed for user `c499043b0de54339b40aaf4db325037d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:36.396787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-047fee5a-855e-41d2-9bc5-17f84f3f14d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:36.473409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d97e3-1495-4b49-b120-e94c4ef9d1f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:36.474852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d97e3-1495-4b49-b120-e94c4ef9d1f6 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:36.485703 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3023/6035] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:36 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:36.605891 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3013/6036] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:36 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:36.926654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d97e3-1495-4b49-b120-e94c4ef9d1f6 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:36.930008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0d2d97e3-1495-4b49-b120-e94c4ef9d1f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:37.079889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d97e3-1495-4b49-b120-e94c4ef9d1f6 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:37.199156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea9e84-f224-417a-971e-d2f56f5565c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:37.200441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9e84-f224-417a-971e-d2f56f5565c3 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:37.200981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9e84-f224-417a-971e-d2f56f5565c3 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:37.201558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea9e84-f224-417a-971e-d2f56f5565c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:37.291066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea9e84-f224-417a-971e-d2f56f5565c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:37.294437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea9e84-f224-417a-971e-d2f56f5565c3 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:37.308277 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3024/6037] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:36 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:37.471648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fee5a-855e-41d2-9bc5-17f84f3f14d1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:37.473536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-047fee5a-855e-41d2-9bc5-17f84f3f14d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:37.504478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fee5a-855e-41d2-9bc5-17f84f3f14d1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:37.517093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e358cf-483e-4a7b-9ca0-3776a8d0798d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:37.517759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e358cf-483e-4a7b-9ca0-3776a8d0798d service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:37.518050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e358cf-483e-4a7b-9ca0-3776a8d0798d service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:37.518319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e358cf-483e-4a7b-9ca0-3776a8d0798d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:37.521104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b1e358cf-483e-4a7b-9ca0-3776a8d0798d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:37.637026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e358cf-483e-4a7b-9ca0-3776a8d0798d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:37.637026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e358cf-483e-4a7b-9ca0-3776a8d0798d service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:37.648433 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3014/6038] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:37 2021] GET /identity/v3/auth/tokens => generated 3272 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:38.062279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb0f11-e9bd-4f9c-af31-e06214b873eb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:38.062768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb0f11-e9bd-4f9c-af31-e06214b873eb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:38.062870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb0f11-e9bd-4f9c-af31-e06214b873eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:38.105371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1ffb0f11-e9bd-4f9c-af31-e06214b873eb None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:38.106627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1ffb0f11-e9bd-4f9c-af31-e06214b873eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:38.309790 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3025/6039] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:04:38 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:38.314109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e358cf-483e-4a7b-9ca0-3776a8d0798d service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:38.316017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b1e358cf-483e-4a7b-9ca0-3776a8d0798d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:38.519961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e358cf-483e-4a7b-9ca0-3776a8d0798d service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:38.532113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288cd96-b269-4442-a0cc-f8229f33ce0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:38.533212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288cd96-b269-4442-a0cc-f8229f33ce0f service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:38.533646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288cd96-b269-4442-a0cc-f8229f33ce0f service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:38.534069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288cd96-b269-4442-a0cc-f8229f33ce0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:38.556803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288cd96-b269-4442-a0cc-f8229f33ce0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:38.560425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288cd96-b269-4442-a0cc-f8229f33ce0f service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:38.570196 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3015/6040] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:04:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:04:39.662058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb0f11-e9bd-4f9c-af31-e06214b873eb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:39.737117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb0f11-e9bd-4f9c-af31-e06214b873eb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:39.744550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:39.747630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:39.748114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:39.748571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] PATH_INFO: `/v3/users/db7a65730d824803a06005dfe1e3c683` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:39.750041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7a65730d824803a06005dfe1e3c683)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:39.753158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:39.845231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7a65730d824803a06005dfe1e3c683'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:39.855340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7a65730d824803a06005dfe1e3c683'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:39.856342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7a65730d824803a06005dfe1e3c683'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:39.867410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7a65730d824803a06005dfe1e3c683'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:39.901063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7a65730d824803a06005dfe1e3c683'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:39.918235 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3026/6041] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:39 2021] DELETE /identity/v3/users/db7a65730d824803a06005dfe1e3c683 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:39.923496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3705-422f-4685-8613-6ba3dd8d2ff4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:39.924542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3705-422f-4685-8613-6ba3dd8d2ff4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:39.924963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3705-422f-4685-8613-6ba3dd8d2ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:39.950245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2d0b3705-422f-4685-8613-6ba3dd8d2ff4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:39.951780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2d0b3705-422f-4685-8613-6ba3dd8d2ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:40.073182 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3016/6042] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:40.096045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:40.099608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:40.231201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbf2a2-c958-4819-a786-f746bed22a17 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:40.235316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccf0c0-6a99-412e-9413-c16b5896df3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:40.236737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf0c0-6a99-412e-9413-c16b5896df3c service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:40.237264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf0c0-6a99-412e-9413-c16b5896df3c service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:40.239027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccf0c0-6a99-412e-9413-c16b5896df3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:40.257910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccf0c0-6a99-412e-9413-c16b5896df3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:40.260906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccf0c0-6a99-412e-9413-c16b5896df3c service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:40.276692 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3027/6043] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:41.971393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b3705-422f-4685-8613-6ba3dd8d2ff4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:41.972920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2d0b3705-422f-4685-8613-6ba3dd8d2ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:41.997989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b3705-422f-4685-8613-6ba3dd8d2ff4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:42.003858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:42.004717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:42.005158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:42.005585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] PATH_INFO: `/v3/projects/9a4a2c65a731454ea501c6a4c8a382f3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:42.016234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4a2c65a731454ea501c6a4c8a382f3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:42.018204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:42.088265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4a2c65a731454ea501c6a4c8a382f3', 'request_id': 'req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:42.096085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4a2c65a731454ea501c6a4c8a382f3', 'request_id': 'req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:42.106323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4a2c65a731454ea501c6a4c8a382f3', 'request_id': 'req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:42.120939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] The token cache is being invalidate because project 9a4a2c65a731454ea501c6a4c8a382f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:42.121615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:42.122418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:42.125819 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3017/6044] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:41 2021] DELETE /identity/v3/projects/9a4a2c65a731454ea501c6a4c8a382f3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:42.129873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccf0c0-6a99-412e-9413-c16b5896df3c service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:42.142743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccf0c0-6a99-412e-9413-c16b5896df3c service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:42.265492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45136352-1572-4a1f-894b-358b2812fd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:42.266389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45136352-1572-4a1f-894b-358b2812fd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:42.266675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45136352-1572-4a1f-894b-358b2812fd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:42.266942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45136352-1572-4a1f-894b-358b2812fd28 admin admin] PATH_INFO: `/v3/users/15d90a869b194979bf81f715721bac96` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:42.270163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45136352-1572-4a1f-894b-358b2812fd28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d90a869b194979bf81f715721bac96)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:42.272623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45136352-1572-4a1f-894b-358b2812fd28 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:42.375919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-45136352-1572-4a1f-894b-358b2812fd28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d90a869b194979bf81f715721bac96'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:42.387650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-45136352-1572-4a1f-894b-358b2812fd28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d90a869b194979bf81f715721bac96'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:42.388318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-45136352-1572-4a1f-894b-358b2812fd28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d90a869b194979bf81f715721bac96'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:42.396790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-45136352-1572-4a1f-894b-358b2812fd28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d90a869b194979bf81f715721bac96'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:42.412983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-45136352-1572-4a1f-894b-358b2812fd28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d90a869b194979bf81f715721bac96'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:42.422178 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3028/6045] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:42 2021] DELETE /identity/v3/users/15d90a869b194979bf81f715721bac96 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:43.062569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:43.066203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:43.081898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cdd6a-4a2c-49bd-af17-9d79a118e206 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:43.183545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:43.186344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:43.186860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:43.187553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] PATH_INFO: `/v3/projects/b4173c0499524a06a4c3f0d846db196d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:43.190606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4173c0499524a06a4c3f0d846db196d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:43.193652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:43.292314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4173c0499524a06a4c3f0d846db196d', 'request_id': 'req-d88ae7c0-7f22-49c6-9055-deb4d54849c3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:43.300490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4173c0499524a06a4c3f0d846db196d', 'request_id': 'req-d88ae7c0-7f22-49c6-9055-deb4d54849c3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:43.337751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4173c0499524a06a4c3f0d846db196d', 'request_id': 'req-d88ae7c0-7f22-49c6-9055-deb4d54849c3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:43.354481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] The token cache is being invalidate because project b4173c0499524a06a4c3f0d846db196d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:43.354977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:43.356260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:43.359225 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3018/6046] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:43 2021] DELETE /identity/v3/projects/b4173c0499524a06a4c3f0d846db196d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:43.369168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ed9e-a4c5-4512-9f6c-a2e241e14211 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:43.369661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ed9e-a4c5-4512-9f6c-a2e241e14211 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:43.369755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ed9e-a4c5-4512-9f6c-a2e241e14211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:43.409251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3c22ed9e-a4c5-4512-9f6c-a2e241e14211 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:43.410541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3c22ed9e-a4c5-4512-9f6c-a2e241e14211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:43.477077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:43.478947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:43.566930 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3029/6047] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:43.577551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0359c-bfca-4be2-91a5-e7b198ed56b6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:43.577975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0359c-bfca-4be2-91a5-e7b198ed56b6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:43.578261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0359c-bfca-4be2-91a5-e7b198ed56b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:43.601293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae7c0-7f22-49c6-9055-deb4d54849c3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:43.610397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-86a0359c-bfca-4be2-91a5-e7b198ed56b6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:43.611235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549e152-e940-4059-8045-61e8d86a3093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:43.612023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e152-e940-4059-8045-61e8d86a3093 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:43.612408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e152-e940-4059-8045-61e8d86a3093 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:43.612731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-86a0359c-bfca-4be2-91a5-e7b198ed56b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:43.612846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e152-e940-4059-8045-61e8d86a3093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:43.614863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6549e152-e940-4059-8045-61e8d86a3093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:43.629192 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3030/6048] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:43.641282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0359c-bfca-4be2-91a5-e7b198ed56b6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:43.658188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0359c-bfca-4be2-91a5-e7b198ed56b6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:43.666299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87de5e-c292-45f7-936b-3581c845979a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:43.666972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87de5e-c292-45f7-936b-3581c845979a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:43.667262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87de5e-c292-45f7-936b-3581c845979a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:43.667568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87de5e-c292-45f7-936b-3581c845979a admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:43.671165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87de5e-c292-45f7-936b-3581c845979a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:43.671535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87de5e-c292-45f7-936b-3581c845979a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:43.674037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87de5e-c292-45f7-936b-3581c845979a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:43.697580 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3031/6049] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:04:43.703048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87de5e-c292-45f7-936b-3581c845979a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:43.725459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87de5e-c292-45f7-936b-3581c845979a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:43.733943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf4af5-3c0a-4fe6-b616-ac15df8d89b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:43.735402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf4af5-3c0a-4fe6-b616-ac15df8d89b7 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:43.735843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf4af5-3c0a-4fe6-b616-ac15df8d89b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:43.736261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf4af5-3c0a-4fe6-b616-ac15df8d89b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:43.737195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf4af5-3c0a-4fe6-b616-ac15df8d89b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:43.739577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf4af5-3c0a-4fe6-b616-ac15df8d89b7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:43.751966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549e152-e940-4059-8045-61e8d86a3093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:43.754556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549e152-e940-4059-8045-61e8d86a3093 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:43.782188 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3019/6050] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:43 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:04:43.791764 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3032/6051] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:43 2021] POST /identity/v3/projects => generated 409 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:43.796281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549e152-e940-4059-8045-61e8d86a3093 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:43.835286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549e152-e940-4059-8045-61e8d86a3093 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:43.925000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cea649-bd04-493c-9b90-a94efca42b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:43.925917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cea649-bd04-493c-9b90-a94efca42b58 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:43.926350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cea649-bd04-493c-9b90-a94efca42b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:43.926775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cea649-bd04-493c-9b90-a94efca42b58 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:43.927741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cea649-bd04-493c-9b90-a94efca42b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:43.930904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cea649-bd04-493c-9b90-a94efca42b58 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:43.971964 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3020/6052] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:43 2021] POST /identity/v3/users => generated 305 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:43.977449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf4af5-3c0a-4fe6-b616-ac15df8d89b7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:44.000424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf4af5-3c0a-4fe6-b616-ac15df8d89b7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:44.014681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6676f4-faf9-4427-8a3a-f1740c2020a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:44.015503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6676f4-faf9-4427-8a3a-f1740c2020a3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:44.015895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6676f4-faf9-4427-8a3a-f1740c2020a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:44.016315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6676f4-faf9-4427-8a3a-f1740c2020a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:44.017694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6676f4-faf9-4427-8a3a-f1740c2020a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:44.023029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6676f4-faf9-4427-8a3a-f1740c2020a3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:44.046689 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3033/6053] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:43 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:44.050878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cea649-bd04-493c-9b90-a94efca42b58 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:44.067491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cea649-bd04-493c-9b90-a94efca42b58 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:44.082055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8b1a3-580c-4d5a-9baf-966224b3a36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:44.082978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b1a3-580c-4d5a-9baf-966224b3a36b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:44.083453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b1a3-580c-4d5a-9baf-966224b3a36b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:44.084063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8b1a3-580c-4d5a-9baf-966224b3a36b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:44.085041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8b1a3-580c-4d5a-9baf-966224b3a36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:44.086848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8b1a3-580c-4d5a-9baf-966224b3a36b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:44.098782 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3021/6054] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:44 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:44.103524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6676f4-faf9-4427-8a3a-f1740c2020a3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:44.116295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6676f4-faf9-4427-8a3a-f1740c2020a3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:44.125098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e038a-6a02-4cd3-a9a9-89abbd09da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:44.126061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e038a-6a02-4cd3-a9a9-89abbd09da64 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:44.126425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e038a-6a02-4cd3-a9a9-89abbd09da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:44.126838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e038a-6a02-4cd3-a9a9-89abbd09da64 admin admin] PATH_INFO: `/v3/projects/1da887555f8644469f2c0d5986a8423a/users/378870e5a56b433eb4ffbd5cd6ed8bc6/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:44.149034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e038a-6a02-4cd3-a9a9-89abbd09da64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da887555f8644469f2c0d5986a8423a, user_id=378870e5a56b433eb4ffbd5cd6ed8bc6, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:44.151880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e038a-6a02-4cd3-a9a9-89abbd09da64 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:44.172581 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3034/6055] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:44 2021] PUT /identity/v3/projects/1da887555f8644469f2c0d5986a8423a/users/378870e5a56b433eb4ffbd5cd6ed8bc6/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:44.196457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1771581-613e-4df9-bbc9-26580305707f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:44.197123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1771581-613e-4df9-bbc9-26580305707f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:44.197606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1771581-613e-4df9-bbc9-26580305707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:44.253798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e1771581-613e-4df9-bbc9-26580305707f None None] MFA Rules not processed for user `378870e5a56b433eb4ffbd5cd6ed8bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:44.255049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e1771581-613e-4df9-bbc9-26580305707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:44.446636 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3022/6056] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:44 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:44.451782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e038a-6a02-4cd3-a9a9-89abbd09da64 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:44.591750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e038a-6a02-4cd3-a9a9-89abbd09da64 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:44.602271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bc20e-8423-4b06-971a-fd11ff4db91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:44.602948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bc20e-8423-4b06-971a-fd11ff4db91b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:44.603299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bc20e-8423-4b06-971a-fd11ff4db91b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:44.603586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bc20e-8423-4b06-971a-fd11ff4db91b admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:44.604795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bc20e-8423-4b06-971a-fd11ff4db91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:44.606969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bc20e-8423-4b06-971a-fd11ff4db91b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:44.645759 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3035/6057] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:44 2021] POST /identity/v3/projects => generated 407 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:44.650560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1771581-613e-4df9-bbc9-26580305707f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:44.665279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1771581-613e-4df9-bbc9-26580305707f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:44.759052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5fc04-f922-4c1e-a90c-133be01e7f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:44.760073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5fc04-f922-4c1e-a90c-133be01e7f61 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:44.760488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5fc04-f922-4c1e-a90c-133be01e7f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:44.761204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5fc04-f922-4c1e-a90c-133be01e7f61 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:44.762872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5fc04-f922-4c1e-a90c-133be01e7f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:44.765607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5fc04-f922-4c1e-a90c-133be01e7f61 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:44.801887 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3023/6058] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:44 2021] POST /identity/v3/users => generated 310 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:04:44.805752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bc20e-8423-4b06-971a-fd11ff4db91b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:44.822067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bc20e-8423-4b06-971a-fd11ff4db91b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:44.829893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5905a44-bc71-4ed0-8da9-6aa2071820cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:44.831437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5905a44-bc71-4ed0-8da9-6aa2071820cb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:44.831725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5905a44-bc71-4ed0-8da9-6aa2071820cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:44.832001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5905a44-bc71-4ed0-8da9-6aa2071820cb admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:44.833039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5905a44-bc71-4ed0-8da9-6aa2071820cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:44.836046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5905a44-bc71-4ed0-8da9-6aa2071820cb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:44.867038 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3036/6059] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:44 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:44.870063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5fc04-f922-4c1e-a90c-133be01e7f61 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:44.881968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5fc04-f922-4c1e-a90c-133be01e7f61 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:44.887893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d8b5d-2c9e-4a07-a0d2-6c24acc46519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:44.888809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d8b5d-2c9e-4a07-a0d2-6c24acc46519 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:44.889094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d8b5d-2c9e-4a07-a0d2-6c24acc46519 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:44.889524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d8b5d-2c9e-4a07-a0d2-6c24acc46519 admin admin] PATH_INFO: `/v3/projects/4b3dd6bf7ec14092b0d1c35214cd9387/users/1f51c8009a9643e4b2299ab9a90f429a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:44.914241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d8b5d-2c9e-4a07-a0d2-6c24acc46519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3dd6bf7ec14092b0d1c35214cd9387, user_id=1f51c8009a9643e4b2299ab9a90f429a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:44.918540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d8b5d-2c9e-4a07-a0d2-6c24acc46519 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:44.944933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5905a44-bc71-4ed0-8da9-6aa2071820cb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:44.945380 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3024/6060] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:44 2021] PUT /identity/v3/projects/4b3dd6bf7ec14092b0d1c35214cd9387/users/1f51c8009a9643e4b2299ab9a90f429a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:44.961933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5905a44-bc71-4ed0-8da9-6aa2071820cb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:45.043962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0340670-8797-4620-a83a-c3d23813bb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:45.044669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0340670-8797-4620-a83a-c3d23813bb44 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:45.045103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0340670-8797-4620-a83a-c3d23813bb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:45.045587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0340670-8797-4620-a83a-c3d23813bb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:45.046410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0340670-8797-4620-a83a-c3d23813bb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:45.049761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0340670-8797-4620-a83a-c3d23813bb44 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:45.070931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d8b5d-2c9e-4a07-a0d2-6c24acc46519 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:45.085906 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3037/6061] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:44 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:45.087761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d8b5d-2c9e-4a07-a0d2-6c24acc46519 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:45.096644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cee6f-09b5-42af-9d95-2b64d6e64137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:45.097904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cee6f-09b5-42af-9d95-2b64d6e64137 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:45.098429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cee6f-09b5-42af-9d95-2b64d6e64137 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:45.098854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cee6f-09b5-42af-9d95-2b64d6e64137 admin admin] PATH_INFO: `/v3/projects/4b3dd6bf7ec14092b0d1c35214cd9387/users/1f51c8009a9643e4b2299ab9a90f429a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:45.102944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cee6f-09b5-42af-9d95-2b64d6e64137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3dd6bf7ec14092b0d1c35214cd9387, user_id=1f51c8009a9643e4b2299ab9a90f429a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:45.106713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cee6f-09b5-42af-9d95-2b64d6e64137 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:45.139234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd09fc-950e-492d-ab25-1c7e255268f8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:45.140144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd09fc-950e-492d-ab25-1c7e255268f8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:45.140585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd09fc-950e-492d-ab25-1c7e255268f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:45.142160 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3025/6062] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:45 2021] PUT /identity/v3/projects/4b3dd6bf7ec14092b0d1c35214cd9387/users/1f51c8009a9643e4b2299ab9a90f429a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:45.177092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e2fd09fc-950e-492d-ab25-1c7e255268f8 None None] MFA Rules not processed for user `1f51c8009a9643e4b2299ab9a90f429a`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:45.180075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e2fd09fc-950e-492d-ab25-1c7e255268f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:45.348111 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3038/6063] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:45 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:45.381866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cee6f-09b5-42af-9d95-2b64d6e64137 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:45.389054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0b5cee6f-09b5-42af-9d95-2b64d6e64137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:45.531205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cee6f-09b5-42af-9d95-2b64d6e64137 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:45.535824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f27797-74c3-46cb-be1b-21534b0206dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:45.536497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f27797-74c3-46cb-be1b-21534b0206dd service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:45.536979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f27797-74c3-46cb-be1b-21534b0206dd service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:45.537268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f27797-74c3-46cb-be1b-21534b0206dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:45.548269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f27797-74c3-46cb-be1b-21534b0206dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:45.549804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f27797-74c3-46cb-be1b-21534b0206dd service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:45.576677 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3026/6064] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:45 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:45.911102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd09fc-950e-492d-ab25-1c7e255268f8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:45.926798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd09fc-950e-492d-ab25-1c7e255268f8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:45.932663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200db1d-24e5-463e-9166-546297c2f7ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:45.933900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200db1d-24e5-463e-9166-546297c2f7ac service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:45.934235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200db1d-24e5-463e-9166-546297c2f7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:45.934510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200db1d-24e5-463e-9166-546297c2f7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:46.037277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200db1d-24e5-463e-9166-546297c2f7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:46.039566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200db1d-24e5-463e-9166-546297c2f7ac service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:46.059910 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3039/6065] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:45 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:47.999289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f27797-74c3-46cb-be1b-21534b0206dd service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:48.001919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c4f27797-74c3-46cb-be1b-21534b0206dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:48.250143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f27797-74c3-46cb-be1b-21534b0206dd service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:48.267823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:48.268957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:48.269420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:48.269998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] PATH_INFO: `/v3/users/b1067ef43ad34e12b55a057f063dd099` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:48.272037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1067ef43ad34e12b55a057f063dd099)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:48.276751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:48.397327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1067ef43ad34e12b55a057f063dd099'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:48.398261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1067ef43ad34e12b55a057f063dd099'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:48.411733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1067ef43ad34e12b55a057f063dd099'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:48.412654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1067ef43ad34e12b55a057f063dd099'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:48.429465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1067ef43ad34e12b55a057f063dd099'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:48.496112 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3027/6066] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:47 2021] DELETE /identity/v3/users/b1067ef43ad34e12b55a057f063dd099 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:50.034765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200db1d-24e5-463e-9166-546297c2f7ac service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:50.059687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200db1d-24e5-463e-9166-546297c2f7ac service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:50.361680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:50.364053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:50.364338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:50.364616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] PATH_INFO: `/v3/projects/00735fb3099849649f3659ccce46780f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:50.373049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00735fb3099849649f3659ccce46780f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:50.377228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:50.542654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00735fb3099849649f3659ccce46780f', 'request_id': 'req-63b5ac37-1632-496b-9c42-8297f3d37db4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:50.563237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00735fb3099849649f3659ccce46780f', 'request_id': 'req-63b5ac37-1632-496b-9c42-8297f3d37db4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:50.585291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00735fb3099849649f3659ccce46780f', 'request_id': 'req-63b5ac37-1632-496b-9c42-8297f3d37db4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:50.620474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] The token cache is being invalidate because project 00735fb3099849649f3659ccce46780f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:50.622728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:50.626438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:50.636246 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3040/6067] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:50 2021] DELETE /identity/v3/projects/00735fb3099849649f3659ccce46780f => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:50.638222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:50.640370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:50.669062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81983cda-66de-46a5-b2ea-03bfc3c437c2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:50.851607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce1760-1ab8-4440-ba01-96f3834ff492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:50.853996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce1760-1ab8-4440-ba01-96f3834ff492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:50.855725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce1760-1ab8-4440-ba01-96f3834ff492 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:50.856167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce1760-1ab8-4440-ba01-96f3834ff492 admin admin] PATH_INFO: `/v3/users/3ef9a5e156fc4ed491d049fd7c09ee0c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:50.861549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce1760-1ab8-4440-ba01-96f3834ff492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef9a5e156fc4ed491d049fd7c09ee0c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:50.865044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce1760-1ab8-4440-ba01-96f3834ff492 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:50.976248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-88ce1760-1ab8-4440-ba01-96f3834ff492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef9a5e156fc4ed491d049fd7c09ee0c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:50.977256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-88ce1760-1ab8-4440-ba01-96f3834ff492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef9a5e156fc4ed491d049fd7c09ee0c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:50.987668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-88ce1760-1ab8-4440-ba01-96f3834ff492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef9a5e156fc4ed491d049fd7c09ee0c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:50.988640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-88ce1760-1ab8-4440-ba01-96f3834ff492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef9a5e156fc4ed491d049fd7c09ee0c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:50.998999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-88ce1760-1ab8-4440-ba01-96f3834ff492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef9a5e156fc4ed491d049fd7c09ee0c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:51.020679 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3028/6068] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:50 2021] DELETE /identity/v3/users/3ef9a5e156fc4ed491d049fd7c09ee0c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:51.815604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:51.817214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:51.873683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5ac37-1632-496b-9c42-8297f3d37db4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:52.024163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:52.025343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:52.025883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:52.026324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] PATH_INFO: `/v3/projects/1fc5ea29615742c5822e366a80fffc75` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:52.029834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc5ea29615742c5822e366a80fffc75)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:52.030610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:52.107180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc5ea29615742c5822e366a80fffc75', 'request_id': 'req-a3675b21-7d5c-47cf-b846-56ca8c80b528'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:52.119579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc5ea29615742c5822e366a80fffc75', 'request_id': 'req-a3675b21-7d5c-47cf-b846-56ca8c80b528'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:52.133696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc5ea29615742c5822e366a80fffc75', 'request_id': 'req-a3675b21-7d5c-47cf-b846-56ca8c80b528'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:52.160400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] The token cache is being invalidate because project 1fc5ea29615742c5822e366a80fffc75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:52.160700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:52.163081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a3675b21-7d5c-47cf-b846-56ca8c80b528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:52.169664 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3041/6069] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:51 2021] DELETE /identity/v3/projects/1fc5ea29615742c5822e366a80fffc75 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:52.171669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ce13a-bbc1-4eef-993e-4f9bd496de03 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:52.172173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ce13a-bbc1-4eef-993e-4f9bd496de03 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:52.172259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ce13a-bbc1-4eef-993e-4f9bd496de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:52.201125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ee8ce13a-bbc1-4eef-993e-4f9bd496de03 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:52.203179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ee8ce13a-bbc1-4eef-993e-4f9bd496de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:52.336302 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3029/6070] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:52.344035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c596-fbbc-4965-95bb-f945361b97af None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:52.344403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c596-fbbc-4965-95bb-f945361b97af None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:52.345462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210c596-fbbc-4965-95bb-f945361b97af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:52.393075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e210c596-fbbc-4965-95bb-f945361b97af None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:52.398453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e210c596-fbbc-4965-95bb-f945361b97af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:52.413817 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3042/6071] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:52.418612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ce13a-bbc1-4eef-993e-4f9bd496de03 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:52.457996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ce13a-bbc1-4eef-993e-4f9bd496de03 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:52.465377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56d8f7-c0d4-4625-8b02-d314cdaf10b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:52.466106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56d8f7-c0d4-4625-8b02-d314cdaf10b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:52.466493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56d8f7-c0d4-4625-8b02-d314cdaf10b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:52.467223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56d8f7-c0d4-4625-8b02-d314cdaf10b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:52.468164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56d8f7-c0d4-4625-8b02-d314cdaf10b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:52.468933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56d8f7-c0d4-4625-8b02-d314cdaf10b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:52.471757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56d8f7-c0d4-4625-8b02-d314cdaf10b6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:52.502259 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3030/6072] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:04:52.508441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210c596-fbbc-4965-95bb-f945361b97af None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:52.525045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210c596-fbbc-4965-95bb-f945361b97af None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:52.532829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd56ad7-5c79-4cac-bf30-41e0179ae868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:52.533528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd56ad7-5c79-4cac-bf30-41e0179ae868 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:52.533905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd56ad7-5c79-4cac-bf30-41e0179ae868 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:52.534089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd56ad7-5c79-4cac-bf30-41e0179ae868 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:52.547659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd56ad7-5c79-4cac-bf30-41e0179ae868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:52.553326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd56ad7-5c79-4cac-bf30-41e0179ae868 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:52.606936 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3043/6073] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:52 2021] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:52.613763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56d8f7-c0d4-4625-8b02-d314cdaf10b6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:52.635612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56d8f7-c0d4-4625-8b02-d314cdaf10b6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:52.740836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a927070-c83f-476e-a338-6aed30c6e728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:52.741784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a927070-c83f-476e-a338-6aed30c6e728 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:52.742249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a927070-c83f-476e-a338-6aed30c6e728 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:52.742723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a927070-c83f-476e-a338-6aed30c6e728 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:52.743640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a927070-c83f-476e-a338-6aed30c6e728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:52.745887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a927070-c83f-476e-a338-6aed30c6e728 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:52.769239 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3031/6074] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:52 2021] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:52.773471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd56ad7-5c79-4cac-bf30-41e0179ae868 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:52.784225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd56ad7-5c79-4cac-bf30-41e0179ae868 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:52.789663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57924102-62b2-4b00-b2b3-64a6001f2846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:52.790347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57924102-62b2-4b00-b2b3-64a6001f2846 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:52.790630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57924102-62b2-4b00-b2b3-64a6001f2846 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:52.790911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57924102-62b2-4b00-b2b3-64a6001f2846 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:52.791696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57924102-62b2-4b00-b2b3-64a6001f2846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:52.793345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57924102-62b2-4b00-b2b3-64a6001f2846 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:52.806104 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3044/6075] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:52.810337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a927070-c83f-476e-a338-6aed30c6e728 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:52.827132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a927070-c83f-476e-a338-6aed30c6e728 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:52.841172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd756a-8a7a-44d2-9428-1f7d9d07521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:52.842752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd756a-8a7a-44d2-9428-1f7d9d07521d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:52.843042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd756a-8a7a-44d2-9428-1f7d9d07521d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:52.843555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd756a-8a7a-44d2-9428-1f7d9d07521d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:52.844223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd756a-8a7a-44d2-9428-1f7d9d07521d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:52.846495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd756a-8a7a-44d2-9428-1f7d9d07521d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:52.859382 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3032/6076] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:52 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:52.863316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57924102-62b2-4b00-b2b3-64a6001f2846 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:52.877215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57924102-62b2-4b00-b2b3-64a6001f2846 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:52.888863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac02482-fe40-4b22-85c3-bd72b214e841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:52.890422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac02482-fe40-4b22-85c3-bd72b214e841 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:52.890707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac02482-fe40-4b22-85c3-bd72b214e841 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:52.890985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac02482-fe40-4b22-85c3-bd72b214e841 admin admin] PATH_INFO: `/v3/projects/4b756ba4e580446980b973ad0b42b9fe/users/67ee436ffe774a1eb71cdb910112c7eb/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:52.911050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac02482-fe40-4b22-85c3-bd72b214e841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b756ba4e580446980b973ad0b42b9fe, user_id=67ee436ffe774a1eb71cdb910112c7eb, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:52.914575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac02482-fe40-4b22-85c3-bd72b214e841 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:52.937776 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3045/6077] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:52 2021] PUT /identity/v3/projects/4b756ba4e580446980b973ad0b42b9fe/users/67ee436ffe774a1eb71cdb910112c7eb/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:52.944630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260e888-6f71-442f-a355-751d8b71b78d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:52.945350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260e888-6f71-442f-a355-751d8b71b78d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:52.945901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260e888-6f71-442f-a355-751d8b71b78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:52.984826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1260e888-6f71-442f-a355-751d8b71b78d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:52.987898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1260e888-6f71-442f-a355-751d8b71b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:53.096513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac02482-fe40-4b22-85c3-bd72b214e841 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:53.101530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9ac02482-fe40-4b22-85c3-bd72b214e841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:53.158069 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3033/6078] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:53.192311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260e888-6f71-442f-a355-751d8b71b78d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:53.196316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1260e888-6f71-442f-a355-751d8b71b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:53.229731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac02482-fe40-4b22-85c3-bd72b214e841 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:53.244097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:53.245047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:53.245329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:53.245601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] PATH_INFO: `/v3/users/378870e5a56b433eb4ffbd5cd6ed8bc6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:53.254724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378870e5a56b433eb4ffbd5cd6ed8bc6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:53.257149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:53.290343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260e888-6f71-442f-a355-751d8b71b78d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:53.301837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6f3d7-5d2a-4257-960b-6472b4e2be56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:53.302555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f3d7-5d2a-4257-960b-6472b4e2be56 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:53.304462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f3d7-5d2a-4257-960b-6472b4e2be56 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:53.304896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f3d7-5d2a-4257-960b-6472b4e2be56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:53.355358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6f3d7-5d2a-4257-960b-6472b4e2be56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:53.358626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378870e5a56b433eb4ffbd5cd6ed8bc6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:53.360526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6f3d7-5d2a-4257-960b-6472b4e2be56 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:53.373461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378870e5a56b433eb4ffbd5cd6ed8bc6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:53.374317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378870e5a56b433eb4ffbd5cd6ed8bc6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:53.384549 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3034/6079] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:04:53.389003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378870e5a56b433eb4ffbd5cd6ed8bc6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:53.435817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378870e5a56b433eb4ffbd5cd6ed8bc6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:53.457447 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3046/6080] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:53 2021] DELETE /identity/v3/users/378870e5a56b433eb4ffbd5cd6ed8bc6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:04:53.462262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea710-2150-4dca-a2bb-90372f0395ed None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:53.465274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea710-2150-4dca-a2bb-90372f0395ed None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:53.465898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ea710-2150-4dca-a2bb-90372f0395ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:53.507924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f26ea710-2150-4dca-a2bb-90372f0395ed None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:53.509166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f26ea710-2150-4dca-a2bb-90372f0395ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:53.628951 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3035/6081] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:53.648108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:53.649906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:53.762672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b489f6f-9e2e-405d-98a1-deaac6852457 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:53.767360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4349218-fc01-4143-9168-228b2ff1b948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:53.768896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349218-fc01-4143-9168-228b2ff1b948 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:53.769279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349218-fc01-4143-9168-228b2ff1b948 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:53.770463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349218-fc01-4143-9168-228b2ff1b948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:53.781310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4349218-fc01-4143-9168-228b2ff1b948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:53.782845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4349218-fc01-4143-9168-228b2ff1b948 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:53.801705 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3047/6082] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:04:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:04:54.830866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ea710-2150-4dca-a2bb-90372f0395ed None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:54.839309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f26ea710-2150-4dca-a2bb-90372f0395ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:54.875020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ea710-2150-4dca-a2bb-90372f0395ed None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:54.891429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:54.891429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:54.891429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:54.891785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] PATH_INFO: `/v3/projects/1da887555f8644469f2c0d5986a8423a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:54.904242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da887555f8644469f2c0d5986a8423a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:54.906911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:55.044100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da887555f8644469f2c0d5986a8423a', 'request_id': 'req-f6ff5081-28a5-4132-9d46-2b018e8d7954'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:55.058010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da887555f8644469f2c0d5986a8423a', 'request_id': 'req-f6ff5081-28a5-4132-9d46-2b018e8d7954'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:55.076304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da887555f8644469f2c0d5986a8423a', 'request_id': 'req-f6ff5081-28a5-4132-9d46-2b018e8d7954'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:55.104384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] The token cache is being invalidate because project 1da887555f8644469f2c0d5986a8423a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:55.104952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:55.105814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f6ff5081-28a5-4132-9d46-2b018e8d7954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:55.107941 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3036/6083] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:54 2021] DELETE /identity/v3/projects/1da887555f8644469f2c0d5986a8423a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:55.111697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4349218-fc01-4143-9168-228b2ff1b948 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:55.123779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4349218-fc01-4143-9168-228b2ff1b948 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:55.199979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd141-0006-47f7-ae88-b58a9577da21 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:55.200374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd141-0006-47f7-ae88-b58a9577da21 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:55.200754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd141-0006-47f7-ae88-b58a9577da21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:55.226930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-206bd141-0006-47f7-ae88-b58a9577da21 None None] MFA Rules not processed for user `21a4340936c347d3b226f54f99403219`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:55.227864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ff108-ec46-43a9-87cf-8f3de87ed041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:55.228570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-206bd141-0006-47f7-ae88-b58a9577da21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:55.229106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff108-ec46-43a9-87cf-8f3de87ed041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:55.229553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff108-ec46-43a9-87cf-8f3de87ed041 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:55.229978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff108-ec46-43a9-87cf-8f3de87ed041 admin admin] PATH_INFO: `/v3/users/1f51c8009a9643e4b2299ab9a90f429a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:55.235337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ff108-ec46-43a9-87cf-8f3de87ed041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f51c8009a9643e4b2299ab9a90f429a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:55.237486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ff108-ec46-43a9-87cf-8f3de87ed041 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:55.350352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-313ff108-ec46-43a9-87cf-8f3de87ed041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f51c8009a9643e4b2299ab9a90f429a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:55.364279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-313ff108-ec46-43a9-87cf-8f3de87ed041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f51c8009a9643e4b2299ab9a90f429a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:55.365671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-313ff108-ec46-43a9-87cf-8f3de87ed041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f51c8009a9643e4b2299ab9a90f429a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:55.371981 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3037/6084] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:55 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:55.408251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-313ff108-ec46-43a9-87cf-8f3de87ed041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f51c8009a9643e4b2299ab9a90f429a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:55.437986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-313ff108-ec46-43a9-87cf-8f3de87ed041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f51c8009a9643e4b2299ab9a90f429a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:55.449481 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3048/6085] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:04:55 2021] DELETE /identity/v3/users/1f51c8009a9643e4b2299ab9a90f429a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:04:56.917742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd141-0006-47f7-ae88-b58a9577da21 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:56.919225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-206bd141-0006-47f7-ae88-b58a9577da21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:56.951522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd141-0006-47f7-ae88-b58a9577da21 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:57.088008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:57.088945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:57.089303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:57.089696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] PATH_INFO: `/v3/projects/4b3dd6bf7ec14092b0d1c35214cd9387` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:57.092257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3dd6bf7ec14092b0d1c35214cd9387)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:57.096140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:57.197454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3dd6bf7ec14092b0d1c35214cd9387', 'request_id': 'req-83c994c6-2aa6-488f-9fda-83be27d82622'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:57.206803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3dd6bf7ec14092b0d1c35214cd9387', 'request_id': 'req-83c994c6-2aa6-488f-9fda-83be27d82622'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:57.237240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3dd6bf7ec14092b0d1c35214cd9387', 'request_id': 'req-83c994c6-2aa6-488f-9fda-83be27d82622'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:57.253458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] The token cache is being invalidate because project 4b3dd6bf7ec14092b0d1c35214cd9387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:04:57.254218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:57.255762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83c994c6-2aa6-488f-9fda-83be27d82622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:04:57.266199 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3038/6086] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:04:56 2021] DELETE /identity/v3/projects/4b3dd6bf7ec14092b0d1c35214cd9387 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:57.272253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ff21f-323e-408b-8114-766acb4704ac None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:57.273235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ff21f-323e-408b-8114-766acb4704ac None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:57.273653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ff21f-323e-408b-8114-766acb4704ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:57.312372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3b8ff21f-323e-408b-8114-766acb4704ac None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:57.321742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3b8ff21f-323e-408b-8114-766acb4704ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:57.474022 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3049/6087] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:57.487392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcad06-81bf-40b3-b92e-cf3c745e2d39 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:57.487911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcad06-81bf-40b3-b92e-cf3c745e2d39 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:57.488330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcad06-81bf-40b3-b92e-cf3c745e2d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:57.535989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-25dcad06-81bf-40b3-b92e-cf3c745e2d39 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:57.537368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-25dcad06-81bf-40b3-b92e-cf3c745e2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:57.552735 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3039/6088] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:04:57.556301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ff21f-323e-408b-8114-766acb4704ac None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:57.594310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ff21f-323e-408b-8114-766acb4704ac None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:57.606834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b8358-e37e-4a1b-8a4c-fe6ce7b8a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:57.608143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b8358-e37e-4a1b-8a4c-fe6ce7b8a61b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:57.608429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b8358-e37e-4a1b-8a4c-fe6ce7b8a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:57.608701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b8358-e37e-4a1b-8a4c-fe6ce7b8a61b admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:57.609628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b8358-e37e-4a1b-8a4c-fe6ce7b8a61b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:04:57.610091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b8358-e37e-4a1b-8a4c-fe6ce7b8a61b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:57.611902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b8358-e37e-4a1b-8a4c-fe6ce7b8a61b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:57.640774 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3050/6089] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:04:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:04:57.645019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcad06-81bf-40b3-b92e-cf3c745e2d39 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:57.659090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcad06-81bf-40b3-b92e-cf3c745e2d39 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:57.679554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da484db0-0119-4096-a7f1-c219efc4538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:57.680439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da484db0-0119-4096-a7f1-c219efc4538e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:57.682034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da484db0-0119-4096-a7f1-c219efc4538e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:57.682432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da484db0-0119-4096-a7f1-c219efc4538e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:57.685606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da484db0-0119-4096-a7f1-c219efc4538e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:57.690403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da484db0-0119-4096-a7f1-c219efc4538e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:57.745142 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3040/6090] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:57 2021] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:57.749331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b8358-e37e-4a1b-8a4c-fe6ce7b8a61b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:57.763838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b8358-e37e-4a1b-8a4c-fe6ce7b8a61b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:58.018359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0e4c0-c410-490b-be05-82824b6871e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:58.019457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0e4c0-c410-490b-be05-82824b6871e5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:58.020357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0e4c0-c410-490b-be05-82824b6871e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:58.020813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0e4c0-c410-490b-be05-82824b6871e5 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:58.022211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0e4c0-c410-490b-be05-82824b6871e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:58.028536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0e4c0-c410-490b-be05-82824b6871e5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:58.077768 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3051/6091] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:57 2021] POST /identity/v3/users => generated 288 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:58.082035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da484db0-0119-4096-a7f1-c219efc4538e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:58.110894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da484db0-0119-4096-a7f1-c219efc4538e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:58.137274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03a653-75fd-4765-a600-16e18183b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:58.138973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03a653-75fd-4765-a600-16e18183b450 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:58.139764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03a653-75fd-4765-a600-16e18183b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:58.140528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03a653-75fd-4765-a600-16e18183b450 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:58.141579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03a653-75fd-4765-a600-16e18183b450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:58.143757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03a653-75fd-4765-a600-16e18183b450 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:58.160696 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3041/6092] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:58 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:58.164473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0e4c0-c410-490b-be05-82824b6871e5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:58.190577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0e4c0-c410-490b-be05-82824b6871e5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:58.243942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea0f48-9104-4a8e-a898-30d1e3e87b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:58.245992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0f48-9104-4a8e-a898-30d1e3e87b2a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:58.246609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0f48-9104-4a8e-a898-30d1e3e87b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:58.254311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0f48-9104-4a8e-a898-30d1e3e87b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:58.255113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea0f48-9104-4a8e-a898-30d1e3e87b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:58.256829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea0f48-9104-4a8e-a898-30d1e3e87b2a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:58.289500 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3052/6093] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:58 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:58.291566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03a653-75fd-4765-a600-16e18183b450 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:58.313106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03a653-75fd-4765-a600-16e18183b450 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:58.326002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6596e22-62a3-4f76-9f27-301d75fdb530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:58.330154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596e22-62a3-4f76-9f27-301d75fdb530 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:58.330561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596e22-62a3-4f76-9f27-301d75fdb530 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:58.331364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596e22-62a3-4f76-9f27-301d75fdb530 admin admin] PATH_INFO: `/v3/projects/519faaaead914dc8b55c6a4251bb8c46/users/7fd08bde9a52432abf2e0646b2fdf65a/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:58.396651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6596e22-62a3-4f76-9f27-301d75fdb530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519faaaead914dc8b55c6a4251bb8c46, user_id=7fd08bde9a52432abf2e0646b2fdf65a, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:58.412794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6596e22-62a3-4f76-9f27-301d75fdb530 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:58.461223 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3042/6094] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:58 2021] PUT /identity/v3/projects/519faaaead914dc8b55c6a4251bb8c46/users/7fd08bde9a52432abf2e0646b2fdf65a/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:58.471804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4037cd-08a4-4d00-a8fb-e7e74f5180bb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:58.472191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4037cd-08a4-4d00-a8fb-e7e74f5180bb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:58.472905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4037cd-08a4-4d00-a8fb-e7e74f5180bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:58.550554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7d4037cd-08a4-4d00-a8fb-e7e74f5180bb None None] MFA Rules not processed for user `7fd08bde9a52432abf2e0646b2fdf65a`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:58.553681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7d4037cd-08a4-4d00-a8fb-e7e74f5180bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:58.712492 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3053/6095] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:58 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:58.713883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6596e22-62a3-4f76-9f27-301d75fdb530 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:58.920767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6596e22-62a3-4f76-9f27-301d75fdb530 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:58.927949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266cb35-bd7c-4524-ac78-65b7b0257a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:58.931242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266cb35-bd7c-4524-ac78-65b7b0257a43 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:58.932355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266cb35-bd7c-4524-ac78-65b7b0257a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:58.932802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266cb35-bd7c-4524-ac78-65b7b0257a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:58.933888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266cb35-bd7c-4524-ac78-65b7b0257a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:58.953494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266cb35-bd7c-4524-ac78-65b7b0257a43 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:59.025299 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3043/6096] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:58 2021] POST /identity/v3/projects => generated 377 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:59.028011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4037cd-08a4-4d00-a8fb-e7e74f5180bb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:59.048282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4037cd-08a4-4d00-a8fb-e7e74f5180bb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:59.250613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba6f4d-24a7-4753-87fc-e7f0d3e991d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:59.253573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba6f4d-24a7-4753-87fc-e7f0d3e991d5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:59.254015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba6f4d-24a7-4753-87fc-e7f0d3e991d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:59.254571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba6f4d-24a7-4753-87fc-e7f0d3e991d5 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:59.256165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba6f4d-24a7-4753-87fc-e7f0d3e991d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:59.259052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba6f4d-24a7-4753-87fc-e7f0d3e991d5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:59.297270 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3054/6097] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:04:59 2021] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:04:59.302034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266cb35-bd7c-4524-ac78-65b7b0257a43 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:59.324865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266cb35-bd7c-4524-ac78-65b7b0257a43 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:59.332903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c646800-ff17-4385-a7d8-8e67405cac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:59.333700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646800-ff17-4385-a7d8-8e67405cac93 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:59.335216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646800-ff17-4385-a7d8-8e67405cac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:59.335807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c646800-ff17-4385-a7d8-8e67405cac93 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:59.336848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c646800-ff17-4385-a7d8-8e67405cac93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:59.342002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c646800-ff17-4385-a7d8-8e67405cac93 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:59.365768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba6f4d-24a7-4753-87fc-e7f0d3e991d5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:59.370910 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3044/6098] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:59 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:04:59.383725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba6f4d-24a7-4753-87fc-e7f0d3e991d5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:59.409283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7013e-9f1e-4f31-a50d-b988f4cc7777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:59.420460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7013e-9f1e-4f31-a50d-b988f4cc7777 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:59.420766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7013e-9f1e-4f31-a50d-b988f4cc7777 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:59.421171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7013e-9f1e-4f31-a50d-b988f4cc7777 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:59.425620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7013e-9f1e-4f31-a50d-b988f4cc7777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:59.428585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7013e-9f1e-4f31-a50d-b988f4cc7777 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:59.446947 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3055/6099] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:04:59 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:04:59.448435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c646800-ff17-4385-a7d8-8e67405cac93 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:04:59.460434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c646800-ff17-4385-a7d8-8e67405cac93 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:04:59.480439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94fcf6-54c4-4b51-b98b-954c2f2daea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:04:59.485156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fcf6-54c4-4b51-b98b-954c2f2daea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:59.485659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fcf6-54c4-4b51-b98b-954c2f2daea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:59.486112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94fcf6-54c4-4b51-b98b-954c2f2daea8 admin admin] PATH_INFO: `/v3/projects/7acd0fac80f6402abdf7dc84df4f66b6/users/8418d041417b4673a7771b1009a0514e/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:59.524995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94fcf6-54c4-4b51-b98b-954c2f2daea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acd0fac80f6402abdf7dc84df4f66b6, user_id=8418d041417b4673a7771b1009a0514e, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:04:59.528082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94fcf6-54c4-4b51-b98b-954c2f2daea8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:04:59.578599 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3045/6100] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:04:59 2021] PUT /identity/v3/projects/7acd0fac80f6402abdf7dc84df4f66b6/users/8418d041417b4673a7771b1009a0514e/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:04:59.579603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c735d-33fd-4b88-9880-fb402a958b3d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:04:59.580390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c735d-33fd-4b88-9880-fb402a958b3d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:04:59.580798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c735d-33fd-4b88-9880-fb402a958b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:04:59.670946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-193c735d-33fd-4b88-9880-fb402a958b3d None None] MFA Rules not processed for user `8418d041417b4673a7771b1009a0514e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:04:59.672611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-193c735d-33fd-4b88-9880-fb402a958b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:04:59.819815 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3056/6101] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:04:59 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:04:59.824139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94fcf6-54c4-4b51-b98b-954c2f2daea8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:00.011222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94fcf6-54c4-4b51-b98b-954c2f2daea8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:00.027107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72e86-ea41-46f0-847a-e4d24cbcea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:00.028096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72e86-ea41-46f0-847a-e4d24cbcea9a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:00.028531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72e86-ea41-46f0-847a-e4d24cbcea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:00.029077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72e86-ea41-46f0-847a-e4d24cbcea9a admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:00.029938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f72e86-ea41-46f0-847a-e4d24cbcea9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:00.032119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f72e86-ea41-46f0-847a-e4d24cbcea9a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:00.089267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c735d-33fd-4b88-9880-fb402a958b3d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:00.090429 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3046/6102] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:04:59 2021] POST /identity/v3/projects => generated 377 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:00.110787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c735d-33fd-4b88-9880-fb402a958b3d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:00.240741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2ea2f-adb3-47d2-87b3-a691edb2596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:00.241835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2ea2f-adb3-47d2-87b3-a691edb2596f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:00.242459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2ea2f-adb3-47d2-87b3-a691edb2596f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:00.243449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2ea2f-adb3-47d2-87b3-a691edb2596f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:00.246851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2ea2f-adb3-47d2-87b3-a691edb2596f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:00.257838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2ea2f-adb3-47d2-87b3-a691edb2596f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:00.296570 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3057/6103] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:00 2021] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:00.300295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72e86-ea41-46f0-847a-e4d24cbcea9a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:00.316279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72e86-ea41-46f0-847a-e4d24cbcea9a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:00.329615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82531d4b-5c84-4512-9ac9-91243f32ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:00.332076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82531d4b-5c84-4512-9ac9-91243f32ddbc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:00.333438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82531d4b-5c84-4512-9ac9-91243f32ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:00.334993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82531d4b-5c84-4512-9ac9-91243f32ddbc admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:00.337394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82531d4b-5c84-4512-9ac9-91243f32ddbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:00.339622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82531d4b-5c84-4512-9ac9-91243f32ddbc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:00.374814 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3047/6104] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:00 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:00.379159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2ea2f-adb3-47d2-87b3-a691edb2596f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:00.396596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2ea2f-adb3-47d2-87b3-a691edb2596f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:00.406078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff79fe-aa8a-4924-b2e2-671ccab9abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:00.409017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff79fe-aa8a-4924-b2e2-671ccab9abaf admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:00.409800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff79fe-aa8a-4924-b2e2-671ccab9abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:00.410539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff79fe-aa8a-4924-b2e2-671ccab9abaf admin admin] PATH_INFO: `/v3/projects/47de28c147a747e1bee9a85cfcc810f8/users/54203fe102594f319506ce4c05f3686e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:00.546738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff79fe-aa8a-4924-b2e2-671ccab9abaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=47de28c147a747e1bee9a85cfcc810f8, user_id=54203fe102594f319506ce4c05f3686e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:00.562675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff79fe-aa8a-4924-b2e2-671ccab9abaf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:00.593956 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3058/6105] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:00 2021] PUT /identity/v3/projects/47de28c147a747e1bee9a85cfcc810f8/users/54203fe102594f319506ce4c05f3686e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:00.597575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82531d4b-5c84-4512-9ac9-91243f32ddbc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:00.616074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82531d4b-5c84-4512-9ac9-91243f32ddbc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:00.725757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cf906-7792-4bb0-af49-b52edd8efc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:00.726425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf906-7792-4bb0-af49-b52edd8efc4a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:00.726708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf906-7792-4bb0-af49-b52edd8efc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:00.726985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf906-7792-4bb0-af49-b52edd8efc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:00.727794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cf906-7792-4bb0-af49-b52edd8efc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:00.729991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cf906-7792-4bb0-af49-b52edd8efc4a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:00.768191 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3048/6106] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:00 2021] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:00.769343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff79fe-aa8a-4924-b2e2-671ccab9abaf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:00.796089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff79fe-aa8a-4924-b2e2-671ccab9abaf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:00.833793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3289713-5049-42ce-8176-eaabcf111aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:00.838001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3289713-5049-42ce-8176-eaabcf111aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:00.839184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3289713-5049-42ce-8176-eaabcf111aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:00.840477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3289713-5049-42ce-8176-eaabcf111aa4 admin admin] PATH_INFO: `/v3/projects/47de28c147a747e1bee9a85cfcc810f8/users/54203fe102594f319506ce4c05f3686e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:00.851153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3289713-5049-42ce-8176-eaabcf111aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47de28c147a747e1bee9a85cfcc810f8, user_id=54203fe102594f319506ce4c05f3686e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:00.860091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3289713-5049-42ce-8176-eaabcf111aa4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:00.888370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d510b-075a-4cdd-a7e2-3e83eefe8b67 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:00.888511 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3059/6107] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:00 2021] PUT /identity/v3/projects/47de28c147a747e1bee9a85cfcc810f8/users/54203fe102594f319506ce4c05f3686e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:00.888665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d510b-075a-4cdd-a7e2-3e83eefe8b67 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:00.888944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d510b-075a-4cdd-a7e2-3e83eefe8b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:00.959996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c74d510b-075a-4cdd-a7e2-3e83eefe8b67 None None] MFA Rules not processed for user `54203fe102594f319506ce4c05f3686e`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:00.979096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c74d510b-075a-4cdd-a7e2-3e83eefe8b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:01.132109 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3049/6108] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:00 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:01.144693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3289713-5049-42ce-8176-eaabcf111aa4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:01.149879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a3289713-5049-42ce-8176-eaabcf111aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:01.288500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3289713-5049-42ce-8176-eaabcf111aa4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:01.292334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85cc09-b3ab-472c-bd76-43235de0c965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:01.293004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85cc09-b3ab-472c-bd76-43235de0c965 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:01.293288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85cc09-b3ab-472c-bd76-43235de0c965 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:01.293783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85cc09-b3ab-472c-bd76-43235de0c965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:01.306710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85cc09-b3ab-472c-bd76-43235de0c965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:01.309090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85cc09-b3ab-472c-bd76-43235de0c965 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:01.327869 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3060/6109] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:01 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:01.383101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d510b-075a-4cdd-a7e2-3e83eefe8b67 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:01.385298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c74d510b-075a-4cdd-a7e2-3e83eefe8b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:01.465454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d510b-075a-4cdd-a7e2-3e83eefe8b67 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:01.472585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0346b-5c94-44d0-adb0-307d995be5eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:01.473623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0346b-5c94-44d0-adb0-307d995be5eb service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:01.474121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0346b-5c94-44d0-adb0-307d995be5eb service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:01.474767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0346b-5c94-44d0-adb0-307d995be5eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:01.582564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0346b-5c94-44d0-adb0-307d995be5eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:01.586141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0346b-5c94-44d0-adb0-307d995be5eb service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:01.599356 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3050/6110] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:01 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:02.293563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85cc09-b3ab-472c-bd76-43235de0c965 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:02.295850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5a85cc09-b3ab-472c-bd76-43235de0c965 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:02.475448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85cc09-b3ab-472c-bd76-43235de0c965 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:02.501780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0560f4-988e-4037-88b2-fb4091046b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:02.505892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0560f4-988e-4037-88b2-fb4091046b1a service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:02.508958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0560f4-988e-4037-88b2-fb4091046b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:02.509395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0560f4-988e-4037-88b2-fb4091046b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:02.535696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7b0560f4-988e-4037-88b2-fb4091046b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:02.785044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0560f4-988e-4037-88b2-fb4091046b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:02.787924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0560f4-988e-4037-88b2-fb4091046b1a service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:02.824215 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3061/6111] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:02 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:05.359196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0346b-5c94-44d0-adb0-307d995be5eb service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:05.565961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0346b-5c94-44d0-adb0-307d995be5eb service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:05.592820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:05.598829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:05.599232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:05.599619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] PATH_INFO: `/v3/users/7fd08bde9a52432abf2e0646b2fdf65a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:05.603477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd08bde9a52432abf2e0646b2fdf65a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:05.609213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:05.733646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd08bde9a52432abf2e0646b2fdf65a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:05.735625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd08bde9a52432abf2e0646b2fdf65a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:05.753202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd08bde9a52432abf2e0646b2fdf65a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:05.755926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd08bde9a52432abf2e0646b2fdf65a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:05.771286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd08bde9a52432abf2e0646b2fdf65a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:05.808361 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3051/6112] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:05 2021] DELETE /identity/v3/users/7fd08bde9a52432abf2e0646b2fdf65a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:05.813400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bb7b2-dc2c-4ee6-9954-e97e2383e809 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:05.813929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bb7b2-dc2c-4ee6-9954-e97e2383e809 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:05.814007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bb7b2-dc2c-4ee6-9954-e97e2383e809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:05.867948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7f5bb7b2-dc2c-4ee6-9954-e97e2383e809 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:05.871844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7f5bb7b2-dc2c-4ee6-9954-e97e2383e809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:06.065802 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3062/6113] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:06.145576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:06.147879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:06.292229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cd69c-c6fa-4991-9f15-f400116c09af admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:06.300048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792f771-dfd1-4433-b7bf-45ceedf1578c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:06.301709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792f771-dfd1-4433-b7bf-45ceedf1578c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:06.302187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792f771-dfd1-4433-b7bf-45ceedf1578c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:06.302650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792f771-dfd1-4433-b7bf-45ceedf1578c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:06.319245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792f771-dfd1-4433-b7bf-45ceedf1578c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:06.322327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792f771-dfd1-4433-b7bf-45ceedf1578c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:06.340637 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3052/6114] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:07.273449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004385c-7ac6-4455-8036-c74db8ee4627 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:07.275317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004385c-7ac6-4455-8036-c74db8ee4627 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:07.275803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004385c-7ac6-4455-8036-c74db8ee4627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:07.405603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d004385c-7ac6-4455-8036-c74db8ee4627 None None] MFA Rules not processed for user `67ee436ffe774a1eb71cdb910112c7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:07.406846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d004385c-7ac6-4455-8036-c74db8ee4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:07.652183 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3063/6115] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:07 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:07.965993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792f771-dfd1-4433-b7bf-45ceedf1578c service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:07.967514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b792f771-dfd1-4433-b7bf-45ceedf1578c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:07.989633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792f771-dfd1-4433-b7bf-45ceedf1578c service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:08.006025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:08.007340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:08.007808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:08.008743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] PATH_INFO: `/v3/projects/519faaaead914dc8b55c6a4251bb8c46` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:08.013205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=519faaaead914dc8b55c6a4251bb8c46)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:08.016256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:08.026263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004385c-7ac6-4455-8036-c74db8ee4627 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:08.027963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d004385c-7ac6-4455-8036-c74db8ee4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:08.128271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519faaaead914dc8b55c6a4251bb8c46', 'request_id': 'req-0f3fec5b-1392-4162-9535-2ccfcef79689'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:08.139396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519faaaead914dc8b55c6a4251bb8c46', 'request_id': 'req-0f3fec5b-1392-4162-9535-2ccfcef79689'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:08.159810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519faaaead914dc8b55c6a4251bb8c46', 'request_id': 'req-0f3fec5b-1392-4162-9535-2ccfcef79689'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:08.189093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] The token cache is being invalidate because project 519faaaead914dc8b55c6a4251bb8c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:08.189922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:08.192300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:08.201625 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3053/6116] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:07 2021] DELETE /identity/v3/projects/519faaaead914dc8b55c6a4251bb8c46 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:08.203343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:08.207352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:08.244702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004385c-7ac6-4455-8036-c74db8ee4627 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:08.384560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fec5b-1392-4162-9535-2ccfcef79689 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:08.402518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:08.404185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:08.405862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:08.406314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] PATH_INFO: `/v3/users/8418d041417b4673a7771b1009a0514e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:08.411170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8418d041417b4673a7771b1009a0514e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:08.414905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d7f19-826d-423f-a009-8b75b64bbf42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:08.416527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d7f19-826d-423f-a009-8b75b64bbf42 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:08.417353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d7f19-826d-423f-a009-8b75b64bbf42 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:08.417508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:08.418276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d7f19-826d-423f-a009-8b75b64bbf42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:08.420553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-aa5d7f19-826d-423f-a009-8b75b64bbf42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:08.543442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8418d041417b4673a7771b1009a0514e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:08.544564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8418d041417b4673a7771b1009a0514e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:08.550451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d7f19-826d-423f-a009-8b75b64bbf42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:08.553248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d7f19-826d-423f-a009-8b75b64bbf42 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:08.558506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8418d041417b4673a7771b1009a0514e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:08.561317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8418d041417b4673a7771b1009a0514e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:08.578301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8418d041417b4673a7771b1009a0514e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:08.578617 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3064/6117] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:08 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:05:08.613166 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3054/6118] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:08 2021] DELETE /identity/v3/users/8418d041417b4673a7771b1009a0514e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:09.837693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d7f19-826d-423f-a009-8b75b64bbf42 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:09.850250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d7f19-826d-423f-a009-8b75b64bbf42 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:09.995092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:09.996429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:09.997054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:09.997721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] PATH_INFO: `/v3/projects/7acd0fac80f6402abdf7dc84df4f66b6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:10.001960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:10.004176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:10.011433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7acd0fac80f6402abdf7dc84df4f66b6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:10.017786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:10.175398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7acd0fac80f6402abdf7dc84df4f66b6', 'request_id': 'req-5bb5b4ab-758b-4439-ae1a-5d237403569a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:10.188845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e23a8-6274-4d9c-9841-76913247bf4f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:10.194157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7acd0fac80f6402abdf7dc84df4f66b6', 'request_id': 'req-5bb5b4ab-758b-4439-ae1a-5d237403569a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:10.207899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7acd0fac80f6402abdf7dc84df4f66b6', 'request_id': 'req-5bb5b4ab-758b-4439-ae1a-5d237403569a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:10.239027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] The token cache is being invalidate because project 7acd0fac80f6402abdf7dc84df4f66b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:10.240232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:10.243799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:10.248966 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3065/6119] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:09 2021] DELETE /identity/v3/projects/7acd0fac80f6402abdf7dc84df4f66b6 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:10.253588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:10.263001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:10.288893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0d571-6cf3-4e75-95a4-37fd55b2be04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:10.290460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0d571-6cf3-4e75-95a4-37fd55b2be04 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:10.291625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0d571-6cf3-4e75-95a4-37fd55b2be04 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:10.292474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0d571-6cf3-4e75-95a4-37fd55b2be04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:10.299808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b7a0d571-6cf3-4e75-95a4-37fd55b2be04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:10.348025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5b4ab-758b-4439-ae1a-5d237403569a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:10.361725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94c73b-0ba0-489c-8c19-ef65ddcdadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:10.363695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94c73b-0ba0-489c-8c19-ef65ddcdadc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:10.365586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94c73b-0ba0-489c-8c19-ef65ddcdadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:10.365875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94c73b-0ba0-489c-8c19-ef65ddcdadc6 admin admin] PATH_INFO: `/v3/users/54203fe102594f319506ce4c05f3686e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:10.368045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94c73b-0ba0-489c-8c19-ef65ddcdadc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54203fe102594f319506ce4c05f3686e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:10.372964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94c73b-0ba0-489c-8c19-ef65ddcdadc6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:10.477377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0d571-6cf3-4e75-95a4-37fd55b2be04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:10.479206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0d571-6cf3-4e75-95a4-37fd55b2be04 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:10.500689 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3055/6120] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:05:10.541694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be94c73b-0ba0-489c-8c19-ef65ddcdadc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54203fe102594f319506ce4c05f3686e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:10.563820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be94c73b-0ba0-489c-8c19-ef65ddcdadc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54203fe102594f319506ce4c05f3686e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:10.564658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be94c73b-0ba0-489c-8c19-ef65ddcdadc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54203fe102594f319506ce4c05f3686e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:10.577938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be94c73b-0ba0-489c-8c19-ef65ddcdadc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54203fe102594f319506ce4c05f3686e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:10.600517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be94c73b-0ba0-489c-8c19-ef65ddcdadc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54203fe102594f319506ce4c05f3686e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:10.610644 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3066/6121] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:10 2021] DELETE /identity/v3/users/54203fe102594f319506ce4c05f3686e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:12.339932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0d571-6cf3-4e75-95a4-37fd55b2be04 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:12.356026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0d571-6cf3-4e75-95a4-37fd55b2be04 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:12.474462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:12.475609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:12.476039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:12.476997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] PATH_INFO: `/v3/projects/47de28c147a747e1bee9a85cfcc810f8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:12.479846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47de28c147a747e1bee9a85cfcc810f8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:12.482459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:12.553286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47de28c147a747e1bee9a85cfcc810f8', 'request_id': 'req-faf725ef-7210-4c95-9bf5-3551bc7a8398'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:12.566613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47de28c147a747e1bee9a85cfcc810f8', 'request_id': 'req-faf725ef-7210-4c95-9bf5-3551bc7a8398'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:12.576771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47de28c147a747e1bee9a85cfcc810f8', 'request_id': 'req-faf725ef-7210-4c95-9bf5-3551bc7a8398'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:12.590235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] The token cache is being invalidate because project 47de28c147a747e1bee9a85cfcc810f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:12.590526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:12.591390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-faf725ef-7210-4c95-9bf5-3551bc7a8398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:12.593540 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3056/6122] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:12 2021] DELETE /identity/v3/projects/47de28c147a747e1bee9a85cfcc810f8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:12.599959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f7b1c-5aff-4e69-97a3-6fd066d8167d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:12.600456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f7b1c-5aff-4e69-97a3-6fd066d8167d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:12.600652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f7b1c-5aff-4e69-97a3-6fd066d8167d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:12.625982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cb9f7b1c-5aff-4e69-97a3-6fd066d8167d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:12.627351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cb9f7b1c-5aff-4e69-97a3-6fd066d8167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:12.712399 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3067/6123] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:12.722343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fcbab-1bca-4bc9-ae56-11323a0aa4ea None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:12.725114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fcbab-1bca-4bc9-ae56-11323a0aa4ea None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:12.725635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fcbab-1bca-4bc9-ae56-11323a0aa4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:12.749937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4d9fcbab-1bca-4bc9-ae56-11323a0aa4ea None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:12.751523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4d9fcbab-1bca-4bc9-ae56-11323a0aa4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:12.772812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f7b1c-5aff-4e69-97a3-6fd066d8167d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:12.779373 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3057/6124] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:12.797212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f7b1c-5aff-4e69-97a3-6fd066d8167d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:12.818303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa679ce6-e7c2-43cc-a9da-ac4b5a8133b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:12.819213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa679ce6-e7c2-43cc-a9da-ac4b5a8133b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:12.819809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa679ce6-e7c2-43cc-a9da-ac4b5a8133b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:12.820766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa679ce6-e7c2-43cc-a9da-ac4b5a8133b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:12.822480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa679ce6-e7c2-43cc-a9da-ac4b5a8133b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:12.822938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa679ce6-e7c2-43cc-a9da-ac4b5a8133b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:12.828960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa679ce6-e7c2-43cc-a9da-ac4b5a8133b6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:12.853336 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3068/6125] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:12.858427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fcbab-1bca-4bc9-ae56-11323a0aa4ea None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:12.873569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fcbab-1bca-4bc9-ae56-11323a0aa4ea None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:12.885548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d938d-6f4a-4510-b5e4-229cecb2589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:12.887977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d938d-6f4a-4510-b5e4-229cecb2589e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:12.888386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d938d-6f4a-4510-b5e4-229cecb2589e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:12.889090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d938d-6f4a-4510-b5e4-229cecb2589e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:12.889629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d938d-6f4a-4510-b5e4-229cecb2589e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:12.895711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d938d-6f4a-4510-b5e4-229cecb2589e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:12.955537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa679ce6-e7c2-43cc-a9da-ac4b5a8133b6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:12.961814 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3058/6126] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:12 2021] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:12.968207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa679ce6-e7c2-43cc-a9da-ac4b5a8133b6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:13.116276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ba165-df8e-4328-b848-c24fac8eeef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:13.117270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ba165-df8e-4328-b848-c24fac8eeef7 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:13.117693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ba165-df8e-4328-b848-c24fac8eeef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:13.118344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ba165-df8e-4328-b848-c24fac8eeef7 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:13.118890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ba165-df8e-4328-b848-c24fac8eeef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:13.121676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ba165-df8e-4328-b848-c24fac8eeef7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:13.172954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d938d-6f4a-4510-b5e4-229cecb2589e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:13.185784 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3069/6127] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:12 2021] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:13.188657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d938d-6f4a-4510-b5e4-229cecb2589e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:13.198372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39bb87-27b6-41a9-aa73-a1640e3d74bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:13.200702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39bb87-27b6-41a9-aa73-a1640e3d74bc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:13.201088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39bb87-27b6-41a9-aa73-a1640e3d74bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:13.201465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39bb87-27b6-41a9-aa73-a1640e3d74bc admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:13.203577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39bb87-27b6-41a9-aa73-a1640e3d74bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:13.209945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39bb87-27b6-41a9-aa73-a1640e3d74bc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:13.231809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ba165-df8e-4328-b848-c24fac8eeef7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:13.232429 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3059/6128] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:13 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:13.245168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ba165-df8e-4328-b848-c24fac8eeef7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:13.255499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ad84e-6290-4ed8-9aa0-ab81812d0de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:13.255964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ad84e-6290-4ed8-9aa0-ab81812d0de7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:13.256353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ad84e-6290-4ed8-9aa0-ab81812d0de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:13.256949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ad84e-6290-4ed8-9aa0-ab81812d0de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:13.258305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ad84e-6290-4ed8-9aa0-ab81812d0de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:13.261521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ad84e-6290-4ed8-9aa0-ab81812d0de7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:13.280651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39bb87-27b6-41a9-aa73-a1640e3d74bc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:13.292435 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3070/6129] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:13 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:13.294614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39bb87-27b6-41a9-aa73-a1640e3d74bc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:13.303021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32ce2-dbe2-40b5-a140-6991a508dfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:13.304111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32ce2-dbe2-40b5-a140-6991a508dfe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:13.304618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32ce2-dbe2-40b5-a140-6991a508dfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:13.304974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32ce2-dbe2-40b5-a140-6991a508dfe8 admin admin] PATH_INFO: `/v3/projects/ed8c6529d50a4da58d691684a58f3787/users/610a935385384f64b6ed518478019711/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:13.327321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c32ce2-dbe2-40b5-a140-6991a508dfe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8c6529d50a4da58d691684a58f3787, user_id=610a935385384f64b6ed518478019711, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:13.330987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c32ce2-dbe2-40b5-a140-6991a508dfe8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:13.359579 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3060/6130] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:13 2021] PUT /identity/v3/projects/ed8c6529d50a4da58d691684a58f3787/users/610a935385384f64b6ed518478019711/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:13.366765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6dec-e507-49aa-bc23-504a94082e5f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:13.366993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6dec-e507-49aa-bc23-504a94082e5f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:13.367380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b6dec-e507-49aa-bc23-504a94082e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:13.401216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fe6b6dec-e507-49aa-bc23-504a94082e5f None None] MFA Rules not processed for user `610a935385384f64b6ed518478019711`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:13.402260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fe6b6dec-e507-49aa-bc23-504a94082e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:13.534571 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3071/6131] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:13 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:13.549889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32ce2-dbe2-40b5-a140-6991a508dfe8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:13.552559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-41c32ce2-dbe2-40b5-a140-6991a508dfe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:13.654816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c32ce2-dbe2-40b5-a140-6991a508dfe8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:13.659388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59b0b3-3b68-453f-9679-c17754cccae4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:13.660137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59b0b3-3b68-453f-9679-c17754cccae4 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:13.660429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59b0b3-3b68-453f-9679-c17754cccae4 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:13.660757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59b0b3-3b68-453f-9679-c17754cccae4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:13.677395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59b0b3-3b68-453f-9679-c17754cccae4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:13.679660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59b0b3-3b68-453f-9679-c17754cccae4 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:13.693135 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3061/6132] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:13 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:14.279234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b6dec-e507-49aa-bc23-504a94082e5f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:14.280813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fe6b6dec-e507-49aa-bc23-504a94082e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:14.421929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b6dec-e507-49aa-bc23-504a94082e5f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:14.433422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1b951-cae0-42d2-8744-054b3b9cbcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:14.438797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b951-cae0-42d2-8744-054b3b9cbcef admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:14.442632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b951-cae0-42d2-8744-054b3b9cbcef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:14.446518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b951-cae0-42d2-8744-054b3b9cbcef admin admin] PATH_INFO: `/v3/users/9a60782e0d8945c2b99dac616fda491d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:14.450205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1b951-cae0-42d2-8744-054b3b9cbcef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a60782e0d8945c2b99dac616fda491d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:14.453541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1b951-cae0-42d2-8744-054b3b9cbcef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:14.482420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d275d-1049-473a-871f-533411ff186d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:14.482952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d275d-1049-473a-871f-533411ff186d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:14.482952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d275d-1049-473a-871f-533411ff186d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:14.526017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-244d275d-1049-473a-871f-533411ff186d None None] MFA Rules not processed for user `67ee436ffe774a1eb71cdb910112c7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:14.529382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-244d275d-1049-473a-871f-533411ff186d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:14.605492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ee1b951-cae0-42d2-8744-054b3b9cbcef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a60782e0d8945c2b99dac616fda491d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:14.624119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ee1b951-cae0-42d2-8744-054b3b9cbcef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a60782e0d8945c2b99dac616fda491d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:14.625547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ee1b951-cae0-42d2-8744-054b3b9cbcef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a60782e0d8945c2b99dac616fda491d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:14.678396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ee1b951-cae0-42d2-8744-054b3b9cbcef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a60782e0d8945c2b99dac616fda491d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:14.702126 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3062/6133] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:14 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:14.731300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7ee1b951-cae0-42d2-8744-054b3b9cbcef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a60782e0d8945c2b99dac616fda491d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:14.760254 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3072/6134] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:14 2021] DELETE /identity/v3/users/9a60782e0d8945c2b99dac616fda491d => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:15.708456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d275d-1049-473a-871f-533411ff186d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:15.709973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-244d275d-1049-473a-871f-533411ff186d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:15.739041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d275d-1049-473a-871f-533411ff186d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:15.875869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:15.876742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:15.877350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:15.877836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] PATH_INFO: `/v3/projects/85c58aa2d3dd4e09a26b5265084b8493` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:15.879518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c58aa2d3dd4e09a26b5265084b8493)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:15.882212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:15.986856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c58aa2d3dd4e09a26b5265084b8493', 'request_id': 'req-3d496642-31ce-4448-a87a-264c323455b5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:16.006838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c58aa2d3dd4e09a26b5265084b8493', 'request_id': 'req-3d496642-31ce-4448-a87a-264c323455b5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:16.022232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c58aa2d3dd4e09a26b5265084b8493', 'request_id': 'req-3d496642-31ce-4448-a87a-264c323455b5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:16.047828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] The token cache is being invalidate because project 85c58aa2d3dd4e09a26b5265084b8493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:16.048124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:16.050791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3d496642-31ce-4448-a87a-264c323455b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:16.062239 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3063/6135] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:15 2021] DELETE /identity/v3/projects/85c58aa2d3dd4e09a26b5265084b8493 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:16.063971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316735-119e-4bdd-8a76-e9b3cf228022 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:16.064447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316735-119e-4bdd-8a76-e9b3cf228022 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:16.064542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316735-119e-4bdd-8a76-e9b3cf228022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:16.122001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4f316735-119e-4bdd-8a76-e9b3cf228022 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:16.128495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4f316735-119e-4bdd-8a76-e9b3cf228022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:16.286474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0303e9-8be6-41e7-b5b0-e23c145b867f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:16.286795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0303e9-8be6-41e7-b5b0-e23c145b867f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:16.287103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0303e9-8be6-41e7-b5b0-e23c145b867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:16.291051 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3073/6136] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:16.322649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1a0303e9-8be6-41e7-b5b0-e23c145b867f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:16.324297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1a0303e9-8be6-41e7-b5b0-e23c145b867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:16.338738 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3064/6137] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:16.340237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f316735-119e-4bdd-8a76-e9b3cf228022 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:16.351767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f316735-119e-4bdd-8a76-e9b3cf228022 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:16.359016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc3573-d97a-43cc-8251-ab0d33c9e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:16.359970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc3573-d97a-43cc-8251-ab0d33c9e18a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:16.360258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc3573-d97a-43cc-8251-ab0d33c9e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:16.360536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc3573-d97a-43cc-8251-ab0d33c9e18a admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:16.361288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc3573-d97a-43cc-8251-ab0d33c9e18a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:16.361593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc3573-d97a-43cc-8251-ab0d33c9e18a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:16.364080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc3573-d97a-43cc-8251-ab0d33c9e18a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:16.385586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0303e9-8be6-41e7-b5b0-e23c145b867f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:16.392435 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3074/6138] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:16.398323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0303e9-8be6-41e7-b5b0-e23c145b867f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:16.404806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbc20a-aa60-4524-bf1f-2cb3ac8b94f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:16.405483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbc20a-aa60-4524-bf1f-2cb3ac8b94f6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:16.405797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbc20a-aa60-4524-bf1f-2cb3ac8b94f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:16.406259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbc20a-aa60-4524-bf1f-2cb3ac8b94f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:16.406985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbc20a-aa60-4524-bf1f-2cb3ac8b94f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:16.409176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbc20a-aa60-4524-bf1f-2cb3ac8b94f6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:16.451217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc3573-d97a-43cc-8251-ab0d33c9e18a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:16.452863 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3065/6139] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:16 2021] POST /identity/v3/projects => generated 361 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:16.467389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc3573-d97a-43cc-8251-ab0d33c9e18a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:16.631177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbb130-5c04-4ae7-8f66-4afc13399534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:16.632685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb130-5c04-4ae7-8f66-4afc13399534 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:16.633085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb130-5c04-4ae7-8f66-4afc13399534 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:16.633442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb130-5c04-4ae7-8f66-4afc13399534 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:16.634530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbb130-5c04-4ae7-8f66-4afc13399534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:16.636604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbb130-5c04-4ae7-8f66-4afc13399534 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:16.663598 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3075/6140] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:16 2021] POST /identity/v3/users => generated 281 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:16.667826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbc20a-aa60-4524-bf1f-2cb3ac8b94f6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:16.684522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbc20a-aa60-4524-bf1f-2cb3ac8b94f6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:16.710272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd582e0e-3388-44c6-97cc-c39a9de3da88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:16.712118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd582e0e-3388-44c6-97cc-c39a9de3da88 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:16.712586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd582e0e-3388-44c6-97cc-c39a9de3da88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:16.713662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd582e0e-3388-44c6-97cc-c39a9de3da88 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:16.715020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd582e0e-3388-44c6-97cc-c39a9de3da88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:16.717975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd582e0e-3388-44c6-97cc-c39a9de3da88 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:16.736644 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3066/6141] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:16 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:16.737855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbb130-5c04-4ae7-8f66-4afc13399534 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:16.763319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbb130-5c04-4ae7-8f66-4afc13399534 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:16.769903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e62d8-b215-4557-bbd3-aa4b6ca4d188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:16.770621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e62d8-b215-4557-bbd3-aa4b6ca4d188 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:16.774727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e62d8-b215-4557-bbd3-aa4b6ca4d188 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:16.775204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e62d8-b215-4557-bbd3-aa4b6ca4d188 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:16.776454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e62d8-b215-4557-bbd3-aa4b6ca4d188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:16.778183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357e62d8-b215-4557-bbd3-aa4b6ca4d188 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:16.791309 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3076/6142] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:16 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:16.794429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd582e0e-3388-44c6-97cc-c39a9de3da88 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:16.807987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd582e0e-3388-44c6-97cc-c39a9de3da88 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:16.814463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29fa6d-7c3b-48e2-bf34-14c798933f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:16.815832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29fa6d-7c3b-48e2-bf34-14c798933f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:16.816374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29fa6d-7c3b-48e2-bf34-14c798933f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:16.816865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29fa6d-7c3b-48e2-bf34-14c798933f21 admin admin] PATH_INFO: `/v3/projects/a607d8ff0b0949bfab4174f042cb691a/users/7199ef0c5a004b2c8b1c9fde106fb62e/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:16.837335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29fa6d-7c3b-48e2-bf34-14c798933f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a607d8ff0b0949bfab4174f042cb691a, user_id=7199ef0c5a004b2c8b1c9fde106fb62e, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:16.843969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29fa6d-7c3b-48e2-bf34-14c798933f21 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:16.871512 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3067/6143] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:16 2021] PUT /identity/v3/projects/a607d8ff0b0949bfab4174f042cb691a/users/7199ef0c5a004b2c8b1c9fde106fb62e/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:16.882525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c6e84-79b1-4fef-a7b9-032e97e2e344 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:16.883056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c6e84-79b1-4fef-a7b9-032e97e2e344 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:16.883693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c6e84-79b1-4fef-a7b9-032e97e2e344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:16.934298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-559c6e84-79b1-4fef-a7b9-032e97e2e344 None None] MFA Rules not processed for user `7199ef0c5a004b2c8b1c9fde106fb62e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:16.935488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-559c6e84-79b1-4fef-a7b9-032e97e2e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:17.117710 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3077/6144] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:16 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:17.168250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29fa6d-7c3b-48e2-bf34-14c798933f21 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:17.329950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29fa6d-7c3b-48e2-bf34-14c798933f21 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:17.357628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:17.359209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:17.359958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:17.360398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] PATH_INFO: `/v3/users/7199ef0c5a004b2c8b1c9fde106fb62e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:17.361875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7199ef0c5a004b2c8b1c9fde106fb62e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:17.364052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:17.516132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7199ef0c5a004b2c8b1c9fde106fb62e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:17.517403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7199ef0c5a004b2c8b1c9fde106fb62e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:17.554745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7199ef0c5a004b2c8b1c9fde106fb62e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:17.556728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7199ef0c5a004b2c8b1c9fde106fb62e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:17.576435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7199ef0c5a004b2c8b1c9fde106fb62e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:17.655645 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3068/6145] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:17 2021] DELETE /identity/v3/users/7199ef0c5a004b2c8b1c9fde106fb62e => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:17.661929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37848db-36fa-4b88-bd3a-d3b9bbab6b25 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:17.662536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37848db-36fa-4b88-bd3a-d3b9bbab6b25 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:17.662885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37848db-36fa-4b88-bd3a-d3b9bbab6b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:17.711296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b37848db-36fa-4b88-bd3a-d3b9bbab6b25 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:17.715900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b37848db-36fa-4b88-bd3a-d3b9bbab6b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:17.873744 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3078/6146] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:17.923321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:17.925695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:18.050468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4a54a-f776-4d6d-924e-8838ed4fdb25 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:18.056071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ae560-fd90-4265-b950-7b8486cabee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:18.057219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ae560-fd90-4265-b950-7b8486cabee5 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:18.060701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ae560-fd90-4265-b950-7b8486cabee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:18.062245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ae560-fd90-4265-b950-7b8486cabee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:18.083772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ae560-fd90-4265-b950-7b8486cabee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:18.085366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ae560-fd90-4265-b950-7b8486cabee5 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:18.114934 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3069/6147] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:19.167522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37848db-36fa-4b88-bd3a-d3b9bbab6b25 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:19.169179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b37848db-36fa-4b88-bd3a-d3b9bbab6b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:19.185273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37848db-36fa-4b88-bd3a-d3b9bbab6b25 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:19.196579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:19.197558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:19.197847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:19.198245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] PATH_INFO: `/v3/projects/a607d8ff0b0949bfab4174f042cb691a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:19.203401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a607d8ff0b0949bfab4174f042cb691a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:19.207480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:19.296396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a607d8ff0b0949bfab4174f042cb691a', 'request_id': 'req-89e2dcf0-352e-47de-bce5-d471280eeee2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:19.311851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a607d8ff0b0949bfab4174f042cb691a', 'request_id': 'req-89e2dcf0-352e-47de-bce5-d471280eeee2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:19.322076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a607d8ff0b0949bfab4174f042cb691a', 'request_id': 'req-89e2dcf0-352e-47de-bce5-d471280eeee2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:19.337074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] The token cache is being invalidate because project a607d8ff0b0949bfab4174f042cb691a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:19.338335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:19.341441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-89e2dcf0-352e-47de-bce5-d471280eeee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:19.346109 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3079/6148] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:19 2021] DELETE /identity/v3/projects/a607d8ff0b0949bfab4174f042cb691a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:19.354895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7184d3b-d83f-4381-8907-241fe9b5d9c4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:19.355747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7184d3b-d83f-4381-8907-241fe9b5d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:19.356252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7184d3b-d83f-4381-8907-241fe9b5d9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:19.377922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f7184d3b-d83f-4381-8907-241fe9b5d9c4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:19.379446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f7184d3b-d83f-4381-8907-241fe9b5d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:19.496276 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3070/6149] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:19.507575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59ad64-8009-4bf6-bf5b-92a080015cf5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:19.507868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59ad64-8009-4bf6-bf5b-92a080015cf5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:19.508140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59ad64-8009-4bf6-bf5b-92a080015cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:19.531879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cc59ad64-8009-4bf6-bf5b-92a080015cf5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:19.533169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cc59ad64-8009-4bf6-bf5b-92a080015cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:19.547611 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3080/6150] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:19.552182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7184d3b-d83f-4381-8907-241fe9b5d9c4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:19.564037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7184d3b-d83f-4381-8907-241fe9b5d9c4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:19.585736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238f60f-7846-4214-9af4-221095b034a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:19.587128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238f60f-7846-4214-9af4-221095b034a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:19.590482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59ad64-8009-4bf6-bf5b-92a080015cf5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:19.591322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238f60f-7846-4214-9af4-221095b034a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:19.591725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238f60f-7846-4214-9af4-221095b034a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:19.591973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cc59ad64-8009-4bf6-bf5b-92a080015cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:19.592843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238f60f-7846-4214-9af4-221095b034a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:19.593262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238f60f-7846-4214-9af4-221095b034a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:19.595280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238f60f-7846-4214-9af4-221095b034a6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:19.611201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59ad64-8009-4bf6-bf5b-92a080015cf5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:19.612610 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3071/6151] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:19.618456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238f60f-7846-4214-9af4-221095b034a6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:19.619175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dc64b-5346-4eb6-83fe-ad2f651dd7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:19.620859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dc64b-5346-4eb6-83fe-ad2f651dd7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:19.621837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dc64b-5346-4eb6-83fe-ad2f651dd7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:19.622733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dc64b-5346-4eb6-83fe-ad2f651dd7c9 admin admin] PATH_INFO: `/v3/users/610a935385384f64b6ed518478019711` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:19.626350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dc64b-5346-4eb6-83fe-ad2f651dd7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=610a935385384f64b6ed518478019711)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:19.629479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dc64b-5346-4eb6-83fe-ad2f651dd7c9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:19.633240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238f60f-7846-4214-9af4-221095b034a6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:19.638350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823cf7e-cc6b-407b-8340-3ea572d24fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:19.639285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823cf7e-cc6b-407b-8340-3ea572d24fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:19.640440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823cf7e-cc6b-407b-8340-3ea572d24fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:19.641818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823cf7e-cc6b-407b-8340-3ea572d24fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:19.642746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823cf7e-cc6b-407b-8340-3ea572d24fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:19.646054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823cf7e-cc6b-407b-8340-3ea572d24fe3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:19.690340 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3072/6152] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:19 2021] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:19.696943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823cf7e-cc6b-407b-8340-3ea572d24fe3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:19.703475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a75dc64b-5346-4eb6-83fe-ad2f651dd7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610a935385384f64b6ed518478019711'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:19.718190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a75dc64b-5346-4eb6-83fe-ad2f651dd7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610a935385384f64b6ed518478019711'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:19.719979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a75dc64b-5346-4eb6-83fe-ad2f651dd7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610a935385384f64b6ed518478019711'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:19.739955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a75dc64b-5346-4eb6-83fe-ad2f651dd7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610a935385384f64b6ed518478019711'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:19.760667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a75dc64b-5346-4eb6-83fe-ad2f651dd7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610a935385384f64b6ed518478019711'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:19.773486 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3081/6153] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:19 2021] DELETE /identity/v3/users/610a935385384f64b6ed518478019711 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:19.778825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb54f4-c3a2-4484-a1aa-d867bcf9f43a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:19.779857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb54f4-c3a2-4484-a1aa-d867bcf9f43a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:19.781307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb54f4-c3a2-4484-a1aa-d867bcf9f43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:19.794937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823cf7e-cc6b-407b-8340-3ea572d24fe3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:19.824583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a9eb54f4-c3a2-4484-a1aa-d867bcf9f43a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:19.826563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a9eb54f4-c3a2-4484-a1aa-d867bcf9f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:19.888725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cf67e-1941-4c28-a032-52af203cbd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:19.889969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf67e-1941-4c28-a032-52af203cbd33 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:19.890756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf67e-1941-4c28-a032-52af203cbd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:19.891131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf67e-1941-4c28-a032-52af203cbd33 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:19.893221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cf67e-1941-4c28-a032-52af203cbd33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:19.898255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cf67e-1941-4c28-a032-52af203cbd33 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:19.937115 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3082/6155] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:19.937300 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3073/6155] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:19 2021] POST /identity/v3/users => generated 284 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:19.938674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb54f4-c3a2-4484-a1aa-d867bcf9f43a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:19.940055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a9eb54f4-c3a2-4484-a1aa-d867bcf9f43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:19.955304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb54f4-c3a2-4484-a1aa-d867bcf9f43a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:19.956687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cf67e-1941-4c28-a032-52af203cbd33 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:19.959228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec8cf67e-1941-4c28-a032-52af203cbd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:19.961622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92799c25-955f-4059-9cb2-2200b045bd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:19.962416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799c25-955f-4059-9cb2-2200b045bd6e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:19.962750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799c25-955f-4059-9cb2-2200b045bd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:19.963031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92799c25-955f-4059-9cb2-2200b045bd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:19.964213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92799c25-955f-4059-9cb2-2200b045bd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:19.968107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92799c25-955f-4059-9cb2-2200b045bd6e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:19.984974 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3083/6156] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:19 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:19.986517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92799c25-955f-4059-9cb2-2200b045bd6e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:20.004864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92799c25-955f-4059-9cb2-2200b045bd6e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:20.011104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266e62f-21f1-4d6f-91fd-fe89d2e91332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:20.012707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266e62f-21f1-4d6f-91fd-fe89d2e91332 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:20.013707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266e62f-21f1-4d6f-91fd-fe89d2e91332 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:20.013910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266e62f-21f1-4d6f-91fd-fe89d2e91332 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:20.014808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266e62f-21f1-4d6f-91fd-fe89d2e91332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:20.016686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266e62f-21f1-4d6f-91fd-fe89d2e91332 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:20.039883 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3084/6157] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:19 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:20.043285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266e62f-21f1-4d6f-91fd-fe89d2e91332 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:20.057032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266e62f-21f1-4d6f-91fd-fe89d2e91332 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:20.063229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095ea4d-3e8c-4eba-af81-fab7c2eea107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:20.064487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095ea4d-3e8c-4eba-af81-fab7c2eea107 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:20.065248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095ea4d-3e8c-4eba-af81-fab7c2eea107 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:20.065674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095ea4d-3e8c-4eba-af81-fab7c2eea107 admin admin] PATH_INFO: `/v3/projects/29050c1a174a40f08424688125357adc/users/c8346709abb542d9a01ca7c4c4ddeec2/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:20.083273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095ea4d-3e8c-4eba-af81-fab7c2eea107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29050c1a174a40f08424688125357adc, user_id=c8346709abb542d9a01ca7c4c4ddeec2, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:20.086749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095ea4d-3e8c-4eba-af81-fab7c2eea107 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:20.096459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cf67e-1941-4c28-a032-52af203cbd33 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:20.107155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a36c0-5796-4f1e-bd1a-86bddac5247a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:20.107846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a36c0-5796-4f1e-bd1a-86bddac5247a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:20.109123 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3085/6158] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:20 2021] PUT /identity/v3/projects/29050c1a174a40f08424688125357adc/users/c8346709abb542d9a01ca7c4c4ddeec2/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:20.111431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a36c0-5796-4f1e-bd1a-86bddac5247a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:20.112382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a36c0-5796-4f1e-bd1a-86bddac5247a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:20.120455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbec4d-ff98-45d6-a4d1-ee27a2c60787 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:20.120743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbec4d-ff98-45d6-a4d1-ee27a2c60787 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:20.121265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbec4d-ff98-45d6-a4d1-ee27a2c60787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:20.140642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a36c0-5796-4f1e-bd1a-86bddac5247a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:20.142122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a36c0-5796-4f1e-bd1a-86bddac5247a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:20.153282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a7fbec4d-ff98-45d6-a4d1-ee27a2c60787 None None] MFA Rules not processed for user `c8346709abb542d9a01ca7c4c4ddeec2`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:20.154664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a7fbec4d-ff98-45d6-a4d1-ee27a2c60787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:20.158019 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3074/6159] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:20.237999 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3086/6160] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:20 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:20.242866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a36c0-5796-4f1e-bd1a-86bddac5247a service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:20.256386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a36c0-5796-4f1e-bd1a-86bddac5247a service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:20.336653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e32a4-f410-459b-b781-7e02e0da1b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:20.338403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e32a4-f410-459b-b781-7e02e0da1b1d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:20.338739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e32a4-f410-459b-b781-7e02e0da1b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:20.339019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e32a4-f410-459b-b781-7e02e0da1b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:20.339870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e32a4-f410-459b-b781-7e02e0da1b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:20.342498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e32a4-f410-459b-b781-7e02e0da1b1d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:20.417464 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3075/6161] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:20 2021] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:20.418103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbec4d-ff98-45d6-a4d1-ee27a2c60787 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:20.431364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbec4d-ff98-45d6-a4d1-ee27a2c60787 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:20.504058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd26346-cf77-4435-aa7e-052ad475ff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:20.504956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd26346-cf77-4435-aa7e-052ad475ff43 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:20.505499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd26346-cf77-4435-aa7e-052ad475ff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:20.506003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd26346-cf77-4435-aa7e-052ad475ff43 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:20.506949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd26346-cf77-4435-aa7e-052ad475ff43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:20.509139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd26346-cf77-4435-aa7e-052ad475ff43 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:20.555556 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3087/6162] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:20 2021] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:20.562984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e32a4-f410-459b-b781-7e02e0da1b1d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:20.582168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e32a4-f410-459b-b781-7e02e0da1b1d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:20.589877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef1138-df26-4033-b24b-cd0f19aa1807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:20.591433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef1138-df26-4033-b24b-cd0f19aa1807 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:20.592176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef1138-df26-4033-b24b-cd0f19aa1807 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:20.592749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef1138-df26-4033-b24b-cd0f19aa1807 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:20.594024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef1138-df26-4033-b24b-cd0f19aa1807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:20.597205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef1138-df26-4033-b24b-cd0f19aa1807 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:20.620444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd26346-cf77-4435-aa7e-052ad475ff43 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:20.620780 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3076/6163] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:20 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:20.633877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd26346-cf77-4435-aa7e-052ad475ff43 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:20.639753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bf881-83b4-4932-b14a-961f1f0043b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:20.640809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf881-83b4-4932-b14a-961f1f0043b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:20.641232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf881-83b4-4932-b14a-961f1f0043b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:20.641521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf881-83b4-4932-b14a-961f1f0043b6 admin admin] PATH_INFO: `/v3/projects/49aefe1786754dccbf9b335949565c4b/users/a500d9e6873e4152b308ef5ad1521dd6/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:20.679441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bf881-83b4-4932-b14a-961f1f0043b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49aefe1786754dccbf9b335949565c4b, user_id=a500d9e6873e4152b308ef5ad1521dd6, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:20.683587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bf881-83b4-4932-b14a-961f1f0043b6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:20.703268 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3088/6164] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:20 2021] PUT /identity/v3/projects/49aefe1786754dccbf9b335949565c4b/users/a500d9e6873e4152b308ef5ad1521dd6/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:20.708808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef1138-df26-4033-b24b-cd0f19aa1807 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:20.721782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef1138-df26-4033-b24b-cd0f19aa1807 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:20.849044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b8914-d8e3-4b46-9eb2-dbd66076250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:20.849782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b8914-d8e3-4b46-9eb2-dbd66076250a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:20.850059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b8914-d8e3-4b46-9eb2-dbd66076250a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:20.850334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b8914-d8e3-4b46-9eb2-dbd66076250a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:20.851075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b8914-d8e3-4b46-9eb2-dbd66076250a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:20.852712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b8914-d8e3-4b46-9eb2-dbd66076250a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:20.865169 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3077/6165] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:20 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:20.869602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bf881-83b4-4932-b14a-961f1f0043b6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:20.883514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bf881-83b4-4932-b14a-961f1f0043b6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:20.890100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1656f-dfe2-4be2-8d39-1513ed1d49b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:20.891081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1656f-dfe2-4be2-8d39-1513ed1d49b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:20.891499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1656f-dfe2-4be2-8d39-1513ed1d49b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:20.891777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1656f-dfe2-4be2-8d39-1513ed1d49b8 admin admin] PATH_INFO: `/v3/projects/49aefe1786754dccbf9b335949565c4b/users/a500d9e6873e4152b308ef5ad1521dd6/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:20.894121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1656f-dfe2-4be2-8d39-1513ed1d49b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49aefe1786754dccbf9b335949565c4b, user_id=a500d9e6873e4152b308ef5ad1521dd6, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:20.897767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1656f-dfe2-4be2-8d39-1513ed1d49b8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:20.913661 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3089/6166] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:20 2021] PUT /identity/v3/projects/49aefe1786754dccbf9b335949565c4b/users/a500d9e6873e4152b308ef5ad1521dd6/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:20.932421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6cdf7-8ffb-45c7-b1aa-cebffc784f58 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:20.932732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6cdf7-8ffb-45c7-b1aa-cebffc784f58 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:20.932971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6cdf7-8ffb-45c7-b1aa-cebffc784f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.003815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3cb6cdf7-8ffb-45c7-b1aa-cebffc784f58 None None] MFA Rules not processed for user `a500d9e6873e4152b308ef5ad1521dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:21.007666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3cb6cdf7-8ffb-45c7-b1aa-cebffc784f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:21.179627 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3078/6167] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:20 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:21.183737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1656f-dfe2-4be2-8d39-1513ed1d49b8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.199471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1656f-dfe2-4be2-8d39-1513ed1d49b8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.204904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf812721-c383-4e8b-9707-fc6673967252 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.205851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf812721-c383-4e8b-9707-fc6673967252 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.206606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf812721-c383-4e8b-9707-fc6673967252 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.207283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf812721-c383-4e8b-9707-fc6673967252 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.209188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf812721-c383-4e8b-9707-fc6673967252 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.212054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf812721-c383-4e8b-9707-fc6673967252 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.235816 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3090/6168] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:21 2021] POST /identity/v3/services => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:21.240699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6cdf7-8ffb-45c7-b1aa-cebffc784f58 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.251694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6cdf7-8ffb-45c7-b1aa-cebffc784f58 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.276075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a2d75-9177-455e-99b6-39fccfafd93d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.276747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a2d75-9177-455e-99b6-39fccfafd93d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.277035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a2d75-9177-455e-99b6-39fccfafd93d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.278508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a2d75-9177-455e-99b6-39fccfafd93d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.279788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a2d75-9177-455e-99b6-39fccfafd93d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.281420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a2d75-9177-455e-99b6-39fccfafd93d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.314563 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-284a2d75-9177-455e-99b6-39fccfafd93d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-779388645. To ensure interoperability, identifiers should be a valid uuid. Nov 27 21:05:21.314563 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 27 21:05:21.314563 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:05:21.352182 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3079/6169] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:05:21 2021] POST /identity/v3/endpoints => generated 359 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:21.356154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf812721-c383-4e8b-9707-fc6673967252 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.367677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf812721-c383-4e8b-9707-fc6673967252 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.396515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cd5ae-e4c1-43dc-a951-d1a96c0697ca tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.397911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cd5ae-e4c1-43dc-a951-d1a96c0697ca tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.398907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cd5ae-e4c1-43dc-a951-d1a96c0697ca tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.399194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cd5ae-e4c1-43dc-a951-d1a96c0697ca tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/regions/tempest-region-779388645` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.399940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cd5ae-e4c1-43dc-a951-d1a96c0697ca tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-779388645)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.401547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cd5ae-e4c1-43dc-a951-d1a96c0697ca tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.409744 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3091/6170] 10.222.0.21 () {58 vars in 1202 bytes} [Sat Nov 27 21:05:21 2021] GET /identity/v3/regions/tempest-region-779388645 => generated 178 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:21.409911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a2d75-9177-455e-99b6-39fccfafd93d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.423029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a2d75-9177-455e-99b6-39fccfafd93d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.428725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6e1dd-18e7-4a65-b718-6684a282e34e tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.429844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6e1dd-18e7-4a65-b718-6684a282e34e tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.431083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6e1dd-18e7-4a65-b718-6684a282e34e tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.431591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6e1dd-18e7-4a65-b718-6684a282e34e tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.432979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6e1dd-18e7-4a65-b718-6684a282e34e tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.435014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6e1dd-18e7-4a65-b718-6684a282e34e tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.463408 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3080/6171] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:21 2021] POST /identity/v3/services => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:21.467544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cd5ae-e4c1-43dc-a951-d1a96c0697ca tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.480722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cd5ae-e4c1-43dc-a951-d1a96c0697ca tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.486434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6e1dd-18e7-4a65-b718-6684a282e34e tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.488488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b1a6e1dd-18e7-4a65-b718-6684a282e34e tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:21.505077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd22b3-cbf3-4a7b-b9fa-cb5f8bdb2aa7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.505749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd22b3-cbf3-4a7b-b9fa-cb5f8bdb2aa7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.506051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd22b3-cbf3-4a7b-b9fa-cb5f8bdb2aa7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.506321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd22b3-cbf3-4a7b-b9fa-cb5f8bdb2aa7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.507576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd22b3-cbf3-4a7b-b9fa-cb5f8bdb2aa7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.509325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd22b3-cbf3-4a7b-b9fa-cb5f8bdb2aa7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.541010 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-d8bd22b3-cbf3-4a7b-b9fa-cb5f8bdb2aa7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1543211557. To ensure interoperability, identifiers should be a valid uuid. Nov 27 21:05:21.541010 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 27 21:05:21.541010 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:21.587914 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3092/6172] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:05:21 2021] POST /identity/v3/endpoints => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:21.589713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd22b3-cbf3-4a7b-b9fa-cb5f8bdb2aa7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.592340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6e1dd-18e7-4a65-b718-6684a282e34e tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.614026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd22b3-cbf3-4a7b-b9fa-cb5f8bdb2aa7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.619190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.621842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959a3e1-ee29-44c7-aa90-6b0ce7f0a5ad tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.622049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.622354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.622796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] PATH_INFO: `/v3/projects/ed8c6529d50a4da58d691684a58f3787` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.623652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a3e1-ee29-44c7-aa90-6b0ce7f0a5ad tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.624112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a3e1-ee29-44c7-aa90-6b0ce7f0a5ad tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.624487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8c6529d50a4da58d691684a58f3787)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.624800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a3e1-ee29-44c7-aa90-6b0ce7f0a5ad tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/regions/tempest-region-1543211557` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.625701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959a3e1-ee29-44c7-aa90-6b0ce7f0a5ad tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1543211557)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.626935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959a3e1-ee29-44c7-aa90-6b0ce7f0a5ad tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.627170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.630174 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3093/6173] 10.222.0.21 () {58 vars in 1205 bytes} [Sat Nov 27 21:05:21 2021] GET /identity/v3/regions/tempest-region-1543211557 => generated 180 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:21.636127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959a3e1-ee29-44c7-aa90-6b0ce7f0a5ad tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.649081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959a3e1-ee29-44c7-aa90-6b0ce7f0a5ad tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.655117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe42ed-b00c-4c8d-9814-dbcfa7223343 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.656259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe42ed-b00c-4c8d-9814-dbcfa7223343 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.656698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe42ed-b00c-4c8d-9814-dbcfa7223343 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.657122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe42ed-b00c-4c8d-9814-dbcfa7223343 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.658091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe42ed-b00c-4c8d-9814-dbcfa7223343 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.660098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe42ed-b00c-4c8d-9814-dbcfa7223343 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.683310 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-1abe42ed-b00c-4c8d-9814-dbcfa7223343 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1166860158. To ensure interoperability, identifiers should be a valid uuid. Nov 27 21:05:21.683310 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 27 21:05:21.683310 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:21.700929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8c6529d50a4da58d691684a58f3787', 'request_id': 'req-ec225107-c97a-4f98-a65e-6b609dac12fb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:21.708850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8c6529d50a4da58d691684a58f3787', 'request_id': 'req-ec225107-c97a-4f98-a65e-6b609dac12fb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:21.717769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8c6529d50a4da58d691684a58f3787', 'request_id': 'req-ec225107-c97a-4f98-a65e-6b609dac12fb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:21.721465 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3094/6174] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:05:21 2021] POST /identity/v3/endpoints => generated 361 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:21.726025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe42ed-b00c-4c8d-9814-dbcfa7223343 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.735970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] The token cache is being invalidate because project ed8c6529d50a4da58d691684a58f3787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:21.736439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:21.737183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ec225107-c97a-4f98-a65e-6b609dac12fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:21.740148 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3081/6175] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:21 2021] DELETE /identity/v3/projects/ed8c6529d50a4da58d691684a58f3787 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:21.745169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1565f-0b54-47e4-9725-9be836ff28da None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.745722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1565f-0b54-47e4-9725-9be836ff28da None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.746355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1565f-0b54-47e4-9725-9be836ff28da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.760864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe42ed-b00c-4c8d-9814-dbcfa7223343 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.768517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e3e1565f-0b54-47e4-9725-9be836ff28da None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:21.769850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e3e1565f-0b54-47e4-9725-9be836ff28da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:21.860637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c0422-6150-41bb-ba7b-9ade10798b90 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.861485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0422-6150-41bb-ba7b-9ade10798b90 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.861903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0422-6150-41bb-ba7b-9ade10798b90 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.862190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0422-6150-41bb-ba7b-9ade10798b90 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/regions/tempest-region-1166860158` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.862989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c0422-6150-41bb-ba7b-9ade10798b90 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1166860158)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.865327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c0422-6150-41bb-ba7b-9ade10798b90 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.868723 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3095/6176] 10.222.0.21 () {58 vars in 1205 bytes} [Sat Nov 27 21:05:21 2021] GET /identity/v3/regions/tempest-region-1166860158 => generated 180 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:05:21.872926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c0422-6150-41bb-ba7b-9ade10798b90 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.881816 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3082/6177] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:21 2021] POST /identity/v3/auth/tokens => generated 4048 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:21.881983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-042c0422-6150-41bb-ba7b-9ade10798b90 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:21.883729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229e58f-54dd-40c2-8342-08ebbdf2ef67 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.884089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229e58f-54dd-40c2-8342-08ebbdf2ef67 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.884444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229e58f-54dd-40c2-8342-08ebbdf2ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.890623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c0422-6150-41bb-ba7b-9ade10798b90 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.898000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09b8ef-807f-4a7a-a111-ccd4bc696158 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.899727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b8ef-807f-4a7a-a111-ccd4bc696158 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.900077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b8ef-807f-4a7a-a111-ccd4bc696158 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.900427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b8ef-807f-4a7a-a111-ccd4bc696158 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.901221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09b8ef-807f-4a7a-a111-ccd4bc696158 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.903860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09b8ef-807f-4a7a-a111-ccd4bc696158 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.907336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e229e58f-54dd-40c2-8342-08ebbdf2ef67 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:21.912810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e229e58f-54dd-40c2-8342-08ebbdf2ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:21.916739 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3096/6178] 10.222.0.21 () {58 vars in 1133 bytes} [Sat Nov 27 21:05:21 2021] GET /identity/v3/endpoints => generated 4387 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:21.920443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09b8ef-807f-4a7a-a111-ccd4bc696158 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.928149 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3083/6179] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:21 2021] POST /identity/v3/auth/tokens => generated 4048 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:21.933639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229e58f-54dd-40c2-8342-08ebbdf2ef67 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.938486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09b8ef-807f-4a7a-a111-ccd4bc696158 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.945996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ced93-a4f9-4d04-8313-e695aa512ccd tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.946968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ced93-a4f9-4d04-8313-e695aa512ccd tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.947091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229e58f-54dd-40c2-8342-08ebbdf2ef67 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.947498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ced93-a4f9-4d04-8313-e695aa512ccd tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.948374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ced93-a4f9-4d04-8313-e695aa512ccd tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints/0a0c9da4c34e408693deb5285652d629` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.952805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06060c6-a5c7-455b-bafc-3fa4d6d4ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.953646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06060c6-a5c7-455b-bafc-3fa4d6d4ee4b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.954261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06060c6-a5c7-455b-bafc-3fa4d6d4ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.954550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06060c6-a5c7-455b-bafc-3fa4d6d4ee4b admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.955426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06060c6-a5c7-455b-bafc-3fa4d6d4ee4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:21.955746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06060c6-a5c7-455b-bafc-3fa4d6d4ee4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.958526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06060c6-a5c7-455b-bafc-3fa4d6d4ee4b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.959119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ced93-a4f9-4d04-8313-e695aa512ccd tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=0a0c9da4c34e408693deb5285652d629)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.960667 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-364ced93-a4f9-4d04-8313-e695aa512ccd tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:21.960667 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:05:21.960667 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:21.961865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ced93-a4f9-4d04-8313-e695aa512ccd tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:21.965677 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3097/6180] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:21 2021] GET /identity/v3/endpoints/0a0c9da4c34e408693deb5285652d629 => generated 361 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:05:21.969121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ced93-a4f9-4d04-8313-e695aa512ccd tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.979733 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3084/6181] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:21.981125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06060c6-a5c7-455b-bafc-3fa4d6d4ee4b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:21.988183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ced93-a4f9-4d04-8313-e695aa512ccd tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:21.995681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8047d-b599-4057-90c5-ea44b6e57b68 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:21.997295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8047d-b599-4057-90c5-ea44b6e57b68 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:21.997740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8047d-b599-4057-90c5-ea44b6e57b68 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:21.998171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8047d-b599-4057-90c5-ea44b6e57b68 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints/0a0c9da4c34e408693deb5285652d629` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:21.999691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8047d-b599-4057-90c5-ea44b6e57b68 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=0a0c9da4c34e408693deb5285652d629)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:21.999814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06060c6-a5c7-455b-bafc-3fa4d6d4ee4b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.001278 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-c9f8047d-b599-4057-90c5-ea44b6e57b68 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:22.001278 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:05:22.001278 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:22.002749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8047d-b599-4057-90c5-ea44b6e57b68 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.012953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92e206-6e7e-4daa-b277-ff21bc0b72a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.014770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e206-6e7e-4daa-b277-ff21bc0b72a0 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.015019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e206-6e7e-4daa-b277-ff21bc0b72a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.015412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92e206-6e7e-4daa-b277-ff21bc0b72a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.016332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92e206-6e7e-4daa-b277-ff21bc0b72a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.018038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c9f8047d-b599-4057-90c5-ea44b6e57b68 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '0a0c9da4c34e408693deb5285652d629', 'request_id': 'req-c9f8047d-b599-4057-90c5-ea44b6e57b68'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:22.022907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92e206-6e7e-4daa-b277-ff21bc0b72a0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.044163 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3098/6182] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:21 2021] DELETE /identity/v3/endpoints/0a0c9da4c34e408693deb5285652d629 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:22.048768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8047d-b599-4057-90c5-ea44b6e57b68 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.071355 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3085/6183] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:21 2021] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:22.078879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92e206-6e7e-4daa-b277-ff21bc0b72a0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.108257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8047d-b599-4057-90c5-ea44b6e57b68 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.162360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92e206-6e7e-4daa-b277-ff21bc0b72a0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.182919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacec817-44c3-40e1-a9ca-8870f9f31c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.183902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacec817-44c3-40e1-a9ca-8870f9f31c65 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.184195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacec817-44c3-40e1-a9ca-8870f9f31c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.184477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacec817-44c3-40e1-a9ca-8870f9f31c65 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.185187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacec817-44c3-40e1-a9ca-8870f9f31c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.187318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacec817-44c3-40e1-a9ca-8870f9f31c65 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.229825 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3086/6184] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:22 2021] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:22.233537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacec817-44c3-40e1-a9ca-8870f9f31c65 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.253041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacec817-44c3-40e1-a9ca-8870f9f31c65 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.263017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9536e8d-3af0-44b5-bd9e-47f1b5cfcdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.263732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9536e8d-3af0-44b5-bd9e-47f1b5cfcdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.264015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9536e8d-3af0-44b5-bd9e-47f1b5cfcdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.264295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9536e8d-3af0-44b5-bd9e-47f1b5cfcdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.265033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9536e8d-3af0-44b5-bd9e-47f1b5cfcdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.266668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9536e8d-3af0-44b5-bd9e-47f1b5cfcdf1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.289917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3010e07-2490-4e76-b0ef-866bd9b7e39c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.290821 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3087/6185] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:22 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:22.290953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3010e07-2490-4e76-b0ef-866bd9b7e39c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.291142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3010e07-2490-4e76-b0ef-866bd9b7e39c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.295102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3010e07-2490-4e76-b0ef-866bd9b7e39c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.296008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9536e8d-3af0-44b5-bd9e-47f1b5cfcdf1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.296172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3010e07-2490-4e76-b0ef-866bd9b7e39c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.310992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3010e07-2490-4e76-b0ef-866bd9b7e39c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.324759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9536e8d-3af0-44b5-bd9e-47f1b5cfcdf1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.328992 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3099/6186] 10.222.0.21 () {58 vars in 1133 bytes} [Sat Nov 27 21:05:22 2021] GET /identity/v3/endpoints => generated 4039 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:22.330868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3010e07-2490-4e76-b0ef-866bd9b7e39c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.340196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d9269-30ff-459f-ba63-1106e1d0bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.341113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d9269-30ff-459f-ba63-1106e1d0bdee admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.341239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d9269-30ff-459f-ba63-1106e1d0bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.341440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d9269-30ff-459f-ba63-1106e1d0bdee admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.342170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d9269-30ff-459f-ba63-1106e1d0bdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.345215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3010e07-2490-4e76-b0ef-866bd9b7e39c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.347925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d9269-30ff-459f-ba63-1106e1d0bdee admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.350456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b778cec-9571-4bd7-be90-f7bc897c42a1 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.351265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b778cec-9571-4bd7-be90-f7bc897c42a1 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.351651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b778cec-9571-4bd7-be90-f7bc897c42a1 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.352037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b778cec-9571-4bd7-be90-f7bc897c42a1 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints/0a0c9da4c34e408693deb5285652d629` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.363300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b778cec-9571-4bd7-be90-f7bc897c42a1 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 21:05:22.368992 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3088/6187] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:22 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:22.373252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d9269-30ff-459f-ba63-1106e1d0bdee admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.382672 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-2b778cec-9571-4bd7-be90-f7bc897c42a1 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Could not find endpoint: 0a0c9da4c34e408693deb5285652d629.: keystone.exception.EndpointNotFound: Could not find endpoint: 0a0c9da4c34e408693deb5285652d629. Nov 27 21:05:22.384363 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3100/6188] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:22 2021] DELETE /identity/v3/endpoints/0a0c9da4c34e408693deb5285652d629 => generated 114 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:05:22.388494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b778cec-9571-4bd7-be90-f7bc897c42a1 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.399924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d9269-30ff-459f-ba63-1106e1d0bdee admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.401570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b778cec-9571-4bd7-be90-f7bc897c42a1 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.406641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c27e2-31c3-4f8f-973c-e883f8f26eb9 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.407574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c27e2-31c3-4f8f-973c-e883f8f26eb9 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.407867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c27e2-31c3-4f8f-973c-e883f8f26eb9 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.408150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c27e2-31c3-4f8f-973c-e883f8f26eb9 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/regions/tempest-region-1166860158` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.409003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c27e2-31c3-4f8f-973c-e883f8f26eb9 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1166860158)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.410678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c27e2-31c3-4f8f-973c-e883f8f26eb9 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.415963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3389ca-835d-4784-9946-93ff54371bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.416872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3389ca-835d-4784-9946-93ff54371bff admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.417154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3389ca-835d-4784-9946-93ff54371bff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.417429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3389ca-835d-4784-9946-93ff54371bff admin admin] PATH_INFO: `/v3/projects/f6bdcf37a45c4567bdcafd69eddf81a1/users/f850a01aa7a642d7b5f3e861fa2eec92/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.447458 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3101/6189] 10.222.0.21 () {58 vars in 1208 bytes} [Sat Nov 27 21:05:22 2021] DELETE /identity/v3/regions/tempest-region-1166860158 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:22.453001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c27e2-31c3-4f8f-973c-e883f8f26eb9 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.462940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3389ca-835d-4784-9946-93ff54371bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bdcf37a45c4567bdcafd69eddf81a1, user_id=f850a01aa7a642d7b5f3e861fa2eec92, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.469801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3389ca-835d-4784-9946-93ff54371bff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.502512 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3089/6190] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:22 2021] PUT /identity/v3/projects/f6bdcf37a45c4567bdcafd69eddf81a1/users/f850a01aa7a642d7b5f3e861fa2eec92/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:22.515300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76086-ff19-4f87-8fa5-a78056baed54 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.517018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76086-ff19-4f87-8fa5-a78056baed54 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.517469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76086-ff19-4f87-8fa5-a78056baed54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.523882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c27e2-31c3-4f8f-973c-e883f8f26eb9 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.613299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-faf76086-ff19-4f87-8fa5-a78056baed54 None None] MFA Rules not processed for user `f850a01aa7a642d7b5f3e861fa2eec92`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:22.615079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-faf76086-ff19-4f87-8fa5-a78056baed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:22.682612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83d8d6-d59c-4c21-b66f-d1d4f82cce9a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.683652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83d8d6-d59c-4c21-b66f-d1d4f82cce9a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.683935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83d8d6-d59c-4c21-b66f-d1d4f82cce9a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.684207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83d8d6-d59c-4c21-b66f-d1d4f82cce9a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.685088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83d8d6-d59c-4c21-b66f-d1d4f82cce9a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.686693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83d8d6-d59c-4c21-b66f-d1d4f82cce9a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.701064 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3102/6191] 10.222.0.21 () {58 vars in 1133 bytes} [Sat Nov 27 21:05:22 2021] GET /identity/v3/endpoints => generated 4039 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:22.710067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83d8d6-d59c-4c21-b66f-d1d4f82cce9a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.721324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83d8d6-d59c-4c21-b66f-d1d4f82cce9a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.731946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667d2d9-f8ba-442f-a685-f7dd0d3a2eb5 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.732616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667d2d9-f8ba-442f-a685-f7dd0d3a2eb5 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.732892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667d2d9-f8ba-442f-a685-f7dd0d3a2eb5 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.733201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667d2d9-f8ba-442f-a685-f7dd0d3a2eb5 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.733910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667d2d9-f8ba-442f-a685-f7dd0d3a2eb5 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Adding query filter params (service_id=380569778c2f4f4f89fc9f84596a52bb) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:22.734293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667d2d9-f8ba-442f-a685-f7dd0d3a2eb5 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.737423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667d2d9-f8ba-442f-a685-f7dd0d3a2eb5 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.750408 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3103/6192] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 21:05:22 2021] GET /identity/v3/endpoints?service_id=380569778c2f4f4f89fc9f84596a52bb => generated 501 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:22.751697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667d2d9-f8ba-442f-a685-f7dd0d3a2eb5 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.767738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667d2d9-f8ba-442f-a685-f7dd0d3a2eb5 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.774678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a87af-97ae-458a-8e6b-7db465c67da0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.775546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a87af-97ae-458a-8e6b-7db465c67da0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.775932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a87af-97ae-458a-8e6b-7db465c67da0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.776310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a87af-97ae-458a-8e6b-7db465c67da0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.777158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a87af-97ae-458a-8e6b-7db465c67da0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Adding query filter params (service_id=7ccbd825ee564b4c9bb4fd53c2fbd031) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:22.777569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a87af-97ae-458a-8e6b-7db465c67da0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.779646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a87af-97ae-458a-8e6b-7db465c67da0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.790207 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3104/6193] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 21:05:22 2021] GET /identity/v3/endpoints?service_id=7ccbd825ee564b4c9bb4fd53c2fbd031 => generated 505 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:05:22.805122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a87af-97ae-458a-8e6b-7db465c67da0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.828088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a87af-97ae-458a-8e6b-7db465c67da0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.844269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ad8aa-8b35-4f47-a11b-d366dbbcb501 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.845320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ad8aa-8b35-4f47-a11b-d366dbbcb501 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.846217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ad8aa-8b35-4f47-a11b-d366dbbcb501 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.847660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ad8aa-8b35-4f47-a11b-d366dbbcb501 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.848676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ad8aa-8b35-4f47-a11b-d366dbbcb501 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:22.854620 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3090/6194] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:22 2021] POST /identity/v3/auth/tokens => generated 3886 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:22.861015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf76086-ff19-4f87-8fa5-a78056baed54 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.867191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ad8aa-8b35-4f47-a11b-d366dbbcb501 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.878231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ad8aa-8b35-4f47-a11b-d366dbbcb501 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.897183 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3105/6195] 10.222.0.21 () {58 vars in 1166 bytes} [Sat Nov 27 21:05:22 2021] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:22.902095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ad8aa-8b35-4f47-a11b-d366dbbcb501 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:22.947691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ad8aa-8b35-4f47-a11b-d366dbbcb501 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:22.953785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c1ffa-6124-4072-bd60-c03f573e1407 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:22.954899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1ffa-6124-4072-bd60-c03f573e1407 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:22.955433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1ffa-6124-4072-bd60-c03f573e1407 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:22.956120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c1ffa-6124-4072-bd60-c03f573e1407 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:22.957142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c1ffa-6124-4072-bd60-c03f573e1407 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:22.957918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c1ffa-6124-4072-bd60-c03f573e1407 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:22.959981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c1ffa-6124-4072-bd60-c03f573e1407 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:22.980555 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3106/6196] 10.222.0.21 () {58 vars in 1170 bytes} [Sat Nov 27 21:05:22 2021] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:22.985703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c1ffa-6124-4072-bd60-c03f573e1407 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.004042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c1ffa-6124-4072-bd60-c03f573e1407 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.010292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047beca-4251-4cc7-a88c-4a7e1eb1d6a7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.011036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047beca-4251-4cc7-a88c-4a7e1eb1d6a7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.011420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047beca-4251-4cc7-a88c-4a7e1eb1d6a7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.011770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047beca-4251-4cc7-a88c-4a7e1eb1d6a7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.012581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047beca-4251-4cc7-a88c-4a7e1eb1d6a7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.014314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047beca-4251-4cc7-a88c-4a7e1eb1d6a7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.017638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf76086-ff19-4f87-8fa5-a78056baed54 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.028523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bcaec-fffa-4d22-87b6-d13b324d77d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.029258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bcaec-fffa-4d22-87b6-d13b324d77d0 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.029542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bcaec-fffa-4d22-87b6-d13b324d77d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.029816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bcaec-fffa-4d22-87b6-d13b324d77d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.030531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bcaec-fffa-4d22-87b6-d13b324d77d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.034633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bcaec-fffa-4d22-87b6-d13b324d77d0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.039851 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3107/6197] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:22 2021] POST /identity/v3/services => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:23.044015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047beca-4251-4cc7-a88c-4a7e1eb1d6a7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.079074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047beca-4251-4cc7-a88c-4a7e1eb1d6a7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.085643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10afa96-8eb3-4933-832c-286f32528303 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.086594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10afa96-8eb3-4933-832c-286f32528303 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.086981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10afa96-8eb3-4933-832c-286f32528303 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.087488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10afa96-8eb3-4933-832c-286f32528303 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.088695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10afa96-8eb3-4933-832c-286f32528303 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.091197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10afa96-8eb3-4933-832c-286f32528303 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.093211 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3091/6198] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:22 2021] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:23.097148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bcaec-fffa-4d22-87b6-d13b324d77d0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.135225 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-f10afa96-8eb3-4933-832c-286f32528303 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-337738285. To ensure interoperability, identifiers should be a valid uuid. Nov 27 21:05:23.135225 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 27 21:05:23.135225 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:23.176289 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3108/6199] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:05:23 2021] POST /identity/v3/endpoints => generated 358 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:23.180921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10afa96-8eb3-4933-832c-286f32528303 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.220249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10afa96-8eb3-4933-832c-286f32528303 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.230428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bcaec-fffa-4d22-87b6-d13b324d77d0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.250906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fad80a-a0f9-4ed3-8635-aabb52dbfe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.251727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fad80a-a0f9-4ed3-8635-aabb52dbfe51 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.252620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fad80a-a0f9-4ed3-8635-aabb52dbfe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.253011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fad80a-a0f9-4ed3-8635-aabb52dbfe51 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.253949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fad80a-a0f9-4ed3-8635-aabb52dbfe51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.256228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fad80a-a0f9-4ed3-8635-aabb52dbfe51 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.283271 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3092/6200] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:23 2021] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:23.287943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fad80a-a0f9-4ed3-8635-aabb52dbfe51 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.300891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fad80a-a0f9-4ed3-8635-aabb52dbfe51 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.308123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c374ce-499b-4653-8867-6c180f907659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.308806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c374ce-499b-4653-8867-6c180f907659 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.309092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c374ce-499b-4653-8867-6c180f907659 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.309422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c374ce-499b-4653-8867-6c180f907659 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.310168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c374ce-499b-4653-8867-6c180f907659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.313088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c374ce-499b-4653-8867-6c180f907659 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.320253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b63467-7ac5-4330-bc9e-570b8a65c4e0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.322206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b63467-7ac5-4330-bc9e-570b8a65c4e0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.322500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b63467-7ac5-4330-bc9e-570b8a65c4e0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.322907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b63467-7ac5-4330-bc9e-570b8a65c4e0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/regions/tempest-region-337738285` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.325863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b63467-7ac5-4330-bc9e-570b8a65c4e0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-337738285)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.328394 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3093/6201] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:23 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:23.332894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b63467-7ac5-4330-bc9e-570b8a65c4e0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.333150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c374ce-499b-4653-8867-6c180f907659 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.339973 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3109/6202] 10.222.0.21 () {58 vars in 1202 bytes} [Sat Nov 27 21:05:23 2021] GET /identity/v3/regions/tempest-region-337738285 => generated 178 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:23.340873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b63467-7ac5-4330-bc9e-570b8a65c4e0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.345064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c374ce-499b-4653-8867-6c180f907659 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.351397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735da56d-865f-4f9a-b13c-c3f755143d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.352412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735da56d-865f-4f9a-b13c-c3f755143d9d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.352775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735da56d-865f-4f9a-b13c-c3f755143d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.353115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735da56d-865f-4f9a-b13c-c3f755143d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.354322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735da56d-865f-4f9a-b13c-c3f755143d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.355960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735da56d-865f-4f9a-b13c-c3f755143d9d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.365754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b63467-7ac5-4330-bc9e-570b8a65c4e0 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.377354 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3094/6203] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:23 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:23.378788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735da56d-865f-4f9a-b13c-c3f755143d9d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.379070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935377eb-2cac-485d-8f74-8d7f3d34ef9c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.380112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935377eb-2cac-485d-8f74-8d7f3d34ef9c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.380397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935377eb-2cac-485d-8f74-8d7f3d34ef9c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.380678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935377eb-2cac-485d-8f74-8d7f3d34ef9c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints/62ef2d38b5a54f658fd074e8e48f3f1e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.391651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735da56d-865f-4f9a-b13c-c3f755143d9d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.397976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935377eb-2cac-485d-8f74-8d7f3d34ef9c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=62ef2d38b5a54f658fd074e8e48f3f1e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.398519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba9da6-a2ce-46a1-a286-8c9da3362a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.399423 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-935377eb-2cac-485d-8f74-8d7f3d34ef9c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:23.399423 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:05:23.399423 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:23.400073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba9da6-a2ce-46a1-a286-8c9da3362a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.400528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935377eb-2cac-485d-8f74-8d7f3d34ef9c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.400753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba9da6-a2ce-46a1-a286-8c9da3362a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.402433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba9da6-a2ce-46a1-a286-8c9da3362a2e admin admin] PATH_INFO: `/v3/projects/2dcf989d53664ec2a7f59f24f9ac37e6/users/25962c4135e04d19b5150a29b30c8eaa/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.436227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba9da6-a2ce-46a1-a286-8c9da3362a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dcf989d53664ec2a7f59f24f9ac37e6, user_id=25962c4135e04d19b5150a29b30c8eaa, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.440427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba9da6-a2ce-46a1-a286-8c9da3362a2e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.454581 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-935377eb-2cac-485d-8f74-8d7f3d34ef9c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1185568779. To ensure interoperability, identifiers should be a valid uuid. Nov 27 21:05:23.454581 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 27 21:05:23.454581 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:23.472075 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3095/6204] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:23 2021] PUT /identity/v3/projects/2dcf989d53664ec2a7f59f24f9ac37e6/users/25962c4135e04d19b5150a29b30c8eaa/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:23.485552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774a6da-d0ef-4809-a3dd-b7f6ec2edc7e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.485882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774a6da-d0ef-4809-a3dd-b7f6ec2edc7e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.486171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774a6da-d0ef-4809-a3dd-b7f6ec2edc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.520768 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3110/6205] 10.222.0.21 () {60 vars in 1255 bytes} [Sat Nov 27 21:05:23 2021] PATCH /identity/v3/endpoints/62ef2d38b5a54f658fd074e8e48f3f1e => generated 363 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:23.525407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935377eb-2cac-485d-8f74-8d7f3d34ef9c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.530664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9774a6da-d0ef-4809-a3dd-b7f6ec2edc7e None None] MFA Rules not processed for user `25962c4135e04d19b5150a29b30c8eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:23.533958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9774a6da-d0ef-4809-a3dd-b7f6ec2edc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:23.569600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935377eb-2cac-485d-8f74-8d7f3d34ef9c tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.648955 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3096/6206] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:23 2021] POST /identity/v3/auth/tokens => generated 4019 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:23.650460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774a6da-d0ef-4809-a3dd-b7f6ec2edc7e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.684185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb80668-dfe8-4f72-9e6b-5b9f3a478c70 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.685046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb80668-dfe8-4f72-9e6b-5b9f3a478c70 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.685329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb80668-dfe8-4f72-9e6b-5b9f3a478c70 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.685597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb80668-dfe8-4f72-9e6b-5b9f3a478c70 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/regions/tempest-region-1185568779` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.686279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb80668-dfe8-4f72-9e6b-5b9f3a478c70 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1185568779)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.687396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb80668-dfe8-4f72-9e6b-5b9f3a478c70 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.690951 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3111/6207] 10.222.0.21 () {58 vars in 1205 bytes} [Sat Nov 27 21:05:23 2021] GET /identity/v3/regions/tempest-region-1185568779 => generated 180 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:23.696726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb80668-dfe8-4f72-9e6b-5b9f3a478c70 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.712994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb80668-dfe8-4f72-9e6b-5b9f3a478c70 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.719111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ac1e4-e19e-4a7f-9cf7-8bcc76b93b0f tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.720056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ac1e4-e19e-4a7f-9cf7-8bcc76b93b0f tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.720352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ac1e4-e19e-4a7f-9cf7-8bcc76b93b0f tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.720679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ac1e4-e19e-4a7f-9cf7-8bcc76b93b0f tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints/62ef2d38b5a54f658fd074e8e48f3f1e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.728303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ac1e4-e19e-4a7f-9cf7-8bcc76b93b0f tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=62ef2d38b5a54f658fd074e8e48f3f1e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.730001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ac1e4-e19e-4a7f-9cf7-8bcc76b93b0f tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.742170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9b1ac1e4-e19e-4a7f-9cf7-8bcc76b93b0f tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '62ef2d38b5a54f658fd074e8e48f3f1e', 'request_id': 'req-9b1ac1e4-e19e-4a7f-9cf7-8bcc76b93b0f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:23.749655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774a6da-d0ef-4809-a3dd-b7f6ec2edc7e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.758302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3112/6208] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:23 2021] DELETE /identity/v3/endpoints/62ef2d38b5a54f658fd074e8e48f3f1e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:23.762698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ac1e4-e19e-4a7f-9cf7-8bcc76b93b0f tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.789285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809b895-2e09-4f1f-ab0f-992ebdfcd958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.789970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809b895-2e09-4f1f-ab0f-992ebdfcd958 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.790419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809b895-2e09-4f1f-ab0f-992ebdfcd958 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.790936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809b895-2e09-4f1f-ab0f-992ebdfcd958 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.804682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809b895-2e09-4f1f-ab0f-992ebdfcd958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.807970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809b895-2e09-4f1f-ab0f-992ebdfcd958 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.819939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ac1e4-e19e-4a7f-9cf7-8bcc76b93b0f tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.826005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe5852-b288-45c2-a65a-b24c65cf3e8d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:23.827185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5852-b288-45c2-a65a-b24c65cf3e8d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:23.827615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5852-b288-45c2-a65a-b24c65cf3e8d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:23.828096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5852-b288-45c2-a65a-b24c65cf3e8d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/regions/tempest-region-1185568779` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:23.829319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe5852-b288-45c2-a65a-b24c65cf3e8d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1185568779)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:23.831224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe5852-b288-45c2-a65a-b24c65cf3e8d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:23.858235 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3097/6209] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:23 2021] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:23.859469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809b895-2e09-4f1f-ab0f-992ebdfcd958 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.879387 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3113/6210] 10.222.0.21 () {58 vars in 1208 bytes} [Sat Nov 27 21:05:23 2021] DELETE /identity/v3/regions/tempest-region-1185568779 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:23.885759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe5852-b288-45c2-a65a-b24c65cf3e8d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:23.937217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe5852-b288-45c2-a65a-b24c65cf3e8d tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:23.958483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809b895-2e09-4f1f-ab0f-992ebdfcd958 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:24.015061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13db82a-57aa-4f0e-8a61-746a6456abd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:24.016034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db82a-57aa-4f0e-8a61-746a6456abd9 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:24.016475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db82a-57aa-4f0e-8a61-746a6456abd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:24.017416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13db82a-57aa-4f0e-8a61-746a6456abd9 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:24.018546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13db82a-57aa-4f0e-8a61-746a6456abd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:24.023282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13db82a-57aa-4f0e-8a61-746a6456abd9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:24.051338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d9f76-1059-4300-b2e2-3e33e8b965f7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:24.052191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d9f76-1059-4300-b2e2-3e33e8b965f7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:24.052477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d9f76-1059-4300-b2e2-3e33e8b965f7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:24.052762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d9f76-1059-4300-b2e2-3e33e8b965f7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/regions/tempest-region-337738285` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:24.053469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d9f76-1059-4300-b2e2-3e33e8b965f7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-337738285)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:24.055367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d9f76-1059-4300-b2e2-3e33e8b965f7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:24.066212 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3098/6211] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:23 2021] POST /identity/v3/users => generated 299 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:24.068171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13db82a-57aa-4f0e-8a61-746a6456abd9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:24.099234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13db82a-57aa-4f0e-8a61-746a6456abd9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:24.105379 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3114/6212] 10.222.0.21 () {58 vars in 1205 bytes} [Sat Nov 27 21:05:23 2021] DELETE /identity/v3/regions/tempest-region-337738285 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:24.110593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d9f76-1059-4300-b2e2-3e33e8b965f7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:24.140160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a979daa-4f25-41ab-95c8-2a5e46c7a523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:24.141543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a979daa-4f25-41ab-95c8-2a5e46c7a523 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:24.141970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a979daa-4f25-41ab-95c8-2a5e46c7a523 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:24.142647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a979daa-4f25-41ab-95c8-2a5e46c7a523 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:24.144500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a979daa-4f25-41ab-95c8-2a5e46c7a523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:24.146414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a979daa-4f25-41ab-95c8-2a5e46c7a523 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:24.170194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d9f76-1059-4300-b2e2-3e33e8b965f7 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:24.175174 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3099/6213] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:24 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:24.179449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4949f-d565-4b4b-90e5-91b980edbe57 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:24.179449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4949f-d565-4b4b-90e5-91b980edbe57 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:24.179449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4949f-d565-4b4b-90e5-91b980edbe57 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:24.179702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4949f-d565-4b4b-90e5-91b980edbe57 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/services/00a93d0e67794b7dae29d5e4f520efef` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:24.179702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4949f-d565-4b4b-90e5-91b980edbe57 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_service(service_id=00a93d0e67794b7dae29d5e4f520efef)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:24.181442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a979daa-4f25-41ab-95c8-2a5e46c7a523 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:24.181930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4949f-d565-4b4b-90e5-91b980edbe57 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:24.199936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a979daa-4f25-41ab-95c8-2a5e46c7a523 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:24.208362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90731c16-8d77-4dc1-a039-15b4da252e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:24.211616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731c16-8d77-4dc1-a039-15b4da252e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:24.213155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731c16-8d77-4dc1-a039-15b4da252e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:24.220203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731c16-8d77-4dc1-a039-15b4da252e4f admin admin] PATH_INFO: `/v3/projects/264c3319761849859b8ffde0644ea067/users/05f1495e562443a88fbbf05d75c3ba03/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:24.233386 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3115/6214] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:24 2021] DELETE /identity/v3/services/00a93d0e67794b7dae29d5e4f520efef => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:24.240712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4949f-d565-4b4b-90e5-91b980edbe57 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:24.264816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90731c16-8d77-4dc1-a039-15b4da252e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=264c3319761849859b8ffde0644ea067, user_id=05f1495e562443a88fbbf05d75c3ba03, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:24.267915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90731c16-8d77-4dc1-a039-15b4da252e4f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:24.279501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4949f-d565-4b4b-90e5-91b980edbe57 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:24.286610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f53eb0-b5fd-4622-a537-d52b68a5956b tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:24.287901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53eb0-b5fd-4622-a537-d52b68a5956b tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:24.288031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53eb0-b5fd-4622-a537-d52b68a5956b tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:24.288319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53eb0-b5fd-4622-a537-d52b68a5956b tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints/ca7b517472374bd3924f24bf653db4d6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:24.295154 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3100/6215] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:24 2021] PUT /identity/v3/projects/264c3319761849859b8ffde0644ea067/users/05f1495e562443a88fbbf05d75c3ba03/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:24.297952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f53eb0-b5fd-4622-a537-d52b68a5956b tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ca7b517472374bd3924f24bf653db4d6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:24.299978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90731c16-8d77-4dc1-a039-15b4da252e4f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:24.302896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f53eb0-b5fd-4622-a537-d52b68a5956b tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:24.318599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-74f53eb0-b5fd-4622-a537-d52b68a5956b tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ca7b517472374bd3924f24bf653db4d6', 'request_id': 'req-74f53eb0-b5fd-4622-a537-d52b68a5956b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:24.335341 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3116/6216] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:24 2021] DELETE /identity/v3/endpoints/ca7b517472374bd3924f24bf653db4d6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:24.340925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f53eb0-b5fd-4622-a537-d52b68a5956b tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:24.420395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f53eb0-b5fd-4622-a537-d52b68a5956b tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:24.534702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90731c16-8d77-4dc1-a039-15b4da252e4f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:24.575289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c6cd-960b-4a92-9f82-41aa2a6f12da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:24.577085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c6cd-960b-4a92-9f82-41aa2a6f12da admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:24.577375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c6cd-960b-4a92-9f82-41aa2a6f12da admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:24.578459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06c6cd-960b-4a92-9f82-41aa2a6f12da admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:24.580028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06c6cd-960b-4a92-9f82-41aa2a6f12da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:24.583492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06c6cd-960b-4a92-9f82-41aa2a6f12da admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:24.601405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b61d-fab1-4746-8732-6577f2d182a8 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:24.603158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b61d-fab1-4746-8732-6577f2d182a8 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:24.604025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b61d-fab1-4746-8732-6577f2d182a8 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:24.604316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b61d-fab1-4746-8732-6577f2d182a8 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/regions/tempest-region-1543211557` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:24.605015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5b61d-fab1-4746-8732-6577f2d182a8 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1543211557)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:24.612351 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3101/6217] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:24 2021] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:24.612746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5b61d-fab1-4746-8732-6577f2d182a8 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:24.614810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c6cd-960b-4a92-9f82-41aa2a6f12da admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:24.635404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06c6cd-960b-4a92-9f82-41aa2a6f12da admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:24.652684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc5dc5-f82a-4d90-aea2-88d9ab1d2394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:24.666773 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3117/6218] 10.222.0.21 () {58 vars in 1208 bytes} [Sat Nov 27 21:05:24 2021] DELETE /identity/v3/regions/tempest-region-1543211557 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:24.669781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc5dc5-f82a-4d90-aea2-88d9ab1d2394 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:24.669781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc5dc5-f82a-4d90-aea2-88d9ab1d2394 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:24.669781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc5dc5-f82a-4d90-aea2-88d9ab1d2394 admin admin] PATH_INFO: `/v3/projects/264c3319761849859b8ffde0644ea067/users/05f1495e562443a88fbbf05d75c3ba03/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:24.670638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b61d-fab1-4746-8732-6577f2d182a8 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:24.678299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc5dc5-f82a-4d90-aea2-88d9ab1d2394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264c3319761849859b8ffde0644ea067, user_id=05f1495e562443a88fbbf05d75c3ba03, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:24.685891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc5dc5-f82a-4d90-aea2-88d9ab1d2394 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:24.719844 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3102/6219] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:24 2021] PUT /identity/v3/projects/264c3319761849859b8ffde0644ea067/users/05f1495e562443a88fbbf05d75c3ba03/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:24.728056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fcbea-d715-404b-90e6-1318e574f115 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:24.728863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fcbea-d715-404b-90e6-1318e574f115 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:24.729029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fcbea-d715-404b-90e6-1318e574f115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:24.731416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b61d-fab1-4746-8732-6577f2d182a8 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:24.804353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3a4fcbea-d715-404b-90e6-1318e574f115 None None] MFA Rules not processed for user `05f1495e562443a88fbbf05d75c3ba03`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:24.808084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3a4fcbea-d715-404b-90e6-1318e574f115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:24.881885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175e90-907f-42e5-93be-1a819a24fd4a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:24.883138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175e90-907f-42e5-93be-1a819a24fd4a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:24.883422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175e90-907f-42e5-93be-1a819a24fd4a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:24.883859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92175e90-907f-42e5-93be-1a819a24fd4a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/services/7ccbd825ee564b4c9bb4fd53c2fbd031` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:24.884537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92175e90-907f-42e5-93be-1a819a24fd4a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7ccbd825ee564b4c9bb4fd53c2fbd031)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:24.886757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92175e90-907f-42e5-93be-1a819a24fd4a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:24.924050 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3118/6220] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:24 2021] DELETE /identity/v3/services/7ccbd825ee564b4c9bb4fd53c2fbd031 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:24.925854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175e90-907f-42e5-93be-1a819a24fd4a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:24.973044 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3103/6221] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:24 2021] POST /identity/v3/auth/tokens => generated 3634 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:24.986783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92175e90-907f-42e5-93be-1a819a24fd4a tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:24.987003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fcbea-d715-404b-90e6-1318e574f115 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:24.994614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3a4fcbea-d715-404b-90e6-1318e574f115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:25.000202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f744440-4fef-4a41-b4c6-f8faa4cc6c05 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:25.001750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744440-4fef-4a41-b4c6-f8faa4cc6c05 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:25.002324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744440-4fef-4a41-b4c6-f8faa4cc6c05 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:25.003417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744440-4fef-4a41-b4c6-f8faa4cc6c05 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/endpoints/077c6d983da945d385c28cb9df32bde9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:25.021504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f744440-4fef-4a41-b4c6-f8faa4cc6c05 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=077c6d983da945d385c28cb9df32bde9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:25.023492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f744440-4fef-4a41-b4c6-f8faa4cc6c05 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:25.053067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3f744440-4fef-4a41-b4c6-f8faa4cc6c05 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '077c6d983da945d385c28cb9df32bde9', 'request_id': 'req-3f744440-4fef-4a41-b4c6-f8faa4cc6c05'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:25.073588 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3119/6222] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:24 2021] DELETE /identity/v3/endpoints/077c6d983da945d385c28cb9df32bde9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:25.077555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f744440-4fef-4a41-b4c6-f8faa4cc6c05 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:25.121910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f744440-4fef-4a41-b4c6-f8faa4cc6c05 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:25.132133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239828a7-9105-479c-9a78-5714d6cfccd4 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:25.133144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239828a7-9105-479c-9a78-5714d6cfccd4 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:25.133435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239828a7-9105-479c-9a78-5714d6cfccd4 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:25.133714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239828a7-9105-479c-9a78-5714d6cfccd4 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/regions/tempest-region-779388645` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:25.134547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239828a7-9105-479c-9a78-5714d6cfccd4 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-779388645)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:25.136203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239828a7-9105-479c-9a78-5714d6cfccd4 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:25.142932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fcbea-d715-404b-90e6-1318e574f115 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:25.165466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e14a7-5f4a-42b8-8354-98c9fe2dfb30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:25.166229 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-239828a7-9105-479c-9a78-5714d6cfccd4 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-779388645. To ensure interoperability, identifiers should be a valid uuid. Nov 27 21:05:25.166229 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 27 21:05:25.166229 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:25.167848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e14a7-5f4a-42b8-8354-98c9fe2dfb30 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:25.168252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e14a7-5f4a-42b8-8354-98c9fe2dfb30 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:25.168538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e14a7-5f4a-42b8-8354-98c9fe2dfb30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:25.175079 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3120/6223] 10.222.0.21 () {58 vars in 1205 bytes} [Sat Nov 27 21:05:25 2021] DELETE /identity/v3/regions/tempest-region-779388645 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:25.178816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239828a7-9105-479c-9a78-5714d6cfccd4 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:25.225030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239828a7-9105-479c-9a78-5714d6cfccd4 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:25.232678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6244555-8971-494a-a28f-8443c35bc612 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a500d9e6873e4152b308ef5ad1521dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '49aefe1786754dccbf9b335949565c4b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:25.233550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244555-8971-494a-a28f-8443c35bc612 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:25.233839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244555-8971-494a-a28f-8443c35bc612 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:25.234388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244555-8971-494a-a28f-8443c35bc612 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] PATH_INFO: `/v3/services/380569778c2f4f4f89fc9f84596a52bb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:25.235078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6244555-8971-494a-a28f-8443c35bc612 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorizing `identity:delete_service(service_id=380569778c2f4f4f89fc9f84596a52bb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:25.239131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6244555-8971-494a-a28f-8443c35bc612 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:25.259518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e14a7-5f4a-42b8-8354-98c9fe2dfb30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:25.261014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e14a7-5f4a-42b8-8354-98c9fe2dfb30 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:25.283718 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3121/6224] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:25 2021] DELETE /identity/v3/services/380569778c2f4f4f89fc9f84596a52bb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:25.288295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6244555-8971-494a-a28f-8443c35bc612 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:25.291133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d6244555-8971-494a-a28f-8443c35bc612 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:25.311995 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3104/6225] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:24 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:05:25.423984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6244555-8971-494a-a28f-8443c35bc612 tempest-EndPointsTestJSON-1431383080 tempest-EndPointsTestJSON-1431383080-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:25.431306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:25.432670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:25.433695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:25.434230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] PATH_INFO: `/v3/users/c8346709abb542d9a01ca7c4c4ddeec2` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:25.436306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8346709abb542d9a01ca7c4c4ddeec2)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:25.439044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:25.527799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8346709abb542d9a01ca7c4c4ddeec2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:25.538569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8346709abb542d9a01ca7c4c4ddeec2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:25.540498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8346709abb542d9a01ca7c4c4ddeec2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:25.560312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8346709abb542d9a01ca7c4c4ddeec2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:25.582017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8346709abb542d9a01ca7c4c4ddeec2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:25.611273 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3122/6226] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:25 2021] DELETE /identity/v3/users/c8346709abb542d9a01ca7c4c4ddeec2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:25.624892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbd118-fb3d-4507-8c53-ce00f6e0bd3a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:25.627092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbd118-fb3d-4507-8c53-ce00f6e0bd3a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:25.627488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbd118-fb3d-4507-8c53-ce00f6e0bd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:25.659171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5edbd118-fb3d-4507-8c53-ce00f6e0bd3a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:25.660462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5edbd118-fb3d-4507-8c53-ce00f6e0bd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:25.765933 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3105/6227] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:25.812940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:25.814709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:26.011396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40352f-ef12-4d39-8395-ec9b2f044b71 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:26.025866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3906e-7c68-4b45-894c-e76590f984da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:26.026938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3906e-7c68-4b45-894c-e76590f984da service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:26.027375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3906e-7c68-4b45-894c-e76590f984da service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:26.028031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3906e-7c68-4b45-894c-e76590f984da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:26.049887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3906e-7c68-4b45-894c-e76590f984da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:26.055237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3906e-7c68-4b45-894c-e76590f984da service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:26.089177 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3123/6228] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:27.208483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbd118-fb3d-4507-8c53-ce00f6e0bd3a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:27.210017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5edbd118-fb3d-4507-8c53-ce00f6e0bd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:27.348378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3906e-7c68-4b45-894c-e76590f984da service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:27.350325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e1f3906e-7c68-4b45-894c-e76590f984da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:27.370433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3906e-7c68-4b45-894c-e76590f984da service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:27.378627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbd118-fb3d-4507-8c53-ce00f6e0bd3a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:27.383368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:27.383368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:27.383368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:27.383368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] PATH_INFO: `/v3/projects/29050c1a174a40f08424688125357adc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:27.386487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] RBAC: Authorizing `identity:delete_project(project_id=29050c1a174a40f08424688125357adc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:27.389995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:27.391936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558c5d3-fb1f-4c87-83e4-a3541085cdc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:27.392715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558c5d3-fb1f-4c87-83e4-a3541085cdc3 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:27.393131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558c5d3-fb1f-4c87-83e4-a3541085cdc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:27.393507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558c5d3-fb1f-4c87-83e4-a3541085cdc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:27.399283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e558c5d3-fb1f-4c87-83e4-a3541085cdc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:27.512352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29050c1a174a40f08424688125357adc', 'request_id': 'req-0c12c4cc-71ab-472b-b993-b084ecd2ecee'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:27.525660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29050c1a174a40f08424688125357adc', 'request_id': 'req-0c12c4cc-71ab-472b-b993-b084ecd2ecee'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:27.534694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29050c1a174a40f08424688125357adc', 'request_id': 'req-0c12c4cc-71ab-472b-b993-b084ecd2ecee'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:27.550332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558c5d3-fb1f-4c87-83e4-a3541085cdc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:27.554036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558c5d3-fb1f-4c87-83e4-a3541085cdc3 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:27.562843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] The token cache is being invalidate because project 29050c1a174a40f08424688125357adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:27.563348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:27.565240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:27.568392 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3124/6229] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:27 2021] DELETE /identity/v3/projects/29050c1a174a40f08424688125357adc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:27.572068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:27.575438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:27.598729 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3106/6230] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:27 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:27.669810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12c4cc-71ab-472b-b993-b084ecd2ecee admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:27.681557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:27.683541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:27.683714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:27.683997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] PATH_INFO: `/v3/users/a500d9e6873e4152b308ef5ad1521dd6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:27.690461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a500d9e6873e4152b308ef5ad1521dd6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:27.694490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:27.796323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a500d9e6873e4152b308ef5ad1521dd6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:27.815994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a500d9e6873e4152b308ef5ad1521dd6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:27.818003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a500d9e6873e4152b308ef5ad1521dd6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:27.847265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a500d9e6873e4152b308ef5ad1521dd6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:27.873049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a500d9e6873e4152b308ef5ad1521dd6'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:27.883935 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3125/6231] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:27 2021] DELETE /identity/v3/users/a500d9e6873e4152b308ef5ad1521dd6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:27.939832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558c5d3-fb1f-4c87-83e4-a3541085cdc3 service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:27.943791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e558c5d3-fb1f-4c87-83e4-a3541085cdc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:27.974803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558c5d3-fb1f-4c87-83e4-a3541085cdc3 service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:28.083881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:28.085769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:28.086297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:28.086973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] PATH_INFO: `/v3/users/05f09b6a534240fc82a45ce979040e3e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:28.089056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f09b6a534240fc82a45ce979040e3e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:28.093605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:28.213934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f09b6a534240fc82a45ce979040e3e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:28.216159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f09b6a534240fc82a45ce979040e3e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:28.233299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f09b6a534240fc82a45ce979040e3e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:28.234071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f09b6a534240fc82a45ce979040e3e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:28.250788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f09b6a534240fc82a45ce979040e3e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:28.290932 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3107/6232] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:27 2021] DELETE /identity/v3/users/05f09b6a534240fc82a45ce979040e3e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:28.468521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:28.470009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:28.489644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618b65-d8f3-4375-8307-def6240b9475 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:28.575337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:28.576370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:28.576876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:28.577295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] PATH_INFO: `/v3/projects/49aefe1786754dccbf9b335949565c4b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:28.578683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49aefe1786754dccbf9b335949565c4b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:28.581053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:28.636048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:28.637834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:28.652245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49aefe1786754dccbf9b335949565c4b', 'request_id': 'req-b513de2c-5bdf-4547-9392-c40d2c402f37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:28.662479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49aefe1786754dccbf9b335949565c4b', 'request_id': 'req-b513de2c-5bdf-4547-9392-c40d2c402f37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:28.672153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49aefe1786754dccbf9b335949565c4b', 'request_id': 'req-b513de2c-5bdf-4547-9392-c40d2c402f37'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:28.687050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] The token cache is being invalidate because project 49aefe1786754dccbf9b335949565c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:28.687459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:28.688314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b513de2c-5bdf-4547-9392-c40d2c402f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:28.691334 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3126/6233] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:28 2021] DELETE /identity/v3/projects/49aefe1786754dccbf9b335949565c4b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:28.698430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d387dc-ef1b-47d2-9cb1-4d55a7902989 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:28.699729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d387dc-ef1b-47d2-9cb1-4d55a7902989 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:28.700022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d387dc-ef1b-47d2-9cb1-4d55a7902989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:28.724694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c1d387dc-ef1b-47d2-9cb1-4d55a7902989 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:28.726586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c1d387dc-ef1b-47d2-9cb1-4d55a7902989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:28.739781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f6ab0-246e-47d6-b2a0-22459d1da37c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:28.798102 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3127/6234] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:28.805872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c175e-4c0b-485e-bc40-4f38b4f1c08d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:28.806204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c175e-4c0b-485e-bc40-4f38b4f1c08d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:28.806473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c175e-4c0b-485e-bc40-4f38b4f1c08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:28.810163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b947f-4e18-4080-83ff-e791adc02bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:28.810937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b947f-4e18-4080-83ff-e791adc02bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:28.811327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b947f-4e18-4080-83ff-e791adc02bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:28.811681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b947f-4e18-4080-83ff-e791adc02bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:28.814692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f47b947f-4e18-4080-83ff-e791adc02bf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:28.825818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-592c175e-4c0b-485e-bc40-4f38b4f1c08d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:28.826945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-592c175e-4c0b-485e-bc40-4f38b4f1c08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:28.835678 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3128/6235] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:28.839754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c175e-4c0b-485e-bc40-4f38b4f1c08d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:28.855160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c175e-4c0b-485e-bc40-4f38b4f1c08d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:28.862871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f94578-7634-452a-a182-2133e3f0075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:28.864256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f94578-7634-452a-a182-2133e3f0075d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:28.865208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f94578-7634-452a-a182-2133e3f0075d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:28.865775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f94578-7634-452a-a182-2133e3f0075d admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:28.866934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f94578-7634-452a-a182-2133e3f0075d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:28.867279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f94578-7634-452a-a182-2133e3f0075d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:28.869872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f94578-7634-452a-a182-2133e3f0075d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:28.890918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b947f-4e18-4080-83ff-e791adc02bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:28.891141 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3129/6236] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:05:28.891243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b947f-4e18-4080-83ff-e791adc02bf0 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:28.892012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f94578-7634-452a-a182-2133e3f0075d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:28.905060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f94578-7634-452a-a182-2133e3f0075d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:28.912729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef3231-e60b-4c05-a375-85a2c05096aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:28.913162 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3108/6237] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:28 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:28.913710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3231-e60b-4c05-a375-85a2c05096aa admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:28.913998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3231-e60b-4c05-a375-85a2c05096aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:28.914280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3231-e60b-4c05-a375-85a2c05096aa admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:28.915058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef3231-e60b-4c05-a375-85a2c05096aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:28.916985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef3231-e60b-4c05-a375-85a2c05096aa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:28.963556 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3130/6238] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:28 2021] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:28.965975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b947f-4e18-4080-83ff-e791adc02bf0 service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:28.984558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b947f-4e18-4080-83ff-e791adc02bf0 service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:29.111162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e545abe-ccf4-4d1c-ae63-f4c612479856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:29.111986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e545abe-ccf4-4d1c-ae63-f4c612479856 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:29.112355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e545abe-ccf4-4d1c-ae63-f4c612479856 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:29.112717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e545abe-ccf4-4d1c-ae63-f4c612479856 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:29.117884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e545abe-ccf4-4d1c-ae63-f4c612479856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:29.117884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e545abe-ccf4-4d1c-ae63-f4c612479856 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:29.120041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef3231-e60b-4c05-a375-85a2c05096aa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:29.122080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a9ef3231-e60b-4c05-a375-85a2c05096aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:29.154532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef3231-e60b-4c05-a375-85a2c05096aa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:29.167727 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3109/6239] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:28 2021] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:29.179393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e545abe-ccf4-4d1c-ae63-f4c612479856 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:29.185958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:29.187295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:29.187295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:29.187506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] PATH_INFO: `/v3/projects/76f19e09c6b04ac1a559d52d9cad1c77` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:29.192392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f19e09c6b04ac1a559d52d9cad1c77)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:29.192513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e545abe-ccf4-4d1c-ae63-f4c612479856 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:29.200611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d75e-55a9-4113-915b-6cf6fe975c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:29.200883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:29.201821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d75e-55a9-4113-915b-6cf6fe975c52 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:29.201821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d75e-55a9-4113-915b-6cf6fe975c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:29.202035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d75e-55a9-4113-915b-6cf6fe975c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:29.202777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140d75e-55a9-4113-915b-6cf6fe975c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:29.205094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140d75e-55a9-4113-915b-6cf6fe975c52 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:29.221067 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3110/6240] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:29 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:29.225494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d75e-55a9-4113-915b-6cf6fe975c52 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:29.236214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d75e-55a9-4113-915b-6cf6fe975c52 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:29.242855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ba907-c4d3-4f9e-9444-d37e3e55e771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:29.243713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba907-c4d3-4f9e-9444-d37e3e55e771 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:29.243713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba907-c4d3-4f9e-9444-d37e3e55e771 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:29.243995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ba907-c4d3-4f9e-9444-d37e3e55e771 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:29.244902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ba907-c4d3-4f9e-9444-d37e3e55e771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:29.247683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ba907-c4d3-4f9e-9444-d37e3e55e771 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:29.272375 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3111/6241] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:29 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:29.277860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ba907-c4d3-4f9e-9444-d37e3e55e771 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:29.293747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ba907-c4d3-4f9e-9444-d37e3e55e771 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:29.321281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f19e09c6b04ac1a559d52d9cad1c77', 'request_id': 'req-0aa76a63-136a-4edf-9241-3eb257eb47da'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:29.339441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f19e09c6b04ac1a559d52d9cad1c77', 'request_id': 'req-0aa76a63-136a-4edf-9241-3eb257eb47da'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:29.346572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f19e09c6b04ac1a559d52d9cad1c77', 'request_id': 'req-0aa76a63-136a-4edf-9241-3eb257eb47da'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:29.376278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d9f8f-c4f3-4017-a214-eeaaa33c397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:29.376278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9f8f-c4f3-4017-a214-eeaaa33c397f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:29.376278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9f8f-c4f3-4017-a214-eeaaa33c397f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:29.376278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d9f8f-c4f3-4017-a214-eeaaa33c397f admin admin] PATH_INFO: `/v3/projects/9d9f0f39b5b647cab03525ae0479db5b/users/90bc9a4bb4da40acb6ce1da436d07414/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:29.376777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] The token cache is being invalidate because project 76f19e09c6b04ac1a559d52d9cad1c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:29.376777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:29.379895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:29.385578 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3131/6242] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:29 2021] DELETE /identity/v3/projects/76f19e09c6b04ac1a559d52d9cad1c77 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:29.386609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:29.398872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:29.412805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9f8f-c4f3-4017-a214-eeaaa33c397f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9f0f39b5b647cab03525ae0479db5b, user_id=90bc9a4bb4da40acb6ce1da436d07414, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:29.417384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d9f8f-c4f3-4017-a214-eeaaa33c397f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:29.436664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa76a63-136a-4edf-9241-3eb257eb47da admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:29.452971 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3112/6243] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:29 2021] PUT /identity/v3/projects/9d9f0f39b5b647cab03525ae0479db5b/users/90bc9a4bb4da40acb6ce1da436d07414/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:29.463829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c919530-687b-4157-858e-5cd00b72b77c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:29.464117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c919530-687b-4157-858e-5cd00b72b77c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:29.464400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c919530-687b-4157-858e-5cd00b72b77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:29.507065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8c919530-687b-4157-858e-5cd00b72b77c None None] MFA Rules not processed for user `90bc9a4bb4da40acb6ce1da436d07414`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:29.512885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8c919530-687b-4157-858e-5cd00b72b77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:29.525650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:29.526552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:29.526870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:29.527153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] PATH_INFO: `/v3/users/098b638877f34c648d92b8c10a0fef12` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:29.549571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=098b638877f34c648d92b8c10a0fef12)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:29.553416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:29.644451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098b638877f34c648d92b8c10a0fef12'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:29.653707 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3113/6244] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:29 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:29.654934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c919530-687b-4157-858e-5cd00b72b77c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:29.656626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8c919530-687b-4157-858e-5cd00b72b77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:29.661644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098b638877f34c648d92b8c10a0fef12'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:29.662640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098b638877f34c648d92b8c10a0fef12'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:29.673198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098b638877f34c648d92b8c10a0fef12'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:29.678866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c919530-687b-4157-858e-5cd00b72b77c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:29.693279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098b638877f34c648d92b8c10a0fef12'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:29.696184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c5686-d20e-43db-b169-f5cb4a8d676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:29.697089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5686-d20e-43db-b169-f5cb4a8d676b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:29.697683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5686-d20e-43db-b169-f5cb4a8d676b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:29.698157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c5686-d20e-43db-b169-f5cb4a8d676b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:29.699186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c5686-d20e-43db-b169-f5cb4a8d676b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:29.701832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c5686-d20e-43db-b169-f5cb4a8d676b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:29.702409 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3132/6245] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:29 2021] DELETE /identity/v3/users/098b638877f34c648d92b8c10a0fef12 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:29.759190 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3114/6246] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:29 2021] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:29.759988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:29.761923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:29.873604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279810e-3867-49df-be1f-30840e9d9335 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:29.958271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1d384-ad2e-41eb-b37a-9df567fd6631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:29.958946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1d384-ad2e-41eb-b37a-9df567fd6631 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:29.959320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1d384-ad2e-41eb-b37a-9df567fd6631 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:29.959651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1d384-ad2e-41eb-b37a-9df567fd6631 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:29.960372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1d384-ad2e-41eb-b37a-9df567fd6631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:29.962863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1d384-ad2e-41eb-b37a-9df567fd6631 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:29.987772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c5686-d20e-43db-b169-f5cb4a8d676b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:29.989809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ef2c5686-d20e-43db-b169-f5cb4a8d676b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:29.995356 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3133/6247] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:29 2021] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:29.999809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1d384-ad2e-41eb-b37a-9df567fd6631 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:30.011657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1d384-ad2e-41eb-b37a-9df567fd6631 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:30.015699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c5686-d20e-43db-b169-f5cb4a8d676b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:30.021445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f075a1-9503-4904-94f8-7aafca1738fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:30.022253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f075a1-9503-4904-94f8-7aafca1738fb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.022543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f075a1-9503-4904-94f8-7aafca1738fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.022805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f075a1-9503-4904-94f8-7aafca1738fb admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.023315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:30.023583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f075a1-9503-4904-94f8-7aafca1738fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:30.024462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.024862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.025191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f075a1-9503-4904-94f8-7aafca1738fb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:30.025287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] PATH_INFO: `/v3/projects/a85cfc14a75e4c43a682f2856111aaf2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.041589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85cfc14a75e4c43a682f2856111aaf2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:30.042833 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3134/6248] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:29 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:30.044604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:30.046717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f075a1-9503-4904-94f8-7aafca1738fb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:30.057465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f075a1-9503-4904-94f8-7aafca1738fb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:30.062710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6d118-35b3-412a-9e24-9a4db167c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:30.063629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6d118-35b3-412a-9e24-9a4db167c605 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.063919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6d118-35b3-412a-9e24-9a4db167c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.064194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6d118-35b3-412a-9e24-9a4db167c605 admin admin] PATH_INFO: `/v3/projects/91a0bf6af3c84fb5bdc1438fa5d08c7a/users/2d9e8b79bd2a4a3b92187950d5b3344a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.086229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6d118-35b3-412a-9e24-9a4db167c605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a0bf6af3c84fb5bdc1438fa5d08c7a, user_id=2d9e8b79bd2a4a3b92187950d5b3344a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:30.099351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6d118-35b3-412a-9e24-9a4db167c605 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:30.125298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85cfc14a75e4c43a682f2856111aaf2', 'request_id': 'req-8a9d302d-7060-4af5-a2b2-54df4e127ba6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:30.131711 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3135/6249] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:30 2021] PUT /identity/v3/projects/91a0bf6af3c84fb5bdc1438fa5d08c7a/users/2d9e8b79bd2a4a3b92187950d5b3344a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:30.132275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85cfc14a75e4c43a682f2856111aaf2', 'request_id': 'req-8a9d302d-7060-4af5-a2b2-54df4e127ba6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:30.133426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6d118-35b3-412a-9e24-9a4db167c605 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:30.143587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85cfc14a75e4c43a682f2856111aaf2', 'request_id': 'req-8a9d302d-7060-4af5-a2b2-54df4e127ba6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:30.185274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] The token cache is being invalidate because project a85cfc14a75e4c43a682f2856111aaf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:30.185574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:30.186339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a9d302d-7060-4af5-a2b2-54df4e127ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:30.190442 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3115/6250] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:29 2021] DELETE /identity/v3/projects/a85cfc14a75e4c43a682f2856111aaf2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:30.197995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c397b1-7c59-44f2-b16f-635fde3931bd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.198857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c397b1-7c59-44f2-b16f-635fde3931bd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.199561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c397b1-7c59-44f2-b16f-635fde3931bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.229861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d7c397b1-7c59-44f2-b16f-635fde3931bd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:30.231414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d7c397b1-7c59-44f2-b16f-635fde3931bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:30.313923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6d118-35b3-412a-9e24-9a4db167c605 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:30.318766 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3116/6251] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:30.321019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c397b1-7c59-44f2-b16f-635fde3931bd None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:30.327027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d7c397b1-7c59-44f2-b16f-635fde3931bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:30.332034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1184e-318b-4f1e-8694-c3a992e9e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:30.334598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1184e-318b-4f1e-8694-c3a992e9e5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.335293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1184e-318b-4f1e-8694-c3a992e9e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.335293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1184e-318b-4f1e-8694-c3a992e9e5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.337815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1184e-318b-4f1e-8694-c3a992e9e5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:30.344998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1184e-318b-4f1e-8694-c3a992e9e5f7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:30.377203 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3136/6252] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:30 2021] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:30.378843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9adc56-d815-40ce-9ac3-4cf5c893ad30 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.382811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9adc56-d815-40ce-9ac3-4cf5c893ad30 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.383229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9adc56-d815-40ce-9ac3-4cf5c893ad30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.423052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5f9adc56-d815-40ce-9ac3-4cf5c893ad30 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:30.423052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f9adc56-d815-40ce-9ac3-4cf5c893ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:30.436013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c397b1-7c59-44f2-b16f-635fde3931bd None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:30.444251 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3137/6253] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:30.449019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9adc56-d815-40ce-9ac3-4cf5c893ad30 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:30.450407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f9adc56-d815-40ce-9ac3-4cf5c893ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:30.456108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5352eda-2960-4c1e-9a6a-2da5d67eb656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:30.458007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5352eda-2960-4c1e-9a6a-2da5d67eb656 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.458427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5352eda-2960-4c1e-9a6a-2da5d67eb656 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.458903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5352eda-2960-4c1e-9a6a-2da5d67eb656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.462450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d5352eda-2960-4c1e-9a6a-2da5d67eb656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:30.465870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9adc56-d815-40ce-9ac3-4cf5c893ad30 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:30.478533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3375ff3-5d34-42d1-b2c4-e3b56a6144a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:30.479498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375ff3-5d34-42d1-b2c4-e3b56a6144a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.479782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375ff3-5d34-42d1-b2c4-e3b56a6144a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.481219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3375ff3-5d34-42d1-b2c4-e3b56a6144a0 admin admin] PATH_INFO: `/v3/projects/91a0bf6af3c84fb5bdc1438fa5d08c7a/users/2d9e8b79bd2a4a3b92187950d5b3344a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.487396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3375ff3-5d34-42d1-b2c4-e3b56a6144a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a0bf6af3c84fb5bdc1438fa5d08c7a, user_id=2d9e8b79bd2a4a3b92187950d5b3344a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:30.494612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3375ff3-5d34-42d1-b2c4-e3b56a6144a0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:30.523392 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3138/6254] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:30 2021] PUT /identity/v3/projects/91a0bf6af3c84fb5bdc1438fa5d08c7a/users/2d9e8b79bd2a4a3b92187950d5b3344a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:30.524299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3375ff3-5d34-42d1-b2c4-e3b56a6144a0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:30.610449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5352eda-2960-4c1e-9a6a-2da5d67eb656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:30.617767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5352eda-2960-4c1e-9a6a-2da5d67eb656 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:30.654388 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3117/6255] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:30.658066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb5b8-8e1b-426c-bc81-8783fa2d8dfa None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.659712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb5b8-8e1b-426c-bc81-8783fa2d8dfa None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.659930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb5b8-8e1b-426c-bc81-8783fa2d8dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.691071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3375ff3-5d34-42d1-b2c4-e3b56a6144a0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:30.708754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d155c-f1e0-4215-b211-d4e7c362f58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:30.709443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d155c-f1e0-4215-b211-d4e7c362f58c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.709739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d155c-f1e0-4215-b211-d4e7c362f58c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.710021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d155c-f1e0-4215-b211-d4e7c362f58c admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.710945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d155c-f1e0-4215-b211-d4e7c362f58c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:30.711300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d155c-f1e0-4215-b211-d4e7c362f58c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:30.713148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d155c-f1e0-4215-b211-d4e7c362f58c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:30.719823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-800cb5b8-8e1b-426c-bc81-8783fa2d8dfa None None] MFA Rules not processed for user `2d9e8b79bd2a4a3b92187950d5b3344a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:30.722686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-800cb5b8-8e1b-426c-bc81-8783fa2d8dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:30.746948 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3139/6256] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:30.749201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d155c-f1e0-4215-b211-d4e7c362f58c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:30.761683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d155c-f1e0-4215-b211-d4e7c362f58c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:30.769220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7339-21b6-4be3-abac-4ea9264961dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:30.770081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7339-21b6-4be3-abac-4ea9264961dd admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.770471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7339-21b6-4be3-abac-4ea9264961dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.770925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7339-21b6-4be3-abac-4ea9264961dd admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.771798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a7339-21b6-4be3-abac-4ea9264961dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:30.774019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a7339-21b6-4be3-abac-4ea9264961dd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:30.818763 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3140/6257] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:30 2021] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:30.821449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7339-21b6-4be3-abac-4ea9264961dd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:30.890791 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3118/6258] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:30 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:30.896869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cb5b8-8e1b-426c-bc81-8783fa2d8dfa None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:30.913279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7339-21b6-4be3-abac-4ea9264961dd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:30.913888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cb5b8-8e1b-426c-bc81-8783fa2d8dfa None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:30.927388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d770ac-29b7-4522-a2dd-c4aed9f5b96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:30.928352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d770ac-29b7-4522-a2dd-c4aed9f5b96e admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:30.929701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d770ac-29b7-4522-a2dd-c4aed9f5b96e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:30.930095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d770ac-29b7-4522-a2dd-c4aed9f5b96e admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:30.931415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d770ac-29b7-4522-a2dd-c4aed9f5b96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:30.934816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d770ac-29b7-4522-a2dd-c4aed9f5b96e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:30.975673 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3141/6259] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:30 2021] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:30.976903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d770ac-29b7-4522-a2dd-c4aed9f5b96e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:30.999868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d770ac-29b7-4522-a2dd-c4aed9f5b96e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.006912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c284e-4276-427b-a6e1-49d662fc6d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.007803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c284e-4276-427b-a6e1-49d662fc6d81 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.008195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c284e-4276-427b-a6e1-49d662fc6d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.008582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c284e-4276-427b-a6e1-49d662fc6d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.009451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c284e-4276-427b-a6e1-49d662fc6d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.011312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c284e-4276-427b-a6e1-49d662fc6d81 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.030503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4f0fe-fae0-450e-b2ad-6637f943b337 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.031368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4f0fe-fae0-450e-b2ad-6637f943b337 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.031666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4f0fe-fae0-450e-b2ad-6637f943b337 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.032078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4f0fe-fae0-450e-b2ad-6637f943b337 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.036332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4f0fe-fae0-450e-b2ad-6637f943b337 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.036634 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3142/6260] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:30 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:31.037919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4f0fe-fae0-450e-b2ad-6637f943b337 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.038231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c284e-4276-427b-a6e1-49d662fc6d81 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.049875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c284e-4276-427b-a6e1-49d662fc6d81 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.057809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb0c51-6e30-4f5b-bd25-9c1d4c3054f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.058593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb0c51-6e30-4f5b-bd25-9c1d4c3054f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.058995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb0c51-6e30-4f5b-bd25-9c1d4c3054f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.059410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb0c51-6e30-4f5b-bd25-9c1d4c3054f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.060571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb0c51-6e30-4f5b-bd25-9c1d4c3054f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.062081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb0c51-6e30-4f5b-bd25-9c1d4c3054f5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.063138 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3119/6261] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:30 2021] POST /identity/v3/services => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:31.070957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4f0fe-fae0-450e-b2ad-6637f943b337 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.077946 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3143/6262] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:31 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:31.082906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb0c51-6e30-4f5b-bd25-9c1d4c3054f5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.100323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb0c51-6e30-4f5b-bd25-9c1d4c3054f5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.111434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4f0fe-fae0-450e-b2ad-6637f943b337 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.124647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e29a2-38bd-47e6-8dbd-c3e79d07a2f4 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.125327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e29a2-38bd-47e6-8dbd-c3e79d07a2f4 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.125612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e29a2-38bd-47e6-8dbd-c3e79d07a2f4 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.125892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e29a2-38bd-47e6-8dbd-c3e79d07a2f4 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.126886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e29a2-38bd-47e6-8dbd-c3e79d07a2f4 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.127307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b45e2-f409-4fcc-bc1b-ced46459daed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.128408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e29a2-38bd-47e6-8dbd-c3e79d07a2f4 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.128621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b45e2-f409-4fcc-bc1b-ced46459daed admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.128911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b45e2-f409-4fcc-bc1b-ced46459daed admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.129938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b45e2-f409-4fcc-bc1b-ced46459daed admin admin] PATH_INFO: `/v3/projects/2237b56d0b4b4fa3ace78023aa3fe435/users/7cd64b2d9718476ea2c0a4255c801b00/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.134444 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-a64e29a2-38bd-47e6-8dbd-c3e79d07a2f4 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 27 21:05:31.134444 ncdv-master-1 devstack@keystone.service[90122]: Failed validating 'type' in schema['properties']['enabled']: Nov 27 21:05:31.134444 ncdv-master-1 devstack@keystone.service[90122]: {'enum': [True, False, None], 'type': 'boolean'} Nov 27 21:05:31.134444 ncdv-master-1 devstack@keystone.service[90122]: On instance['enabled']: Nov 27 21:05:31.134444 ncdv-master-1 devstack@keystone.service[90122]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 27 21:05:31.139790 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3120/6263] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:05:31 2021] POST /identity/v3/endpoints => generated 283 bytes in 69 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 27 21:05:31.140961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e29a2-38bd-47e6-8dbd-c3e79d07a2f4 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.152111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e29a2-38bd-47e6-8dbd-c3e79d07a2f4 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.153604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b45e2-f409-4fcc-bc1b-ced46459daed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2237b56d0b4b4fa3ace78023aa3fe435, user_id=7cd64b2d9718476ea2c0a4255c801b00, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.156370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b45e2-f409-4fcc-bc1b-ced46459daed admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.162355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9091a-900a-44d8-be40-fbe690242ebf tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.163802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9091a-900a-44d8-be40-fbe690242ebf tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.163802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9091a-900a-44d8-be40-fbe690242ebf tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.164252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9091a-900a-44d8-be40-fbe690242ebf tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.165190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9091a-900a-44d8-be40-fbe690242ebf tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.166948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9091a-900a-44d8-be40-fbe690242ebf tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.172968 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-4df9091a-900a-44d8-be40-fbe690242ebf tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 27 21:05:31.172968 ncdv-master-1 devstack@keystone.service[90122]: Failed validating 'type' in schema['properties']['enabled']: Nov 27 21:05:31.172968 ncdv-master-1 devstack@keystone.service[90122]: {'enum': [True, False, None], 'type': 'boolean'} Nov 27 21:05:31.172968 ncdv-master-1 devstack@keystone.service[90122]: On instance['enabled']: Nov 27 21:05:31.172968 ncdv-master-1 devstack@keystone.service[90122]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 27 21:05:31.175100 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3121/6264] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:05:31 2021] POST /identity/v3/endpoints => generated 281 bytes in 34 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 27 21:05:31.175747 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3144/6265] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:31 2021] PUT /identity/v3/projects/2237b56d0b4b4fa3ace78023aa3fe435/users/7cd64b2d9718476ea2c0a4255c801b00/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:31.182182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9091a-900a-44d8-be40-fbe690242ebf tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.182741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4f9cb-5100-4ef0-b132-b4c1e50db656 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.183039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4f9cb-5100-4ef0-b132-b4c1e50db656 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.183363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4f9cb-5100-4ef0-b132-b4c1e50db656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.195282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9091a-900a-44d8-be40-fbe690242ebf tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.202800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-43b4f9cb-5100-4ef0-b132-b4c1e50db656 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:31.204074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-43b4f9cb-5100-4ef0-b132-b4c1e50db656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:31.339768 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3145/6266] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:31 2021] POST /identity/v3/auth/tokens => generated 3363 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:31.349440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4f9cb-5100-4ef0-b132-b4c1e50db656 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.355085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895ea5-51db-4933-b148-60c2fc40a0dd tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.355817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895ea5-51db-4933-b148-60c2fc40a0dd tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.356474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895ea5-51db-4933-b148-60c2fc40a0dd tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.356651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e895ea5-51db-4933-b148-60c2fc40a0dd tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.357438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e895ea5-51db-4933-b148-60c2fc40a0dd tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.359242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e895ea5-51db-4933-b148-60c2fc40a0dd tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.384025 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-4e895ea5-51db-4933-b148-60c2fc40a0dd tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2013085164. To ensure interoperability, identifiers should be a valid uuid. Nov 27 21:05:31.384025 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 27 21:05:31.384025 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:05:31.427529 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3122/6267] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:05:31 2021] POST /identity/v3/endpoints => generated 360 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:31.431962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895ea5-51db-4933-b148-60c2fc40a0dd tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.500649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e895ea5-51db-4933-b148-60c2fc40a0dd tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.508276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdb3a7-1b9c-484b-bba7-e3124c6d873e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.509484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdb3a7-1b9c-484b-bba7-e3124c6d873e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.511542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdb3a7-1b9c-484b-bba7-e3124c6d873e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.512015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdb3a7-1b9c-484b-bba7-e3124c6d873e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/regions/tempest-region-2013085164` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.513129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdb3a7-1b9c-484b-bba7-e3124c6d873e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2013085164)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.513715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4f9cb-5100-4ef0-b132-b4c1e50db656 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.514467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdb3a7-1b9c-484b-bba7-e3124c6d873e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.517888 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3123/6268] 10.222.0.21 () {58 vars in 1205 bytes} [Sat Nov 27 21:05:31 2021] GET /identity/v3/regions/tempest-region-2013085164 => generated 180 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:31.530615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdb3a7-1b9c-484b-bba7-e3124c6d873e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.532860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078a417-b2f2-44ba-8f63-14bc874befc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.533753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a417-b2f2-44ba-8f63-14bc874befc1 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.534953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a417-b2f2-44ba-8f63-14bc874befc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.536193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a417-b2f2-44ba-8f63-14bc874befc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.546747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdb3a7-1b9c-484b-bba7-e3124c6d873e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.554160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c02af0-2bb0-47ca-a1bd-a67618199650 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.554298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078a417-b2f2-44ba-8f63-14bc874befc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.555183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02af0-2bb0-47ca-a1bd-a67618199650 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.555556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078a417-b2f2-44ba-8f63-14bc874befc1 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.555702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02af0-2bb0-47ca-a1bd-a67618199650 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.556121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02af0-2bb0-47ca-a1bd-a67618199650 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/endpoints/767fb00e7bb04fc99a9675c77868fc22` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.566050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c02af0-2bb0-47ca-a1bd-a67618199650 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=767fb00e7bb04fc99a9675c77868fc22)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.567464 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-56c02af0-2bb0-47ca-a1bd-a67618199650 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:31.567464 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:05:31.567464 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:05:31.569034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c02af0-2bb0-47ca-a1bd-a67618199650 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.581361 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-56c02af0-2bb0-47ca-a1bd-a67618199650 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 27 21:05:31.581361 ncdv-master-1 devstack@keystone.service[90122]: Failed validating 'type' in schema['properties']['enabled']: Nov 27 21:05:31.581361 ncdv-master-1 devstack@keystone.service[90122]: {'enum': [True, False, None], 'type': 'boolean'} Nov 27 21:05:31.581361 ncdv-master-1 devstack@keystone.service[90122]: On instance['enabled']: Nov 27 21:05:31.581361 ncdv-master-1 devstack@keystone.service[90122]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 27 21:05:31.586385 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3124/6269] 10.222.0.21 () {60 vars in 1254 bytes} [Sat Nov 27 21:05:31 2021] PATCH /identity/v3/endpoints/767fb00e7bb04fc99a9675c77868fc22 => generated 283 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 27 21:05:31.586523 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3146/6270] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:31 2021] GET /identity/v3/auth/tokens => generated 3545 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:31.587542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c02af0-2bb0-47ca-a1bd-a67618199650 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.600161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c02af0-2bb0-47ca-a1bd-a67618199650 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.606018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0ed77-e092-4dea-81c6-4f9b29c81410 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.606941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0ed77-e092-4dea-81c6-4f9b29c81410 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.607367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0ed77-e092-4dea-81c6-4f9b29c81410 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.607730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0ed77-e092-4dea-81c6-4f9b29c81410 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/endpoints/767fb00e7bb04fc99a9675c77868fc22` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.609496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0ed77-e092-4dea-81c6-4f9b29c81410 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=767fb00e7bb04fc99a9675c77868fc22)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.610350 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-57b0ed77-e092-4dea-81c6-4f9b29c81410 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:31.610350 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:05:31.610350 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:05:31.611671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0ed77-e092-4dea-81c6-4f9b29c81410 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.624526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-57b0ed77-e092-4dea-81c6-4f9b29c81410 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '767fb00e7bb04fc99a9675c77868fc22', 'request_id': 'req-57b0ed77-e092-4dea-81c6-4f9b29c81410'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:31.659028 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3125/6271] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:31 2021] DELETE /identity/v3/endpoints/767fb00e7bb04fc99a9675c77868fc22 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:31.661314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078a417-b2f2-44ba-8f63-14bc874befc1 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.681480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078a417-b2f2-44ba-8f63-14bc874befc1 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.709860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98e556-4e3c-4ea0-8bb3-392c74aed54c tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.710767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e556-4e3c-4ea0-8bb3-392c74aed54c tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.711697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e556-4e3c-4ea0-8bb3-392c74aed54c tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.712074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e556-4e3c-4ea0-8bb3-392c74aed54c tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/regions/tempest-region-2013085164` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.713172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98e556-4e3c-4ea0-8bb3-392c74aed54c tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2013085164)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.714886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98e556-4e3c-4ea0-8bb3-392c74aed54c tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.739525 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-9d98e556-4e3c-4ea0-8bb3-392c74aed54c tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2013085164. To ensure interoperability, identifiers should be a valid uuid. Nov 27 21:05:31.739525 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 27 21:05:31.739525 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:31.754492 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3147/6272] 10.222.0.21 () {58 vars in 1208 bytes} [Sat Nov 27 21:05:31 2021] DELETE /identity/v3/regions/tempest-region-2013085164 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:31.755001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0ed77-e092-4dea-81c6-4f9b29c81410 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.770690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0ed77-e092-4dea-81c6-4f9b29c81410 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.800190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad91c7a-970e-4226-83bf-fe8c8e6d03aa tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.803807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91c7a-970e-4226-83bf-fe8c8e6d03aa tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.806205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91c7a-970e-4226-83bf-fe8c8e6d03aa tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.806985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad91c7a-970e-4226-83bf-fe8c8e6d03aa tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.808079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad91c7a-970e-4226-83bf-fe8c8e6d03aa tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.811952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad91c7a-970e-4226-83bf-fe8c8e6d03aa tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.833818 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-1ad91c7a-970e-4226-83bf-fe8c8e6d03aa tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-679346014. To ensure interoperability, identifiers should be a valid uuid. Nov 27 21:05:31.833818 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 27 21:05:31.833818 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:05:31.895244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98e556-4e3c-4ea0-8bb3-392c74aed54c tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.895686 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3126/6273] 10.222.0.21 () {60 vars in 1155 bytes} [Sat Nov 27 21:05:31 2021] POST /identity/v3/endpoints => generated 358 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:31.911785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98e556-4e3c-4ea0-8bb3-392c74aed54c tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:31.954587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe3cf0-1c60-42bb-bb3b-fc4273a0ee6e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:31.955567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3cf0-1c60-42bb-bb3b-fc4273a0ee6e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:31.955867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3cf0-1c60-42bb-bb3b-fc4273a0ee6e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:31.956615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3cf0-1c60-42bb-bb3b-fc4273a0ee6e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/regions/tempest-region-679346014` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:31.957340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe3cf0-1c60-42bb-bb3b-fc4273a0ee6e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-679346014)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:31.959072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe3cf0-1c60-42bb-bb3b-fc4273a0ee6e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:31.971319 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3148/6274] 10.222.0.21 () {58 vars in 1202 bytes} [Sat Nov 27 21:05:31 2021] GET /identity/v3/regions/tempest-region-679346014 => generated 178 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:31.975509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad91c7a-970e-4226-83bf-fe8c8e6d03aa tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:31.992090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad91c7a-970e-4226-83bf-fe8c8e6d03aa tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:32.005197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7983-aa3b-4469-b850-6993193f2c24 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:32.006070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7983-aa3b-4469-b850-6993193f2c24 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:32.006416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7983-aa3b-4469-b850-6993193f2c24 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:32.006624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7983-aa3b-4469-b850-6993193f2c24 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/endpoints/15495d16d92041f0895e50e4b7e761c0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:32.020289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a7983-aa3b-4469-b850-6993193f2c24 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=15495d16d92041f0895e50e4b7e761c0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:32.021951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a7983-aa3b-4469-b850-6993193f2c24 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:32.037448 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-705a7983-aa3b-4469-b850-6993193f2c24 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 27 21:05:32.037448 ncdv-master-1 devstack@keystone.service[90122]: Failed validating 'type' in schema['properties']['enabled']: Nov 27 21:05:32.037448 ncdv-master-1 devstack@keystone.service[90122]: {'enum': [True, False, None], 'type': 'boolean'} Nov 27 21:05:32.037448 ncdv-master-1 devstack@keystone.service[90122]: On instance['enabled']: Nov 27 21:05:32.037448 ncdv-master-1 devstack@keystone.service[90122]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 27 21:05:32.039014 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3127/6275] 10.222.0.21 () {60 vars in 1254 bytes} [Sat Nov 27 21:05:31 2021] PATCH /identity/v3/endpoints/15495d16d92041f0895e50e4b7e761c0 => generated 281 bytes in 64 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 27 21:05:32.043303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe3cf0-1c60-42bb-bb3b-fc4273a0ee6e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:32.064312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe3cf0-1c60-42bb-bb3b-fc4273a0ee6e tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:32.092967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e12432-978c-4586-ae3c-910494a20904 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:32.093842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e12432-978c-4586-ae3c-910494a20904 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:32.094130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e12432-978c-4586-ae3c-910494a20904 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:32.094410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e12432-978c-4586-ae3c-910494a20904 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/endpoints/15495d16d92041f0895e50e4b7e761c0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:32.095788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e12432-978c-4586-ae3c-910494a20904 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=15495d16d92041f0895e50e4b7e761c0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:32.097433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e12432-978c-4586-ae3c-910494a20904 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:32.112891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-19e12432-978c-4586-ae3c-910494a20904 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '15495d16d92041f0895e50e4b7e761c0', 'request_id': 'req-19e12432-978c-4586-ae3c-910494a20904'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:32.130959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7983-aa3b-4469-b850-6993193f2c24 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:32.131939 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3149/6276] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:05:32 2021] DELETE /identity/v3/endpoints/15495d16d92041f0895e50e4b7e761c0 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:32.144214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7983-aa3b-4469-b850-6993193f2c24 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:32.183083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26902e1-d67b-48c9-8445-b9fc2c3e2422 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:32.184004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26902e1-d67b-48c9-8445-b9fc2c3e2422 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:32.184293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26902e1-d67b-48c9-8445-b9fc2c3e2422 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:32.184573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26902e1-d67b-48c9-8445-b9fc2c3e2422 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/regions/tempest-region-679346014` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:32.185256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26902e1-d67b-48c9-8445-b9fc2c3e2422 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-679346014)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:32.186926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26902e1-d67b-48c9-8445-b9fc2c3e2422 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:32.231231 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3128/6277] 10.222.0.21 () {58 vars in 1205 bytes} [Sat Nov 27 21:05:32 2021] DELETE /identity/v3/regions/tempest-region-679346014 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:32.235999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e12432-978c-4586-ae3c-910494a20904 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:32.251234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e12432-978c-4586-ae3c-910494a20904 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:32.271705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61050db2-18eb-4e43-b297-7fc179aa0aa5 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d9e8b79bd2a4a3b92187950d5b3344a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:32.272708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61050db2-18eb-4e43-b297-7fc179aa0aa5 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:32.273067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61050db2-18eb-4e43-b297-7fc179aa0aa5 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:32.273499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61050db2-18eb-4e43-b297-7fc179aa0aa5 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] PATH_INFO: `/v3/services/feb1d2a81ae3400db79482db6bfe6b8c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:32.274298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61050db2-18eb-4e43-b297-7fc179aa0aa5 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorizing `identity:delete_service(service_id=feb1d2a81ae3400db79482db6bfe6b8c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:32.286807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61050db2-18eb-4e43-b297-7fc179aa0aa5 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:32.324448 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3150/6278] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:32 2021] DELETE /identity/v3/services/feb1d2a81ae3400db79482db6bfe6b8c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:32.325892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26902e1-d67b-48c9-8445-b9fc2c3e2422 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:32.372856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26902e1-d67b-48c9-8445-b9fc2c3e2422 tempest-EndpointsNegativeTestJSON-589870918 tempest-EndpointsNegativeTestJSON-589870918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:32.400402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:32.401271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:32.401627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:32.401812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] PATH_INFO: `/v3/users/90bc9a4bb4da40acb6ce1da436d07414` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:32.403149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90bc9a4bb4da40acb6ce1da436d07414)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:32.405188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:32.467585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90bc9a4bb4da40acb6ce1da436d07414'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:32.468739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90bc9a4bb4da40acb6ce1da436d07414'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:32.476807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90bc9a4bb4da40acb6ce1da436d07414'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:32.477607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90bc9a4bb4da40acb6ce1da436d07414'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:32.486645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90bc9a4bb4da40acb6ce1da436d07414'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:32.510527 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3129/6279] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:32 2021] DELETE /identity/v3/users/90bc9a4bb4da40acb6ce1da436d07414 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:32.515567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f461e4-60e8-4abe-9ef8-8e695a7e9232 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:32.515921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f461e4-60e8-4abe-9ef8-8e695a7e9232 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:32.516140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f461e4-60e8-4abe-9ef8-8e695a7e9232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:32.535389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-28f461e4-60e8-4abe-9ef8-8e695a7e9232 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:32.538440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-28f461e4-60e8-4abe-9ef8-8e695a7e9232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:32.622630 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3151/6280] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:32.649423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:32.651097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:32.747149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6277c8-d181-49be-a393-98291fd535a8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:32.752501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b007de7-af8d-4fac-aea1-c1e9c26127b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:32.755003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007de7-af8d-4fac-aea1-c1e9c26127b1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:32.755410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007de7-af8d-4fac-aea1-c1e9c26127b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:32.768198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007de7-af8d-4fac-aea1-c1e9c26127b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:32.791016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b007de7-af8d-4fac-aea1-c1e9c26127b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:32.792821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b007de7-af8d-4fac-aea1-c1e9c26127b1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:32.809435 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3130/6281] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:33.381149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faae267-549c-497d-98eb-4108b8d7e11b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:33.381735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faae267-549c-497d-98eb-4108b8d7e11b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:33.381735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faae267-549c-497d-98eb-4108b8d7e11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:33.405569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b007de7-af8d-4fac-aea1-c1e9c26127b1 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:33.406863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0b007de7-af8d-4fac-aea1-c1e9c26127b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:33.428360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b007de7-af8d-4fac-aea1-c1e9c26127b1 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:33.446512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:33.448581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:33.449018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:33.449310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] PATH_INFO: `/v3/projects/9d9f0f39b5b647cab03525ae0479db5b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:33.452314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9f0f39b5b647cab03525ae0479db5b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:33.456757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:33.517013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6faae267-549c-497d-98eb-4108b8d7e11b None None] MFA Rules not processed for user `7cd64b2d9718476ea2c0a4255c801b00`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:33.518285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6faae267-549c-497d-98eb-4108b8d7e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:33.588000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9f0f39b5b647cab03525ae0479db5b', 'request_id': 'req-1eb3fd52-5879-44d1-b8af-63583c79d055'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.596040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9f0f39b5b647cab03525ae0479db5b', 'request_id': 'req-1eb3fd52-5879-44d1-b8af-63583c79d055'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.615420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9f0f39b5b647cab03525ae0479db5b', 'request_id': 'req-1eb3fd52-5879-44d1-b8af-63583c79d055'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.632751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] The token cache is being invalidate because project 9d9f0f39b5b647cab03525ae0479db5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:33.633275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.634253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.636435 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3131/6282] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:33 2021] DELETE /identity/v3/projects/9d9f0f39b5b647cab03525ae0479db5b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:33.637608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:33.639642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:33.640926 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3152/6283] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:33 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:33.642370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faae267-549c-497d-98eb-4108b8d7e11b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:33.662927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faae267-549c-497d-98eb-4108b8d7e11b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:33.755408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25929981-c5c8-4457-99cc-9d2321a3db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:33.756290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25929981-c5c8-4457-99cc-9d2321a3db4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:33.756572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25929981-c5c8-4457-99cc-9d2321a3db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:33.756844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25929981-c5c8-4457-99cc-9d2321a3db4c admin admin] PATH_INFO: `/v3/users/2d9e8b79bd2a4a3b92187950d5b3344a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:33.758298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25929981-c5c8-4457-99cc-9d2321a3db4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9e8b79bd2a4a3b92187950d5b3344a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:33.760675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25929981-c5c8-4457-99cc-9d2321a3db4c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:33.782417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3fd52-5879-44d1-b8af-63583c79d055 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:33.791214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428e0e2-71d4-49a9-b911-e18296e94531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:33.792484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428e0e2-71d4-49a9-b911-e18296e94531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:33.792830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428e0e2-71d4-49a9-b911-e18296e94531 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:33.793252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428e0e2-71d4-49a9-b911-e18296e94531 admin admin] PATH_INFO: `/v3/users/f850a01aa7a642d7b5f3e861fa2eec92` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:33.796987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428e0e2-71d4-49a9-b911-e18296e94531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f850a01aa7a642d7b5f3e861fa2eec92)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:33.804987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428e0e2-71d4-49a9-b911-e18296e94531 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:33.840754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25929981-c5c8-4457-99cc-9d2321a3db4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9e8b79bd2a4a3b92187950d5b3344a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.858988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25929981-c5c8-4457-99cc-9d2321a3db4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9e8b79bd2a4a3b92187950d5b3344a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.860186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25929981-c5c8-4457-99cc-9d2321a3db4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9e8b79bd2a4a3b92187950d5b3344a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.870489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25929981-c5c8-4457-99cc-9d2321a3db4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9e8b79bd2a4a3b92187950d5b3344a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.894540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-25929981-c5c8-4457-99cc-9d2321a3db4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9e8b79bd2a4a3b92187950d5b3344a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.902002 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3153/6284] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:33 2021] DELETE /identity/v3/users/2d9e8b79bd2a4a3b92187950d5b3344a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:33.903900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bb65-63db-4e49-a342-822afaf6c428 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:33.904396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bb65-63db-4e49-a342-822afaf6c428 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:33.904919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bb65-63db-4e49-a342-822afaf6c428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:33.919188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9428e0e2-71d4-49a9-b911-e18296e94531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f850a01aa7a642d7b5f3e861fa2eec92'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.920157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9428e0e2-71d4-49a9-b911-e18296e94531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f850a01aa7a642d7b5f3e861fa2eec92'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.932467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c824bb65-63db-4e49-a342-822afaf6c428 None None] MFA Rules not processed for user `7cd64b2d9718476ea2c0a4255c801b00`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:33.934265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c824bb65-63db-4e49-a342-822afaf6c428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:33.941430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9428e0e2-71d4-49a9-b911-e18296e94531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f850a01aa7a642d7b5f3e861fa2eec92'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.942502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9428e0e2-71d4-49a9-b911-e18296e94531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f850a01aa7a642d7b5f3e861fa2eec92'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.953357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9428e0e2-71d4-49a9-b911-e18296e94531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f850a01aa7a642d7b5f3e861fa2eec92'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:33.991133 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3132/6285] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:33 2021] DELETE /identity/v3/users/f850a01aa7a642d7b5f3e861fa2eec92 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:33.995402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576548f-1382-49c2-bbe1-8a84229ca43c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:33.996501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576548f-1382-49c2-bbe1-8a84229ca43c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:33.997599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576548f-1382-49c2-bbe1-8a84229ca43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:34.025153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b576548f-1382-49c2-bbe1-8a84229ca43c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:34.026988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b576548f-1382-49c2-bbe1-8a84229ca43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:34.086458 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3154/6286] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:33 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:34.102860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bb65-63db-4e49-a342-822afaf6c428 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:34.104471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c824bb65-63db-4e49-a342-822afaf6c428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:34.129057 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3133/6287] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:34.150114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576548f-1382-49c2-bbe1-8a84229ca43c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:34.152348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b576548f-1382-49c2-bbe1-8a84229ca43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:34.284542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bb65-63db-4e49-a342-822afaf6c428 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:34.298300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576548f-1382-49c2-bbe1-8a84229ca43c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:34.305025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02704213-cb56-4cd8-af6c-f39213fda781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:34.306306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704213-cb56-4cd8-af6c-f39213fda781 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:34.307009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704213-cb56-4cd8-af6c-f39213fda781 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:34.307599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704213-cb56-4cd8-af6c-f39213fda781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:34.326907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02704213-cb56-4cd8-af6c-f39213fda781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:34.328527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02704213-cb56-4cd8-af6c-f39213fda781 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:34.345980 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3134/6288] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:34.374034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c18a9-ee13-4880-8d3c-9dd4c989c920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:34.374988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c18a9-ee13-4880-8d3c-9dd4c989c920 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:34.375647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c18a9-ee13-4880-8d3c-9dd4c989c920 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:34.376106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c18a9-ee13-4880-8d3c-9dd4c989c920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:34.379829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d37c18a9-ee13-4880-8d3c-9dd4c989c920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:34.471338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02704213-cb56-4cd8-af6c-f39213fda781 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:34.472793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-02704213-cb56-4cd8-af6c-f39213fda781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:34.474852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c18a9-ee13-4880-8d3c-9dd4c989c920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:34.476622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c18a9-ee13-4880-8d3c-9dd4c989c920 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:34.488196 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3155/6289] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:34 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:34.494636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02704213-cb56-4cd8-af6c-f39213fda781 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:34.512952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:34.514398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:34.514750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:34.515389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] PATH_INFO: `/v3/projects/91a0bf6af3c84fb5bdc1438fa5d08c7a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:34.518589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a0bf6af3c84fb5bdc1438fa5d08c7a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:34.522359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:34.606204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'request_id': 'req-56c27132-3c09-490f-8645-b1aab1649836'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:34.631903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'request_id': 'req-56c27132-3c09-490f-8645-b1aab1649836'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:34.646521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a0bf6af3c84fb5bdc1438fa5d08c7a', 'request_id': 'req-56c27132-3c09-490f-8645-b1aab1649836'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:34.665946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] The token cache is being invalidate because project 91a0bf6af3c84fb5bdc1438fa5d08c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:34.666400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:34.667145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-56c27132-3c09-490f-8645-b1aab1649836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:34.668891 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3135/6290] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:34 2021] DELETE /identity/v3/projects/91a0bf6af3c84fb5bdc1438fa5d08c7a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:34.675396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c129fb9-40d9-4924-acc7-ff763ec7ac46 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:34.676599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c129fb9-40d9-4924-acc7-ff763ec7ac46 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:34.676894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c129fb9-40d9-4924-acc7-ff763ec7ac46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:34.706462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2c129fb9-40d9-4924-acc7-ff763ec7ac46 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:34.708398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2c129fb9-40d9-4924-acc7-ff763ec7ac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:34.787989 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3156/6291] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:34.796878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87cd3-4c65-4a6a-8f28-cc92b2bfaedb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:34.797177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87cd3-4c65-4a6a-8f28-cc92b2bfaedb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:34.797463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c87cd3-4c65-4a6a-8f28-cc92b2bfaedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:34.819355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-01c87cd3-4c65-4a6a-8f28-cc92b2bfaedb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:34.820592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-01c87cd3-4c65-4a6a-8f28-cc92b2bfaedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:34.829725 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3136/6292] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:34.834158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c129fb9-40d9-4924-acc7-ff763ec7ac46 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:34.844827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c129fb9-40d9-4924-acc7-ff763ec7ac46 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:34.850711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83033fc8-ed70-4673-8b9e-59f01ff12fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:34.851010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83033fc8-ed70-4673-8b9e-59f01ff12fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:34.851590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83033fc8-ed70-4673-8b9e-59f01ff12fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:34.851924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83033fc8-ed70-4673-8b9e-59f01ff12fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:34.852664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83033fc8-ed70-4673-8b9e-59f01ff12fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:34.853469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83033fc8-ed70-4673-8b9e-59f01ff12fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:34.855235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83033fc8-ed70-4673-8b9e-59f01ff12fb2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:34.873158 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3157/6293] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:34.874993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c87cd3-4c65-4a6a-8f28-cc92b2bfaedb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:34.891724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c87cd3-4c65-4a6a-8f28-cc92b2bfaedb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:34.896883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e3873-a356-4c69-8614-0dc45c25aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:34.897882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3873-a356-4c69-8614-0dc45c25aff2 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:34.897882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3873-a356-4c69-8614-0dc45c25aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:34.898064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3873-a356-4c69-8614-0dc45c25aff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:34.898655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e3873-a356-4c69-8614-0dc45c25aff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:34.900640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e3873-a356-4c69-8614-0dc45c25aff2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:34.931297 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3137/6294] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:34 2021] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:34.936203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83033fc8-ed70-4673-8b9e-59f01ff12fb2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:34.948151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83033fc8-ed70-4673-8b9e-59f01ff12fb2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:35.071912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de51a3-523b-4434-86b7-ad745497ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:35.072625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de51a3-523b-4434-86b7-ad745497ffde admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:35.072917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de51a3-523b-4434-86b7-ad745497ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:35.073197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de51a3-523b-4434-86b7-ad745497ffde admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:35.073916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de51a3-523b-4434-86b7-ad745497ffde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:35.075967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de51a3-523b-4434-86b7-ad745497ffde admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:35.085003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e3873-a356-4c69-8614-0dc45c25aff2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:35.087811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e92e3873-a356-4c69-8614-0dc45c25aff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:35.124485 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3158/6295] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:34 2021] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:35.126231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de51a3-523b-4434-86b7-ad745497ffde admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:35.142596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e3873-a356-4c69-8614-0dc45c25aff2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:35.157328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de51a3-523b-4434-86b7-ad745497ffde admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:35.162378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:35.163998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:35.165041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:35.165564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] PATH_INFO: `/v3/projects/f6bdcf37a45c4567bdcafd69eddf81a1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:35.169788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bdcf37a45c4567bdcafd69eddf81a1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:35.170630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cfa3f-1119-4b21-9762-727071e9e614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:35.172452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cfa3f-1119-4b21-9762-727071e9e614 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:35.172851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cfa3f-1119-4b21-9762-727071e9e614 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:35.173235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cfa3f-1119-4b21-9762-727071e9e614 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:35.175779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:35.178025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cfa3f-1119-4b21-9762-727071e9e614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:35.181320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cfa3f-1119-4b21-9762-727071e9e614 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:35.206898 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3159/6296] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:35 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:35.210995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cfa3f-1119-4b21-9762-727071e9e614 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:35.229168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cfa3f-1119-4b21-9762-727071e9e614 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:35.242524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b8c6f-7442-4703-bae9-5f2344c7d796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:35.243499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8c6f-7442-4703-bae9-5f2344c7d796 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:35.244087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8c6f-7442-4703-bae9-5f2344c7d796 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:35.244536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8c6f-7442-4703-bae9-5f2344c7d796 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:35.245432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b8c6f-7442-4703-bae9-5f2344c7d796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:35.266782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bdcf37a45c4567bdcafd69eddf81a1', 'request_id': 'req-2702863c-7268-469b-ab4f-09beaaef6a57'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:35.267549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b8c6f-7442-4703-bae9-5f2344c7d796 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:35.275423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bdcf37a45c4567bdcafd69eddf81a1', 'request_id': 'req-2702863c-7268-469b-ab4f-09beaaef6a57'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:35.289711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bdcf37a45c4567bdcafd69eddf81a1', 'request_id': 'req-2702863c-7268-469b-ab4f-09beaaef6a57'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:35.305656 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3160/6297] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:35 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:35.309850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b8c6f-7442-4703-bae9-5f2344c7d796 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:35.332584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b8c6f-7442-4703-bae9-5f2344c7d796 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:35.358574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] The token cache is being invalidate because project f6bdcf37a45c4567bdcafd69eddf81a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:35.358891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:35.360777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:35.364905 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3138/6298] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:35 2021] DELETE /identity/v3/projects/f6bdcf37a45c4567bdcafd69eddf81a1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:35.372726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:35.374181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:35.496151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d180b-3e19-4928-8b65-9ed803c01e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:35.497720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d180b-3e19-4928-8b65-9ed803c01e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:35.498087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d180b-3e19-4928-8b65-9ed803c01e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:35.499619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d180b-3e19-4928-8b65-9ed803c01e76 admin admin] PATH_INFO: `/v3/projects/c6e03e8ac0644e179fd3cfb4863e1a74/users/e4c9591ff5e14d469d6c16c7f37ce7fa/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:35.524671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d180b-3e19-4928-8b65-9ed803c01e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e03e8ac0644e179fd3cfb4863e1a74, user_id=e4c9591ff5e14d469d6c16c7f37ce7fa, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:35.527768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d180b-3e19-4928-8b65-9ed803c01e76 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:35.543083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702863c-7268-469b-ab4f-09beaaef6a57 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:35.555296 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3161/6299] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:35 2021] PUT /identity/v3/projects/c6e03e8ac0644e179fd3cfb4863e1a74/users/e4c9591ff5e14d469d6c16c7f37ce7fa/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:35.568318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9efe-b9aa-43ca-bd9c-5d045cb234a7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:35.568809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9efe-b9aa-43ca-bd9c-5d045cb234a7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:35.569241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba9efe-b9aa-43ca-bd9c-5d045cb234a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:35.613181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3dba9efe-b9aa-43ca-bd9c-5d045cb234a7 None None] MFA Rules not processed for user `e4c9591ff5e14d469d6c16c7f37ce7fa`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:35.615112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3dba9efe-b9aa-43ca-bd9c-5d045cb234a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:35.649953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:35.651069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:35.651717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:35.652155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] PATH_INFO: `/v3/users/25962c4135e04d19b5150a29b30c8eaa` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:35.654952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=25962c4135e04d19b5150a29b30c8eaa)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:35.657134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:35.749804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25962c4135e04d19b5150a29b30c8eaa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:35.750653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25962c4135e04d19b5150a29b30c8eaa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:35.767456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25962c4135e04d19b5150a29b30c8eaa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:35.768807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25962c4135e04d19b5150a29b30c8eaa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:35.787382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25962c4135e04d19b5150a29b30c8eaa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:35.829630 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3162/6300] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:35 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:35.830597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba9efe-b9aa-43ca-bd9c-5d045cb234a7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:35.834189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3dba9efe-b9aa-43ca-bd9c-5d045cb234a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:35.841673 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3139/6301] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:35 2021] DELETE /identity/v3/users/25962c4135e04d19b5150a29b30c8eaa => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:35.864564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba9efe-b9aa-43ca-bd9c-5d045cb234a7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:36.000597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566da958-02c3-4855-bbb6-2b1fcef323a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:36.001525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566da958-02c3-4855-bbb6-2b1fcef323a2 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:36.001895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566da958-02c3-4855-bbb6-2b1fcef323a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:36.002614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566da958-02c3-4855-bbb6-2b1fcef323a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:36.003411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566da958-02c3-4855-bbb6-2b1fcef323a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:36.007924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566da958-02c3-4855-bbb6-2b1fcef323a2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:36.066943 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3163/6302] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:35 2021] POST /identity/v3/projects => generated 369 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:36.071552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:36.085280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca323e-088d-48da-bb44-d0ff07d550dc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:36.241708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d6e16-0af1-4a63-851c-8fc7e869ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:36.242939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d6e16-0af1-4a63-851c-8fc7e869ea5f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:36.243374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d6e16-0af1-4a63-851c-8fc7e869ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:36.243729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d6e16-0af1-4a63-851c-8fc7e869ea5f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:36.244482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d6e16-0af1-4a63-851c-8fc7e869ea5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:36.247240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d6e16-0af1-4a63-851c-8fc7e869ea5f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:36.283459 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3140/6303] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:36 2021] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:36.285261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566da958-02c3-4855-bbb6-2b1fcef323a2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:36.300295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566da958-02c3-4855-bbb6-2b1fcef323a2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:36.308310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e04e4-fbc4-4d0d-a798-f11ec63a0eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:36.309476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e04e4-fbc4-4d0d-a798-f11ec63a0eeb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:36.315368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e04e4-fbc4-4d0d-a798-f11ec63a0eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:36.316615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e04e4-fbc4-4d0d-a798-f11ec63a0eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:36.319198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e04e4-fbc4-4d0d-a798-f11ec63a0eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:36.321163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e04e4-fbc4-4d0d-a798-f11ec63a0eeb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:36.339356 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3164/6304] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:36 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:36.340238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d6e16-0af1-4a63-851c-8fc7e869ea5f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:36.357442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d6e16-0af1-4a63-851c-8fc7e869ea5f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:36.364088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780ad9a-3a2c-4341-ab2a-c77e76d38220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:36.364668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780ad9a-3a2c-4341-ab2a-c77e76d38220 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:36.364955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780ad9a-3a2c-4341-ab2a-c77e76d38220 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:36.366932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780ad9a-3a2c-4341-ab2a-c77e76d38220 admin admin] PATH_INFO: `/v3/projects/dbfbac827796447b839286a63582008b/users/06b3fea414304f77a92ce702b4b33842/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:36.390962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780ad9a-3a2c-4341-ab2a-c77e76d38220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfbac827796447b839286a63582008b, user_id=06b3fea414304f77a92ce702b4b33842, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:36.394259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780ad9a-3a2c-4341-ab2a-c77e76d38220 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:36.420941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e04e4-fbc4-4d0d-a798-f11ec63a0eeb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:36.421575 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3141/6305] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:36 2021] PUT /identity/v3/projects/dbfbac827796447b839286a63582008b/users/06b3fea414304f77a92ce702b4b33842/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:36.439883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e04e4-fbc4-4d0d-a798-f11ec63a0eeb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:36.560259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec761dc-9348-4f41-85bc-fcc137d1a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:36.561046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec761dc-9348-4f41-85bc-fcc137d1a0fe admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:36.561411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec761dc-9348-4f41-85bc-fcc137d1a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:36.561769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec761dc-9348-4f41-85bc-fcc137d1a0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:36.562590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec761dc-9348-4f41-85bc-fcc137d1a0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:36.564329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec761dc-9348-4f41-85bc-fcc137d1a0fe admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:36.578403 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3165/6306] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:36 2021] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:36.583274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780ad9a-3a2c-4341-ab2a-c77e76d38220 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:36.593965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780ad9a-3a2c-4341-ab2a-c77e76d38220 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:36.618533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ec990-0028-4a97-83f0-9da31cf7b065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:36.619678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ec990-0028-4a97-83f0-9da31cf7b065 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:36.620354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ec990-0028-4a97-83f0-9da31cf7b065 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:36.621785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ec990-0028-4a97-83f0-9da31cf7b065 admin admin] PATH_INFO: `/v3/projects/dbfbac827796447b839286a63582008b/users/06b3fea414304f77a92ce702b4b33842/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:36.632179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ec990-0028-4a97-83f0-9da31cf7b065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfbac827796447b839286a63582008b, user_id=06b3fea414304f77a92ce702b4b33842, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:36.642175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ec990-0028-4a97-83f0-9da31cf7b065 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:36.661710 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3142/6307] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:36 2021] PUT /identity/v3/projects/dbfbac827796447b839286a63582008b/users/06b3fea414304f77a92ce702b4b33842/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:36.672446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ec990-0028-4a97-83f0-9da31cf7b065 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:36.672723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316b6d-5407-4815-8c89-ca6dbc6a9164 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:36.673018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316b6d-5407-4815-8c89-ca6dbc6a9164 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:36.673298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316b6d-5407-4815-8c89-ca6dbc6a9164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:36.675351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-da1ec990-0028-4a97-83f0-9da31cf7b065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:36.738476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-89316b6d-5407-4815-8c89-ca6dbc6a9164 None None] MFA Rules not processed for user `06b3fea414304f77a92ce702b4b33842`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:36.740412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-89316b6d-5407-4815-8c89-ca6dbc6a9164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:36.812059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ec990-0028-4a97-83f0-9da31cf7b065 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:36.819590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:36.820916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:36.821504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:36.822000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] PATH_INFO: `/v3/projects/2dcf989d53664ec2a7f59f24f9ac37e6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:36.823668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dcf989d53664ec2a7f59f24f9ac37e6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:36.827285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:36.938959 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3166/6308] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:36 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:36.940032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316b6d-5407-4815-8c89-ca6dbc6a9164 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:36.955438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dcf989d53664ec2a7f59f24f9ac37e6', 'request_id': 'req-a680babd-2993-4176-a69c-52829fba18df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:36.957344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316b6d-5407-4815-8c89-ca6dbc6a9164 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:36.982036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dcf989d53664ec2a7f59f24f9ac37e6', 'request_id': 'req-a680babd-2993-4176-a69c-52829fba18df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:37.006594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dcf989d53664ec2a7f59f24f9ac37e6', 'request_id': 'req-a680babd-2993-4176-a69c-52829fba18df'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:37.023879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452dd14-f234-4014-88b0-a57153f3d996 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b3fea414304f77a92ce702b4b33842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbfbac827796447b839286a63582008b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.026203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] The token cache is being invalidate because project 2dcf989d53664ec2a7f59f24f9ac37e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:37.026805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:37.027839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452dd14-f234-4014-88b0-a57153f3d996 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.028139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:37.028476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452dd14-f234-4014-88b0-a57153f3d996 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.029388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452dd14-f234-4014-88b0-a57153f3d996 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] PATH_INFO: `/v3/policies` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.030759 ncdv-master-1 devstack@keystone.service[90123]: WARNING oslo_log.versionutils [None req-0452dd14-f234-4014-88b0-a57153f3d996 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 27 21:05:37.031194 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3143/6309] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:36 2021] DELETE /identity/v3/projects/2dcf989d53664ec2a7f59f24f9ac37e6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:37.031544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452dd14-f234-4014-88b0-a57153f3d996 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.033016 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-0452dd14-f234-4014-88b0-a57153f3d996 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:37.033016 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:05:37.033016 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:37.034878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452dd14-f234-4014-88b0-a57153f3d996 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.035329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.037989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:37.066149 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3167/6310] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:05:36 2021] POST /identity/v3/policies => generated 229 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:37.072456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452dd14-f234-4014-88b0-a57153f3d996 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.075500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0452dd14-f234-4014-88b0-a57153f3d996 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:37.091149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452dd14-f234-4014-88b0-a57153f3d996 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.096662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37557-22fc-4bdc-a814-9900f8c1dd31 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b3fea414304f77a92ce702b4b33842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbfbac827796447b839286a63582008b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.097835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37557-22fc-4bdc-a814-9900f8c1dd31 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.098288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37557-22fc-4bdc-a814-9900f8c1dd31 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.098668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37557-22fc-4bdc-a814-9900f8c1dd31 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] PATH_INFO: `/v3/policies/8bf0572637f1496c9d78e04deeb2fb0c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.099853 ncdv-master-1 devstack@keystone.service[90123]: WARNING oslo_log.versionutils [None req-3db37557-22fc-4bdc-a814-9900f8c1dd31 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 27 21:05:37.100496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37557-22fc-4bdc-a814-9900f8c1dd31 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=8bf0572637f1496c9d78e04deeb2fb0c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.101841 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-3db37557-22fc-4bdc-a814-9900f8c1dd31 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:37.101841 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:05:37.101841 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:37.103022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37557-22fc-4bdc-a814-9900f8c1dd31 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.131968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680babd-2993-4176-a69c-52829fba18df admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.133715 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3168/6311] 10.222.0.21 () {60 vars in 1251 bytes} [Sat Nov 27 21:05:37 2021] PATCH /identity/v3/policies/8bf0572637f1496c9d78e04deeb2fb0c => generated 236 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:37.137511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37557-22fc-4bdc-a814-9900f8c1dd31 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.140099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.141173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.142108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.142550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] PATH_INFO: `/v3/users/05f1495e562443a88fbbf05d75c3ba03` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.146377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f1495e562443a88fbbf05d75c3ba03)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.149296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.154238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37557-22fc-4bdc-a814-9900f8c1dd31 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.162286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b70ec5-621b-4a6d-900f-f7a5c6461527 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b3fea414304f77a92ce702b4b33842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbfbac827796447b839286a63582008b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.164763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b70ec5-621b-4a6d-900f-f7a5c6461527 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.165194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b70ec5-621b-4a6d-900f-f7a5c6461527 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.166078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b70ec5-621b-4a6d-900f-f7a5c6461527 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] PATH_INFO: `/v3/policies/8bf0572637f1496c9d78e04deeb2fb0c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.167450 ncdv-master-1 devstack@keystone.service[90123]: WARNING oslo_log.versionutils [None req-35b70ec5-621b-4a6d-900f-f7a5c6461527 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 27 21:05:37.168437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b70ec5-621b-4a6d-900f-f7a5c6461527 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=8bf0572637f1496c9d78e04deeb2fb0c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.171928 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-35b70ec5-621b-4a6d-900f-f7a5c6461527 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:37.171928 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:05:37.171928 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:37.174493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b70ec5-621b-4a6d-900f-f7a5c6461527 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.187546 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3169/6312] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:05:37 2021] GET /identity/v3/policies/8bf0572637f1496c9d78e04deeb2fb0c => generated 236 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:37.193344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b70ec5-621b-4a6d-900f-f7a5c6461527 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.205840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b70ec5-621b-4a6d-900f-f7a5c6461527 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.211931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b147fb-9b38-46c2-96ac-4673db14c5e1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b3fea414304f77a92ce702b4b33842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbfbac827796447b839286a63582008b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.213934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b147fb-9b38-46c2-96ac-4673db14c5e1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.215026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b147fb-9b38-46c2-96ac-4673db14c5e1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.215310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b147fb-9b38-46c2-96ac-4673db14c5e1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] PATH_INFO: `/v3/policies/8bf0572637f1496c9d78e04deeb2fb0c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.216405 ncdv-master-1 devstack@keystone.service[90123]: WARNING oslo_log.versionutils [None req-01b147fb-9b38-46c2-96ac-4673db14c5e1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 27 21:05:37.217334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b147fb-9b38-46c2-96ac-4673db14c5e1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8bf0572637f1496c9d78e04deeb2fb0c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.218774 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-01b147fb-9b38-46c2-96ac-4673db14c5e1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:37.218774 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:05:37.218774 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:05:37.220452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b147fb-9b38-46c2-96ac-4673db14c5e1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.225393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f1495e562443a88fbbf05d75c3ba03'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:37.228610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f1495e562443a88fbbf05d75c3ba03'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:37.240807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f1495e562443a88fbbf05d75c3ba03'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:37.242529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f1495e562443a88fbbf05d75c3ba03'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:37.253383 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3170/6313] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:37 2021] DELETE /identity/v3/policies/8bf0572637f1496c9d78e04deeb2fb0c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:37.253660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f1495e562443a88fbbf05d75c3ba03'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:37.259630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b147fb-9b38-46c2-96ac-4673db14c5e1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.262380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-01b147fb-9b38-46c2-96ac-4673db14c5e1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:37.281272 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3144/6314] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:37 2021] DELETE /identity/v3/users/05f1495e562443a88fbbf05d75c3ba03 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:37.281464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b147fb-9b38-46c2-96ac-4673db14c5e1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.388153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cc9dd-a9e9-4f60-ae7b-9c693d7549c1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b3fea414304f77a92ce702b4b33842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbfbac827796447b839286a63582008b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.389065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cc9dd-a9e9-4f60-ae7b-9c693d7549c1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.390418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cc9dd-a9e9-4f60-ae7b-9c693d7549c1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.391352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cc9dd-a9e9-4f60-ae7b-9c693d7549c1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] PATH_INFO: `/v3/policies` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.393318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cc9dd-a9e9-4f60-ae7b-9c693d7549c1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.397029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cc9dd-a9e9-4f60-ae7b-9c693d7549c1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.442383 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3171/6315] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:05:37 2021] POST /identity/v3/policies => generated 230 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:37.444701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.468526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c90f8-2962-4d91-965b-775ab2b3b12e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.478314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a27b5-971c-438d-b0d9-4703d8a94c0e tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b3fea414304f77a92ce702b4b33842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbfbac827796447b839286a63582008b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.479432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a27b5-971c-438d-b0d9-4703d8a94c0e tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.479958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a27b5-971c-438d-b0d9-4703d8a94c0e tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.480455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a27b5-971c-438d-b0d9-4703d8a94c0e tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] PATH_INFO: `/v3/policies` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.481703 ncdv-master-1 devstack@keystone.service[90122]: WARNING oslo_log.versionutils [None req-310a27b5-971c-438d-b0d9-4703d8a94c0e tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 27 21:05:37.482445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a27b5-971c-438d-b0d9-4703d8a94c0e tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.486558 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-310a27b5-971c-438d-b0d9-4703d8a94c0e tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:37.486558 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:05:37.486558 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:05:37.490219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a27b5-971c-438d-b0d9-4703d8a94c0e tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.550672 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3145/6316] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:05:37 2021] POST /identity/v3/policies => generated 229 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:37.556242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cc9dd-a9e9-4f60-ae7b-9c693d7549c1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.568518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cc9dd-a9e9-4f60-ae7b-9c693d7549c1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.574637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff3aa4-9b97-4144-825e-6aaeda7902db tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b3fea414304f77a92ce702b4b33842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbfbac827796447b839286a63582008b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.575595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3aa4-9b97-4144-825e-6aaeda7902db tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.575880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3aa4-9b97-4144-825e-6aaeda7902db tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.576161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3aa4-9b97-4144-825e-6aaeda7902db tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] PATH_INFO: `/v3/policies` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.577619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff3aa4-9b97-4144-825e-6aaeda7902db tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.579579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff3aa4-9b97-4144-825e-6aaeda7902db tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.607560 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3172/6317] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:05:37 2021] POST /identity/v3/policies => generated 229 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:37.611218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a27b5-971c-438d-b0d9-4703d8a94c0e tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.625387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a27b5-971c-438d-b0d9-4703d8a94c0e tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.633444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f7f0e-cbe0-4f8d-8afe-83af54f8b2fb tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b3fea414304f77a92ce702b4b33842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbfbac827796447b839286a63582008b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.633444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7f0e-cbe0-4f8d-8afe-83af54f8b2fb tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.633444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7f0e-cbe0-4f8d-8afe-83af54f8b2fb tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.633756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7f0e-cbe0-4f8d-8afe-83af54f8b2fb tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] PATH_INFO: `/v3/policies` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.634301 ncdv-master-1 devstack@keystone.service[90122]: WARNING oslo_log.versionutils [None req-f99f7f0e-cbe0-4f8d-8afe-83af54f8b2fb tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 27 21:05:37.634693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f7f0e-cbe0-4f8d-8afe-83af54f8b2fb tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.636222 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-f99f7f0e-cbe0-4f8d-8afe-83af54f8b2fb tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_policies failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:37.636222 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:05:37.636222 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:05:37.637256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f7f0e-cbe0-4f8d-8afe-83af54f8b2fb tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.653364 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3146/6318] 10.222.0.21 () {58 vars in 1130 bytes} [Sat Nov 27 21:05:37 2021] GET /identity/v3/policies => generated 764 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:05:37.654923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff3aa4-9b97-4144-825e-6aaeda7902db tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.670187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff3aa4-9b97-4144-825e-6aaeda7902db tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.677000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff7c24-2a53-4222-94e4-f44bcaeb0346 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b3fea414304f77a92ce702b4b33842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbfbac827796447b839286a63582008b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.678075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7c24-2a53-4222-94e4-f44bcaeb0346 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.678214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7c24-2a53-4222-94e4-f44bcaeb0346 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.678408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7c24-2a53-4222-94e4-f44bcaeb0346 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] PATH_INFO: `/v3/policies/dd4b949cffec401c938fb2acf52c6046` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.681221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff7c24-2a53-4222-94e4-f44bcaeb0346 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=dd4b949cffec401c938fb2acf52c6046)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.681513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff7c24-2a53-4222-94e4-f44bcaeb0346 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.702372 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3173/6319] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:37 2021] DELETE /identity/v3/policies/dd4b949cffec401c938fb2acf52c6046 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:37.703699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f7f0e-cbe0-4f8d-8afe-83af54f8b2fb tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.716452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f7f0e-cbe0-4f8d-8afe-83af54f8b2fb tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.724209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c78e4-8f96-4d43-96d1-0098589f47a1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b3fea414304f77a92ce702b4b33842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbfbac827796447b839286a63582008b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.725381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c78e4-8f96-4d43-96d1-0098589f47a1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.725937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c78e4-8f96-4d43-96d1-0098589f47a1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.726439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c78e4-8f96-4d43-96d1-0098589f47a1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] PATH_INFO: `/v3/policies/6955139282ba4b3d9bcdaf99dd788868` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.727535 ncdv-master-1 devstack@keystone.service[90122]: WARNING oslo_log.versionutils [None req-fc8c78e4-8f96-4d43-96d1-0098589f47a1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 27 21:05:37.728565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c78e4-8f96-4d43-96d1-0098589f47a1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=6955139282ba4b3d9bcdaf99dd788868)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.730279 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-fc8c78e4-8f96-4d43-96d1-0098589f47a1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_policy failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:05:37.730279 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:05:37.730279 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:05:37.731737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c78e4-8f96-4d43-96d1-0098589f47a1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.759633 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3147/6320] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:37 2021] DELETE /identity/v3/policies/6955139282ba4b3d9bcdaf99dd788868 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:37.764041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff7c24-2a53-4222-94e4-f44bcaeb0346 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.778296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff7c24-2a53-4222-94e4-f44bcaeb0346 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.790939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23079db8-7adf-4b56-930e-caddfeabf756 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06b3fea414304f77a92ce702b4b33842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbfbac827796447b839286a63582008b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.791970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079db8-7adf-4b56-930e-caddfeabf756 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.792262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079db8-7adf-4b56-930e-caddfeabf756 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.792600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079db8-7adf-4b56-930e-caddfeabf756 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] PATH_INFO: `/v3/policies/9733d1c049bf4282bebe98403e111da6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.793760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23079db8-7adf-4b56-930e-caddfeabf756 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=9733d1c049bf4282bebe98403e111da6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.795848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23079db8-7adf-4b56-930e-caddfeabf756 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:37.823289 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3174/6321] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:37 2021] DELETE /identity/v3/policies/9733d1c049bf4282bebe98403e111da6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:37.828516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c78e4-8f96-4d43-96d1-0098589f47a1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:37.831449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fc8c78e4-8f96-4d43-96d1-0098589f47a1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:37.944114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c78e4-8f96-4d43-96d1-0098589f47a1 tempest-PoliciesTestJSON-1439768032 tempest-PoliciesTestJSON-1439768032-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:37.949330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:37.950388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:37.950777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:37.951162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] PATH_INFO: `/v3/users/e4c9591ff5e14d469d6c16c7f37ce7fa` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:37.952731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c9591ff5e14d469d6c16c7f37ce7fa)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:37.954952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:38.049728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c9591ff5e14d469d6c16c7f37ce7fa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:38.051751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c9591ff5e14d469d6c16c7f37ce7fa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:38.071932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c9591ff5e14d469d6c16c7f37ce7fa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:38.073046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c9591ff5e14d469d6c16c7f37ce7fa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:38.082358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c9591ff5e14d469d6c16c7f37ce7fa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:38.105847 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3148/6322] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:37 2021] DELETE /identity/v3/users/e4c9591ff5e14d469d6c16c7f37ce7fa => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:38.113323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aa1a4-2ad7-4ede-b4ee-3a9e4e4075d7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:38.115087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aa1a4-2ad7-4ede-b4ee-3a9e4e4075d7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:38.115579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329aa1a4-2ad7-4ede-b4ee-3a9e4e4075d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:38.139144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-329aa1a4-2ad7-4ede-b4ee-3a9e4e4075d7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:38.140766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-329aa1a4-2ad7-4ede-b4ee-3a9e4e4075d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:38.212006 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3175/6323] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:38.237902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:38.239987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:38.357744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea484b6e-504e-42b5-a029-e779bfd846b3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:38.364513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35be49-8156-41a0-aee3-b7569f8e4eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:38.365813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35be49-8156-41a0-aee3-b7569f8e4eff service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:38.366110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35be49-8156-41a0-aee3-b7569f8e4eff service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:38.366552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35be49-8156-41a0-aee3-b7569f8e4eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:38.383036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35be49-8156-41a0-aee3-b7569f8e4eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:38.384954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35be49-8156-41a0-aee3-b7569f8e4eff service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:38.402063 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3149/6324] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:38.939712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aa1a4-2ad7-4ede-b4ee-3a9e4e4075d7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:38.941840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-329aa1a4-2ad7-4ede-b4ee-3a9e4e4075d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:38.965628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329aa1a4-2ad7-4ede-b4ee-3a9e4e4075d7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:38.974601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:38.975554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:38.975997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:38.976709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] PATH_INFO: `/v3/projects/c6e03e8ac0644e179fd3cfb4863e1a74` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:38.979034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e03e8ac0644e179fd3cfb4863e1a74)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:38.981430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:39.047147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e03e8ac0644e179fd3cfb4863e1a74', 'request_id': 'req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.060602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e03e8ac0644e179fd3cfb4863e1a74', 'request_id': 'req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.069438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e03e8ac0644e179fd3cfb4863e1a74', 'request_id': 'req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.085994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] The token cache is being invalidate because project c6e03e8ac0644e179fd3cfb4863e1a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:39.086431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.087987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.089998 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3176/6325] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:38 2021] DELETE /identity/v3/projects/c6e03e8ac0644e179fd3cfb4863e1a74 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:39.093772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35be49-8156-41a0-aee3-b7569f8e4eff service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:39.106650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35be49-8156-41a0-aee3-b7569f8e4eff service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:39.151201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:39.154591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:39.214313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7e1d4-7d9a-49ef-b703-d1403fc78942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:39.215506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e1d4-7d9a-49ef-b703-d1403fc78942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:39.215900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e1d4-7d9a-49ef-b703-d1403fc78942 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:39.216455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7e1d4-7d9a-49ef-b703-d1403fc78942 admin admin] PATH_INFO: `/v3/users/06b3fea414304f77a92ce702b4b33842` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:39.218379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7e1d4-7d9a-49ef-b703-d1403fc78942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b3fea414304f77a92ce702b4b33842)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:39.220766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7e1d4-7d9a-49ef-b703-d1403fc78942 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:39.250566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfca3ae-a6e8-49de-95dc-26ef1ef2f34c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:39.257937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:39.259363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:39.259781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:39.260167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] PATH_INFO: `/v3/projects/264c3319761849859b8ffde0644ea067` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:39.261836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] RBAC: Authorizing `identity:delete_project(project_id=264c3319761849859b8ffde0644ea067)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:39.264089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:39.298939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8b7e1d4-7d9a-49ef-b703-d1403fc78942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b3fea414304f77a92ce702b4b33842'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.300182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8b7e1d4-7d9a-49ef-b703-d1403fc78942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b3fea414304f77a92ce702b4b33842'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.323149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8b7e1d4-7d9a-49ef-b703-d1403fc78942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b3fea414304f77a92ce702b4b33842'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.324341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8b7e1d4-7d9a-49ef-b703-d1403fc78942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b3fea414304f77a92ce702b4b33842'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.336401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8b7e1d4-7d9a-49ef-b703-d1403fc78942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b3fea414304f77a92ce702b4b33842'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.362074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264c3319761849859b8ffde0644ea067', 'request_id': 'req-64bb3021-d3ba-4831-a9cd-a975b77a180e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.363681 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3150/6326] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:39 2021] DELETE /identity/v3/users/06b3fea414304f77a92ce702b4b33842 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:39.385424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264c3319761849859b8ffde0644ea067', 'request_id': 'req-64bb3021-d3ba-4831-a9cd-a975b77a180e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.402028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264c3319761849859b8ffde0644ea067', 'request_id': 'req-64bb3021-d3ba-4831-a9cd-a975b77a180e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.416202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] The token cache is being invalidate because project 264c3319761849859b8ffde0644ea067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:39.416691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.417504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:39.420705 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3177/6327] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:39 2021] DELETE /identity/v3/projects/264c3319761849859b8ffde0644ea067 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:39.429829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93eda-e7d5-40a6-aa70-1a9dae228ba2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:39.430264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93eda-e7d5-40a6-aa70-1a9dae228ba2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:39.430863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b93eda-e7d5-40a6-aa70-1a9dae228ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:39.460019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:39.462050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:39.476000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-02b93eda-e7d5-40a6-aa70-1a9dae228ba2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:39.477289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-02b93eda-e7d5-40a6-aa70-1a9dae228ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:39.563388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb3021-d3ba-4831-a9cd-a975b77a180e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:39.630012 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3151/6328] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:39.643603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6031c89-a45a-458c-a4cf-61eee22c26ad None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:39.648325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6031c89-a45a-458c-a4cf-61eee22c26ad None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:39.648325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6031c89-a45a-458c-a4cf-61eee22c26ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:39.687289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e328-0ed8-4607-a9a1-b2ebb9af8652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:39.688456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e328-0ed8-4607-a9a1-b2ebb9af8652 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:39.690059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e328-0ed8-4607-a9a1-b2ebb9af8652 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:39.690682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1e328-0ed8-4607-a9a1-b2ebb9af8652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:39.694380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c6031c89-a45a-458c-a4cf-61eee22c26ad None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:39.696488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c6031c89-a45a-458c-a4cf-61eee22c26ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:39.696709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fbd1e328-0ed8-4607-a9a1-b2ebb9af8652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:39.727620 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3152/6329] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:39.728843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6031c89-a45a-458c-a4cf-61eee22c26ad None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:39.748562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6031c89-a45a-458c-a4cf-61eee22c26ad None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:39.761543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731214c-ffa0-4153-9ce1-0040f662f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:39.762266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731214c-ffa0-4153-9ce1-0040f662f777 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:39.762555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731214c-ffa0-4153-9ce1-0040f662f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:39.762837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731214c-ffa0-4153-9ce1-0040f662f777 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:39.764541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731214c-ffa0-4153-9ce1-0040f662f777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:39.764773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731214c-ffa0-4153-9ce1-0040f662f777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:39.766401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731214c-ffa0-4153-9ce1-0040f662f777 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:39.797800 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3153/6330] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:39.802863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731214c-ffa0-4153-9ce1-0040f662f777 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:39.815225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731214c-ffa0-4153-9ce1-0040f662f777 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:39.825088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f3e29-8aeb-49a3-a0e3-560d5488568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:39.826315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3e29-8aeb-49a3-a0e3-560d5488568f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:39.826617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3e29-8aeb-49a3-a0e3-560d5488568f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:39.826891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f3e29-8aeb-49a3-a0e3-560d5488568f admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:39.830996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f3e29-8aeb-49a3-a0e3-560d5488568f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:39.837775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f3e29-8aeb-49a3-a0e3-560d5488568f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:39.878173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1e328-0ed8-4607-a9a1-b2ebb9af8652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:39.880929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1e328-0ed8-4607-a9a1-b2ebb9af8652 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:39.904302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3178/6331] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:05:39.910723 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3154/6332] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:39 2021] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:39.917741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e328-0ed8-4607-a9a1-b2ebb9af8652 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:39.932560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1e328-0ed8-4607-a9a1-b2ebb9af8652 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:40.015722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76369f3d-772a-485c-ad6a-baf61c8c1417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:40.016420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76369f3d-772a-485c-ad6a-baf61c8c1417 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:40.016678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76369f3d-772a-485c-ad6a-baf61c8c1417 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:40.016946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76369f3d-772a-485c-ad6a-baf61c8c1417 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:40.017913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76369f3d-772a-485c-ad6a-baf61c8c1417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:40.022546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76369f3d-772a-485c-ad6a-baf61c8c1417 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:40.054994 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3179/6333] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:39 2021] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:40.059364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f3e29-8aeb-49a3-a0e3-560d5488568f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:40.073667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f3e29-8aeb-49a3-a0e3-560d5488568f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:40.079934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84665370-43be-45d4-9251-25f088458d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:40.081382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84665370-43be-45d4-9251-25f088458d18 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:40.082691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84665370-43be-45d4-9251-25f088458d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:40.083578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84665370-43be-45d4-9251-25f088458d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:40.085244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84665370-43be-45d4-9251-25f088458d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:40.087150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84665370-43be-45d4-9251-25f088458d18 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:40.103763 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3155/6334] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:40 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:40.105233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76369f3d-772a-485c-ad6a-baf61c8c1417 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:40.116867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76369f3d-772a-485c-ad6a-baf61c8c1417 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:40.122779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438e36c-65f6-4f90-9160-828a442f9afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:40.123617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438e36c-65f6-4f90-9160-828a442f9afa admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:40.123846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438e36c-65f6-4f90-9160-828a442f9afa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:40.124124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438e36c-65f6-4f90-9160-828a442f9afa admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:40.124863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438e36c-65f6-4f90-9160-828a442f9afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:40.126669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438e36c-65f6-4f90-9160-828a442f9afa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:40.141462 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3180/6335] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:40 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:40.147122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84665370-43be-45d4-9251-25f088458d18 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:40.167851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84665370-43be-45d4-9251-25f088458d18 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:40.191283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c317-efc4-4ff2-8f42-3602971c6f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:40.193715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c317-efc4-4ff2-8f42-3602971c6f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:40.194605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c317-efc4-4ff2-8f42-3602971c6f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:40.195157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c317-efc4-4ff2-8f42-3602971c6f30 admin admin] PATH_INFO: `/v3/projects/4732694cf811451b8ffabd706cd72965/users/e3dacaf685b54cf89bc9aa4e050b9a74/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:40.226571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c317-efc4-4ff2-8f42-3602971c6f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4732694cf811451b8ffabd706cd72965, user_id=e3dacaf685b54cf89bc9aa4e050b9a74, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:40.230207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c317-efc4-4ff2-8f42-3602971c6f30 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:40.251872 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3156/6336] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:40 2021] PUT /identity/v3/projects/4732694cf811451b8ffabd706cd72965/users/e3dacaf685b54cf89bc9aa4e050b9a74/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:40.264144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5d5ae-ca53-4709-93fe-24a5dbb74875 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:40.264357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5d5ae-ca53-4709-93fe-24a5dbb74875 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:40.264547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5d5ae-ca53-4709-93fe-24a5dbb74875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:40.324032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f9c5d5ae-ca53-4709-93fe-24a5dbb74875 None None] MFA Rules not processed for user `e3dacaf685b54cf89bc9aa4e050b9a74`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:40.325998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f9c5d5ae-ca53-4709-93fe-24a5dbb74875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:40.421531 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3181/6337] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:40 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:40.431883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c317-efc4-4ff2-8f42-3602971c6f30 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:40.436129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0373c317-efc4-4ff2-8f42-3602971c6f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:40.533417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c317-efc4-4ff2-8f42-3602971c6f30 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:40.538308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5cbae-e87a-47fb-961a-caec181e2103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:40.539992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5cbae-e87a-47fb-961a-caec181e2103 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:40.540379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5cbae-e87a-47fb-961a-caec181e2103 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:40.540753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5cbae-e87a-47fb-961a-caec181e2103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:40.553091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5cbae-e87a-47fb-961a-caec181e2103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:40.554721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5cbae-e87a-47fb-961a-caec181e2103 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:40.569534 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3157/6338] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:40 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:40.677784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5d5ae-ca53-4709-93fe-24a5dbb74875 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:40.680358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f9c5d5ae-ca53-4709-93fe-24a5dbb74875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:40.832815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5d5ae-ca53-4709-93fe-24a5dbb74875 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:40.852506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:40.853500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:40.853781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:40.854097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] PATH_INFO: `/v3/projects/dbfbac827796447b839286a63582008b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:40.856451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfbac827796447b839286a63582008b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:40.858303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:40.944666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfbac827796447b839286a63582008b', 'request_id': 'req-84f7c42f-2980-4cd9-869d-7d274bf8c763'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:40.957037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfbac827796447b839286a63582008b', 'request_id': 'req-84f7c42f-2980-4cd9-869d-7d274bf8c763'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:40.980687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfbac827796447b839286a63582008b', 'request_id': 'req-84f7c42f-2980-4cd9-869d-7d274bf8c763'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:41.009735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] The token cache is being invalidate because project dbfbac827796447b839286a63582008b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:41.021871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:41.024092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84f7c42f-2980-4cd9-869d-7d274bf8c763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:41.029316 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3182/6339] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:40 2021] DELETE /identity/v3/projects/dbfbac827796447b839286a63582008b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:41.042333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1e402-2200-4460-88af-470036de3a77 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:41.042628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1e402-2200-4460-88af-470036de3a77 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:41.042920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1e402-2200-4460-88af-470036de3a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:41.075870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-11d1e402-2200-4460-88af-470036de3a77 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:41.088193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-11d1e402-2200-4460-88af-470036de3a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:41.268928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1137ac9-09e5-424f-8e02-00044bf1f93d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:41.269245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1137ac9-09e5-424f-8e02-00044bf1f93d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:41.269576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1137ac9-09e5-424f-8e02-00044bf1f93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:41.271439 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3158/6340] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:41.336948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d1137ac9-09e5-424f-8e02-00044bf1f93d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:41.338298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d1137ac9-09e5-424f-8e02-00044bf1f93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:41.358153 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3183/6341] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:41.359723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1e402-2200-4460-88af-470036de3a77 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:41.396766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1e402-2200-4460-88af-470036de3a77 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:41.417391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4575b4-f3c1-4168-b0fe-ffaa2861c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:41.419002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4575b4-f3c1-4168-b0fe-ffaa2861c022 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:41.419472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4575b4-f3c1-4168-b0fe-ffaa2861c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:41.419895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4575b4-f3c1-4168-b0fe-ffaa2861c022 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:41.420964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4575b4-f3c1-4168-b0fe-ffaa2861c022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:41.421420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4575b4-f3c1-4168-b0fe-ffaa2861c022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:41.430749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4575b4-f3c1-4168-b0fe-ffaa2861c022 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:41.459542 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3159/6342] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:41.463914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1137ac9-09e5-424f-8e02-00044bf1f93d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:41.489694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1137ac9-09e5-424f-8e02-00044bf1f93d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:41.496617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67282384-b347-449b-948b-9b6a56296d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:41.497453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67282384-b347-449b-948b-9b6a56296d9a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:41.497920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67282384-b347-449b-948b-9b6a56296d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:41.498163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67282384-b347-449b-948b-9b6a56296d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:41.498943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67282384-b347-449b-948b-9b6a56296d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:41.502059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67282384-b347-449b-948b-9b6a56296d9a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:41.552402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4575b4-f3c1-4168-b0fe-ffaa2861c022 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:41.553226 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3184/6343] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:41 2021] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:41.568316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4575b4-f3c1-4168-b0fe-ffaa2861c022 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:41.662868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2ac9-b651-47fb-a0b8-59e2449352ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:41.663749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2ac9-b651-47fb-a0b8-59e2449352ee admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:41.664168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2ac9-b651-47fb-a0b8-59e2449352ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:41.664545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e2ac9-b651-47fb-a0b8-59e2449352ee admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:41.665379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e2ac9-b651-47fb-a0b8-59e2449352ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:41.667744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e2ac9-b651-47fb-a0b8-59e2449352ee admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:41.704336 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3160/6344] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:41 2021] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:41.709378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67282384-b347-449b-948b-9b6a56296d9a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:41.723635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67282384-b347-449b-948b-9b6a56296d9a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:41.735976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeb4ca-56ca-4671-83b6-4f664e034df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:41.736784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeb4ca-56ca-4671-83b6-4f664e034df5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:41.737172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeb4ca-56ca-4671-83b6-4f664e034df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:41.737550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeb4ca-56ca-4671-83b6-4f664e034df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:41.738457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeb4ca-56ca-4671-83b6-4f664e034df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:41.744933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeb4ca-56ca-4671-83b6-4f664e034df5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:41.784835 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3185/6345] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:41 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:41.788623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2ac9-b651-47fb-a0b8-59e2449352ee admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:41.799798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e2ac9-b651-47fb-a0b8-59e2449352ee admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:41.806162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609f812-3741-4b01-8d8c-af58848e663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:41.807682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609f812-3741-4b01-8d8c-af58848e663e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:41.807682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609f812-3741-4b01-8d8c-af58848e663e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:41.807682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609f812-3741-4b01-8d8c-af58848e663e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:41.808560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609f812-3741-4b01-8d8c-af58848e663e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:41.810375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609f812-3741-4b01-8d8c-af58848e663e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:41.826259 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3161/6346] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:41 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:41.827182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeb4ca-56ca-4671-83b6-4f664e034df5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:41.845917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeb4ca-56ca-4671-83b6-4f664e034df5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:41.858903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d80d65-3df4-4a6d-985b-114e8fb7ed72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:41.861505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80d65-3df4-4a6d-985b-114e8fb7ed72 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:41.863584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80d65-3df4-4a6d-985b-114e8fb7ed72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:41.863982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d80d65-3df4-4a6d-985b-114e8fb7ed72 admin admin] PATH_INFO: `/v3/projects/aa36fb3c9a9047eb9d284ab88ac00243/users/5e6b743c18364c598348794ec9ab2c26/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:41.896587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d80d65-3df4-4a6d-985b-114e8fb7ed72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa36fb3c9a9047eb9d284ab88ac00243, user_id=5e6b743c18364c598348794ec9ab2c26, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:41.899427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d80d65-3df4-4a6d-985b-114e8fb7ed72 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:41.938786 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3186/6347] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:41 2021] PUT /identity/v3/projects/aa36fb3c9a9047eb9d284ab88ac00243/users/5e6b743c18364c598348794ec9ab2c26/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:41.950523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78885b-836b-4571-98f5-a469a6273f40 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:41.950819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78885b-836b-4571-98f5-a469a6273f40 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:41.953849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78885b-836b-4571-98f5-a469a6273f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:41.986859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5a78885b-836b-4571-98f5-a469a6273f40 None None] MFA Rules not processed for user `5e6b743c18364c598348794ec9ab2c26`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:41.988291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5a78885b-836b-4571-98f5-a469a6273f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:42.088903 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3162/6348] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:41 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:42.092698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d80d65-3df4-4a6d-985b-114e8fb7ed72 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:42.105756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d80d65-3df4-4a6d-985b-114e8fb7ed72 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:42.116459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797f49-93a5-4b4c-b1c8-89591acce376 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:42.117522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797f49-93a5-4b4c-b1c8-89591acce376 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:42.117918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797f49-93a5-4b4c-b1c8-89591acce376 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:42.118307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797f49-93a5-4b4c-b1c8-89591acce376 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:42.119164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797f49-93a5-4b4c-b1c8-89591acce376 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:create_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:42.120594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797f49-93a5-4b4c-b1c8-89591acce376 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:42.154019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5615d4-8aa2-40bf-868f-43c62efebe10 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:42.154575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5615d4-8aa2-40bf-868f-43c62efebe10 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:42.155112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5615d4-8aa2-40bf-868f-43c62efebe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:42.181499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-be5615d4-8aa2-40bf-868f-43c62efebe10 None None] MFA Rules not processed for user `e3dacaf685b54cf89bc9aa4e050b9a74`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:42.183741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-be5615d4-8aa2-40bf-868f-43c62efebe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:42.227465 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3187/6349] 10.222.0.21 () {60 vars in 1313 bytes} [Sat Nov 27 21:05:42 2021] POST /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials => generated 789 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:42.231450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797f49-93a5-4b4c-b1c8-89591acce376 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:42.241985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797f49-93a5-4b4c-b1c8-89591acce376 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:42.248660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e30605-9d0b-4583-9d3e-97728b0bfeaf tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:42.249562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30605-9d0b-4583-9d3e-97728b0bfeaf tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:42.249859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30605-9d0b-4583-9d3e-97728b0bfeaf tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:42.250141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30605-9d0b-4583-9d3e-97728b0bfeaf tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/170bf3a8572f49f0b0021643aee6ed83` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:42.270124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e30605-9d0b-4583-9d3e-97728b0bfeaf tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:get_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26, application_credential_id=170bf3a8572f49f0b0021643aee6ed83)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:42.272144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e30605-9d0b-4583-9d3e-97728b0bfeaf tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:42.274626 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3188/6350] 10.222.0.21 () {58 vars in 1391 bytes} [Sat Nov 27 21:05:42 2021] GET /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/170bf3a8572f49f0b0021643aee6ed83 => generated 689 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:42.275151 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3163/6351] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:42 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:42.281247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7cbda-e35a-4282-9cc6-bf7a0bc08fbf None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:42.281528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7cbda-e35a-4282-9cc6-bf7a0bc08fbf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:42.281809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7cbda-e35a-4282-9cc6-bf7a0bc08fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:42.295795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-75d7cbda-e35a-4282-9cc6-bf7a0bc08fbf None None] MFA Rules not processed for user `5e6b743c18364c598348794ec9ab2c26`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:42.297192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-75d7cbda-e35a-4282-9cc6-bf7a0bc08fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:42.415570 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3189/6352] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:42 2021] POST /identity/v3/auth/tokens => generated 3415 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Nov 27 21:05:42.420090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5615d4-8aa2-40bf-868f-43c62efebe10 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:42.437596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5615d4-8aa2-40bf-868f-43c62efebe10 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:42.441890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8129af-b88a-49d4-8e3e-797023534ab3 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:42.443055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8129af-b88a-49d4-8e3e-797023534ab3 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:42.443563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8129af-b88a-49d4-8e3e-797023534ab3 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:42.443996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8129af-b88a-49d4-8e3e-797023534ab3 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/170bf3a8572f49f0b0021643aee6ed83` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:42.445581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8129af-b88a-49d4-8e3e-797023534ab3 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:delete_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26, application_credential_id=170bf3a8572f49f0b0021643aee6ed83)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:42.447326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8129af-b88a-49d4-8e3e-797023534ab3 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:42.489344 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3164/6353] 10.222.0.21 () {58 vars in 1394 bytes} [Sat Nov 27 21:05:42 2021] DELETE /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/170bf3a8572f49f0b0021643aee6ed83 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:42.497251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7cbda-e35a-4282-9cc6-bf7a0bc08fbf None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:42.508456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7cbda-e35a-4282-9cc6-bf7a0bc08fbf None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:42.512877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567862-0f49-4a40-b2f3-445c142f2812 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:42.513769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567862-0f49-4a40-b2f3-445c142f2812 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:42.514056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567862-0f49-4a40-b2f3-445c142f2812 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:42.514415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567862-0f49-4a40-b2f3-445c142f2812 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:42.515186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567862-0f49-4a40-b2f3-445c142f2812 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:create_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:42.516953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567862-0f49-4a40-b2f3-445c142f2812 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:42.609384 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3190/6354] 10.222.0.21 () {60 vars in 1314 bytes} [Sat Nov 27 21:05:42 2021] POST /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials => generated 921 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:42.614429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8129af-b88a-49d4-8e3e-797023534ab3 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:42.625126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8129af-b88a-49d4-8e3e-797023534ab3 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:42.629882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6d24b-9547-4ea7-9303-d393b353386e tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:42.630832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6d24b-9547-4ea7-9303-d393b353386e tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:42.631117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6d24b-9547-4ea7-9303-d393b353386e tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:42.631591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6d24b-9547-4ea7-9303-d393b353386e tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/4f6974a56d8f4fe59d90ff7c43505eaa` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:42.642605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6d24b-9547-4ea7-9303-d393b353386e tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:delete_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26, application_credential_id=4f6974a56d8f4fe59d90ff7c43505eaa)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:42.644181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6d24b-9547-4ea7-9303-d393b353386e tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:42.667204 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3165/6355] 10.222.0.21 () {58 vars in 1394 bytes} [Sat Nov 27 21:05:42 2021] DELETE /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/4f6974a56d8f4fe59d90ff7c43505eaa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:42.672435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567862-0f49-4a40-b2f3-445c142f2812 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:42.682660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567862-0f49-4a40-b2f3-445c142f2812 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:42.687076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0e27-4e60-4d2c-a301-4a016cfa0ddb tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:42.687979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0e27-4e60-4d2c-a301-4a016cfa0ddb tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:42.688271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0e27-4e60-4d2c-a301-4a016cfa0ddb tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:42.688551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0e27-4e60-4d2c-a301-4a016cfa0ddb tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:42.689306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca0e27-4e60-4d2c-a301-4a016cfa0ddb tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:create_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:42.690461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca0e27-4e60-4d2c-a301-4a016cfa0ddb tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:42.759430 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3191/6356] 10.222.0.21 () {60 vars in 1314 bytes} [Sat Nov 27 21:05:42 2021] POST /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials => generated 813 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:42.763027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6d24b-9547-4ea7-9303-d393b353386e tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:42.772664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6d24b-9547-4ea7-9303-d393b353386e tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:42.777569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e5f98-b9e6-4ad9-bd0f-73d7a695d0ed tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:42.778739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e5f98-b9e6-4ad9-bd0f-73d7a695d0ed tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:42.778876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e5f98-b9e6-4ad9-bd0f-73d7a695d0ed tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:42.779529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e5f98-b9e6-4ad9-bd0f-73d7a695d0ed tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/237cef34119f4f5fafbcbabfac3c52c2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:42.791136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e5f98-b9e6-4ad9-bd0f-73d7a695d0ed tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:delete_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26, application_credential_id=237cef34119f4f5fafbcbabfac3c52c2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:42.792834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e5f98-b9e6-4ad9-bd0f-73d7a695d0ed tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:42.813153 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3166/6357] 10.222.0.21 () {58 vars in 1394 bytes} [Sat Nov 27 21:05:42 2021] DELETE /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/237cef34119f4f5fafbcbabfac3c52c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:42.818300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0e27-4e60-4d2c-a301-4a016cfa0ddb tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:42.827778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0e27-4e60-4d2c-a301-4a016cfa0ddb tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:42.832066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae050c0-fd09-4c4e-9cd5-5bd199462ca9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:42.832927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae050c0-fd09-4c4e-9cd5-5bd199462ca9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:42.833228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae050c0-fd09-4c4e-9cd5-5bd199462ca9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:42.833486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae050c0-fd09-4c4e-9cd5-5bd199462ca9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:42.834232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae050c0-fd09-4c4e-9cd5-5bd199462ca9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:create_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:42.835419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae050c0-fd09-4c4e-9cd5-5bd199462ca9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:42.903568 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3192/6358] 10.222.0.21 () {60 vars in 1313 bytes} [Sat Nov 27 21:05:42 2021] POST /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials => generated 788 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:42.907803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e5f98-b9e6-4ad9-bd0f-73d7a695d0ed tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:42.918189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e5f98-b9e6-4ad9-bd0f-73d7a695d0ed tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:42.922520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b797a00-7352-451e-82df-d4e0e08abd7a tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:42.923426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b797a00-7352-451e-82df-d4e0e08abd7a tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:42.923714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b797a00-7352-451e-82df-d4e0e08abd7a tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:42.923992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b797a00-7352-451e-82df-d4e0e08abd7a tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:42.924732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b797a00-7352-451e-82df-d4e0e08abd7a tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:create_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:42.925944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b797a00-7352-451e-82df-d4e0e08abd7a tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:42.994495 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3167/6359] 10.222.0.21 () {60 vars in 1313 bytes} [Sat Nov 27 21:05:42 2021] POST /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials => generated 789 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:42.998992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae050c0-fd09-4c4e-9cd5-5bd199462ca9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:43.010774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae050c0-fd09-4c4e-9cd5-5bd199462ca9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:43.016528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d06f41-5c66-4d70-8c14-32693acd1750 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:43.017553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d06f41-5c66-4d70-8c14-32693acd1750 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:43.018290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d06f41-5c66-4d70-8c14-32693acd1750 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:43.018290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d06f41-5c66-4d70-8c14-32693acd1750 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:43.019171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d06f41-5c66-4d70-8c14-32693acd1750 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:list_application_credentials(user_id=5e6b743c18364c598348794ec9ab2c26)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:43.021420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d06f41-5c66-4d70-8c14-32693acd1750 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:43.034119 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3193/6360] 10.222.0.21 () {58 vars in 1292 bytes} [Sat Nov 27 21:05:42 2021] GET /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials => generated 1501 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:43.039203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b797a00-7352-451e-82df-d4e0e08abd7a tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:43.049270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b797a00-7352-451e-82df-d4e0e08abd7a tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:43.054998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed26ca2-cfd2-4efa-888d-aae93ac9c8ae tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:43.056135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26ca2-cfd2-4efa-888d-aae93ac9c8ae tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:43.056633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26ca2-cfd2-4efa-888d-aae93ac9c8ae tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:43.056878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed26ca2-cfd2-4efa-888d-aae93ac9c8ae tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/e79db5e356c34943b333468d78c7e9f6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:43.066541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed26ca2-cfd2-4efa-888d-aae93ac9c8ae tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:delete_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26, application_credential_id=e79db5e356c34943b333468d78c7e9f6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:43.068440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed26ca2-cfd2-4efa-888d-aae93ac9c8ae tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:43.095934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d06f41-5c66-4d70-8c14-32693acd1750 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:43.098283 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3168/6361] 10.222.0.21 () {58 vars in 1394 bytes} [Sat Nov 27 21:05:43 2021] DELETE /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/e79db5e356c34943b333468d78c7e9f6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:43.107743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d06f41-5c66-4d70-8c14-32693acd1750 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:43.112270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56203e7-047b-4ab1-a456-85470d91e6c9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:43.113377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56203e7-047b-4ab1-a456-85470d91e6c9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:43.113733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56203e7-047b-4ab1-a456-85470d91e6c9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:43.114080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56203e7-047b-4ab1-a456-85470d91e6c9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/f4bd05ac676348489cb28da1d955ad40` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:43.124570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56203e7-047b-4ab1-a456-85470d91e6c9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:delete_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26, application_credential_id=f4bd05ac676348489cb28da1d955ad40)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:43.126258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56203e7-047b-4ab1-a456-85470d91e6c9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:43.153961 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3194/6362] 10.222.0.21 () {58 vars in 1394 bytes} [Sat Nov 27 21:05:43 2021] DELETE /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/f4bd05ac676348489cb28da1d955ad40 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:43.159084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed26ca2-cfd2-4efa-888d-aae93ac9c8ae tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:43.169246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed26ca2-cfd2-4efa-888d-aae93ac9c8ae tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:43.173452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6b3a0-c8ec-485b-91c9-0344f927f020 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:43.174310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b3a0-c8ec-485b-91c9-0344f927f020 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:43.174596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b3a0-c8ec-485b-91c9-0344f927f020 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:43.174873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b3a0-c8ec-485b-91c9-0344f927f020 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:43.175688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6b3a0-c8ec-485b-91c9-0344f927f020 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:create_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:43.176992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6b3a0-c8ec-485b-91c9-0344f927f020 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:43.256990 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3169/6363] 10.222.0.21 () {60 vars in 1313 bytes} [Sat Nov 27 21:05:43 2021] POST /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials => generated 788 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:43.261502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56203e7-047b-4ab1-a456-85470d91e6c9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:43.272688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56203e7-047b-4ab1-a456-85470d91e6c9 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:43.277172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f4b43-8722-4558-8d6b-25afe70a57dd tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:43.278039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4b43-8722-4558-8d6b-25afe70a57dd tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:43.278323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4b43-8722-4558-8d6b-25afe70a57dd tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:43.278598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f4b43-8722-4558-8d6b-25afe70a57dd tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:43.279367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f4b43-8722-4558-8d6b-25afe70a57dd tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:create_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:43.280704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f4b43-8722-4558-8d6b-25afe70a57dd tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:43.366086 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3195/6364] 10.222.0.21 () {60 vars in 1313 bytes} [Sat Nov 27 21:05:43 2021] POST /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials => generated 789 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:43.370361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6b3a0-c8ec-485b-91c9-0344f927f020 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:43.386070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6b3a0-c8ec-485b-91c9-0344f927f020 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:43.399309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ba102-e292-4b03-ba1c-c91e56bb4457 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:43.400293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ba102-e292-4b03-ba1c-c91e56bb4457 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:43.400649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ba102-e292-4b03-ba1c-c91e56bb4457 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:43.401023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ba102-e292-4b03-ba1c-c91e56bb4457 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:43.402090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ba102-e292-4b03-ba1c-c91e56bb4457 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Adding query filter params (name=tempest-application_credential-1058483031) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:43.402460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ba102-e292-4b03-ba1c-c91e56bb4457 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:list_application_credentials(user_id=5e6b743c18364c598348794ec9ab2c26)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:43.405377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ba102-e292-4b03-ba1c-c91e56bb4457 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:43.419803 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3170/6365] 10.222.0.21 () {58 vars in 1385 bytes} [Sat Nov 27 21:05:43 2021] GET /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials?name=tempest-application_credential-1058483031 => generated 887 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:43.425820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f4b43-8722-4558-8d6b-25afe70a57dd tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:43.440360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f4b43-8722-4558-8d6b-25afe70a57dd tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:43.446571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47cc0-1c80-4089-848a-07e075ed5b67 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:43.447809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47cc0-1c80-4089-848a-07e075ed5b67 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:43.448271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47cc0-1c80-4089-848a-07e075ed5b67 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:43.448650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47cc0-1c80-4089-848a-07e075ed5b67 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/eefc54d7d78a4316b476e142b4d164ef` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:43.460132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a47cc0-1c80-4089-848a-07e075ed5b67 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:delete_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26, application_credential_id=eefc54d7d78a4316b476e142b4d164ef)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:43.461939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a47cc0-1c80-4089-848a-07e075ed5b67 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:43.493051 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3196/6366] 10.222.0.21 () {58 vars in 1394 bytes} [Sat Nov 27 21:05:43 2021] DELETE /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/eefc54d7d78a4316b476e142b4d164ef => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:43.494176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ba102-e292-4b03-ba1c-c91e56bb4457 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:43.519869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ba102-e292-4b03-ba1c-c91e56bb4457 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:43.533063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52cb3a-4ae3-43a7-b184-fee9a7f2a841 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e6b743c18364c598348794ec9ab2c26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa36fb3c9a9047eb9d284ab88ac00243', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:43.534103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52cb3a-4ae3-43a7-b184-fee9a7f2a841 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:43.534436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52cb3a-4ae3-43a7-b184-fee9a7f2a841 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:43.534719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52cb3a-4ae3-43a7-b184-fee9a7f2a841 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/30ca39c9bb5b476386dfaecda8f1feb3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:43.547945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52cb3a-4ae3-43a7-b184-fee9a7f2a841 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorizing `identity:delete_application_credential(user_id=5e6b743c18364c598348794ec9ab2c26, application_credential_id=30ca39c9bb5b476386dfaecda8f1feb3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:43.552522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52cb3a-4ae3-43a7-b184-fee9a7f2a841 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:43.592905 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3171/6367] 10.222.0.21 () {58 vars in 1394 bytes} [Sat Nov 27 21:05:43 2021] DELETE /identity/v3/users/5e6b743c18364c598348794ec9ab2c26/application_credentials/30ca39c9bb5b476386dfaecda8f1feb3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:43.597769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47cc0-1c80-4089-848a-07e075ed5b67 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:43.760220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47cc0-1c80-4089-848a-07e075ed5b67 tempest-ApplicationCredentialsV3Test-654203277 tempest-ApplicationCredentialsV3Test-654203277-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:43.766151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:43.766959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:43.767243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:43.767549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] PATH_INFO: `/v3/users/5e6b743c18364c598348794ec9ab2c26` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:43.768796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6b743c18364c598348794ec9ab2c26)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:43.771996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:43.882240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6b743c18364c598348794ec9ab2c26'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:43.894902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6b743c18364c598348794ec9ab2c26'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:43.897719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6b743c18364c598348794ec9ab2c26'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:43.906480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6b743c18364c598348794ec9ab2c26'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:43.946724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6b743c18364c598348794ec9ab2c26'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:43.957362 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3197/6368] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:43 2021] DELETE /identity/v3/users/5e6b743c18364c598348794ec9ab2c26 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:43.963127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762e3e1-3cac-4878-9e13-50774dd924ea None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:43.963700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762e3e1-3cac-4878-9e13-50774dd924ea None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:43.964247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762e3e1-3cac-4878-9e13-50774dd924ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:44.017073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d762e3e1-3cac-4878-9e13-50774dd924ea None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:44.020437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d762e3e1-3cac-4878-9e13-50774dd924ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:44.123501 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3172/6369] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:44.168895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:44.171465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:44.305228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fded4-2b14-4879-bc8f-3e37eded6bf7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:44.310068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e49cfc-c896-4e5f-83fa-7b8420503a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:44.310883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e49cfc-c896-4e5f-83fa-7b8420503a67 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:44.311384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e49cfc-c896-4e5f-83fa-7b8420503a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:44.311825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e49cfc-c896-4e5f-83fa-7b8420503a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:44.324494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e49cfc-c896-4e5f-83fa-7b8420503a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:44.326439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e49cfc-c896-4e5f-83fa-7b8420503a67 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:44.338044 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3198/6370] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:45.195580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762e3e1-3cac-4878-9e13-50774dd924ea None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:45.197312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d762e3e1-3cac-4878-9e13-50774dd924ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:45.219026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762e3e1-3cac-4878-9e13-50774dd924ea None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:45.235246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:45.236933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:45.237433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:45.238474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] PATH_INFO: `/v3/projects/aa36fb3c9a9047eb9d284ab88ac00243` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:45.239963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa36fb3c9a9047eb9d284ab88ac00243)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:45.242149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:45.330718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa36fb3c9a9047eb9d284ab88ac00243', 'request_id': 'req-5fa9b63c-14db-456c-8481-83daf121e217'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:45.344365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa36fb3c9a9047eb9d284ab88ac00243', 'request_id': 'req-5fa9b63c-14db-456c-8481-83daf121e217'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:45.355535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa36fb3c9a9047eb9d284ab88ac00243', 'request_id': 'req-5fa9b63c-14db-456c-8481-83daf121e217'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:45.372489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] The token cache is being invalidate because project aa36fb3c9a9047eb9d284ab88ac00243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:45.376188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:45.379812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5fa9b63c-14db-456c-8481-83daf121e217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:45.385184 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3173/6371] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:45 2021] DELETE /identity/v3/projects/aa36fb3c9a9047eb9d284ab88ac00243 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:45.393302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7af152-86d1-47e8-83f5-38b75d3a9bdf None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:45.394533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7af152-86d1-47e8-83f5-38b75d3a9bdf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:45.395032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7af152-86d1-47e8-83f5-38b75d3a9bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:45.434165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7a7af152-86d1-47e8-83f5-38b75d3a9bdf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:45.436549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7a7af152-86d1-47e8-83f5-38b75d3a9bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:45.524168 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3199/6372] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:45.535668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83395-9ce5-4e83-bbd1-549fac7dae77 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:45.539939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83395-9ce5-4e83-bbd1-549fac7dae77 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:45.540350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83395-9ce5-4e83-bbd1-549fac7dae77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:45.591861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e4c83395-9ce5-4e83-bbd1-549fac7dae77 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:45.596766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e4c83395-9ce5-4e83-bbd1-549fac7dae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:45.610857 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3174/6373] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:45.615542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7af152-86d1-47e8-83f5-38b75d3a9bdf None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:45.626227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7af152-86d1-47e8-83f5-38b75d3a9bdf None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:45.632078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874eb1c6-db4c-410e-a43c-05b99ec5392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:45.633012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eb1c6-db4c-410e-a43c-05b99ec5392e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:45.633531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eb1c6-db4c-410e-a43c-05b99ec5392e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:45.634015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eb1c6-db4c-410e-a43c-05b99ec5392e admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:45.634991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874eb1c6-db4c-410e-a43c-05b99ec5392e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:45.635416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874eb1c6-db4c-410e-a43c-05b99ec5392e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:45.637287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874eb1c6-db4c-410e-a43c-05b99ec5392e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:45.653917 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3200/6374] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:45.658852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c83395-9ce5-4e83-bbd1-549fac7dae77 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:45.669942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c83395-9ce5-4e83-bbd1-549fac7dae77 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:45.676897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603384bd-9e8e-4032-a1d5-d1fa9121e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:45.677627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603384bd-9e8e-4032-a1d5-d1fa9121e5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:45.677914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603384bd-9e8e-4032-a1d5-d1fa9121e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:45.678828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603384bd-9e8e-4032-a1d5-d1fa9121e5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:45.678951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603384bd-9e8e-4032-a1d5-d1fa9121e5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:45.681421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603384bd-9e8e-4032-a1d5-d1fa9121e5d5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:45.724660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874eb1c6-db4c-410e-a43c-05b99ec5392e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:45.727423 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3175/6375] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:45 2021] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:45.750853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874eb1c6-db4c-410e-a43c-05b99ec5392e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:45.851124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3166bf6-63a8-4dd5-b76c-7894620e6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:45.852287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3166bf6-63a8-4dd5-b76c-7894620e6374 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:45.852287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3166bf6-63a8-4dd5-b76c-7894620e6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:45.852575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3166bf6-63a8-4dd5-b76c-7894620e6374 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:45.853607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3166bf6-63a8-4dd5-b76c-7894620e6374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:45.855768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3166bf6-63a8-4dd5-b76c-7894620e6374 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:45.889635 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3201/6376] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:45 2021] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:45.894761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603384bd-9e8e-4032-a1d5-d1fa9121e5d5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:45.909511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603384bd-9e8e-4032-a1d5-d1fa9121e5d5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:45.916350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1aa0-cb83-49fc-a0e3-792c18c12811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:45.917006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1aa0-cb83-49fc-a0e3-792c18c12811 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:45.917292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1aa0-cb83-49fc-a0e3-792c18c12811 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:45.917564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c1aa0-cb83-49fc-a0e3-792c18c12811 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:45.918572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c1aa0-cb83-49fc-a0e3-792c18c12811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:45.920306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c1aa0-cb83-49fc-a0e3-792c18c12811 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:45.937727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3166bf6-63a8-4dd5-b76c-7894620e6374 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:45.938681 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3176/6377] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:45 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:45.951095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3166bf6-63a8-4dd5-b76c-7894620e6374 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:45.961154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f5117-eb06-4d75-bb64-12df211c649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:45.961840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f5117-eb06-4d75-bb64-12df211c649b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:45.962122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f5117-eb06-4d75-bb64-12df211c649b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:45.962393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f5117-eb06-4d75-bb64-12df211c649b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:45.965181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f5117-eb06-4d75-bb64-12df211c649b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:45.966835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f5117-eb06-4d75-bb64-12df211c649b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:45.994463 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3202/6378] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:45 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:45.996302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1aa0-cb83-49fc-a0e3-792c18c12811 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:46.010347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c1aa0-cb83-49fc-a0e3-792c18c12811 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:46.018301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ed14e-faa8-46c5-a2ac-6fce3308100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:46.021797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ed14e-faa8-46c5-a2ac-6fce3308100a admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:46.022493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ed14e-faa8-46c5-a2ac-6fce3308100a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:46.023007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ed14e-faa8-46c5-a2ac-6fce3308100a admin admin] PATH_INFO: `/v3/projects/5fa45d95e84d4ccf8ae0b8d74b37f624/users/e848febd3679437cb0e60ac1865267c9/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:46.069533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ed14e-faa8-46c5-a2ac-6fce3308100a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa45d95e84d4ccf8ae0b8d74b37f624, user_id=e848febd3679437cb0e60ac1865267c9, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:46.079970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ed14e-faa8-46c5-a2ac-6fce3308100a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:46.114403 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3177/6379] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:45 2021] PUT /identity/v3/projects/5fa45d95e84d4ccf8ae0b8d74b37f624/users/e848febd3679437cb0e60ac1865267c9/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:46.125101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f79f94-b1ce-4a4d-992d-07866c917ed4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:46.125395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f79f94-b1ce-4a4d-992d-07866c917ed4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:46.125681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f79f94-b1ce-4a4d-992d-07866c917ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:46.177105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f9f79f94-b1ce-4a4d-992d-07866c917ed4 None None] MFA Rules not processed for user `e848febd3679437cb0e60ac1865267c9`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:46.179584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f9f79f94-b1ce-4a4d-992d-07866c917ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:46.368338 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3203/6380] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:46 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:46.369334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ed14e-faa8-46c5-a2ac-6fce3308100a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:46.481262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ed14e-faa8-46c5-a2ac-6fce3308100a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:46.486087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba9c02-da9f-493e-9aee-1e8a1a012e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:46.486754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba9c02-da9f-493e-9aee-1e8a1a012e12 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:46.487038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba9c02-da9f-493e-9aee-1e8a1a012e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:46.487347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba9c02-da9f-493e-9aee-1e8a1a012e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:46.488116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba9c02-da9f-493e-9aee-1e8a1a012e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:46.490071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba9c02-da9f-493e-9aee-1e8a1a012e12 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:46.527469 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3178/6381] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:46 2021] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:46.529430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f79f94-b1ce-4a4d-992d-07866c917ed4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:46.542897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f79f94-b1ce-4a4d-992d-07866c917ed4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:46.608358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869575de-6cff-4bbe-ad7b-c630737d1a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:46.609033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869575de-6cff-4bbe-ad7b-c630737d1a38 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:46.609328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869575de-6cff-4bbe-ad7b-c630737d1a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:46.609605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869575de-6cff-4bbe-ad7b-c630737d1a38 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:46.610405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869575de-6cff-4bbe-ad7b-c630737d1a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:46.614120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba9c02-da9f-493e-9aee-1e8a1a012e12 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:46.615836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dfba9c02-da9f-493e-9aee-1e8a1a012e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:46.623651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869575de-6cff-4bbe-ad7b-c630737d1a38 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:46.633829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba9c02-da9f-493e-9aee-1e8a1a012e12 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:46.645240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153eb8a-066c-4014-81ef-b6fcde6c2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:46.646400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153eb8a-066c-4014-81ef-b6fcde6c2882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:46.646849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153eb8a-066c-4014-81ef-b6fcde6c2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:46.647132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153eb8a-066c-4014-81ef-b6fcde6c2882 admin admin] PATH_INFO: `/v3/users/6f916a8692ba40bba0fae64d4d9601d2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:46.648616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153eb8a-066c-4014-81ef-b6fcde6c2882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f916a8692ba40bba0fae64d4d9601d2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:46.649410 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3204/6382] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:46 2021] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:46.650801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153eb8a-066c-4014-81ef-b6fcde6c2882 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:46.652863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869575de-6cff-4bbe-ad7b-c630737d1a38 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:46.662917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869575de-6cff-4bbe-ad7b-c630737d1a38 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:46.668256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48942a03-f44e-4631-8bbd-7242b217fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:46.669159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48942a03-f44e-4631-8bbd-7242b217fbce admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:46.669600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48942a03-f44e-4631-8bbd-7242b217fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:46.670029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48942a03-f44e-4631-8bbd-7242b217fbce admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:46.671235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48942a03-f44e-4631-8bbd-7242b217fbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:46.673261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48942a03-f44e-4631-8bbd-7242b217fbce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:46.686042 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3205/6383] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:46 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:46.690074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48942a03-f44e-4631-8bbd-7242b217fbce admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:46.706943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48942a03-f44e-4631-8bbd-7242b217fbce admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:46.713516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef0ba-3a5f-4e3c-9cb2-9eda4a2d4310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:46.714556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7153eb8a-066c-4014-81ef-b6fcde6c2882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f916a8692ba40bba0fae64d4d9601d2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:46.714679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef0ba-3a5f-4e3c-9cb2-9eda4a2d4310 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:46.715089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef0ba-3a5f-4e3c-9cb2-9eda4a2d4310 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:46.715379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7153eb8a-066c-4014-81ef-b6fcde6c2882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f916a8692ba40bba0fae64d4d9601d2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:46.715524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef0ba-3a5f-4e3c-9cb2-9eda4a2d4310 admin admin] PATH_INFO: `/v3/projects/1c559ed7c130437588dcea9d3e1373b9/users/14416ce8454046bf997883f826b43ec7/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:46.724925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7153eb8a-066c-4014-81ef-b6fcde6c2882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f916a8692ba40bba0fae64d4d9601d2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:46.725853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7153eb8a-066c-4014-81ef-b6fcde6c2882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f916a8692ba40bba0fae64d4d9601d2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:46.733428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7153eb8a-066c-4014-81ef-b6fcde6c2882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f916a8692ba40bba0fae64d4d9601d2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:46.733668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ef0ba-3a5f-4e3c-9cb2-9eda4a2d4310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c559ed7c130437588dcea9d3e1373b9, user_id=14416ce8454046bf997883f826b43ec7, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:46.736555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ef0ba-3a5f-4e3c-9cb2-9eda4a2d4310 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:46.757393 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3206/6384] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:46 2021] PUT /identity/v3/projects/1c559ed7c130437588dcea9d3e1373b9/users/14416ce8454046bf997883f826b43ec7/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:46.761248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef0ba-3a5f-4e3c-9cb2-9eda4a2d4310 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:46.762150 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3179/6385] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:46 2021] DELETE /identity/v3/users/6f916a8692ba40bba0fae64d4d9601d2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:46.763156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-919ef0ba-3a5f-4e3c-9cb2-9eda4a2d4310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:46.766132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7799332-5055-4037-8590-1c1772f1ef01 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:46.766422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7799332-5055-4037-8590-1c1772f1ef01 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:46.766694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7799332-5055-4037-8590-1c1772f1ef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:46.784640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f7799332-5055-4037-8590-1c1772f1ef01 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:46.785874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f7799332-5055-4037-8590-1c1772f1ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:46.842858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef0ba-3a5f-4e3c-9cb2-9eda4a2d4310 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:46.864506 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3180/6386] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:46.875894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7799332-5055-4037-8590-1c1772f1ef01 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:46.877296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f7799332-5055-4037-8590-1c1772f1ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:46.930743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a834-ad22-4f21-87c7-f770ef3be267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:46.931790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a834-ad22-4f21-87c7-f770ef3be267 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:46.931790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a834-ad22-4f21-87c7-f770ef3be267 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:46.932061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a834-ad22-4f21-87c7-f770ef3be267 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:46.932807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0a834-ad22-4f21-87c7-f770ef3be267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:46.934411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0a834-ad22-4f21-87c7-f770ef3be267 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:46.951290 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3207/6387] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:46 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:46.961047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a834-ad22-4f21-87c7-f770ef3be267 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:46.965361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7799332-5055-4037-8590-1c1772f1ef01 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:46.969407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4427b8-1ebe-4ca3-a0b9-0d766cde3a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:46.970281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4427b8-1ebe-4ca3-a0b9-0d766cde3a68 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:46.970583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4427b8-1ebe-4ca3-a0b9-0d766cde3a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:46.970864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4427b8-1ebe-4ca3-a0b9-0d766cde3a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:46.972959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a834-ad22-4f21-87c7-f770ef3be267 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:46.978790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df98889-e8d0-433c-a5e5-1792962549b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:46.979554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df98889-e8d0-433c-a5e5-1792962549b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:46.979831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df98889-e8d0-433c-a5e5-1792962549b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:46.980112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df98889-e8d0-433c-a5e5-1792962549b7 admin admin] PATH_INFO: `/v3/projects/1c559ed7c130437588dcea9d3e1373b9/users/14416ce8454046bf997883f826b43ec7/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:46.982199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df98889-e8d0-433c-a5e5-1792962549b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c559ed7c130437588dcea9d3e1373b9, user_id=14416ce8454046bf997883f826b43ec7, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:46.982644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4427b8-1ebe-4ca3-a0b9-0d766cde3a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:46.984376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4427b8-1ebe-4ca3-a0b9-0d766cde3a68 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:46.984895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df98889-e8d0-433c-a5e5-1792962549b7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:46.997529 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3181/6388] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:47.005322 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3208/6389] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:46 2021] PUT /identity/v3/projects/1c559ed7c130437588dcea9d3e1373b9/users/14416ce8454046bf997883f826b43ec7/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:47.096679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c3166-c680-4e48-a5a9-a5864e0ca86e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:47.097822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c3166-c680-4e48-a5a9-a5864e0ca86e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:47.098633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c3166-c680-4e48-a5a9-a5864e0ca86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:47.134585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d11c3166-c680-4e48-a5a9-a5864e0ca86e None None] MFA Rules not processed for user `14416ce8454046bf997883f826b43ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:47.136407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d11c3166-c680-4e48-a5a9-a5864e0ca86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:47.218426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df98889-e8d0-433c-a5e5-1792962549b7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:47.221979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9df98889-e8d0-433c-a5e5-1792962549b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:47.242812 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3182/6390] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:47 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:47.244047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c3166-c680-4e48-a5a9-a5864e0ca86e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:47.255732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c3166-c680-4e48-a5a9-a5864e0ca86e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:47.260968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09a00c-4855-4358-ac00-fe3da5b00d70 tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14416ce8454046bf997883f826b43ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c559ed7c130437588dcea9d3e1373b9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:47.261633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09a00c-4855-4358-ac00-fe3da5b00d70 tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:47.262109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09a00c-4855-4358-ac00-fe3da5b00d70 tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:47.262521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09a00c-4855-4358-ac00-fe3da5b00d70 tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:47.263964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09a00c-4855-4358-ac00-fe3da5b00d70 tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:47.264285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09a00c-4855-4358-ac00-fe3da5b00d70 tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:47.265913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09a00c-4855-4358-ac00-fe3da5b00d70 tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:47.288328 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3183/6391] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:47.293412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09a00c-4855-4358-ac00-fe3da5b00d70 tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:47.324540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09a00c-4855-4358-ac00-fe3da5b00d70 tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:47.347753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7624a40-6a26-4b43-ab39-7365b58f5d6b tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14416ce8454046bf997883f826b43ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c559ed7c130437588dcea9d3e1373b9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:47.347753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7624a40-6a26-4b43-ab39-7365b58f5d6b tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:47.347753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7624a40-6a26-4b43-ab39-7365b58f5d6b tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:47.348216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7624a40-6a26-4b43-ab39-7365b58f5d6b tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:47.348216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7624a40-6a26-4b43-ab39-7365b58f5d6b tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:47.351551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7624a40-6a26-4b43-ab39-7365b58f5d6b tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:47.377259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df98889-e8d0-433c-a5e5-1792962549b7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:47.392328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:47.393314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:47.393625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:47.393939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] PATH_INFO: `/v3/projects/43d96f70dd574c329276ab3646183310` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:47.395863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d96f70dd574c329276ab3646183310)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:47.399845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:47.439027 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3184/6392] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:47 2021] POST /identity/v3/projects => generated 348 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:47.445178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7624a40-6a26-4b43-ab39-7365b58f5d6b tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:47.507042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d96f70dd574c329276ab3646183310', 'request_id': 'req-30f60659-e686-44e6-bda8-e6229da10b55'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:47.522626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d96f70dd574c329276ab3646183310', 'request_id': 'req-30f60659-e686-44e6-bda8-e6229da10b55'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:47.539720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d96f70dd574c329276ab3646183310', 'request_id': 'req-30f60659-e686-44e6-bda8-e6229da10b55'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:47.553893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] The token cache is being invalidate because project 43d96f70dd574c329276ab3646183310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:47.554186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:47.555082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30f60659-e686-44e6-bda8-e6229da10b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:47.557134 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3209/6393] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:47 2021] DELETE /identity/v3/projects/43d96f70dd574c329276ab3646183310 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:47.562468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff72c-1ae6-4054-8f6a-a0d81f4a1ac1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:47.563274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff72c-1ae6-4054-8f6a-a0d81f4a1ac1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:47.563723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff72c-1ae6-4054-8f6a-a0d81f4a1ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:47.582522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7624a40-6a26-4b43-ab39-7365b58f5d6b tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:47.586178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a4fff72c-1ae6-4054-8f6a-a0d81f4a1ac1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:47.587699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a4fff72c-1ae6-4054-8f6a-a0d81f4a1ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:47.670183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f9489-2ecd-4bae-a697-50b64798fcdb tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14416ce8454046bf997883f826b43ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c559ed7c130437588dcea9d3e1373b9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:47.670999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f9489-2ecd-4bae-a697-50b64798fcdb tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:47.671186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f9489-2ecd-4bae-a697-50b64798fcdb tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:47.671502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f9489-2ecd-4bae-a697-50b64798fcdb tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:47.672633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f9489-2ecd-4bae-a697-50b64798fcdb tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:47.672954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f9489-2ecd-4bae-a697-50b64798fcdb tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:47.674783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f9489-2ecd-4bae-a697-50b64798fcdb tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:47.693725 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3185/6394] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:47.701566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f9489-2ecd-4bae-a697-50b64798fcdb tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:47.703350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-285f9489-2ecd-4bae-a697-50b64798fcdb tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:47.711513 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3210/6395] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:47.719028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f702-58de-46d2-b3d5-66b6b37dfd36 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:47.719356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f702-58de-46d2-b3d5-66b6b37dfd36 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:47.719642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f702-58de-46d2-b3d5-66b6b37dfd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:47.740644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-54b3f702-58de-46d2-b3d5-66b6b37dfd36 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:47.741860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-54b3f702-58de-46d2-b3d5-66b6b37dfd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:47.753359 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3211/6396] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:05:47.766105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f702-58de-46d2-b3d5-66b6b37dfd36 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:47.777694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f702-58de-46d2-b3d5-66b6b37dfd36 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:47.782814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21541f6f-e70e-4ac0-8d5c-1fcef50713f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:47.783523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21541f6f-e70e-4ac0-8d5c-1fcef50713f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:47.783809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21541f6f-e70e-4ac0-8d5c-1fcef50713f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:47.784088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21541f6f-e70e-4ac0-8d5c-1fcef50713f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:47.784884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21541f6f-e70e-4ac0-8d5c-1fcef50713f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:47.785474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21541f6f-e70e-4ac0-8d5c-1fcef50713f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:47.787278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21541f6f-e70e-4ac0-8d5c-1fcef50713f2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:47.794017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f9489-2ecd-4bae-a697-50b64798fcdb tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:47.802030 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3212/6397] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:47.806387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21541f6f-e70e-4ac0-8d5c-1fcef50713f2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:47.812605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1971a88-90c0-4f73-ae9e-e842bfb3ec43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:47.813521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1971a88-90c0-4f73-ae9e-e842bfb3ec43 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:47.814100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1971a88-90c0-4f73-ae9e-e842bfb3ec43 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:47.814361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1971a88-90c0-4f73-ae9e-e842bfb3ec43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:47.822871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e1971a88-90c0-4f73-ae9e-e842bfb3ec43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:47.854387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1971a88-90c0-4f73-ae9e-e842bfb3ec43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:47.855923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1971a88-90c0-4f73-ae9e-e842bfb3ec43 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:47.868502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21541f6f-e70e-4ac0-8d5c-1fcef50713f2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:47.875543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9630092-fe5a-4775-b99a-2ceb204b0bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:47.876219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9630092-fe5a-4775-b99a-2ceb204b0bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:47.876503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9630092-fe5a-4775-b99a-2ceb204b0bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:47.876777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9630092-fe5a-4775-b99a-2ceb204b0bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:47.877490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9630092-fe5a-4775-b99a-2ceb204b0bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:47.880266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9630092-fe5a-4775-b99a-2ceb204b0bd7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:47.892637 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3186/6398] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:47 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:47.928961 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3213/6399] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:47 2021] POST /identity/v3/projects => generated 357 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:47.932875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1971a88-90c0-4f73-ae9e-e842bfb3ec43 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:47.949811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1971a88-90c0-4f73-ae9e-e842bfb3ec43 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:48.071670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a6834-d0fb-440d-ba63-791e7b14afc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:48.072905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6834-d0fb-440d-ba63-791e7b14afc5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:48.073375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6834-d0fb-440d-ba63-791e7b14afc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:48.073804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a6834-d0fb-440d-ba63-791e7b14afc5 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:48.074708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a6834-d0fb-440d-ba63-791e7b14afc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:48.077440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a6834-d0fb-440d-ba63-791e7b14afc5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:48.105839 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3187/6400] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:47 2021] POST /identity/v3/users => generated 279 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:48.106924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9630092-fe5a-4775-b99a-2ceb204b0bd7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:48.119416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9630092-fe5a-4775-b99a-2ceb204b0bd7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:48.127648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48e46c-93d4-4be7-ad93-541121372f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:48.128465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e46c-93d4-4be7-ad93-541121372f1e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:48.129300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e46c-93d4-4be7-ad93-541121372f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:48.129646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e46c-93d4-4be7-ad93-541121372f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:48.130482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48e46c-93d4-4be7-ad93-541121372f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:48.132197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48e46c-93d4-4be7-ad93-541121372f1e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:48.142932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3214/6401] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:48.147723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a6834-d0fb-440d-ba63-791e7b14afc5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:48.157492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a6834-d0fb-440d-ba63-791e7b14afc5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:48.162769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77002659-c478-4cf4-9310-1cb9268b9a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:48.163456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77002659-c478-4cf4-9310-1cb9268b9a03 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:48.163737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77002659-c478-4cf4-9310-1cb9268b9a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:48.164066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77002659-c478-4cf4-9310-1cb9268b9a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:48.164796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77002659-c478-4cf4-9310-1cb9268b9a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:48.166389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77002659-c478-4cf4-9310-1cb9268b9a03 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:48.179420 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3188/6402] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:48 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:48.182239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48e46c-93d4-4be7-ad93-541121372f1e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:48.195701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48e46c-93d4-4be7-ad93-541121372f1e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:48.202316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f43b78-a338-4462-92fc-87d3ffa935d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:48.203328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43b78-a338-4462-92fc-87d3ffa935d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:48.203620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43b78-a338-4462-92fc-87d3ffa935d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:48.203899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f43b78-a338-4462-92fc-87d3ffa935d6 admin admin] PATH_INFO: `/v3/projects/08c3aa90c56842e4933bcaf0284cbc43/users/52809bdbaa7a49da830722fbb54e9a7d/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:48.221609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f43b78-a338-4462-92fc-87d3ffa935d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c3aa90c56842e4933bcaf0284cbc43, user_id=52809bdbaa7a49da830722fbb54e9a7d, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:48.225061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f43b78-a338-4462-92fc-87d3ffa935d6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:48.240316 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3215/6403] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:48 2021] PUT /identity/v3/projects/08c3aa90c56842e4933bcaf0284cbc43/users/52809bdbaa7a49da830722fbb54e9a7d/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:48.251493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5696516-785d-4b4d-a515-a2e8e1eacaa9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:48.251839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5696516-785d-4b4d-a515-a2e8e1eacaa9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:48.252141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5696516-785d-4b4d-a515-a2e8e1eacaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:48.284370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b5696516-785d-4b4d-a515-a2e8e1eacaa9 None None] MFA Rules not processed for user `52809bdbaa7a49da830722fbb54e9a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:48.286240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b5696516-785d-4b4d-a515-a2e8e1eacaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:48.363686 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3189/6404] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:48 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:48.402085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f43b78-a338-4462-92fc-87d3ffa935d6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:48.405031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-98f43b78-a338-4462-92fc-87d3ffa935d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:48.493535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f43b78-a338-4462-92fc-87d3ffa935d6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:48.498193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c46ae-a22a-4155-b7fc-b78160d119a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:48.499017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c46ae-a22a-4155-b7fc-b78160d119a3 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:48.499380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c46ae-a22a-4155-b7fc-b78160d119a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:48.499862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c46ae-a22a-4155-b7fc-b78160d119a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:48.511632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c46ae-a22a-4155-b7fc-b78160d119a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:48.513457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c46ae-a22a-4155-b7fc-b78160d119a3 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:48.526529 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3216/6405] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:48 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:50.220157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5696516-785d-4b4d-a515-a2e8e1eacaa9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:50.308396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5696516-785d-4b4d-a515-a2e8e1eacaa9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:50.316155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14416ce8454046bf997883f826b43ec7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c559ed7c130437588dcea9d3e1373b9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:50.317083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:50.317424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:50.317717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] PATH_INFO: `/v3/projects/6b495595d69648f09d3c68320b5b1d15` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:50.319081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6b495595d69648f09d3c68320b5b1d15)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:50.321764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:50.377947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b495595d69648f09d3c68320b5b1d15', 'request_id': 'req-c74653d5-64ba-478f-a021-c4dc6851968a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:50.387830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b495595d69648f09d3c68320b5b1d15', 'request_id': 'req-c74653d5-64ba-478f-a021-c4dc6851968a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:50.399398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b495595d69648f09d3c68320b5b1d15', 'request_id': 'req-c74653d5-64ba-478f-a021-c4dc6851968a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:50.413956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] The token cache is being invalidate because project 6b495595d69648f09d3c68320b5b1d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:50.414396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:50.415190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c74653d5-64ba-478f-a021-c4dc6851968a tempest-QuotasNegativeTest-1911625278 tempest-QuotasNegativeTest-1911625278-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:50.419672 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3190/6406] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:50 2021] DELETE /identity/v3/projects/6b495595d69648f09d3c68320b5b1d15 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:50.423366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c46ae-a22a-4155-b7fc-b78160d119a3 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:50.425884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-176c46ae-a22a-4155-b7fc-b78160d119a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:50.511121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c46ae-a22a-4155-b7fc-b78160d119a3 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:50.600329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:50.601207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:50.601489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:50.602220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] PATH_INFO: `/v3/users/e848febd3679437cb0e60ac1865267c9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:50.603574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e848febd3679437cb0e60ac1865267c9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:50.605498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:50.679049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e848febd3679437cb0e60ac1865267c9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:50.690762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e848febd3679437cb0e60ac1865267c9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:50.691887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e848febd3679437cb0e60ac1865267c9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:50.704466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e848febd3679437cb0e60ac1865267c9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:50.719940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e848febd3679437cb0e60ac1865267c9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:50.731336 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3217/6407] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:50 2021] DELETE /identity/v3/users/e848febd3679437cb0e60ac1865267c9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:50.734712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e619b-e5ec-40a2-be63-2315383a8ecb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:50.735007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e619b-e5ec-40a2-be63-2315383a8ecb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:50.735312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e619b-e5ec-40a2-be63-2315383a8ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:50.759654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ff0e619b-e5ec-40a2-be63-2315383a8ecb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:50.761153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ff0e619b-e5ec-40a2-be63-2315383a8ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:50.829163 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3191/6408] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:50.840573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:50.842130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:50.917903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce581ba-0278-4dd4-8125-74e38368dedd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:50.921683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fe1cc-5db5-424a-91e7-f96504f189ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:50.922343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fe1cc-5db5-424a-91e7-f96504f189ae service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:50.922627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fe1cc-5db5-424a-91e7-f96504f189ae service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:50.922904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fe1cc-5db5-424a-91e7-f96504f189ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:50.937677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fe1cc-5db5-424a-91e7-f96504f189ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:50.939194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fe1cc-5db5-424a-91e7-f96504f189ae service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:50.954826 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3218/6409] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:51.413108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e619b-e5ec-40a2-be63-2315383a8ecb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:51.415229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ff0e619b-e5ec-40a2-be63-2315383a8ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:51.433941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e619b-e5ec-40a2-be63-2315383a8ecb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:51.457811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:51.458968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:51.459712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:51.460139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] PATH_INFO: `/v3/projects/5fa45d95e84d4ccf8ae0b8d74b37f624` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:51.461795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa45d95e84d4ccf8ae0b8d74b37f624)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:51.466931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:51.556878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa45d95e84d4ccf8ae0b8d74b37f624', 'request_id': 'req-e55cbede-f6a1-4248-aabd-986cc6bb4d35'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:51.564573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa45d95e84d4ccf8ae0b8d74b37f624', 'request_id': 'req-e55cbede-f6a1-4248-aabd-986cc6bb4d35'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:51.577246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa45d95e84d4ccf8ae0b8d74b37f624', 'request_id': 'req-e55cbede-f6a1-4248-aabd-986cc6bb4d35'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:51.591192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] The token cache is being invalidate because project 5fa45d95e84d4ccf8ae0b8d74b37f624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:51.591536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:51.599830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:51.605221 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3192/6410] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:51 2021] DELETE /identity/v3/projects/5fa45d95e84d4ccf8ae0b8d74b37f624 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:51.609182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fe1cc-5db5-424a-91e7-f96504f189ae service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:51.622332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fe1cc-5db5-424a-91e7-f96504f189ae service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:51.686312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246a6ef-8536-4d3f-ac55-9da9575c98a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:51.687391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246a6ef-8536-4d3f-ac55-9da9575c98a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:51.687779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246a6ef-8536-4d3f-ac55-9da9575c98a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:51.688182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246a6ef-8536-4d3f-ac55-9da9575c98a9 admin admin] PATH_INFO: `/v3/users/14416ce8454046bf997883f826b43ec7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:51.689575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246a6ef-8536-4d3f-ac55-9da9575c98a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14416ce8454046bf997883f826b43ec7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:51.691753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246a6ef-8536-4d3f-ac55-9da9575c98a9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:51.759184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e246a6ef-8536-4d3f-ac55-9da9575c98a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14416ce8454046bf997883f826b43ec7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:51.771996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e246a6ef-8536-4d3f-ac55-9da9575c98a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14416ce8454046bf997883f826b43ec7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:51.772956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e246a6ef-8536-4d3f-ac55-9da9575c98a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14416ce8454046bf997883f826b43ec7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:51.781663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e246a6ef-8536-4d3f-ac55-9da9575c98a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14416ce8454046bf997883f826b43ec7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:51.795045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e246a6ef-8536-4d3f-ac55-9da9575c98a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14416ce8454046bf997883f826b43ec7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:51.801665 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3219/6411] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:51 2021] DELETE /identity/v3/users/14416ce8454046bf997883f826b43ec7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:52.293467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:52.295795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:52.313588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cbede-f6a1-4248-aabd-986cc6bb4d35 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:52.384699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:52.385591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:52.385880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:52.386160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] PATH_INFO: `/v3/projects/1c559ed7c130437588dcea9d3e1373b9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:52.388117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c559ed7c130437588dcea9d3e1373b9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:52.391477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:52.453976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c559ed7c130437588dcea9d3e1373b9', 'request_id': 'req-83068e7c-b649-4f28-8278-2249601e9aa7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:52.464617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c559ed7c130437588dcea9d3e1373b9', 'request_id': 'req-83068e7c-b649-4f28-8278-2249601e9aa7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:52.475514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c559ed7c130437588dcea9d3e1373b9', 'request_id': 'req-83068e7c-b649-4f28-8278-2249601e9aa7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:52.496404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] The token cache is being invalidate because project 1c559ed7c130437588dcea9d3e1373b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:52.496704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:52.497425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83068e7c-b649-4f28-8278-2249601e9aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:52.499079 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3193/6412] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:52 2021] DELETE /identity/v3/projects/1c559ed7c130437588dcea9d3e1373b9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:52.505971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd21b-670e-4f6f-bd87-f0916999e29a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:52.506263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd21b-670e-4f6f-bd87-f0916999e29a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:52.506541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfd21b-670e-4f6f-bd87-f0916999e29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:52.526623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-dfdfd21b-670e-4f6f-bd87-f0916999e29a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:52.528752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dfdfd21b-670e-4f6f-bd87-f0916999e29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:52.598801 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3220/6413] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:52.606513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2742722-d5c1-47de-afb7-326e72063e98 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:52.607148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2742722-d5c1-47de-afb7-326e72063e98 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:52.607681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2742722-d5c1-47de-afb7-326e72063e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:52.640349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b2742722-d5c1-47de-afb7-326e72063e98 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:52.641654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b2742722-d5c1-47de-afb7-326e72063e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:52.663904 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3194/6414] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:52.668280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfd21b-670e-4f6f-bd87-f0916999e29a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:52.681971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfd21b-670e-4f6f-bd87-f0916999e29a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:52.686615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320ea0b-5f1c-42b9-9009-35d1f53745c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:52.687299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320ea0b-5f1c-42b9-9009-35d1f53745c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:52.687590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320ea0b-5f1c-42b9-9009-35d1f53745c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:52.687862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320ea0b-5f1c-42b9-9009-35d1f53745c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:52.688605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320ea0b-5f1c-42b9-9009-35d1f53745c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:52.688913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320ea0b-5f1c-42b9-9009-35d1f53745c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:52.691433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320ea0b-5f1c-42b9-9009-35d1f53745c9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:52.704567 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3221/6415] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:05:52.709404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2742722-d5c1-47de-afb7-326e72063e98 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:52.720942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2742722-d5c1-47de-afb7-326e72063e98 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:52.726401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273d7bd-dfb6-4035-9da6-f6c01ce5b6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:52.727765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273d7bd-dfb6-4035-9da6-f6c01ce5b6af admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:52.728124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273d7bd-dfb6-4035-9da6-f6c01ce5b6af admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:52.728848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273d7bd-dfb6-4035-9da6-f6c01ce5b6af admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:52.729732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273d7bd-dfb6-4035-9da6-f6c01ce5b6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:52.731789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5273d7bd-dfb6-4035-9da6-f6c01ce5b6af admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:52.765311 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3195/6416] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:52 2021] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:52.769519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320ea0b-5f1c-42b9-9009-35d1f53745c9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:52.780944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320ea0b-5f1c-42b9-9009-35d1f53745c9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:52.849942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215cdef-a7f8-4149-a86a-d9a4970e4658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:52.850803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215cdef-a7f8-4149-a86a-d9a4970e4658 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:52.851169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215cdef-a7f8-4149-a86a-d9a4970e4658 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:52.851552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215cdef-a7f8-4149-a86a-d9a4970e4658 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:52.852344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215cdef-a7f8-4149-a86a-d9a4970e4658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:52.856813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215cdef-a7f8-4149-a86a-d9a4970e4658 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:52.906614 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3222/6417] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:52 2021] POST /identity/v3/users => generated 304 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:52.908166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273d7bd-dfb6-4035-9da6-f6c01ce5b6af admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:52.930236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273d7bd-dfb6-4035-9da6-f6c01ce5b6af admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:52.939087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6d523-ca6e-45b4-9233-48dc49cbf920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:52.939936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6d523-ca6e-45b4-9233-48dc49cbf920 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:52.951104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6d523-ca6e-45b4-9233-48dc49cbf920 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:52.951466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6d523-ca6e-45b4-9233-48dc49cbf920 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:52.952319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6d523-ca6e-45b4-9233-48dc49cbf920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:52.959505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6d523-ca6e-45b4-9233-48dc49cbf920 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:52.978424 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3196/6418] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:52 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:05:52.982466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215cdef-a7f8-4149-a86a-d9a4970e4658 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:52.993551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215cdef-a7f8-4149-a86a-d9a4970e4658 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:52.999397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c65d3a-d08f-4d1b-ba51-d07c26f15b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:53.000087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c65d3a-d08f-4d1b-ba51-d07c26f15b5b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:53.000377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c65d3a-d08f-4d1b-ba51-d07c26f15b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:53.000656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c65d3a-d08f-4d1b-ba51-d07c26f15b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:53.001698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c65d3a-d08f-4d1b-ba51-d07c26f15b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:53.003452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c65d3a-d08f-4d1b-ba51-d07c26f15b5b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:53.017928 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3223/6419] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:52 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:53.021435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6d523-ca6e-45b4-9233-48dc49cbf920 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:53.035479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6d523-ca6e-45b4-9233-48dc49cbf920 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:53.040851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62339a42-c658-4157-8273-7a0b324ddd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:53.041299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62339a42-c658-4157-8273-7a0b324ddd1c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:53.041572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62339a42-c658-4157-8273-7a0b324ddd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:53.041850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62339a42-c658-4157-8273-7a0b324ddd1c admin admin] PATH_INFO: `/v3/projects/9e6bcd10b34e4c42a28bc46d863eb8f7/users/e4f38c30c83549a7ac014192816775fb/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:53.069669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62339a42-c658-4157-8273-7a0b324ddd1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6bcd10b34e4c42a28bc46d863eb8f7, user_id=e4f38c30c83549a7ac014192816775fb, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:53.073321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62339a42-c658-4157-8273-7a0b324ddd1c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:53.114665 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3197/6420] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:53 2021] PUT /identity/v3/projects/9e6bcd10b34e4c42a28bc46d863eb8f7/users/e4f38c30c83549a7ac014192816775fb/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:05:53.121891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdeaa4-82e9-4516-b643-ee6bad6f2ee8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:53.122256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdeaa4-82e9-4516-b643-ee6bad6f2ee8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:53.122611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdeaa4-82e9-4516-b643-ee6bad6f2ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:53.155149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b2fdeaa4-82e9-4516-b643-ee6bad6f2ee8 None None] MFA Rules not processed for user `e4f38c30c83549a7ac014192816775fb`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:53.160022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b2fdeaa4-82e9-4516-b643-ee6bad6f2ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:53.317003 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3224/6421] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:53 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:53.326025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62339a42-c658-4157-8273-7a0b324ddd1c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:53.418038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62339a42-c658-4157-8273-7a0b324ddd1c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:53.423910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b2f9d-e4cb-44de-b3b8-00c66018377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:53.424850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b2f9d-e4cb-44de-b3b8-00c66018377e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:53.425622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b2f9d-e4cb-44de-b3b8-00c66018377e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:53.426123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b2f9d-e4cb-44de-b3b8-00c66018377e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:53.427768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b2f9d-e4cb-44de-b3b8-00c66018377e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:53.430444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b2f9d-e4cb-44de-b3b8-00c66018377e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:53.466990 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3198/6422] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:53 2021] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:53.470545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdeaa4-82e9-4516-b643-ee6bad6f2ee8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:53.488193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdeaa4-82e9-4516-b643-ee6bad6f2ee8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:53.586192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9352d-c0a2-4618-b50b-ef6997abab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:53.586884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9352d-c0a2-4618-b50b-ef6997abab2d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:53.587164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9352d-c0a2-4618-b50b-ef6997abab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:53.587463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9352d-c0a2-4618-b50b-ef6997abab2d admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:53.588811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9352d-c0a2-4618-b50b-ef6997abab2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:53.591680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9352d-c0a2-4618-b50b-ef6997abab2d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:53.627644 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3225/6423] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:53 2021] POST /identity/v3/users => generated 309 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:05:53.634333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b2f9d-e4cb-44de-b3b8-00c66018377e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:53.646832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b2f9d-e4cb-44de-b3b8-00c66018377e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:53.652282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5df5b0-824e-45e3-8ebd-9647bfc70170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:53.653164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5df5b0-824e-45e3-8ebd-9647bfc70170 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:53.654112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5df5b0-824e-45e3-8ebd-9647bfc70170 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:53.657006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5df5b0-824e-45e3-8ebd-9647bfc70170 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:53.657006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5df5b0-824e-45e3-8ebd-9647bfc70170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:53.657833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5df5b0-824e-45e3-8ebd-9647bfc70170 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:53.672114 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3199/6424] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:53 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:53.676141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9352d-c0a2-4618-b50b-ef6997abab2d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:53.688101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9352d-c0a2-4618-b50b-ef6997abab2d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:53.694954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb3e59-644f-4837-aa14-511083de43ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:53.696536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3e59-644f-4837-aa14-511083de43ff admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:53.697511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3e59-644f-4837-aa14-511083de43ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:53.698031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3e59-644f-4837-aa14-511083de43ff admin admin] PATH_INFO: `/v3/projects/7c0cae28b290437eb192abd062933b8a/users/8a20bc7c6368464da2d7eb411b10457d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:53.717727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb3e59-644f-4837-aa14-511083de43ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0cae28b290437eb192abd062933b8a, user_id=8a20bc7c6368464da2d7eb411b10457d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:53.720610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb3e59-644f-4837-aa14-511083de43ff admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:53.739175 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3226/6425] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:53 2021] PUT /identity/v3/projects/7c0cae28b290437eb192abd062933b8a/users/8a20bc7c6368464da2d7eb411b10457d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:53.743074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5df5b0-824e-45e3-8ebd-9647bfc70170 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:53.756833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5df5b0-824e-45e3-8ebd-9647bfc70170 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:53.826079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf769b5d-532a-44e0-b318-a98d358284fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:53.826814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769b5d-532a-44e0-b318-a98d358284fd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:53.827106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769b5d-532a-44e0-b318-a98d358284fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:53.834075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf769b5d-532a-44e0-b318-a98d358284fd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:53.834873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf769b5d-532a-44e0-b318-a98d358284fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:53.836541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf769b5d-532a-44e0-b318-a98d358284fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:53.851051 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3200/6426] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:53 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:53.852169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb3e59-644f-4837-aa14-511083de43ff admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:53.863684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb3e59-644f-4837-aa14-511083de43ff admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:53.868725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0476148-a443-4770-baad-97090ad89e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:53.869687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0476148-a443-4770-baad-97090ad89e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:53.870073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0476148-a443-4770-baad-97090ad89e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:53.870446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0476148-a443-4770-baad-97090ad89e81 admin admin] PATH_INFO: `/v3/projects/7c0cae28b290437eb192abd062933b8a/users/8a20bc7c6368464da2d7eb411b10457d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:53.872951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0476148-a443-4770-baad-97090ad89e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0cae28b290437eb192abd062933b8a, user_id=8a20bc7c6368464da2d7eb411b10457d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:53.875681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0476148-a443-4770-baad-97090ad89e81 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:53.887749 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3227/6427] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:53 2021] PUT /identity/v3/projects/7c0cae28b290437eb192abd062933b8a/users/8a20bc7c6368464da2d7eb411b10457d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:53.900443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccac7d-e4fd-4ccf-afdc-00adf294ca4c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:53.900973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccac7d-e4fd-4ccf-afdc-00adf294ca4c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:53.901486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccac7d-e4fd-4ccf-afdc-00adf294ca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:53.929631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-93ccac7d-e4fd-4ccf-afdc-00adf294ca4c None None] MFA Rules not processed for user `8a20bc7c6368464da2d7eb411b10457d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:53.930872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-93ccac7d-e4fd-4ccf-afdc-00adf294ca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:54.012183 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3201/6428] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:53 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:54.023245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0476148-a443-4770-baad-97090ad89e81 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:54.025240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c0476148-a443-4770-baad-97090ad89e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:54.084359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0476148-a443-4770-baad-97090ad89e81 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:54.088064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738074b5-ca63-4fd1-aa3f-1879e76e9e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:54.088709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738074b5-ca63-4fd1-aa3f-1879e76e9e9f service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:54.088992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738074b5-ca63-4fd1-aa3f-1879e76e9e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:54.089264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738074b5-ca63-4fd1-aa3f-1879e76e9e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:54.149142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738074b5-ca63-4fd1-aa3f-1879e76e9e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:54.151357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738074b5-ca63-4fd1-aa3f-1879e76e9e9f service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:54.162292 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3228/6429] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:54 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:54.584523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccac7d-e4fd-4ccf-afdc-00adf294ca4c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:54.586653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-93ccac7d-e4fd-4ccf-afdc-00adf294ca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:54.667785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccac7d-e4fd-4ccf-afdc-00adf294ca4c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:54.675847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7637d8-1a03-4dc2-9363-9333422c1971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:54.676690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7637d8-1a03-4dc2-9363-9333422c1971 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:54.677125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7637d8-1a03-4dc2-9363-9333422c1971 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:54.677844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7637d8-1a03-4dc2-9363-9333422c1971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:54.688042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7637d8-1a03-4dc2-9363-9333422c1971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:54.690321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7637d8-1a03-4dc2-9363-9333422c1971 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:54.705828 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3202/6430] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:05:54 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:05:58.512382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738074b5-ca63-4fd1-aa3f-1879e76e9e9f service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:58.513939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-738074b5-ca63-4fd1-aa3f-1879e76e9e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:58.584946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738074b5-ca63-4fd1-aa3f-1879e76e9e9f service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:58.589527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ef640-cdc8-4707-aef6-78ca93715b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:58.590395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ef640-cdc8-4707-aef6-78ca93715b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:58.590708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ef640-cdc8-4707-aef6-78ca93715b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:58.590984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ef640-cdc8-4707-aef6-78ca93715b75 admin admin] PATH_INFO: `/v3/users/7cd64b2d9718476ea2c0a4255c801b00` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:58.592230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ef640-cdc8-4707-aef6-78ca93715b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd64b2d9718476ea2c0a4255c801b00)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:58.594150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ef640-cdc8-4707-aef6-78ca93715b75 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:58.641913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d68ef640-cdc8-4707-aef6-78ca93715b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd64b2d9718476ea2c0a4255c801b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:58.657308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d68ef640-cdc8-4707-aef6-78ca93715b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd64b2d9718476ea2c0a4255c801b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:58.659211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d68ef640-cdc8-4707-aef6-78ca93715b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd64b2d9718476ea2c0a4255c801b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:58.670252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d68ef640-cdc8-4707-aef6-78ca93715b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd64b2d9718476ea2c0a4255c801b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:58.686823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d68ef640-cdc8-4707-aef6-78ca93715b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd64b2d9718476ea2c0a4255c801b00'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:58.694369 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3229/6431] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:05:58 2021] DELETE /identity/v3/users/7cd64b2d9718476ea2c0a4255c801b00 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:59.060493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7637d8-1a03-4dc2-9363-9333422c1971 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:59.100225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7637d8-1a03-4dc2-9363-9333422c1971 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:59.165863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:59.167322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:59.167812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:59.168775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] PATH_INFO: `/v3/projects/2237b56d0b4b4fa3ace78023aa3fe435` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:59.170563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2237b56d0b4b4fa3ace78023aa3fe435)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:59.173488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:59.289716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2237b56d0b4b4fa3ace78023aa3fe435', 'request_id': 'req-3e58d578-9f7d-4442-8c84-c065c823d177'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:59.298012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2237b56d0b4b4fa3ace78023aa3fe435', 'request_id': 'req-3e58d578-9f7d-4442-8c84-c065c823d177'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:59.314938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2237b56d0b4b4fa3ace78023aa3fe435', 'request_id': 'req-3e58d578-9f7d-4442-8c84-c065c823d177'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:59.330160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] The token cache is being invalidate because project 2237b56d0b4b4fa3ace78023aa3fe435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:05:59.330463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:59.331478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3e58d578-9f7d-4442-8c84-c065c823d177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:05:59.333786 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3203/6432] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:05:59 2021] DELETE /identity/v3/projects/2237b56d0b4b4fa3ace78023aa3fe435 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:05:59.347141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0a9c2-49f7-44a3-8c87-459d4d1cca0f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:59.347141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0a9c2-49f7-44a3-8c87-459d4d1cca0f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:59.347141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0a9c2-49f7-44a3-8c87-459d4d1cca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:59.369419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bfc0a9c2-49f7-44a3-8c87-459d4d1cca0f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:59.370732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bfc0a9c2-49f7-44a3-8c87-459d4d1cca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:59.504333 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3230/6433] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:59.507198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27646eb-0a58-431c-818a-08471240ce13 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:59.507736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27646eb-0a58-431c-818a-08471240ce13 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:59.508224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27646eb-0a58-431c-818a-08471240ce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:59.530916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a27646eb-0a58-431c-818a-08471240ce13 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:05:59.532496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a27646eb-0a58-431c-818a-08471240ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:05:59.545871 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3204/6434] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:05:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:05:59.546331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0a9c2-49f7-44a3-8c87-459d4d1cca0f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:59.557278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0a9c2-49f7-44a3-8c87-459d4d1cca0f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:59.563298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393388b-5bdb-40b3-8500-1e02bf1a1bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:59.564331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393388b-5bdb-40b3-8500-1e02bf1a1bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:59.564616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393388b-5bdb-40b3-8500-1e02bf1a1bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:59.564892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393388b-5bdb-40b3-8500-1e02bf1a1bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:59.565754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393388b-5bdb-40b3-8500-1e02bf1a1bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:05:59.566062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393388b-5bdb-40b3-8500-1e02bf1a1bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:59.567719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393388b-5bdb-40b3-8500-1e02bf1a1bf4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:59.588265 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3231/6435] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:05:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:05:59.590026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27646eb-0a58-431c-818a-08471240ce13 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:59.603616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27646eb-0a58-431c-818a-08471240ce13 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:59.610334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd53f52-e2f4-49c9-b527-2fb147afaab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:59.611361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd53f52-e2f4-49c9-b527-2fb147afaab1 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:59.612180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd53f52-e2f4-49c9-b527-2fb147afaab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:59.613098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd53f52-e2f4-49c9-b527-2fb147afaab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:59.614687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd53f52-e2f4-49c9-b527-2fb147afaab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:59.617372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd53f52-e2f4-49c9-b527-2fb147afaab1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:59.671181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393388b-5bdb-40b3-8500-1e02bf1a1bf4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:59.682569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393388b-5bdb-40b3-8500-1e02bf1a1bf4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:59.683488 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3205/6436] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:05:59 2021] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:59.829645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cb424-c485-4ce8-bfa6-23a7d67731ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:59.830835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cb424-c485-4ce8-bfa6-23a7d67731ef admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:59.831744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cb424-c485-4ce8-bfa6-23a7d67731ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:59.832028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cb424-c485-4ce8-bfa6-23a7d67731ef admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:59.832925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cb424-c485-4ce8-bfa6-23a7d67731ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:59.837140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cb424-c485-4ce8-bfa6-23a7d67731ef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:59.869948 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3232/6437] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:05:59 2021] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:05:59.875226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd53f52-e2f4-49c9-b527-2fb147afaab1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:59.895606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd53f52-e2f4-49c9-b527-2fb147afaab1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:59.908009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995719d-91c2-4178-8a89-a897fc36e49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:59.909583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995719d-91c2-4178-8a89-a897fc36e49f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:59.909950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995719d-91c2-4178-8a89-a897fc36e49f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:59.911201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995719d-91c2-4178-8a89-a897fc36e49f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:59.912001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995719d-91c2-4178-8a89-a897fc36e49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:59.914519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995719d-91c2-4178-8a89-a897fc36e49f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:59.932226 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3206/6438] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:59 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:05:59.933581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cb424-c485-4ce8-bfa6-23a7d67731ef admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:05:59.965267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cb424-c485-4ce8-bfa6-23a7d67731ef admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:05:59.971281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d97b9-1eec-492b-ae3f-1517f077d953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:05:59.973146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d97b9-1eec-492b-ae3f-1517f077d953 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:05:59.973877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d97b9-1eec-492b-ae3f-1517f077d953 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:05:59.974190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d97b9-1eec-492b-ae3f-1517f077d953 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:05:59.975178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d97b9-1eec-492b-ae3f-1517f077d953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:05:59.977478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d97b9-1eec-492b-ae3f-1517f077d953 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:05:59.996942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995719d-91c2-4178-8a89-a897fc36e49f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:00.005100 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3233/6439] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:05:59 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:00.005100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d97b9-1eec-492b-ae3f-1517f077d953 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:00.009386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995719d-91c2-4178-8a89-a897fc36e49f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:00.011150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4a4d97b9-1eec-492b-ae3f-1517f077d953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:00.019866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a3c0c-8749-4885-8257-0ab945c400db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:00.021213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3c0c-8749-4885-8257-0ab945c400db admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:00.021923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3c0c-8749-4885-8257-0ab945c400db admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:00.024008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3c0c-8749-4885-8257-0ab945c400db admin admin] PATH_INFO: `/v3/projects/2fcfaa0229934ca2881bd510e1a2aade/users/0b931665afff4f99b4804188e9ae1438/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:00.027411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d97b9-1eec-492b-ae3f-1517f077d953 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:00.033035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc81fea-399a-4f0f-b975-f54ed28de7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:00.033912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81fea-399a-4f0f-b975-f54ed28de7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:00.034241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81fea-399a-4f0f-b975-f54ed28de7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:00.034523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc81fea-399a-4f0f-b975-f54ed28de7f2 admin admin] PATH_INFO: `/v3/users/52809bdbaa7a49da830722fbb54e9a7d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:00.035832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc81fea-399a-4f0f-b975-f54ed28de7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52809bdbaa7a49da830722fbb54e9a7d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:00.037765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc81fea-399a-4f0f-b975-f54ed28de7f2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:00.044603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a3c0c-8749-4885-8257-0ab945c400db admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcfaa0229934ca2881bd510e1a2aade, user_id=0b931665afff4f99b4804188e9ae1438, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:00.047974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a3c0c-8749-4885-8257-0ab945c400db admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:00.066655 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3207/6440] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:05:59 2021] PUT /identity/v3/projects/2fcfaa0229934ca2881bd510e1a2aade/users/0b931665afff4f99b4804188e9ae1438/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:00.074049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35ccab-f048-4df4-bef4-feff5b360b61 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:00.074590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35ccab-f048-4df4-bef4-feff5b360b61 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:00.075072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35ccab-f048-4df4-bef4-feff5b360b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:00.097809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1b35ccab-f048-4df4-bef4-feff5b360b61 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:00.099356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1b35ccab-f048-4df4-bef4-feff5b360b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:00.131768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-abc81fea-399a-4f0f-b975-f54ed28de7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52809bdbaa7a49da830722fbb54e9a7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:00.146545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-abc81fea-399a-4f0f-b975-f54ed28de7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52809bdbaa7a49da830722fbb54e9a7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:00.147442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-abc81fea-399a-4f0f-b975-f54ed28de7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52809bdbaa7a49da830722fbb54e9a7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:00.160260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-abc81fea-399a-4f0f-b975-f54ed28de7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52809bdbaa7a49da830722fbb54e9a7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:00.174310 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3208/6441] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:00.179789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-abc81fea-399a-4f0f-b975-f54ed28de7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52809bdbaa7a49da830722fbb54e9a7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:00.188358 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3234/6442] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:00 2021] DELETE /identity/v3/users/52809bdbaa7a49da830722fbb54e9a7d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:00.193970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35ccab-f048-4df4-bef4-feff5b360b61 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:00.196164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1b35ccab-f048-4df4-bef4-feff5b360b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:00.196636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eb2df-9bc8-4ece-af93-bd8ebb942410 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:00.197032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eb2df-9bc8-4ece-af93-bd8ebb942410 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:00.197551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eb2df-9bc8-4ece-af93-bd8ebb942410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:00.230456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c66eb2df-9bc8-4ece-af93-bd8ebb942410 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:00.230861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c66eb2df-9bc8-4ece-af93-bd8ebb942410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:00.260412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35ccab-f048-4df4-bef4-feff5b360b61 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:00.300923 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3235/6443] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:00.317424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ded3e0-5313-4f22-87e4-a340b0f2889c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:00.318072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ded3e0-5313-4f22-87e4-a340b0f2889c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:00.318352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ded3e0-5313-4f22-87e4-a340b0f2889c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:00.318645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ded3e0-5313-4f22-87e4-a340b0f2889c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:00.320336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eb2df-9bc8-4ece-af93-bd8ebb942410 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:00.321885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c66eb2df-9bc8-4ece-af93-bd8ebb942410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:00.329329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ded3e0-5313-4f22-87e4-a340b0f2889c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:00.330778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ded3e0-5313-4f22-87e4-a340b0f2889c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:00.337187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eb2df-9bc8-4ece-af93-bd8ebb942410 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:00.341292 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3209/6444] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:00.352486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dbd93-3bce-4a3a-b80e-edaa5ae344ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:00.353371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbd93-3bce-4a3a-b80e-edaa5ae344ca service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:00.353770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbd93-3bce-4a3a-b80e-edaa5ae344ca service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:00.354115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbd93-3bce-4a3a-b80e-edaa5ae344ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:00.366152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dbd93-3bce-4a3a-b80e-edaa5ae344ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:00.367678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dbd93-3bce-4a3a-b80e-edaa5ae344ca service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:00.379445 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3236/6445] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:00.763164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ded3e0-5313-4f22-87e4-a340b0f2889c service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:00.765241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c9ded3e0-5313-4f22-87e4-a340b0f2889c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:00.789465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ded3e0-5313-4f22-87e4-a340b0f2889c service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:00.794647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:00.795657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:00.796490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:00.796872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] PATH_INFO: `/v3/projects/08c3aa90c56842e4933bcaf0284cbc43` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:00.798210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c3aa90c56842e4933bcaf0284cbc43)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:00.800975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:00.860623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c3aa90c56842e4933bcaf0284cbc43', 'request_id': 'req-3588c924-0f38-404b-a81a-74f8e89542fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:00.868307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c3aa90c56842e4933bcaf0284cbc43', 'request_id': 'req-3588c924-0f38-404b-a81a-74f8e89542fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:00.878143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c3aa90c56842e4933bcaf0284cbc43', 'request_id': 'req-3588c924-0f38-404b-a81a-74f8e89542fc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:00.891662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] The token cache is being invalidate because project 08c3aa90c56842e4933bcaf0284cbc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:00.892041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:00.893215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3588c924-0f38-404b-a81a-74f8e89542fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:00.895708 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3210/6446] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:00 2021] DELETE /identity/v3/projects/08c3aa90c56842e4933bcaf0284cbc43 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:00.901939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b774c-9242-461a-8392-0b8d2481c687 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:00.902523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b774c-9242-461a-8392-0b8d2481c687 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:00.902523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b774c-9242-461a-8392-0b8d2481c687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:00.924299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a71b774c-9242-461a-8392-0b8d2481c687 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:00.925822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a71b774c-9242-461a-8392-0b8d2481c687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:00.998172 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3237/6447] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:01.000066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f079c-a078-4bfc-a879-bbfd917aabcd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:01.000489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f079c-a078-4bfc-a879-bbfd917aabcd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:01.000847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f079c-a078-4bfc-a879-bbfd917aabcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:01.020799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d98f079c-a078-4bfc-a879-bbfd917aabcd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:01.022080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d98f079c-a078-4bfc-a879-bbfd917aabcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:01.030468 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3211/6448] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:01.035197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b774c-9242-461a-8392-0b8d2481c687 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:01.045038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b774c-9242-461a-8392-0b8d2481c687 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:01.049891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a71ab3-82cc-452c-8d58-6e151924dd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:01.050543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a71ab3-82cc-452c-8d58-6e151924dd07 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:01.050826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a71ab3-82cc-452c-8d58-6e151924dd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:01.051101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a71ab3-82cc-452c-8d58-6e151924dd07 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:01.051866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a71ab3-82cc-452c-8d58-6e151924dd07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:06:01.052173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a71ab3-82cc-452c-8d58-6e151924dd07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:01.053755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a71ab3-82cc-452c-8d58-6e151924dd07 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:01.065843 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3238/6449] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:06:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:06:01.070652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f079c-a078-4bfc-a879-bbfd917aabcd None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:01.080864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f079c-a078-4bfc-a879-bbfd917aabcd None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:01.086865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da287e74-e684-4a61-97c5-f8e229abba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:01.087996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da287e74-e684-4a61-97c5-f8e229abba24 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:01.088463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da287e74-e684-4a61-97c5-f8e229abba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:01.088748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da287e74-e684-4a61-97c5-f8e229abba24 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:01.089458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da287e74-e684-4a61-97c5-f8e229abba24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:01.091405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da287e74-e684-4a61-97c5-f8e229abba24 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:01.121684 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3212/6450] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:01 2021] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:01.126259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a71ab3-82cc-452c-8d58-6e151924dd07 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:01.137573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a71ab3-82cc-452c-8d58-6e151924dd07 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:01.274896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f101fa7-6e7c-4c11-b072-358b0844e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:01.275709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f101fa7-6e7c-4c11-b072-358b0844e21f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:01.276254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f101fa7-6e7c-4c11-b072-358b0844e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:01.276540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f101fa7-6e7c-4c11-b072-358b0844e21f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:01.277405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f101fa7-6e7c-4c11-b072-358b0844e21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:01.280277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f101fa7-6e7c-4c11-b072-358b0844e21f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:01.321880 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3239/6451] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:01 2021] POST /identity/v3/users => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:01.326052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da287e74-e684-4a61-97c5-f8e229abba24 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:01.351725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da287e74-e684-4a61-97c5-f8e229abba24 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:01.371742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca8f38-c391-448d-9cc8-5f5e24cff4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:01.374645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca8f38-c391-448d-9cc8-5f5e24cff4ad admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:01.375161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca8f38-c391-448d-9cc8-5f5e24cff4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:01.379484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca8f38-c391-448d-9cc8-5f5e24cff4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:01.380549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca8f38-c391-448d-9cc8-5f5e24cff4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:01.385005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca8f38-c391-448d-9cc8-5f5e24cff4ad admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:01.418318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f101fa7-6e7c-4c11-b072-358b0844e21f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:01.431063 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3213/6452] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:01 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:01.441728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f101fa7-6e7c-4c11-b072-358b0844e21f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:01.467824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060211ec-a7cd-401c-a61e-6380e0bce88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:01.468672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060211ec-a7cd-401c-a61e-6380e0bce88d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:01.469091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060211ec-a7cd-401c-a61e-6380e0bce88d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:01.469475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060211ec-a7cd-401c-a61e-6380e0bce88d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:01.470357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060211ec-a7cd-401c-a61e-6380e0bce88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:01.473147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060211ec-a7cd-401c-a61e-6380e0bce88d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:01.487950 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3240/6453] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:01 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:01.492320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca8f38-c391-448d-9cc8-5f5e24cff4ad admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:01.505326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca8f38-c391-448d-9cc8-5f5e24cff4ad admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:01.512547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2358275-a742-42ec-8538-972084c1bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:01.514386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2358275-a742-42ec-8538-972084c1bf5e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:01.514896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2358275-a742-42ec-8538-972084c1bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:01.515454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2358275-a742-42ec-8538-972084c1bf5e admin admin] PATH_INFO: `/v3/projects/da27d7b4acc24a768261818bfb21020e/users/05ed58bd09c24611aad101bc1e96c811/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:01.536128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2358275-a742-42ec-8538-972084c1bf5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da27d7b4acc24a768261818bfb21020e, user_id=05ed58bd09c24611aad101bc1e96c811, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:01.539673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2358275-a742-42ec-8538-972084c1bf5e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:01.563678 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3214/6454] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:01 2021] PUT /identity/v3/projects/da27d7b4acc24a768261818bfb21020e/users/05ed58bd09c24611aad101bc1e96c811/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:01.575121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6fd32-d71b-498a-9956-e3adae87dcfb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:01.575708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6fd32-d71b-498a-9956-e3adae87dcfb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:01.576137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6fd32-d71b-498a-9956-e3adae87dcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:01.607246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-68f6fd32-d71b-498a-9956-e3adae87dcfb None None] MFA Rules not processed for user `05ed58bd09c24611aad101bc1e96c811`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:01.609181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-68f6fd32-d71b-498a-9956-e3adae87dcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:01.700496 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3241/6455] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:01 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:01.701674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2358275-a742-42ec-8538-972084c1bf5e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:01.783881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2358275-a742-42ec-8538-972084c1bf5e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:01.789237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a59d12-6b99-47ae-ba3c-21440b4b992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:01.790056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a59d12-6b99-47ae-ba3c-21440b4b992b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:01.790651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a59d12-6b99-47ae-ba3c-21440b4b992b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:01.791030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a59d12-6b99-47ae-ba3c-21440b4b992b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:01.791874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a59d12-6b99-47ae-ba3c-21440b4b992b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:01.793893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a59d12-6b99-47ae-ba3c-21440b4b992b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:01.822434 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3215/6456] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:01 2021] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:06:01.826470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6fd32-d71b-498a-9956-e3adae87dcfb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:01.838922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6fd32-d71b-498a-9956-e3adae87dcfb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:01.903873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc4efd-0236-4aee-b253-3be001f9eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:01.905214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc4efd-0236-4aee-b253-3be001f9eb6a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:01.905489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc4efd-0236-4aee-b253-3be001f9eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:01.906085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc4efd-0236-4aee-b253-3be001f9eb6a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:01.907121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc4efd-0236-4aee-b253-3be001f9eb6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:01.910506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc4efd-0236-4aee-b253-3be001f9eb6a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:01.936909 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3242/6457] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:01 2021] POST /identity/v3/users => generated 308 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:06:01.938979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a59d12-6b99-47ae-ba3c-21440b4b992b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:01.951490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a59d12-6b99-47ae-ba3c-21440b4b992b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:01.957411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acde989-920b-4fdd-808d-df6df4927222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:01.958092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acde989-920b-4fdd-808d-df6df4927222 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:01.958378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acde989-920b-4fdd-808d-df6df4927222 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:01.958846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acde989-920b-4fdd-808d-df6df4927222 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:01.960330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acde989-920b-4fdd-808d-df6df4927222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:01.961955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acde989-920b-4fdd-808d-df6df4927222 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:01.979084 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3216/6458] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:01 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:01.983739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc4efd-0236-4aee-b253-3be001f9eb6a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:01.995637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc4efd-0236-4aee-b253-3be001f9eb6a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:02.002531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1b737-98fc-4a56-812c-73cb3007176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:02.004015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b737-98fc-4a56-812c-73cb3007176b admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:02.004300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b737-98fc-4a56-812c-73cb3007176b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:02.004577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1b737-98fc-4a56-812c-73cb3007176b admin admin] PATH_INFO: `/v3/projects/eed47947badb4c4a9aa0a6deae51ead7/users/d0f4fb398686468e8c1d7f610f73fc3a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:02.021573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1b737-98fc-4a56-812c-73cb3007176b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed47947badb4c4a9aa0a6deae51ead7, user_id=d0f4fb398686468e8c1d7f610f73fc3a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:02.024268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1b737-98fc-4a56-812c-73cb3007176b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:02.043209 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3243/6459] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:01 2021] PUT /identity/v3/projects/eed47947badb4c4a9aa0a6deae51ead7/users/d0f4fb398686468e8c1d7f610f73fc3a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:02.044145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acde989-920b-4fdd-808d-df6df4927222 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:02.055374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acde989-920b-4fdd-808d-df6df4927222 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:02.121931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ece336-047a-40db-a343-e4a5d3deec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:02.122858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ece336-047a-40db-a343-e4a5d3deec23 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:02.123159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ece336-047a-40db-a343-e4a5d3deec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:02.123461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ece336-047a-40db-a343-e4a5d3deec23 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:02.124199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ece336-047a-40db-a343-e4a5d3deec23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:02.125816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ece336-047a-40db-a343-e4a5d3deec23 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:02.137156 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3217/6460] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:02 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:06:02.142857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1b737-98fc-4a56-812c-73cb3007176b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:02.154552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1b737-98fc-4a56-812c-73cb3007176b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:02.159771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e20eb1-e3e6-45d0-a90b-93193bfde5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:02.160764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20eb1-e3e6-45d0-a90b-93193bfde5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:02.161164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20eb1-e3e6-45d0-a90b-93193bfde5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:02.161937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20eb1-e3e6-45d0-a90b-93193bfde5cf admin admin] PATH_INFO: `/v3/projects/eed47947badb4c4a9aa0a6deae51ead7/users/d0f4fb398686468e8c1d7f610f73fc3a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:02.163992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e20eb1-e3e6-45d0-a90b-93193bfde5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed47947badb4c4a9aa0a6deae51ead7, user_id=d0f4fb398686468e8c1d7f610f73fc3a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:02.167092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e20eb1-e3e6-45d0-a90b-93193bfde5cf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:02.179957 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3244/6461] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:02 2021] PUT /identity/v3/projects/eed47947badb4c4a9aa0a6deae51ead7/users/d0f4fb398686468e8c1d7f610f73fc3a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:02.191450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc983e-e51c-4749-a3b1-a43682e589bd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:02.194091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc983e-e51c-4749-a3b1-a43682e589bd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:02.194791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc983e-e51c-4749-a3b1-a43682e589bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:02.226892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-79bc983e-e51c-4749-a3b1-a43682e589bd None None] MFA Rules not processed for user `d0f4fb398686468e8c1d7f610f73fc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:02.228183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-79bc983e-e51c-4749-a3b1-a43682e589bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:02.308546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e20eb1-e3e6-45d0-a90b-93193bfde5cf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:02.310729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f0e20eb1-e3e6-45d0-a90b-93193bfde5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:02.322867 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3218/6462] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:02 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:02.334912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc983e-e51c-4749-a3b1-a43682e589bd None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:02.336419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-79bc983e-e51c-4749-a3b1-a43682e589bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:02.462516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e20eb1-e3e6-45d0-a90b-93193bfde5cf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:02.465287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc983e-e51c-4749-a3b1-a43682e589bd None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:02.469544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb5809-a858-4b03-9b2c-d19d33da588e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:02.471003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb5809-a858-4b03-9b2c-d19d33da588e service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:02.471456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb5809-a858-4b03-9b2c-d19d33da588e service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:02.471906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb5809-a858-4b03-9b2c-d19d33da588e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:02.481348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:02.482215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:02.482490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:02.482774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] PATH_INFO: `/v3/users/e4f38c30c83549a7ac014192816775fb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:02.483713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb5809-a858-4b03-9b2c-d19d33da588e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:02.484036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f38c30c83549a7ac014192816775fb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:02.485971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:02.486323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb5809-a858-4b03-9b2c-d19d33da588e service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:02.508140 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3219/6463] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:02 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:06:02.589988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f38c30c83549a7ac014192816775fb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:02.615121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f38c30c83549a7ac014192816775fb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:02.615811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f38c30c83549a7ac014192816775fb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:02.630075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f38c30c83549a7ac014192816775fb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:02.666717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f38c30c83549a7ac014192816775fb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:02.679338 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3245/6464] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:02 2021] DELETE /identity/v3/users/e4f38c30c83549a7ac014192816775fb => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:02.681570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd6597-96d3-4884-8125-f4be375f1df2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:02.682488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd6597-96d3-4884-8125-f4be375f1df2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:02.682978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd6597-96d3-4884-8125-f4be375f1df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:02.712284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:02.714437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cadd6597-96d3-4884-8125-f4be375f1df2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:02.715147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:02.716182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cadd6597-96d3-4884-8125-f4be375f1df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:02.820229 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3220/6465] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:02.829913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd6597-96d3-4884-8125-f4be375f1df2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:02.830274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464ac8f-02a0-4fe0-bb9e-5dfadcc20d66 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:02.831751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cadd6597-96d3-4884-8125-f4be375f1df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:02.836332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7a982-48dd-411e-8246-48852bd3ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:02.837320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7a982-48dd-411e-8246-48852bd3ab2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:02.837610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7a982-48dd-411e-8246-48852bd3ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:02.837889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7a982-48dd-411e-8246-48852bd3ab2e admin admin] PATH_INFO: `/v3/users/05ed58bd09c24611aad101bc1e96c811` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:02.839627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7a982-48dd-411e-8246-48852bd3ab2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ed58bd09c24611aad101bc1e96c811)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:02.841569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7a982-48dd-411e-8246-48852bd3ab2e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:02.906349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a0d7a982-48dd-411e-8246-48852bd3ab2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ed58bd09c24611aad101bc1e96c811'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:02.912941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd6597-96d3-4884-8125-f4be375f1df2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:02.917477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e2ff-a8f6-4018-9df8-6a9733b9b00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:02.918201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e2ff-a8f6-4018-9df8-6a9733b9b00d service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:02.918317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a0d7a982-48dd-411e-8246-48852bd3ab2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ed58bd09c24611aad101bc1e96c811'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:02.918508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e2ff-a8f6-4018-9df8-6a9733b9b00d service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:02.918742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e2ff-a8f6-4018-9df8-6a9733b9b00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:02.918858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a0d7a982-48dd-411e-8246-48852bd3ab2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ed58bd09c24611aad101bc1e96c811'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:02.920635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4f68e2ff-a8f6-4018-9df8-6a9733b9b00d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:02.929010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a0d7a982-48dd-411e-8246-48852bd3ab2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ed58bd09c24611aad101bc1e96c811'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:02.934571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68e2ff-a8f6-4018-9df8-6a9733b9b00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:02.936053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68e2ff-a8f6-4018-9df8-6a9733b9b00d service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:02.948668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a0d7a982-48dd-411e-8246-48852bd3ab2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ed58bd09c24611aad101bc1e96c811'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:02.957752 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3246/6467] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:02 2021] DELETE /identity/v3/users/05ed58bd09c24611aad101bc1e96c811 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:02.962638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72353-1dc5-402f-acc0-507cbde3b3cc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:02.962936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72353-1dc5-402f-acc0-507cbde3b3cc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:02.963220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72353-1dc5-402f-acc0-507cbde3b3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:02.966488 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3221/6467] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:06:02.987905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d6c72353-1dc5-402f-acc0-507cbde3b3cc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:02.989667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d6c72353-1dc5-402f-acc0-507cbde3b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:03.068831 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3247/6468] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:03.080735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e2ff-a8f6-4018-9df8-6a9733b9b00d service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:03.084826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4f68e2ff-a8f6-4018-9df8-6a9733b9b00d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:03.102653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e2ff-a8f6-4018-9df8-6a9733b9b00d service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:03.155859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3baa1-1b34-4ac2-9ab8-e9de47a8c00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:03.156608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3baa1-1b34-4ac2-9ab8-e9de47a8c00f service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:03.156855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3baa1-1b34-4ac2-9ab8-e9de47a8c00f service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:03.157096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3baa1-1b34-4ac2-9ab8-e9de47a8c00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:03.168297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3baa1-1b34-4ac2-9ab8-e9de47a8c00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:03.170456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3baa1-1b34-4ac2-9ab8-e9de47a8c00f service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:03.181269 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3222/6469] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:03.190089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c72353-1dc5-402f-acc0-507cbde3b3cc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:03.191594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d6c72353-1dc5-402f-acc0-507cbde3b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:03.219063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c72353-1dc5-402f-acc0-507cbde3b3cc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:03.224737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:03.225629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:03.225915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:03.226192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] PATH_INFO: `/v3/projects/9e6bcd10b34e4c42a28bc46d863eb8f7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:03.227493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e6bcd10b34e4c42a28bc46d863eb8f7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:03.229406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:03.278693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6bcd10b34e4c42a28bc46d863eb8f7', 'request_id': 'req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.287016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6bcd10b34e4c42a28bc46d863eb8f7', 'request_id': 'req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.293605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6bcd10b34e4c42a28bc46d863eb8f7', 'request_id': 'req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.304611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] The token cache is being invalidate because project 9e6bcd10b34e4c42a28bc46d863eb8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:03.304904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.305642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.308293 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3248/6470] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:03 2021] DELETE /identity/v3/projects/9e6bcd10b34e4c42a28bc46d863eb8f7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:03.312367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3baa1-1b34-4ac2-9ab8-e9de47a8c00f service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:03.322430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3baa1-1b34-4ac2-9ab8-e9de47a8c00f service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:03.383514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:03.384528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:03.384820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:03.385109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] PATH_INFO: `/v3/users/8a20bc7c6368464da2d7eb411b10457d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:03.386481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a20bc7c6368464da2d7eb411b10457d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:03.388508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:03.442718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a20bc7c6368464da2d7eb411b10457d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.443874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a20bc7c6368464da2d7eb411b10457d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.453281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a20bc7c6368464da2d7eb411b10457d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.454223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a20bc7c6368464da2d7eb411b10457d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.463315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a20bc7c6368464da2d7eb411b10457d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.484818 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3223/6471] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:03 2021] DELETE /identity/v3/users/8a20bc7c6368464da2d7eb411b10457d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:06:03.629639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:03.631138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:03.651772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9181d4-5018-4bbf-9e72-81bc3728dfa2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:03.715937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:03.716930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:03.717502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:03.717977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] PATH_INFO: `/v3/projects/da27d7b4acc24a768261818bfb21020e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:03.719373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da27d7b4acc24a768261818bfb21020e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:03.721930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:03.781955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da27d7b4acc24a768261818bfb21020e', 'request_id': 'req-fa94736f-5577-46a8-8b34-8ed0d8451429'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.795564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da27d7b4acc24a768261818bfb21020e', 'request_id': 'req-fa94736f-5577-46a8-8b34-8ed0d8451429'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.803213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da27d7b4acc24a768261818bfb21020e', 'request_id': 'req-fa94736f-5577-46a8-8b34-8ed0d8451429'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.820871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] The token cache is being invalidate because project da27d7b4acc24a768261818bfb21020e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:03.821170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.821828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fa94736f-5577-46a8-8b34-8ed0d8451429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:03.828366 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3249/6472] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:03 2021] DELETE /identity/v3/projects/da27d7b4acc24a768261818bfb21020e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:03.829560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:03.831624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:03.848952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a877b0-4490-4dce-87d1-077184477818 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:03.944877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:03.946048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:03.946519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:03.946883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] PATH_INFO: `/v3/users/d0f4fb398686468e8c1d7f610f73fc3a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:03.948737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f4fb398686468e8c1d7f610f73fc3a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:03.951205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:03.957360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf30bb-5ffe-4635-874c-58d5b344a10d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:03.958982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf30bb-5ffe-4635-874c-58d5b344a10d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:03.959506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf30bb-5ffe-4635-874c-58d5b344a10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:03.982026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4eaf30bb-5ffe-4635-874c-58d5b344a10d None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:03.983781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4eaf30bb-5ffe-4635-874c-58d5b344a10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:04.024615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f4fb398686468e8c1d7f610f73fc3a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.025690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f4fb398686468e8c1d7f610f73fc3a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.041809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f4fb398686468e8c1d7f610f73fc3a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.042984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f4fb398686468e8c1d7f610f73fc3a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.060799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f4fb398686468e8c1d7f610f73fc3a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.077757 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3250/6473] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:06:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:04.079671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf30bb-5ffe-4635-874c-58d5b344a10d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:04.082139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4eaf30bb-5ffe-4635-874c-58d5b344a10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:04.111904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf30bb-5ffe-4635-874c-58d5b344a10d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:04.118447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:04.119533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:04.121632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:04.121904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] PATH_INFO: `/v3/projects/7c0cae28b290437eb192abd062933b8a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:04.122627 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3224/6474] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:03 2021] DELETE /identity/v3/users/d0f4fb398686468e8c1d7f610f73fc3a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:04.125567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0cae28b290437eb192abd062933b8a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:04.129701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:04.144396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:04.145853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:04.230774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0cae28b290437eb192abd062933b8a', 'request_id': 'req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.241152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0cae28b290437eb192abd062933b8a', 'request_id': 'req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.250385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0cae28b290437eb192abd062933b8a', 'request_id': 'req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.264427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] The token cache is being invalidate because project 7c0cae28b290437eb192abd062933b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:04.264774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.265589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef726fbe-b9f8-4a25-a0bb-b1f16f717d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.267566 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3251/6475] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:04 2021] DELETE /identity/v3/projects/7c0cae28b290437eb192abd062933b8a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:04.273264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963f954-4405-4561-946f-843cd8dc105d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:04.273534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963f954-4405-4561-946f-843cd8dc105d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:04.273856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963f954-4405-4561-946f-843cd8dc105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:04.322764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7963f954-4405-4561-946f-843cd8dc105d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:04.322764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7963f954-4405-4561-946f-843cd8dc105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:04.344718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29083f8-bf79-4a33-860a-dece80ff2e30 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:04.453624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130ee1-31cc-41a7-bb5f-9cd68ed8a68b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:04.454301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130ee1-31cc-41a7-bb5f-9cd68ed8a68b service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:04.454584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130ee1-31cc-41a7-bb5f-9cd68ed8a68b service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:04.454860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130ee1-31cc-41a7-bb5f-9cd68ed8a68b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:04.456817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec130ee1-31cc-41a7-bb5f-9cd68ed8a68b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:04.458507 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3252/6476] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:04.464502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b324c28-57ed-4195-b7d3-f7059e411c7a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:04.465048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b324c28-57ed-4195-b7d3-f7059e411c7a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:04.465547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b324c28-57ed-4195-b7d3-f7059e411c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:04.505047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4b324c28-57ed-4195-b7d3-f7059e411c7a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:04.507821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4b324c28-57ed-4195-b7d3-f7059e411c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:04.528374 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3253/6477] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:04.533752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b324c28-57ed-4195-b7d3-f7059e411c7a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:04.550307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b324c28-57ed-4195-b7d3-f7059e411c7a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:04.574319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f4e55-7d6b-47da-8a01-87fad9933046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:04.574319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f4e55-7d6b-47da-8a01-87fad9933046 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:04.574319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f4e55-7d6b-47da-8a01-87fad9933046 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:04.574319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f4e55-7d6b-47da-8a01-87fad9933046 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:04.576246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f4e55-7d6b-47da-8a01-87fad9933046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:06:04.576638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f4e55-7d6b-47da-8a01-87fad9933046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:04.578442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f4e55-7d6b-47da-8a01-87fad9933046 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:04.584985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130ee1-31cc-41a7-bb5f-9cd68ed8a68b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:04.586892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130ee1-31cc-41a7-bb5f-9cd68ed8a68b service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:04.604624 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3254/6478] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:06:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:06:04.606187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f4e55-7d6b-47da-8a01-87fad9933046 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:04.610796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f91f4e55-7d6b-47da-8a01-87fad9933046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:04.611371 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3225/6479] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:06:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:06:04.613531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130ee1-31cc-41a7-bb5f-9cd68ed8a68b service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:04.632751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130ee1-31cc-41a7-bb5f-9cd68ed8a68b service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:04.644240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf064ce-49f3-43ce-82d5-f1030f05fdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:04.644916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf064ce-49f3-43ce-82d5-f1030f05fdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:04.645205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf064ce-49f3-43ce-82d5-f1030f05fdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:04.645481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf064ce-49f3-43ce-82d5-f1030f05fdc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:04.646201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf064ce-49f3-43ce-82d5-f1030f05fdc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:04.648277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf064ce-49f3-43ce-82d5-f1030f05fdc9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:04.648526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f4e55-7d6b-47da-8a01-87fad9933046 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:04.662582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:04.663497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:04.663784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:04.664135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] PATH_INFO: `/v3/projects/eed47947badb4c4a9aa0a6deae51ead7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:04.665548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed47947badb4c4a9aa0a6deae51ead7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:04.667765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:04.683114 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3226/6480] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:04 2021] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:04.691050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf064ce-49f3-43ce-82d5-f1030f05fdc9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:04.740363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed47947badb4c4a9aa0a6deae51ead7', 'request_id': 'req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.751656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed47947badb4c4a9aa0a6deae51ead7', 'request_id': 'req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.763481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed47947badb4c4a9aa0a6deae51ead7', 'request_id': 'req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.779896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] The token cache is being invalidate because project eed47947badb4c4a9aa0a6deae51ead7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:04.780194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.781228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ecfddecc-3e36-4a0f-bcbd-f580938c0db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:04.787572 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3255/6481] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:04 2021] DELETE /identity/v3/projects/eed47947badb4c4a9aa0a6deae51ead7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:04.790355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f691b-7b33-4b10-be35-82254f385411 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:04.790652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f691b-7b33-4b10-be35-82254f385411 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:04.791421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f691b-7b33-4b10-be35-82254f385411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:04.795503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf064ce-49f3-43ce-82d5-f1030f05fdc9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:04.816091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ad3f691b-7b33-4b10-be35-82254f385411 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:04.817755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ad3f691b-7b33-4b10-be35-82254f385411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:04.919038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a2edc-1519-49e9-bcc8-79587e3d7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:04.919437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a2edc-1519-49e9-bcc8-79587e3d7a31 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:04.919718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a2edc-1519-49e9-bcc8-79587e3d7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:04.919991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a2edc-1519-49e9-bcc8-79587e3d7a31 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:04.920693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a2edc-1519-49e9-bcc8-79587e3d7a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:04.922638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a2edc-1519-49e9-bcc8-79587e3d7a31 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:04.954244 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3256/6482] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:04.967170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abcb89-8c40-4969-9430-99c62d94dbf2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:04.967817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abcb89-8c40-4969-9430-99c62d94dbf2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:04.969398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abcb89-8c40-4969-9430-99c62d94dbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:04.972307 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3227/6483] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:04 2021] POST /identity/v3/users => generated 288 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:04.978453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a2edc-1519-49e9-bcc8-79587e3d7a31 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:04.982667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5e5a2edc-1519-49e9-bcc8-79587e3d7a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:05.011842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a2edc-1519-49e9-bcc8-79587e3d7a31 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:05.034687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc87ce-6e78-41f8-a810-bcfb3eaf39aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:05.035397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc87ce-6e78-41f8-a810-bcfb3eaf39aa admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.036370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e7abcb89-8c40-4969-9430-99c62d94dbf2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:05.038053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc87ce-6e78-41f8-a810-bcfb3eaf39aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.038341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc87ce-6e78-41f8-a810-bcfb3eaf39aa admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.039636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc87ce-6e78-41f8-a810-bcfb3eaf39aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:05.039846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e7abcb89-8c40-4969-9430-99c62d94dbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:05.041452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc87ce-6e78-41f8-a810-bcfb3eaf39aa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:05.048778 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3257/6484] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:05.058170 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3228/6485] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:04 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:05.058401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abcb89-8c40-4969-9430-99c62d94dbf2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:05.059743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc87ce-6e78-41f8-a810-bcfb3eaf39aa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:05.069578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abcb89-8c40-4969-9430-99c62d94dbf2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:05.071824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc87ce-6e78-41f8-a810-bcfb3eaf39aa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:05.075984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d134b7-7eea-426c-b6cc-e0d3823ddf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:05.076744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d134b7-7eea-426c-b6cc-e0d3823ddf3d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.078337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d134b7-7eea-426c-b6cc-e0d3823ddf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.078620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bdaa2-4e50-4b19-9144-1a9372bb67d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:05.078847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d134b7-7eea-426c-b6cc-e0d3823ddf3d admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.079664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d134b7-7eea-426c-b6cc-e0d3823ddf3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:06:05.079843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bdaa2-4e50-4b19-9144-1a9372bb67d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.080474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bdaa2-4e50-4b19-9144-1a9372bb67d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.080657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d134b7-7eea-426c-b6cc-e0d3823ddf3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:05.081544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bdaa2-4e50-4b19-9144-1a9372bb67d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.082654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bdaa2-4e50-4b19-9144-1a9372bb67d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:05.083793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d134b7-7eea-426c-b6cc-e0d3823ddf3d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:05.084440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bdaa2-4e50-4b19-9144-1a9372bb67d5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:05.102713 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3229/6486] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:05 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:05.102959 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3258/6487] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:06:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:06:05.103125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bdaa2-4e50-4b19-9144-1a9372bb67d5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:05.104385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d134b7-7eea-426c-b6cc-e0d3823ddf3d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:05.116677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d134b7-7eea-426c-b6cc-e0d3823ddf3d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:05.117523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bdaa2-4e50-4b19-9144-1a9372bb67d5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:05.121906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f93c1-e64c-4967-89d2-61a27f046e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:05.123280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f93c1-e64c-4967-89d2-61a27f046e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.123568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f93c1-e64c-4967-89d2-61a27f046e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.123832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f93c1-e64c-4967-89d2-61a27f046e3a admin admin] PATH_INFO: `/v3/projects/5ad20665d5f24ef592fcb13ca600d1fb/users/7f047e715a384795921a30dfab4be955/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.124751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825a081-7b63-4313-82a0-ef96c383cbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:05.125737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825a081-7b63-4313-82a0-ef96c383cbea admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.126420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825a081-7b63-4313-82a0-ef96c383cbea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.126902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825a081-7b63-4313-82a0-ef96c383cbea admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.128371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825a081-7b63-4313-82a0-ef96c383cbea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:05.131719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825a081-7b63-4313-82a0-ef96c383cbea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:05.141452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f93c1-e64c-4967-89d2-61a27f046e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad20665d5f24ef592fcb13ca600d1fb, user_id=7f047e715a384795921a30dfab4be955, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:05.144859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f93c1-e64c-4967-89d2-61a27f046e3a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:05.167870 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3259/6488] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:05 2021] PUT /identity/v3/projects/5ad20665d5f24ef592fcb13ca600d1fb/users/7f047e715a384795921a30dfab4be955/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:05.179514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cb576-c500-4d12-844f-223452cb2b05 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.179861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cb576-c500-4d12-844f-223452cb2b05 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.180096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cb576-c500-4d12-844f-223452cb2b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.182749 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3230/6489] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:05 2021] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:06:05.188400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825a081-7b63-4313-82a0-ef96c383cbea admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:05.211227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-146cb576-c500-4d12-844f-223452cb2b05 None None] MFA Rules not processed for user `7f047e715a384795921a30dfab4be955`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:05.212760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-146cb576-c500-4d12-844f-223452cb2b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:05.309782 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3260/6490] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:05 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:05.333161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cb576-c500-4d12-844f-223452cb2b05 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:05.336243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-146cb576-c500-4d12-844f-223452cb2b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:05.368909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825a081-7b63-4313-82a0-ef96c383cbea admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:05.383522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305f1f-3d20-46fc-9416-03bfee6cbbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:05.386227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305f1f-3d20-46fc-9416-03bfee6cbbeb admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.386520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305f1f-3d20-46fc-9416-03bfee6cbbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.386802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305f1f-3d20-46fc-9416-03bfee6cbbeb admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.389901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305f1f-3d20-46fc-9416-03bfee6cbbeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:05.393194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305f1f-3d20-46fc-9416-03bfee6cbbeb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:05.433995 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3231/6491] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:05 2021] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:06:05.440181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305f1f-3d20-46fc-9416-03bfee6cbbeb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:05.448418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cb576-c500-4d12-844f-223452cb2b05 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:05.453903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfe101-b5f1-4a55-91da-09c6ab548319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:05.454741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfe101-b5f1-4a55-91da-09c6ab548319 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.455213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfe101-b5f1-4a55-91da-09c6ab548319 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.455663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfe101-b5f1-4a55-91da-09c6ab548319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.466483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfe101-b5f1-4a55-91da-09c6ab548319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:05.468347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfe101-b5f1-4a55-91da-09c6ab548319 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:05.469852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305f1f-3d20-46fc-9416-03bfee6cbbeb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:05.479580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3921d22-c557-48d7-9ce5-5a0f7353b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:05.481051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3921d22-c557-48d7-9ce5-5a0f7353b30b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.481820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3921d22-c557-48d7-9ce5-5a0f7353b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.482556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3921d22-c557-48d7-9ce5-5a0f7353b30b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.484166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3921d22-c557-48d7-9ce5-5a0f7353b30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:05.488446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3921d22-c557-48d7-9ce5-5a0f7353b30b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:05.502520 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3261/6492] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:05 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:06:05.511750 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3232/6493] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:05 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:05.515394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfe101-b5f1-4a55-91da-09c6ab548319 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:05.542418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfe101-b5f1-4a55-91da-09c6ab548319 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:05.551352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301fff5-1eff-4dac-97ae-33ce6a778e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:05.553523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301fff5-1eff-4dac-97ae-33ce6a778e99 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.554203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301fff5-1eff-4dac-97ae-33ce6a778e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.554658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301fff5-1eff-4dac-97ae-33ce6a778e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.555573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301fff5-1eff-4dac-97ae-33ce6a778e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:05.557805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301fff5-1eff-4dac-97ae-33ce6a778e99 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:05.596002 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3262/6494] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:05 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:05.600976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3921d22-c557-48d7-9ce5-5a0f7353b30b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:05.620677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd197-6fb9-4700-a66c-107dcfccc013 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.621456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd197-6fb9-4700-a66c-107dcfccc013 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.622173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bd197-6fb9-4700-a66c-107dcfccc013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.625714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3921d22-c557-48d7-9ce5-5a0f7353b30b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:05.637532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8042a-0b05-42ec-8619-cd5293510906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:05.640140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8042a-0b05-42ec-8619-cd5293510906 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.641372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8042a-0b05-42ec-8619-cd5293510906 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.641959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8042a-0b05-42ec-8619-cd5293510906 admin admin] PATH_INFO: `/v3/projects/2a5ad81e73ad4ba88b6315045aef7abc/users/3f90b25dee0148bb893dce0951c5f8b2/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.675374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8042a-0b05-42ec-8619-cd5293510906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5ad81e73ad4ba88b6315045aef7abc, user_id=3f90b25dee0148bb893dce0951c5f8b2, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:05.681959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8042a-0b05-42ec-8619-cd5293510906 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:05.704124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8f2bd197-6fb9-4700-a66c-107dcfccc013 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:05.708568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8f2bd197-6fb9-4700-a66c-107dcfccc013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:05.725916 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3233/6495] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:05 2021] PUT /identity/v3/projects/2a5ad81e73ad4ba88b6315045aef7abc/users/3f90b25dee0148bb893dce0951c5f8b2/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:05.741717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b051-fbc2-4f2b-a9d0-03096c9d0bf5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.743050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b051-fbc2-4f2b-a9d0-03096c9d0bf5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.744883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15b051-fbc2-4f2b-a9d0-03096c9d0bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.800613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6d15b051-fbc2-4f2b-a9d0-03096c9d0bf5 None None] MFA Rules not processed for user `3f90b25dee0148bb893dce0951c5f8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:05.802183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6d15b051-fbc2-4f2b-a9d0-03096c9d0bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:05.827485 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3263/6496] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:06:05 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:05.841625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd197-6fb9-4700-a66c-107dcfccc013 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:05.843472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8f2bd197-6fb9-4700-a66c-107dcfccc013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:05.898272 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3234/6497] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:05 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:05.902872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15b051-fbc2-4f2b-a9d0-03096c9d0bf5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:05.939598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bd197-6fb9-4700-a66c-107dcfccc013 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:05.946487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c990a-32e9-4b24-93f1-edf90eba690f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:05.947164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c990a-32e9-4b24-93f1-edf90eba690f service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:05.947641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c990a-32e9-4b24-93f1-edf90eba690f service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:05.947937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c990a-32e9-4b24-93f1-edf90eba690f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:05.958992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c990a-32e9-4b24-93f1-edf90eba690f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:05.960652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c990a-32e9-4b24-93f1-edf90eba690f service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:05.970138 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3264/6498] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:06:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:06:06.011070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15b051-fbc2-4f2b-a9d0-03096c9d0bf5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:06.018871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4063e-0fff-45da-866e-3c59bfa46f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:06.020736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4063e-0fff-45da-866e-3c59bfa46f00 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:06.023594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4063e-0fff-45da-866e-3c59bfa46f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:06.024195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4063e-0fff-45da-866e-3c59bfa46f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:06.024661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4063e-0fff-45da-866e-3c59bfa46f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:06.026597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4063e-0fff-45da-866e-3c59bfa46f00 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:06.068639 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3235/6499] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:05 2021] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:06.070523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c990a-32e9-4b24-93f1-edf90eba690f service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:06.081745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c990a-32e9-4b24-93f1-edf90eba690f service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:06.159694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e583592-304a-4333-93a2-2047a0b8ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:06.160493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e583592-304a-4333-93a2-2047a0b8ddd9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:06.160846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e583592-304a-4333-93a2-2047a0b8ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:06.161074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e583592-304a-4333-93a2-2047a0b8ddd9 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:06.161820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e583592-304a-4333-93a2-2047a0b8ddd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:06.164001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e583592-304a-4333-93a2-2047a0b8ddd9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:06.187978 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3265/6500] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:06 2021] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:06.193551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4063e-0fff-45da-866e-3c59bfa46f00 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:06.212689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4063e-0fff-45da-866e-3c59bfa46f00 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:06.222239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2758f-4826-4648-a774-ae72e449c334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:06.223035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2758f-4826-4648-a774-ae72e449c334 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:06.223419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2758f-4826-4648-a774-ae72e449c334 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:06.223768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2758f-4826-4648-a774-ae72e449c334 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:06.226382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2758f-4826-4648-a774-ae72e449c334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:06.231795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2758f-4826-4648-a774-ae72e449c334 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:06.251924 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3236/6501] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:06 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:06:06.256281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e583592-304a-4333-93a2-2047a0b8ddd9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:06.272461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e583592-304a-4333-93a2-2047a0b8ddd9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:06.278666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42b1ac-9eeb-426c-9e0f-52e99c1d8ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:06.279639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42b1ac-9eeb-426c-9e0f-52e99c1d8ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:06.279920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42b1ac-9eeb-426c-9e0f-52e99c1d8ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:06.280223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42b1ac-9eeb-426c-9e0f-52e99c1d8ae4 admin admin] PATH_INFO: `/v3/projects/4d96368817104856815838e24b41f99a/users/81fca18f1a334877bc1c5e123857218d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:06.280715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3683-7b91-4572-bb1b-c8989b0c12ea None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:06.281371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3683-7b91-4572-bb1b-c8989b0c12ea None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:06.281849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3683-7b91-4572-bb1b-c8989b0c12ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:06.299699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42b1ac-9eeb-426c-9e0f-52e99c1d8ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d96368817104856815838e24b41f99a, user_id=81fca18f1a334877bc1c5e123857218d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:06.304035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42b1ac-9eeb-426c-9e0f-52e99c1d8ae4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:06.325350 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3266/6502] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:06 2021] PUT /identity/v3/projects/4d96368817104856815838e24b41f99a/users/81fca18f1a334877bc1c5e123857218d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:06.329697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42b1ac-9eeb-426c-9e0f-52e99c1d8ae4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:06.334025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ce5c3683-7b91-4572-bb1b-c8989b0c12ea None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:06.343615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ce5c3683-7b91-4572-bb1b-c8989b0c12ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:06.470084 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3237/6503] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:06:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:06.486155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42b1ac-9eeb-426c-9e0f-52e99c1d8ae4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:06.492570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5527d-f70d-464a-a8ea-db89114fa186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:06.493629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5527d-f70d-464a-a8ea-db89114fa186 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:06.494106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5527d-f70d-464a-a8ea-db89114fa186 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:06.494582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5527d-f70d-464a-a8ea-db89114fa186 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:06.496067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5527d-f70d-464a-a8ea-db89114fa186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:06.497330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5527d-f70d-464a-a8ea-db89114fa186 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:06.501745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3683-7b91-4572-bb1b-c8989b0c12ea None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:06.526227 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3267/6504] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:06 2021] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:06.527438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5527d-f70d-464a-a8ea-db89114fa186 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:06.537693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5527d-f70d-464a-a8ea-db89114fa186 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:06.544032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c41e40-54fc-4a34-a69c-33a6fb6619ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:06.546434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c41e40-54fc-4a34-a69c-33a6fb6619ce admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:06.546982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c41e40-54fc-4a34-a69c-33a6fb6619ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:06.547509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c41e40-54fc-4a34-a69c-33a6fb6619ce admin admin] PATH_INFO: `/v3/projects/4d96368817104856815838e24b41f99a/users/81fca18f1a334877bc1c5e123857218d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:06.551798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c41e40-54fc-4a34-a69c-33a6fb6619ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d96368817104856815838e24b41f99a, user_id=81fca18f1a334877bc1c5e123857218d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:06.556258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c41e40-54fc-4a34-a69c-33a6fb6619ce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:06.575572 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3268/6505] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:06 2021] PUT /identity/v3/projects/4d96368817104856815838e24b41f99a/users/81fca18f1a334877bc1c5e123857218d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:06.594518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3683-7b91-4572-bb1b-c8989b0c12ea None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:06.595670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da0e52-c1bc-4ac3-8ac1-2a55df6bc70a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:06.595968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da0e52-c1bc-4ac3-8ac1-2a55df6bc70a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:06.596757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da0e52-c1bc-4ac3-8ac1-2a55df6bc70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:06.640567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-59da0e52-c1bc-4ac3-8ac1-2a55df6bc70a None None] MFA Rules not processed for user `81fca18f1a334877bc1c5e123857218d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:06.641787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-59da0e52-c1bc-4ac3-8ac1-2a55df6bc70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:06.730671 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3269/6506] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:06 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:06.746713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da0e52-c1bc-4ac3-8ac1-2a55df6bc70a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:06.749323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-59da0e52-c1bc-4ac3-8ac1-2a55df6bc70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:06.753870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891ea7f-8af4-49df-980a-26b749657277 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:06.754593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891ea7f-8af4-49df-980a-26b749657277 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:06.754841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891ea7f-8af4-49df-980a-26b749657277 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:06.755809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891ea7f-8af4-49df-980a-26b749657277 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:06.833216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891ea7f-8af4-49df-980a-26b749657277 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:06.834852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891ea7f-8af4-49df-980a-26b749657277 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:06.839942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da0e52-c1bc-4ac3-8ac1-2a55df6bc70a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:06.851167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9163a-9a19-40a0-ad09-09a68f14f616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:06.852509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9163a-9a19-40a0-ad09-09a68f14f616 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:06.852989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9163a-9a19-40a0-ad09-09a68f14f616 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:06.853547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9163a-9a19-40a0-ad09-09a68f14f616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:06.859464 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3238/6507] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:06:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:06:06.961646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9163a-9a19-40a0-ad09-09a68f14f616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:06.963550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9163a-9a19-40a0-ad09-09a68f14f616 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:06.979501 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3270/6508] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:06 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:07.189772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843580-12db-4feb-9221-7d55b55e24fa None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:07.190702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843580-12db-4feb-9221-7d55b55e24fa None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:07.191399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843580-12db-4feb-9221-7d55b55e24fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:07.263129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fb843580-12db-4feb-9221-7d55b55e24fa None None] MFA Rules not processed for user `0b931665afff4f99b4804188e9ae1438`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:07.264478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fb843580-12db-4feb-9221-7d55b55e24fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:07.354719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92d87-fc9b-4e0b-acb0-6768d3e983b9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:07.355041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92d87-fc9b-4e0b-acb0-6768d3e983b9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:07.355443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92d87-fc9b-4e0b-acb0-6768d3e983b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:07.387382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-32c92d87-fc9b-4e0b-acb0-6768d3e983b9 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:07.388618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-32c92d87-fc9b-4e0b-acb0-6768d3e983b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:07.408701 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3271/6509] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:06:07 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:07.423417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c92d87-fc9b-4e0b-acb0-6768d3e983b9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:07.438700 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3239/6510] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:07 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:07.458258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475467f6-8404-4a5e-8955-fdad7569f8d8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:07.461127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475467f6-8404-4a5e-8955-fdad7569f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:07.462791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475467f6-8404-4a5e-8955-fdad7569f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:07.470528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c92d87-fc9b-4e0b-acb0-6768d3e983b9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:07.486157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efb2cf-5ddf-415d-a14f-851e83876c03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:07.486828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb2cf-5ddf-415d-a14f-851e83876c03 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:07.493947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb2cf-5ddf-415d-a14f-851e83876c03 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:07.493947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efb2cf-5ddf-415d-a14f-851e83876c03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:07.505950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-475467f6-8404-4a5e-8955-fdad7569f8d8 None None] MFA Rules not processed for user `0b931665afff4f99b4804188e9ae1438`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:07.507626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-475467f6-8404-4a5e-8955-fdad7569f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:07.524632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efb2cf-5ddf-415d-a14f-851e83876c03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:07.526717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efb2cf-5ddf-415d-a14f-851e83876c03 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:07.558670 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3240/6511] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:07 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:07.568471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475467f6-8404-4a5e-8955-fdad7569f8d8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:07.569972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-475467f6-8404-4a5e-8955-fdad7569f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:07.574594 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3272/6512] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:06:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:06:07.753580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475467f6-8404-4a5e-8955-fdad7569f8d8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:07.773449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73eee0-0179-41e0-8f6c-9c5e69c0c300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:07.782203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73eee0-0179-41e0-8f6c-9c5e69c0c300 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:07.782611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73eee0-0179-41e0-8f6c-9c5e69c0c300 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:07.782905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73eee0-0179-41e0-8f6c-9c5e69c0c300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:07.805738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73eee0-0179-41e0-8f6c-9c5e69c0c300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:07.807664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73eee0-0179-41e0-8f6c-9c5e69c0c300 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:07.851712 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3241/6513] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:07 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:06:09.031591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed061a-1ddd-4a9c-a4b1-27c8aa16e877 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:09.032559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed061a-1ddd-4a9c-a4b1-27c8aa16e877 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:09.033114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed061a-1ddd-4a9c-a4b1-27c8aa16e877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:09.134533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-49ed061a-1ddd-4a9c-a4b1-27c8aa16e877 None None] MFA Rules not processed for user `0b931665afff4f99b4804188e9ae1438`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:09.135837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-49ed061a-1ddd-4a9c-a4b1-27c8aa16e877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:09.235277 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3273/6514] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:09 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:10.429929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73eee0-0179-41e0-8f6c-9c5e69c0c300 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:10.438246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ad73eee0-0179-41e0-8f6c-9c5e69c0c300 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:10.830556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73eee0-0179-41e0-8f6c-9c5e69c0c300 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:10.841609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:10.842496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:10.842783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:10.843063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] PATH_INFO: `/v3/users/e3dacaf685b54cf89bc9aa4e050b9a74` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:10.845990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3dacaf685b54cf89bc9aa4e050b9a74)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:10.848225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:11.020998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3dacaf685b54cf89bc9aa4e050b9a74'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:11.023803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3dacaf685b54cf89bc9aa4e050b9a74'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:11.051594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3dacaf685b54cf89bc9aa4e050b9a74'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:11.052582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3dacaf685b54cf89bc9aa4e050b9a74'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:11.099231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3dacaf685b54cf89bc9aa4e050b9a74'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:11.182658 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3242/6515] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:10 2021] DELETE /identity/v3/users/e3dacaf685b54cf89bc9aa4e050b9a74 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:11.189959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae1c7a-7451-4b96-b986-451c46740b7d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:11.190821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae1c7a-7451-4b96-b986-451c46740b7d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:11.192748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae1c7a-7451-4b96-b986-451c46740b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:11.243580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f7ae1c7a-7451-4b96-b986-451c46740b7d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:11.244833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f7ae1c7a-7451-4b96-b986-451c46740b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:11.434136 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3274/6516] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:11.497824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:11.499729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:11.780245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37e78e-20b6-4e59-b596-44a6086ef4b9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:11.789586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c4c7b-5a39-4a74-87bb-ab077596a757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:11.790611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c4c7b-5a39-4a74-87bb-ab077596a757 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:11.792264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c4c7b-5a39-4a74-87bb-ab077596a757 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:11.793215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c4c7b-5a39-4a74-87bb-ab077596a757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:11.837561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c4c7b-5a39-4a74-87bb-ab077596a757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:11.840328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c4c7b-5a39-4a74-87bb-ab077596a757 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:11.878311 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3243/6517] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:12.228085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae1c7a-7451-4b96-b986-451c46740b7d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:12.230306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f7ae1c7a-7451-4b96-b986-451c46740b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:12.261843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae1c7a-7451-4b96-b986-451c46740b7d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:12.267144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288b231-78d8-4337-a799-35d63527a1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:12.268415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288b231-78d8-4337-a799-35d63527a1cd service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:12.269042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288b231-78d8-4337-a799-35d63527a1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:12.269582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288b231-78d8-4337-a799-35d63527a1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:12.273571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2288b231-78d8-4337-a799-35d63527a1cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:12.321060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288b231-78d8-4337-a799-35d63527a1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:12.323219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288b231-78d8-4337-a799-35d63527a1cd service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:12.353469 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3275/6518] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:12 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:06:12.403184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c4c7b-5a39-4a74-87bb-ab077596a757 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:12.405855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d32c4c7b-5a39-4a74-87bb-ab077596a757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:12.429090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c4c7b-5a39-4a74-87bb-ab077596a757 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:12.437821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:12.438841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:12.439128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:12.439438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] PATH_INFO: `/v3/projects/4732694cf811451b8ffabd706cd72965` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:12.445385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4732694cf811451b8ffabd706cd72965)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:12.446873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:12.563741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288b231-78d8-4337-a799-35d63527a1cd service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:12.566009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2288b231-78d8-4337-a799-35d63527a1cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:12.622614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4732694cf811451b8ffabd706cd72965', 'request_id': 'req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:12.652170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4732694cf811451b8ffabd706cd72965', 'request_id': 'req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:12.666003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4732694cf811451b8ffabd706cd72965', 'request_id': 'req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:12.690693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] The token cache is being invalidate because project 4732694cf811451b8ffabd706cd72965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:12.690986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:12.692441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:12.711286 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3244/6519] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:12 2021] DELETE /identity/v3/projects/4732694cf811451b8ffabd706cd72965 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:12.847404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288b231-78d8-4337-a799-35d63527a1cd service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:12.993184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83819585-84a1-471a-ad43-172cbe77989a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:12.994115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83819585-84a1-471a-ad43-172cbe77989a service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:12.994549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83819585-84a1-471a-ad43-172cbe77989a service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:12.994973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83819585-84a1-471a-ad43-172cbe77989a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:13.007173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-83819585-84a1-471a-ad43-172cbe77989a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:13.143865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83819585-84a1-471a-ad43-172cbe77989a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:13.145747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83819585-84a1-471a-ad43-172cbe77989a service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:13.189441 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3276/6520] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:12 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:06:14.680302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:14.682017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:14.816767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bda3d-d0ec-45a1-a551-a4fe88b8a581 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:14.825116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa304a-6bce-4752-a802-15c4497c80fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:14.825795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa304a-6bce-4752-a802-15c4497c80fa service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:14.826091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa304a-6bce-4752-a802-15c4497c80fa service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:14.826445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa304a-6bce-4752-a802-15c4497c80fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:14.839081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d3fa304a-6bce-4752-a802-15c4497c80fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:14.876774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa304a-6bce-4752-a802-15c4497c80fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:14.886096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa304a-6bce-4752-a802-15c4497c80fa service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:14.928040 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3245/6521] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:14 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:15.104586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83819585-84a1-471a-ad43-172cbe77989a service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:15.106460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-83819585-84a1-471a-ad43-172cbe77989a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:15.283091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83819585-84a1-471a-ad43-172cbe77989a service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:15.287743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68199212-1217-4c68-b4c3-3d4d098f0584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:15.288941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68199212-1217-4c68-b4c3-3d4d098f0584 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:15.289415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68199212-1217-4c68-b4c3-3d4d098f0584 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:15.289876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68199212-1217-4c68-b4c3-3d4d098f0584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:15.292337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-68199212-1217-4c68-b4c3-3d4d098f0584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:15.323177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68199212-1217-4c68-b4c3-3d4d098f0584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:15.327632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68199212-1217-4c68-b4c3-3d4d098f0584 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:15.350535 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3277/6522] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:15 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:19.833486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa304a-6bce-4752-a802-15c4497c80fa service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:19.834930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d3fa304a-6bce-4752-a802-15c4497c80fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:19.898795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa304a-6bce-4752-a802-15c4497c80fa service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:19.903342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:19.904319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:19.904598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:19.904873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] PATH_INFO: `/v3/users/3f90b25dee0148bb893dce0951c5f8b2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:19.906096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f90b25dee0148bb893dce0951c5f8b2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:19.908092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:19.958421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f90b25dee0148bb893dce0951c5f8b2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:19.958850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f90b25dee0148bb893dce0951c5f8b2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:19.968520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f90b25dee0148bb893dce0951c5f8b2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:19.969210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f90b25dee0148bb893dce0951c5f8b2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:19.979945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f90b25dee0148bb893dce0951c5f8b2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:20.002206 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3246/6523] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:19 2021] DELETE /identity/v3/users/3f90b25dee0148bb893dce0951c5f8b2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:20.008035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78bd95-2e32-4cef-acd1-9d6b8ec7ccd1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:20.008560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78bd95-2e32-4cef-acd1-9d6b8ec7ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:20.008655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78bd95-2e32-4cef-acd1-9d6b8ec7ccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:20.038503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fb78bd95-2e32-4cef-acd1-9d6b8ec7ccd1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:20.039938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fb78bd95-2e32-4cef-acd1-9d6b8ec7ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:20.129206 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3278/6524] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:20.142118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:20.144222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:20.252574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c214d5-2f28-4cc4-8197-fcdf906507f8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:20.256199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45372dc3-b5a4-4550-ba43-6d7a81d36a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:20.256859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45372dc3-b5a4-4550-ba43-6d7a81d36a68 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:20.257144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45372dc3-b5a4-4550-ba43-6d7a81d36a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:20.257421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45372dc3-b5a4-4550-ba43-6d7a81d36a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:20.268242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45372dc3-b5a4-4550-ba43-6d7a81d36a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:20.269701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45372dc3-b5a4-4550-ba43-6d7a81d36a68 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:20.281866 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3247/6525] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:20.628084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78bd95-2e32-4cef-acd1-9d6b8ec7ccd1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:20.629280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fb78bd95-2e32-4cef-acd1-9d6b8ec7ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:20.652444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78bd95-2e32-4cef-acd1-9d6b8ec7ccd1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:20.657341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:20.658881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:20.659380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:20.659768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] PATH_INFO: `/v3/projects/2a5ad81e73ad4ba88b6315045aef7abc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:20.661091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5ad81e73ad4ba88b6315045aef7abc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:20.663112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:20.721795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5ad81e73ad4ba88b6315045aef7abc', 'request_id': 'req-c615df28-5fdd-43cc-bb46-eb58c4381cc2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:20.730435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5ad81e73ad4ba88b6315045aef7abc', 'request_id': 'req-c615df28-5fdd-43cc-bb46-eb58c4381cc2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:20.738822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5ad81e73ad4ba88b6315045aef7abc', 'request_id': 'req-c615df28-5fdd-43cc-bb46-eb58c4381cc2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:20.750879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] The token cache is being invalidate because project 2a5ad81e73ad4ba88b6315045aef7abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:20.751175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:20.751873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:20.754402 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3279/6526] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:20 2021] DELETE /identity/v3/projects/2a5ad81e73ad4ba88b6315045aef7abc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:20.758916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45372dc3-b5a4-4550-ba43-6d7a81d36a68 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:20.769880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45372dc3-b5a4-4550-ba43-6d7a81d36a68 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:20.826355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78605eb-96db-462f-b143-e03eb2a430aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:20.827221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78605eb-96db-462f-b143-e03eb2a430aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:20.827535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78605eb-96db-462f-b143-e03eb2a430aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:20.827816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78605eb-96db-462f-b143-e03eb2a430aa admin admin] PATH_INFO: `/v3/users/81fca18f1a334877bc1c5e123857218d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:20.829013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78605eb-96db-462f-b143-e03eb2a430aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=81fca18f1a334877bc1c5e123857218d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:20.831592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78605eb-96db-462f-b143-e03eb2a430aa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:20.885894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e78605eb-96db-462f-b143-e03eb2a430aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81fca18f1a334877bc1c5e123857218d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:20.886969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e78605eb-96db-462f-b143-e03eb2a430aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81fca18f1a334877bc1c5e123857218d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:20.896294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e78605eb-96db-462f-b143-e03eb2a430aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81fca18f1a334877bc1c5e123857218d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:20.897067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e78605eb-96db-462f-b143-e03eb2a430aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81fca18f1a334877bc1c5e123857218d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:20.905595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e78605eb-96db-462f-b143-e03eb2a430aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81fca18f1a334877bc1c5e123857218d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:20.924871 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3248/6527] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:20 2021] DELETE /identity/v3/users/81fca18f1a334877bc1c5e123857218d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:21.268880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:21.270571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:21.286305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615df28-5fdd-43cc-bb46-eb58c4381cc2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:21.359571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:21.360440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:21.360755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:21.361027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] PATH_INFO: `/v3/projects/4d96368817104856815838e24b41f99a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:21.363046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d96368817104856815838e24b41f99a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:21.365056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:21.428563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d96368817104856815838e24b41f99a', 'request_id': 'req-9155d078-bde6-4376-b22d-159f2eb841fe'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:21.437344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d96368817104856815838e24b41f99a', 'request_id': 'req-9155d078-bde6-4376-b22d-159f2eb841fe'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:21.447812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d96368817104856815838e24b41f99a', 'request_id': 'req-9155d078-bde6-4376-b22d-159f2eb841fe'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:21.458154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] The token cache is being invalidate because project 4d96368817104856815838e24b41f99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:21.458441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:21.459214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9155d078-bde6-4376-b22d-159f2eb841fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:21.460799 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3280/6528] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:21 2021] DELETE /identity/v3/projects/4d96368817104856815838e24b41f99a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:21.467734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a10d6b-5d5d-4d9c-88a4-46eec4686cb1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:21.468302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a10d6b-5d5d-4d9c-88a4-46eec4686cb1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:21.468658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a10d6b-5d5d-4d9c-88a4-46eec4686cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:21.510735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a6a10d6b-5d5d-4d9c-88a4-46eec4686cb1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:21.512225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a6a10d6b-5d5d-4d9c-88a4-46eec4686cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:21.630806 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3249/6529] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:21.639546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61987d-8fac-40c7-abb7-d3057b37374f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:21.639865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61987d-8fac-40c7-abb7-d3057b37374f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:21.640133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61987d-8fac-40c7-abb7-d3057b37374f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:21.659716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3f61987d-8fac-40c7-abb7-d3057b37374f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:21.660941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3f61987d-8fac-40c7-abb7-d3057b37374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:21.675683 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3281/6530] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:21.680661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a10d6b-5d5d-4d9c-88a4-46eec4686cb1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:21.693893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a10d6b-5d5d-4d9c-88a4-46eec4686cb1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:21.699916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723ec27-8ab7-4977-8875-e6c270c1ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:21.700482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723ec27-8ab7-4977-8875-e6c270c1ee14 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:21.701229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723ec27-8ab7-4977-8875-e6c270c1ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:21.701852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723ec27-8ab7-4977-8875-e6c270c1ee14 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:21.702982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723ec27-8ab7-4977-8875-e6c270c1ee14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:06:21.703640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723ec27-8ab7-4977-8875-e6c270c1ee14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:21.707457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723ec27-8ab7-4977-8875-e6c270c1ee14 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:21.721069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61987d-8fac-40c7-abb7-d3057b37374f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:21.723105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3f61987d-8fac-40c7-abb7-d3057b37374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:21.733421 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3250/6531] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:06:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:06:21.738649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723ec27-8ab7-4977-8875-e6c270c1ee14 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:21.754762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723ec27-8ab7-4977-8875-e6c270c1ee14 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:21.761141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc309e-38d6-440e-b262-770369bc9cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:21.762116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc309e-38d6-440e-b262-770369bc9cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:21.762575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc309e-38d6-440e-b262-770369bc9cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:21.763013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc309e-38d6-440e-b262-770369bc9cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:21.764219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc309e-38d6-440e-b262-770369bc9cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:21.766128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc309e-38d6-440e-b262-770369bc9cd6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:21.809088 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3251/6532] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:21 2021] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:06:21.813582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc309e-38d6-440e-b262-770369bc9cd6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:21.835183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61987d-8fac-40c7-abb7-d3057b37374f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:21.882754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc309e-38d6-440e-b262-770369bc9cd6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:21.888061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7fd84-5372-4610-a95d-0bc6f0fa4b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:21.888860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fd84-5372-4610-a95d-0bc6f0fa4b41 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:21.889188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fd84-5372-4610-a95d-0bc6f0fa4b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:21.889493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fd84-5372-4610-a95d-0bc6f0fa4b41 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:21.890120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7fd84-5372-4610-a95d-0bc6f0fa4b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:21.892094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7fd84-5372-4610-a95d-0bc6f0fa4b41 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:21.899553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b25ed-1965-4110-a9dc-3db7136bedad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:21.900238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b25ed-1965-4110-a9dc-3db7136bedad service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:21.900519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b25ed-1965-4110-a9dc-3db7136bedad service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:21.901086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b25ed-1965-4110-a9dc-3db7136bedad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:21.903019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-743b25ed-1965-4110-a9dc-3db7136bedad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:21.913894 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3252/6533] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:21 2021] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:06:21.917812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7fd84-5372-4610-a95d-0bc6f0fa4b41 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:21.922015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b25ed-1965-4110-a9dc-3db7136bedad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:21.924830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b25ed-1965-4110-a9dc-3db7136bedad service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:21.930237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7fd84-5372-4610-a95d-0bc6f0fa4b41 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:21.935071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97215ec-ca99-487f-b555-32f0ca9e1741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:21.935791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97215ec-ca99-487f-b555-32f0ca9e1741 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:21.936074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97215ec-ca99-487f-b555-32f0ca9e1741 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:21.936350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97215ec-ca99-487f-b555-32f0ca9e1741 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:21.937259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97215ec-ca99-487f-b555-32f0ca9e1741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:21.938835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97215ec-ca99-487f-b555-32f0ca9e1741 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:21.939998 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3282/6534] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:21 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:21.950317 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3253/6535] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:21 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:06:21.954277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b25ed-1965-4110-a9dc-3db7136bedad service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:21.966117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b25ed-1965-4110-a9dc-3db7136bedad service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:21.970977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203513b5-9a59-4e91-b3f5-2a975dfc9cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:21.971993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203513b5-9a59-4e91-b3f5-2a975dfc9cef admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:21.971993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203513b5-9a59-4e91-b3f5-2a975dfc9cef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:21.972228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203513b5-9a59-4e91-b3f5-2a975dfc9cef admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:21.972911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203513b5-9a59-4e91-b3f5-2a975dfc9cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:21.974493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203513b5-9a59-4e91-b3f5-2a975dfc9cef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:21.988373 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3283/6536] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:21.989556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97215ec-ca99-487f-b555-32f0ca9e1741 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:22.000464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97215ec-ca99-487f-b555-32f0ca9e1741 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:22.005898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331027d-da7e-4726-a71a-46e6f1dd8777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:22.006854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331027d-da7e-4726-a71a-46e6f1dd8777 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:22.007144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331027d-da7e-4726-a71a-46e6f1dd8777 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:22.007457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331027d-da7e-4726-a71a-46e6f1dd8777 admin admin] PATH_INFO: `/v3/projects/6932613307d5487fb2f86c52bd43f160/users/b2dabc2ea3044dd49789bbc25d9b1c0e/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:22.023165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331027d-da7e-4726-a71a-46e6f1dd8777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6932613307d5487fb2f86c52bd43f160, user_id=b2dabc2ea3044dd49789bbc25d9b1c0e, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:22.025876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331027d-da7e-4726-a71a-46e6f1dd8777 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:22.042672 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3254/6537] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:21 2021] PUT /identity/v3/projects/6932613307d5487fb2f86c52bd43f160/users/b2dabc2ea3044dd49789bbc25d9b1c0e/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:06:22.059088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edcaa7-9915-4d9b-a4e4-c2afdf4d47d8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:22.059448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edcaa7-9915-4d9b-a4e4-c2afdf4d47d8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:22.059791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edcaa7-9915-4d9b-a4e4-c2afdf4d47d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:22.090574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-66edcaa7-9915-4d9b-a4e4-c2afdf4d47d8 None None] MFA Rules not processed for user `b2dabc2ea3044dd49789bbc25d9b1c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:22.092158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-66edcaa7-9915-4d9b-a4e4-c2afdf4d47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:22.176489 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3284/6538] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:22 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:22.186926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331027d-da7e-4726-a71a-46e6f1dd8777 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:22.188806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1331027d-da7e-4726-a71a-46e6f1dd8777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:22.248753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331027d-da7e-4726-a71a-46e6f1dd8777 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:22.252415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdc36a-3766-47c0-bb47-20b3859069ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:22.253057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdc36a-3766-47c0-bb47-20b3859069ff service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:22.253340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdc36a-3766-47c0-bb47-20b3859069ff service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:22.253613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdc36a-3766-47c0-bb47-20b3859069ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:22.262452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdc36a-3766-47c0-bb47-20b3859069ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:22.263935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdc36a-3766-47c0-bb47-20b3859069ff service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:22.273917 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3255/6539] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:22 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:26.596274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edcaa7-9915-4d9b-a4e4-c2afdf4d47d8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:26.597750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-66edcaa7-9915-4d9b-a4e4-c2afdf4d47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:26.662022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edcaa7-9915-4d9b-a4e4-c2afdf4d47d8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:26.666438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:26.667327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:26.667606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:26.667888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] PATH_INFO: `/v3/users/7f047e715a384795921a30dfab4be955` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:26.669059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f047e715a384795921a30dfab4be955)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:26.670948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:26.718547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f047e715a384795921a30dfab4be955'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:26.726147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f047e715a384795921a30dfab4be955'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:26.726792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f047e715a384795921a30dfab4be955'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:26.733676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f047e715a384795921a30dfab4be955'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:26.746812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f047e715a384795921a30dfab4be955'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:26.753261 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3285/6540] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:26 2021] DELETE /identity/v3/users/7f047e715a384795921a30dfab4be955 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:26.757849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b926-1445-477a-b8b3-5cce981578ba None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:26.758351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b926-1445-477a-b8b3-5cce981578ba None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:26.758480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b926-1445-477a-b8b3-5cce981578ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:26.775192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f804b926-1445-477a-b8b3-5cce981578ba None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:26.776503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f804b926-1445-477a-b8b3-5cce981578ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:26.835690 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3256/6541] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:26.848264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:26.852837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:26.916137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61a0c0-4b5f-41f2-b606-93144a8543fb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:26.920013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312967d-8fc7-4a5a-9a90-fcc0c0c2dd57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:26.920745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312967d-8fc7-4a5a-9a90-fcc0c0c2dd57 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:26.921039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312967d-8fc7-4a5a-9a90-fcc0c0c2dd57 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:26.921324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312967d-8fc7-4a5a-9a90-fcc0c0c2dd57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:26.932492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312967d-8fc7-4a5a-9a90-fcc0c0c2dd57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:26.934271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312967d-8fc7-4a5a-9a90-fcc0c0c2dd57 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:26.944851 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3286/6542] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:27.203341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b926-1445-477a-b8b3-5cce981578ba None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:27.205632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f804b926-1445-477a-b8b3-5cce981578ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:27.220164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b926-1445-477a-b8b3-5cce981578ba None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:27.249376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:27.250587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:27.251048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:27.251525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] PATH_INFO: `/v3/projects/5ad20665d5f24ef592fcb13ca600d1fb` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:27.253001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad20665d5f24ef592fcb13ca600d1fb)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:27.255131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:27.313036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad20665d5f24ef592fcb13ca600d1fb', 'request_id': 'req-22b120a9-1221-4c8a-ad08-dc73a055731b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:27.322757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad20665d5f24ef592fcb13ca600d1fb', 'request_id': 'req-22b120a9-1221-4c8a-ad08-dc73a055731b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:27.333727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad20665d5f24ef592fcb13ca600d1fb', 'request_id': 'req-22b120a9-1221-4c8a-ad08-dc73a055731b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:27.346426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] The token cache is being invalidate because project 5ad20665d5f24ef592fcb13ca600d1fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:27.346713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:27.347420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22b120a9-1221-4c8a-ad08-dc73a055731b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:27.348966 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3257/6543] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:27 2021] DELETE /identity/v3/projects/5ad20665d5f24ef592fcb13ca600d1fb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:27.355121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d16d8d-dbf6-407b-b358-8d48c0c26936 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:27.355452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d16d8d-dbf6-407b-b358-8d48c0c26936 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:27.355734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d16d8d-dbf6-407b-b358-8d48c0c26936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:27.379500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-88d16d8d-dbf6-407b-b358-8d48c0c26936 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:27.380712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-88d16d8d-dbf6-407b-b358-8d48c0c26936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:27.449526 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3287/6544] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:27.457954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c57c6-4b33-4936-a497-1d0269fc195e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:27.458472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c57c6-4b33-4936-a497-1d0269fc195e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:27.458755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c57c6-4b33-4936-a497-1d0269fc195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:27.480662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-314c57c6-4b33-4936-a497-1d0269fc195e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:27.481890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-314c57c6-4b33-4936-a497-1d0269fc195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:27.490397 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3258/6545] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:27.496058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d16d8d-dbf6-407b-b358-8d48c0c26936 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:27.507819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d16d8d-dbf6-407b-b358-8d48c0c26936 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:27.512701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849af342-478f-48f9-bb80-5f60c40233ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:27.513363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af342-478f-48f9-bb80-5f60c40233ea admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:27.513643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af342-478f-48f9-bb80-5f60c40233ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:27.513918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af342-478f-48f9-bb80-5f60c40233ea admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:27.514649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849af342-478f-48f9-bb80-5f60c40233ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:06:27.514952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849af342-478f-48f9-bb80-5f60c40233ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:27.516587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849af342-478f-48f9-bb80-5f60c40233ea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:27.529079 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3288/6546] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:06:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:06:27.533146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c57c6-4b33-4936-a497-1d0269fc195e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:27.542160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c57c6-4b33-4936-a497-1d0269fc195e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:27.547057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dbe8f-ee84-4990-98e0-08507ce0f5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:27.547768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dbe8f-ee84-4990-98e0-08507ce0f5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:27.548053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dbe8f-ee84-4990-98e0-08507ce0f5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:27.548327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dbe8f-ee84-4990-98e0-08507ce0f5d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:27.549086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dbe8f-ee84-4990-98e0-08507ce0f5d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:27.550979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6dbe8f-ee84-4990-98e0-08507ce0f5d8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:27.577057 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3259/6547] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:27 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:06:27.581832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849af342-478f-48f9-bb80-5f60c40233ea admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:27.591635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849af342-478f-48f9-bb80-5f60c40233ea admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:27.648266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a6c38-34b6-4c14-b238-11f6b99875ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:27.649609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a6c38-34b6-4c14-b238-11f6b99875ef admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:27.649908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a6c38-34b6-4c14-b238-11f6b99875ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:27.650210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a6c38-34b6-4c14-b238-11f6b99875ef admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:27.650978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a6c38-34b6-4c14-b238-11f6b99875ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:27.652931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a6c38-34b6-4c14-b238-11f6b99875ef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:27.672657 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3289/6548] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:27 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:27.677112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dbe8f-ee84-4990-98e0-08507ce0f5d8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:27.688212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6dbe8f-ee84-4990-98e0-08507ce0f5d8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:27.693930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341ba17-7f65-4656-9187-cde4dc4b43c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:27.694657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341ba17-7f65-4656-9187-cde4dc4b43c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:27.695071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341ba17-7f65-4656-9187-cde4dc4b43c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:27.695392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341ba17-7f65-4656-9187-cde4dc4b43c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:27.696163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341ba17-7f65-4656-9187-cde4dc4b43c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:27.697826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341ba17-7f65-4656-9187-cde4dc4b43c1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:27.709428 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3260/6549] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:27 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:27.713330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a6c38-34b6-4c14-b238-11f6b99875ef admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:27.723542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a6c38-34b6-4c14-b238-11f6b99875ef admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:27.728209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e3081-65a2-48fb-b84c-6422027bbaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:27.728797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e3081-65a2-48fb-b84c-6422027bbaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:27.729079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e3081-65a2-48fb-b84c-6422027bbaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:27.729358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e3081-65a2-48fb-b84c-6422027bbaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:27.730086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e3081-65a2-48fb-b84c-6422027bbaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:27.731726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e3081-65a2-48fb-b84c-6422027bbaa0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:27.741760 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3290/6550] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:27.746473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341ba17-7f65-4656-9187-cde4dc4b43c1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:27.758475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341ba17-7f65-4656-9187-cde4dc4b43c1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:27.763659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e810-234a-482b-bb0b-0dccb5967952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:27.764584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e810-234a-482b-bb0b-0dccb5967952 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:27.764817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e810-234a-482b-bb0b-0dccb5967952 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:27.765094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e810-234a-482b-bb0b-0dccb5967952 admin admin] PATH_INFO: `/v3/projects/7afbb7ecad0945e481bdcce35173b4a3/users/063ba0eab97e42a6ab426bae795ecf9b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:27.781477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42e810-234a-482b-bb0b-0dccb5967952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7afbb7ecad0945e481bdcce35173b4a3, user_id=063ba0eab97e42a6ab426bae795ecf9b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:27.784188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42e810-234a-482b-bb0b-0dccb5967952 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:27.798704 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3261/6551] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:27 2021] PUT /identity/v3/projects/7afbb7ecad0945e481bdcce35173b4a3/users/063ba0eab97e42a6ab426bae795ecf9b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:27.812815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52533161-3780-4c75-bc5c-011635434528 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:27.813108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52533161-3780-4c75-bc5c-011635434528 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:27.813384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52533161-3780-4c75-bc5c-011635434528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:27.840143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-52533161-3780-4c75-bc5c-011635434528 None None] MFA Rules not processed for user `063ba0eab97e42a6ab426bae795ecf9b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:27.841327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-52533161-3780-4c75-bc5c-011635434528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:27.907844 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3291/6552] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:27 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:27.909218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e810-234a-482b-bb0b-0dccb5967952 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:27.929386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52533161-3780-4c75-bc5c-011635434528 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:27.930821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-52533161-3780-4c75-bc5c-011635434528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:27.978353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e810-234a-482b-bb0b-0dccb5967952 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:27.983374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ef1ae-afd7-4a1a-ab1d-dd656bedc4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:27.984074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ef1ae-afd7-4a1a-ab1d-dd656bedc4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:27.984369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ef1ae-afd7-4a1a-ab1d-dd656bedc4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:27.984653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ef1ae-afd7-4a1a-ab1d-dd656bedc4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:27.985378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ef1ae-afd7-4a1a-ab1d-dd656bedc4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:27.987826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ef1ae-afd7-4a1a-ab1d-dd656bedc4d1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:27.998605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52533161-3780-4c75-bc5c-011635434528 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:28.004046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da6098-0bd4-4a05-a340-48f2be1d02b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:28.005012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da6098-0bd4-4a05-a340-48f2be1d02b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.005313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da6098-0bd4-4a05-a340-48f2be1d02b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.005718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da6098-0bd4-4a05-a340-48f2be1d02b8 admin admin] PATH_INFO: `/v3/users/b2dabc2ea3044dd49789bbc25d9b1c0e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.006978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da6098-0bd4-4a05-a340-48f2be1d02b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2dabc2ea3044dd49789bbc25d9b1c0e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:28.009024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da6098-0bd4-4a05-a340-48f2be1d02b8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:28.016704 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3262/6553] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:27 2021] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:28.020948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ef1ae-afd7-4a1a-ab1d-dd656bedc4d1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:28.061933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30da6098-0bd4-4a05-a340-48f2be1d02b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2dabc2ea3044dd49789bbc25d9b1c0e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:28.070274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30da6098-0bd4-4a05-a340-48f2be1d02b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2dabc2ea3044dd49789bbc25d9b1c0e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:28.071117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30da6098-0bd4-4a05-a340-48f2be1d02b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2dabc2ea3044dd49789bbc25d9b1c0e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:28.078341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30da6098-0bd4-4a05-a340-48f2be1d02b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2dabc2ea3044dd49789bbc25d9b1c0e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:28.089739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ef1ae-afd7-4a1a-ab1d-dd656bedc4d1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:28.093469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-30da6098-0bd4-4a05-a340-48f2be1d02b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2dabc2ea3044dd49789bbc25d9b1c0e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:28.095010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936e449-f960-4350-8e5f-52647ee880ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:28.095785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e449-f960-4350-8e5f-52647ee880ed admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.096196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e449-f960-4350-8e5f-52647ee880ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.096338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e449-f960-4350-8e5f-52647ee880ed admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.097065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936e449-f960-4350-8e5f-52647ee880ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:28.099040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936e449-f960-4350-8e5f-52647ee880ed admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:28.100177 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3292/6554] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:27 2021] DELETE /identity/v3/users/b2dabc2ea3044dd49789bbc25d9b1c0e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:28.104340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad80f27-85bf-483a-bc74-0cc637e34702 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.104637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad80f27-85bf-483a-bc74-0cc637e34702 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.104918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad80f27-85bf-483a-bc74-0cc637e34702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.123959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9ad80f27-85bf-483a-bc74-0cc637e34702 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:28.124382 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3263/6555] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:28 2021] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:06:28.125936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9ad80f27-85bf-483a-bc74-0cc637e34702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:28.128791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936e449-f960-4350-8e5f-52647ee880ed admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:28.130334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6936e449-f960-4350-8e5f-52647ee880ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:28.142312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936e449-f960-4350-8e5f-52647ee880ed admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:28.187368 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3293/6556] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:28.197765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad80f27-85bf-483a-bc74-0cc637e34702 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:28.199217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9ad80f27-85bf-483a-bc74-0cc637e34702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:28.204351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48578c-f92c-4718-9b24-76c3eed04524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:28.205061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48578c-f92c-4718-9b24-76c3eed04524 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.205351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48578c-f92c-4718-9b24-76c3eed04524 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.205648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48578c-f92c-4718-9b24-76c3eed04524 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.206396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48578c-f92c-4718-9b24-76c3eed04524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:28.208053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48578c-f92c-4718-9b24-76c3eed04524 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:28.217964 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3264/6557] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:28 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:06:28.222598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48578c-f92c-4718-9b24-76c3eed04524 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:28.232974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48578c-f92c-4718-9b24-76c3eed04524 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:28.238479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525fb8-4f6a-494d-95b9-7affeb3bf09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:28.239396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525fb8-4f6a-494d-95b9-7affeb3bf09b admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.239692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525fb8-4f6a-494d-95b9-7affeb3bf09b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.240032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525fb8-4f6a-494d-95b9-7affeb3bf09b admin admin] PATH_INFO: `/v3/projects/2d8d9900b5f8499e91ad84b278134d0d/users/ea8b38fe12ad4b0e856774ffec82ce11/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.258987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa525fb8-4f6a-494d-95b9-7affeb3bf09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8d9900b5f8499e91ad84b278134d0d, user_id=ea8b38fe12ad4b0e856774ffec82ce11, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:28.262367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa525fb8-4f6a-494d-95b9-7affeb3bf09b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:28.263147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad80f27-85bf-483a-bc74-0cc637e34702 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:28.269943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b0ac0-60ac-4c21-ab3d-f75bde929ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:28.270978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0ac0-60ac-4c21-ab3d-f75bde929ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.271770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0ac0-60ac-4c21-ab3d-f75bde929ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.272055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0ac0-60ac-4c21-ab3d-f75bde929ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.283815 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3265/6558] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:28 2021] PUT /identity/v3/projects/2d8d9900b5f8499e91ad84b278134d0d/users/ea8b38fe12ad4b0e856774ffec82ce11/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:06:28.284723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525fb8-4f6a-494d-95b9-7affeb3bf09b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:28.284844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b0ac0-60ac-4c21-ab3d-f75bde929ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:28.286239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b0ac0-60ac-4c21-ab3d-f75bde929ad6 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:28.299437 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3294/6559] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:06:28.350737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525fb8-4f6a-494d-95b9-7affeb3bf09b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:28.355998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f36d2-3d0e-463b-bb24-3a95a0afeae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:28.356792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f36d2-3d0e-463b-bb24-3a95a0afeae3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.357082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f36d2-3d0e-463b-bb24-3a95a0afeae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.357359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f36d2-3d0e-463b-bb24-3a95a0afeae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.358126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f36d2-3d0e-463b-bb24-3a95a0afeae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:28.359946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f36d2-3d0e-463b-bb24-3a95a0afeae3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:28.371228 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3266/6560] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:28 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:28.375444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b0ac0-60ac-4c21-ab3d-f75bde929ad6 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:28.385216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b0ac0-60ac-4c21-ab3d-f75bde929ad6 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:28.389959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2f9e-b546-4e82-a1a2-037fea8bbeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:28.390928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2f9e-b546-4e82-a1a2-037fea8bbeca admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.391213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2f9e-b546-4e82-a1a2-037fea8bbeca admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.391520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2f9e-b546-4e82-a1a2-037fea8bbeca admin admin] PATH_INFO: `/v3/projects/2d8d9900b5f8499e91ad84b278134d0d/users/ea8b38fe12ad4b0e856774ffec82ce11/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.393596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f2f9e-b546-4e82-a1a2-037fea8bbeca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8d9900b5f8499e91ad84b278134d0d, user_id=ea8b38fe12ad4b0e856774ffec82ce11, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:28.396477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f2f9e-b546-4e82-a1a2-037fea8bbeca admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:28.407787 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3295/6561] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:28 2021] PUT /identity/v3/projects/2d8d9900b5f8499e91ad84b278134d0d/users/ea8b38fe12ad4b0e856774ffec82ce11/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:06:28.419851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11006b0-a73c-4268-b835-10b151104d98 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.420145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11006b0-a73c-4268-b835-10b151104d98 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.420426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11006b0-a73c-4268-b835-10b151104d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.461255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c11006b0-a73c-4268-b835-10b151104d98 None None] MFA Rules not processed for user `ea8b38fe12ad4b0e856774ffec82ce11`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:28.462478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c11006b0-a73c-4268-b835-10b151104d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:28.536562 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3267/6562] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:28 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:28.547613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2f9e-b546-4e82-a1a2-037fea8bbeca admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:28.549886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0f8f2f9e-b546-4e82-a1a2-037fea8bbeca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:28.608574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2f9e-b546-4e82-a1a2-037fea8bbeca admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:28.612920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b9e66-8d47-4f90-9ff5-680b269ba97d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:28.613565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9e66-8d47-4f90-9ff5-680b269ba97d service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.613899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9e66-8d47-4f90-9ff5-680b269ba97d service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.614180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9e66-8d47-4f90-9ff5-680b269ba97d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.623704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b9e66-8d47-4f90-9ff5-680b269ba97d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:28.625167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b9e66-8d47-4f90-9ff5-680b269ba97d service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:28.634787 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3296/6563] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:28 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:28.660004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11006b0-a73c-4268-b835-10b151104d98 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:28.661592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c11006b0-a73c-4268-b835-10b151104d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:28.708473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b9e66-8d47-4f90-9ff5-680b269ba97d service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:28.721388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b9e66-8d47-4f90-9ff5-680b269ba97d service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:28.725316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1663899-fb06-4241-a064-8f732f0db9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:28.726009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1663899-fb06-4241-a064-8f732f0db9ac service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.726301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1663899-fb06-4241-a064-8f732f0db9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.726579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1663899-fb06-4241-a064-8f732f0db9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.728407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b1663899-fb06-4241-a064-8f732f0db9ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:28.739143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11006b0-a73c-4268-b835-10b151104d98 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:28.744483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:28.745326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.745862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.746141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] PATH_INFO: `/v3/projects/6932613307d5487fb2f86c52bd43f160` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.747451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6932613307d5487fb2f86c52bd43f160)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:28.749447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:28.789112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1663899-fb06-4241-a064-8f732f0db9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:28.790652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1663899-fb06-4241-a064-8f732f0db9ac service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:28.799981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6932613307d5487fb2f86c52bd43f160', 'request_id': 'req-83f2d897-1883-423d-904f-9e7bd8c88c27'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:28.800491 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3297/6564] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:28 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:06:28.806483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6932613307d5487fb2f86c52bd43f160', 'request_id': 'req-83f2d897-1883-423d-904f-9e7bd8c88c27'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:28.818396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6932613307d5487fb2f86c52bd43f160', 'request_id': 'req-83f2d897-1883-423d-904f-9e7bd8c88c27'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:28.834257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] The token cache is being invalidate because project 6932613307d5487fb2f86c52bd43f160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:28.834257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:28.835503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-83f2d897-1883-423d-904f-9e7bd8c88c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:28.837669 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3268/6565] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:28 2021] DELETE /identity/v3/projects/6932613307d5487fb2f86c52bd43f160 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:28.843213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbecce-1d91-4c79-871f-ed9ca849c08b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.843635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbecce-1d91-4c79-871f-ed9ca849c08b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.844024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbecce-1d91-4c79-871f-ed9ca849c08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.871223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-63bbecce-1d91-4c79-871f-ed9ca849c08b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:28.873021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-63bbecce-1d91-4c79-871f-ed9ca849c08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:28.944348 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3298/6566] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:28.952070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80a240-5bb0-4c4d-aff5-cbe740d39128 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:28.952232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80a240-5bb0-4c4d-aff5-cbe740d39128 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:28.952502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80a240-5bb0-4c4d-aff5-cbe740d39128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:28.972722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7c80a240-5bb0-4c4d-aff5-cbe740d39128 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:28.974296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7c80a240-5bb0-4c4d-aff5-cbe740d39128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:28.987615 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3269/6567] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:28.990041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbecce-1d91-4c79-871f-ed9ca849c08b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.000136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbecce-1d91-4c79-871f-ed9ca849c08b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.007371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae505b08-f8d2-4839-b3dc-d9c49b264949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.008119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505b08-f8d2-4839-b3dc-d9c49b264949 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.008401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505b08-f8d2-4839-b3dc-d9c49b264949 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.008672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505b08-f8d2-4839-b3dc-d9c49b264949 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.009408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae505b08-f8d2-4839-b3dc-d9c49b264949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:06:29.009714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae505b08-f8d2-4839-b3dc-d9c49b264949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.011318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae505b08-f8d2-4839-b3dc-d9c49b264949 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.046916 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3299/6568] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:06:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:06:29.048282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80a240-5bb0-4c4d-aff5-cbe740d39128 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.057722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80a240-5bb0-4c4d-aff5-cbe740d39128 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.062570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bf91a-3de1-4c1e-8080-47604f5e59f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.063264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bf91a-3de1-4c1e-8080-47604f5e59f7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.063594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bf91a-3de1-4c1e-8080-47604f5e59f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.063874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bf91a-3de1-4c1e-8080-47604f5e59f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.065101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bf91a-3de1-4c1e-8080-47604f5e59f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.067006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bf91a-3de1-4c1e-8080-47604f5e59f7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.068166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20850ef-0834-44a6-8c97-0291adae86de None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.068592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20850ef-0834-44a6-8c97-0291adae86de None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.069008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20850ef-0834-44a6-8c97-0291adae86de None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.071138 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3300/6569] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 21:06:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 21:06:29.077397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9001abe-87d2-4b5b-926f-ef128a237890 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.077865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9001abe-87d2-4b5b-926f-ef128a237890 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.078296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9001abe-87d2-4b5b-926f-ef128a237890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.096820 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3270/6570] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:29 2021] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:29.100385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d9001abe-87d2-4b5b-926f-ef128a237890 None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:29.101112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bf91a-3de1-4c1e-8080-47604f5e59f7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.101569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d9001abe-87d2-4b5b-926f-ef128a237890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:29.163695 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3301/6571] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:06:29 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:29.165725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bf91a-3de1-4c1e-8080-47604f5e59f7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.170622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e207d83-9234-4279-aae6-994d8fe2d93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.171407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e207d83-9234-4279-aae6-994d8fe2d93b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.171916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e207d83-9234-4279-aae6-994d8fe2d93b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.172263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e207d83-9234-4279-aae6-994d8fe2d93b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.173036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e207d83-9234-4279-aae6-994d8fe2d93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.175476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e207d83-9234-4279-aae6-994d8fe2d93b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.176240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9001abe-87d2-4b5b-926f-ef128a237890 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.177606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d9001abe-87d2-4b5b-926f-ef128a237890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:29.192375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9001abe-87d2-4b5b-926f-ef128a237890 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.196370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477a85f-9ece-4f4d-bd3b-e383c75e1e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.196684 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3271/6572] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:29 2021] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:06:29.197019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477a85f-9ece-4f4d-bd3b-e383c75e1e7a service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.197421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477a85f-9ece-4f4d-bd3b-e383c75e1e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.197706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477a85f-9ece-4f4d-bd3b-e383c75e1e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.200684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e207d83-9234-4279-aae6-994d8fe2d93b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.205904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477a85f-9ece-4f4d-bd3b-e383c75e1e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.207531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477a85f-9ece-4f4d-bd3b-e383c75e1e7a service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.211029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e207d83-9234-4279-aae6-994d8fe2d93b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.215287 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3302/6573] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:29 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:06:29.216183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3d812-c80b-4253-a0a2-d3b22a9ce818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.216902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d812-c80b-4253-a0a2-d3b22a9ce818 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.217194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d812-c80b-4253-a0a2-d3b22a9ce818 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.217475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d812-c80b-4253-a0a2-d3b22a9ce818 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.218206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3d812-c80b-4253-a0a2-d3b22a9ce818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.219838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3d812-c80b-4253-a0a2-d3b22a9ce818 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.230424 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3272/6574] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:06:29.234381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477a85f-9ece-4f4d-bd3b-e383c75e1e7a service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.246042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477a85f-9ece-4f4d-bd3b-e383c75e1e7a service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.250779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d577c-0881-461a-9496-9d1bb1bdbbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.251511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d577c-0881-461a-9496-9d1bb1bdbbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.252360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d577c-0881-461a-9496-9d1bb1bdbbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.252641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d577c-0881-461a-9496-9d1bb1bdbbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.253931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d577c-0881-461a-9496-9d1bb1bdbbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.255577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d577c-0881-461a-9496-9d1bb1bdbbb2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.269207 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3303/6575] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:29 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:29.271521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3d812-c80b-4253-a0a2-d3b22a9ce818 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.283017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3d812-c80b-4253-a0a2-d3b22a9ce818 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.287800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751e32e-4063-46d9-be03-60ab519859c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.288679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e32e-4063-46d9-be03-60ab519859c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.288962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e32e-4063-46d9-be03-60ab519859c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.289252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e32e-4063-46d9-be03-60ab519859c2 admin admin] PATH_INFO: `/v3/projects/0e5095f98d2343c580afbe3b6ca53b96/users/db14a94ab5604fa9a7e65087f820a3c1/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.304785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751e32e-4063-46d9-be03-60ab519859c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5095f98d2343c580afbe3b6ca53b96, user_id=db14a94ab5604fa9a7e65087f820a3c1, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.307513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751e32e-4063-46d9-be03-60ab519859c2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.322236 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3273/6576] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:29 2021] PUT /identity/v3/projects/0e5095f98d2343c580afbe3b6ca53b96/users/db14a94ab5604fa9a7e65087f820a3c1/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:29.334087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560084-04db-4e22-80f5-14c087cd9d29 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.334375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560084-04db-4e22-80f5-14c087cd9d29 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.334654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be560084-04db-4e22-80f5-14c087cd9d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.371877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-be560084-04db-4e22-80f5-14c087cd9d29 None None] MFA Rules not processed for user `db14a94ab5604fa9a7e65087f820a3c1`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:29.373370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-be560084-04db-4e22-80f5-14c087cd9d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:29.456569 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3304/6577] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:29 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:29.461309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751e32e-4063-46d9-be03-60ab519859c2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.531727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751e32e-4063-46d9-be03-60ab519859c2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.541285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6517b-79a4-4dce-a297-d3bf4a9a899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.541948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6517b-79a4-4dce-a297-d3bf4a9a899a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.542229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6517b-79a4-4dce-a297-d3bf4a9a899a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.542555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6517b-79a4-4dce-a297-d3bf4a9a899a admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.543386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6517b-79a4-4dce-a297-d3bf4a9a899a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.545351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6517b-79a4-4dce-a297-d3bf4a9a899a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.575684 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3274/6578] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:29 2021] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:29.576884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be560084-04db-4e22-80f5-14c087cd9d29 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.587832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be560084-04db-4e22-80f5-14c087cd9d29 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.662555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1509e-d5e9-4927-a00c-d7044254e8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.663368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1509e-d5e9-4927-a00c-d7044254e8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.663652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1509e-d5e9-4927-a00c-d7044254e8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.663929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1509e-d5e9-4927-a00c-d7044254e8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.665156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1509e-d5e9-4927-a00c-d7044254e8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.668300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1509e-d5e9-4927-a00c-d7044254e8c4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.701166 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3305/6579] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:29 2021] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:06:29.705534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6517b-79a4-4dce-a297-d3bf4a9a899a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.717726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6517b-79a4-4dce-a297-d3bf4a9a899a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.724974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4f103-0864-4c43-af3c-9e07972ed961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.725658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4f103-0864-4c43-af3c-9e07972ed961 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.725970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4f103-0864-4c43-af3c-9e07972ed961 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.726216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4f103-0864-4c43-af3c-9e07972ed961 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.726954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4f103-0864-4c43-af3c-9e07972ed961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.728649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4f103-0864-4c43-af3c-9e07972ed961 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.740991 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3275/6580] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:29 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:29.749307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1509e-d5e9-4927-a00c-d7044254e8c4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.759546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1509e-d5e9-4927-a00c-d7044254e8c4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.764397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf3135-ebc6-4705-bc92-80be3ba94951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.765052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf3135-ebc6-4705-bc92-80be3ba94951 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.765334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf3135-ebc6-4705-bc92-80be3ba94951 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.765608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf3135-ebc6-4705-bc92-80be3ba94951 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.766366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf3135-ebc6-4705-bc92-80be3ba94951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.768210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf3135-ebc6-4705-bc92-80be3ba94951 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.778659 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3306/6581] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:29.782598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4f103-0864-4c43-af3c-9e07972ed961 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:29.793883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4f103-0864-4c43-af3c-9e07972ed961 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:29.799161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04dd44-8f29-4a20-9fa4-4bc6a5dc7151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:29.800074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04dd44-8f29-4a20-9fa4-4bc6a5dc7151 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.800620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04dd44-8f29-4a20-9fa4-4bc6a5dc7151 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.800620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04dd44-8f29-4a20-9fa4-4bc6a5dc7151 admin admin] PATH_INFO: `/v3/projects/be1fcaf3208148b7ab32f74cba12ff8c/users/c6e2cae17ae042138650a511f1e9ee37/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.816659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04dd44-8f29-4a20-9fa4-4bc6a5dc7151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1fcaf3208148b7ab32f74cba12ff8c, user_id=c6e2cae17ae042138650a511f1e9ee37, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:29.819455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04dd44-8f29-4a20-9fa4-4bc6a5dc7151 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:29.833182 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3276/6582] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:29 2021] PUT /identity/v3/projects/be1fcaf3208148b7ab32f74cba12ff8c/users/c6e2cae17ae042138650a511f1e9ee37/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:29.842603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19416ed6-f2d8-44e4-9bc8-9ce11ee26336 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:29.842872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19416ed6-f2d8-44e4-9bc8-9ce11ee26336 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:29.843142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19416ed6-f2d8-44e4-9bc8-9ce11ee26336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:29.870111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-19416ed6-f2d8-44e4-9bc8-9ce11ee26336 None None] MFA Rules not processed for user `c6e2cae17ae042138650a511f1e9ee37`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:29.871614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-19416ed6-f2d8-44e4-9bc8-9ce11ee26336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:29.942396 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3307/6583] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:29 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:29.946956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04dd44-8f29-4a20-9fa4-4bc6a5dc7151 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:30.034967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04dd44-8f29-4a20-9fa4-4bc6a5dc7151 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:30.041583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e9307-26ce-4e3f-acdf-da83f9b3148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:30.042486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e9307-26ce-4e3f-acdf-da83f9b3148b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:30.042836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e9307-26ce-4e3f-acdf-da83f9b3148b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:30.043182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e9307-26ce-4e3f-acdf-da83f9b3148b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:30.044163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e9307-26ce-4e3f-acdf-da83f9b3148b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:30.047394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e9307-26ce-4e3f-acdf-da83f9b3148b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:30.092404 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3277/6584] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:29 2021] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:30.095082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19416ed6-f2d8-44e4-9bc8-9ce11ee26336 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:30.109206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19416ed6-f2d8-44e4-9bc8-9ce11ee26336 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:30.201724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35689882-f6dd-4696-ad70-f0822b1d0791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:30.202479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689882-f6dd-4696-ad70-f0822b1d0791 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:30.202761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689882-f6dd-4696-ad70-f0822b1d0791 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:30.203031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35689882-f6dd-4696-ad70-f0822b1d0791 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:30.204093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35689882-f6dd-4696-ad70-f0822b1d0791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:30.206570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35689882-f6dd-4696-ad70-f0822b1d0791 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:30.228118 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3308/6585] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:30 2021] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:30.232154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e9307-26ce-4e3f-acdf-da83f9b3148b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:30.243369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e9307-26ce-4e3f-acdf-da83f9b3148b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:30.250622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277e769-182b-43c2-99e6-caa2c53e8900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:30.251336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277e769-182b-43c2-99e6-caa2c53e8900 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:30.251661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277e769-182b-43c2-99e6-caa2c53e8900 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:30.251939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277e769-182b-43c2-99e6-caa2c53e8900 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:30.252678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277e769-182b-43c2-99e6-caa2c53e8900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:30.254367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277e769-182b-43c2-99e6-caa2c53e8900 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:30.267976 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3278/6586] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:30 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:30.272432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35689882-f6dd-4696-ad70-f0822b1d0791 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:30.289131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35689882-f6dd-4696-ad70-f0822b1d0791 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:30.294593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb260c2-a451-4e9a-9094-15270a237c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:30.295620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb260c2-a451-4e9a-9094-15270a237c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:30.296095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb260c2-a451-4e9a-9094-15270a237c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:30.296458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb260c2-a451-4e9a-9094-15270a237c09 admin admin] PATH_INFO: `/v3/projects/19ed7a0660a8433aba8702f0adca92e4/users/e166e9bf082944308f1f03c79ed5e6ad/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:30.313683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb260c2-a451-4e9a-9094-15270a237c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ed7a0660a8433aba8702f0adca92e4, user_id=e166e9bf082944308f1f03c79ed5e6ad, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:30.327293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb260c2-a451-4e9a-9094-15270a237c09 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:30.364778 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3309/6587] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:30 2021] PUT /identity/v3/projects/19ed7a0660a8433aba8702f0adca92e4/users/e166e9bf082944308f1f03c79ed5e6ad/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:06:30.368741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277e769-182b-43c2-99e6-caa2c53e8900 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:30.384131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277e769-182b-43c2-99e6-caa2c53e8900 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:30.468239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f0dbe-a45e-48d1-87fd-62eeb9026e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:30.468934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f0dbe-a45e-48d1-87fd-62eeb9026e18 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:30.469250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f0dbe-a45e-48d1-87fd-62eeb9026e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:30.469524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f0dbe-a45e-48d1-87fd-62eeb9026e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:30.470283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f0dbe-a45e-48d1-87fd-62eeb9026e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:30.472453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f0dbe-a45e-48d1-87fd-62eeb9026e18 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:30.482948 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3279/6588] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:30 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:06:30.487000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb260c2-a451-4e9a-9094-15270a237c09 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:30.501359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb260c2-a451-4e9a-9094-15270a237c09 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:30.508165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f293094-2d82-4cc1-a7e0-a25010a5f0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:30.509149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f293094-2d82-4cc1-a7e0-a25010a5f0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:30.509497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f293094-2d82-4cc1-a7e0-a25010a5f0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:30.509842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f293094-2d82-4cc1-a7e0-a25010a5f0ff admin admin] PATH_INFO: `/v3/projects/19ed7a0660a8433aba8702f0adca92e4/users/e166e9bf082944308f1f03c79ed5e6ad/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:30.512235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f293094-2d82-4cc1-a7e0-a25010a5f0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ed7a0660a8433aba8702f0adca92e4, user_id=e166e9bf082944308f1f03c79ed5e6ad, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:30.514854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f293094-2d82-4cc1-a7e0-a25010a5f0ff admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:30.530317 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3310/6589] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:30 2021] PUT /identity/v3/projects/19ed7a0660a8433aba8702f0adca92e4/users/e166e9bf082944308f1f03c79ed5e6ad/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:06:30.539891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4116-328e-4c7f-81ab-ab437e32cbb7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:30.540182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4116-328e-4c7f-81ab-ab437e32cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:30.540458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4116-328e-4c7f-81ab-ab437e32cbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:30.573533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2e6a4116-328e-4c7f-81ab-ab437e32cbb7 None None] MFA Rules not processed for user `e166e9bf082944308f1f03c79ed5e6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:30.575685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2e6a4116-328e-4c7f-81ab-ab437e32cbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:30.678274 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3280/6590] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:30 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:30.686389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f293094-2d82-4cc1-a7e0-a25010a5f0ff admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:30.688252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7f293094-2d82-4cc1-a7e0-a25010a5f0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:30.746394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f293094-2d82-4cc1-a7e0-a25010a5f0ff admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:30.751223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1579a9-a2a7-4e11-a4d7-1ee84d41cc5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:30.752433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1579a9-a2a7-4e11-a4d7-1ee84d41cc5b service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:30.752796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1579a9-a2a7-4e11-a4d7-1ee84d41cc5b service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:30.753140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1579a9-a2a7-4e11-a4d7-1ee84d41cc5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:30.818822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1579a9-a2a7-4e11-a4d7-1ee84d41cc5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:30.820461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1579a9-a2a7-4e11-a4d7-1ee84d41cc5b service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:30.833190 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3311/6591] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:30 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:32.382485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a4116-328e-4c7f-81ab-ab437e32cbb7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:32.397651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a4116-328e-4c7f-81ab-ab437e32cbb7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:32.403422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfa392-c3c2-4b38-b4fa-4dadcf7a8f6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:32.405799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfa392-c3c2-4b38-b4fa-4dadcf7a8f6b service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:32.406396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfa392-c3c2-4b38-b4fa-4dadcf7a8f6b service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:32.406890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfa392-c3c2-4b38-b4fa-4dadcf7a8f6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:32.519236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfa392-c3c2-4b38-b4fa-4dadcf7a8f6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:32.523562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfa392-c3c2-4b38-b4fa-4dadcf7a8f6b service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:32.552924 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3281/6592] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:32 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:33.332991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1579a9-a2a7-4e11-a4d7-1ee84d41cc5b service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:33.348337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1579a9-a2a7-4e11-a4d7-1ee84d41cc5b service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:33.353123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2a2f9-4d55-4974-968c-356f4d6a6691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:33.354186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2a2f9-4d55-4974-968c-356f4d6a6691 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:33.354812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2a2f9-4d55-4974-968c-356f4d6a6691 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:33.355773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2a2f9-4d55-4974-968c-356f4d6a6691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:33.378074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2a2f9-4d55-4974-968c-356f4d6a6691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:33.379875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2a2f9-4d55-4974-968c-356f4d6a6691 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:33.396559 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3312/6593] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:33 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:36.087805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5aee-555a-4167-8705-8b2f18d1c067 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:36.088308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5aee-555a-4167-8705-8b2f18d1c067 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:36.088398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5aee-555a-4167-8705-8b2f18d1c067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:36.108717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e2be5aee-555a-4167-8705-8b2f18d1c067 None None] MFA Rules not processed for user `21a4340936c347d3b226f54f99403219`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:36.109928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e2be5aee-555a-4167-8705-8b2f18d1c067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:36.270691 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3282/6594] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:36 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:37.619723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2a2f9-4d55-4974-968c-356f4d6a6691 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:37.621500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-69e2a2f9-4d55-4974-968c-356f4d6a6691 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:37.811385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2a2f9-4d55-4974-968c-356f4d6a6691 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:37.818992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f4fe8-d82a-46dd-b8a9-d3d2f61e2a9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:37.820060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4fe8-d82a-46dd-b8a9-d3d2f61e2a9e service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:37.820560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4fe8-d82a-46dd-b8a9-d3d2f61e2a9e service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:37.820999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f4fe8-d82a-46dd-b8a9-d3d2f61e2a9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:37.823390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-568f4fe8-d82a-46dd-b8a9-d3d2f61e2a9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:37.860301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f4fe8-d82a-46dd-b8a9-d3d2f61e2a9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:37.864563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f4fe8-d82a-46dd-b8a9-d3d2f61e2a9e service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:37.883980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be5aee-555a-4167-8705-8b2f18d1c067 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:37.899627 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3313/6595] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:38.014753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be5aee-555a-4167-8705-8b2f18d1c067 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:38.021139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:38.022906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:38.023462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:38.024103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] PATH_INFO: `/v3/users/db14a94ab5604fa9a7e65087f820a3c1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:38.025899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db14a94ab5604fa9a7e65087f820a3c1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:38.028495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:38.112642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db14a94ab5604fa9a7e65087f820a3c1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:38.113900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db14a94ab5604fa9a7e65087f820a3c1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:38.128666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db14a94ab5604fa9a7e65087f820a3c1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:38.130431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db14a94ab5604fa9a7e65087f820a3c1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:38.151225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db14a94ab5604fa9a7e65087f820a3c1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:38.179218 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3283/6596] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:37 2021] DELETE /identity/v3/users/db14a94ab5604fa9a7e65087f820a3c1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:38.180339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace46a3b-68b6-413c-90de-7ecd85f75316 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:38.180636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace46a3b-68b6-413c-90de-7ecd85f75316 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:38.180911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace46a3b-68b6-413c-90de-7ecd85f75316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:38.214176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ace46a3b-68b6-413c-90de-7ecd85f75316 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:38.222091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ace46a3b-68b6-413c-90de-7ecd85f75316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:38.349504 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3314/6597] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:38.357515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:38.359269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:38.483084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37274762-f5ba-4357-a883-28cb06e4e543 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:38.490988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a7b40-df64-4ef7-8edd-f8a7f75c6d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:38.492175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a7b40-df64-4ef7-8edd-f8a7f75c6d7c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:38.492519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a7b40-df64-4ef7-8edd-f8a7f75c6d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:38.492741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a7b40-df64-4ef7-8edd-f8a7f75c6d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:38.519920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a7b40-df64-4ef7-8edd-f8a7f75c6d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:38.525173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a7b40-df64-4ef7-8edd-f8a7f75c6d7c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:38.552904 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3284/6598] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:38.998712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace46a3b-68b6-413c-90de-7ecd85f75316 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:39.000305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ace46a3b-68b6-413c-90de-7ecd85f75316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:39.015447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace46a3b-68b6-413c-90de-7ecd85f75316 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:39.022484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:39.023599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:39.024029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:39.024412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] PATH_INFO: `/v3/projects/0e5095f98d2343c580afbe3b6ca53b96` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:39.025855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5095f98d2343c580afbe3b6ca53b96)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:39.028617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:39.116295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5095f98d2343c580afbe3b6ca53b96', 'request_id': 'req-1c76d062-626e-4514-9198-f822f2ee7b7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:39.127446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5095f98d2343c580afbe3b6ca53b96', 'request_id': 'req-1c76d062-626e-4514-9198-f822f2ee7b7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:39.135055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5095f98d2343c580afbe3b6ca53b96', 'request_id': 'req-1c76d062-626e-4514-9198-f822f2ee7b7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:39.147565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] The token cache is being invalidate because project 0e5095f98d2343c580afbe3b6ca53b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:39.147959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:39.148710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:39.150348 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3315/6599] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:38 2021] DELETE /identity/v3/projects/0e5095f98d2343c580afbe3b6ca53b96 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:06:39.154409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a7b40-df64-4ef7-8edd-f8a7f75c6d7c service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:39.165349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a7b40-df64-4ef7-8edd-f8a7f75c6d7c service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:39.236802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:39.237784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:39.238132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:39.238475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] PATH_INFO: `/v3/users/c6e2cae17ae042138650a511f1e9ee37` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:39.239936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e2cae17ae042138650a511f1e9ee37)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:39.243770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:39.305662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e2cae17ae042138650a511f1e9ee37'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:39.306456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e2cae17ae042138650a511f1e9ee37'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:39.323449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e2cae17ae042138650a511f1e9ee37'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:39.324253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e2cae17ae042138650a511f1e9ee37'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:39.339065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e2cae17ae042138650a511f1e9ee37'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:39.362311 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3285/6600] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:39 2021] DELETE /identity/v3/users/c6e2cae17ae042138650a511f1e9ee37 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:39.882243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:39.883752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:39.905265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76d062-626e-4514-9198-f822f2ee7b7f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:39.997418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:39.998498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:39.999134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:40.000055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] PATH_INFO: `/v3/projects/be1fcaf3208148b7ab32f74cba12ff8c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:40.002906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1fcaf3208148b7ab32f74cba12ff8c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:40.006276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:40.070489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1fcaf3208148b7ab32f74cba12ff8c', 'request_id': 'req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:40.099341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1fcaf3208148b7ab32f74cba12ff8c', 'request_id': 'req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:40.116445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1fcaf3208148b7ab32f74cba12ff8c', 'request_id': 'req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:40.133573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] The token cache is being invalidate because project be1fcaf3208148b7ab32f74cba12ff8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:40.133881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:40.134926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:40.136547 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3316/6601] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:39 2021] DELETE /identity/v3/projects/be1fcaf3208148b7ab32f74cba12ff8c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:40.141311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:40.144002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:40.173315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e4b02-e048-4a4e-9385-794d5c348a52 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:40.266231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5266c08-44f4-4d2f-a447-7f96199e5140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:40.267873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266c08-44f4-4d2f-a447-7f96199e5140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:40.268234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266c08-44f4-4d2f-a447-7f96199e5140 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:40.268635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5266c08-44f4-4d2f-a447-7f96199e5140 admin admin] PATH_INFO: `/v3/users/e166e9bf082944308f1f03c79ed5e6ad` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:40.270165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5266c08-44f4-4d2f-a447-7f96199e5140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e166e9bf082944308f1f03c79ed5e6ad)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:40.273098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5266c08-44f4-4d2f-a447-7f96199e5140 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:40.333935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f5266c08-44f4-4d2f-a447-7f96199e5140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e166e9bf082944308f1f03c79ed5e6ad'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:40.334591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f5266c08-44f4-4d2f-a447-7f96199e5140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e166e9bf082944308f1f03c79ed5e6ad'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:40.342677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f5266c08-44f4-4d2f-a447-7f96199e5140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e166e9bf082944308f1f03c79ed5e6ad'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:40.343616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f5266c08-44f4-4d2f-a447-7f96199e5140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e166e9bf082944308f1f03c79ed5e6ad'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:40.351070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f5266c08-44f4-4d2f-a447-7f96199e5140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e166e9bf082944308f1f03c79ed5e6ad'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:40.369728 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3286/6602] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:06:40 2021] DELETE /identity/v3/users/e166e9bf082944308f1f03c79ed5e6ad => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:40.842849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:40.844300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:40.857298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8cbc1-d34f-4109-be96-4efbb1d8d8cb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:40.922223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:40.923737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:40.924230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:40.924513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] PATH_INFO: `/v3/projects/19ed7a0660a8433aba8702f0adca92e4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:40.925788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ed7a0660a8433aba8702f0adca92e4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:40.927799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:40.992005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ed7a0660a8433aba8702f0adca92e4', 'request_id': 'req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:41.002025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ed7a0660a8433aba8702f0adca92e4', 'request_id': 'req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:41.014223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ed7a0660a8433aba8702f0adca92e4', 'request_id': 'req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:41.027269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] The token cache is being invalidate because project 19ed7a0660a8433aba8702f0adca92e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:06:41.027575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:41.028244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-29df5b8b-e1e5-4062-b0b2-109e1fe4c9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:06:41.041945 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3317/6603] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:06:40 2021] DELETE /identity/v3/projects/19ed7a0660a8433aba8702f0adca92e4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:06:41.045642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b5a44-2c9c-42fe-bd08-56bd190d9024 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:41.046409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b5a44-2c9c-42fe-bd08-56bd190d9024 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:41.047153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b5a44-2c9c-42fe-bd08-56bd190d9024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:41.088597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6c3b5a44-2c9c-42fe-bd08-56bd190d9024 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:41.090171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6c3b5a44-2c9c-42fe-bd08-56bd190d9024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:41.199211 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3287/6604] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:41.207449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac9c9-1880-4d76-bd00-d5cc6b729cd6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:41.208245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac9c9-1880-4d76-bd00-d5cc6b729cd6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:41.208917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac9c9-1880-4d76-bd00-d5cc6b729cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:41.262178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bf7ac9c9-1880-4d76-bd00-d5cc6b729cd6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:41.266664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bf7ac9c9-1880-4d76-bd00-d5cc6b729cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:41.290804 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3318/6605] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:41.291413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b5a44-2c9c-42fe-bd08-56bd190d9024 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:41.307537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b5a44-2c9c-42fe-bd08-56bd190d9024 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:41.318921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835ead5-d27a-4a1c-8a2d-5f614378e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:41.320235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835ead5-d27a-4a1c-8a2d-5f614378e3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:41.320841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835ead5-d27a-4a1c-8a2d-5f614378e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:41.321600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835ead5-d27a-4a1c-8a2d-5f614378e3d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:41.322739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835ead5-d27a-4a1c-8a2d-5f614378e3d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:06:41.323412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835ead5-d27a-4a1c-8a2d-5f614378e3d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:41.325248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835ead5-d27a-4a1c-8a2d-5f614378e3d2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:41.341173 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3288/6606] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:06:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:06:41.347509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac9c9-1880-4d76-bd00-d5cc6b729cd6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:41.362255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac9c9-1880-4d76-bd00-d5cc6b729cd6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:41.378852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e32fa0-953d-4bfd-81bc-8f4b6bb0e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:41.380651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e32fa0-953d-4bfd-81bc-8f4b6bb0e79f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:41.381292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e32fa0-953d-4bfd-81bc-8f4b6bb0e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:41.381836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e32fa0-953d-4bfd-81bc-8f4b6bb0e79f admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:41.382960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e32fa0-953d-4bfd-81bc-8f4b6bb0e79f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:41.386615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e32fa0-953d-4bfd-81bc-8f4b6bb0e79f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:41.440991 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3319/6607] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:06:41 2021] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:41.446103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835ead5-d27a-4a1c-8a2d-5f614378e3d2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:41.473843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835ead5-d27a-4a1c-8a2d-5f614378e3d2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:41.602454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8585cc3-7f17-47a6-a14b-80165bd6406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:41.603157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585cc3-7f17-47a6-a14b-80165bd6406d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:41.603481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585cc3-7f17-47a6-a14b-80165bd6406d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:41.603804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585cc3-7f17-47a6-a14b-80165bd6406d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:41.605260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8585cc3-7f17-47a6-a14b-80165bd6406d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:41.607783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8585cc3-7f17-47a6-a14b-80165bd6406d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:41.632498 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3289/6608] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:06:41 2021] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:06:41.636854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e32fa0-953d-4bfd-81bc-8f4b6bb0e79f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:41.649339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e32fa0-953d-4bfd-81bc-8f4b6bb0e79f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:41.654248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47648a97-7d77-4fee-9446-9b5064111a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:41.654925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47648a97-7d77-4fee-9446-9b5064111a55 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:41.655206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47648a97-7d77-4fee-9446-9b5064111a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:41.655503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47648a97-7d77-4fee-9446-9b5064111a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:41.656238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47648a97-7d77-4fee-9446-9b5064111a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:41.659063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47648a97-7d77-4fee-9446-9b5064111a55 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:41.671366 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3320/6609] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:41 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:06:41.675313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8585cc3-7f17-47a6-a14b-80165bd6406d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:41.686564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8585cc3-7f17-47a6-a14b-80165bd6406d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:41.691501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3ab54-92a3-4194-8ac8-d9bfc43e05c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:41.692238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3ab54-92a3-4194-8ac8-d9bfc43e05c3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:41.692532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3ab54-92a3-4194-8ac8-d9bfc43e05c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:41.693011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3ab54-92a3-4194-8ac8-d9bfc43e05c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:41.693931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3ab54-92a3-4194-8ac8-d9bfc43e05c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:41.695738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3ab54-92a3-4194-8ac8-d9bfc43e05c3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:41.708032 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3290/6610] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:06:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:06:41.712308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47648a97-7d77-4fee-9446-9b5064111a55 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:41.725113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47648a97-7d77-4fee-9446-9b5064111a55 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:41.730053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c438-3944-4036-baec-44bb40751b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:41.730954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c438-3944-4036-baec-44bb40751b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:41.731237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c438-3944-4036-baec-44bb40751b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:41.731673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c438-3944-4036-baec-44bb40751b3e admin admin] PATH_INFO: `/v3/projects/f916d44620e3418a8916382d00618dc9/users/bd92ea56b41244a58e3a959f665431c2/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:41.748587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05c438-3944-4036-baec-44bb40751b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f916d44620e3418a8916382d00618dc9, user_id=bd92ea56b41244a58e3a959f665431c2, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:41.751934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05c438-3944-4036-baec-44bb40751b3e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:41.772347 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3321/6611] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:06:41 2021] PUT /identity/v3/projects/f916d44620e3418a8916382d00618dc9/users/bd92ea56b41244a58e3a959f665431c2/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:06:41.777663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b904f-9043-4f8a-93c6-5083e3b6a356 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:41.777956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b904f-9043-4f8a-93c6-5083e3b6a356 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:41.778262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b904f-9043-4f8a-93c6-5083e3b6a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:41.796441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-595b904f-9043-4f8a-93c6-5083e3b6a356 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:41.797680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-595b904f-9043-4f8a-93c6-5083e3b6a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:41.855975 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3291/6612] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:06:41.865840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c438-3944-4036-baec-44bb40751b3e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:41.867602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ae05c438-3944-4036-baec-44bb40751b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:41.941625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c438-3944-4036-baec-44bb40751b3e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:41.945311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433aa8b-16c7-4d2a-a797-9d9ac3e74cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:41.945960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433aa8b-16c7-4d2a-a797-9d9ac3e74cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:41.946243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433aa8b-16c7-4d2a-a797-9d9ac3e74cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:41.946522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433aa8b-16c7-4d2a-a797-9d9ac3e74cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:41.956197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433aa8b-16c7-4d2a-a797-9d9ac3e74cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:41.957619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433aa8b-16c7-4d2a-a797-9d9ac3e74cd8 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:41.967537 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3322/6613] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:42.681501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36e4cb-a55f-4668-b309-a14b8eea76d6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:42.682044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36e4cb-a55f-4668-b309-a14b8eea76d6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:42.682147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36e4cb-a55f-4668-b309-a14b8eea76d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:42.713886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ae36e4cb-a55f-4668-b309-a14b8eea76d6 None None] MFA Rules not processed for user `bd92ea56b41244a58e3a959f665431c2`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:42.724885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ae36e4cb-a55f-4668-b309-a14b8eea76d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:42.811883 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3292/6614] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:42 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:06:42.823069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433aa8b-16c7-4d2a-a797-9d9ac3e74cd8 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:06:42.825256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9433aa8b-16c7-4d2a-a797-9d9ac3e74cd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:42.902216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433aa8b-16c7-4d2a-a797-9d9ac3e74cd8 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:06:42.906451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb2274-248d-4295-a878-52d0a3a54c96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:06:42.907104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb2274-248d-4295-a878-52d0a3a54c96 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:42.908116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb2274-248d-4295-a878-52d0a3a54c96 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:42.908324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb2274-248d-4295-a878-52d0a3a54c96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:42.918514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb2274-248d-4295-a878-52d0a3a54c96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:06:42.920476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb2274-248d-4295-a878-52d0a3a54c96 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:06:42.930750 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3323/6615] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:06:42 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:06:44.275460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303479b-9af7-42f6-b828-56607bdcfcec None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:06:44.275928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303479b-9af7-42f6-b828-56607bdcfcec None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:06:44.276023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303479b-9af7-42f6-b828-56607bdcfcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:06:44.294059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c303479b-9af7-42f6-b828-56607bdcfcec None None] MFA Rules not processed for user `bd92ea56b41244a58e3a959f665431c2`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:06:44.295297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c303479b-9af7-42f6-b828-56607bdcfcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:06:44.303193 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3293/6616] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:06:44 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:00.375820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac0304-beac-43fa-be89-9181b3950dee None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:00.376792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac0304-beac-43fa-be89-9181b3950dee None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:00.377782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac0304-beac-43fa-be89-9181b3950dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:00.398899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-63ac0304-beac-43fa-be89-9181b3950dee None None] MFA Rules not processed for user `bd92ea56b41244a58e3a959f665431c2`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:00.400383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-63ac0304-beac-43fa-be89-9181b3950dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:00.413800 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3324/6617] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:00 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:07:03.366867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303479b-9af7-42f6-b828-56607bdcfcec None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:03.369117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c303479b-9af7-42f6-b828-56607bdcfcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:03.387554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303479b-9af7-42f6-b828-56607bdcfcec None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:03.397948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:03.399333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:03.400452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:03.400969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] PATH_INFO: `/v3/users/063ba0eab97e42a6ab426bae795ecf9b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:03.403048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=063ba0eab97e42a6ab426bae795ecf9b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:03.406867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:03.508313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063ba0eab97e42a6ab426bae795ecf9b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:03.509199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063ba0eab97e42a6ab426bae795ecf9b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:03.517813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063ba0eab97e42a6ab426bae795ecf9b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:03.518580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063ba0eab97e42a6ab426bae795ecf9b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:03.525819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063ba0eab97e42a6ab426bae795ecf9b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:03.555762 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3294/6618] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:03 2021] DELETE /identity/v3/users/063ba0eab97e42a6ab426bae795ecf9b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:03.560032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2039c57-5617-4384-9735-5fc426ec7d27 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:03.560545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2039c57-5617-4384-9735-5fc426ec7d27 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:03.560643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2039c57-5617-4384-9735-5fc426ec7d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:03.580773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b2039c57-5617-4384-9735-5fc426ec7d27 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:03.582560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b2039c57-5617-4384-9735-5fc426ec7d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:03.652580 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3325/6619] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:03.667004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:03.668455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:03.737154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da701ceb-3800-4b50-9e5d-c4e45b6deeeb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:03.741763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f37e5-ff7d-4b3d-9e95-db8072b3e681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:03.742536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f37e5-ff7d-4b3d-9e95-db8072b3e681 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:03.742898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f37e5-ff7d-4b3d-9e95-db8072b3e681 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:03.743227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f37e5-ff7d-4b3d-9e95-db8072b3e681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:03.754531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f37e5-ff7d-4b3d-9e95-db8072b3e681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:03.756948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f37e5-ff7d-4b3d-9e95-db8072b3e681 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:03.769995 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3295/6620] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:04.447528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2039c57-5617-4384-9735-5fc426ec7d27 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:04.448820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b2039c57-5617-4384-9735-5fc426ec7d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:04.471971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2039c57-5617-4384-9735-5fc426ec7d27 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:04.481085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:04.482021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:04.482195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:04.482472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] PATH_INFO: `/v3/projects/7afbb7ecad0945e481bdcce35173b4a3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:04.488877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7afbb7ecad0945e481bdcce35173b4a3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:04.491457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:04.564987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7afbb7ecad0945e481bdcce35173b4a3', 'request_id': 'req-bb9e442d-4490-4192-a1f3-c376a67e61f3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:04.575245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7afbb7ecad0945e481bdcce35173b4a3', 'request_id': 'req-bb9e442d-4490-4192-a1f3-c376a67e61f3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:04.587341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7afbb7ecad0945e481bdcce35173b4a3', 'request_id': 'req-bb9e442d-4490-4192-a1f3-c376a67e61f3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:04.605506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] The token cache is being invalidate because project 7afbb7ecad0945e481bdcce35173b4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:04.606025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:04.607580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:04.610791 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3326/6621] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:04 2021] DELETE /identity/v3/projects/7afbb7ecad0945e481bdcce35173b4a3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:04.614543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f37e5-ff7d-4b3d-9e95-db8072b3e681 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:04.626971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f37e5-ff7d-4b3d-9e95-db8072b3e681 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:04.688026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5e07b-f5d6-44af-9fcd-b591cf5c35c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:04.689238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5e07b-f5d6-44af-9fcd-b591cf5c35c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:04.689737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5e07b-f5d6-44af-9fcd-b591cf5c35c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:04.690191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5e07b-f5d6-44af-9fcd-b591cf5c35c5 admin admin] PATH_INFO: `/v3/users/ea8b38fe12ad4b0e856774ffec82ce11` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:04.691726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5e07b-f5d6-44af-9fcd-b591cf5c35c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8b38fe12ad4b0e856774ffec82ce11)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:04.694142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5e07b-f5d6-44af-9fcd-b591cf5c35c5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:04.754880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a8c5e07b-f5d6-44af-9fcd-b591cf5c35c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8b38fe12ad4b0e856774ffec82ce11'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:04.755931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a8c5e07b-f5d6-44af-9fcd-b591cf5c35c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8b38fe12ad4b0e856774ffec82ce11'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:04.765672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a8c5e07b-f5d6-44af-9fcd-b591cf5c35c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8b38fe12ad4b0e856774ffec82ce11'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:04.767099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a8c5e07b-f5d6-44af-9fcd-b591cf5c35c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8b38fe12ad4b0e856774ffec82ce11'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:04.776332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a8c5e07b-f5d6-44af-9fcd-b591cf5c35c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8b38fe12ad4b0e856774ffec82ce11'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:04.799906 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3296/6622] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:04 2021] DELETE /identity/v3/users/ea8b38fe12ad4b0e856774ffec82ce11 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:05.489463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:05.491192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:05.509005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e442d-4490-4192-a1f3-c376a67e61f3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:05.585754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:05.586930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:05.587209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:05.587698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] PATH_INFO: `/v3/projects/2d8d9900b5f8499e91ad84b278134d0d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:05.589176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8d9900b5f8499e91ad84b278134d0d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:05.591121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:05.657095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8d9900b5f8499e91ad84b278134d0d', 'request_id': 'req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:05.669699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8d9900b5f8499e91ad84b278134d0d', 'request_id': 'req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:05.677631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8d9900b5f8499e91ad84b278134d0d', 'request_id': 'req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:05.693830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] The token cache is being invalidate because project 2d8d9900b5f8499e91ad84b278134d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:05.694511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:05.696232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-87034ca7-be0a-4d02-bec6-c4bdf09be8cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:05.699048 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3327/6623] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:05 2021] DELETE /identity/v3/projects/2d8d9900b5f8499e91ad84b278134d0d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:05.705006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028178ec-1fce-460e-9662-49c063e7d742 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:05.705561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028178ec-1fce-460e-9662-49c063e7d742 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:05.705784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028178ec-1fce-460e-9662-49c063e7d742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:05.725909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-028178ec-1fce-460e-9662-49c063e7d742 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:05.727890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-028178ec-1fce-460e-9662-49c063e7d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:05.813675 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3297/6624] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:05.822690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8437b06-a1ac-40aa-a8aa-f2a7022b6cf8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:05.822976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8437b06-a1ac-40aa-a8aa-f2a7022b6cf8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:05.823285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8437b06-a1ac-40aa-a8aa-f2a7022b6cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:05.844027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f8437b06-a1ac-40aa-a8aa-f2a7022b6cf8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:05.845894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f8437b06-a1ac-40aa-a8aa-f2a7022b6cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:05.854045 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3328/6625] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:05.858491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028178ec-1fce-460e-9662-49c063e7d742 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:05.870803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028178ec-1fce-460e-9662-49c063e7d742 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:05.880722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0032ac3-3470-4ed3-9b3b-8a74a733ea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:05.881518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0032ac3-3470-4ed3-9b3b-8a74a733ea8a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:05.881872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0032ac3-3470-4ed3-9b3b-8a74a733ea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:05.882311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0032ac3-3470-4ed3-9b3b-8a74a733ea8a admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:05.883147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0032ac3-3470-4ed3-9b3b-8a74a733ea8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:07:05.883604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0032ac3-3470-4ed3-9b3b-8a74a733ea8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:05.885647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0032ac3-3470-4ed3-9b3b-8a74a733ea8a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:05.899093 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3298/6626] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:07:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:07:05.902993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8437b06-a1ac-40aa-a8aa-f2a7022b6cf8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:05.916161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8437b06-a1ac-40aa-a8aa-f2a7022b6cf8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:05.929097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c5a9c-b11a-4109-8291-61990a18edee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:05.929902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c5a9c-b11a-4109-8291-61990a18edee admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:05.930285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c5a9c-b11a-4109-8291-61990a18edee admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:05.930661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c5a9c-b11a-4109-8291-61990a18edee admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:05.931504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c5a9c-b11a-4109-8291-61990a18edee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:05.933709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c5a9c-b11a-4109-8291-61990a18edee admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:05.969474 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3329/6627] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:07:05 2021] POST /identity/v3/projects => generated 357 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:05.973743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0032ac3-3470-4ed3-9b3b-8a74a733ea8a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:05.988661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0032ac3-3470-4ed3-9b3b-8a74a733ea8a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:06.066730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91ca7c-a12a-48f8-931b-dcdc05a97645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:06.069425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91ca7c-a12a-48f8-931b-dcdc05a97645 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:06.069720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91ca7c-a12a-48f8-931b-dcdc05a97645 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:06.070006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91ca7c-a12a-48f8-931b-dcdc05a97645 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:06.071975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91ca7c-a12a-48f8-931b-dcdc05a97645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:06.074583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91ca7c-a12a-48f8-931b-dcdc05a97645 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:06.110479 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3299/6628] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:07:05 2021] POST /identity/v3/users => generated 279 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:06.116239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c5a9c-b11a-4109-8291-61990a18edee admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:06.128881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c5a9c-b11a-4109-8291-61990a18edee admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:06.134430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e01f1-cffe-4b20-aa2f-6a4651450402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:06.136025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e01f1-cffe-4b20-aa2f-6a4651450402 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:06.136477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e01f1-cffe-4b20-aa2f-6a4651450402 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:06.136987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e01f1-cffe-4b20-aa2f-6a4651450402 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:06.137989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e01f1-cffe-4b20-aa2f-6a4651450402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:06.139781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e01f1-cffe-4b20-aa2f-6a4651450402 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:06.158409 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3330/6629] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:06.159369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91ca7c-a12a-48f8-931b-dcdc05a97645 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:06.174486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91ca7c-a12a-48f8-931b-dcdc05a97645 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:06.183414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0322f9-ead7-46d0-9a9a-47a66a387876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:06.184956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0322f9-ead7-46d0-9a9a-47a66a387876 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:06.185484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0322f9-ead7-46d0-9a9a-47a66a387876 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:06.186034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0322f9-ead7-46d0-9a9a-47a66a387876 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:06.187427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0322f9-ead7-46d0-9a9a-47a66a387876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:06.189756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0322f9-ead7-46d0-9a9a-47a66a387876 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:06.206340 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3300/6630] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:07:06.210320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e01f1-cffe-4b20-aa2f-6a4651450402 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:06.225464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e01f1-cffe-4b20-aa2f-6a4651450402 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:06.247752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df9f39-442b-40f0-bbaf-53b152b918b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:06.249110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df9f39-442b-40f0-bbaf-53b152b918b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:06.249581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df9f39-442b-40f0-bbaf-53b152b918b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:06.250739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df9f39-442b-40f0-bbaf-53b152b918b6 admin admin] PATH_INFO: `/v3/projects/01631e590ebe4902a5848693921c36c6/users/b4a0ffea69144229864909cd516d0be8/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:06.286313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df9f39-442b-40f0-bbaf-53b152b918b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01631e590ebe4902a5848693921c36c6, user_id=b4a0ffea69144229864909cd516d0be8, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:06.291425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df9f39-442b-40f0-bbaf-53b152b918b6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:06.319155 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3331/6631] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:06 2021] PUT /identity/v3/projects/01631e590ebe4902a5848693921c36c6/users/b4a0ffea69144229864909cd516d0be8/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:06.332026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90d99e-278a-45c6-9a1b-2d17ff15bd87 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:06.332364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90d99e-278a-45c6-9a1b-2d17ff15bd87 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:06.332597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90d99e-278a-45c6-9a1b-2d17ff15bd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:06.390643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cb90d99e-278a-45c6-9a1b-2d17ff15bd87 None None] MFA Rules not processed for user `b4a0ffea69144229864909cd516d0be8`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:06.391914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cb90d99e-278a-45c6-9a1b-2d17ff15bd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:06.520054 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3301/6632] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:06 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:06.524365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df9f39-442b-40f0-bbaf-53b152b918b6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:06.627579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df9f39-442b-40f0-bbaf-53b152b918b6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:06.633231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d9e9f-2d0c-40bc-a1f8-0215b43dba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:06.633900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d9e9f-2d0c-40bc-a1f8-0215b43dba67 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:06.634184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d9e9f-2d0c-40bc-a1f8-0215b43dba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:06.634665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d9e9f-2d0c-40bc-a1f8-0215b43dba67 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:06.635575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d9e9f-2d0c-40bc-a1f8-0215b43dba67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:06.637928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d9e9f-2d0c-40bc-a1f8-0215b43dba67 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:06.667863 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3332/6633] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:07:06 2021] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:06.671947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90d99e-278a-45c6-9a1b-2d17ff15bd87 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:06.687487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90d99e-278a-45c6-9a1b-2d17ff15bd87 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:06.781418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e65c4-24f4-45dc-83b0-67ea4d8984cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:06.782194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e65c4-24f4-45dc-83b0-67ea4d8984cc admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:06.782509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e65c4-24f4-45dc-83b0-67ea4d8984cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:06.783351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e65c4-24f4-45dc-83b0-67ea4d8984cc admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:06.784063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e65c4-24f4-45dc-83b0-67ea4d8984cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:06.786589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e65c4-24f4-45dc-83b0-67ea4d8984cc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:06.818037 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3302/6634] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:07:06 2021] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:06.821913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d9e9f-2d0c-40bc-a1f8-0215b43dba67 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:06.834266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d9e9f-2d0c-40bc-a1f8-0215b43dba67 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:06.839582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50a136-089c-4602-823a-7fc941573101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:06.840540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a136-089c-4602-823a-7fc941573101 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:06.841021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a136-089c-4602-823a-7fc941573101 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:06.841490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a136-089c-4602-823a-7fc941573101 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:06.842461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50a136-089c-4602-823a-7fc941573101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:06.844228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50a136-089c-4602-823a-7fc941573101 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:06.861717 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3333/6635] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:07:06.865796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e65c4-24f4-45dc-83b0-67ea4d8984cc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:06.876314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e65c4-24f4-45dc-83b0-67ea4d8984cc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:06.882186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a762-fd9e-47c2-abb1-729df3cdc025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:06.883068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a762-fd9e-47c2-abb1-729df3cdc025 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:06.883388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a762-fd9e-47c2-abb1-729df3cdc025 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:06.883666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858a762-fd9e-47c2-abb1-729df3cdc025 admin admin] PATH_INFO: `/v3/projects/db215f31a6a14d658f748276b18125aa/users/bf12085d6b834a8eadc4423fecac4a55/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:06.899526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858a762-fd9e-47c2-abb1-729df3cdc025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db215f31a6a14d658f748276b18125aa, user_id=bf12085d6b834a8eadc4423fecac4a55, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:06.902298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858a762-fd9e-47c2-abb1-729df3cdc025 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:06.917213 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3303/6636] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:06 2021] PUT /identity/v3/projects/db215f31a6a14d658f748276b18125aa/users/bf12085d6b834a8eadc4423fecac4a55/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:06.921699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50a136-089c-4602-823a-7fc941573101 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:06.931406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50a136-089c-4602-823a-7fc941573101 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:06.992020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980de655-02f7-4714-8efd-1fe4f37f6822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:06.993092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980de655-02f7-4714-8efd-1fe4f37f6822 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:06.994291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980de655-02f7-4714-8efd-1fe4f37f6822 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:06.994291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980de655-02f7-4714-8efd-1fe4f37f6822 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:06.994727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980de655-02f7-4714-8efd-1fe4f37f6822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:06.996840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980de655-02f7-4714-8efd-1fe4f37f6822 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:07.009157 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3334/6637] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:07.013397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a762-fd9e-47c2-abb1-729df3cdc025 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:07.024902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858a762-fd9e-47c2-abb1-729df3cdc025 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:07.031079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244388-2799-404e-a3bb-24e1436ef25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:07.032119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244388-2799-404e-a3bb-24e1436ef25c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:07.032401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244388-2799-404e-a3bb-24e1436ef25c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:07.032677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1244388-2799-404e-a3bb-24e1436ef25c admin admin] PATH_INFO: `/v3/projects/db215f31a6a14d658f748276b18125aa/users/bf12085d6b834a8eadc4423fecac4a55/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:07.035388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244388-2799-404e-a3bb-24e1436ef25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db215f31a6a14d658f748276b18125aa, user_id=bf12085d6b834a8eadc4423fecac4a55, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:07.038186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1244388-2799-404e-a3bb-24e1436ef25c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:07.050489 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3304/6638] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:07 2021] PUT /identity/v3/projects/db215f31a6a14d658f748276b18125aa/users/bf12085d6b834a8eadc4423fecac4a55/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:07.060696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b28632-6fc0-45df-8de8-64fbe0d05dd5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:07.060989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b28632-6fc0-45df-8de8-64fbe0d05dd5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:07.061486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b28632-6fc0-45df-8de8-64fbe0d05dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:07.091857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-97b28632-6fc0-45df-8de8-64fbe0d05dd5 None None] MFA Rules not processed for user `bf12085d6b834a8eadc4423fecac4a55`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:07.093425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-97b28632-6fc0-45df-8de8-64fbe0d05dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:07.165941 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3335/6639] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:07 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:07.176420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244388-2799-404e-a3bb-24e1436ef25c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:07.178159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a1244388-2799-404e-a3bb-24e1436ef25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:07.240823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1244388-2799-404e-a3bb-24e1436ef25c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:07.244625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0f74e-aaa5-4443-bbcb-49a3bd2ffcac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:07.245293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0f74e-aaa5-4443-bbcb-49a3bd2ffcac service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:07.245880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0f74e-aaa5-4443-bbcb-49a3bd2ffcac service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:07.246148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0f74e-aaa5-4443-bbcb-49a3bd2ffcac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:07.256047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0f74e-aaa5-4443-bbcb-49a3bd2ffcac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:07.257483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0f74e-aaa5-4443-bbcb-49a3bd2ffcac service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:07.270013 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3305/6640] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:07 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:07.341325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b28632-6fc0-45df-8de8-64fbe0d05dd5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:07.342740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-97b28632-6fc0-45df-8de8-64fbe0d05dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:07.347529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0f74e-aaa5-4443-bbcb-49a3bd2ffcac service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:07.358798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0f74e-aaa5-4443-bbcb-49a3bd2ffcac service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:07.363203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2399236-3590-4772-a9b8-af4b3218c9b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:07.364085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2399236-3590-4772-a9b8-af4b3218c9b3 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:07.364664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2399236-3590-4772-a9b8-af4b3218c9b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:07.365039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2399236-3590-4772-a9b8-af4b3218c9b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:07.415470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b28632-6fc0-45df-8de8-64fbe0d05dd5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:07.420118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:07.420981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:07.421258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:07.421546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] PATH_INFO: `/v3/users/21a4340936c347d3b226f54f99403219` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:07.422766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a4340936c347d3b226f54f99403219)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:07.434808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2399236-3590-4772-a9b8-af4b3218c9b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:07.434952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:07.436269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2399236-3590-4772-a9b8-af4b3218c9b3 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:07.449910 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3306/6641] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:07 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:07.532847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a4340936c347d3b226f54f99403219'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:07.545253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a4340936c347d3b226f54f99403219'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:07.546257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a4340936c347d3b226f54f99403219'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:07.564599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a4340936c347d3b226f54f99403219'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:07.583121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a4340936c347d3b226f54f99403219'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:07.595772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b17d5-c9b4-4a91-8ff9-2c2e4bae557f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:07.596230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b17d5-c9b4-4a91-8ff9-2c2e4bae557f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:07.596615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b17d5-c9b4-4a91-8ff9-2c2e4bae557f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:07.598047 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3336/6642] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:07 2021] DELETE /identity/v3/users/21a4340936c347d3b226f54f99403219 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:07:07.625051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f15b17d5-c9b4-4a91-8ff9-2c2e4bae557f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:07.627197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f15b17d5-c9b4-4a91-8ff9-2c2e4bae557f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:07.709817 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3307/6643] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:07.719816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:07.721324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:07.779067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d61c6-8d2b-4feb-beb7-82ca21fec6b8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:07.782825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35453d19-42cd-4257-bb8b-e38c895cc5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:07.783498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35453d19-42cd-4257-bb8b-e38c895cc5fc service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:07.783782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35453d19-42cd-4257-bb8b-e38c895cc5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:07.784059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35453d19-42cd-4257-bb8b-e38c895cc5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:07.794047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35453d19-42cd-4257-bb8b-e38c895cc5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:07.795643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35453d19-42cd-4257-bb8b-e38c895cc5fc service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:07.806258 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3337/6644] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:08.048054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b17d5-c9b4-4a91-8ff9-2c2e4bae557f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:08.050270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f15b17d5-c9b4-4a91-8ff9-2c2e4bae557f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:08.064089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b17d5-c9b4-4a91-8ff9-2c2e4bae557f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:08.069911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:08.070931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:08.071779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:08.071885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] PATH_INFO: `/v3/projects/8367cf5d4f724cabb1d4ac0a8e7a6b89` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:08.073061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8367cf5d4f724cabb1d4ac0a8e7a6b89)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:08.074973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:08.122440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'request_id': 'req-3520793a-44ad-4e5c-b35c-d0e5b148855c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.128579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'request_id': 'req-3520793a-44ad-4e5c-b35c-d0e5b148855c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.135929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8367cf5d4f724cabb1d4ac0a8e7a6b89', 'request_id': 'req-3520793a-44ad-4e5c-b35c-d0e5b148855c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.146303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] The token cache is being invalidate because project 8367cf5d4f724cabb1d4ac0a8e7a6b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:08.146590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.147239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.148834 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3308/6645] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:08 2021] DELETE /identity/v3/projects/8367cf5d4f724cabb1d4ac0a8e7a6b89 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:08.152855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35453d19-42cd-4257-bb8b-e38c895cc5fc service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:08.163424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35453d19-42cd-4257-bb8b-e38c895cc5fc service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:08.219344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:08.220809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:08.221246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:08.221531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] PATH_INFO: `/v3/users/085dcb6b7b45445e9986dfb3e5a17171` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:08.223383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=085dcb6b7b45445e9986dfb3e5a17171)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:08.225828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:08.271585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085dcb6b7b45445e9986dfb3e5a17171'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.279104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085dcb6b7b45445e9986dfb3e5a17171'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.279798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085dcb6b7b45445e9986dfb3e5a17171'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.287541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085dcb6b7b45445e9986dfb3e5a17171'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.300232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085dcb6b7b45445e9986dfb3e5a17171'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.305983 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3338/6646] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:08 2021] DELETE /identity/v3/users/085dcb6b7b45445e9986dfb3e5a17171 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:07:08.566933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:08.568453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:08.583807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520793a-44ad-4e5c-b35c-d0e5b148855c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:08.641086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:08.641969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:08.642742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:08.643014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] PATH_INFO: `/v3/projects/4fc8f4845a06488eb7542f9a67e999ed` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:08.644248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc8f4845a06488eb7542f9a67e999ed)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:08.646150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:08.700459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc8f4845a06488eb7542f9a67e999ed', 'request_id': 'req-894ca891-9ad1-4687-ab83-0cba85dcf6d0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.709621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc8f4845a06488eb7542f9a67e999ed', 'request_id': 'req-894ca891-9ad1-4687-ab83-0cba85dcf6d0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.721833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc8f4845a06488eb7542f9a67e999ed', 'request_id': 'req-894ca891-9ad1-4687-ab83-0cba85dcf6d0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.739033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] The token cache is being invalidate because project 4fc8f4845a06488eb7542f9a67e999ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:08.739406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.740193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.742277 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3309/6647] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:08 2021] DELETE /identity/v3/projects/4fc8f4845a06488eb7542f9a67e999ed => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:08.746944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:08.748550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:08.764500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cad05d-5205-4de4-bb0b-e19f95dcf876 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:08.865261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:08.866221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:08.866517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:08.866792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] PATH_INFO: `/v3/users/c499043b0de54339b40aaf4db325037d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:08.868317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c499043b0de54339b40aaf4db325037d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:08.870711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:08.923436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c499043b0de54339b40aaf4db325037d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.930883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c499043b0de54339b40aaf4db325037d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.931531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c499043b0de54339b40aaf4db325037d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.938241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c499043b0de54339b40aaf4db325037d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.950122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c499043b0de54339b40aaf4db325037d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:08.956434 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3339/6648] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:08 2021] DELETE /identity/v3/users/c499043b0de54339b40aaf4db325037d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:09.194830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:09.196487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:09.221226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ca891-9ad1-4687-ab83-0cba85dcf6d0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:09.283897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:09.284745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:09.285027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:09.285299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] PATH_INFO: `/v3/projects/ecf574b6fd6542ea99394a276de3ca85` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:09.286484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf574b6fd6542ea99394a276de3ca85)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:09.288430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:09.338021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf574b6fd6542ea99394a276de3ca85', 'request_id': 'req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:09.344022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf574b6fd6542ea99394a276de3ca85', 'request_id': 'req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:09.351951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf574b6fd6542ea99394a276de3ca85', 'request_id': 'req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:09.362444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] The token cache is being invalidate because project ecf574b6fd6542ea99394a276de3ca85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:09.362726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:09.363367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ca10aaa5-14fd-4dd1-a38a-87eea9072af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:09.365071 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3310/6649] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:09 2021] DELETE /identity/v3/projects/ecf574b6fd6542ea99394a276de3ca85 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:16.618747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:16.620656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:16.720530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0a4b-92ee-4719-a140-3be42afb53cc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:16.787122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b49cf-30f5-45b9-afd8-b4a0ae6ada0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:16.787845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b49cf-30f5-45b9-afd8-b4a0ae6ada0c service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:16.788132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b49cf-30f5-45b9-afd8-b4a0ae6ada0c service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:16.788412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b49cf-30f5-45b9-afd8-b4a0ae6ada0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:16.790194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d49b49cf-30f5-45b9-afd8-b4a0ae6ada0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:16.804865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b49cf-30f5-45b9-afd8-b4a0ae6ada0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:16.806442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b49cf-30f5-45b9-afd8-b4a0ae6ada0c service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:16.819916 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3340/6650] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:19.593964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade086c4-89d9-4d4d-b13d-e0143952e582 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:19.593964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade086c4-89d9-4d4d-b13d-e0143952e582 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:19.593964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade086c4-89d9-4d4d-b13d-e0143952e582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:19.617198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ade086c4-89d9-4d4d-b13d-e0143952e582 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:19.619781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ade086c4-89d9-4d4d-b13d-e0143952e582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:19.703554 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3311/6651] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:07:19 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:19.753487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b49cf-30f5-45b9-afd8-b4a0ae6ada0c service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:19.755021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d49b49cf-30f5-45b9-afd8-b4a0ae6ada0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:19.830307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b49cf-30f5-45b9-afd8-b4a0ae6ada0c service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:19.835306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00e91e-8daf-4444-8e9f-36fd067f9967 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:19.835955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00e91e-8daf-4444-8e9f-36fd067f9967 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:19.836239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00e91e-8daf-4444-8e9f-36fd067f9967 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:19.836515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00e91e-8daf-4444-8e9f-36fd067f9967 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:19.844806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00e91e-8daf-4444-8e9f-36fd067f9967 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:19.846407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00e91e-8daf-4444-8e9f-36fd067f9967 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:19.855134 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3341/6652] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:07:19 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:07:22.562223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade086c4-89d9-4d4d-b13d-e0143952e582 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:22.564899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ade086c4-89d9-4d4d-b13d-e0143952e582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:22.657041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade086c4-89d9-4d4d-b13d-e0143952e582 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:22.664129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:22.665426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:22.665912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:22.666543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] PATH_INFO: `/v3/users/b4a0ffea69144229864909cd516d0be8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:22.668935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a0ffea69144229864909cd516d0be8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:22.671843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:22.759513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a0ffea69144229864909cd516d0be8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:22.760473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a0ffea69144229864909cd516d0be8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:22.779720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a0ffea69144229864909cd516d0be8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:22.784082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a0ffea69144229864909cd516d0be8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:22.795019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a0ffea69144229864909cd516d0be8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:22.850552 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3312/6653] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:22 2021] DELETE /identity/v3/users/b4a0ffea69144229864909cd516d0be8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:22.855848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f329a-a7b2-4b08-a5cc-428ccce6346e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:22.856366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f329a-a7b2-4b08-a5cc-428ccce6346e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:22.856540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f329a-a7b2-4b08-a5cc-428ccce6346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:22.912723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-179f329a-a7b2-4b08-a5cc-428ccce6346e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:22.916001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-179f329a-a7b2-4b08-a5cc-428ccce6346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:23.049276 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3342/6654] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:07:23.059845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:23.062935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:23.249989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197343c-f786-41b2-8427-836f731a99de admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:23.257550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54701d-4703-4141-be30-195812f1a567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:23.258212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54701d-4703-4141-be30-195812f1a567 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:23.258493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54701d-4703-4141-be30-195812f1a567 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:23.258768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54701d-4703-4141-be30-195812f1a567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:23.271215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54701d-4703-4141-be30-195812f1a567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:23.274327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54701d-4703-4141-be30-195812f1a567 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:23.296561 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3313/6655] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:23.781656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f329a-a7b2-4b08-a5cc-428ccce6346e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:23.783640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-179f329a-a7b2-4b08-a5cc-428ccce6346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:23.824350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f329a-a7b2-4b08-a5cc-428ccce6346e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:23.838675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:23.839617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:23.840304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:23.840304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] PATH_INFO: `/v3/projects/01631e590ebe4902a5848693921c36c6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:23.841455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] RBAC: Authorizing `identity:delete_project(project_id=01631e590ebe4902a5848693921c36c6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:23.843459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:23.933303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01631e590ebe4902a5848693921c36c6', 'request_id': 'req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:23.950145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01631e590ebe4902a5848693921c36c6', 'request_id': 'req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:23.959958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01631e590ebe4902a5848693921c36c6', 'request_id': 'req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:23.976106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] The token cache is being invalidate because project 01631e590ebe4902a5848693921c36c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:23.976751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:23.977683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:23.979614 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3343/6656] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:23 2021] DELETE /identity/v3/projects/01631e590ebe4902a5848693921c36c6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:23.983441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54701d-4703-4141-be30-195812f1a567 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:23.994151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54701d-4703-4141-be30-195812f1a567 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:24.070547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05047b-4d47-4a52-95cc-f862a08a18af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:24.071473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05047b-4d47-4a52-95cc-f862a08a18af admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:24.071764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05047b-4d47-4a52-95cc-f862a08a18af admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:24.072129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05047b-4d47-4a52-95cc-f862a08a18af admin admin] PATH_INFO: `/v3/users/bf12085d6b834a8eadc4423fecac4a55` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:24.075899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05047b-4d47-4a52-95cc-f862a08a18af admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf12085d6b834a8eadc4423fecac4a55)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:24.078339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05047b-4d47-4a52-95cc-f862a08a18af admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:24.151555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c05047b-4d47-4a52-95cc-f862a08a18af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf12085d6b834a8eadc4423fecac4a55'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:24.152319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c05047b-4d47-4a52-95cc-f862a08a18af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf12085d6b834a8eadc4423fecac4a55'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:24.161319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c05047b-4d47-4a52-95cc-f862a08a18af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf12085d6b834a8eadc4423fecac4a55'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:24.162291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c05047b-4d47-4a52-95cc-f862a08a18af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf12085d6b834a8eadc4423fecac4a55'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:24.173912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c05047b-4d47-4a52-95cc-f862a08a18af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf12085d6b834a8eadc4423fecac4a55'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:24.196537 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3314/6657] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:23 2021] DELETE /identity/v3/users/bf12085d6b834a8eadc4423fecac4a55 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:07:24.581856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:24.583673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:24.599169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93bf70-45cc-4a80-87f8-2ab0bee7e61e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:24.684077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:24.685217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:24.685801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:24.686229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] PATH_INFO: `/v3/projects/db215f31a6a14d658f748276b18125aa` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:24.687694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=db215f31a6a14d658f748276b18125aa)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:24.690523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:24.754662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db215f31a6a14d658f748276b18125aa', 'request_id': 'req-ccdefae1-288b-4469-8ecb-cc08447d5aea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:24.765782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db215f31a6a14d658f748276b18125aa', 'request_id': 'req-ccdefae1-288b-4469-8ecb-cc08447d5aea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:24.774754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db215f31a6a14d658f748276b18125aa', 'request_id': 'req-ccdefae1-288b-4469-8ecb-cc08447d5aea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:24.787436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] The token cache is being invalidate because project db215f31a6a14d658f748276b18125aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:24.787958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:24.788824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ccdefae1-288b-4469-8ecb-cc08447d5aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:24.790814 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3344/6658] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:24 2021] DELETE /identity/v3/projects/db215f31a6a14d658f748276b18125aa => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:24.796321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391953-78e0-40eb-b646-a59f040a5c07 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:24.796608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391953-78e0-40eb-b646-a59f040a5c07 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:24.796886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391953-78e0-40eb-b646-a59f040a5c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:24.822367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-23391953-78e0-40eb-b646-a59f040a5c07 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:24.822920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-23391953-78e0-40eb-b646-a59f040a5c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:24.891011 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3315/6659] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:07:24.900851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd457f5-8d1d-4cdc-b77b-ade24efa94e3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:24.901472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd457f5-8d1d-4cdc-b77b-ade24efa94e3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:24.901963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd457f5-8d1d-4cdc-b77b-ade24efa94e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:24.929513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2dd457f5-8d1d-4cdc-b77b-ade24efa94e3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:24.930785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2dd457f5-8d1d-4cdc-b77b-ade24efa94e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:24.939132 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3345/6660] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:24.943622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23391953-78e0-40eb-b646-a59f040a5c07 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:24.963083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23391953-78e0-40eb-b646-a59f040a5c07 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:24.977846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcfe8b-a966-4993-be66-8621c18138ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:24.979203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcfe8b-a966-4993-be66-8621c18138ba admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:24.979935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcfe8b-a966-4993-be66-8621c18138ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:24.980620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcfe8b-a966-4993-be66-8621c18138ba admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:24.981925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcfe8b-a966-4993-be66-8621c18138ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:07:24.982413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcfe8b-a966-4993-be66-8621c18138ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:24.984867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcfe8b-a966-4993-be66-8621c18138ba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:25.005662 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3316/6661] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:07:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:07:25.009312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd457f5-8d1d-4cdc-b77b-ade24efa94e3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:25.020256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd457f5-8d1d-4cdc-b77b-ade24efa94e3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:25.025662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1d2a5-3aea-4874-b9f7-540951f5be51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:25.026580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1d2a5-3aea-4874-b9f7-540951f5be51 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:25.027557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1d2a5-3aea-4874-b9f7-540951f5be51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:25.027905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1d2a5-3aea-4874-b9f7-540951f5be51 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:25.028679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1d2a5-3aea-4874-b9f7-540951f5be51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:25.030699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1d2a5-3aea-4874-b9f7-540951f5be51 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:25.070110 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3346/6662] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:07:25 2021] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:25.074232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcfe8b-a966-4993-be66-8621c18138ba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:25.088172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcfe8b-a966-4993-be66-8621c18138ba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:25.160261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325f212-9010-4be7-9bda-84b2e7cc60cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:25.160947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325f212-9010-4be7-9bda-84b2e7cc60cc admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:25.161374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325f212-9010-4be7-9bda-84b2e7cc60cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:25.161661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325f212-9010-4be7-9bda-84b2e7cc60cc admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:25.162381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325f212-9010-4be7-9bda-84b2e7cc60cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:25.164357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325f212-9010-4be7-9bda-84b2e7cc60cc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:25.190869 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3317/6663] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:07:25 2021] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:25.194760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1d2a5-3aea-4874-b9f7-540951f5be51 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:25.206983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1d2a5-3aea-4874-b9f7-540951f5be51 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:25.213121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682f727-2164-4f5c-ac5d-077ef18aea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:25.213796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682f727-2164-4f5c-ac5d-077ef18aea3d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:25.214086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682f727-2164-4f5c-ac5d-077ef18aea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:25.214364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682f727-2164-4f5c-ac5d-077ef18aea3d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:25.215106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682f727-2164-4f5c-ac5d-077ef18aea3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:25.216738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682f727-2164-4f5c-ac5d-077ef18aea3d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:25.230781 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3347/6664] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:25 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:25.234827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325f212-9010-4be7-9bda-84b2e7cc60cc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:25.246676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325f212-9010-4be7-9bda-84b2e7cc60cc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:25.252243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a5a9e-2b44-42d3-8b74-c4a1b316a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:25.252923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a5a9e-2b44-42d3-8b74-c4a1b316a013 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:25.253212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a5a9e-2b44-42d3-8b74-c4a1b316a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:25.253582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a5a9e-2b44-42d3-8b74-c4a1b316a013 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:25.254321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a5a9e-2b44-42d3-8b74-c4a1b316a013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:25.256039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a5a9e-2b44-42d3-8b74-c4a1b316a013 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:25.269131 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3318/6665] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:25 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:25.272678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682f727-2164-4f5c-ac5d-077ef18aea3d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:25.283150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682f727-2164-4f5c-ac5d-077ef18aea3d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:25.291447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad8f9-b711-4324-8125-bad0c5f70dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:25.292775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad8f9-b711-4324-8125-bad0c5f70dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:25.293217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad8f9-b711-4324-8125-bad0c5f70dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:25.293488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad8f9-b711-4324-8125-bad0c5f70dd9 admin admin] PATH_INFO: `/v3/projects/be7dd4c26d8244d9882a1e97162c411f/users/cbe6330b159e4829a35f1c20f8a64eba/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:25.316509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ad8f9-b711-4324-8125-bad0c5f70dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7dd4c26d8244d9882a1e97162c411f, user_id=cbe6330b159e4829a35f1c20f8a64eba, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:25.321163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ad8f9-b711-4324-8125-bad0c5f70dd9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:25.341505 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3348/6666] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:25 2021] PUT /identity/v3/projects/be7dd4c26d8244d9882a1e97162c411f/users/cbe6330b159e4829a35f1c20f8a64eba/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:07:25.351742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edf632-baab-441d-bfab-c62100e8d3c5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:25.352318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edf632-baab-441d-bfab-c62100e8d3c5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:25.352707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edf632-baab-441d-bfab-c62100e8d3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:25.385604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a8edf632-baab-441d-bfab-c62100e8d3c5 None None] MFA Rules not processed for user `cbe6330b159e4829a35f1c20f8a64eba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:25.387339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a8edf632-baab-441d-bfab-c62100e8d3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:25.493497 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3319/6667] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:25 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:25.496381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad8f9-b711-4324-8125-bad0c5f70dd9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:25.578928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad8f9-b711-4324-8125-bad0c5f70dd9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:25.584389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d153d-b1e1-4fa7-b188-2a3771c1a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:25.585052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d153d-b1e1-4fa7-b188-2a3771c1a710 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:25.585336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d153d-b1e1-4fa7-b188-2a3771c1a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:25.585608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d153d-b1e1-4fa7-b188-2a3771c1a710 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:25.586312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d153d-b1e1-4fa7-b188-2a3771c1a710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:25.590595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d153d-b1e1-4fa7-b188-2a3771c1a710 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:25.624671 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3349/6668] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:07:25 2021] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:25.625785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edf632-baab-441d-bfab-c62100e8d3c5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:25.645968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edf632-baab-441d-bfab-c62100e8d3c5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:25.731966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed045a51-26f2-42ce-a2a7-d2bcffd23d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:25.733255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045a51-26f2-42ce-a2a7-d2bcffd23d4d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:25.733752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045a51-26f2-42ce-a2a7-d2bcffd23d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:25.734421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045a51-26f2-42ce-a2a7-d2bcffd23d4d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:25.735551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed045a51-26f2-42ce-a2a7-d2bcffd23d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:25.738253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed045a51-26f2-42ce-a2a7-d2bcffd23d4d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:25.770439 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3320/6669] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:07:25 2021] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:25.774269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d153d-b1e1-4fa7-b188-2a3771c1a710 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:25.793636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d153d-b1e1-4fa7-b188-2a3771c1a710 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:25.801914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f0b01-12a8-4d33-8d41-d8ce2f1a9f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:25.802585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f0b01-12a8-4d33-8d41-d8ce2f1a9f93 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:25.802865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f0b01-12a8-4d33-8d41-d8ce2f1a9f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:25.803138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f0b01-12a8-4d33-8d41-d8ce2f1a9f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:25.804144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f0b01-12a8-4d33-8d41-d8ce2f1a9f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:25.808532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f0b01-12a8-4d33-8d41-d8ce2f1a9f93 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:25.826162 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3350/6670] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:25 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:25.827682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed045a51-26f2-42ce-a2a7-d2bcffd23d4d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:25.840232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed045a51-26f2-42ce-a2a7-d2bcffd23d4d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:25.852303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd567d9-ee72-49f4-8886-a569259fa4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:25.854591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd567d9-ee72-49f4-8886-a569259fa4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:25.854791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd567d9-ee72-49f4-8886-a569259fa4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:25.855497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd567d9-ee72-49f4-8886-a569259fa4d9 admin admin] PATH_INFO: `/v3/projects/9426be9f70f4498cb413acffebd1aa03/users/fd3b9e37fa7244f5be38336c1971f6b9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:25.889207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd567d9-ee72-49f4-8886-a569259fa4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9426be9f70f4498cb413acffebd1aa03, user_id=fd3b9e37fa7244f5be38336c1971f6b9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:25.892827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd567d9-ee72-49f4-8886-a569259fa4d9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:25.916637 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3321/6671] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:25 2021] PUT /identity/v3/projects/9426be9f70f4498cb413acffebd1aa03/users/fd3b9e37fa7244f5be38336c1971f6b9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:25.918283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f0b01-12a8-4d33-8d41-d8ce2f1a9f93 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:25.931010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f0b01-12a8-4d33-8d41-d8ce2f1a9f93 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:26.062740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3296e45-669e-47bf-86af-7c5842cd1aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:26.064650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3296e45-669e-47bf-86af-7c5842cd1aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:26.065503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3296e45-669e-47bf-86af-7c5842cd1aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:26.066776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3296e45-669e-47bf-86af-7c5842cd1aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:26.070271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3296e45-669e-47bf-86af-7c5842cd1aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:26.073307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3296e45-669e-47bf-86af-7c5842cd1aa9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:26.112277 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3351/6672] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:25 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:07:26.113270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd567d9-ee72-49f4-8886-a569259fa4d9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:26.128438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd567d9-ee72-49f4-8886-a569259fa4d9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:26.135298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515170b-1b30-48cc-b766-c44ac11a2e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:26.136237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515170b-1b30-48cc-b766-c44ac11a2e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:26.136528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515170b-1b30-48cc-b766-c44ac11a2e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:26.136802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515170b-1b30-48cc-b766-c44ac11a2e27 admin admin] PATH_INFO: `/v3/projects/9426be9f70f4498cb413acffebd1aa03/users/fd3b9e37fa7244f5be38336c1971f6b9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:26.139179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515170b-1b30-48cc-b766-c44ac11a2e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9426be9f70f4498cb413acffebd1aa03, user_id=fd3b9e37fa7244f5be38336c1971f6b9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:26.142722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515170b-1b30-48cc-b766-c44ac11a2e27 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:26.158321 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3322/6673] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:26 2021] PUT /identity/v3/projects/9426be9f70f4498cb413acffebd1aa03/users/fd3b9e37fa7244f5be38336c1971f6b9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:26.168663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569098b3-c499-4412-abb6-b86dcb4698ff None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:26.168944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569098b3-c499-4412-abb6-b86dcb4698ff None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:26.169224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569098b3-c499-4412-abb6-b86dcb4698ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:26.204960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-569098b3-c499-4412-abb6-b86dcb4698ff None None] MFA Rules not processed for user `fd3b9e37fa7244f5be38336c1971f6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:26.206191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-569098b3-c499-4412-abb6-b86dcb4698ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:26.286828 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3352/6674] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:26 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:26.296745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515170b-1b30-48cc-b766-c44ac11a2e27 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:26.300380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0515170b-1b30-48cc-b766-c44ac11a2e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:26.377278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515170b-1b30-48cc-b766-c44ac11a2e27 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:26.382089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80014f8c-7605-4ed5-8eb0-9f60c3a4d24b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:26.382734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80014f8c-7605-4ed5-8eb0-9f60c3a4d24b service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:26.383013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80014f8c-7605-4ed5-8eb0-9f60c3a4d24b service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:26.383311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80014f8c-7605-4ed5-8eb0-9f60c3a4d24b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:26.397371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80014f8c-7605-4ed5-8eb0-9f60c3a4d24b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:26.398821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80014f8c-7605-4ed5-8eb0-9f60c3a4d24b service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:26.413932 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3323/6675] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:26 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:28.069980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569098b3-c499-4412-abb6-b86dcb4698ff None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:28.154665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569098b3-c499-4412-abb6-b86dcb4698ff None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:28.164869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:28.165681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:28.165964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:28.166236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] PATH_INFO: `/v3/users/cbe6330b159e4829a35f1c20f8a64eba` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:28.167557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe6330b159e4829a35f1c20f8a64eba)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:28.169723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:28.253893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe6330b159e4829a35f1c20f8a64eba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:28.271305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe6330b159e4829a35f1c20f8a64eba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:28.272260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe6330b159e4829a35f1c20f8a64eba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:28.284463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe6330b159e4829a35f1c20f8a64eba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:28.300198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe6330b159e4829a35f1c20f8a64eba'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:28.308154 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3353/6676] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:28 2021] DELETE /identity/v3/users/cbe6330b159e4829a35f1c20f8a64eba => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:28.314874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27954627-a7c7-429b-8290-03899ae9a483 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:28.315468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27954627-a7c7-429b-8290-03899ae9a483 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:28.315641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27954627-a7c7-429b-8290-03899ae9a483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:28.352654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-27954627-a7c7-429b-8290-03899ae9a483 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:28.354096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-27954627-a7c7-429b-8290-03899ae9a483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:28.464268 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3324/6677] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:07:28.474506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:28.476786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:28.555149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35373063-7a85-4e3f-a32a-2402d6f4496c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:28.559805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c9d82-0739-4627-8655-3ddace98b080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:28.560875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9d82-0739-4627-8655-3ddace98b080 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:28.561337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9d82-0739-4627-8655-3ddace98b080 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:28.561611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9d82-0739-4627-8655-3ddace98b080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:28.572059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c9d82-0739-4627-8655-3ddace98b080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:28.573644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c9d82-0739-4627-8655-3ddace98b080 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:28.593959 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3354/6678] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:28.928024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27954627-a7c7-429b-8290-03899ae9a483 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:28.929887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-27954627-a7c7-429b-8290-03899ae9a483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:28.955919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27954627-a7c7-429b-8290-03899ae9a483 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:28.965567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:28.966665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:28.967134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:28.967679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] PATH_INFO: `/v3/projects/be7dd4c26d8244d9882a1e97162c411f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:28.969213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7dd4c26d8244d9882a1e97162c411f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:28.972003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:29.042592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7dd4c26d8244d9882a1e97162c411f', 'request_id': 'req-f175596b-7cd1-441f-8f32-f272183c4f64'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:29.053003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7dd4c26d8244d9882a1e97162c411f', 'request_id': 'req-f175596b-7cd1-441f-8f32-f272183c4f64'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:29.061754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7dd4c26d8244d9882a1e97162c411f', 'request_id': 'req-f175596b-7cd1-441f-8f32-f272183c4f64'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:29.072949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] The token cache is being invalidate because project be7dd4c26d8244d9882a1e97162c411f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:29.073238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:29.073885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:29.079628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c9d82-0739-4627-8655-3ddace98b080 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:29.080203 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3325/6679] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:28 2021] DELETE /identity/v3/projects/be7dd4c26d8244d9882a1e97162c411f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:29.089597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c9d82-0739-4627-8655-3ddace98b080 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:29.159957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a46cf-0702-4852-b5e5-4860492ab8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:29.161161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a46cf-0702-4852-b5e5-4860492ab8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:29.161472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a46cf-0702-4852-b5e5-4860492ab8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:29.161772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a46cf-0702-4852-b5e5-4860492ab8f0 admin admin] PATH_INFO: `/v3/users/fd3b9e37fa7244f5be38336c1971f6b9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:29.163272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a46cf-0702-4852-b5e5-4860492ab8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3b9e37fa7244f5be38336c1971f6b9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:29.165236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a46cf-0702-4852-b5e5-4860492ab8f0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:29.225637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-605a46cf-0702-4852-b5e5-4860492ab8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3b9e37fa7244f5be38336c1971f6b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:29.239781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-605a46cf-0702-4852-b5e5-4860492ab8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3b9e37fa7244f5be38336c1971f6b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:29.239781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-605a46cf-0702-4852-b5e5-4860492ab8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3b9e37fa7244f5be38336c1971f6b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:29.248838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-605a46cf-0702-4852-b5e5-4860492ab8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3b9e37fa7244f5be38336c1971f6b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:29.261775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-605a46cf-0702-4852-b5e5-4860492ab8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3b9e37fa7244f5be38336c1971f6b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:29.268425 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3355/6680] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:29 2021] DELETE /identity/v3/users/fd3b9e37fa7244f5be38336c1971f6b9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:29.784701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:29.786533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:29.805772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175596b-7cd1-441f-8f32-f272183c4f64 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:29.936469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:29.939788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:29.941099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:29.941414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] PATH_INFO: `/v3/projects/9426be9f70f4498cb413acffebd1aa03` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:29.945860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9426be9f70f4498cb413acffebd1aa03)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:29.950010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:30.041336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9426be9f70f4498cb413acffebd1aa03', 'request_id': 'req-f43ccec0-1f0a-4160-82c4-8ec439487b47'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:30.060475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9426be9f70f4498cb413acffebd1aa03', 'request_id': 'req-f43ccec0-1f0a-4160-82c4-8ec439487b47'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:30.079858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9426be9f70f4498cb413acffebd1aa03', 'request_id': 'req-f43ccec0-1f0a-4160-82c4-8ec439487b47'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:30.104181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] The token cache is being invalidate because project 9426be9f70f4498cb413acffebd1aa03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:30.104515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:30.105445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f43ccec0-1f0a-4160-82c4-8ec439487b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:30.107071 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3326/6681] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:29 2021] DELETE /identity/v3/projects/9426be9f70f4498cb413acffebd1aa03 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:30.117416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760871e-06b6-4fee-8af8-38224c4fd1ac None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:30.117956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760871e-06b6-4fee-8af8-38224c4fd1ac None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:30.118383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760871e-06b6-4fee-8af8-38224c4fd1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:30.159069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e760871e-06b6-4fee-8af8-38224c4fd1ac None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:30.161832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e760871e-06b6-4fee-8af8-38224c4fd1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:30.243826 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3356/6682] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:30.252506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04ffaa-ff87-4447-984b-7de88e0a429e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:30.252794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04ffaa-ff87-4447-984b-7de88e0a429e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:30.253062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04ffaa-ff87-4447-984b-7de88e0a429e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:30.279476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fd04ffaa-ff87-4447-984b-7de88e0a429e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:30.281323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fd04ffaa-ff87-4447-984b-7de88e0a429e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:30.290731 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3327/6683] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:30.295165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760871e-06b6-4fee-8af8-38224c4fd1ac None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:30.308181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760871e-06b6-4fee-8af8-38224c4fd1ac None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:30.317051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca930c9-9c8a-4e8d-8254-453676915d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:30.317748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca930c9-9c8a-4e8d-8254-453676915d70 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:30.318031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca930c9-9c8a-4e8d-8254-453676915d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:30.318508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca930c9-9c8a-4e8d-8254-453676915d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:30.319308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca930c9-9c8a-4e8d-8254-453676915d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:07:30.319625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca930c9-9c8a-4e8d-8254-453676915d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:30.321329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca930c9-9c8a-4e8d-8254-453676915d70 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:30.342198 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3357/6684] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:07:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:07:30.347751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04ffaa-ff87-4447-984b-7de88e0a429e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:30.359932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04ffaa-ff87-4447-984b-7de88e0a429e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:30.379327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4ec19-387c-43d4-8387-11557fd6b947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:30.379327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4ec19-387c-43d4-8387-11557fd6b947 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:30.379327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4ec19-387c-43d4-8387-11557fd6b947 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:30.379327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4ec19-387c-43d4-8387-11557fd6b947 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:30.379861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4ec19-387c-43d4-8387-11557fd6b947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:30.379861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4ec19-387c-43d4-8387-11557fd6b947 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:30.432098 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3328/6685] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:07:30 2021] POST /identity/v3/projects => generated 389 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:30.433712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca930c9-9c8a-4e8d-8254-453676915d70 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:30.444253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca930c9-9c8a-4e8d-8254-453676915d70 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:30.505252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8514d-fa7f-4890-8663-7a9022ab1749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:30.505918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8514d-fa7f-4890-8663-7a9022ab1749 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:30.506198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8514d-fa7f-4890-8663-7a9022ab1749 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:30.506471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8514d-fa7f-4890-8663-7a9022ab1749 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:30.507172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8514d-fa7f-4890-8663-7a9022ab1749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:30.509129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8514d-fa7f-4890-8663-7a9022ab1749 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:30.541153 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3358/6686] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:07:30 2021] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:30.545200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4ec19-387c-43d4-8387-11557fd6b947 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:30.559180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4ec19-387c-43d4-8387-11557fd6b947 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:30.564849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebec39-4db7-4651-93ab-f4f5ba6da62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:30.565592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebec39-4db7-4651-93ab-f4f5ba6da62a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:30.565946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebec39-4db7-4651-93ab-f4f5ba6da62a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:30.566290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebec39-4db7-4651-93ab-f4f5ba6da62a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:30.567223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebec39-4db7-4651-93ab-f4f5ba6da62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:30.568982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baebec39-4db7-4651-93ab-f4f5ba6da62a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:30.583548 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3329/6687] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:30 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:30.587556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8514d-fa7f-4890-8663-7a9022ab1749 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:30.599114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8514d-fa7f-4890-8663-7a9022ab1749 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:30.606247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7caab-025a-4289-a11f-04b18ec84796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:30.606922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7caab-025a-4289-a11f-04b18ec84796 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:30.607210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7caab-025a-4289-a11f-04b18ec84796 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:30.607523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7caab-025a-4289-a11f-04b18ec84796 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:30.608260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7caab-025a-4289-a11f-04b18ec84796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:30.609922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7caab-025a-4289-a11f-04b18ec84796 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:30.624152 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3359/6688] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:30 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:07:30.628808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebec39-4db7-4651-93ab-f4f5ba6da62a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:30.642579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebec39-4db7-4651-93ab-f4f5ba6da62a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:30.647747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225bd3d-2652-4c39-8e47-7b507d12c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:30.649105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225bd3d-2652-4c39-8e47-7b507d12c291 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:30.649403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225bd3d-2652-4c39-8e47-7b507d12c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:30.649742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225bd3d-2652-4c39-8e47-7b507d12c291 admin admin] PATH_INFO: `/v3/projects/fb6a3ca6f66d4f898a2edd7ba3116cca/users/ebf7a731ca05402e9af975dd8a495ae2/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:30.665963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225bd3d-2652-4c39-8e47-7b507d12c291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6a3ca6f66d4f898a2edd7ba3116cca, user_id=ebf7a731ca05402e9af975dd8a495ae2, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:30.668868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225bd3d-2652-4c39-8e47-7b507d12c291 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:30.684258 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3330/6689] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:30 2021] PUT /identity/v3/projects/fb6a3ca6f66d4f898a2edd7ba3116cca/users/ebf7a731ca05402e9af975dd8a495ae2/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:07:30.694967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06f7a3-1141-4f46-bf23-e09a04544aa8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:30.695286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06f7a3-1141-4f46-bf23-e09a04544aa8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:30.695568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06f7a3-1141-4f46-bf23-e09a04544aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:30.732109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1a06f7a3-1141-4f46-bf23-e09a04544aa8 None None] MFA Rules not processed for user `ebf7a731ca05402e9af975dd8a495ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:30.733410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1a06f7a3-1141-4f46-bf23-e09a04544aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:30.842250 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3360/6690] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:30 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:30.846979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225bd3d-2652-4c39-8e47-7b507d12c291 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:30.954291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225bd3d-2652-4c39-8e47-7b507d12c291 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:30.967297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0524c-7e14-4634-940c-f4a9b1208c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:30.967913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0524c-7e14-4634-940c-f4a9b1208c89 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:30.968202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0524c-7e14-4634-940c-f4a9b1208c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:30.968478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0524c-7e14-4634-940c-f4a9b1208c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:30.969190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0524c-7e14-4634-940c-f4a9b1208c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:30.971475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0524c-7e14-4634-940c-f4a9b1208c89 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:31.020504 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3331/6691] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:07:30 2021] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:31.025400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06f7a3-1141-4f46-bf23-e09a04544aa8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:31.037759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06f7a3-1141-4f46-bf23-e09a04544aa8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:31.145978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a544b-58f6-4821-b179-18bb5ca5ce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:31.146595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a544b-58f6-4821-b179-18bb5ca5ce30 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:31.146878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a544b-58f6-4821-b179-18bb5ca5ce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:31.146989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a544b-58f6-4821-b179-18bb5ca5ce30 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:31.147748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a544b-58f6-4821-b179-18bb5ca5ce30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:31.149763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a544b-58f6-4821-b179-18bb5ca5ce30 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:31.207380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0524c-7e14-4634-940c-f4a9b1208c89 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:31.219316 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3361/6692] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:07:31 2021] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:31.220960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0524c-7e14-4634-940c-f4a9b1208c89 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:31.229386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb767db2-809f-4af8-a31e-27461486e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:31.230067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb767db2-809f-4af8-a31e-27461486e3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:31.230349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb767db2-809f-4af8-a31e-27461486e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:31.230628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb767db2-809f-4af8-a31e-27461486e3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:31.231481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb767db2-809f-4af8-a31e-27461486e3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:31.233084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb767db2-809f-4af8-a31e-27461486e3f7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:31.244844 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3332/6693] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:31 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:31.249703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a544b-58f6-4821-b179-18bb5ca5ce30 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:31.262415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a544b-58f6-4821-b179-18bb5ca5ce30 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:31.272080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519c44c-07cd-4684-adba-fd05c8fbeb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:31.273102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c44c-07cd-4684-adba-fd05c8fbeb0c admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:31.273524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c44c-07cd-4684-adba-fd05c8fbeb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:31.273876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519c44c-07cd-4684-adba-fd05c8fbeb0c admin admin] PATH_INFO: `/v3/projects/39dae204cc28443ab86176db95b44c16/users/0dc8cc3c6fcf4541b95dfaa3c86f8aa9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:31.293327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519c44c-07cd-4684-adba-fd05c8fbeb0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=39dae204cc28443ab86176db95b44c16, user_id=0dc8cc3c6fcf4541b95dfaa3c86f8aa9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:31.296190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519c44c-07cd-4684-adba-fd05c8fbeb0c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:31.321596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb767db2-809f-4af8-a31e-27461486e3f7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:31.322476 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3362/6694] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:31 2021] PUT /identity/v3/projects/39dae204cc28443ab86176db95b44c16/users/0dc8cc3c6fcf4541b95dfaa3c86f8aa9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:31.334123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb767db2-809f-4af8-a31e-27461486e3f7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:31.379611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717acc78-f88c-4d4d-b278-c44a6475c532 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:31.379975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717acc78-f88c-4d4d-b278-c44a6475c532 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:31.380324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717acc78-f88c-4d4d-b278-c44a6475c532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:31.399553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-717acc78-f88c-4d4d-b278-c44a6475c532 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:31.400989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-717acc78-f88c-4d4d-b278-c44a6475c532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:31.424063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f429d-2f7a-4a95-b076-f7fcb7f97368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:31.424941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f429d-2f7a-4a95-b076-f7fcb7f97368 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:31.425374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f429d-2f7a-4a95-b076-f7fcb7f97368 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:31.425912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f429d-2f7a-4a95-b076-f7fcb7f97368 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:31.426766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f429d-2f7a-4a95-b076-f7fcb7f97368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:31.428686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f429d-2f7a-4a95-b076-f7fcb7f97368 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:31.444727 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3333/6695] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:31 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:31.445732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f429d-2f7a-4a95-b076-f7fcb7f97368 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:31.456897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f429d-2f7a-4a95-b076-f7fcb7f97368 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:31.461933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec54f4-b4c2-435d-be15-34908f9cb353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:31.464957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec54f4-b4c2-435d-be15-34908f9cb353 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:31.464957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec54f4-b4c2-435d-be15-34908f9cb353 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:31.464957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec54f4-b4c2-435d-be15-34908f9cb353 admin admin] PATH_INFO: `/v3/projects/39dae204cc28443ab86176db95b44c16/users/0dc8cc3c6fcf4541b95dfaa3c86f8aa9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:31.466021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec54f4-b4c2-435d-be15-34908f9cb353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39dae204cc28443ab86176db95b44c16, user_id=0dc8cc3c6fcf4541b95dfaa3c86f8aa9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:31.469259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec54f4-b4c2-435d-be15-34908f9cb353 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:31.483186 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3334/6696] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:31 2021] PUT /identity/v3/projects/39dae204cc28443ab86176db95b44c16/users/0dc8cc3c6fcf4541b95dfaa3c86f8aa9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:31.494165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f365-77e3-4013-be6d-8fe9a5d5bf04 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:31.494520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f365-77e3-4013-be6d-8fe9a5d5bf04 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:31.494864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f365-77e3-4013-be6d-8fe9a5d5bf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:31.503165 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3363/6697] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:07:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:07:31.526309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717acc78-f88c-4d4d-b278-c44a6475c532 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:31.527826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-717acc78-f88c-4d4d-b278-c44a6475c532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:31.539714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8ab7f365-77e3-4013-be6d-8fe9a5d5bf04 None None] MFA Rules not processed for user `0dc8cc3c6fcf4541b95dfaa3c86f8aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:31.541034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8ab7f365-77e3-4013-be6d-8fe9a5d5bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:31.619883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717acc78-f88c-4d4d-b278-c44a6475c532 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:31.681971 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3335/6698] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:31 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:31.687448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f365-77e3-4013-be6d-8fe9a5d5bf04 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:31.691363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8ab7f365-77e3-4013-be6d-8fe9a5d5bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:31.710889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d2f10-8404-470e-be10-8db70f7d2033 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:31.711730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2f10-8404-470e-be10-8db70f7d2033 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:31.712114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2f10-8404-470e-be10-8db70f7d2033 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:31.712928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2f10-8404-470e-be10-8db70f7d2033 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:31.758986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f365-77e3-4013-be6d-8fe9a5d5bf04 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:31.763116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86e09e-5560-46a5-a7d8-4387dcc73eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:31.763818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86e09e-5560-46a5-a7d8-4387dcc73eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:31.764108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86e09e-5560-46a5-a7d8-4387dcc73eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:31.764383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86e09e-5560-46a5-a7d8-4387dcc73eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:31.775788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86e09e-5560-46a5-a7d8-4387dcc73eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:31.777500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86e09e-5560-46a5-a7d8-4387dcc73eb2 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:31.787948 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3336/6699] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:31 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:07:31.814749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d2f10-8404-470e-be10-8db70f7d2033 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:31.816418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d2f10-8404-470e-be10-8db70f7d2033 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:31.829810 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3364/6700] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:07:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:07:31.987912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86e09e-5560-46a5-a7d8-4387dcc73eb2 service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:32.304443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86e09e-5560-46a5-a7d8-4387dcc73eb2 service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:32.319000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:32.319861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:32.320149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:32.320433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] PATH_INFO: `/v3/users/ebf7a731ca05402e9af975dd8a495ae2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:32.325800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf7a731ca05402e9af975dd8a495ae2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:32.327852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:32.473363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf7a731ca05402e9af975dd8a495ae2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:32.474560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf7a731ca05402e9af975dd8a495ae2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:32.514182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf7a731ca05402e9af975dd8a495ae2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:32.515601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf7a731ca05402e9af975dd8a495ae2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:32.539980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf7a731ca05402e9af975dd8a495ae2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:32.577015 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3337/6701] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:31 2021] DELETE /identity/v3/users/ebf7a731ca05402e9af975dd8a495ae2 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:32.581828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c2e2a-ea9f-48d5-ac25-af38628c2161 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:32.583574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c2e2a-ea9f-48d5-ac25-af38628c2161 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:32.584092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c2e2a-ea9f-48d5-ac25-af38628c2161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:32.613878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c13c2e2a-ea9f-48d5-ac25-af38628c2161 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:32.616681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c13c2e2a-ea9f-48d5-ac25-af38628c2161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:32.736719 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3365/6702] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:07:32.741980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:32.744028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:32.891424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a179-2c94-47d4-b173-707e09cec70d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:32.904674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9110d-d320-419c-8fa8-c982a02c12c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:32.905985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9110d-d320-419c-8fa8-c982a02c12c6 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:32.906523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9110d-d320-419c-8fa8-c982a02c12c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:32.907021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9110d-d320-419c-8fa8-c982a02c12c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:32.930876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9110d-d320-419c-8fa8-c982a02c12c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:32.932769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9110d-d320-419c-8fa8-c982a02c12c6 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:32.955927 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3338/6703] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:33.640193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c2e2a-ea9f-48d5-ac25-af38628c2161 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:33.647461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c13c2e2a-ea9f-48d5-ac25-af38628c2161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:33.673930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c2e2a-ea9f-48d5-ac25-af38628c2161 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:33.688283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:33.689209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:33.689494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:33.689772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] PATH_INFO: `/v3/projects/fb6a3ca6f66d4f898a2edd7ba3116cca` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:33.692577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6a3ca6f66d4f898a2edd7ba3116cca)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:33.694590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:33.796112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6a3ca6f66d4f898a2edd7ba3116cca', 'request_id': 'req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:33.821531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6a3ca6f66d4f898a2edd7ba3116cca', 'request_id': 'req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:33.859869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6a3ca6f66d4f898a2edd7ba3116cca', 'request_id': 'req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:33.894727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] The token cache is being invalidate because project fb6a3ca6f66d4f898a2edd7ba3116cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:33.895027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:33.896559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:33.903119 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3366/6704] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:33 2021] DELETE /identity/v3/projects/fb6a3ca6f66d4f898a2edd7ba3116cca => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:33.904966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9110d-d320-419c-8fa8-c982a02c12c6 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:33.915641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9110d-d320-419c-8fa8-c982a02c12c6 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:34.051819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926df27-0ff1-4c6a-afdd-ea413d05ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:34.053171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926df27-0ff1-4c6a-afdd-ea413d05ea39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:34.053677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926df27-0ff1-4c6a-afdd-ea413d05ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:34.054187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926df27-0ff1-4c6a-afdd-ea413d05ea39 admin admin] PATH_INFO: `/v3/users/0dc8cc3c6fcf4541b95dfaa3c86f8aa9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:34.055688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926df27-0ff1-4c6a-afdd-ea413d05ea39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc8cc3c6fcf4541b95dfaa3c86f8aa9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:34.058210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926df27-0ff1-4c6a-afdd-ea413d05ea39 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:34.180044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d926df27-0ff1-4c6a-afdd-ea413d05ea39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc8cc3c6fcf4541b95dfaa3c86f8aa9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:34.181650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d926df27-0ff1-4c6a-afdd-ea413d05ea39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc8cc3c6fcf4541b95dfaa3c86f8aa9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:34.200838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d926df27-0ff1-4c6a-afdd-ea413d05ea39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc8cc3c6fcf4541b95dfaa3c86f8aa9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:34.201951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d926df27-0ff1-4c6a-afdd-ea413d05ea39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc8cc3c6fcf4541b95dfaa3c86f8aa9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:34.228472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d926df27-0ff1-4c6a-afdd-ea413d05ea39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc8cc3c6fcf4541b95dfaa3c86f8aa9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:34.288101 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3339/6705] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:33 2021] DELETE /identity/v3/users/0dc8cc3c6fcf4541b95dfaa3c86f8aa9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:35.427315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:35.430212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:35.459054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7ebcf-cf0e-49f3-aec0-96bf51f45d6e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:35.632397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:35.633365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:35.633714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:35.634064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] PATH_INFO: `/v3/projects/39dae204cc28443ab86176db95b44c16` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:35.635404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=39dae204cc28443ab86176db95b44c16)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:35.637597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:35.706408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39dae204cc28443ab86176db95b44c16', 'request_id': 'req-099c2244-c237-434e-8f9c-cbfa7874a59f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:35.724516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39dae204cc28443ab86176db95b44c16', 'request_id': 'req-099c2244-c237-434e-8f9c-cbfa7874a59f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:35.739282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39dae204cc28443ab86176db95b44c16', 'request_id': 'req-099c2244-c237-434e-8f9c-cbfa7874a59f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:35.762511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] The token cache is being invalidate because project 39dae204cc28443ab86176db95b44c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:35.762829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:35.763522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-099c2244-c237-434e-8f9c-cbfa7874a59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:35.770244 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3367/6706] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:35 2021] DELETE /identity/v3/projects/39dae204cc28443ab86176db95b44c16 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:35.772343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdeb0b-9538-42b7-96fa-0d239ea332a1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:35.773282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdeb0b-9538-42b7-96fa-0d239ea332a1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:35.773800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdeb0b-9538-42b7-96fa-0d239ea332a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:35.812195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-98cdeb0b-9538-42b7-96fa-0d239ea332a1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:35.817043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-98cdeb0b-9538-42b7-96fa-0d239ea332a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:35.904332 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3340/6707] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:35.936673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a5c19-06c2-4db9-8d72-f8a1537b86a2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:35.936673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a5c19-06c2-4db9-8d72-f8a1537b86a2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:35.936673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a5c19-06c2-4db9-8d72-f8a1537b86a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:36.019658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5f1a5c19-06c2-4db9-8d72-f8a1537b86a2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:36.019658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f1a5c19-06c2-4db9-8d72-f8a1537b86a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:36.065845 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3368/6708] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:36.066638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdeb0b-9538-42b7-96fa-0d239ea332a1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:36.078116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdeb0b-9538-42b7-96fa-0d239ea332a1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:36.083786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2808588-66a2-4c38-9ebd-5a63c052c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:36.084614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2808588-66a2-4c38-9ebd-5a63c052c2be admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:36.084909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2808588-66a2-4c38-9ebd-5a63c052c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:36.085184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2808588-66a2-4c38-9ebd-5a63c052c2be admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:36.085938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2808588-66a2-4c38-9ebd-5a63c052c2be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:07:36.086247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2808588-66a2-4c38-9ebd-5a63c052c2be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:36.087982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2808588-66a2-4c38-9ebd-5a63c052c2be admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:36.106384 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3341/6709] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:07:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:07:36.107642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a5c19-06c2-4db9-8d72-f8a1537b86a2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:36.130217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a5c19-06c2-4db9-8d72-f8a1537b86a2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:36.140648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2efaf6-fee0-4ff8-b135-52d551c1033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:36.142040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2efaf6-fee0-4ff8-b135-52d551c1033e admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:36.143724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2efaf6-fee0-4ff8-b135-52d551c1033e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:36.144957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2efaf6-fee0-4ff8-b135-52d551c1033e admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:36.146212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2efaf6-fee0-4ff8-b135-52d551c1033e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:36.149888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2efaf6-fee0-4ff8-b135-52d551c1033e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:36.187903 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3369/6710] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:07:36 2021] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:36.192431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2808588-66a2-4c38-9ebd-5a63c052c2be admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:36.206081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2808588-66a2-4c38-9ebd-5a63c052c2be admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:36.366955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb71701-85f0-48ff-ae9c-e6b47a6f7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:36.367885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb71701-85f0-48ff-ae9c-e6b47a6f7c58 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:36.368345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb71701-85f0-48ff-ae9c-e6b47a6f7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:36.368910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb71701-85f0-48ff-ae9c-e6b47a6f7c58 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:36.369840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb71701-85f0-48ff-ae9c-e6b47a6f7c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:36.376806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb71701-85f0-48ff-ae9c-e6b47a6f7c58 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:36.487398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2efaf6-fee0-4ff8-b135-52d551c1033e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:36.491587 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3342/6711] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:07:36 2021] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:36.509948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2efaf6-fee0-4ff8-b135-52d551c1033e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:36.521086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb150a-d982-4b30-a6bd-b12321a69921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:36.522177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb150a-d982-4b30-a6bd-b12321a69921 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:36.524113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb150a-d982-4b30-a6bd-b12321a69921 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:36.524768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb150a-d982-4b30-a6bd-b12321a69921 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:36.526956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb150a-d982-4b30-a6bd-b12321a69921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:36.533853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb150a-d982-4b30-a6bd-b12321a69921 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:36.561374 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3370/6712] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:36 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:07:36.562185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb71701-85f0-48ff-ae9c-e6b47a6f7c58 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:36.593878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb71701-85f0-48ff-ae9c-e6b47a6f7c58 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:36.616726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0395d9-8de4-4f28-935d-9db1366620f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:36.618396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0395d9-8de4-4f28-935d-9db1366620f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:36.618688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0395d9-8de4-4f28-935d-9db1366620f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:36.618970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0395d9-8de4-4f28-935d-9db1366620f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:36.619788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0395d9-8de4-4f28-935d-9db1366620f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:36.629538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0395d9-8de4-4f28-935d-9db1366620f2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:36.674441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb150a-d982-4b30-a6bd-b12321a69921 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:36.680656 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3343/6713] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:36 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:36.694046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb150a-d982-4b30-a6bd-b12321a69921 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:36.708343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc83f0-6d34-45ca-bc82-8d06a53598b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:36.711038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc83f0-6d34-45ca-bc82-8d06a53598b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:36.711900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc83f0-6d34-45ca-bc82-8d06a53598b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:36.712373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc83f0-6d34-45ca-bc82-8d06a53598b9 admin admin] PATH_INFO: `/v3/projects/85d69b223b23413a93ff4d1f75f567e9/users/42df5e51102343e98ab6fde63c1c9bbb/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:36.768567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc83f0-6d34-45ca-bc82-8d06a53598b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d69b223b23413a93ff4d1f75f567e9, user_id=42df5e51102343e98ab6fde63c1c9bbb, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:36.777135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc83f0-6d34-45ca-bc82-8d06a53598b9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:36.820695 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3371/6714] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:36 2021] PUT /identity/v3/projects/85d69b223b23413a93ff4d1f75f567e9/users/42df5e51102343e98ab6fde63c1c9bbb/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:07:36.829720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704fa95-3c9e-43a1-a050-31dfff110709 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:36.830286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704fa95-3c9e-43a1-a050-31dfff110709 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:36.830286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704fa95-3c9e-43a1-a050-31dfff110709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:36.898563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6704fa95-3c9e-43a1-a050-31dfff110709 None None] MFA Rules not processed for user `42df5e51102343e98ab6fde63c1c9bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:36.900009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6704fa95-3c9e-43a1-a050-31dfff110709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:36.991368 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3344/6715] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:36 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:36.996335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc83f0-6d34-45ca-bc82-8d06a53598b9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:37.123801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc83f0-6d34-45ca-bc82-8d06a53598b9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:37.133213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016c9e8-5aef-481d-98ac-f8fef33593bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:37.134791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016c9e8-5aef-481d-98ac-f8fef33593bb admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:37.135200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016c9e8-5aef-481d-98ac-f8fef33593bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:37.135718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016c9e8-5aef-481d-98ac-f8fef33593bb admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:37.136590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016c9e8-5aef-481d-98ac-f8fef33593bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:37.139579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016c9e8-5aef-481d-98ac-f8fef33593bb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:37.218679 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3372/6716] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:07:36 2021] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:07:37.223294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704fa95-3c9e-43a1-a050-31dfff110709 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:37.260312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704fa95-3c9e-43a1-a050-31dfff110709 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:37.416479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69316e8f-4d41-4259-bc4a-05f2af1ab716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:37.417223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69316e8f-4d41-4259-bc4a-05f2af1ab716 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:37.417516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69316e8f-4d41-4259-bc4a-05f2af1ab716 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:37.417799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69316e8f-4d41-4259-bc4a-05f2af1ab716 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:37.418513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69316e8f-4d41-4259-bc4a-05f2af1ab716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:37.422308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69316e8f-4d41-4259-bc4a-05f2af1ab716 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:37.484971 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3345/6717] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:07:37 2021] POST /identity/v3/users => generated 296 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:37.489348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016c9e8-5aef-481d-98ac-f8fef33593bb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:37.507505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016c9e8-5aef-481d-98ac-f8fef33593bb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:37.525449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8eb9f7-3cd9-4a12-bdd0-97ec6f486717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:37.529716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb9f7-3cd9-4a12-bdd0-97ec6f486717 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:37.534660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb9f7-3cd9-4a12-bdd0-97ec6f486717 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:37.535125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eb9f7-3cd9-4a12-bdd0-97ec6f486717 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:37.537225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8eb9f7-3cd9-4a12-bdd0-97ec6f486717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:37.541027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8eb9f7-3cd9-4a12-bdd0-97ec6f486717 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:37.577397 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3373/6718] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:37 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:37.578217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69316e8f-4d41-4259-bc4a-05f2af1ab716 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:37.592503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69316e8f-4d41-4259-bc4a-05f2af1ab716 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:37.603225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8ab4-dded-454f-ac02-a2b38cc7f272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:37.604174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8ab4-dded-454f-ac02-a2b38cc7f272 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:37.604461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8ab4-dded-454f-ac02-a2b38cc7f272 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:37.604743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b8ab4-dded-454f-ac02-a2b38cc7f272 admin admin] PATH_INFO: `/v3/projects/1d4b95b2a4854adea4ef7e29f25aeb84/users/6c49857f8ece464ab93d0d0755979b0a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:37.642106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b8ab4-dded-454f-ac02-a2b38cc7f272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4b95b2a4854adea4ef7e29f25aeb84, user_id=6c49857f8ece464ab93d0d0755979b0a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:37.645625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b8ab4-dded-454f-ac02-a2b38cc7f272 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:37.683304 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3346/6719] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:37 2021] PUT /identity/v3/projects/1d4b95b2a4854adea4ef7e29f25aeb84/users/6c49857f8ece464ab93d0d0755979b0a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:07:37.687962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8eb9f7-3cd9-4a12-bdd0-97ec6f486717 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:37.710048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8eb9f7-3cd9-4a12-bdd0-97ec6f486717 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:37.868503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b608513-670f-4ec9-a936-ba0cac462090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:37.869523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b608513-670f-4ec9-a936-ba0cac462090 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:37.869918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b608513-670f-4ec9-a936-ba0cac462090 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:37.870556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b608513-670f-4ec9-a936-ba0cac462090 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:37.871797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b608513-670f-4ec9-a936-ba0cac462090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:37.874685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b608513-670f-4ec9-a936-ba0cac462090 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:37.897863 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3374/6720] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:37 2021] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:37.898470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8ab4-dded-454f-ac02-a2b38cc7f272 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:37.925314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b8ab4-dded-454f-ac02-a2b38cc7f272 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:37.942554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b8cc-bfb1-46a4-ae8c-88ff4120529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:37.944167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b8cc-bfb1-46a4-ae8c-88ff4120529c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:37.944457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b8cc-bfb1-46a4-ae8c-88ff4120529c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:37.944748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b8cc-bfb1-46a4-ae8c-88ff4120529c admin admin] PATH_INFO: `/v3/projects/1d4b95b2a4854adea4ef7e29f25aeb84/users/6c49857f8ece464ab93d0d0755979b0a/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:37.956009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7b8cc-bfb1-46a4-ae8c-88ff4120529c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4b95b2a4854adea4ef7e29f25aeb84, user_id=6c49857f8ece464ab93d0d0755979b0a, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:37.959139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7b8cc-bfb1-46a4-ae8c-88ff4120529c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:37.985331 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3347/6721] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:37 2021] PUT /identity/v3/projects/1d4b95b2a4854adea4ef7e29f25aeb84/users/6c49857f8ece464ab93d0d0755979b0a/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:38.002674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75c16-85cc-42e0-a326-01c98b6758fb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:38.003037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75c16-85cc-42e0-a326-01c98b6758fb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:38.003234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75c16-85cc-42e0-a326-01c98b6758fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:38.061532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9ec75c16-85cc-42e0-a326-01c98b6758fb None None] MFA Rules not processed for user `6c49857f8ece464ab93d0d0755979b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:38.063036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9ec75c16-85cc-42e0-a326-01c98b6758fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:38.340632 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3375/6722] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:37 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:38.342390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b8cc-bfb1-46a4-ae8c-88ff4120529c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:38.344607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0ae7b8cc-bfb1-46a4-ae8c-88ff4120529c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:38.530356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b8cc-bfb1-46a4-ae8c-88ff4120529c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:38.535313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e194c-ffa0-44c3-a4bb-bc6556b77e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:38.536393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e194c-ffa0-44c3-a4bb-bc6556b77e22 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:38.537136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e194c-ffa0-44c3-a4bb-bc6556b77e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:38.537702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e194c-ffa0-44c3-a4bb-bc6556b77e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:38.573690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e194c-ffa0-44c3-a4bb-bc6556b77e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:38.574898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e194c-ffa0-44c3-a4bb-bc6556b77e22 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:38.596883 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3348/6723] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:38 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:39.365180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec75c16-85cc-42e0-a326-01c98b6758fb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:39.518744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec75c16-85cc-42e0-a326-01c98b6758fb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:39.528994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:39.529952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:39.530516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:39.530516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] PATH_INFO: `/v3/users/42df5e51102343e98ab6fde63c1c9bbb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:39.531833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42df5e51102343e98ab6fde63c1c9bbb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:39.534312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:39.622092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42df5e51102343e98ab6fde63c1c9bbb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:39.634885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42df5e51102343e98ab6fde63c1c9bbb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:39.635978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42df5e51102343e98ab6fde63c1c9bbb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:39.653624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42df5e51102343e98ab6fde63c1c9bbb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:39.697313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42df5e51102343e98ab6fde63c1c9bbb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:39.725310 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3376/6724] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:39 2021] DELETE /identity/v3/users/42df5e51102343e98ab6fde63c1c9bbb => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:39.732366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430700c-7590-44fa-91b9-2a1b466472f6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:39.733351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430700c-7590-44fa-91b9-2a1b466472f6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:39.733797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430700c-7590-44fa-91b9-2a1b466472f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:39.771893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d430700c-7590-44fa-91b9-2a1b466472f6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:39.773412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d430700c-7590-44fa-91b9-2a1b466472f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:39.913921 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3349/6725] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:39.928877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:39.930205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:40.066058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e447c1b-6b43-4c18-b6da-09ca92fbf8e9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:40.079474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e61021-24b0-4875-be15-cc59eecccbf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:40.080147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e61021-24b0-4875-be15-cc59eecccbf5 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:40.080428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e61021-24b0-4875-be15-cc59eecccbf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:40.080701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e61021-24b0-4875-be15-cc59eecccbf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:40.103892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e61021-24b0-4875-be15-cc59eecccbf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:40.105363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e61021-24b0-4875-be15-cc59eecccbf5 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:40.148519 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3377/6726] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:40.747607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430700c-7590-44fa-91b9-2a1b466472f6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:40.749686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d430700c-7590-44fa-91b9-2a1b466472f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:40.768988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430700c-7590-44fa-91b9-2a1b466472f6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:40.795621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:40.798468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:40.798468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:40.798867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] PATH_INFO: `/v3/projects/85d69b223b23413a93ff4d1f75f567e9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:40.800684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d69b223b23413a93ff4d1f75f567e9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:40.802951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:40.895383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d69b223b23413a93ff4d1f75f567e9', 'request_id': 'req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:40.903809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d69b223b23413a93ff4d1f75f567e9', 'request_id': 'req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:40.917171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d69b223b23413a93ff4d1f75f567e9', 'request_id': 'req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:40.934507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] The token cache is being invalidate because project 85d69b223b23413a93ff4d1f75f567e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:40.935099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:40.935969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:40.942280 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3350/6727] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:40 2021] DELETE /identity/v3/projects/85d69b223b23413a93ff4d1f75f567e9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:40.942800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e61021-24b0-4875-be15-cc59eecccbf5 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:40.955719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e61021-24b0-4875-be15-cc59eecccbf5 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:41.069664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6637-b4ef-4afe-8eb7-c4574f5e598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:41.070624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6637-b4ef-4afe-8eb7-c4574f5e598b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:41.071008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6637-b4ef-4afe-8eb7-c4574f5e598b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:41.071430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6637-b4ef-4afe-8eb7-c4574f5e598b admin admin] PATH_INFO: `/v3/users/6c49857f8ece464ab93d0d0755979b0a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:41.076392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff6637-b4ef-4afe-8eb7-c4574f5e598b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c49857f8ece464ab93d0d0755979b0a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:41.078382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff6637-b4ef-4afe-8eb7-c4574f5e598b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:41.133031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0cff6637-b4ef-4afe-8eb7-c4574f5e598b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c49857f8ece464ab93d0d0755979b0a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:41.169387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0cff6637-b4ef-4afe-8eb7-c4574f5e598b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c49857f8ece464ab93d0d0755979b0a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:41.171268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0cff6637-b4ef-4afe-8eb7-c4574f5e598b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c49857f8ece464ab93d0d0755979b0a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:41.216864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0cff6637-b4ef-4afe-8eb7-c4574f5e598b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c49857f8ece464ab93d0d0755979b0a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:41.234503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0cff6637-b4ef-4afe-8eb7-c4574f5e598b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c49857f8ece464ab93d0d0755979b0a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:41.243449 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3378/6728] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:40 2021] DELETE /identity/v3/users/6c49857f8ece464ab93d0d0755979b0a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:41.699650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:41.701106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:41.731774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eaf66-79fa-4e8f-9eab-3342652f2f1a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:41.802242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:41.803907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:41.804406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:41.804840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] PATH_INFO: `/v3/projects/1d4b95b2a4854adea4ef7e29f25aeb84` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:41.806502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4b95b2a4854adea4ef7e29f25aeb84)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:41.808934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:41.869307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4b95b2a4854adea4ef7e29f25aeb84', 'request_id': 'req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:41.885187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4b95b2a4854adea4ef7e29f25aeb84', 'request_id': 'req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:41.896579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4b95b2a4854adea4ef7e29f25aeb84', 'request_id': 'req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:41.909216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] The token cache is being invalidate because project 1d4b95b2a4854adea4ef7e29f25aeb84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:41.909496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:41.910149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bd6c0712-f3b5-4a74-b85d-13adf43ca2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:41.916113 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3351/6729] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:41 2021] DELETE /identity/v3/projects/1d4b95b2a4854adea4ef7e29f25aeb84 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:41.917766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f94af-ab68-4b11-9406-119f4a89e28c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:41.918363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f94af-ab68-4b11-9406-119f4a89e28c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:41.918673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f94af-ab68-4b11-9406-119f4a89e28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:41.948944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1d4f94af-ab68-4b11-9406-119f4a89e28c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:41.951113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1d4f94af-ab68-4b11-9406-119f4a89e28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:42.082208 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3379/6730] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:42.090393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bc370-dae8-4805-8919-2ad2e1915ce0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:42.090798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bc370-dae8-4805-8919-2ad2e1915ce0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:42.091406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bc370-dae8-4805-8919-2ad2e1915ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:42.140825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-133bc370-dae8-4805-8919-2ad2e1915ce0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:42.142087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-133bc370-dae8-4805-8919-2ad2e1915ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:42.147537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026f9d2-c4f7-4fcb-9971-462c8a446213 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:42.148300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026f9d2-c4f7-4fcb-9971-462c8a446213 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:42.148809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026f9d2-c4f7-4fcb-9971-462c8a446213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:42.166661 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3352/6731] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:42.171110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bc370-dae8-4805-8919-2ad2e1915ce0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:42.187704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bc370-dae8-4805-8919-2ad2e1915ce0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:42.194318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b026f9d2-c4f7-4fcb-9971-462c8a446213 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:42.195700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b026f9d2-c4f7-4fcb-9971-462c8a446213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:42.200628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf703421-fab8-4f67-9f74-dfcf02a6eadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:42.202296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703421-fab8-4f67-9f74-dfcf02a6eadc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:42.204813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703421-fab8-4f67-9f74-dfcf02a6eadc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:42.204813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703421-fab8-4f67-9f74-dfcf02a6eadc admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:42.204813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf703421-fab8-4f67-9f74-dfcf02a6eadc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:07:42.207476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf703421-fab8-4f67-9f74-dfcf02a6eadc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:42.210467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf703421-fab8-4f67-9f74-dfcf02a6eadc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:42.231440 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3353/6732] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:07:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:07:42.236400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf703421-fab8-4f67-9f74-dfcf02a6eadc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:42.254651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf703421-fab8-4f67-9f74-dfcf02a6eadc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:42.262229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4552490-7a77-4c0e-abfe-6700bb4767fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:42.263220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4552490-7a77-4c0e-abfe-6700bb4767fd admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:42.263632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4552490-7a77-4c0e-abfe-6700bb4767fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:42.264808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4552490-7a77-4c0e-abfe-6700bb4767fd admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:42.264808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4552490-7a77-4c0e-abfe-6700bb4767fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:42.268731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4552490-7a77-4c0e-abfe-6700bb4767fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:42.303221 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3380/6733] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:07:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:07:42.316035 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3354/6734] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:07:42 2021] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:42.317889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026f9d2-c4f7-4fcb-9971-462c8a446213 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:42.324550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4552490-7a77-4c0e-abfe-6700bb4767fd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:42.327407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a4552490-7a77-4c0e-abfe-6700bb4767fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:42.334096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026f9d2-c4f7-4fcb-9971-462c8a446213 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:42.420794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d760e3-b5ab-4eaf-8d6c-6fc63222c17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:42.421434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d760e3-b5ab-4eaf-8d6c-6fc63222c17c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:42.421724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d760e3-b5ab-4eaf-8d6c-6fc63222c17c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:42.422069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d760e3-b5ab-4eaf-8d6c-6fc63222c17c admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:42.428218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d760e3-b5ab-4eaf-8d6c-6fc63222c17c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:42.428218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d760e3-b5ab-4eaf-8d6c-6fc63222c17c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:42.446215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4552490-7a77-4c0e-abfe-6700bb4767fd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:42.466545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4545f-8787-4fe4-9ec1-1bf363e94524 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:42.467270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4545f-8787-4fe4-9ec1-1bf363e94524 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:42.467560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4545f-8787-4fe4-9ec1-1bf363e94524 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:42.467832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4545f-8787-4fe4-9ec1-1bf363e94524 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:42.478306 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3381/6735] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:07:42 2021] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:42.481126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d760e3-b5ab-4eaf-8d6c-6fc63222c17c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:42.508289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d760e3-b5ab-4eaf-8d6c-6fc63222c17c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:42.514897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca19981-da0d-4aba-a540-dbe91cd2e273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:42.515880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca19981-da0d-4aba-a540-dbe91cd2e273 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:42.516313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca19981-da0d-4aba-a540-dbe91cd2e273 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:42.516695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca19981-da0d-4aba-a540-dbe91cd2e273 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:42.517622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca19981-da0d-4aba-a540-dbe91cd2e273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:42.519478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca19981-da0d-4aba-a540-dbe91cd2e273 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:42.537365 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3382/6736] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:42 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:07:42.538526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca19981-da0d-4aba-a540-dbe91cd2e273 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:42.551572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca19981-da0d-4aba-a540-dbe91cd2e273 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:42.558024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefce12-0c88-4fb4-a2f2-549f9893e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:42.558690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefce12-0c88-4fb4-a2f2-549f9893e4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:42.558979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefce12-0c88-4fb4-a2f2-549f9893e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:42.559277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefce12-0c88-4fb4-a2f2-549f9893e4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:42.560048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefce12-0c88-4fb4-a2f2-549f9893e4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:42.563748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefce12-0c88-4fb4-a2f2-549f9893e4b3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:42.591117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4545f-8787-4fe4-9ec1-1bf363e94524 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:42.595805 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3383/6737] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:42 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:42.595988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4545f-8787-4fe4-9ec1-1bf363e94524 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:42.597742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefce12-0c88-4fb4-a2f2-549f9893e4b3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:42.613460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefce12-0c88-4fb4-a2f2-549f9893e4b3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:42.617423 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3355/6738] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:07:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:07:42.620951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388c5c-a2cc-46ad-821c-5aa5e0b06644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:42.622004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388c5c-a2cc-46ad-821c-5aa5e0b06644 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:42.622390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388c5c-a2cc-46ad-821c-5aa5e0b06644 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:42.622765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388c5c-a2cc-46ad-821c-5aa5e0b06644 admin admin] PATH_INFO: `/v3/projects/1c3bcfde0f704cce95e3dd3f22c1dc2f/users/0daa9eae13b348b38a70707bf25f4184/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:42.654726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97388c5c-a2cc-46ad-821c-5aa5e0b06644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3bcfde0f704cce95e3dd3f22c1dc2f, user_id=0daa9eae13b348b38a70707bf25f4184, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:42.658467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97388c5c-a2cc-46ad-821c-5aa5e0b06644 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:42.696932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3384/6739] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:42 2021] PUT /identity/v3/projects/1c3bcfde0f704cce95e3dd3f22c1dc2f/users/0daa9eae13b348b38a70707bf25f4184/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:07:42.708545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829fd45-8160-4c44-a5d3-50afd7854a66 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:42.708857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829fd45-8160-4c44-a5d3-50afd7854a66 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:42.709105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829fd45-8160-4c44-a5d3-50afd7854a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:42.756382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d829fd45-8160-4c44-a5d3-50afd7854a66 None None] MFA Rules not processed for user `0daa9eae13b348b38a70707bf25f4184`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:42.757620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d829fd45-8160-4c44-a5d3-50afd7854a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:42.875379 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3356/6740] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:42 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:43.271028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388c5c-a2cc-46ad-821c-5aa5e0b06644 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:43.276205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-97388c5c-a2cc-46ad-821c-5aa5e0b06644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:43.419842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388c5c-a2cc-46ad-821c-5aa5e0b06644 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:43.431920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b5e04-6956-432b-85d1-555df3e3c6f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:43.432956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b5e04-6956-432b-85d1-555df3e3c6f9 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:43.433344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b5e04-6956-432b-85d1-555df3e3c6f9 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:43.433734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b5e04-6956-432b-85d1-555df3e3c6f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:43.451286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b5e04-6956-432b-85d1-555df3e3c6f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:43.452869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b5e04-6956-432b-85d1-555df3e3c6f9 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:43.485054 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3385/6741] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:43 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:45.066850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829fd45-8160-4c44-a5d3-50afd7854a66 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:45.068420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d829fd45-8160-4c44-a5d3-50afd7854a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:45.147563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829fd45-8160-4c44-a5d3-50afd7854a66 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:45.152489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca2198-94bb-4726-bdad-bb320a7787a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:45.153421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca2198-94bb-4726-bdad-bb320a7787a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:45.153709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca2198-94bb-4726-bdad-bb320a7787a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:45.153997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca2198-94bb-4726-bdad-bb320a7787a9 admin admin] PATH_INFO: `/v3/users/bd92ea56b41244a58e3a959f665431c2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:45.155417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca2198-94bb-4726-bdad-bb320a7787a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd92ea56b41244a58e3a959f665431c2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:45.157484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca2198-94bb-4726-bdad-bb320a7787a9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:45.212165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-41ca2198-94bb-4726-bdad-bb320a7787a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd92ea56b41244a58e3a959f665431c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:45.213001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-41ca2198-94bb-4726-bdad-bb320a7787a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd92ea56b41244a58e3a959f665431c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:45.223095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-41ca2198-94bb-4726-bdad-bb320a7787a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd92ea56b41244a58e3a959f665431c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:45.223915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-41ca2198-94bb-4726-bdad-bb320a7787a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd92ea56b41244a58e3a959f665431c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:45.235572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-41ca2198-94bb-4726-bdad-bb320a7787a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd92ea56b41244a58e3a959f665431c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:45.253854 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3357/6742] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:45 2021] DELETE /identity/v3/users/bd92ea56b41244a58e3a959f665431c2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:45.592363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b5e04-6956-432b-85d1-555df3e3c6f9 service glance] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:45.611465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b5e04-6956-432b-85d1-555df3e3c6f9 service glance] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:45.693554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:45.697215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:45.699731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:45.700600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] PATH_INFO: `/v3/projects/f916d44620e3418a8916382d00618dc9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:45.710343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f916d44620e3418a8916382d00618dc9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:45.716746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:45.801515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f916d44620e3418a8916382d00618dc9', 'request_id': 'req-7475405e-3870-4e18-98c8-b498cef16c54'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:45.830934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f916d44620e3418a8916382d00618dc9', 'request_id': 'req-7475405e-3870-4e18-98c8-b498cef16c54'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:45.840894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f916d44620e3418a8916382d00618dc9', 'request_id': 'req-7475405e-3870-4e18-98c8-b498cef16c54'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:45.861087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] The token cache is being invalidate because project f916d44620e3418a8916382d00618dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:07:45.861389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:45.862152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7475405e-3870-4e18-98c8-b498cef16c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:45.868294 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3386/6743] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:07:45 2021] DELETE /identity/v3/projects/f916d44620e3418a8916382d00618dc9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:07:45.870658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db1d11-8cfe-42ea-93ed-81371fcc9e85 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:45.871145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db1d11-8cfe-42ea-93ed-81371fcc9e85 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:45.871618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db1d11-8cfe-42ea-93ed-81371fcc9e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:45.907798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-87db1d11-8cfe-42ea-93ed-81371fcc9e85 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:45.909167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-87db1d11-8cfe-42ea-93ed-81371fcc9e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:46.055280 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3358/6744] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:46.063521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11879b-52f8-48d8-9094-8e4054a66a9e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:46.063788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11879b-52f8-48d8-9094-8e4054a66a9e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:46.064067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11879b-52f8-48d8-9094-8e4054a66a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:46.085978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ac11879b-52f8-48d8-9094-8e4054a66a9e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:46.087545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ac11879b-52f8-48d8-9094-8e4054a66a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:46.118329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db1d11-8cfe-42ea-93ed-81371fcc9e85 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:46.125652 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3387/6745] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:46.131148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db1d11-8cfe-42ea-93ed-81371fcc9e85 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:46.136251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9ac5-ebbe-4485-b1db-09d06592c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:46.137140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9ac5-ebbe-4485-b1db-09d06592c5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:46.137730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9ac5-ebbe-4485-b1db-09d06592c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:46.138245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9ac5-ebbe-4485-b1db-09d06592c5c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:46.139166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d9ac5-ebbe-4485-b1db-09d06592c5c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:07:46.139879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d9ac5-ebbe-4485-b1db-09d06592c5c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:46.143367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d9ac5-ebbe-4485-b1db-09d06592c5c4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:46.157693 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3359/6746] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:07:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:07:46.161868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11879b-52f8-48d8-9094-8e4054a66a9e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:46.171426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11879b-52f8-48d8-9094-8e4054a66a9e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:46.176379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cdcad-8435-477f-beab-a7d537efcd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:46.177193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cdcad-8435-477f-beab-a7d537efcd00 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:46.177480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cdcad-8435-477f-beab-a7d537efcd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:46.177889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cdcad-8435-477f-beab-a7d537efcd00 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:46.178738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cdcad-8435-477f-beab-a7d537efcd00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:46.180671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cdcad-8435-477f-beab-a7d537efcd00 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:46.217473 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3388/6747] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:07:46 2021] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:07:46.218562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9ac5-ebbe-4485-b1db-09d06592c5c4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:46.231844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9ac5-ebbe-4485-b1db-09d06592c5c4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:46.315556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc14bb-ac2c-4375-9607-dffe86449e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:46.316234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc14bb-ac2c-4375-9607-dffe86449e56 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:46.316774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc14bb-ac2c-4375-9607-dffe86449e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:46.317061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc14bb-ac2c-4375-9607-dffe86449e56 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:46.317768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc14bb-ac2c-4375-9607-dffe86449e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:46.321135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc14bb-ac2c-4375-9607-dffe86449e56 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:46.346105 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3360/6748] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:07:46 2021] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:07:46.349725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cdcad-8435-477f-beab-a7d537efcd00 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:46.365802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cdcad-8435-477f-beab-a7d537efcd00 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:46.374340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdf38a-1528-49cb-8209-d577c8fc165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:46.374888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdf38a-1528-49cb-8209-d577c8fc165d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:46.375244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdf38a-1528-49cb-8209-d577c8fc165d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:46.376388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdf38a-1528-49cb-8209-d577c8fc165d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:46.377209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdf38a-1528-49cb-8209-d577c8fc165d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:46.379292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdf38a-1528-49cb-8209-d577c8fc165d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:46.394795 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3389/6749] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:46.400245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc14bb-ac2c-4375-9607-dffe86449e56 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:46.412678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc14bb-ac2c-4375-9607-dffe86449e56 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:46.417945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aece64-2dab-4640-a989-b2e535d91356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:46.418912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aece64-2dab-4640-a989-b2e535d91356 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:46.419647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aece64-2dab-4640-a989-b2e535d91356 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:46.420124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aece64-2dab-4640-a989-b2e535d91356 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:46.421081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aece64-2dab-4640-a989-b2e535d91356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:46.423041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aece64-2dab-4640-a989-b2e535d91356 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:46.439291 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3361/6750] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:46 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:46.442273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdf38a-1528-49cb-8209-d577c8fc165d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:46.452982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdf38a-1528-49cb-8209-d577c8fc165d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:46.458752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e683-9f97-498d-81cc-f7d75fd998f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:46.459680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e683-9f97-498d-81cc-f7d75fd998f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:46.460074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e683-9f97-498d-81cc-f7d75fd998f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:46.460223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e683-9f97-498d-81cc-f7d75fd998f6 admin admin] PATH_INFO: `/v3/projects/7d726e50ae6948c1ac498d2bfe00bbdc/users/ef6c7994dcb14b00ae16c87ba99031db/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:46.475811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79e683-9f97-498d-81cc-f7d75fd998f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d726e50ae6948c1ac498d2bfe00bbdc, user_id=ef6c7994dcb14b00ae16c87ba99031db, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:46.478714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79e683-9f97-498d-81cc-f7d75fd998f6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:46.493419 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3390/6751] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:07:46 2021] PUT /identity/v3/projects/7d726e50ae6948c1ac498d2bfe00bbdc/users/ef6c7994dcb14b00ae16c87ba99031db/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:07:46.498952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97eea-2f7c-47a0-bf03-c5b46605a071 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:46.499463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97eea-2f7c-47a0-bf03-c5b46605a071 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:46.499827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d97eea-2f7c-47a0-bf03-c5b46605a071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:46.520050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-10d97eea-2f7c-47a0-bf03-c5b46605a071 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:46.521408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-10d97eea-2f7c-47a0-bf03-c5b46605a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:46.582645 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3362/6752] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:46.593651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e683-9f97-498d-81cc-f7d75fd998f6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:46.595495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4e79e683-9f97-498d-81cc-f7d75fd998f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:46.676966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e683-9f97-498d-81cc-f7d75fd998f6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:46.681592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803fe9d-f823-4ee7-95de-71c0cb73fbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:46.682242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803fe9d-f823-4ee7-95de-71c0cb73fbcd service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:46.682523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803fe9d-f823-4ee7-95de-71c0cb73fbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:46.682798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803fe9d-f823-4ee7-95de-71c0cb73fbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:46.695915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803fe9d-f823-4ee7-95de-71c0cb73fbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:46.697358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803fe9d-f823-4ee7-95de-71c0cb73fbcd service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:46.707771 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3391/6753] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:07:51.465018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d97eea-2f7c-47a0-bf03-c5b46605a071 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:51.466676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-10d97eea-2f7c-47a0-bf03-c5b46605a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:51.513904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d97eea-2f7c-47a0-bf03-c5b46605a071 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:51.524318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373a1d3-5346-40ae-849f-01d59061d56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:51.525776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373a1d3-5346-40ae-849f-01d59061d56a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:51.527633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373a1d3-5346-40ae-849f-01d59061d56a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:51.527925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373a1d3-5346-40ae-849f-01d59061d56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:51.534850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6373a1d3-5346-40ae-849f-01d59061d56a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:51.570404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373a1d3-5346-40ae-849f-01d59061d56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:51.572181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373a1d3-5346-40ae-849f-01d59061d56a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:51.606321 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3363/6754] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:51 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:51.779462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803fe9d-f823-4ee7-95de-71c0cb73fbcd service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:51.781017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c803fe9d-f823-4ee7-95de-71c0cb73fbcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:51.934022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803fe9d-f823-4ee7-95de-71c0cb73fbcd service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:51.939894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e4d20-7439-41e3-a0c1-fbfa0c6c7332 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:51.941995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e4d20-7439-41e3-a0c1-fbfa0c6c7332 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:51.942495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e4d20-7439-41e3-a0c1-fbfa0c6c7332 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:51.943169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e4d20-7439-41e3-a0c1-fbfa0c6c7332 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:51.945481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c33e4d20-7439-41e3-a0c1-fbfa0c6c7332 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:52.109332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e4d20-7439-41e3-a0c1-fbfa0c6c7332 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:52.111027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e4d20-7439-41e3-a0c1-fbfa0c6c7332 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:52.128110 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3392/6755] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:51 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:52.207556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373a1d3-5346-40ae-849f-01d59061d56a service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:52.219506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373a1d3-5346-40ae-849f-01d59061d56a service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:52.224013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e9e17-e8b0-4ecf-a65a-e32483261630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:52.224913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e9e17-e8b0-4ecf-a65a-e32483261630 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:52.225196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e9e17-e8b0-4ecf-a65a-e32483261630 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:52.225476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e9e17-e8b0-4ecf-a65a-e32483261630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:52.227673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2e7e9e17-e8b0-4ecf-a65a-e32483261630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:52.241922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e9e17-e8b0-4ecf-a65a-e32483261630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:52.243358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e9e17-e8b0-4ecf-a65a-e32483261630 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:52.256066 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3364/6756] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:07:52 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:07:52.497788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cb32f-7d0c-45ca-b957-2524b4a17412 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:52.498136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cb32f-7d0c-45ca-b957-2524b4a17412 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:52.498519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cb32f-7d0c-45ca-b957-2524b4a17412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:52.537538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c79cb32f-7d0c-45ca-b957-2524b4a17412 None None] MFA Rules not processed for user `ef6c7994dcb14b00ae16c87ba99031db`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:52.538912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c79cb32f-7d0c-45ca-b957-2524b4a17412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:52.624595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3393/6757] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:52 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:52.626445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e9e17-e8b0-4ecf-a65a-e32483261630 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:52.640101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e9e17-e8b0-4ecf-a65a-e32483261630 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:52.645942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd017e-d0d0-433e-b1e9-acd18766926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:52.646920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd017e-d0d0-433e-b1e9-acd18766926f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:52.647459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd017e-d0d0-433e-b1e9-acd18766926f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:52.647843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd017e-d0d0-433e-b1e9-acd18766926f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:52.648647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd017e-d0d0-433e-b1e9-acd18766926f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:52.650697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd017e-d0d0-433e-b1e9-acd18766926f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:52.674005 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3365/6758] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:07:52 2021] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:07:52.677874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cb32f-7d0c-45ca-b957-2524b4a17412 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:52.690738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cb32f-7d0c-45ca-b957-2524b4a17412 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:52.696041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218b10c-3440-4772-a34b-b9c11a5d1fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:52.696713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218b10c-3440-4772-a34b-b9c11a5d1fbd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:52.696995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218b10c-3440-4772-a34b-b9c11a5d1fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:52.697270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218b10c-3440-4772-a34b-b9c11a5d1fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:52.698005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218b10c-3440-4772-a34b-b9c11a5d1fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:52.699679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218b10c-3440-4772-a34b-b9c11a5d1fbd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:52.710698 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3394/6759] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:07:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:52.715039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd017e-d0d0-433e-b1e9-acd18766926f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:52.728989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd017e-d0d0-433e-b1e9-acd18766926f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:52.735520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabeed1-d032-4b73-9da6-1041701cee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:52.736703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabeed1-d032-4b73-9da6-1041701cee1c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:52.737037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabeed1-d032-4b73-9da6-1041701cee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:52.737293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabeed1-d032-4b73-9da6-1041701cee1c admin admin] PATH_INFO: `/v3/system/users/502106d3bd0d4b1d8cb515bb4979aeb4/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:52.753844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabeed1-d032-4b73-9da6-1041701cee1c admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=502106d3bd0d4b1d8cb515bb4979aeb4, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:52.754813 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-3eabeed1-d032-4b73-9da6-1041701cee1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:07:52.754813 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:07:52.754813 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:07:52.755753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabeed1-d032-4b73-9da6-1041701cee1c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:52.766387 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3366/6760] 10.222.0.21 () {60 vars in 1377 bytes} [Sat Nov 27 21:07:52 2021] PUT /identity/v3/system/users/502106d3bd0d4b1d8cb515bb4979aeb4/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:07:52.781000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc03df-a9e1-4151-be63-0e66444b4661 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:52.781524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc03df-a9e1-4151-be63-0e66444b4661 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:52.781626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc03df-a9e1-4151-be63-0e66444b4661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:52.819682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c6fc03df-a9e1-4151-be63-0e66444b4661 None None] MFA Rules not processed for user `502106d3bd0d4b1d8cb515bb4979aeb4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:52.820926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c6fc03df-a9e1-4151-be63-0e66444b4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:52.921088 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3395/6761] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:07:52 2021] POST /identity/v3/auth/tokens => generated 2405 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 27 21:07:52.926123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabeed1-d032-4b73-9da6-1041701cee1c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:53.042767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabeed1-d032-4b73-9da6-1041701cee1c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:53.177096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697468bc-4072-41bb-963a-2e70d1d8b440 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502106d3bd0d4b1d8cb515bb4979aeb4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:53.178092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697468bc-4072-41bb-963a-2e70d1d8b440 None tempest-ImageQuotaTest-1066698470-system-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:53.178656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697468bc-4072-41bb-963a-2e70d1d8b440 None tempest-ImageQuotaTest-1066698470-system-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:53.179040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697468bc-4072-41bb-963a-2e70d1d8b440 None tempest-ImageQuotaTest-1066698470-system-admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:53.180600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697468bc-4072-41bb-963a-2e70d1d8b440 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:53.182268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697468bc-4072-41bb-963a-2e70d1d8b440 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:53.221147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc03df-a9e1-4151-be63-0e66444b4661 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:53.225504 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3367/6762] 10.222.0.21 () {58 vars in 1109 bytes} [Sat Nov 27 21:07:52 2021] GET /identity/v3/services => generated 2191 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:07:53.427567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc03df-a9e1-4151-be63-0e66444b4661 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:53.475989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969238b-c3e1-49f0-b060-07a0057c48b3 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502106d3bd0d4b1d8cb515bb4979aeb4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:53.476798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969238b-c3e1-49f0-b060-07a0057c48b3 None tempest-ImageQuotaTest-1066698470-system-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:53.477079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969238b-c3e1-49f0-b060-07a0057c48b3 None tempest-ImageQuotaTest-1066698470-system-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:53.477377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969238b-c3e1-49f0-b060-07a0057c48b3 None tempest-ImageQuotaTest-1066698470-system-admin] PATH_INFO: `/v3/limits` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:53.478160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969238b-c3e1-49f0-b060-07a0057c48b3 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:53.479508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969238b-c3e1-49f0-b060-07a0057c48b3 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:53.513694 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-f969238b-c3e1-49f0-b060-07a0057c48b3 None tempest-ImageQuotaTest-1066698470-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Nov 27 21:07:53.515486 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3396/6763] 10.222.0.21 () {60 vars in 1125 bytes} [Sat Nov 27 21:07:53 2021] POST /identity/v3/limits => generated 124 bytes in 295 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:07:53.521567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697468bc-4072-41bb-963a-2e70d1d8b440 None tempest-ImageQuotaTest-1066698470-system-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:53.659291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697468bc-4072-41bb-963a-2e70d1d8b440 None tempest-ImageQuotaTest-1066698470-system-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:53.702166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5ad17-61f5-4d52-bd10-dae015ce8fb5 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502106d3bd0d4b1d8cb515bb4979aeb4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:53.702840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ad17-61f5-4d52-bd10-dae015ce8fb5 None tempest-ImageQuotaTest-1066698470-system-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:53.703134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ad17-61f5-4d52-bd10-dae015ce8fb5 None tempest-ImageQuotaTest-1066698470-system-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:53.704099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5ad17-61f5-4d52-bd10-dae015ce8fb5 None tempest-ImageQuotaTest-1066698470-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:53.704822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ad17-61f5-4d52-bd10-dae015ce8fb5 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:53.705926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5ad17-61f5-4d52-bd10-dae015ce8fb5 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:53.716568 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3368/6764] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 21:07:53 2021] GET /identity/v3/registered_limits => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:07:53.723904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969238b-c3e1-49f0-b060-07a0057c48b3 None tempest-ImageQuotaTest-1066698470-system-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:53.898349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969238b-c3e1-49f0-b060-07a0057c48b3 None tempest-ImageQuotaTest-1066698470-system-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:53.959088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6087173-35a0-4a4a-9f9d-01514afbd139 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '502106d3bd0d4b1d8cb515bb4979aeb4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:53.959914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6087173-35a0-4a4a-9f9d-01514afbd139 None tempest-ImageQuotaTest-1066698470-system-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:53.960270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6087173-35a0-4a4a-9f9d-01514afbd139 None tempest-ImageQuotaTest-1066698470-system-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:53.960645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6087173-35a0-4a4a-9f9d-01514afbd139 None tempest-ImageQuotaTest-1066698470-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:53.961450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6087173-35a0-4a4a-9f9d-01514afbd139 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:53.962731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6087173-35a0-4a4a-9f9d-01514afbd139 None tempest-ImageQuotaTest-1066698470-system-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:53.969853 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3397/6765] 10.222.0.21 () {58 vars in 1136 bytes} [Sat Nov 27 21:07:53 2021] GET /identity/v3/registered_limits => generated 129 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:07:56.623894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2e8c-fcaf-41c0-a644-b2c745406655 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:56.624382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2e8c-fcaf-41c0-a644-b2c745406655 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:56.624479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2e8c-fcaf-41c0-a644-b2c745406655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:56.649548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f51a2e8c-fcaf-41c0-a644-b2c745406655 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:07:56.651068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f51a2e8c-fcaf-41c0-a644-b2c745406655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:56.710078 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3369/6766] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:07:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:07:56.722631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6087173-35a0-4a4a-9f9d-01514afbd139 None tempest-ImageQuotaTest-1066698470-system-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:56.724431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c6087173-35a0-4a4a-9f9d-01514afbd139 None tempest-ImageQuotaTest-1066698470-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:07:56.795137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6087173-35a0-4a4a-9f9d-01514afbd139 None tempest-ImageQuotaTest-1066698470-system-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:56.800287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323a4a6-5aa3-4e58-9317-1e6a2a700566 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:56.800932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323a4a6-5aa3-4e58-9317-1e6a2a700566 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:56.801217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323a4a6-5aa3-4e58-9317-1e6a2a700566 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:56.801501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323a4a6-5aa3-4e58-9317-1e6a2a700566 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:56.810001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323a4a6-5aa3-4e58-9317-1e6a2a700566 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:56.811674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323a4a6-5aa3-4e58-9317-1e6a2a700566 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:56.820711 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3398/6767] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:07:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:07:59.820369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a2e8c-fcaf-41c0-a644-b2c745406655 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:07:59.835380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a2e8c-fcaf-41c0-a644-b2c745406655 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:07:59.841848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:07:59.842941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:07:59.843519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:07:59.844193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] PATH_INFO: `/v3/users/ef6c7994dcb14b00ae16c87ba99031db` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:07:59.846110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6c7994dcb14b00ae16c87ba99031db)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:07:59.848364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:07:59.907967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6c7994dcb14b00ae16c87ba99031db'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:59.908718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6c7994dcb14b00ae16c87ba99031db'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:59.919122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6c7994dcb14b00ae16c87ba99031db'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:59.920283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6c7994dcb14b00ae16c87ba99031db'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:59.931349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6c7994dcb14b00ae16c87ba99031db'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:07:59.959412 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3370/6768] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:07:59 2021] DELETE /identity/v3/users/ef6c7994dcb14b00ae16c87ba99031db => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:00.152623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323a4a6-5aa3-4e58-9317-1e6a2a700566 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:00.168880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323a4a6-5aa3-4e58-9317-1e6a2a700566 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:00.194295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:00.195805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:00.237768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:00.238646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:00.239120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:00.239642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] PATH_INFO: `/v3/projects/7d726e50ae6948c1ac498d2bfe00bbdc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:00.241802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d726e50ae6948c1ac498d2bfe00bbdc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:00.243928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:00.283759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb6931-2590-426d-b286-06fc92ee0580 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:00.298182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d726e50ae6948c1ac498d2bfe00bbdc', 'request_id': 'req-56c8d189-fee6-4b01-82fd-e71269bdf23e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.310311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d726e50ae6948c1ac498d2bfe00bbdc', 'request_id': 'req-56c8d189-fee6-4b01-82fd-e71269bdf23e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.321609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d726e50ae6948c1ac498d2bfe00bbdc', 'request_id': 'req-56c8d189-fee6-4b01-82fd-e71269bdf23e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.335923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] The token cache is being invalidate because project 7d726e50ae6948c1ac498d2bfe00bbdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:08:00.336617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.337649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.340489 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3399/6769] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:08:00 2021] DELETE /identity/v3/projects/7d726e50ae6948c1ac498d2bfe00bbdc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:00.344187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:00.345615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:00.366628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4763da1-9ffe-4dca-9e39-f6fc746a6ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:00.367545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4763da1-9ffe-4dca-9e39-f6fc746a6ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:00.367854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4763da1-9ffe-4dca-9e39-f6fc746a6ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:00.368153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4763da1-9ffe-4dca-9e39-f6fc746a6ae5 admin admin] PATH_INFO: `/v3/users/0daa9eae13b348b38a70707bf25f4184` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:00.369365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4763da1-9ffe-4dca-9e39-f6fc746a6ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0daa9eae13b348b38a70707bf25f4184)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:00.371677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4763da1-9ffe-4dca-9e39-f6fc746a6ae5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:00.419842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8d189-fee6-4b01-82fd-e71269bdf23e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:00.435428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:00.436312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:00.436596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:00.436871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] PATH_INFO: `/v3/users/502106d3bd0d4b1d8cb515bb4979aeb4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:00.438322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=502106d3bd0d4b1d8cb515bb4979aeb4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:00.440471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:00.447094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4763da1-9ffe-4dca-9e39-f6fc746a6ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0daa9eae13b348b38a70707bf25f4184'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.447901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4763da1-9ffe-4dca-9e39-f6fc746a6ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0daa9eae13b348b38a70707bf25f4184'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.456502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4763da1-9ffe-4dca-9e39-f6fc746a6ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0daa9eae13b348b38a70707bf25f4184'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.457232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4763da1-9ffe-4dca-9e39-f6fc746a6ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0daa9eae13b348b38a70707bf25f4184'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.471148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4763da1-9ffe-4dca-9e39-f6fc746a6ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0daa9eae13b348b38a70707bf25f4184'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.509078 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3371/6770] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:08:00 2021] DELETE /identity/v3/users/0daa9eae13b348b38a70707bf25f4184 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:00.511079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066533bb-0db4-42f2-8366-8f692770c642 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:00.511737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066533bb-0db4-42f2-8366-8f692770c642 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:00.512165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066533bb-0db4-42f2-8366-8f692770c642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:00.526108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502106d3bd0d4b1d8cb515bb4979aeb4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.530505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-066533bb-0db4-42f2-8366-8f692770c642 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:00.532849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-066533bb-0db4-42f2-8366-8f692770c642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:00.534413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502106d3bd0d4b1d8cb515bb4979aeb4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.535057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502106d3bd0d4b1d8cb515bb4979aeb4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.546347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502106d3bd0d4b1d8cb515bb4979aeb4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.562265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502106d3bd0d4b1d8cb515bb4979aeb4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:00.574554 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3400/6771] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:08:00 2021] DELETE /identity/v3/users/502106d3bd0d4b1d8cb515bb4979aeb4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:08:00.627033 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3372/6772] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:00.638628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:00.640264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:00.710589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38eec7-e219-4c82-9817-c1d877d88819 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:00.714941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd30528-d4f7-47bf-a222-07feacfc78cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:00.715952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd30528-d4f7-47bf-a222-07feacfc78cf service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:00.716443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd30528-d4f7-47bf-a222-07feacfc78cf service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:00.716910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd30528-d4f7-47bf-a222-07feacfc78cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:00.796545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd30528-d4f7-47bf-a222-07feacfc78cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:00.800299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd30528-d4f7-47bf-a222-07feacfc78cf service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:00.820442 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3401/6773] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:01.130687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066533bb-0db4-42f2-8366-8f692770c642 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:01.132144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-066533bb-0db4-42f2-8366-8f692770c642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:01.160913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066533bb-0db4-42f2-8366-8f692770c642 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:01.166342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a137-e4d4-46ce-884b-b15231d9393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:01.167219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a137-e4d4-46ce-884b-b15231d9393c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:01.167618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a137-e4d4-46ce-884b-b15231d9393c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:01.168117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a137-e4d4-46ce-884b-b15231d9393c admin admin] PATH_INFO: `/v3/projects/None` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:01.182128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033a137-e4d4-46ce-884b-b15231d9393c admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:01.184283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033a137-e4d4-46ce-884b-b15231d9393c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:01.209673 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-9033a137-e4d4-46ce-884b-b15231d9393c admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Nov 27 21:08:01.215329 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3373/6774] 10.222.0.21 () {58 vars in 1148 bytes} [Sat Nov 27 21:08:01 2021] DELETE /identity/v3/projects/None => generated 85 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 27 21:08:01.364553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd30528-d4f7-47bf-a222-07feacfc78cf service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:01.366751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4cd30528-d4f7-47bf-a222-07feacfc78cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:01.383315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd30528-d4f7-47bf-a222-07feacfc78cf service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:01.388459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:01.389340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:01.389609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:01.389879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] PATH_INFO: `/v3/projects/1c3bcfde0f704cce95e3dd3f22c1dc2f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:01.392052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3bcfde0f704cce95e3dd3f22c1dc2f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:01.394207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:01.517939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3bcfde0f704cce95e3dd3f22c1dc2f', 'request_id': 'req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:01.532575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3bcfde0f704cce95e3dd3f22c1dc2f', 'request_id': 'req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:01.541399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3bcfde0f704cce95e3dd3f22c1dc2f', 'request_id': 'req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:01.557044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] The token cache is being invalidate because project 1c3bcfde0f704cce95e3dd3f22c1dc2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:08:01.557342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:01.558158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c12c1b2e-7db1-4ab9-a7bb-13638b20bfe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:01.559968 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3402/6775] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:08:01 2021] DELETE /identity/v3/projects/1c3bcfde0f704cce95e3dd3f22c1dc2f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:01.566403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3410ef-b77b-4082-a373-dcb9dc875e1f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:01.566693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3410ef-b77b-4082-a373-dcb9dc875e1f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:01.566970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3410ef-b77b-4082-a373-dcb9dc875e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:01.598467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fc3410ef-b77b-4082-a373-dcb9dc875e1f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:01.599764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fc3410ef-b77b-4082-a373-dcb9dc875e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:01.708518 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3374/6776] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:01.716451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed692d-4c51-47b5-ad7a-7b630adf60fc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:01.716871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed692d-4c51-47b5-ad7a-7b630adf60fc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:01.717253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed692d-4c51-47b5-ad7a-7b630adf60fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:01.739385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-02ed692d-4c51-47b5-ad7a-7b630adf60fc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:01.754538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-02ed692d-4c51-47b5-ad7a-7b630adf60fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:01.763969 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3403/6777] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:01.768046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3410ef-b77b-4082-a373-dcb9dc875e1f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:01.777677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3410ef-b77b-4082-a373-dcb9dc875e1f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:01.782422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38b0b2-3e2b-4a26-88b5-0c73a59fe414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:01.783072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38b0b2-3e2b-4a26-88b5-0c73a59fe414 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:01.783386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38b0b2-3e2b-4a26-88b5-0c73a59fe414 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:01.783661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38b0b2-3e2b-4a26-88b5-0c73a59fe414 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:01.784394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38b0b2-3e2b-4a26-88b5-0c73a59fe414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:08:01.784700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38b0b2-3e2b-4a26-88b5-0c73a59fe414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:01.786328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38b0b2-3e2b-4a26-88b5-0c73a59fe414 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:01.810133 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3375/6778] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:08:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:08:01.816224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed692d-4c51-47b5-ad7a-7b630adf60fc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:01.846855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed692d-4c51-47b5-ad7a-7b630adf60fc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:01.853302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab773a-5e70-433b-bb55-117cb0386aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:01.853972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab773a-5e70-433b-bb55-117cb0386aea admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:01.854332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab773a-5e70-433b-bb55-117cb0386aea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:01.854521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab773a-5e70-433b-bb55-117cb0386aea admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:01.855229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab773a-5e70-433b-bb55-117cb0386aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:01.857278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab773a-5e70-433b-bb55-117cb0386aea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:01.895527 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3404/6779] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:08:01 2021] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:08:01.899165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38b0b2-3e2b-4a26-88b5-0c73a59fe414 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:01.911374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38b0b2-3e2b-4a26-88b5-0c73a59fe414 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:02.001227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a540e9d-4b61-4fa8-b9e2-eaae1e749837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:02.001985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a540e9d-4b61-4fa8-b9e2-eaae1e749837 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:02.002339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a540e9d-4b61-4fa8-b9e2-eaae1e749837 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:02.002616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a540e9d-4b61-4fa8-b9e2-eaae1e749837 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:02.003706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a540e9d-4b61-4fa8-b9e2-eaae1e749837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:02.006223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a540e9d-4b61-4fa8-b9e2-eaae1e749837 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:02.040764 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3376/6780] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:08:01 2021] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:08:02.044557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab773a-5e70-433b-bb55-117cb0386aea admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:02.064666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab773a-5e70-433b-bb55-117cb0386aea admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:02.073604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1702c-4442-43e6-aa02-90869090ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:02.074294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1702c-4442-43e6-aa02-90869090ec9d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:02.074578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1702c-4442-43e6-aa02-90869090ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:02.074832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1702c-4442-43e6-aa02-90869090ec9d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:02.075695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1702c-4442-43e6-aa02-90869090ec9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:02.077441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1702c-4442-43e6-aa02-90869090ec9d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:02.117533 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3405/6781] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:02 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:08:02.121541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a540e9d-4b61-4fa8-b9e2-eaae1e749837 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:02.138425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a540e9d-4b61-4fa8-b9e2-eaae1e749837 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:02.145305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125205-6700-49a1-a008-64b5e16d798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:02.146205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125205-6700-49a1-a008-64b5e16d798b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:02.146821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125205-6700-49a1-a008-64b5e16d798b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:02.147449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125205-6700-49a1-a008-64b5e16d798b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:02.148381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4125205-6700-49a1-a008-64b5e16d798b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:02.150027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4125205-6700-49a1-a008-64b5e16d798b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:02.163499 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3377/6782] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:02 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:08:02.170735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1702c-4442-43e6-aa02-90869090ec9d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:02.193084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1702c-4442-43e6-aa02-90869090ec9d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:02.204171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6cc5f-e362-495a-8bf9-f6f40f0c165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:02.205077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6cc5f-e362-495a-8bf9-f6f40f0c165e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:02.205362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6cc5f-e362-495a-8bf9-f6f40f0c165e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:02.205642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6cc5f-e362-495a-8bf9-f6f40f0c165e admin admin] PATH_INFO: `/v3/projects/b14c416fb81f4b1dbff2aa82e2323988/users/267a528bdc2d4279b338859db42b5d0d/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:02.246220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6cc5f-e362-495a-8bf9-f6f40f0c165e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14c416fb81f4b1dbff2aa82e2323988, user_id=267a528bdc2d4279b338859db42b5d0d, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:02.256553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6cc5f-e362-495a-8bf9-f6f40f0c165e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:02.278060 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3406/6783] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:08:02 2021] PUT /identity/v3/projects/b14c416fb81f4b1dbff2aa82e2323988/users/267a528bdc2d4279b338859db42b5d0d/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:02.288324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde0fe1-4015-422b-987d-7a1c79d1cda0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:02.289038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde0fe1-4015-422b-987d-7a1c79d1cda0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:02.289632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde0fe1-4015-422b-987d-7a1c79d1cda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:02.327116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4fde0fe1-4015-422b-987d-7a1c79d1cda0 None None] MFA Rules not processed for user `267a528bdc2d4279b338859db42b5d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:02.328446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4fde0fe1-4015-422b-987d-7a1c79d1cda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:02.401023 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3378/6784] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:02 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:02.413789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6cc5f-e362-495a-8bf9-f6f40f0c165e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:02.416008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fcf6cc5f-e362-495a-8bf9-f6f40f0c165e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:02.514018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6cc5f-e362-495a-8bf9-f6f40f0c165e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:02.525451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a8d71-1f77-49be-9eb4-2b8cb8a2f9d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:02.526121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a8d71-1f77-49be-9eb4-2b8cb8a2f9d4 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:02.526393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a8d71-1f77-49be-9eb4-2b8cb8a2f9d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:02.526717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a8d71-1f77-49be-9eb4-2b8cb8a2f9d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:02.541979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a8d71-1f77-49be-9eb4-2b8cb8a2f9d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:02.543741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220a8d71-1f77-49be-9eb4-2b8cb8a2f9d4 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:02.556850 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3407/6785] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:02 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:05.218032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde0fe1-4015-422b-987d-7a1c79d1cda0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:05.305535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde0fe1-4015-422b-987d-7a1c79d1cda0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:05.317495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:05.318406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:05.318708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:05.318988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] PATH_INFO: `/v3/users/267a528bdc2d4279b338859db42b5d0d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:05.323284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=267a528bdc2d4279b338859db42b5d0d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:05.325311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:05.407475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267a528bdc2d4279b338859db42b5d0d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:05.408410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267a528bdc2d4279b338859db42b5d0d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:05.419675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267a528bdc2d4279b338859db42b5d0d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:05.420712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267a528bdc2d4279b338859db42b5d0d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:05.438594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267a528bdc2d4279b338859db42b5d0d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:05.483458 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3379/6786] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:08:05 2021] DELETE /identity/v3/users/267a528bdc2d4279b338859db42b5d0d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:08:05.484392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a3ee7-20c6-4853-acfd-59e656a5331a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:05.484888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a3ee7-20c6-4853-acfd-59e656a5331a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:05.485102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a3ee7-20c6-4853-acfd-59e656a5331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:05.521535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-283a3ee7-20c6-4853-acfd-59e656a5331a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:05.522637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-283a3ee7-20c6-4853-acfd-59e656a5331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:05.643981 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3408/6787] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:08:05.660154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:05.660154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:05.738901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670ba16-9903-4f2f-848f-11c6773e1d41 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:05.753889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239796e-2b60-4397-bb10-f5f54180a4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:05.754571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239796e-2b60-4397-bb10-f5f54180a4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:05.755395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239796e-2b60-4397-bb10-f5f54180a4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:05.755395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239796e-2b60-4397-bb10-f5f54180a4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:05.766937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239796e-2b60-4397-bb10-f5f54180a4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:05.769056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239796e-2b60-4397-bb10-f5f54180a4a8 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:05.781530 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3380/6788] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:06.202245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a3ee7-20c6-4853-acfd-59e656a5331a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:06.205778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-283a3ee7-20c6-4853-acfd-59e656a5331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:06.252654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a3ee7-20c6-4853-acfd-59e656a5331a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:06.273283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:06.274217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:06.274629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:06.274987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] PATH_INFO: `/v3/projects/b14c416fb81f4b1dbff2aa82e2323988` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:06.280605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14c416fb81f4b1dbff2aa82e2323988)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:06.285306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:06.365561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14c416fb81f4b1dbff2aa82e2323988', 'request_id': 'req-c586f9e6-e3f0-4585-a97e-ad47ed061996'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:06.389548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14c416fb81f4b1dbff2aa82e2323988', 'request_id': 'req-c586f9e6-e3f0-4585-a97e-ad47ed061996'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:06.400085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14c416fb81f4b1dbff2aa82e2323988', 'request_id': 'req-c586f9e6-e3f0-4585-a97e-ad47ed061996'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:06.418848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] The token cache is being invalidate because project b14c416fb81f4b1dbff2aa82e2323988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:08:06.419224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:06.419936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c586f9e6-e3f0-4585-a97e-ad47ed061996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:06.422845 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3409/6789] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:08:06 2021] DELETE /identity/v3/projects/b14c416fb81f4b1dbff2aa82e2323988 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:06.428721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dcb7f-e292-4a2a-8604-9a4efb66bf3d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:06.429390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dcb7f-e292-4a2a-8604-9a4efb66bf3d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:06.429515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dcb7f-e292-4a2a-8604-9a4efb66bf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:06.459183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-758dcb7f-e292-4a2a-8604-9a4efb66bf3d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:06.460757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-758dcb7f-e292-4a2a-8604-9a4efb66bf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:06.590933 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3381/6790] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:08:06.597727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa48df-99f1-4a1d-9a95-623132ab21ff None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:06.598621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa48df-99f1-4a1d-9a95-623132ab21ff None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:06.598621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa48df-99f1-4a1d-9a95-623132ab21ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:06.624608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-55aa48df-99f1-4a1d-9a95-623132ab21ff None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:06.626107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-55aa48df-99f1-4a1d-9a95-623132ab21ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:06.635440 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3410/6791] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:06.639689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dcb7f-e292-4a2a-8604-9a4efb66bf3d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:06.652653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dcb7f-e292-4a2a-8604-9a4efb66bf3d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:06.659561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54407e06-61df-4ed2-a0ae-943c1f527c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:06.660908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54407e06-61df-4ed2-a0ae-943c1f527c52 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:06.661261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54407e06-61df-4ed2-a0ae-943c1f527c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:06.661619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54407e06-61df-4ed2-a0ae-943c1f527c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:06.662436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54407e06-61df-4ed2-a0ae-943c1f527c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:08:06.662813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54407e06-61df-4ed2-a0ae-943c1f527c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:06.665154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54407e06-61df-4ed2-a0ae-943c1f527c52 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:06.695379 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3382/6792] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:08:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:08:06.699092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa48df-99f1-4a1d-9a95-623132ab21ff None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:06.708319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa48df-99f1-4a1d-9a95-623132ab21ff None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:06.713094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7655f4-fc64-4038-807a-356a82b1d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:06.713750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7655f4-fc64-4038-807a-356a82b1d7ae admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:06.714038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7655f4-fc64-4038-807a-356a82b1d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:06.714310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7655f4-fc64-4038-807a-356a82b1d7ae admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:06.715012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7655f4-fc64-4038-807a-356a82b1d7ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:06.717021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7655f4-fc64-4038-807a-356a82b1d7ae admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:06.763557 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3411/6793] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:08:06 2021] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:08:06.764003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54407e06-61df-4ed2-a0ae-943c1f527c52 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:06.774934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54407e06-61df-4ed2-a0ae-943c1f527c52 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:06.855980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49542fad-d874-442a-b110-a3ec81ca6186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:06.857031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49542fad-d874-442a-b110-a3ec81ca6186 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:06.857328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49542fad-d874-442a-b110-a3ec81ca6186 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:06.857607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49542fad-d874-442a-b110-a3ec81ca6186 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:06.858378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49542fad-d874-442a-b110-a3ec81ca6186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:06.860514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49542fad-d874-442a-b110-a3ec81ca6186 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:06.882277 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3383/6794] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:08:06 2021] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:08:06.886504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7655f4-fc64-4038-807a-356a82b1d7ae admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:06.897442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7655f4-fc64-4038-807a-356a82b1d7ae admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:06.902902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfa62a-6f2c-4461-93e5-02cdf24fc361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:06.903809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfa62a-6f2c-4461-93e5-02cdf24fc361 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:06.904098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfa62a-6f2c-4461-93e5-02cdf24fc361 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:06.904373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfa62a-6f2c-4461-93e5-02cdf24fc361 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:06.905113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfa62a-6f2c-4461-93e5-02cdf24fc361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:06.907384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfa62a-6f2c-4461-93e5-02cdf24fc361 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:06.919484 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3412/6795] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:08:06.923776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49542fad-d874-442a-b110-a3ec81ca6186 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:06.938076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49542fad-d874-442a-b110-a3ec81ca6186 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:06.943062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec420c-2e9c-4de0-bf21-fe7f84effcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:06.943768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec420c-2e9c-4de0-bf21-fe7f84effcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:06.944197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec420c-2e9c-4de0-bf21-fe7f84effcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:06.944621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec420c-2e9c-4de0-bf21-fe7f84effcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:06.945454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec420c-2e9c-4de0-bf21-fe7f84effcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:06.946997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec420c-2e9c-4de0-bf21-fe7f84effcf7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:06.959404 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3384/6796] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:06 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:08:06.963211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfa62a-6f2c-4461-93e5-02cdf24fc361 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:06.976598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfa62a-6f2c-4461-93e5-02cdf24fc361 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:06.981852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba3bb9-0893-4c88-aaa9-bfe97d4101d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:06.982754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3bb9-0893-4c88-aaa9-bfe97d4101d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:06.983036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3bb9-0893-4c88-aaa9-bfe97d4101d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:06.983361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3bb9-0893-4c88-aaa9-bfe97d4101d1 admin admin] PATH_INFO: `/v3/projects/49981e6330d04897a5b23f4ca0b9a934/users/8e803241af524277951e54959299c98e/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:06.999671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba3bb9-0893-4c88-aaa9-bfe97d4101d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49981e6330d04897a5b23f4ca0b9a934, user_id=8e803241af524277951e54959299c98e, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:07.002329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba3bb9-0893-4c88-aaa9-bfe97d4101d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:07.019696 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3413/6797] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:08:06 2021] PUT /identity/v3/projects/49981e6330d04897a5b23f4ca0b9a934/users/8e803241af524277951e54959299c98e/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:08:07.024546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d934f1-2e52-4273-bbf2-123ca45363e4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:07.024834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d934f1-2e52-4273-bbf2-123ca45363e4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:07.025110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d934f1-2e52-4273-bbf2-123ca45363e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:07.048392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-55d934f1-2e52-4273-bbf2-123ca45363e4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:07.049847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-55d934f1-2e52-4273-bbf2-123ca45363e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:07.120426 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3385/6798] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:07.131284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba3bb9-0893-4c88-aaa9-bfe97d4101d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:07.133003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-72ba3bb9-0893-4c88-aaa9-bfe97d4101d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:07.160548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d934f1-2e52-4273-bbf2-123ca45363e4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:07.162161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-55d934f1-2e52-4273-bbf2-123ca45363e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:07.176257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d934f1-2e52-4273-bbf2-123ca45363e4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:07.180997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044c661-9de9-43c4-8e65-333fb663ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:07.181902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044c661-9de9-43c4-8e65-333fb663ae2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:07.182223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044c661-9de9-43c4-8e65-333fb663ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:07.182504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044c661-9de9-43c4-8e65-333fb663ae2c admin admin] PATH_INFO: `/v3/users/0b931665afff4f99b4804188e9ae1438` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:07.183763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044c661-9de9-43c4-8e65-333fb663ae2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b931665afff4f99b4804188e9ae1438)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:07.185691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044c661-9de9-43c4-8e65-333fb663ae2c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:07.200606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba3bb9-0893-4c88-aaa9-bfe97d4101d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:07.204328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa366b-5684-4d2d-bdc1-08d2a0de8302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:07.204988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa366b-5684-4d2d-bdc1-08d2a0de8302 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:07.205277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa366b-5684-4d2d-bdc1-08d2a0de8302 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:07.205558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa366b-5684-4d2d-bdc1-08d2a0de8302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:07.215463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa366b-5684-4d2d-bdc1-08d2a0de8302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:07.217228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa366b-5684-4d2d-bdc1-08d2a0de8302 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:07.227540 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3414/6799] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:07.231437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c044c661-9de9-43c4-8e65-333fb663ae2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b931665afff4f99b4804188e9ae1438'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:07.232126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c044c661-9de9-43c4-8e65-333fb663ae2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b931665afff4f99b4804188e9ae1438'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:07.240550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c044c661-9de9-43c4-8e65-333fb663ae2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b931665afff4f99b4804188e9ae1438'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:07.241180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c044c661-9de9-43c4-8e65-333fb663ae2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b931665afff4f99b4804188e9ae1438'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:07.248856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c044c661-9de9-43c4-8e65-333fb663ae2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b931665afff4f99b4804188e9ae1438'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:07.267650 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3386/6800] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:08:07 2021] DELETE /identity/v3/users/0b931665afff4f99b4804188e9ae1438 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:07.469139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa366b-5684-4d2d-bdc1-08d2a0de8302 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:07.483655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa366b-5684-4d2d-bdc1-08d2a0de8302 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:07.591015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:07.592033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:07.592600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:07.593119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] PATH_INFO: `/v3/projects/2fcfaa0229934ca2881bd510e1a2aade` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:07.595177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcfaa0229934ca2881bd510e1a2aade)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:07.598288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:07.652023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcfaa0229934ca2881bd510e1a2aade', 'request_id': 'req-65437d0d-d197-4800-ba97-8027c2e81eaa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:07.661871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcfaa0229934ca2881bd510e1a2aade', 'request_id': 'req-65437d0d-d197-4800-ba97-8027c2e81eaa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:07.670827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcfaa0229934ca2881bd510e1a2aade', 'request_id': 'req-65437d0d-d197-4800-ba97-8027c2e81eaa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:07.683383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] The token cache is being invalidate because project 2fcfaa0229934ca2881bd510e1a2aade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:08:07.683730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:07.684474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-65437d0d-d197-4800-ba97-8027c2e81eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:07.686123 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3415/6801] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:08:07 2021] DELETE /identity/v3/projects/2fcfaa0229934ca2881bd510e1a2aade => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:07.691976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfdea5-5d54-48e2-a8c8-610229039be5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:07.692523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfdea5-5d54-48e2-a8c8-610229039be5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:07.692523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfdea5-5d54-48e2-a8c8-610229039be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:07.711383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ebdfdea5-5d54-48e2-a8c8-610229039be5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:07.712500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ebdfdea5-5d54-48e2-a8c8-610229039be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:07.773435 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3387/6802] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:07.782603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9595dd6-6b65-47f6-b44f-426cbdebd1eb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:07.782895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9595dd6-6b65-47f6-b44f-426cbdebd1eb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:07.783204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9595dd6-6b65-47f6-b44f-426cbdebd1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:07.806136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f9595dd6-6b65-47f6-b44f-426cbdebd1eb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:07.807920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f9595dd6-6b65-47f6-b44f-426cbdebd1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:07.822379 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3416/6803] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:08:07.823641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfdea5-5d54-48e2-a8c8-610229039be5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:07.834810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfdea5-5d54-48e2-a8c8-610229039be5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:07.840104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834fad8-2fe4-4332-b247-a10fabada2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:07.840852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834fad8-2fe4-4332-b247-a10fabada2fe admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:07.841139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834fad8-2fe4-4332-b247-a10fabada2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:07.841420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834fad8-2fe4-4332-b247-a10fabada2fe admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:07.842814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834fad8-2fe4-4332-b247-a10fabada2fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:08:07.843128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834fad8-2fe4-4332-b247-a10fabada2fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:07.845531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834fad8-2fe4-4332-b247-a10fabada2fe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:07.861083 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3388/6804] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:08:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:08:07.862541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9595dd6-6b65-47f6-b44f-426cbdebd1eb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:07.872114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9595dd6-6b65-47f6-b44f-426cbdebd1eb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:07.876876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c15649-b408-4542-a411-d169af8cffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:07.877530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c15649-b408-4542-a411-d169af8cffb3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:07.877812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c15649-b408-4542-a411-d169af8cffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:07.878088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c15649-b408-4542-a411-d169af8cffb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:07.878795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c15649-b408-4542-a411-d169af8cffb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:07.880728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c15649-b408-4542-a411-d169af8cffb3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:07.915745 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3417/6805] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:08:07 2021] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:08:07.919973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834fad8-2fe4-4332-b247-a10fabada2fe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:07.930411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834fad8-2fe4-4332-b247-a10fabada2fe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:07.989608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c4037-03bd-4568-a545-ebbc4c11c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:07.990318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c4037-03bd-4568-a545-ebbc4c11c6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:07.990659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c4037-03bd-4568-a545-ebbc4c11c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:07.991282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c4037-03bd-4568-a545-ebbc4c11c6c6 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:07.991692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c4037-03bd-4568-a545-ebbc4c11c6c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:07.993665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c4037-03bd-4568-a545-ebbc4c11c6c6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:08.019529 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3389/6806] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:08:07 2021] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:08:08.024012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c15649-b408-4542-a411-d169af8cffb3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:08.035337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c15649-b408-4542-a411-d169af8cffb3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:08.040173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105c785-b356-4e3d-a2be-af6854a50a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:08.040844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105c785-b356-4e3d-a2be-af6854a50a3b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:08.041161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105c785-b356-4e3d-a2be-af6854a50a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:08.041441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105c785-b356-4e3d-a2be-af6854a50a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:08.042180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105c785-b356-4e3d-a2be-af6854a50a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:08.043812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105c785-b356-4e3d-a2be-af6854a50a3b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:08.055270 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3418/6807] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:08:08.059930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c4037-03bd-4568-a545-ebbc4c11c6c6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:08.071995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c4037-03bd-4568-a545-ebbc4c11c6c6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:08.077443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e926b5-1241-4332-aaff-84a6dea96289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:08.078886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e926b5-1241-4332-aaff-84a6dea96289 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:08.079375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e926b5-1241-4332-aaff-84a6dea96289 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:08.079831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e926b5-1241-4332-aaff-84a6dea96289 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:08.080733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e926b5-1241-4332-aaff-84a6dea96289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:08.082524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e926b5-1241-4332-aaff-84a6dea96289 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:08.093862 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3390/6808] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:08 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:08:08.098044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105c785-b356-4e3d-a2be-af6854a50a3b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:08.108294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105c785-b356-4e3d-a2be-af6854a50a3b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:08.113318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96229b-8d52-48b6-8d48-82b70643b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:08.114202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96229b-8d52-48b6-8d48-82b70643b3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:08.114496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96229b-8d52-48b6-8d48-82b70643b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:08.114801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96229b-8d52-48b6-8d48-82b70643b3b4 admin admin] PATH_INFO: `/v3/projects/9e71ba352bc24e6783f74563b7ccef73/users/58f9c80552ab428e81fd38ed6ed79a9c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:08.132931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96229b-8d52-48b6-8d48-82b70643b3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e71ba352bc24e6783f74563b7ccef73, user_id=58f9c80552ab428e81fd38ed6ed79a9c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:08.135830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96229b-8d52-48b6-8d48-82b70643b3b4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:08.151209 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3419/6809] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:08:08 2021] PUT /identity/v3/projects/9e71ba352bc24e6783f74563b7ccef73/users/58f9c80552ab428e81fd38ed6ed79a9c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:08:08.157169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c0ad-55e2-4784-a9fc-0de185ce86f4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:08.157869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c0ad-55e2-4784-a9fc-0de185ce86f4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:08.158158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c0ad-55e2-4784-a9fc-0de185ce86f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:08.177997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0646c0ad-55e2-4784-a9fc-0de185ce86f4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:08.179236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0646c0ad-55e2-4784-a9fc-0de185ce86f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:08.243483 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3391/6810] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:08.258451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96229b-8d52-48b6-8d48-82b70643b3b4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:08.260995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0b96229b-8d52-48b6-8d48-82b70643b3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:08.331888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96229b-8d52-48b6-8d48-82b70643b3b4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:08.339933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce79e3e-50fa-48ef-8ada-9a56f558dab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:08.340721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce79e3e-50fa-48ef-8ada-9a56f558dab5 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:08.341041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce79e3e-50fa-48ef-8ada-9a56f558dab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:08.341324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce79e3e-50fa-48ef-8ada-9a56f558dab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:08.351244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce79e3e-50fa-48ef-8ada-9a56f558dab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:08.352702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce79e3e-50fa-48ef-8ada-9a56f558dab5 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:08.368393 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3420/6811] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:09.197540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69842-f406-4b02-b8d1-a086b37eaa9a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:09.198349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69842-f406-4b02-b8d1-a086b37eaa9a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:09.198805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69842-f406-4b02-b8d1-a086b37eaa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:09.251324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-baf69842-f406-4b02-b8d1-a086b37eaa9a None None] MFA Rules not processed for user `58f9c80552ab428e81fd38ed6ed79a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:09.252551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-baf69842-f406-4b02-b8d1-a086b37eaa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:09.386816 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3392/6812] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:09 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:09.399513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef09d8-3dd0-4d9d-91c0-55324e6c1e84 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:09.400815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef09d8-3dd0-4d9d-91c0-55324e6c1e84 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:09.401258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef09d8-3dd0-4d9d-91c0-55324e6c1e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:09.439092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f7ef09d8-3dd0-4d9d-91c0-55324e6c1e84 None None] MFA Rules not processed for user `58f9c80552ab428e81fd38ed6ed79a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:09.441575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f7ef09d8-3dd0-4d9d-91c0-55324e6c1e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:09.450955 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3421/6813] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:09 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:09.463738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf69842-f406-4b02-b8d1-a086b37eaa9a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:09.465553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-baf69842-f406-4b02-b8d1-a086b37eaa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:09.607964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf69842-f406-4b02-b8d1-a086b37eaa9a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:09.615091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09333ad3-4c24-46ac-a19a-fe7de4a5925b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:09.615794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333ad3-4c24-46ac-a19a-fe7de4a5925b service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:09.616273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333ad3-4c24-46ac-a19a-fe7de4a5925b service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:09.616553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333ad3-4c24-46ac-a19a-fe7de4a5925b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:09.626106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09333ad3-4c24-46ac-a19a-fe7de4a5925b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:09.627752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09333ad3-4c24-46ac-a19a-fe7de4a5925b service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:09.637885 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3393/6814] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:09 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:12.241594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1d79-99f6-46f1-aa11-75922fadb156 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:12.242153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1d79-99f6-46f1-aa11-75922fadb156 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:12.242153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1d79-99f6-46f1-aa11-75922fadb156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:12.271216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-479d1d79-99f6-46f1-aa11-75922fadb156 None None] MFA Rules not processed for user `8e803241af524277951e54959299c98e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:12.272757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-479d1d79-99f6-46f1-aa11-75922fadb156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:12.344381 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3422/6815] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:12 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:12.348612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09333ad3-4c24-46ac-a19a-fe7de4a5925b service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:12.354207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-09333ad3-4c24-46ac-a19a-fe7de4a5925b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:12.370088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09333ad3-4c24-46ac-a19a-fe7de4a5925b service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:12.377666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bfc85-8228-4887-82e3-c158d305e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:12.378322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bfc85-8228-4887-82e3-c158d305e660 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:12.378609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bfc85-8228-4887-82e3-c158d305e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:12.378929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bfc85-8228-4887-82e3-c158d305e660 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:12.379705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bfc85-8228-4887-82e3-c158d305e660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:12.381669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bfc85-8228-4887-82e3-c158d305e660 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:12.412672 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3394/6816] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:08:12 2021] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:08:12.417196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1d79-99f6-46f1-aa11-75922fadb156 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:12.429961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1d79-99f6-46f1-aa11-75922fadb156 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:12.490424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e307d-b62b-441c-93cd-ef03b068454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:12.491237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e307d-b62b-441c-93cd-ef03b068454c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:12.491556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e307d-b62b-441c-93cd-ef03b068454c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:12.491842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e307d-b62b-441c-93cd-ef03b068454c admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:12.492557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e307d-b62b-441c-93cd-ef03b068454c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:12.494481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e307d-b62b-441c-93cd-ef03b068454c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:12.525263 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3423/6817] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:08:12 2021] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:08:12.529373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bfc85-8228-4887-82e3-c158d305e660 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:12.542631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bfc85-8228-4887-82e3-c158d305e660 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:12.560620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fde4b-3271-4844-a286-623b511eaf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:12.563043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fde4b-3271-4844-a286-623b511eaf8f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:12.563698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fde4b-3271-4844-a286-623b511eaf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:12.564246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fde4b-3271-4844-a286-623b511eaf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:12.567413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fde4b-3271-4844-a286-623b511eaf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:12.569410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fde4b-3271-4844-a286-623b511eaf8f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:12.585196 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3395/6818] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:12 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:08:12.589226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e307d-b62b-441c-93cd-ef03b068454c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:12.609275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e307d-b62b-441c-93cd-ef03b068454c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:12.616478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042293a-1586-4131-9e80-ac16aee393e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:12.617522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042293a-1586-4131-9e80-ac16aee393e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:12.618051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042293a-1586-4131-9e80-ac16aee393e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:12.618562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042293a-1586-4131-9e80-ac16aee393e2 admin admin] PATH_INFO: `/v3/projects/45d33ddc5be04cb1befef1cd37e34830/users/66800fa586a94ac48d8ae8f9a69e361c/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:12.645416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042293a-1586-4131-9e80-ac16aee393e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d33ddc5be04cb1befef1cd37e34830, user_id=66800fa586a94ac48d8ae8f9a69e361c, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:12.649394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042293a-1586-4131-9e80-ac16aee393e2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:12.671311 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3424/6819] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:08:12 2021] PUT /identity/v3/projects/45d33ddc5be04cb1befef1cd37e34830/users/66800fa586a94ac48d8ae8f9a69e361c/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:12.674175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fde4b-3271-4844-a286-623b511eaf8f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:12.685014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fde4b-3271-4844-a286-623b511eaf8f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:12.746489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e654e87-5da0-4cc6-910f-2603d0f41a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:12.746908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654e87-5da0-4cc6-910f-2603d0f41a14 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:12.747191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654e87-5da0-4cc6-910f-2603d0f41a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:12.747508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654e87-5da0-4cc6-910f-2603d0f41a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:12.748246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e654e87-5da0-4cc6-910f-2603d0f41a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:12.751899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e654e87-5da0-4cc6-910f-2603d0f41a14 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:12.779520 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3396/6820] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:12 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:08:12.783669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042293a-1586-4131-9e80-ac16aee393e2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:12.803805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042293a-1586-4131-9e80-ac16aee393e2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:12.813034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a08ba-1c8d-482b-8b3d-868c47a6caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:12.814037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a08ba-1c8d-482b-8b3d-868c47a6caf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:12.814402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a08ba-1c8d-482b-8b3d-868c47a6caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:12.816475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a08ba-1c8d-482b-8b3d-868c47a6caf9 admin admin] PATH_INFO: `/v3/projects/45d33ddc5be04cb1befef1cd37e34830/users/66800fa586a94ac48d8ae8f9a69e361c/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:12.817954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a08ba-1c8d-482b-8b3d-868c47a6caf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d33ddc5be04cb1befef1cd37e34830, user_id=66800fa586a94ac48d8ae8f9a69e361c, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:12.821390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a08ba-1c8d-482b-8b3d-868c47a6caf9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:12.842071 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3425/6821] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:08:12 2021] PUT /identity/v3/projects/45d33ddc5be04cb1befef1cd37e34830/users/66800fa586a94ac48d8ae8f9a69e361c/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:16.180035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a13d4a-c580-4b39-a954-5d61f65d2a6e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:16.181013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a13d4a-c580-4b39-a954-5d61f65d2a6e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:16.181461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a13d4a-c580-4b39-a954-5d61f65d2a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:16.272265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-66a13d4a-c580-4b39-a954-5d61f65d2a6e None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:16.273768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-66a13d4a-c580-4b39-a954-5d61f65d2a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:16.359064 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3397/6822] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:08:16 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:16.375107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a08ba-1c8d-482b-8b3d-868c47a6caf9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:16.377541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-923a08ba-1c8d-482b-8b3d-868c47a6caf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:16.486016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a08ba-1c8d-482b-8b3d-868c47a6caf9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:16.494526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709814d-82f4-418c-b80e-f28f0e8046d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:16.495517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709814d-82f4-418c-b80e-f28f0e8046d1 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:16.495802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709814d-82f4-418c-b80e-f28f0e8046d1 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:16.496149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709814d-82f4-418c-b80e-f28f0e8046d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:16.527725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709814d-82f4-418c-b80e-f28f0e8046d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:16.530212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709814d-82f4-418c-b80e-f28f0e8046d1 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:16.568508 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3426/6823] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:08:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:08:19.129304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab1e5-1ca9-4ca4-941e-dc84adae309e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:19.130128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab1e5-1ca9-4ca4-941e-dc84adae309e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:19.130572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab1e5-1ca9-4ca4-941e-dc84adae309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:19.159297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b5dab1e5-1ca9-4ca4-941e-dc84adae309e None None] MFA Rules not processed for user `66800fa586a94ac48d8ae8f9a69e361c`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:19.160512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b5dab1e5-1ca9-4ca4-941e-dc84adae309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:19.233873 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3398/6824] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:19 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:08:19.246142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709814d-82f4-418c-b80e-f28f0e8046d1 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:19.251929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4709814d-82f4-418c-b80e-f28f0e8046d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:19.356000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709814d-82f4-418c-b80e-f28f0e8046d1 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:19.361732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499042e-1198-4093-ac7c-23e4638df747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:19.362388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499042e-1198-4093-ac7c-23e4638df747 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:19.362882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499042e-1198-4093-ac7c-23e4638df747 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:19.363356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499042e-1198-4093-ac7c-23e4638df747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:19.440422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499042e-1198-4093-ac7c-23e4638df747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:19.442201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499042e-1198-4093-ac7c-23e4638df747 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:19.460997 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3427/6825] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:19 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:20.975400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17428-344a-4537-9d9e-aaaae65e575f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:20.975954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17428-344a-4537-9d9e-aaaae65e575f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:20.975954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17428-344a-4537-9d9e-aaaae65e575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:20.993617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9fd17428-344a-4537-9d9e-aaaae65e575f None None] MFA Rules not processed for user `8e803241af524277951e54959299c98e`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:20.995072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9fd17428-344a-4537-9d9e-aaaae65e575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:21.002894 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3399/6826] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:20 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:28.644734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499042e-1198-4093-ac7c-23e4638df747 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:28.709664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499042e-1198-4093-ac7c-23e4638df747 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:28.714313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739eedb-ec34-4a9c-b5c4-d7575fe898ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:28.715177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739eedb-ec34-4a9c-b5c4-d7575fe898ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:28.715497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739eedb-ec34-4a9c-b5c4-d7575fe898ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:28.715775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739eedb-ec34-4a9c-b5c4-d7575fe898ee admin admin] PATH_INFO: `/v3/users/58f9c80552ab428e81fd38ed6ed79a9c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:28.716991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739eedb-ec34-4a9c-b5c4-d7575fe898ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f9c80552ab428e81fd38ed6ed79a9c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:28.718945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739eedb-ec34-4a9c-b5c4-d7575fe898ee admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:28.767698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6739eedb-ec34-4a9c-b5c4-d7575fe898ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f9c80552ab428e81fd38ed6ed79a9c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:28.774916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6739eedb-ec34-4a9c-b5c4-d7575fe898ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f9c80552ab428e81fd38ed6ed79a9c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:28.775568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6739eedb-ec34-4a9c-b5c4-d7575fe898ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f9c80552ab428e81fd38ed6ed79a9c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:28.782269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6739eedb-ec34-4a9c-b5c4-d7575fe898ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f9c80552ab428e81fd38ed6ed79a9c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:28.793757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6739eedb-ec34-4a9c-b5c4-d7575fe898ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f9c80552ab428e81fd38ed6ed79a9c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:28.800398 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3428/6827] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:08:28 2021] DELETE /identity/v3/users/58f9c80552ab428e81fd38ed6ed79a9c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:28.979373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17428-344a-4537-9d9e-aaaae65e575f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:28.992209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17428-344a-4537-9d9e-aaaae65e575f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:29.058807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:29.059698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:29.059982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:29.060258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] PATH_INFO: `/v3/projects/9e71ba352bc24e6783f74563b7ccef73` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:29.061478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e71ba352bc24e6783f74563b7ccef73)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:29.063418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:29.111760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e71ba352bc24e6783f74563b7ccef73', 'request_id': 'req-850cfe51-0d98-46d0-8676-3e2764917ea8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:29.118141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e71ba352bc24e6783f74563b7ccef73', 'request_id': 'req-850cfe51-0d98-46d0-8676-3e2764917ea8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:29.125496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e71ba352bc24e6783f74563b7ccef73', 'request_id': 'req-850cfe51-0d98-46d0-8676-3e2764917ea8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:29.138829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] The token cache is being invalidate because project 9e71ba352bc24e6783f74563b7ccef73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:08:29.139413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:29.140413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-850cfe51-0d98-46d0-8676-3e2764917ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:29.142222 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3400/6828] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:08:28 2021] DELETE /identity/v3/projects/9e71ba352bc24e6783f74563b7ccef73 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:29.148019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f9e51-8587-4cd6-a884-c96c477ee696 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:29.148337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f9e51-8587-4cd6-a884-c96c477ee696 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:29.148615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f9e51-8587-4cd6-a884-c96c477ee696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:29.167595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-604f9e51-8587-4cd6-a884-c96c477ee696 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:29.168848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-604f9e51-8587-4cd6-a884-c96c477ee696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:29.229514 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3429/6829] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:29.238129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448049-fadb-4565-950b-90ec0866af64 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:29.238420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448049-fadb-4565-950b-90ec0866af64 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:29.238702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448049-fadb-4565-950b-90ec0866af64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:29.256968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0f448049-fadb-4565-950b-90ec0866af64 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:29.258168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0f448049-fadb-4565-950b-90ec0866af64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:29.266258 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3401/6830] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:29.270374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f9e51-8587-4cd6-a884-c96c477ee696 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:29.280485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f9e51-8587-4cd6-a884-c96c477ee696 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:29.285042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3861e-ee50-40ef-8ab4-5becf8674966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:29.285683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3861e-ee50-40ef-8ab4-5becf8674966 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:29.285965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3861e-ee50-40ef-8ab4-5becf8674966 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:29.286239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3861e-ee50-40ef-8ab4-5becf8674966 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:29.286967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3861e-ee50-40ef-8ab4-5becf8674966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:08:29.287299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3861e-ee50-40ef-8ab4-5becf8674966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:29.288930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3861e-ee50-40ef-8ab4-5becf8674966 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:29.300700 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3430/6831] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:08:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:08:29.304764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448049-fadb-4565-950b-90ec0866af64 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:29.313926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448049-fadb-4565-950b-90ec0866af64 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:29.318749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cacbb3-e723-41ab-b700-84ca18acf650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:29.319430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cacbb3-e723-41ab-b700-84ca18acf650 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:29.319725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cacbb3-e723-41ab-b700-84ca18acf650 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:29.320003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cacbb3-e723-41ab-b700-84ca18acf650 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:29.320707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cacbb3-e723-41ab-b700-84ca18acf650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:29.322606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cacbb3-e723-41ab-b700-84ca18acf650 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:29.349456 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3402/6832] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:08:29 2021] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:08:29.353711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3861e-ee50-40ef-8ab4-5becf8674966 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:29.363837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3861e-ee50-40ef-8ab4-5becf8674966 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:29.419432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090cda-6d1b-4079-9d0f-955efd10c7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:29.420093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090cda-6d1b-4079-9d0f-955efd10c7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:29.420390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090cda-6d1b-4079-9d0f-955efd10c7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:29.420667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090cda-6d1b-4079-9d0f-955efd10c7e9 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:29.421369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61090cda-6d1b-4079-9d0f-955efd10c7e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:29.423323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61090cda-6d1b-4079-9d0f-955efd10c7e9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:29.442704 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3431/6833] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:08:29 2021] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:08:29.447023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cacbb3-e723-41ab-b700-84ca18acf650 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:29.457818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cacbb3-e723-41ab-b700-84ca18acf650 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:29.462682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5eeba-98cc-49fe-98eb-b1ec5c08b5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:29.463364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5eeba-98cc-49fe-98eb-b1ec5c08b5cd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:29.463649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5eeba-98cc-49fe-98eb-b1ec5c08b5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:29.463923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5eeba-98cc-49fe-98eb-b1ec5c08b5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:29.464670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5eeba-98cc-49fe-98eb-b1ec5c08b5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:29.466331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5eeba-98cc-49fe-98eb-b1ec5c08b5cd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:29.477549 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3403/6834] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:08:29.481231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090cda-6d1b-4079-9d0f-955efd10c7e9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:29.492368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090cda-6d1b-4079-9d0f-955efd10c7e9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:29.497741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3b72-1c81-4dd2-976f-a66350ca4675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:29.498420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3b72-1c81-4dd2-976f-a66350ca4675 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:29.498737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3b72-1c81-4dd2-976f-a66350ca4675 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:29.499227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3b72-1c81-4dd2-976f-a66350ca4675 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:29.500693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c3b72-1c81-4dd2-976f-a66350ca4675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:29.502455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c3b72-1c81-4dd2-976f-a66350ca4675 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:29.514914 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3432/6835] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:29 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:08:29.519069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5eeba-98cc-49fe-98eb-b1ec5c08b5cd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:29.529065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5eeba-98cc-49fe-98eb-b1ec5c08b5cd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:29.534358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b643cca-c360-46a6-ae7b-b695a156e9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:29.535218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643cca-c360-46a6-ae7b-b695a156e9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:29.535607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643cca-c360-46a6-ae7b-b695a156e9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:29.535906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b643cca-c360-46a6-ae7b-b695a156e9f6 admin admin] PATH_INFO: `/v3/projects/e50ca5bbf0334faa9bad45c847b7301c/users/0bdcce84821340f3ab7c663e137d09fc/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:29.551296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b643cca-c360-46a6-ae7b-b695a156e9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50ca5bbf0334faa9bad45c847b7301c, user_id=0bdcce84821340f3ab7c663e137d09fc, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:29.553863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b643cca-c360-46a6-ae7b-b695a156e9f6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:29.566982 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3404/6836] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:08:29 2021] PUT /identity/v3/projects/e50ca5bbf0334faa9bad45c847b7301c/users/0bdcce84821340f3ab7c663e137d09fc/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:29.572138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3642-4bf0-4276-8b77-686d176175bf None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:29.572423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3642-4bf0-4276-8b77-686d176175bf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:29.572695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3642-4bf0-4276-8b77-686d176175bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:29.590449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fc6c3642-4bf0-4276-8b77-686d176175bf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:29.591658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fc6c3642-4bf0-4276-8b77-686d176175bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:29.647734 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3433/6837] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:08:29.658138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b643cca-c360-46a6-ae7b-b695a156e9f6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:29.659916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0b643cca-c360-46a6-ae7b-b695a156e9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:29.716646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b643cca-c360-46a6-ae7b-b695a156e9f6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:29.720306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb981d6-6ddb-4082-ba48-972825f2c0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:29.721015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb981d6-6ddb-4082-ba48-972825f2c0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:29.721218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb981d6-6ddb-4082-ba48-972825f2c0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:29.721485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb981d6-6ddb-4082-ba48-972825f2c0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:29.730245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb981d6-6ddb-4082-ba48-972825f2c0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:29.731749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb981d6-6ddb-4082-ba48-972825f2c0b4 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:29.740948 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3405/6838] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:30.511923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c162-91a2-41e6-b57e-3fc0a27a7e87 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:30.512208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c162-91a2-41e6-b57e-3fc0a27a7e87 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:30.512482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478c162-91a2-41e6-b57e-3fc0a27a7e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:30.540137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d478c162-91a2-41e6-b57e-3fc0a27a7e87 None None] MFA Rules not processed for user `0bdcce84821340f3ab7c663e137d09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:30.541336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d478c162-91a2-41e6-b57e-3fc0a27a7e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:30.613708 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3434/6839] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:30 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:30.624465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db36a9c-223c-445a-b62c-caf558cc05f7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:30.625015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db36a9c-223c-445a-b62c-caf558cc05f7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:30.625015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db36a9c-223c-445a-b62c-caf558cc05f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:30.642518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1db36a9c-223c-445a-b62c-caf558cc05f7 None None] MFA Rules not processed for user `0bdcce84821340f3ab7c663e137d09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:30.643692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1db36a9c-223c-445a-b62c-caf558cc05f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:30.650854 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3406/6840] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:30 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:30.663170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478c162-91a2-41e6-b57e-3fc0a27a7e87 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:30.664882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d478c162-91a2-41e6-b57e-3fc0a27a7e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:30.740589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478c162-91a2-41e6-b57e-3fc0a27a7e87 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:30.746331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e2a85-7265-4f44-b599-f7394e4ba738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:30.746979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e2a85-7265-4f44-b599-f7394e4ba738 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:30.747274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e2a85-7265-4f44-b599-f7394e4ba738 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:30.747575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e2a85-7265-4f44-b599-f7394e4ba738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:30.755130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e2a85-7265-4f44-b599-f7394e4ba738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:30.756752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e2a85-7265-4f44-b599-f7394e4ba738 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:30.766137 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3435/6841] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:30 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:31.052854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db36a9c-223c-445a-b62c-caf558cc05f7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:31.054718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1db36a9c-223c-445a-b62c-caf558cc05f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:31.073022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db36a9c-223c-445a-b62c-caf558cc05f7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:31.079576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19633263-2f68-4461-9b5d-f1214ce9111c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:31.080222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19633263-2f68-4461-9b5d-f1214ce9111c service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:31.080504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19633263-2f68-4461-9b5d-f1214ce9111c service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:31.080777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19633263-2f68-4461-9b5d-f1214ce9111c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:31.082539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-19633263-2f68-4461-9b5d-f1214ce9111c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:31.169165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19633263-2f68-4461-9b5d-f1214ce9111c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:31.170770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19633263-2f68-4461-9b5d-f1214ce9111c service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:31.191345 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3407/6842] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:31 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:33.402086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e2a85-7265-4f44-b599-f7394e4ba738 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:33.405093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ed5e2a85-7265-4f44-b599-f7394e4ba738 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:33.428696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e2a85-7265-4f44-b599-f7394e4ba738 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:33.436955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12503a40-c055-4f2f-bc5d-a99ae933493a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:33.437960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503a40-c055-4f2f-bc5d-a99ae933493a service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:33.438469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503a40-c055-4f2f-bc5d-a99ae933493a service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:33.438995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12503a40-c055-4f2f-bc5d-a99ae933493a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:33.447511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-12503a40-c055-4f2f-bc5d-a99ae933493a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:33.537582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12503a40-c055-4f2f-bc5d-a99ae933493a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:33.539202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12503a40-c055-4f2f-bc5d-a99ae933493a service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:33.550826 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3436/6843] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:33 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:08:39.584805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19633263-2f68-4461-9b5d-f1214ce9111c service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:39.586800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-19633263-2f68-4461-9b5d-f1214ce9111c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:39.693220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19633263-2f68-4461-9b5d-f1214ce9111c service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:39.698551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7984b-5593-4fbf-8505-9cf2888b90c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:39.699216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7984b-5593-4fbf-8505-9cf2888b90c4 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:39.699543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7984b-5593-4fbf-8505-9cf2888b90c4 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:39.699873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7984b-5593-4fbf-8505-9cf2888b90c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:39.701807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0eb7984b-5593-4fbf-8505-9cf2888b90c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:39.716785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7984b-5593-4fbf-8505-9cf2888b90c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:39.719112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7984b-5593-4fbf-8505-9cf2888b90c4 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:39.747913 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3408/6844] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:44.161245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e2ed1-5f5a-428d-b807-6d68b11ee902 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:44.161804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e2ed1-5f5a-428d-b807-6d68b11ee902 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:44.161804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e2ed1-5f5a-428d-b807-6d68b11ee902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:44.181253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-536e2ed1-5f5a-428d-b807-6d68b11ee902 None None] MFA Rules not processed for user `0bdcce84821340f3ab7c663e137d09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:44.182476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-536e2ed1-5f5a-428d-b807-6d68b11ee902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:44.193859 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3437/6845] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:44 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:44.892301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0133-8e6a-43a4-8894-25bfff87f19c None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:44.893728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0133-8e6a-43a4-8894-25bfff87f19c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:44.894071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f0133-8e6a-43a4-8894-25bfff87f19c None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:44.896446 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3409/6846] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 21:08:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:08:44.902666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed580d-a4a9-4256-afc3-5e58212987dd None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:44.902889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed580d-a4a9-4256-afc3-5e58212987dd None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:44.903593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed580d-a4a9-4256-afc3-5e58212987dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:44.943574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e9ed580d-a4a9-4256-afc3-5e58212987dd None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:44.944906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e9ed580d-a4a9-4256-afc3-5e58212987dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:44.954803 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3438/6847] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:08:44 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:44.978322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0133-8e6a-43a4-8894-25bfff87f19c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:45.003747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f0133-8e6a-43a4-8894-25bfff87f19c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:45.009913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f3e43-f63c-4769-8a33-0e96339f0827 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:45.010583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3e43-f63c-4769-8a33-0e96339f0827 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:45.010937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3e43-f63c-4769-8a33-0e96339f0827 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:45.011316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f3e43-f63c-4769-8a33-0e96339f0827 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:45.021812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f3e43-f63c-4769-8a33-0e96339f0827 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:45.023643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f3e43-f63c-4769-8a33-0e96339f0827 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:45.034354 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3410/6848] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:44 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:45.043298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed580d-a4a9-4256-afc3-5e58212987dd None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:45.046285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e9ed580d-a4a9-4256-afc3-5e58212987dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:45.062687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed580d-a4a9-4256-afc3-5e58212987dd None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:45.068127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b18e33-e814-4341-9e35-72d27ae2c0d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:45.068803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b18e33-e814-4341-9e35-72d27ae2c0d6 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:45.069097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b18e33-e814-4341-9e35-72d27ae2c0d6 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:45.069375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b18e33-e814-4341-9e35-72d27ae2c0d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:45.071117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-68b18e33-e814-4341-9e35-72d27ae2c0d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:45.086834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b18e33-e814-4341-9e35-72d27ae2c0d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:45.088540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b18e33-e814-4341-9e35-72d27ae2c0d6 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:45.101339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d06a1-dbed-49a3-a4b1-2a288c54beb8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:45.101634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d06a1-dbed-49a3-a4b1-2a288c54beb8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:45.101926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d06a1-dbed-49a3-a4b1-2a288c54beb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:45.102064 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3439/6849] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:45 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:45.120783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-931d06a1-dbed-49a3-a4b1-2a288c54beb8 None None] MFA Rules not processed for user `0bdcce84821340f3ab7c663e137d09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:45.121991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-931d06a1-dbed-49a3-a4b1-2a288c54beb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:45.129709 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3411/6850] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:45 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:08:47.799713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b18e33-e814-4341-9e35-72d27ae2c0d6 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:47.811877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b18e33-e814-4341-9e35-72d27ae2c0d6 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:47.815680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9195969-b769-4d62-8c42-76e56f8eb1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:47.816660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9195969-b769-4d62-8c42-76e56f8eb1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:47.817131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9195969-b769-4d62-8c42-76e56f8eb1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:47.817403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9195969-b769-4d62-8c42-76e56f8eb1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:47.819466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e9195969-b769-4d62-8c42-76e56f8eb1d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:47.835244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9195969-b769-4d62-8c42-76e56f8eb1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:47.836847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9195969-b769-4d62-8c42-76e56f8eb1d2 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:47.853135 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3440/6851] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:55.251054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d06a1-dbed-49a3-a4b1-2a288c54beb8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:55.252513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-931d06a1-dbed-49a3-a4b1-2a288c54beb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:55.275108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d06a1-dbed-49a3-a4b1-2a288c54beb8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:55.280516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:55.281463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:55.281822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:55.282168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] PATH_INFO: `/v3/users/8e7695cf8df749e9af62b1746e818ea3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:55.283488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e7695cf8df749e9af62b1746e818ea3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:55.285502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:55.345217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e7695cf8df749e9af62b1746e818ea3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.346089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e7695cf8df749e9af62b1746e818ea3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.354195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e7695cf8df749e9af62b1746e818ea3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.355107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e7695cf8df749e9af62b1746e818ea3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.363831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e7695cf8df749e9af62b1746e818ea3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.382612 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3412/6852] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:08:55 2021] DELETE /identity/v3/users/8e7695cf8df749e9af62b1746e818ea3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:55.612128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9195969-b769-4d62-8c42-76e56f8eb1d2 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:55.629142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9195969-b769-4d62-8c42-76e56f8eb1d2 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:55.689918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:55.690774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:55.691053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:55.691357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] PATH_INFO: `/v3/projects/c03be159839446f2a47ca07f13bb552c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:55.692537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03be159839446f2a47ca07f13bb552c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:55.694449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:55.743690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03be159839446f2a47ca07f13bb552c', 'request_id': 'req-7fb0c3fc-06f3-463b-8145-960c8749d1bc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.751310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03be159839446f2a47ca07f13bb552c', 'request_id': 'req-7fb0c3fc-06f3-463b-8145-960c8749d1bc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.757465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03be159839446f2a47ca07f13bb552c', 'request_id': 'req-7fb0c3fc-06f3-463b-8145-960c8749d1bc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.768582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] The token cache is being invalidate because project c03be159839446f2a47ca07f13bb552c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:08:55.768881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.769539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.771117 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3441/6853] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:08:55 2021] DELETE /identity/v3/projects/c03be159839446f2a47ca07f13bb552c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:55.775071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:55.776570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:55.792415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71159bcf-98ca-49ff-9e75-a220eeb66e8f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:55.848404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a76206-62dc-4abf-9604-ca050a926c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:55.849273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a76206-62dc-4abf-9604-ca050a926c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:55.849550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a76206-62dc-4abf-9604-ca050a926c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:55.849820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a76206-62dc-4abf-9604-ca050a926c75 admin admin] PATH_INFO: `/v3/users/8a6b24888695498b9b368d5f906b0926` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:55.863183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a76206-62dc-4abf-9604-ca050a926c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a6b24888695498b9b368d5f906b0926)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:55.865178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a76206-62dc-4abf-9604-ca050a926c75 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:55.912145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-62a76206-62dc-4abf-9604-ca050a926c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a6b24888695498b9b368d5f906b0926'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.912816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-62a76206-62dc-4abf-9604-ca050a926c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a6b24888695498b9b368d5f906b0926'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.920890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-62a76206-62dc-4abf-9604-ca050a926c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a6b24888695498b9b368d5f906b0926'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.921617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-62a76206-62dc-4abf-9604-ca050a926c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a6b24888695498b9b368d5f906b0926'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.928981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-62a76206-62dc-4abf-9604-ca050a926c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a6b24888695498b9b368d5f906b0926'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:55.949867 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3413/6854] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:08:55 2021] DELETE /identity/v3/users/8a6b24888695498b9b368d5f906b0926 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:56.161742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:56.163422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:56.190166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0c3fc-06f3-463b-8145-960c8749d1bc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:56.261988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:56.263564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:56.264400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:56.264666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] PATH_INFO: `/v3/projects/441ce7b15a1a4d9bb575c26f6393b942` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:56.276806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=441ce7b15a1a4d9bb575c26f6393b942)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:56.279166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:56.329865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441ce7b15a1a4d9bb575c26f6393b942', 'request_id': 'req-22021d12-7860-4229-8848-fb3eda9dab84'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:56.342319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441ce7b15a1a4d9bb575c26f6393b942', 'request_id': 'req-22021d12-7860-4229-8848-fb3eda9dab84'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:56.350667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441ce7b15a1a4d9bb575c26f6393b942', 'request_id': 'req-22021d12-7860-4229-8848-fb3eda9dab84'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:56.363118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] The token cache is being invalidate because project 441ce7b15a1a4d9bb575c26f6393b942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:08:56.363636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:56.364475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-22021d12-7860-4229-8848-fb3eda9dab84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:08:56.366476 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3442/6855] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:08:56 2021] DELETE /identity/v3/projects/441ce7b15a1a4d9bb575c26f6393b942 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:56.372560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390d5f6-72d1-4922-b719-52da33f419f1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:56.373735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390d5f6-72d1-4922-b719-52da33f419f1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:56.373842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390d5f6-72d1-4922-b719-52da33f419f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:56.397231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1390d5f6-72d1-4922-b719-52da33f419f1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:56.398796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1390d5f6-72d1-4922-b719-52da33f419f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:56.473258 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3414/6856] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:56.481324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab99e-3bdc-4ffc-819e-a5cf6dd4ea1a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:56.481666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab99e-3bdc-4ffc-819e-a5cf6dd4ea1a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:56.481943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffab99e-3bdc-4ffc-819e-a5cf6dd4ea1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:56.501270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4ffab99e-3bdc-4ffc-819e-a5cf6dd4ea1a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:56.502469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4ffab99e-3bdc-4ffc-819e-a5cf6dd4ea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:56.510610 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3443/6857] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:08:56.516738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390d5f6-72d1-4922-b719-52da33f419f1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:56.527578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390d5f6-72d1-4922-b719-52da33f419f1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:56.532948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade48c05-e376-423d-85e2-7141d8bcc288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:56.533575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade48c05-e376-423d-85e2-7141d8bcc288 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:56.534090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade48c05-e376-423d-85e2-7141d8bcc288 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:56.534371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade48c05-e376-423d-85e2-7141d8bcc288 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:56.535109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade48c05-e376-423d-85e2-7141d8bcc288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:08:56.535612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade48c05-e376-423d-85e2-7141d8bcc288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:56.537282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade48c05-e376-423d-85e2-7141d8bcc288 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:56.551375 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3415/6858] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:08:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:08:56.555785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffab99e-3bdc-4ffc-819e-a5cf6dd4ea1a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:56.568036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffab99e-3bdc-4ffc-819e-a5cf6dd4ea1a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:56.575646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1388cd1-a2f2-410d-8273-ae0f865f6f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:56.578336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1388cd1-a2f2-410d-8273-ae0f865f6f3b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:56.578625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1388cd1-a2f2-410d-8273-ae0f865f6f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:56.578897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1388cd1-a2f2-410d-8273-ae0f865f6f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:56.579635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1388cd1-a2f2-410d-8273-ae0f865f6f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:56.582844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1388cd1-a2f2-410d-8273-ae0f865f6f3b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:56.615352 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3444/6859] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:08:56 2021] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:08:56.616628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade48c05-e376-423d-85e2-7141d8bcc288 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:56.628700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade48c05-e376-423d-85e2-7141d8bcc288 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:56.689765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ece10-4a5f-4fd5-b880-383f7e022875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:56.690428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ece10-4a5f-4fd5-b880-383f7e022875 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:56.690847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ece10-4a5f-4fd5-b880-383f7e022875 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:56.691119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ece10-4a5f-4fd5-b880-383f7e022875 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:56.692050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ece10-4a5f-4fd5-b880-383f7e022875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:56.694000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ece10-4a5f-4fd5-b880-383f7e022875 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:56.727447 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3416/6860] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:08:56 2021] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:08:56.730000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1388cd1-a2f2-410d-8273-ae0f865f6f3b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:56.742400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1388cd1-a2f2-410d-8273-ae0f865f6f3b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:56.749537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafab031-2e80-4543-b41f-49b6ebc985d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:56.750209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafab031-2e80-4543-b41f-49b6ebc985d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:56.750676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafab031-2e80-4543-b41f-49b6ebc985d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:56.750958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafab031-2e80-4543-b41f-49b6ebc985d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:56.751745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafab031-2e80-4543-b41f-49b6ebc985d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:56.753386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafab031-2e80-4543-b41f-49b6ebc985d5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:56.765861 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3445/6861] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:56 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:08:56.769902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ece10-4a5f-4fd5-b880-383f7e022875 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:56.780711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ece10-4a5f-4fd5-b880-383f7e022875 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:56.786217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2031d-bc8b-4ac9-8439-d53fdaa7e8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:56.786813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2031d-bc8b-4ac9-8439-d53fdaa7e8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:56.787093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2031d-bc8b-4ac9-8439-d53fdaa7e8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:56.787421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2031d-bc8b-4ac9-8439-d53fdaa7e8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:56.788145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2031d-bc8b-4ac9-8439-d53fdaa7e8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:56.789754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2031d-bc8b-4ac9-8439-d53fdaa7e8e0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:56.802646 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3417/6862] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:08:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:08:56.806435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafab031-2e80-4543-b41f-49b6ebc985d5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:56.816963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafab031-2e80-4543-b41f-49b6ebc985d5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:56.821960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ba56-ee41-4659-86bb-08d3ec5a2845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:56.822927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ba56-ee41-4659-86bb-08d3ec5a2845 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:56.823326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ba56-ee41-4659-86bb-08d3ec5a2845 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:56.823784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37ba56-ee41-4659-86bb-08d3ec5a2845 admin admin] PATH_INFO: `/v3/projects/4c38c1fb709545fbb6279c9ee1dafe5d/users/43d9798c04074bc9ac45eb33bf3adb46/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:56.840798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37ba56-ee41-4659-86bb-08d3ec5a2845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c38c1fb709545fbb6279c9ee1dafe5d, user_id=43d9798c04074bc9ac45eb33bf3adb46, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:56.844901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37ba56-ee41-4659-86bb-08d3ec5a2845 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:56.859488 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3446/6863] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:08:56 2021] PUT /identity/v3/projects/4c38c1fb709545fbb6279c9ee1dafe5d/users/43d9798c04074bc9ac45eb33bf3adb46/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:08:56.864621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041311-1de3-4cf4-b5b1-1b1a59a251a3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:56.864910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041311-1de3-4cf4-b5b1-1b1a59a251a3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:56.865237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4041311-1de3-4cf4-b5b1-1b1a59a251a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:56.883972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b4041311-1de3-4cf4-b5b1-1b1a59a251a3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:56.885176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b4041311-1de3-4cf4-b5b1-1b1a59a251a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:56.948366 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3418/6864] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:08:56.957956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ba56-ee41-4659-86bb-08d3ec5a2845 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:08:56.960360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6f37ba56-ee41-4659-86bb-08d3ec5a2845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:57.027886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37ba56-ee41-4659-86bb-08d3ec5a2845 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:08:57.032900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e8ed0-6e57-41da-92cc-45c1e9f3c553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:08:57.033939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e8ed0-6e57-41da-92cc-45c1e9f3c553 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:57.034298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e8ed0-6e57-41da-92cc-45c1e9f3c553 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:57.034647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e8ed0-6e57-41da-92cc-45c1e9f3c553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:57.044204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e8ed0-6e57-41da-92cc-45c1e9f3c553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:08:57.045865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e8ed0-6e57-41da-92cc-45c1e9f3c553 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:08:57.056517 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3447/6865] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:08:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:08:59.284349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b67a27-ea75-4d13-8c02-e82008f2cac2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:59.285045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b67a27-ea75-4d13-8c02-e82008f2cac2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:59.285045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b67a27-ea75-4d13-8c02-e82008f2cac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:59.308186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b9b67a27-ea75-4d13-8c02-e82008f2cac2 None None] MFA Rules not processed for user `0bdcce84821340f3ab7c663e137d09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:59.309390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b9b67a27-ea75-4d13-8c02-e82008f2cac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:59.384551 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3419/6866] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:59 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:08:59.833061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f86f9-0d09-43e0-9972-079c856d9204 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:08:59.833534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f86f9-0d09-43e0-9972-079c856d9204 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:08:59.833622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f86f9-0d09-43e0-9972-079c856d9204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:08:59.866404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1e8f86f9-0d09-43e0-9972-079c856d9204 None None] MFA Rules not processed for user `67ee436ffe774a1eb71cdb910112c7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:08:59.869840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1e8f86f9-0d09-43e0-9972-079c856d9204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:08:59.990176 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3448/6867] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:08:59 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:09:03.875462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119d410-df4f-488f-a177-959990019a3d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:09:03.876519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119d410-df4f-488f-a177-959990019a3d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:09:03.877085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119d410-df4f-488f-a177-959990019a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:09:03.927718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2119d410-df4f-488f-a177-959990019a3d None None] MFA Rules not processed for user `43d9798c04074bc9ac45eb33bf3adb46`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:09:03.929428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2119d410-df4f-488f-a177-959990019a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:04.022922 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3420/6868] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:09:03 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:09:04.038594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f86f9-0d09-43e0-9972-079c856d9204 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:09:04.041281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1e8f86f9-0d09-43e0-9972-079c856d9204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:04.146218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f86f9-0d09-43e0-9972-079c856d9204 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:09:04.157101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cff86f-7806-41ad-9c38-88939fc8b355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:09:04.160392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cff86f-7806-41ad-9c38-88939fc8b355 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:09:04.160842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cff86f-7806-41ad-9c38-88939fc8b355 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:09:04.161265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cff86f-7806-41ad-9c38-88939fc8b355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:09:04.184523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cff86f-7806-41ad-9c38-88939fc8b355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:09:04.186677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cff86f-7806-41ad-9c38-88939fc8b355 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:09:04.220831 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3449/6869] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:09:04 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:09:07.087537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23210b-f43a-4dbf-8a0a-b7d7b635a7dc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:09:07.088025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23210b-f43a-4dbf-8a0a-b7d7b635a7dc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:09:07.088214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23210b-f43a-4dbf-8a0a-b7d7b635a7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:09:07.114886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cf23210b-f43a-4dbf-8a0a-b7d7b635a7dc None None] MFA Rules not processed for user `43d9798c04074bc9ac45eb33bf3adb46`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:09:07.116123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cf23210b-f43a-4dbf-8a0a-b7d7b635a7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:07.124265 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3421/6870] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:09:07 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:09:13.039916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cff86f-7806-41ad-9c38-88939fc8b355 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:09:13.052165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cff86f-7806-41ad-9c38-88939fc8b355 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:09:13.055871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b3fa49-3c8c-48d9-acf6-ed811143999b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:09:13.056515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3fa49-3c8c-48d9-acf6-ed811143999b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:09:13.056807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3fa49-3c8c-48d9-acf6-ed811143999b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:09:13.057085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3fa49-3c8c-48d9-acf6-ed811143999b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:09:13.058908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-33b3fa49-3c8c-48d9-acf6-ed811143999b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:13.070694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3fa49-3c8c-48d9-acf6-ed811143999b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:09:13.072292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b3fa49-3c8c-48d9-acf6-ed811143999b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:09:13.081262 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3450/6871] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:09:13 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:09:15.056745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5850140-4cc7-44ea-a764-ca5d4cf15276 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:09:15.057329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5850140-4cc7-44ea-a764-ca5d4cf15276 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:09:15.057329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5850140-4cc7-44ea-a764-ca5d4cf15276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:09:15.074538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f5850140-4cc7-44ea-a764-ca5d4cf15276 None None] MFA Rules not processed for user `0bdcce84821340f3ab7c663e137d09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:09:15.076280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f5850140-4cc7-44ea-a764-ca5d4cf15276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:15.083358 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3422/6872] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:09:15 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:09:24.291508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c2c7-4602-49a0-9b2e-8ddc2b03987c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:09:24.292038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c2c7-4602-49a0-9b2e-8ddc2b03987c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:09:24.292150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8c2c7-4602-49a0-9b2e-8ddc2b03987c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:09:24.310840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2de8c2c7-4602-49a0-9b2e-8ddc2b03987c None None] MFA Rules not processed for user `0bdcce84821340f3ab7c663e137d09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:09:24.311968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2de8c2c7-4602-49a0-9b2e-8ddc2b03987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:24.318813 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3451/6873] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:09:24 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:09:24.571561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5850140-4cc7-44ea-a764-ca5d4cf15276 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:09:24.572895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f5850140-4cc7-44ea-a764-ca5d4cf15276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:24.586807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5850140-4cc7-44ea-a764-ca5d4cf15276 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:09:24.590382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c86a3a-191c-4fcb-b9ac-7ebfd3a7d263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:09:24.591541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c86a3a-191c-4fcb-b9ac-7ebfd3a7d263 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:09:24.591823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c86a3a-191c-4fcb-b9ac-7ebfd3a7d263 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:09:24.592101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c86a3a-191c-4fcb-b9ac-7ebfd3a7d263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:09:24.593798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-16c86a3a-191c-4fcb-b9ac-7ebfd3a7d263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:24.607399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c86a3a-191c-4fcb-b9ac-7ebfd3a7d263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:09:24.608840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c86a3a-191c-4fcb-b9ac-7ebfd3a7d263 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:09:24.618707 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3423/6874] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:09:24 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:09:25.360791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c2c7-4602-49a0-9b2e-8ddc2b03987c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:09:25.362185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2de8c2c7-4602-49a0-9b2e-8ddc2b03987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:25.430674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8c2c7-4602-49a0-9b2e-8ddc2b03987c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:09:25.436729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddddcc-8e1a-4cb2-a044-03ab6c15e455 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:09:25.437415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddddcc-8e1a-4cb2-a044-03ab6c15e455 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:09:25.437708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddddcc-8e1a-4cb2-a044-03ab6c15e455 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:09:25.437981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddddcc-8e1a-4cb2-a044-03ab6c15e455 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:09:25.439790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cfddddcc-8e1a-4cb2-a044-03ab6c15e455 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:25.454263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddddcc-8e1a-4cb2-a044-03ab6c15e455 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:09:25.455891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddddcc-8e1a-4cb2-a044-03ab6c15e455 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:09:25.467571 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3452/6875] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:09:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:09:43.057775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1d8e-c78e-4118-a5f5-3bdb194d638f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:09:43.058323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1d8e-c78e-4118-a5f5-3bdb194d638f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:09:43.058435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1d8e-c78e-4118-a5f5-3bdb194d638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:09:43.076045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-807f1d8e-c78e-4118-a5f5-3bdb194d638f None None] MFA Rules not processed for user `0bdcce84821340f3ab7c663e137d09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:09:43.077218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-807f1d8e-c78e-4118-a5f5-3bdb194d638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:43.084068 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3424/6876] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:09:43 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:09:59.496069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adc6eb-d560-4ce7-82d2-684bddafa2d6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:09:59.496547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adc6eb-d560-4ce7-82d2-684bddafa2d6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:09:59.496655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adc6eb-d560-4ce7-82d2-684bddafa2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:09:59.514499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-49adc6eb-d560-4ce7-82d2-684bddafa2d6 None None] MFA Rules not processed for user `0bdcce84821340f3ab7c663e137d09fc`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:09:59.515732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-49adc6eb-d560-4ce7-82d2-684bddafa2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:09:59.522600 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3453/6877] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:09:59 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:10:09.046520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1d8e-c78e-4118-a5f5-3bdb194d638f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:09.061900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1d8e-c78e-4118-a5f5-3bdb194d638f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:09.067380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbd4e2-70d1-411b-ad8a-4b6db51bea88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:09.068016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbd4e2-70d1-411b-ad8a-4b6db51bea88 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:09.068308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbd4e2-70d1-411b-ad8a-4b6db51bea88 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:09.068585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbd4e2-70d1-411b-ad8a-4b6db51bea88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:09.070381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6adbd4e2-70d1-411b-ad8a-4b6db51bea88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:09.080722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbd4e2-70d1-411b-ad8a-4b6db51bea88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:09.082319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbd4e2-70d1-411b-ad8a-4b6db51bea88 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:09.092385 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3425/6878] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:10:09 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:10:32.308978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adc6eb-d560-4ce7-82d2-684bddafa2d6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:32.321322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adc6eb-d560-4ce7-82d2-684bddafa2d6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:32.325014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29df7-82c7-4c09-803a-b8ef867d6d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:32.325646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29df7-82c7-4c09-803a-b8ef867d6d76 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:32.325926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29df7-82c7-4c09-803a-b8ef867d6d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:32.326199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29df7-82c7-4c09-803a-b8ef867d6d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:32.328509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4de29df7-82c7-4c09-803a-b8ef867d6d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:32.344856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de29df7-82c7-4c09-803a-b8ef867d6d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:32.346352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de29df7-82c7-4c09-803a-b8ef867d6d76 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:32.359587 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3454/6879] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:10:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:10:38.932349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbd4e2-70d1-411b-ad8a-4b6db51bea88 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:38.943922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbd4e2-70d1-411b-ad8a-4b6db51bea88 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:38.947480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc24ce-2b1f-4797-add7-7a2a102803cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:38.948111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc24ce-2b1f-4797-add7-7a2a102803cd service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:38.948392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc24ce-2b1f-4797-add7-7a2a102803cd service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:38.948668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc24ce-2b1f-4797-add7-7a2a102803cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:38.950415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-03dc24ce-2b1f-4797-add7-7a2a102803cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:38.966608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc24ce-2b1f-4797-add7-7a2a102803cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:38.968721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc24ce-2b1f-4797-add7-7a2a102803cd service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:38.982410 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3426/6880] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:10:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:10:45.077531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29df7-82c7-4c09-803a-b8ef867d6d76 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:45.078990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4de29df7-82c7-4c09-803a-b8ef867d6d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:45.094561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29df7-82c7-4c09-803a-b8ef867d6d76 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:45.100122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ffae7-a290-4f83-a80f-b16e314668b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:45.101083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ffae7-a290-4f83-a80f-b16e314668b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:45.101267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ffae7-a290-4f83-a80f-b16e314668b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:45.101594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ffae7-a290-4f83-a80f-b16e314668b2 admin admin] PATH_INFO: `/v3/users/0bdcce84821340f3ab7c663e137d09fc` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:45.102736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ffae7-a290-4f83-a80f-b16e314668b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bdcce84821340f3ab7c663e137d09fc)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:45.104840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ffae7-a290-4f83-a80f-b16e314668b2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:45.151025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b19ffae7-a290-4f83-a80f-b16e314668b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bdcce84821340f3ab7c663e137d09fc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:45.158063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b19ffae7-a290-4f83-a80f-b16e314668b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bdcce84821340f3ab7c663e137d09fc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:45.158689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b19ffae7-a290-4f83-a80f-b16e314668b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bdcce84821340f3ab7c663e137d09fc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:45.165450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b19ffae7-a290-4f83-a80f-b16e314668b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bdcce84821340f3ab7c663e137d09fc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:45.177216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b19ffae7-a290-4f83-a80f-b16e314668b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bdcce84821340f3ab7c663e137d09fc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:45.182953 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3455/6881] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:10:45 2021] DELETE /identity/v3/users/0bdcce84821340f3ab7c663e137d09fc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:45.356907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc24ce-2b1f-4797-add7-7a2a102803cd service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:45.375642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc24ce-2b1f-4797-add7-7a2a102803cd service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:45.439639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:45.440489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:45.440764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:45.441034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] PATH_INFO: `/v3/projects/e50ca5bbf0334faa9bad45c847b7301c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:45.442220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50ca5bbf0334faa9bad45c847b7301c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:45.444173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:45.488621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50ca5bbf0334faa9bad45c847b7301c', 'request_id': 'req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:45.495128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50ca5bbf0334faa9bad45c847b7301c', 'request_id': 'req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:45.501853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50ca5bbf0334faa9bad45c847b7301c', 'request_id': 'req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:45.511925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] The token cache is being invalidate because project e50ca5bbf0334faa9bad45c847b7301c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:45.512208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:45.512840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cfca009c-2cd9-42a8-b7b1-2ecdcd8922dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:45.514370 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3427/6882] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:45 2021] DELETE /identity/v3/projects/e50ca5bbf0334faa9bad45c847b7301c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:45.520269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058c24-ce3c-4be5-af5a-df6cc3e1e2be None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:45.520559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058c24-ce3c-4be5-af5a-df6cc3e1e2be None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:45.520837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058c24-ce3c-4be5-af5a-df6cc3e1e2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:45.539109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7f058c24-ce3c-4be5-af5a-df6cc3e1e2be None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:45.540387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7f058c24-ce3c-4be5-af5a-df6cc3e1e2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:45.597209 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3456/6883] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:10:45.605377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b569ca-37fd-416d-8724-161eb0bce08e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:45.605659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b569ca-37fd-416d-8724-161eb0bce08e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:45.605934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b569ca-37fd-416d-8724-161eb0bce08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:45.625144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-37b569ca-37fd-416d-8724-161eb0bce08e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:45.626331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-37b569ca-37fd-416d-8724-161eb0bce08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:45.634082 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3428/6884] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:10:45.638149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058c24-ce3c-4be5-af5a-df6cc3e1e2be None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:45.647677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058c24-ce3c-4be5-af5a-df6cc3e1e2be None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:45.652670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5852df-9f5e-4a7b-a0f2-ab11365f2396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:45.653310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5852df-9f5e-4a7b-a0f2-ab11365f2396 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:45.653589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5852df-9f5e-4a7b-a0f2-ab11365f2396 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:45.653862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5852df-9f5e-4a7b-a0f2-ab11365f2396 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:45.655114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5852df-9f5e-4a7b-a0f2-ab11365f2396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:10:45.655452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5852df-9f5e-4a7b-a0f2-ab11365f2396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:45.657038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5852df-9f5e-4a7b-a0f2-ab11365f2396 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:45.668640 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3457/6885] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:10:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:45.673366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b569ca-37fd-416d-8724-161eb0bce08e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:45.682400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b569ca-37fd-416d-8724-161eb0bce08e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:45.686949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4a197-eddf-4b05-8241-30eb6ac9caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:45.687616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4a197-eddf-4b05-8241-30eb6ac9caae admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:45.687894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4a197-eddf-4b05-8241-30eb6ac9caae admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:45.688166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4a197-eddf-4b05-8241-30eb6ac9caae admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:45.688859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4a197-eddf-4b05-8241-30eb6ac9caae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:45.690737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4a197-eddf-4b05-8241-30eb6ac9caae admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:45.726029 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3429/6886] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:45 2021] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:45.730007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5852df-9f5e-4a7b-a0f2-ab11365f2396 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:45.739937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5852df-9f5e-4a7b-a0f2-ab11365f2396 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:45.794288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c5b3-d2a1-4669-bf79-37d1425b646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:45.794973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c5b3-d2a1-4669-bf79-37d1425b646a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:45.795276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c5b3-d2a1-4669-bf79-37d1425b646a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:45.795567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c5b3-d2a1-4669-bf79-37d1425b646a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:45.796267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0c5b3-d2a1-4669-bf79-37d1425b646a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:45.798156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0c5b3-d2a1-4669-bf79-37d1425b646a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:45.820877 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3458/6887] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:10:45 2021] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:45.822065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4a197-eddf-4b05-8241-30eb6ac9caae admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:45.832748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4a197-eddf-4b05-8241-30eb6ac9caae admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:45.837315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53a173-f65c-405a-a3d7-0f7b6dcc5123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:45.837966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53a173-f65c-405a-a3d7-0f7b6dcc5123 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:45.838247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53a173-f65c-405a-a3d7-0f7b6dcc5123 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:45.838520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53a173-f65c-405a-a3d7-0f7b6dcc5123 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:45.839301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53a173-f65c-405a-a3d7-0f7b6dcc5123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:45.840901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53a173-f65c-405a-a3d7-0f7b6dcc5123 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:45.851112 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3430/6888] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:10:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:10:45.854828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c5b3-d2a1-4669-bf79-37d1425b646a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:45.864828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c5b3-d2a1-4669-bf79-37d1425b646a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:45.869739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31d9e7-8bfa-4eb1-b4d8-a11f5bb4af42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:45.870383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31d9e7-8bfa-4eb1-b4d8-a11f5bb4af42 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:45.870665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31d9e7-8bfa-4eb1-b4d8-a11f5bb4af42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:45.870941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31d9e7-8bfa-4eb1-b4d8-a11f5bb4af42 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:45.871701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31d9e7-8bfa-4eb1-b4d8-a11f5bb4af42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:45.873334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31d9e7-8bfa-4eb1-b4d8-a11f5bb4af42 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:45.882862 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3459/6889] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:10:45 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:10:45.886694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53a173-f65c-405a-a3d7-0f7b6dcc5123 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:45.897020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53a173-f65c-405a-a3d7-0f7b6dcc5123 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:45.901565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc384d-8be7-40d3-8d93-617953bdc689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:45.902422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc384d-8be7-40d3-8d93-617953bdc689 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:45.902704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc384d-8be7-40d3-8d93-617953bdc689 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:45.902977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc384d-8be7-40d3-8d93-617953bdc689 admin admin] PATH_INFO: `/v3/projects/b55dff1681ba4140a33bf720af894950/users/f2a5b713c5064baab1441adf11be43b3/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:45.918978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc384d-8be7-40d3-8d93-617953bdc689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55dff1681ba4140a33bf720af894950, user_id=f2a5b713c5064baab1441adf11be43b3, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:45.921655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc384d-8be7-40d3-8d93-617953bdc689 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:45.934204 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3431/6890] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:10:45 2021] PUT /identity/v3/projects/b55dff1681ba4140a33bf720af894950/users/f2a5b713c5064baab1441adf11be43b3/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:45.944848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93d882-4b9a-44ad-8d11-44841ce6dfbc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:45.945191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93d882-4b9a-44ad-8d11-44841ce6dfbc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:45.945475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93d882-4b9a-44ad-8d11-44841ce6dfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:45.972678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5a93d882-4b9a-44ad-8d11-44841ce6dfbc None None] MFA Rules not processed for user `f2a5b713c5064baab1441adf11be43b3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:45.973869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5a93d882-4b9a-44ad-8d11-44841ce6dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:46.036101 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3460/6891] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:45 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:10:46.047867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc384d-8be7-40d3-8d93-617953bdc689 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:46.050069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5bcc384d-8be7-40d3-8d93-617953bdc689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:46.122431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc384d-8be7-40d3-8d93-617953bdc689 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:46.128506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a979cdf-ac2f-4332-97cc-4effbaf1dfb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:46.129135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a979cdf-ac2f-4332-97cc-4effbaf1dfb6 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:46.129415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a979cdf-ac2f-4332-97cc-4effbaf1dfb6 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:46.129688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a979cdf-ac2f-4332-97cc-4effbaf1dfb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:46.137394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a979cdf-ac2f-4332-97cc-4effbaf1dfb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:46.139622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a979cdf-ac2f-4332-97cc-4effbaf1dfb6 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:46.148181 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3432/6892] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:10:46 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:10:48.830953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93d882-4b9a-44ad-8d11-44841ce6dfbc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:48.890748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93d882-4b9a-44ad-8d11-44841ce6dfbc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:48.895231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:48.896108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:48.896386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:48.896659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] PATH_INFO: `/v3/users/f2a5b713c5064baab1441adf11be43b3` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:48.897836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a5b713c5064baab1441adf11be43b3)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:48.899755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:48.942263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a5b713c5064baab1441adf11be43b3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:48.948479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a5b713c5064baab1441adf11be43b3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:48.949128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a5b713c5064baab1441adf11be43b3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:48.956293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a5b713c5064baab1441adf11be43b3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:48.968052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a5b713c5064baab1441adf11be43b3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:48.973789 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3461/6893] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:10:48 2021] DELETE /identity/v3/users/f2a5b713c5064baab1441adf11be43b3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:48.978324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500402e-99cf-4a4f-94e7-37eabddd19c7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:48.978836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500402e-99cf-4a4f-94e7-37eabddd19c7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:48.978940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500402e-99cf-4a4f-94e7-37eabddd19c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:48.996283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2500402e-99cf-4a4f-94e7-37eabddd19c7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:48.997493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2500402e-99cf-4a4f-94e7-37eabddd19c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:49.062028 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3433/6894] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:10:49.071882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:49.073265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:49.132331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9749344-bcc7-4397-a174-eaaaaf40a45b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:49.136000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e66834-dca3-4739-9566-a65dd53af293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:49.136641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e66834-dca3-4739-9566-a65dd53af293 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:49.136924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e66834-dca3-4739-9566-a65dd53af293 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:49.137198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e66834-dca3-4739-9566-a65dd53af293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:49.148763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e66834-dca3-4739-9566-a65dd53af293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:49.150210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e66834-dca3-4739-9566-a65dd53af293 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:49.159976 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3462/6895] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:10:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:10:49.419883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500402e-99cf-4a4f-94e7-37eabddd19c7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:49.421322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2500402e-99cf-4a4f-94e7-37eabddd19c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:49.434633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500402e-99cf-4a4f-94e7-37eabddd19c7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:49.440185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:49.443346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:49.443346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:49.443346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] PATH_INFO: `/v3/projects/b55dff1681ba4140a33bf720af894950` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:49.443346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55dff1681ba4140a33bf720af894950)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:49.445402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:49.491201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55dff1681ba4140a33bf720af894950', 'request_id': 'req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:49.497485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55dff1681ba4140a33bf720af894950', 'request_id': 'req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:49.505301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55dff1681ba4140a33bf720af894950', 'request_id': 'req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:49.515376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] The token cache is being invalidate because project b55dff1681ba4140a33bf720af894950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:49.515666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:49.516294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b2cfe1e-e269-41d3-a7ee-5f05c04db548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:49.517825 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3434/6896] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:49 2021] DELETE /identity/v3/projects/b55dff1681ba4140a33bf720af894950 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:10:49.527171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2019e5e-f494-491b-a6f5-07c70267f11f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:49.527597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2019e5e-f494-491b-a6f5-07c70267f11f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:49.527877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2019e5e-f494-491b-a6f5-07c70267f11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:49.546029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e2019e5e-f494-491b-a6f5-07c70267f11f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:49.547201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e2019e5e-f494-491b-a6f5-07c70267f11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:49.605615 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3463/6897] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:10:49.613710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21f9a-16d7-43f6-abf2-ced9467d6ac9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:49.614001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21f9a-16d7-43f6-abf2-ced9467d6ac9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:49.614280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21f9a-16d7-43f6-abf2-ced9467d6ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:49.633709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-73e21f9a-16d7-43f6-abf2-ced9467d6ac9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:49.635169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-73e21f9a-16d7-43f6-abf2-ced9467d6ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:49.643147 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3435/6898] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:10:49.647230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2019e5e-f494-491b-a6f5-07c70267f11f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:49.657794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2019e5e-f494-491b-a6f5-07c70267f11f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:49.665399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb4c20-854e-4366-ad09-70551ee4b007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:49.666059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4c20-854e-4366-ad09-70551ee4b007 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:49.666340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4c20-854e-4366-ad09-70551ee4b007 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:49.666610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4c20-854e-4366-ad09-70551ee4b007 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:49.667377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb4c20-854e-4366-ad09-70551ee4b007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:10:49.667688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb4c20-854e-4366-ad09-70551ee4b007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:49.669274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb4c20-854e-4366-ad09-70551ee4b007 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:49.681669 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3464/6899] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:10:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:10:49.686811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21f9a-16d7-43f6-abf2-ced9467d6ac9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:49.696187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21f9a-16d7-43f6-abf2-ced9467d6ac9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:49.701464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2a35-229a-47c4-b2fe-99bd13ecae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:49.702116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2a35-229a-47c4-b2fe-99bd13ecae9a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:49.702397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2a35-229a-47c4-b2fe-99bd13ecae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:49.702669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f2a35-229a-47c4-b2fe-99bd13ecae9a admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:49.703402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2a35-229a-47c4-b2fe-99bd13ecae9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:49.705422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f2a35-229a-47c4-b2fe-99bd13ecae9a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:49.730385 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3436/6900] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:49 2021] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:49.734998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb4c20-854e-4366-ad09-70551ee4b007 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:49.745261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb4c20-854e-4366-ad09-70551ee4b007 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:49.800211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5742b-9cd4-4c27-9e21-5c3e1db3ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:49.800858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5742b-9cd4-4c27-9e21-5c3e1db3ddbf admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:49.801544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5742b-9cd4-4c27-9e21-5c3e1db3ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:49.801822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5742b-9cd4-4c27-9e21-5c3e1db3ddbf admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:49.802530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5742b-9cd4-4c27-9e21-5c3e1db3ddbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:49.804452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5742b-9cd4-4c27-9e21-5c3e1db3ddbf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:49.823916 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3465/6901] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:10:49 2021] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:49.828051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2a35-229a-47c4-b2fe-99bd13ecae9a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:49.838241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f2a35-229a-47c4-b2fe-99bd13ecae9a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:49.843362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21ee74-7ab2-4253-b387-3e399e5a497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:49.844010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21ee74-7ab2-4253-b387-3e399e5a497e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:49.844295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21ee74-7ab2-4253-b387-3e399e5a497e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:49.844570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21ee74-7ab2-4253-b387-3e399e5a497e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:49.845340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21ee74-7ab2-4253-b387-3e399e5a497e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:49.846948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21ee74-7ab2-4253-b387-3e399e5a497e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:49.857755 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3437/6902] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:10:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:10:49.861503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5742b-9cd4-4c27-9e21-5c3e1db3ddbf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:49.871428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5742b-9cd4-4c27-9e21-5c3e1db3ddbf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:49.876052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc21db-e87a-48e2-a93a-4bd3ebd31dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:49.876694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc21db-e87a-48e2-a93a-4bd3ebd31dcf admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:49.876977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc21db-e87a-48e2-a93a-4bd3ebd31dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:49.877252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc21db-e87a-48e2-a93a-4bd3ebd31dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:49.877990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc21db-e87a-48e2-a93a-4bd3ebd31dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:49.879600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc21db-e87a-48e2-a93a-4bd3ebd31dcf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:49.889602 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3466/6903] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:10:49 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:10:49.893362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21ee74-7ab2-4253-b387-3e399e5a497e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:49.902993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21ee74-7ab2-4253-b387-3e399e5a497e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:49.908105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d683dd-bc85-4922-90ab-77a88a47d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:49.908963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d683dd-bc85-4922-90ab-77a88a47d806 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:49.909245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d683dd-bc85-4922-90ab-77a88a47d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:49.909519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d683dd-bc85-4922-90ab-77a88a47d806 admin admin] PATH_INFO: `/v3/projects/f81590033de149a3941c282b24569840/users/68ad904ba31643acacd89aeb7349245d/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:49.924170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d683dd-bc85-4922-90ab-77a88a47d806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81590033de149a3941c282b24569840, user_id=68ad904ba31643acacd89aeb7349245d, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:49.926805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d683dd-bc85-4922-90ab-77a88a47d806 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:49.939213 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3438/6904] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:10:49 2021] PUT /identity/v3/projects/f81590033de149a3941c282b24569840/users/68ad904ba31643acacd89aeb7349245d/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:49.949189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67d4c-a6cc-47fe-a29b-7461766cdd6d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:49.949504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67d4c-a6cc-47fe-a29b-7461766cdd6d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:49.949778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67d4c-a6cc-47fe-a29b-7461766cdd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:49.975748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-89d67d4c-a6cc-47fe-a29b-7461766cdd6d None None] MFA Rules not processed for user `68ad904ba31643acacd89aeb7349245d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:49.976928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-89d67d4c-a6cc-47fe-a29b-7461766cdd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:50.037849 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3467/6905] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:49 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:10:50.042269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d683dd-bc85-4922-90ab-77a88a47d806 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:50.103037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d683dd-bc85-4922-90ab-77a88a47d806 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:50.108257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390d6ac-3d99-4cb3-89ec-3a95ad5525c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:50.108907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390d6ac-3d99-4cb3-89ec-3a95ad5525c6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:50.109187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390d6ac-3d99-4cb3-89ec-3a95ad5525c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:50.109457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390d6ac-3d99-4cb3-89ec-3a95ad5525c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:50.110157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390d6ac-3d99-4cb3-89ec-3a95ad5525c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:50.112104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390d6ac-3d99-4cb3-89ec-3a95ad5525c6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:50.136590 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3439/6906] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:50 2021] POST /identity/v3/projects => generated 401 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:50.140703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d67d4c-a6cc-47fe-a29b-7461766cdd6d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:50.151026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d67d4c-a6cc-47fe-a29b-7461766cdd6d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:50.204723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8814f1-f5ec-467f-9424-c2340afe7d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:50.205389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8814f1-f5ec-467f-9424-c2340afe7d77 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:50.205705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8814f1-f5ec-467f-9424-c2340afe7d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:50.205988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8814f1-f5ec-467f-9424-c2340afe7d77 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:50.206726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8814f1-f5ec-467f-9424-c2340afe7d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:50.208715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8814f1-f5ec-467f-9424-c2340afe7d77 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:50.228496 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3468/6907] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:10:50 2021] POST /identity/v3/users => generated 307 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:50.232609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390d6ac-3d99-4cb3-89ec-3a95ad5525c6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:50.242995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390d6ac-3d99-4cb3-89ec-3a95ad5525c6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:50.248134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd6afc-ef43-441c-9424-04b74cc57133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:50.248779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd6afc-ef43-441c-9424-04b74cc57133 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:50.249061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd6afc-ef43-441c-9424-04b74cc57133 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:50.249337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd6afc-ef43-441c-9424-04b74cc57133 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:50.250055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd6afc-ef43-441c-9424-04b74cc57133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:50.251692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd6afc-ef43-441c-9424-04b74cc57133 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:50.261815 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3440/6908] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:10:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:10:50.266358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8814f1-f5ec-467f-9424-c2340afe7d77 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:50.276257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8814f1-f5ec-467f-9424-c2340afe7d77 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:50.281439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072588e-8ede-46d3-bafd-4ba75e316d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:50.282297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072588e-8ede-46d3-bafd-4ba75e316d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:50.282578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072588e-8ede-46d3-bafd-4ba75e316d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:50.283568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072588e-8ede-46d3-bafd-4ba75e316d7d admin admin] PATH_INFO: `/v3/projects/459ba99499df49f1aeadadd0c6603924/users/7b17d93c95ca4410af4ad8ecbff8c855/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:50.298157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072588e-8ede-46d3-bafd-4ba75e316d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=459ba99499df49f1aeadadd0c6603924, user_id=7b17d93c95ca4410af4ad8ecbff8c855, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:50.300820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072588e-8ede-46d3-bafd-4ba75e316d7d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:50.314017 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3469/6909] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:10:50 2021] PUT /identity/v3/projects/459ba99499df49f1aeadadd0c6603924/users/7b17d93c95ca4410af4ad8ecbff8c855/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:10:50.318032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd6afc-ef43-441c-9424-04b74cc57133 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:50.328575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd6afc-ef43-441c-9424-04b74cc57133 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:50.386458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac3cc4-462b-49b3-b215-acea546d589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:50.387166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac3cc4-462b-49b3-b215-acea546d589f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:50.387488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac3cc4-462b-49b3-b215-acea546d589f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:50.387767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac3cc4-462b-49b3-b215-acea546d589f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:50.389034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac3cc4-462b-49b3-b215-acea546d589f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:50.390633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac3cc4-462b-49b3-b215-acea546d589f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:50.403839 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3441/6910] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:10:50 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:10:50.405685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072588e-8ede-46d3-bafd-4ba75e316d7d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:50.416084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072588e-8ede-46d3-bafd-4ba75e316d7d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:50.420972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e143-aac3-408c-8206-2cec58985d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:50.421812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e143-aac3-408c-8206-2cec58985d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:50.422092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e143-aac3-408c-8206-2cec58985d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:50.422367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e143-aac3-408c-8206-2cec58985d09 admin admin] PATH_INFO: `/v3/projects/459ba99499df49f1aeadadd0c6603924/users/7b17d93c95ca4410af4ad8ecbff8c855/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:50.424406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4e143-aac3-408c-8206-2cec58985d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=459ba99499df49f1aeadadd0c6603924, user_id=7b17d93c95ca4410af4ad8ecbff8c855, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:50.427070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4e143-aac3-408c-8206-2cec58985d09 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:50.438061 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3470/6911] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:10:50 2021] PUT /identity/v3/projects/459ba99499df49f1aeadadd0c6603924/users/7b17d93c95ca4410af4ad8ecbff8c855/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:50.509876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891d834-8f64-4717-a830-95c5ae01a6b0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:50.510179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891d834-8f64-4717-a830-95c5ae01a6b0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:50.510462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891d834-8f64-4717-a830-95c5ae01a6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:50.538297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3891d834-8f64-4717-a830-95c5ae01a6b0 None None] MFA Rules not processed for user `7b17d93c95ca4410af4ad8ecbff8c855`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:50.539519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3891d834-8f64-4717-a830-95c5ae01a6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:50.606623 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3442/6912] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:50 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:10:50.611512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e143-aac3-408c-8206-2cec58985d09 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:50.622008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e143-aac3-408c-8206-2cec58985d09 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:50.627202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326afda-1e7c-4e70-8e31-470085108a30 tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b17d93c95ca4410af4ad8ecbff8c855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '459ba99499df49f1aeadadd0c6603924', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:50.627884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326afda-1e7c-4e70-8e31-470085108a30 tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:50.628181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326afda-1e7c-4e70-8e31-470085108a30 tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:50.628435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326afda-1e7c-4e70-8e31-470085108a30 tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:50.629187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326afda-1e7c-4e70-8e31-470085108a30 tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:50.630749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326afda-1e7c-4e70-8e31-470085108a30 tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:50.647783 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3471/6913] 10.222.0.21 () {60 vars in 1142 bytes} [Sat Nov 27 21:10:50 2021] POST /identity/v3/roles => generated 240 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:50.651619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891d834-8f64-4717-a830-95c5ae01a6b0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:50.674344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891d834-8f64-4717-a830-95c5ae01a6b0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:50.676221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3d314-a31d-4cab-aa8a-cb9fcef47e2f tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b17d93c95ca4410af4ad8ecbff8c855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '459ba99499df49f1aeadadd0c6603924', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:50.677241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3d314-a31d-4cab-aa8a-cb9fcef47e2f tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:50.677633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3d314-a31d-4cab-aa8a-cb9fcef47e2f tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:50.678017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3d314-a31d-4cab-aa8a-cb9fcef47e2f tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] PATH_INFO: `/v3/projects/f81590033de149a3941c282b24569840/users/68ad904ba31643acacd89aeb7349245d/roles/2b7d90f01dde4fc787b275c600c048a8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:50.680668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3d314-a31d-4cab-aa8a-cb9fcef47e2f tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f81590033de149a3941c282b24569840, user_id=68ad904ba31643acacd89aeb7349245d, role_id=2b7d90f01dde4fc787b275c600c048a8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:50.686138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3d314-a31d-4cab-aa8a-cb9fcef47e2f tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:50.698911 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3443/6914] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:10:50 2021] PUT /identity/v3/projects/f81590033de149a3941c282b24569840/users/68ad904ba31643acacd89aeb7349245d/roles/2b7d90f01dde4fc787b275c600c048a8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:10:50.704807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326afda-1e7c-4e70-8e31-470085108a30 tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:50.770470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326afda-1e7c-4e70-8e31-470085108a30 tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:50.828239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce84925-825a-487c-b84e-6e48ccb3b29c tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ad904ba31643acacd89aeb7349245d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f81590033de149a3941c282b24569840', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1863946153', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:50.829258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce84925-825a-487c-b84e-6e48ccb3b29c tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:50.829657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce84925-825a-487c-b84e-6e48ccb3b29c tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:50.830168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce84925-825a-487c-b84e-6e48ccb3b29c tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] PATH_INFO: `/v3/users/68ad904ba31643acacd89aeb7349245d/application_credentials` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:50.831013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce84925-825a-487c-b84e-6e48ccb3b29c tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] RBAC: Authorizing `identity:create_application_credential(user_id=68ad904ba31643acacd89aeb7349245d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:50.832444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce84925-825a-487c-b84e-6e48ccb3b29c tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:50.900266 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3472/6915] 10.222.0.21 () {60 vars in 1314 bytes} [Sat Nov 27 21:10:50 2021] POST /identity/v3/users/68ad904ba31643acacd89aeb7349245d/application_credentials => generated 659 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:50.904751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e7cd-10d7-437f-839c-80b91dc560e4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:50.905104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e7cd-10d7-437f-839c-80b91dc560e4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:50.905452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e7cd-10d7-437f-839c-80b91dc560e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:50.927216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0cb2e7cd-10d7-437f-839c-80b91dc560e4 None None] MFA Rules not processed for user `68ad904ba31643acacd89aeb7349245d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:50.928612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0cb2e7cd-10d7-437f-839c-80b91dc560e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:51.030739 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3444/6916] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:50 2021] POST /identity/v3/auth/tokens => generated 3386 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Nov 27 21:10:51.035172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce84925-825a-487c-b84e-6e48ccb3b29c tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:51.045632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce84925-825a-487c-b84e-6e48ccb3b29c tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:51.050310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5635e-2510-436f-b31a-7a6a1a274ef9 tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68ad904ba31643acacd89aeb7349245d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f81590033de149a3941c282b24569840', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1863946153', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:51.051308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5635e-2510-436f-b31a-7a6a1a274ef9 tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:51.051596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5635e-2510-436f-b31a-7a6a1a274ef9 tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:51.051875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5635e-2510-436f-b31a-7a6a1a274ef9 tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] PATH_INFO: `/v3/users/68ad904ba31643acacd89aeb7349245d/application_credentials/ad53948d31584eb08d4d7eaddc9ffb17` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:51.053079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5635e-2510-436f-b31a-7a6a1a274ef9 tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] RBAC: Authorizing `identity:delete_application_credential(user_id=68ad904ba31643acacd89aeb7349245d, application_credential_id=ad53948d31584eb08d4d7eaddc9ffb17)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:51.054575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5635e-2510-436f-b31a-7a6a1a274ef9 tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:51.073465 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3473/6917] 10.222.0.21 () {58 vars in 1394 bytes} [Sat Nov 27 21:10:51 2021] DELETE /identity/v3/users/68ad904ba31643acacd89aeb7349245d/application_credentials/ad53948d31584eb08d4d7eaddc9ffb17 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:51.077967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2e7cd-10d7-437f-839c-80b91dc560e4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:51.138194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2e7cd-10d7-437f-839c-80b91dc560e4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:51.143699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adebfc-6881-434c-b055-87b7ea3515eb tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b17d93c95ca4410af4ad8ecbff8c855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '459ba99499df49f1aeadadd0c6603924', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:51.145007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adebfc-6881-434c-b055-87b7ea3515eb tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:51.145496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adebfc-6881-434c-b055-87b7ea3515eb tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:51.145836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adebfc-6881-434c-b055-87b7ea3515eb tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] PATH_INFO: `/v3/roles/2b7d90f01dde4fc787b275c600c048a8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:51.147388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adebfc-6881-434c-b055-87b7ea3515eb tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2b7d90f01dde4fc787b275c600c048a8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:51.149013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adebfc-6881-434c-b055-87b7ea3515eb tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:51.185770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c6adebfc-6881-434c-b055-87b7ea3515eb tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] Invalidating the token cache because role 2b7d90f01dde4fc787b275c600c048a8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:51.186015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c6adebfc-6881-434c-b055-87b7ea3515eb tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.186751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c6adebfc-6881-434c-b055-87b7ea3515eb tempest-ApplicationCredentialsV3AdminTest-962859200 tempest-ApplicationCredentialsV3AdminTest-962859200-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.188627 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3445/6918] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:10:51 2021] DELETE /identity/v3/roles/2b7d90f01dde4fc787b275c600c048a8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:51.193997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5635e-2510-436f-b31a-7a6a1a274ef9 tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:51.195713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c6c5635e-2510-436f-b31a-7a6a1a274ef9 tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:51.258696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5635e-2510-436f-b31a-7a6a1a274ef9 tempest-ApplicationCredentialsV3AdminTest-1969321432 tempest-ApplicationCredentialsV3AdminTest-1969321432-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:51.313162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:51.314018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:51.314294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:51.314562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] PATH_INFO: `/v3/users/68ad904ba31643acacd89aeb7349245d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:51.315819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ad904ba31643acacd89aeb7349245d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:51.317724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:51.362731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ad904ba31643acacd89aeb7349245d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.369644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ad904ba31643acacd89aeb7349245d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.370277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ad904ba31643acacd89aeb7349245d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.377427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ad904ba31643acacd89aeb7349245d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.388746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ad904ba31643acacd89aeb7349245d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.394548 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3474/6919] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:10:51 2021] DELETE /identity/v3/users/68ad904ba31643acacd89aeb7349245d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:51.399059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6f02-c5de-4df0-a54b-3df985467d6c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:51.399387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6f02-c5de-4df0-a54b-3df985467d6c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:51.399672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af6f02-c5de-4df0-a54b-3df985467d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:51.417357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e2af6f02-c5de-4df0-a54b-3df985467d6c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:51.418550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e2af6f02-c5de-4df0-a54b-3df985467d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:51.477302 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3446/6920] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:10:51.487847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:51.489299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:51.546398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad0990-a99c-4f75-8b3d-4ac4d7a0d546 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:51.550075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfa868-175f-4f10-ac82-de76bc49ed2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:51.550717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa868-175f-4f10-ac82-de76bc49ed2b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:51.551034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa868-175f-4f10-ac82-de76bc49ed2b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:51.551352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa868-175f-4f10-ac82-de76bc49ed2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:51.560210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa868-175f-4f10-ac82-de76bc49ed2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:51.561639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa868-175f-4f10-ac82-de76bc49ed2b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:51.571175 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3475/6921] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:10:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:10:51.837381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af6f02-c5de-4df0-a54b-3df985467d6c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:51.838848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e2af6f02-c5de-4df0-a54b-3df985467d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:51.852230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af6f02-c5de-4df0-a54b-3df985467d6c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:51.857114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:51.857992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:51.858270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:51.858538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] PATH_INFO: `/v3/projects/f81590033de149a3941c282b24569840` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:51.859756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81590033de149a3941c282b24569840)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:51.862051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:51.907683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81590033de149a3941c282b24569840', 'request_id': 'req-012b565f-2150-487e-bc27-9412cb21fed2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.913615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81590033de149a3941c282b24569840', 'request_id': 'req-012b565f-2150-487e-bc27-9412cb21fed2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.920757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81590033de149a3941c282b24569840', 'request_id': 'req-012b565f-2150-487e-bc27-9412cb21fed2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.930867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] The token cache is being invalidate because project f81590033de149a3941c282b24569840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:51.931158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.931817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:51.933357 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3447/6922] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:51 2021] DELETE /identity/v3/projects/f81590033de149a3941c282b24569840 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:51.937418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfa868-175f-4f10-ac82-de76bc49ed2b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:51.946971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfa868-175f-4f10-ac82-de76bc49ed2b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:52.001712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5737d60-ec7b-496e-9b8e-9c16e4a82861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:52.002496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737d60-ec7b-496e-9b8e-9c16e4a82861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:52.002782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737d60-ec7b-496e-9b8e-9c16e4a82861 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:52.003061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737d60-ec7b-496e-9b8e-9c16e4a82861 admin admin] PATH_INFO: `/v3/users/7b17d93c95ca4410af4ad8ecbff8c855` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:52.004290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5737d60-ec7b-496e-9b8e-9c16e4a82861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b17d93c95ca4410af4ad8ecbff8c855)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:52.006190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5737d60-ec7b-496e-9b8e-9c16e4a82861 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:52.049096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d5737d60-ec7b-496e-9b8e-9c16e4a82861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b17d93c95ca4410af4ad8ecbff8c855'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:52.055677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d5737d60-ec7b-496e-9b8e-9c16e4a82861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b17d93c95ca4410af4ad8ecbff8c855'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:52.056301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d5737d60-ec7b-496e-9b8e-9c16e4a82861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b17d93c95ca4410af4ad8ecbff8c855'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:52.063557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d5737d60-ec7b-496e-9b8e-9c16e4a82861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b17d93c95ca4410af4ad8ecbff8c855'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:52.074840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d5737d60-ec7b-496e-9b8e-9c16e4a82861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b17d93c95ca4410af4ad8ecbff8c855'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:52.081218 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3476/6923] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:10:51 2021] DELETE /identity/v3/users/7b17d93c95ca4410af4ad8ecbff8c855 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:52.340085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:52.342101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:52.356353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b565f-2150-487e-bc27-9412cb21fed2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:52.412935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:52.413783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:52.414098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:52.414377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] PATH_INFO: `/v3/projects/459ba99499df49f1aeadadd0c6603924` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:52.415592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=459ba99499df49f1aeadadd0c6603924)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:52.417493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:52.463633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459ba99499df49f1aeadadd0c6603924', 'request_id': 'req-c942c841-a5b3-47cd-810f-2f63fb716068'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:52.470196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459ba99499df49f1aeadadd0c6603924', 'request_id': 'req-c942c841-a5b3-47cd-810f-2f63fb716068'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:52.477644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459ba99499df49f1aeadadd0c6603924', 'request_id': 'req-c942c841-a5b3-47cd-810f-2f63fb716068'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:52.488237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] The token cache is being invalidate because project 459ba99499df49f1aeadadd0c6603924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:52.488519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:52.489147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c942c841-a5b3-47cd-810f-2f63fb716068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:52.490674 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3448/6924] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:52 2021] DELETE /identity/v3/projects/459ba99499df49f1aeadadd0c6603924 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:52.497036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d041-cb49-4a6f-ac7e-99af1b918ebf None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:52.497355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d041-cb49-4a6f-ac7e-99af1b918ebf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:52.497628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d041-cb49-4a6f-ac7e-99af1b918ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:52.515840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7723d041-cb49-4a6f-ac7e-99af1b918ebf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:52.517133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7723d041-cb49-4a6f-ac7e-99af1b918ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:52.573168 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3477/6925] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:10:52.581347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd34fb-d408-4c02-9268-1f5dd9590011 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:52.581634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd34fb-d408-4c02-9268-1f5dd9590011 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:52.581915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd34fb-d408-4c02-9268-1f5dd9590011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:52.600947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-81cd34fb-d408-4c02-9268-1f5dd9590011 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:52.602129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-81cd34fb-d408-4c02-9268-1f5dd9590011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:52.609878 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3449/6926] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:10:52.614028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d041-cb49-4a6f-ac7e-99af1b918ebf None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:52.623763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d041-cb49-4a6f-ac7e-99af1b918ebf None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:52.628298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340b4a3-4513-40d0-83e3-8cc10c1be091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:52.628944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340b4a3-4513-40d0-83e3-8cc10c1be091 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:52.629229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340b4a3-4513-40d0-83e3-8cc10c1be091 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:52.629506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340b4a3-4513-40d0-83e3-8cc10c1be091 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:52.630237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340b4a3-4513-40d0-83e3-8cc10c1be091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:10:52.630546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340b4a3-4513-40d0-83e3-8cc10c1be091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:52.632167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340b4a3-4513-40d0-83e3-8cc10c1be091 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:52.643900 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3478/6927] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:10:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:52.647869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd34fb-d408-4c02-9268-1f5dd9590011 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:52.657464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd34fb-d408-4c02-9268-1f5dd9590011 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:52.662048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a2f3-4901-4fe8-abe3-ec27109a38c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:52.662705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a2f3-4901-4fe8-abe3-ec27109a38c8 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:52.662983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a2f3-4901-4fe8-abe3-ec27109a38c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:52.663281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558a2f3-4901-4fe8-abe3-ec27109a38c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:52.663976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558a2f3-4901-4fe8-abe3-ec27109a38c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:52.665847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558a2f3-4901-4fe8-abe3-ec27109a38c8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:52.690414 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3450/6928] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:52 2021] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:52.694175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340b4a3-4513-40d0-83e3-8cc10c1be091 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:52.704520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340b4a3-4513-40d0-83e3-8cc10c1be091 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:52.759765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6022-402f-4504-9423-7aa777d256f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:52.760425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6022-402f-4504-9423-7aa777d256f7 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:52.760707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6022-402f-4504-9423-7aa777d256f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:52.760981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6022-402f-4504-9423-7aa777d256f7 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:52.761683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6022-402f-4504-9423-7aa777d256f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:52.764117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6022-402f-4504-9423-7aa777d256f7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:52.782771 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3479/6929] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:10:52 2021] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:52.786877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a2f3-4901-4fe8-abe3-ec27109a38c8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:52.797665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558a2f3-4901-4fe8-abe3-ec27109a38c8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:52.802647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c2aa4-64f5-46d0-9b8e-78328e02c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:52.803107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2aa4-64f5-46d0-9b8e-78328e02c969 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:52.803430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2aa4-64f5-46d0-9b8e-78328e02c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:52.803830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c2aa4-64f5-46d0-9b8e-78328e02c969 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:52.804442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c2aa4-64f5-46d0-9b8e-78328e02c969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:52.806033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c2aa4-64f5-46d0-9b8e-78328e02c969 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:52.817335 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3451/6930] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:10:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:10:52.821549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6022-402f-4504-9423-7aa777d256f7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:52.832535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6022-402f-4504-9423-7aa777d256f7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:52.837944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657c078-26b2-424a-8064-27c0150c92a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:52.838891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657c078-26b2-424a-8064-27c0150c92a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:52.839175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657c078-26b2-424a-8064-27c0150c92a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:52.839483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657c078-26b2-424a-8064-27c0150c92a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:52.840215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657c078-26b2-424a-8064-27c0150c92a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:52.841791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657c078-26b2-424a-8064-27c0150c92a2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:52.853172 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3480/6931] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:10:52 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:10:52.857516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c2aa4-64f5-46d0-9b8e-78328e02c969 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:52.867903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c2aa4-64f5-46d0-9b8e-78328e02c969 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:52.873901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8db9b-c6e5-4136-804d-9991e7f1bd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:52.874807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8db9b-c6e5-4136-804d-9991e7f1bd30 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:52.875094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8db9b-c6e5-4136-804d-9991e7f1bd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:52.875404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8db9b-c6e5-4136-804d-9991e7f1bd30 admin admin] PATH_INFO: `/v3/projects/eccb384080724d99820eadb5b0d2c7e4/users/ad499b8e631d4ba6b22e64a647af7450/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:52.890657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8db9b-c6e5-4136-804d-9991e7f1bd30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccb384080724d99820eadb5b0d2c7e4, user_id=ad499b8e631d4ba6b22e64a647af7450, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:52.893555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8db9b-c6e5-4136-804d-9991e7f1bd30 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:52.907606 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3452/6932] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:10:52 2021] PUT /identity/v3/projects/eccb384080724d99820eadb5b0d2c7e4/users/ad499b8e631d4ba6b22e64a647af7450/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:52.917473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9154b-4b34-43a7-977c-74de7830fd6d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:52.917759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9154b-4b34-43a7-977c-74de7830fd6d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:52.918031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9154b-4b34-43a7-977c-74de7830fd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:52.944806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-edb9154b-4b34-43a7-977c-74de7830fd6d None None] MFA Rules not processed for user `ad499b8e631d4ba6b22e64a647af7450`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:52.946005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-edb9154b-4b34-43a7-977c-74de7830fd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:53.008316 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3481/6933] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:52 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:10:53.012736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8db9b-c6e5-4136-804d-9991e7f1bd30 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.072228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8db9b-c6e5-4136-804d-9991e7f1bd30 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:53.077514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eac9a-c840-4dfb-b79d-2798920dc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:53.078159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eac9a-c840-4dfb-b79d-2798920dc31a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.078442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eac9a-c840-4dfb-b79d-2798920dc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.078717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6eac9a-c840-4dfb-b79d-2798920dc31a admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.079458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6eac9a-c840-4dfb-b79d-2798920dc31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:53.081364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6eac9a-c840-4dfb-b79d-2798920dc31a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:53.105537 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3453/6934] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:53 2021] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:53.109549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9154b-4b34-43a7-977c-74de7830fd6d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.120445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9154b-4b34-43a7-977c-74de7830fd6d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:53.177476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a1a7-7ecf-42d6-90df-939a8255b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:53.178141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a1a7-7ecf-42d6-90df-939a8255b53b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.178427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a1a7-7ecf-42d6-90df-939a8255b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.178705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a1a7-7ecf-42d6-90df-939a8255b53b admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.179432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455a1a7-7ecf-42d6-90df-939a8255b53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:53.181340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455a1a7-7ecf-42d6-90df-939a8255b53b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:53.204156 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3482/6935] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:10:53 2021] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:53.205332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eac9a-c840-4dfb-b79d-2798920dc31a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.215771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6eac9a-c840-4dfb-b79d-2798920dc31a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:53.220598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea3ef9-410c-44c1-8cac-7548fb965751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:53.221252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea3ef9-410c-44c1-8cac-7548fb965751 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.221537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea3ef9-410c-44c1-8cac-7548fb965751 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.221816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea3ef9-410c-44c1-8cac-7548fb965751 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.222543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea3ef9-410c-44c1-8cac-7548fb965751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:53.224197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea3ef9-410c-44c1-8cac-7548fb965751 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:53.236432 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3454/6936] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:10:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:10:53.240553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a1a7-7ecf-42d6-90df-939a8255b53b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.251158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a1a7-7ecf-42d6-90df-939a8255b53b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:53.255874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e00f6-eeeb-4df4-be4c-072efdc0d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:53.256777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e00f6-eeeb-4df4-be4c-072efdc0d90a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.257117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e00f6-eeeb-4df4-be4c-072efdc0d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.257337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e00f6-eeeb-4df4-be4c-072efdc0d90a admin admin] PATH_INFO: `/v3/projects/818a986a96314fa889f82fbd0a0a1123/users/db711f074b1b4d6cbf57c634e3cdf6f5/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.272391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e00f6-eeeb-4df4-be4c-072efdc0d90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=818a986a96314fa889f82fbd0a0a1123, user_id=db711f074b1b4d6cbf57c634e3cdf6f5, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:53.275073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e00f6-eeeb-4df4-be4c-072efdc0d90a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:53.287510 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3483/6937] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:10:53 2021] PUT /identity/v3/projects/818a986a96314fa889f82fbd0a0a1123/users/db711f074b1b4d6cbf57c634e3cdf6f5/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:10:53.291523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea3ef9-410c-44c1-8cac-7548fb965751 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.301780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea3ef9-410c-44c1-8cac-7548fb965751 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:53.356432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beca41-df8f-4ac3-89ec-5b11efdcc14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:53.357632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beca41-df8f-4ac3-89ec-5b11efdcc14b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.357779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beca41-df8f-4ac3-89ec-5b11efdcc14b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.358055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beca41-df8f-4ac3-89ec-5b11efdcc14b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.358782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beca41-df8f-4ac3-89ec-5b11efdcc14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:53.360404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beca41-df8f-4ac3-89ec-5b11efdcc14b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:53.370119 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3455/6938] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:10:53 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:10:53.374879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e00f6-eeeb-4df4-be4c-072efdc0d90a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.385719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e00f6-eeeb-4df4-be4c-072efdc0d90a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:53.390413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f4f4f-e428-40a3-b771-e394f09978e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:53.391544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4f4f-e428-40a3-b771-e394f09978e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.391827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4f4f-e428-40a3-b771-e394f09978e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.392103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4f4f-e428-40a3-b771-e394f09978e3 admin admin] PATH_INFO: `/v3/projects/818a986a96314fa889f82fbd0a0a1123/users/db711f074b1b4d6cbf57c634e3cdf6f5/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.394136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f4f4f-e428-40a3-b771-e394f09978e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818a986a96314fa889f82fbd0a0a1123, user_id=db711f074b1b4d6cbf57c634e3cdf6f5, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:53.396837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f4f4f-e428-40a3-b771-e394f09978e3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:53.406883 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3484/6939] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:10:53 2021] PUT /identity/v3/projects/818a986a96314fa889f82fbd0a0a1123/users/db711f074b1b4d6cbf57c634e3cdf6f5/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:53.417915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d415-8c6f-49b3-ab1b-592678667ba7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.418209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d415-8c6f-49b3-ab1b-592678667ba7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.418489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d415-8c6f-49b3-ab1b-592678667ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.445504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5157d415-8c6f-49b3-ab1b-592678667ba7 None None] MFA Rules not processed for user `db711f074b1b4d6cbf57c634e3cdf6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:53.446703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5157d415-8c6f-49b3-ab1b-592678667ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:53.512199 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3456/6940] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:53 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:10:53.517243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f4f4f-e428-40a3-b771-e394f09978e3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.528433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f4f4f-e428-40a3-b771-e394f09978e3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:53.533584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857b945-feb9-4c0e-923d-359cbc637edf tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:53.534227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857b945-feb9-4c0e-923d-359cbc637edf tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.534512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857b945-feb9-4c0e-923d-359cbc637edf tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.534790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857b945-feb9-4c0e-923d-359cbc637edf tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.535515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857b945-feb9-4c0e-923d-359cbc637edf tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:53.537340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857b945-feb9-4c0e-923d-359cbc637edf tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:53.568204 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3485/6941] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:53 2021] POST /identity/v3/projects => generated 360 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:53.572156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157d415-8c6f-49b3-ab1b-592678667ba7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.581292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157d415-8c6f-49b3-ab1b-592678667ba7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:53.635647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a00dd-8f8d-47f4-be47-e7c3019d48e6 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:53.636248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a00dd-8f8d-47f4-be47-e7c3019d48e6 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.636534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a00dd-8f8d-47f4-be47-e7c3019d48e6 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.636808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a00dd-8f8d-47f4-be47-e7c3019d48e6 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.637508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a00dd-8f8d-47f4-be47-e7c3019d48e6 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:53.639390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a00dd-8f8d-47f4-be47-e7c3019d48e6 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:53.662346 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3457/6942] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:10:53 2021] POST /identity/v3/users => generated 413 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:53.666685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857b945-feb9-4c0e-923d-359cbc637edf tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.677952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857b945-feb9-4c0e-923d-359cbc637edf tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:53.682582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02833849-7e6b-4172-8344-92de756a3359 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:53.683749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02833849-7e6b-4172-8344-92de756a3359 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.684038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02833849-7e6b-4172-8344-92de756a3359 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.684314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02833849-7e6b-4172-8344-92de756a3359 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/users/31dd5e9ee38f4646bb461da01025f91f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.697870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02833849-7e6b-4172-8344-92de756a3359 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:get_user(user_id=31dd5e9ee38f4646bb461da01025f91f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:53.700153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02833849-7e6b-4172-8344-92de756a3359 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:53.701772 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3486/6943] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 21:10:53 2021] GET /identity/v3/users/31dd5e9ee38f4646bb461da01025f91f => generated 413 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:53.705846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a00dd-8f8d-47f4-be47-e7c3019d48e6 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.715926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a00dd-8f8d-47f4-be47-e7c3019d48e6 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:53.721030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:53.721877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.722162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.722444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/users/31dd5e9ee38f4646bb461da01025f91f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.723683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_user(user_id=31dd5e9ee38f4646bb461da01025f91f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:53.725761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:53.768524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31dd5e9ee38f4646bb461da01025f91f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:53.769277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31dd5e9ee38f4646bb461da01025f91f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:53.776431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31dd5e9ee38f4646bb461da01025f91f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:53.777167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31dd5e9ee38f4646bb461da01025f91f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:53.784285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31dd5e9ee38f4646bb461da01025f91f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:53.801398 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3458/6944] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:10:53 2021] DELETE /identity/v3/users/31dd5e9ee38f4646bb461da01025f91f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:53.805414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02833849-7e6b-4172-8344-92de756a3359 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.807320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-02833849-7e6b-4172-8344-92de756a3359 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:53.820527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02833849-7e6b-4172-8344-92de756a3359 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:53.877085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:53.877946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:53.878235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:53.878508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/f5f123d60f834a6194691de567a45e7e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:53.879860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f5f123d60f834a6194691de567a45e7e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:53.881884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:53.932038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f123d60f834a6194691de567a45e7e', 'request_id': 'req-17495f71-d411-4f01-8f36-c3787212b39e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:53.939635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f123d60f834a6194691de567a45e7e', 'request_id': 'req-17495f71-d411-4f01-8f36-c3787212b39e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:53.945946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f123d60f834a6194691de567a45e7e', 'request_id': 'req-17495f71-d411-4f01-8f36-c3787212b39e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:53.956723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project f5f123d60f834a6194691de567a45e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:53.957014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:53.958526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:53.960734 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3487/6945] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:53 2021] DELETE /identity/v3/projects/f5f123d60f834a6194691de567a45e7e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:53.965759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:53.976547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb67c0-7f01-42f5-a2b4-580ccb1e2d41 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:54.038426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29ff04-5df9-4df6-bf4d-c23b377f641e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:54.039082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29ff04-5df9-4df6-bf4d-c23b377f641e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:54.039391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29ff04-5df9-4df6-bf4d-c23b377f641e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:54.039692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29ff04-5df9-4df6-bf4d-c23b377f641e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:54.040401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29ff04-5df9-4df6-bf4d-c23b377f641e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:54.042097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29ff04-5df9-4df6-bf4d-c23b377f641e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:54.056257 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3459/6946] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:53 2021] POST /identity/v3/projects => generated 347 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:54.060276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:54.061652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:54.073945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17495f71-d411-4f01-8f36-c3787212b39e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:54.127922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654893-a180-4e55-b678-7dc5c2305402 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:54.128576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654893-a180-4e55-b678-7dc5c2305402 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:54.128865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654893-a180-4e55-b678-7dc5c2305402 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:54.129146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654893-a180-4e55-b678-7dc5c2305402 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:54.129905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e654893-a180-4e55-b678-7dc5c2305402 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:10:54.130214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e654893-a180-4e55-b678-7dc5c2305402 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:54.132076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e654893-a180-4e55-b678-7dc5c2305402 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:54.144083 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3488/6947] 10.222.0.21 () {58 vars in 1159 bytes} [Sat Nov 27 21:10:54 2021] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:10:54.148203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29ff04-5df9-4df6-bf4d-c23b377f641e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:54.159081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29ff04-5df9-4df6-bf4d-c23b377f641e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:54.163853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3eabf7-f7b8-47b0-8f6f-2460b4cd4508 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:54.164440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3eabf7-f7b8-47b0-8f6f-2460b4cd4508 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:54.164731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3eabf7-f7b8-47b0-8f6f-2460b4cd4508 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:54.165016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3eabf7-f7b8-47b0-8f6f-2460b4cd4508 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:54.165725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3eabf7-f7b8-47b0-8f6f-2460b4cd4508 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:54.167355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3eabf7-f7b8-47b0-8f6f-2460b4cd4508 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:54.178980 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3460/6948] 10.222.0.21 () {58 vars in 1127 bytes} [Sat Nov 27 21:10:54 2021] GET /identity/v3/domains => generated 828 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:54.182847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654893-a180-4e55-b678-7dc5c2305402 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:54.192623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654893-a180-4e55-b678-7dc5c2305402 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:54.197202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:54.198056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:54.198346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:54.198650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/335f8db1ec904e99a8b8d8f6908a95e4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:54.199940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:update_project(project_id=335f8db1ec904e99a8b8d8f6908a95e4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:54.201421 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:10:54.201421 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:10:54.201421 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:10:54.202405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:54.213146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.213820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.238203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.239068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.241782 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3489/6949] 10.222.0.21 () {60 vars in 1251 bytes} [Sat Nov 27 21:10:54 2021] PATCH /identity/v3/projects/335f8db1ec904e99a8b8d8f6908a95e4 => generated 361 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:54.245988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3eabf7-f7b8-47b0-8f6f-2460b4cd4508 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:54.248019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2e3eabf7-f7b8-47b0-8f6f-2460b4cd4508 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:54.261339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3eabf7-f7b8-47b0-8f6f-2460b4cd4508 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:54.317231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:54.318077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:54.318360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:54.318642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/335f8db1ec904e99a8b8d8f6908a95e4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:54.331728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=335f8db1ec904e99a8b8d8f6908a95e4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:54.333506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:54.358199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.367887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.407727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4', 'request_id': 'req-ea206fa2-92d2-4695-83eb-799b703a4188'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.414800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4', 'request_id': 'req-ea206fa2-92d2-4695-83eb-799b703a4188'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.421868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4', 'request_id': 'req-ea206fa2-92d2-4695-83eb-799b703a4188'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.432116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project 335f8db1ec904e99a8b8d8f6908a95e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:54.432404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.433063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.441329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4', 'request_id': 'req-ea206fa2-92d2-4695-83eb-799b703a4188'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.441989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4', 'request_id': 'req-ea206fa2-92d2-4695-83eb-799b703a4188'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.445214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '335f8db1ec904e99a8b8d8f6908a95e4', 'request_id': 'req-ea206fa2-92d2-4695-83eb-799b703a4188'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.451486 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3461/6950] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:54 2021] DELETE /identity/v3/projects/335f8db1ec904e99a8b8d8f6908a95e4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:54.456506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:54.466634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce74637-cd0b-4144-8a50-d6125a0eab94 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:54.520967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a3fd1-b793-4573-bfc0-39a27ba507ec tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:54.521656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a3fd1-b793-4573-bfc0-39a27ba507ec tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:54.521945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a3fd1-b793-4573-bfc0-39a27ba507ec tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:54.522340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a3fd1-b793-4573-bfc0-39a27ba507ec tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:54.523050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a3fd1-b793-4573-bfc0-39a27ba507ec tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:54.524949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a3fd1-b793-4573-bfc0-39a27ba507ec tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:54.553472 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3490/6951] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:54 2021] POST /identity/v3/projects => generated 360 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:54.557547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:54.558947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:54.572111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea206fa2-92d2-4695-83eb-799b703a4188 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:54.626930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d20311-b4ad-4a53-9eae-5415e4a6e95c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:54.627806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20311-b4ad-4a53-9eae-5415e4a6e95c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:54.628087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20311-b4ad-4a53-9eae-5415e4a6e95c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:54.628366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20311-b4ad-4a53-9eae-5415e4a6e95c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/f9ffc87da0c747ac96f63d1889ae3e6b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:54.629568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d20311-b4ad-4a53-9eae-5415e4a6e95c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:get_project(project_id=f9ffc87da0c747ac96f63d1889ae3e6b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:54.631655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d20311-b4ad-4a53-9eae-5415e4a6e95c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:54.633329 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3462/6952] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:10:54 2021] GET /identity/v3/projects/f9ffc87da0c747ac96f63d1889ae3e6b => generated 360 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:54.637600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a3fd1-b793-4573-bfc0-39a27ba507ec tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:54.649202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a3fd1-b793-4573-bfc0-39a27ba507ec tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:54.653727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:54.654564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:54.654854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:54.655128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/f9ffc87da0c747ac96f63d1889ae3e6b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:54.656372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f9ffc87da0c747ac96f63d1889ae3e6b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:54.658922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:54.704766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ffc87da0c747ac96f63d1889ae3e6b', 'request_id': 'req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.711759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ffc87da0c747ac96f63d1889ae3e6b', 'request_id': 'req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.718202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ffc87da0c747ac96f63d1889ae3e6b', 'request_id': 'req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.728338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project f9ffc87da0c747ac96f63d1889ae3e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:54.728622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.729348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.730931 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3491/6953] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:54 2021] DELETE /identity/v3/projects/f9ffc87da0c747ac96f63d1889ae3e6b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:10:54.736459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d20311-b4ad-4a53-9eae-5415e4a6e95c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:54.738201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c7d20311-b4ad-4a53-9eae-5415e4a6e95c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:54.751535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d20311-b4ad-4a53-9eae-5415e4a6e95c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:54.806196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1a36d-bcdb-42d2-a824-87a686972030 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:54.806839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a36d-bcdb-42d2-a824-87a686972030 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:54.807119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a36d-bcdb-42d2-a824-87a686972030 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:54.807425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1a36d-bcdb-42d2-a824-87a686972030 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:54.808119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1a36d-bcdb-42d2-a824-87a686972030 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:54.810543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1a36d-bcdb-42d2-a824-87a686972030 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:54.839202 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3463/6954] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:54 2021] POST /identity/v3/projects => generated 360 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:54.843198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:54.853231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32081a-431a-49f9-a7e8-4eaf5b206c8e tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:54.908343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6238770-4eff-4f7e-b508-84ea6d67b7a1 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:54.909190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238770-4eff-4f7e-b508-84ea6d67b7a1 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:54.909479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238770-4eff-4f7e-b508-84ea6d67b7a1 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:54.909764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238770-4eff-4f7e-b508-84ea6d67b7a1 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/89ab325f5d4843a292bd257e35741914` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:54.910987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6238770-4eff-4f7e-b508-84ea6d67b7a1 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:get_project(project_id=89ab325f5d4843a292bd257e35741914)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:54.913092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6238770-4eff-4f7e-b508-84ea6d67b7a1 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:54.914813 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3492/6955] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:10:54 2021] GET /identity/v3/projects/89ab325f5d4843a292bd257e35741914 => generated 360 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:54.919645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1a36d-bcdb-42d2-a824-87a686972030 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:54.931517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1a36d-bcdb-42d2-a824-87a686972030 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:54.936837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:54.937688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:54.937970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:54.938241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/89ab325f5d4843a292bd257e35741914` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:54.939500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=89ab325f5d4843a292bd257e35741914)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:54.941605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:54.988876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ab325f5d4843a292bd257e35741914', 'request_id': 'req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:54.995295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ab325f5d4843a292bd257e35741914', 'request_id': 'req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.003931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ab325f5d4843a292bd257e35741914', 'request_id': 'req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.015136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project 89ab325f5d4843a292bd257e35741914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:55.015472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.016238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.018198 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3464/6956] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:54 2021] DELETE /identity/v3/projects/89ab325f5d4843a292bd257e35741914 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:55.023371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6238770-4eff-4f7e-b508-84ea6d67b7a1 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:55.025382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d6238770-4eff-4f7e-b508-84ea6d67b7a1 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:55.042269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6238770-4eff-4f7e-b508-84ea6d67b7a1 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:55.096080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd9a67-6861-4dbb-9d39-1a674628b6d7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:55.096738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9a67-6861-4dbb-9d39-1a674628b6d7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:55.097314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9a67-6861-4dbb-9d39-1a674628b6d7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:55.097601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9a67-6861-4dbb-9d39-1a674628b6d7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:55.098304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd9a67-6861-4dbb-9d39-1a674628b6d7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:55.100185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd9a67-6861-4dbb-9d39-1a674628b6d7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:55.129648 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3493/6957] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:10:55 2021] POST /identity/v3/projects => generated 347 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:55.133731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:55.143903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f9a97-ffe5-4b57-a2be-7c81c15f1646 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:55.199949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38eb17-657b-47e4-acb0-2db885fe531f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:55.200801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38eb17-657b-47e4-acb0-2db885fe531f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:55.201107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38eb17-657b-47e4-acb0-2db885fe531f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:55.201368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38eb17-657b-47e4-acb0-2db885fe531f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/679569eaad994ebba94082fa10eeeb32` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:55.202572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38eb17-657b-47e4-acb0-2db885fe531f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:get_project(project_id=679569eaad994ebba94082fa10eeeb32)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:55.204673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38eb17-657b-47e4-acb0-2db885fe531f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:55.206397 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3465/6958] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:10:55 2021] GET /identity/v3/projects/679569eaad994ebba94082fa10eeeb32 => generated 347 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:55.210754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd9a67-6861-4dbb-9d39-1a674628b6d7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:55.221740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd9a67-6861-4dbb-9d39-1a674628b6d7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:55.226361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:55.227139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:55.227458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:55.227733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/679569eaad994ebba94082fa10eeeb32` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:55.228917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=679569eaad994ebba94082fa10eeeb32)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:55.230946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:55.277949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679569eaad994ebba94082fa10eeeb32', 'request_id': 'req-2fe1eb92-64d1-4cd4-8943-24a9430f298a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.285806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679569eaad994ebba94082fa10eeeb32', 'request_id': 'req-2fe1eb92-64d1-4cd4-8943-24a9430f298a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.292897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679569eaad994ebba94082fa10eeeb32', 'request_id': 'req-2fe1eb92-64d1-4cd4-8943-24a9430f298a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.303498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project 679569eaad994ebba94082fa10eeeb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:55.303783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.304514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.306111 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3494/6959] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:55 2021] DELETE /identity/v3/projects/679569eaad994ebba94082fa10eeeb32 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:55.311136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38eb17-657b-47e4-acb0-2db885fe531f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:55.313315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bb38eb17-657b-47e4-acb0-2db885fe531f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:55.326554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38eb17-657b-47e4-acb0-2db885fe531f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:55.382419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9066f8-ba4e-49d7-af2c-5f228e0996f0 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:55.383089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9066f8-ba4e-49d7-af2c-5f228e0996f0 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:55.383374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9066f8-ba4e-49d7-af2c-5f228e0996f0 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:55.383647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9066f8-ba4e-49d7-af2c-5f228e0996f0 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:55.384385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9066f8-ba4e-49d7-af2c-5f228e0996f0 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:55.385975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9066f8-ba4e-49d7-af2c-5f228e0996f0 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:55.400393 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3466/6960] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 21:10:55 2021] POST /identity/v3/domains => generated 276 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:55.404987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:55.415077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1eb92-64d1-4cd4-8943-24a9430f298a tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:55.471325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c811300-0cdf-41af-ba37-464b4a7b28ac tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:55.471989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811300-0cdf-41af-ba37-464b4a7b28ac tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:55.472274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811300-0cdf-41af-ba37-464b4a7b28ac tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:55.472551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811300-0cdf-41af-ba37-464b4a7b28ac tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:55.473261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c811300-0cdf-41af-ba37-464b4a7b28ac tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:55.475164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c811300-0cdf-41af-ba37-464b4a7b28ac tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:55.508774 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3495/6961] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:55 2021] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:55.513463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9066f8-ba4e-49d7-af2c-5f228e0996f0 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:55.524306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9066f8-ba4e-49d7-af2c-5f228e0996f0 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:55.579086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62dae1-6464-46af-bf52-bfd2246dff6c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:55.580006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62dae1-6464-46af-bf52-bfd2246dff6c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:55.580322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62dae1-6464-46af-bf52-bfd2246dff6c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:55.580599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62dae1-6464-46af-bf52-bfd2246dff6c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/e9a88b1678664a33b78c31fe383e7c1d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:55.581780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62dae1-6464-46af-bf52-bfd2246dff6c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:get_project(project_id=e9a88b1678664a33b78c31fe383e7c1d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:55.583959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62dae1-6464-46af-bf52-bfd2246dff6c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:55.585625 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3467/6962] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:10:55 2021] GET /identity/v3/projects/e9a88b1678664a33b78c31fe383e7c1d => generated 405 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:55.589687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c811300-0cdf-41af-ba37-464b4a7b28ac tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:55.600462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c811300-0cdf-41af-ba37-464b4a7b28ac tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:55.605118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:55.605958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:55.606245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:55.606523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/e9a88b1678664a33b78c31fe383e7c1d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:55.607750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e9a88b1678664a33b78c31fe383e7c1d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:55.609636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:55.654407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a88b1678664a33b78c31fe383e7c1d', 'request_id': 'req-9506a2e1-3eea-4e68-86f3-66266b46fbe3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.660872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a88b1678664a33b78c31fe383e7c1d', 'request_id': 'req-9506a2e1-3eea-4e68-86f3-66266b46fbe3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.667103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a88b1678664a33b78c31fe383e7c1d', 'request_id': 'req-9506a2e1-3eea-4e68-86f3-66266b46fbe3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.676978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project e9a88b1678664a33b78c31fe383e7c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:55.677269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.677947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.679566 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3496/6963] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:55 2021] DELETE /identity/v3/projects/e9a88b1678664a33b78c31fe383e7c1d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:55.683633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62dae1-6464-46af-bf52-bfd2246dff6c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:55.685339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fc62dae1-6464-46af-bf52-bfd2246dff6c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:55.697498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62dae1-6464-46af-bf52-bfd2246dff6c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:55.751527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:55.752363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:55.752644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:55.752919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/domains/16950432f7a04242b0090eb8a5f72ed8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:55.754279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=16950432f7a04242b0090eb8a5f72ed8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:55.755903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:55.774995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.775604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.799079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.799747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.802131 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3468/6964] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:10:55 2021] PATCH /identity/v3/domains/16950432f7a04242b0090eb8a5f72ed8 => generated 277 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:10:55.806187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:55.816610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a2e1-3eea-4e68-86f3-66266b46fbe3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:55.870837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:55.871738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:55.872028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:55.872307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/domains/16950432f7a04242b0090eb8a5f72ed8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:55.883004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=16950432f7a04242b0090eb8a5f72ed8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:55.884649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:55.906515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.915929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.953439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8', 'request_id': 'req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.959756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8', 'request_id': 'req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.967318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8', 'request_id': 'req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.977048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project 16950432f7a04242b0090eb8a5f72ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:55.977329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.977970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.984911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8', 'request_id': 'req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.985552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8', 'request_id': 'req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.986170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '16950432f7a04242b0090eb8a5f72ed8', 'request_id': 'req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:55.994364 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3497/6965] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:10:55 2021] DELETE /identity/v3/domains/16950432f7a04242b0090eb8a5f72ed8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:56.000384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:56.001941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:56.014991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146e4b0-052d-4e7a-b61e-d34b6cb56949 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:56.073431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247279f1-8f8d-4b70-b2e8-dc64b0828916 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:56.074100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247279f1-8f8d-4b70-b2e8-dc64b0828916 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:56.074387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247279f1-8f8d-4b70-b2e8-dc64b0828916 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:56.074665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247279f1-8f8d-4b70-b2e8-dc64b0828916 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:56.075447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247279f1-8f8d-4b70-b2e8-dc64b0828916 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:56.077694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247279f1-8f8d-4b70-b2e8-dc64b0828916 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:56.094864 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3469/6966] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 21:10:55 2021] POST /identity/v3/domains => generated 275 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:56.096211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:56.097951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:56.111900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5fa7e-c5a8-4c0c-8bb4-8d0e84305092 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:56.166257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8bd32-a53c-45a9-b955-6122bcb63119 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:56.166919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8bd32-a53c-45a9-b955-6122bcb63119 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:56.167207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8bd32-a53c-45a9-b955-6122bcb63119 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:56.167512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8bd32-a53c-45a9-b955-6122bcb63119 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:56.168210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8bd32-a53c-45a9-b955-6122bcb63119 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:56.170612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8bd32-a53c-45a9-b955-6122bcb63119 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:56.203811 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3498/6967] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:56 2021] POST /identity/v3/projects => generated 408 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:56.207996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247279f1-8f8d-4b70-b2e8-dc64b0828916 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:56.218740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247279f1-8f8d-4b70-b2e8-dc64b0828916 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:56.274381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5624-ca1b-48b2-8abe-86e16790f64b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:56.275040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5624-ca1b-48b2-8abe-86e16790f64b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:56.275359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5624-ca1b-48b2-8abe-86e16790f64b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:56.275637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5624-ca1b-48b2-8abe-86e16790f64b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:56.276354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5624-ca1b-48b2-8abe-86e16790f64b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:56.278260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5624-ca1b-48b2-8abe-86e16790f64b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:56.311338 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3470/6968] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:56 2021] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:56.315323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8bd32-a53c-45a9-b955-6122bcb63119 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:56.326019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8bd32-a53c-45a9-b955-6122bcb63119 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:56.382749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:56.383705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:56.383986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:56.384258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/1e3fc0f5baf84bc6ac80a7c22afbfeb7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:56.385448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e3fc0f5baf84bc6ac80a7c22afbfeb7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:56.387363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:56.431528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3fc0f5baf84bc6ac80a7c22afbfeb7', 'request_id': 'req-e362e1e0-210a-4bc1-bc3c-db0c59636529'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.438970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3fc0f5baf84bc6ac80a7c22afbfeb7', 'request_id': 'req-e362e1e0-210a-4bc1-bc3c-db0c59636529'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.445552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3fc0f5baf84bc6ac80a7c22afbfeb7', 'request_id': 'req-e362e1e0-210a-4bc1-bc3c-db0c59636529'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.456066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project 1e3fc0f5baf84bc6ac80a7c22afbfeb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:56.456353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.457009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.458645 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3499/6969] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:56 2021] DELETE /identity/v3/projects/1e3fc0f5baf84bc6ac80a7c22afbfeb7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:56.462692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5624-ca1b-48b2-8abe-86e16790f64b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:56.464514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-87ea5624-ca1b-48b2-8abe-86e16790f64b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:56.476774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5624-ca1b-48b2-8abe-86e16790f64b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:56.532314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:56.533190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:56.533476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:56.533751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/344b5a441bef4cf3bf2740e91386877e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:56.534938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=344b5a441bef4cf3bf2740e91386877e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:56.536889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:56.580146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344b5a441bef4cf3bf2740e91386877e', 'request_id': 'req-b5ebd006-93a3-4428-a805-d1524b4f8b9d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.586113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344b5a441bef4cf3bf2740e91386877e', 'request_id': 'req-b5ebd006-93a3-4428-a805-d1524b4f8b9d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.593881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344b5a441bef4cf3bf2740e91386877e', 'request_id': 'req-b5ebd006-93a3-4428-a805-d1524b4f8b9d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.603713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project 344b5a441bef4cf3bf2740e91386877e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:56.604001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.604638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.606163 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3471/6970] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:56 2021] DELETE /identity/v3/projects/344b5a441bef4cf3bf2740e91386877e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:56.610870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:56.621003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362e1e0-210a-4bc1-bc3c-db0c59636529 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:56.675182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:56.676632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:56.676922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:56.677212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/domains/bccf959e60ba4c9596fe3bf60cbbfdac` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:56.678521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bccf959e60ba4c9596fe3bf60cbbfdac)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:56.680135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:56.698798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.699479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.722908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.723569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.726014 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3500/6971] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:10:56 2021] PATCH /identity/v3/domains/bccf959e60ba4c9596fe3bf60cbbfdac => generated 276 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:56.730043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:56.731489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:56.744713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebd006-93a3-4428-a805-d1524b4f8b9d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:56.800422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:56.801265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:56.801550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:56.801833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/domains/bccf959e60ba4c9596fe3bf60cbbfdac` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:56.811983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bccf959e60ba4c9596fe3bf60cbbfdac)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:56.813584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:56.834740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.844352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.881180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac', 'request_id': 'req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.887686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac', 'request_id': 'req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.895368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac', 'request_id': 'req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.905958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project bccf959e60ba4c9596fe3bf60cbbfdac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:56.906238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.906865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.913885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac', 'request_id': 'req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.914509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac', 'request_id': 'req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.917683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bccf959e60ba4c9596fe3bf60cbbfdac', 'request_id': 'req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:56.923130 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3472/6972] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:10:56 2021] DELETE /identity/v3/domains/bccf959e60ba4c9596fe3bf60cbbfdac => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:56.928368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:56.929777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:56.942570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c05fa-c199-4c6b-8138-841e2f35e244 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:56.998001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23174e0f-5514-4e94-b16d-1754b5ce34af tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:56.998670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174e0f-5514-4e94-b16d-1754b5ce34af tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:56.998953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174e0f-5514-4e94-b16d-1754b5ce34af tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:56.999228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23174e0f-5514-4e94-b16d-1754b5ce34af tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:56.999960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23174e0f-5514-4e94-b16d-1754b5ce34af tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.001797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23174e0f-5514-4e94-b16d-1754b5ce34af tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.035402 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3501/6973] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:56 2021] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:57.039547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.040951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:57.053539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3fbea-4871-478b-bfd6-a7c2cc9c1585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:57.109402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609ee7c-8045-483e-b8c2-267e0e433beb tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:57.110213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609ee7c-8045-483e-b8c2-267e0e433beb tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:57.110495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609ee7c-8045-483e-b8c2-267e0e433beb tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:57.110767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609ee7c-8045-483e-b8c2-267e0e433beb tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/7ddaf0db7cd448729cc4e14209885077` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:57.112030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609ee7c-8045-483e-b8c2-267e0e433beb tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:get_project(project_id=7ddaf0db7cd448729cc4e14209885077)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.114092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609ee7c-8045-483e-b8c2-267e0e433beb tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.115840 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3473/6974] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:10:57 2021] GET /identity/v3/projects/7ddaf0db7cd448729cc4e14209885077 => generated 377 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:57.120432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23174e0f-5514-4e94-b16d-1754b5ce34af tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.131898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23174e0f-5514-4e94-b16d-1754b5ce34af tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:57.137011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517d5b5-67e7-4fa3-b0ca-7c3888b39a4c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:57.137675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517d5b5-67e7-4fa3-b0ca-7c3888b39a4c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:57.137965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517d5b5-67e7-4fa3-b0ca-7c3888b39a4c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:57.138248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517d5b5-67e7-4fa3-b0ca-7c3888b39a4c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:57.139540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517d5b5-67e7-4fa3-b0ca-7c3888b39a4c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.141557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517d5b5-67e7-4fa3-b0ca-7c3888b39a4c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.162946 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3502/6975] 10.222.0.21 () {58 vars in 1130 bytes} [Sat Nov 27 21:10:57 2021] GET /identity/v3/projects => generated 5092 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:10:57.164037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609ee7c-8045-483e-b8c2-267e0e433beb tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.177065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609ee7c-8045-483e-b8c2-267e0e433beb tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:57.181777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:57.182617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:57.182900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:57.183174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/7ddaf0db7cd448729cc4e14209885077` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:57.184407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ddaf0db7cd448729cc4e14209885077)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.186335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.234849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ddaf0db7cd448729cc4e14209885077', 'request_id': 'req-0c34168c-2202-4113-a87e-f87ae801f1a7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.240923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ddaf0db7cd448729cc4e14209885077', 'request_id': 'req-0c34168c-2202-4113-a87e-f87ae801f1a7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.248765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ddaf0db7cd448729cc4e14209885077', 'request_id': 'req-0c34168c-2202-4113-a87e-f87ae801f1a7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.258891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project 7ddaf0db7cd448729cc4e14209885077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:57.259178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.259849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.261412 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3474/6976] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:57 2021] DELETE /identity/v3/projects/7ddaf0db7cd448729cc4e14209885077 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:57.267145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517d5b5-67e7-4fa3-b0ca-7c3888b39a4c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.269126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c517d5b5-67e7-4fa3-b0ca-7c3888b39a4c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:57.283678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517d5b5-67e7-4fa3-b0ca-7c3888b39a4c tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:57.338554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f700d-8865-4259-9846-18eb86ee649d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:57.339217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f700d-8865-4259-9846-18eb86ee649d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:57.339539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f700d-8865-4259-9846-18eb86ee649d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:57.339829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f700d-8865-4259-9846-18eb86ee649d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:57.340544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f700d-8865-4259-9846-18eb86ee649d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.342895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f700d-8865-4259-9846-18eb86ee649d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.372034 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3503/6977] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:10:57 2021] POST /identity/v3/projects => generated 347 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:57.376182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.386215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34168c-2202-4113-a87e-f87ae801f1a7 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:57.444418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f70831-752a-46af-852f-7248acddc7f8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:57.445275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f70831-752a-46af-852f-7248acddc7f8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:57.445562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f70831-752a-46af-852f-7248acddc7f8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:57.445844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f70831-752a-46af-852f-7248acddc7f8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/060aa14bc8cb44e3940c0f90fb2c0885` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:57.447349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f70831-752a-46af-852f-7248acddc7f8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:update_project(project_id=060aa14bc8cb44e3940c0f90fb2c0885)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.448252 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-e9f70831-752a-46af-852f-7248acddc7f8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:10:57.448252 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:10:57.448252 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:10:57.449439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f70831-752a-46af-852f-7248acddc7f8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.480545 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3475/6978] 10.222.0.21 () {60 vars in 1251 bytes} [Sat Nov 27 21:10:57 2021] PATCH /identity/v3/projects/060aa14bc8cb44e3940c0f90fb2c0885 => generated 361 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:57.485549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f700d-8865-4259-9846-18eb86ee649d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.496298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f700d-8865-4259-9846-18eb86ee649d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:57.500979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d0cf7-c664-4b36-8882-6e5da47354fd tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:57.501838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0cf7-c664-4b36-8882-6e5da47354fd tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:57.502111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0cf7-c664-4b36-8882-6e5da47354fd tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:57.502386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d0cf7-c664-4b36-8882-6e5da47354fd tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/060aa14bc8cb44e3940c0f90fb2c0885` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:57.513533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d0cf7-c664-4b36-8882-6e5da47354fd tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:get_project(project_id=060aa14bc8cb44e3940c0f90fb2c0885)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.515710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d0cf7-c664-4b36-8882-6e5da47354fd tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.517380 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3504/6979] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:10:57 2021] GET /identity/v3/projects/060aa14bc8cb44e3940c0f90fb2c0885 => generated 348 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:57.521378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f70831-752a-46af-852f-7248acddc7f8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.531967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f70831-752a-46af-852f-7248acddc7f8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:57.536892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:57.537733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:57.538017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:57.538297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/060aa14bc8cb44e3940c0f90fb2c0885` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:57.539531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=060aa14bc8cb44e3940c0f90fb2c0885)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.541466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.587091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060aa14bc8cb44e3940c0f90fb2c0885', 'request_id': 'req-7aa855da-968b-4618-8391-63ab7f111e6b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.593948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060aa14bc8cb44e3940c0f90fb2c0885', 'request_id': 'req-7aa855da-968b-4618-8391-63ab7f111e6b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.600666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060aa14bc8cb44e3940c0f90fb2c0885', 'request_id': 'req-7aa855da-968b-4618-8391-63ab7f111e6b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.611122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project 060aa14bc8cb44e3940c0f90fb2c0885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:57.611439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.612075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.613705 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3476/6980] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:57 2021] DELETE /identity/v3/projects/060aa14bc8cb44e3940c0f90fb2c0885 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:57.619080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d0cf7-c664-4b36-8882-6e5da47354fd tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.620992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-980d0cf7-c664-4b36-8882-6e5da47354fd tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:57.634151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d0cf7-c664-4b36-8882-6e5da47354fd tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:57.688201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78501d26-edb0-4598-bb55-b3ca35500585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:57.688856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78501d26-edb0-4598-bb55-b3ca35500585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:57.689143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78501d26-edb0-4598-bb55-b3ca35500585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:57.689428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78501d26-edb0-4598-bb55-b3ca35500585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:57.690162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78501d26-edb0-4598-bb55-b3ca35500585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.692103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78501d26-edb0-4598-bb55-b3ca35500585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.720825 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3505/6981] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:57 2021] POST /identity/v3/projects => generated 360 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:10:57.724913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.735398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa855da-968b-4618-8391-63ab7f111e6b tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:57.791363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a4f9e-b042-4672-8490-ae01f7ffc5e8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:57.792217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4f9e-b042-4672-8490-ae01f7ffc5e8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:57.792505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4f9e-b042-4672-8490-ae01f7ffc5e8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:57.792783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4f9e-b042-4672-8490-ae01f7ffc5e8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/4206ea29508c41fd96e9cf0bce2683c7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:57.794045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a4f9e-b042-4672-8490-ae01f7ffc5e8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:update_project(project_id=4206ea29508c41fd96e9cf0bce2683c7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.796032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a4f9e-b042-4672-8490-ae01f7ffc5e8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.841420 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3477/6982] 10.222.0.21 () {60 vars in 1251 bytes} [Sat Nov 27 21:10:57 2021] PATCH /identity/v3/projects/4206ea29508c41fd96e9cf0bce2683c7 => generated 372 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:57.846560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78501d26-edb0-4598-bb55-b3ca35500585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.857006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78501d26-edb0-4598-bb55-b3ca35500585 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:57.861675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00935c8-ee41-4354-a40c-2db9347e2596 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:57.862515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00935c8-ee41-4354-a40c-2db9347e2596 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:57.862799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00935c8-ee41-4354-a40c-2db9347e2596 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:57.863072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00935c8-ee41-4354-a40c-2db9347e2596 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/4206ea29508c41fd96e9cf0bce2683c7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:57.875864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00935c8-ee41-4354-a40c-2db9347e2596 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:get_project(project_id=4206ea29508c41fd96e9cf0bce2683c7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.878038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00935c8-ee41-4354-a40c-2db9347e2596 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.879807 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3506/6983] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:10:57 2021] GET /identity/v3/projects/4206ea29508c41fd96e9cf0bce2683c7 => generated 359 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:57.883762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a4f9e-b042-4672-8490-ae01f7ffc5e8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.894231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a4f9e-b042-4672-8490-ae01f7ffc5e8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:57.898743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:57.899611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:57.899893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:57.900165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/4206ea29508c41fd96e9cf0bce2683c7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:57.901351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4206ea29508c41fd96e9cf0bce2683c7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:57.903236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:57.950252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4206ea29508c41fd96e9cf0bce2683c7', 'request_id': 'req-b89177e7-7c53-42d0-9e59-584c2226715d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.958034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4206ea29508c41fd96e9cf0bce2683c7', 'request_id': 'req-b89177e7-7c53-42d0-9e59-584c2226715d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.966303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4206ea29508c41fd96e9cf0bce2683c7', 'request_id': 'req-b89177e7-7c53-42d0-9e59-584c2226715d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.977634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project 4206ea29508c41fd96e9cf0bce2683c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:57.977924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.978570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:57.980201 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3478/6984] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:57 2021] DELETE /identity/v3/projects/4206ea29508c41fd96e9cf0bce2683c7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:57.985446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00935c8-ee41-4354-a40c-2db9347e2596 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:57.987330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d00935c8-ee41-4354-a40c-2db9347e2596 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:58.000946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00935c8-ee41-4354-a40c-2db9347e2596 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:58.054973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f892a-fc00-443f-b3d4-c850957f3b5d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:58.055661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f892a-fc00-443f-b3d4-c850957f3b5d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:58.055944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f892a-fc00-443f-b3d4-c850957f3b5d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:58.056220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f892a-fc00-443f-b3d4-c850957f3b5d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:58.056919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f892a-fc00-443f-b3d4-c850957f3b5d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:58.058803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f892a-fc00-443f-b3d4-c850957f3b5d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:58.087892 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3507/6985] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:57 2021] POST /identity/v3/projects => generated 354 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:58.091939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:58.101702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89177e7-7c53-42d0-9e59-584c2226715d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:58.158883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d797b-b31b-48a7-ae90-c253edb67409 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:58.159706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d797b-b31b-48a7-ae90-c253edb67409 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:58.159991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d797b-b31b-48a7-ae90-c253edb67409 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:58.160267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d797b-b31b-48a7-ae90-c253edb67409 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/8968e5b393784cdb8b2dc6a710cf1989` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:58.161554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d797b-b31b-48a7-ae90-c253edb67409 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:update_project(project_id=8968e5b393784cdb8b2dc6a710cf1989)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:58.163489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d797b-b31b-48a7-ae90-c253edb67409 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:58.196427 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3479/6986] 10.222.0.21 () {60 vars in 1251 bytes} [Sat Nov 27 21:10:58 2021] PATCH /identity/v3/projects/8968e5b393784cdb8b2dc6a710cf1989 => generated 368 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:58.200755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f892a-fc00-443f-b3d4-c850957f3b5d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:58.212919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f892a-fc00-443f-b3d4-c850957f3b5d tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:58.218181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f52aff-2152-4a9d-90e2-f179252b62c8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:58.219583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f52aff-2152-4a9d-90e2-f179252b62c8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:58.219963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f52aff-2152-4a9d-90e2-f179252b62c8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:58.220352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f52aff-2152-4a9d-90e2-f179252b62c8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/8968e5b393784cdb8b2dc6a710cf1989` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:58.237123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f52aff-2152-4a9d-90e2-f179252b62c8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:get_project(project_id=8968e5b393784cdb8b2dc6a710cf1989)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:58.238800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f52aff-2152-4a9d-90e2-f179252b62c8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:58.240650 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3508/6987] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:10:58 2021] GET /identity/v3/projects/8968e5b393784cdb8b2dc6a710cf1989 => generated 355 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:10:58.245153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d797b-b31b-48a7-ae90-c253edb67409 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:58.259005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d797b-b31b-48a7-ae90-c253edb67409 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:58.265317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:58.266208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:58.266705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:58.267201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/projects/8968e5b393784cdb8b2dc6a710cf1989` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:58.269565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8968e5b393784cdb8b2dc6a710cf1989)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:58.271949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:58.320336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8968e5b393784cdb8b2dc6a710cf1989', 'request_id': 'req-bc9cc6a9-7166-4884-8c04-ca36b05ada08'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:58.327292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8968e5b393784cdb8b2dc6a710cf1989', 'request_id': 'req-bc9cc6a9-7166-4884-8c04-ca36b05ada08'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:58.334946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8968e5b393784cdb8b2dc6a710cf1989', 'request_id': 'req-bc9cc6a9-7166-4884-8c04-ca36b05ada08'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:58.346341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] The token cache is being invalidate because project 8968e5b393784cdb8b2dc6a710cf1989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:58.346841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:58.347686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:58.349523 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3480/6988] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:58 2021] DELETE /identity/v3/projects/8968e5b393784cdb8b2dc6a710cf1989 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:10:58.354537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f52aff-2152-4a9d-90e2-f179252b62c8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:58.357059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e1f52aff-2152-4a9d-90e2-f179252b62c8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:58.371097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f52aff-2152-4a9d-90e2-f179252b62c8 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:58.432473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c669e-a93f-4715-8687-ea29e6ce90a3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:58.433302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c669e-a93f-4715-8687-ea29e6ce90a3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:58.433582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c669e-a93f-4715-8687-ea29e6ce90a3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:58.433878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c669e-a93f-4715-8687-ea29e6ce90a3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/domains/bccf959e60ba4c9596fe3bf60cbbfdac` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:58.445574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c669e-a93f-4715-8687-ea29e6ce90a3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 21:10:58.452704 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-b96c669e-a93f-4715-8687-ea29e6ce90a3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Could not find domain: bccf959e60ba4c9596fe3bf60cbbfdac.: keystone.exception.DomainNotFound: Could not find domain: bccf959e60ba4c9596fe3bf60cbbfdac. Nov 27 21:10:58.453973 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3509/6989] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:10:58 2021] PATCH /identity/v3/domains/bccf959e60ba4c9596fe3bf60cbbfdac => generated 112 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 21:10:58.457909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:58.468576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cc6a9-7166-4884-8c04-ca36b05ada08 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:58.473322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53b74c-4e90-476b-adcf-1f0c09d0331f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db711f074b1b4d6cbf57c634e3cdf6f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '818a986a96314fa889f82fbd0a0a1123', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:58.474239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53b74c-4e90-476b-adcf-1f0c09d0331f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:58.474608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53b74c-4e90-476b-adcf-1f0c09d0331f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:58.474949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53b74c-4e90-476b-adcf-1f0c09d0331f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] PATH_INFO: `/v3/domains/16950432f7a04242b0090eb8a5f72ed8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:58.481988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53b74c-4e90-476b-adcf-1f0c09d0331f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 21:10:58.491562 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-1b53b74c-4e90-476b-adcf-1f0c09d0331f tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Could not find domain: 16950432f7a04242b0090eb8a5f72ed8.: keystone.exception.DomainNotFound: Could not find domain: 16950432f7a04242b0090eb8a5f72ed8. Nov 27 21:10:58.492799 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3481/6990] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:10:58 2021] PATCH /identity/v3/domains/16950432f7a04242b0090eb8a5f72ed8 => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 21:10:58.496847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c669e-a93f-4715-8687-ea29e6ce90a3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:58.499159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b96c669e-a93f-4715-8687-ea29e6ce90a3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:58.561156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c669e-a93f-4715-8687-ea29e6ce90a3 tempest-ProjectsTestJSON-249434405 tempest-ProjectsTestJSON-249434405-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:58.565820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:58.566658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:58.566940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:58.567213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] PATH_INFO: `/v3/users/ad499b8e631d4ba6b22e64a647af7450` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:58.568431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad499b8e631d4ba6b22e64a647af7450)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:58.570390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:58.619240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad499b8e631d4ba6b22e64a647af7450'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:58.628205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad499b8e631d4ba6b22e64a647af7450'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:58.629114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad499b8e631d4ba6b22e64a647af7450'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:58.636297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad499b8e631d4ba6b22e64a647af7450'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:58.648270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad499b8e631d4ba6b22e64a647af7450'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:58.654323 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3510/6991] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:10:58 2021] DELETE /identity/v3/users/ad499b8e631d4ba6b22e64a647af7450 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:58.658912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455e7f-682b-45a7-ac57-0832aefb2410 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:58.659230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455e7f-682b-45a7-ac57-0832aefb2410 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:58.659534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455e7f-682b-45a7-ac57-0832aefb2410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:58.678576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a2455e7f-682b-45a7-ac57-0832aefb2410 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:58.679864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a2455e7f-682b-45a7-ac57-0832aefb2410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:58.742228 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3482/6992] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:10:58.752973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:58.754371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:58.811765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021b44c-56ff-4ef2-8d13-cc95c0a4550e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:58.815445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00505774-b61a-417e-b751-ac8a3fa5ac33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:58.816088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00505774-b61a-417e-b751-ac8a3fa5ac33 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:58.816369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00505774-b61a-417e-b751-ac8a3fa5ac33 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:58.816643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00505774-b61a-417e-b751-ac8a3fa5ac33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:58.826648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00505774-b61a-417e-b751-ac8a3fa5ac33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:58.828108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00505774-b61a-417e-b751-ac8a3fa5ac33 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:58.837647 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3511/6993] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:10:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:10:59.100030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2455e7f-682b-45a7-ac57-0832aefb2410 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:59.101455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a2455e7f-682b-45a7-ac57-0832aefb2410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:59.114070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2455e7f-682b-45a7-ac57-0832aefb2410 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:59.119041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:59.119924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:59.120208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:59.120477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] PATH_INFO: `/v3/projects/eccb384080724d99820eadb5b0d2c7e4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:59.121701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccb384080724d99820eadb5b0d2c7e4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:59.123652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:59.169879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccb384080724d99820eadb5b0d2c7e4', 'request_id': 'req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.177795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccb384080724d99820eadb5b0d2c7e4', 'request_id': 'req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.185143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccb384080724d99820eadb5b0d2c7e4', 'request_id': 'req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.195161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] The token cache is being invalidate because project eccb384080724d99820eadb5b0d2c7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:59.195493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.196125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.197683 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3483/6994] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:59 2021] DELETE /identity/v3/projects/eccb384080724d99820eadb5b0d2c7e4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:59.202113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00505774-b61a-417e-b751-ac8a3fa5ac33 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:59.211596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00505774-b61a-417e-b751-ac8a3fa5ac33 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:59.268145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247b99-cb6c-44f7-9dce-3c5b792af18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:59.269038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b99-cb6c-44f7-9dce-3c5b792af18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:59.269318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b99-cb6c-44f7-9dce-3c5b792af18f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:59.269960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247b99-cb6c-44f7-9dce-3c5b792af18f admin admin] PATH_INFO: `/v3/users/db711f074b1b4d6cbf57c634e3cdf6f5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:59.270774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247b99-cb6c-44f7-9dce-3c5b792af18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db711f074b1b4d6cbf57c634e3cdf6f5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:59.272706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247b99-cb6c-44f7-9dce-3c5b792af18f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:59.320580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3e247b99-cb6c-44f7-9dce-3c5b792af18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db711f074b1b4d6cbf57c634e3cdf6f5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.330360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3e247b99-cb6c-44f7-9dce-3c5b792af18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db711f074b1b4d6cbf57c634e3cdf6f5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.331079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3e247b99-cb6c-44f7-9dce-3c5b792af18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db711f074b1b4d6cbf57c634e3cdf6f5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.338089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3e247b99-cb6c-44f7-9dce-3c5b792af18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db711f074b1b4d6cbf57c634e3cdf6f5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.351354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3e247b99-cb6c-44f7-9dce-3c5b792af18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db711f074b1b4d6cbf57c634e3cdf6f5'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.357361 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3512/6995] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:10:59 2021] DELETE /identity/v3/users/db711f074b1b4d6cbf57c634e3cdf6f5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:59.621247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:59.623742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:59.643024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c71b7-c6c9-4460-84b1-c6e59d3beaf9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:59.699167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:59.700052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:59.700336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:59.700612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] PATH_INFO: `/v3/projects/818a986a96314fa889f82fbd0a0a1123` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:59.702436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=818a986a96314fa889f82fbd0a0a1123)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:59.704390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:59.750321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818a986a96314fa889f82fbd0a0a1123', 'request_id': 'req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.756316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818a986a96314fa889f82fbd0a0a1123', 'request_id': 'req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.764258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818a986a96314fa889f82fbd0a0a1123', 'request_id': 'req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.774483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] The token cache is being invalidate because project 818a986a96314fa889f82fbd0a0a1123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:10:59.774771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.775435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-12c177a9-7a15-4505-96ea-9e1c4e6e08fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:10:59.776966 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3484/6996] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:10:59 2021] DELETE /identity/v3/projects/818a986a96314fa889f82fbd0a0a1123 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:10:59.783029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dad45-1883-42d5-b13b-7c348efe980b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:59.783416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dad45-1883-42d5-b13b-7c348efe980b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:59.783696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dad45-1883-42d5-b13b-7c348efe980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:59.801802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-520dad45-1883-42d5-b13b-7c348efe980b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:59.802912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-520dad45-1883-42d5-b13b-7c348efe980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:59.859760 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3513/6997] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:10:59.867331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b707b11-ea77-40a2-9bd8-34bf1a3a6d3c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:59.867621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b707b11-ea77-40a2-9bd8-34bf1a3a6d3c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:59.867901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b707b11-ea77-40a2-9bd8-34bf1a3a6d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:59.886445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8b707b11-ea77-40a2-9bd8-34bf1a3a6d3c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:10:59.887666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8b707b11-ea77-40a2-9bd8-34bf1a3a6d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:10:59.896124 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3485/6998] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:10:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:10:59.900115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dad45-1883-42d5-b13b-7c348efe980b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:59.909885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dad45-1883-42d5-b13b-7c348efe980b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:59.914404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9441e4-7231-4258-9285-d9cd374fecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:59.915052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9441e4-7231-4258-9285-d9cd374fecf2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:59.915369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9441e4-7231-4258-9285-d9cd374fecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:59.915650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9441e4-7231-4258-9285-d9cd374fecf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:59.916390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9441e4-7231-4258-9285-d9cd374fecf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:10:59.916698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9441e4-7231-4258-9285-d9cd374fecf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:59.918319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9441e4-7231-4258-9285-d9cd374fecf2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:59.930253 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3514/6999] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:10:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:10:59.934344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b707b11-ea77-40a2-9bd8-34bf1a3a6d3c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:59.944182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b707b11-ea77-40a2-9bd8-34bf1a3a6d3c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:10:59.948858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cd061-8583-4803-acb5-cbffcff39775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:10:59.949493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cd061-8583-4803-acb5-cbffcff39775 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:10:59.949774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cd061-8583-4803-acb5-cbffcff39775 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:10:59.950046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cd061-8583-4803-acb5-cbffcff39775 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:10:59.950735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cd061-8583-4803-acb5-cbffcff39775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:10:59.952691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cd061-8583-4803-acb5-cbffcff39775 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:10:59.977506 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3486/7000] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:10:59 2021] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:10:59.982031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9441e4-7231-4258-9285-d9cd374fecf2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:10:59.992788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9441e4-7231-4258-9285-d9cd374fecf2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.048247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c262b61-a101-4a6d-9ea6-ac3faaf00b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.048911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c262b61-a101-4a6d-9ea6-ac3faaf00b68 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.049195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c262b61-a101-4a6d-9ea6-ac3faaf00b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.049470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c262b61-a101-4a6d-9ea6-ac3faaf00b68 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.050178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c262b61-a101-4a6d-9ea6-ac3faaf00b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.052185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c262b61-a101-4a6d-9ea6-ac3faaf00b68 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.071803 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3515/7001] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:10:59 2021] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:00.076005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cd061-8583-4803-acb5-cbffcff39775 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.086381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cd061-8583-4803-acb5-cbffcff39775 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.091020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8e348-55c0-401d-ab4d-66d1ffd07d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.091789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8e348-55c0-401d-ab4d-66d1ffd07d04 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.092108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8e348-55c0-401d-ab4d-66d1ffd07d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.092410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8e348-55c0-401d-ab4d-66d1ffd07d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.093140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8e348-55c0-401d-ab4d-66d1ffd07d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.094766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8e348-55c0-401d-ab4d-66d1ffd07d04 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.104937 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3487/7002] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:00.109184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c262b61-a101-4a6d-9ea6-ac3faaf00b68 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.119195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c262b61-a101-4a6d-9ea6-ac3faaf00b68 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.124523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0ef8a-b558-4f89-9d2c-9a802f81a56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.125170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ef8a-b558-4f89-9d2c-9a802f81a56b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.125455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ef8a-b558-4f89-9d2c-9a802f81a56b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.125732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ef8a-b558-4f89-9d2c-9a802f81a56b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.126456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0ef8a-b558-4f89-9d2c-9a802f81a56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.128082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0ef8a-b558-4f89-9d2c-9a802f81a56b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.137698 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3516/7003] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:11:00.141540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8e348-55c0-401d-ab4d-66d1ffd07d04 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.151399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8e348-55c0-401d-ab4d-66d1ffd07d04 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.156081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67751d92-6ee9-4041-b717-4d09961bd630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.156942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67751d92-6ee9-4041-b717-4d09961bd630 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.157227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67751d92-6ee9-4041-b717-4d09961bd630 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.157505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67751d92-6ee9-4041-b717-4d09961bd630 admin admin] PATH_INFO: `/v3/projects/734f48230ca04e5290a8817613b7160d/users/45109102d8924385b6e9d3c7385af4cf/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.172755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67751d92-6ee9-4041-b717-4d09961bd630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734f48230ca04e5290a8817613b7160d, user_id=45109102d8924385b6e9d3c7385af4cf, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.175469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67751d92-6ee9-4041-b717-4d09961bd630 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.188496 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3488/7004] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:00 2021] PUT /identity/v3/projects/734f48230ca04e5290a8817613b7160d/users/45109102d8924385b6e9d3c7385af4cf/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:00.198525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d1d58-6c30-4b86-86e2-37740cd8d524 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.198821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d1d58-6c30-4b86-86e2-37740cd8d524 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.199102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d1d58-6c30-4b86-86e2-37740cd8d524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.225734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-417d1d58-6c30-4b86-86e2-37740cd8d524 None None] MFA Rules not processed for user `45109102d8924385b6e9d3c7385af4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:00.226929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-417d1d58-6c30-4b86-86e2-37740cd8d524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:00.289559 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3517/7005] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:00 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:00.293983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67751d92-6ee9-4041-b717-4d09961bd630 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.355997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67751d92-6ee9-4041-b717-4d09961bd630 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.361797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9b902-b610-4785-a6c6-b8965bc32912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.362455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9b902-b610-4785-a6c6-b8965bc32912 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.362739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9b902-b610-4785-a6c6-b8965bc32912 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.363019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9b902-b610-4785-a6c6-b8965bc32912 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.363771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9b902-b610-4785-a6c6-b8965bc32912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.365686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9b902-b610-4785-a6c6-b8965bc32912 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.395708 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3489/7006] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:00 2021] POST /identity/v3/projects => generated 397 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:00.399685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d1d58-6c30-4b86-86e2-37740cd8d524 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.410856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d1d58-6c30-4b86-86e2-37740cd8d524 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.466504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9d32-d686-420e-b4d6-330858d87dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.467698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9d32-d686-420e-b4d6-330858d87dde admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.467977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9d32-d686-420e-b4d6-330858d87dde admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.468245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9d32-d686-420e-b4d6-330858d87dde admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.468936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e9d32-d686-420e-b4d6-330858d87dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.470821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e9d32-d686-420e-b4d6-330858d87dde admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.490830 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3518/7007] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:11:00 2021] POST /identity/v3/users => generated 305 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:00.494963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9b902-b610-4785-a6c6-b8965bc32912 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.505299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9b902-b610-4785-a6c6-b8965bc32912 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.510040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb022b1-e8f7-41af-b77c-45a95d86dfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.510697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb022b1-e8f7-41af-b77c-45a95d86dfff admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.510986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb022b1-e8f7-41af-b77c-45a95d86dfff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.511291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb022b1-e8f7-41af-b77c-45a95d86dfff admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.512066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb022b1-e8f7-41af-b77c-45a95d86dfff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.513711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb022b1-e8f7-41af-b77c-45a95d86dfff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.525596 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3490/7008] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:00.530224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9d32-d686-420e-b4d6-330858d87dde admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.540418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9d32-d686-420e-b4d6-330858d87dde admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.545652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b04b9-3f55-4963-836b-ed91c28d49e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.546516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b04b9-3f55-4963-836b-ed91c28d49e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.546797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b04b9-3f55-4963-836b-ed91c28d49e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.547072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b04b9-3f55-4963-836b-ed91c28d49e2 admin admin] PATH_INFO: `/v3/projects/c4dee4304a8c4994b1cf50bde8853bf8/users/8988948179bb4a6abb6ad2c44f09405b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.561198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b04b9-3f55-4963-836b-ed91c28d49e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dee4304a8c4994b1cf50bde8853bf8, user_id=8988948179bb4a6abb6ad2c44f09405b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.563861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b04b9-3f55-4963-836b-ed91c28d49e2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.576193 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3519/7009] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:00 2021] PUT /identity/v3/projects/c4dee4304a8c4994b1cf50bde8853bf8/users/8988948179bb4a6abb6ad2c44f09405b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:00.580078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb022b1-e8f7-41af-b77c-45a95d86dfff admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.590516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb022b1-e8f7-41af-b77c-45a95d86dfff admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.645733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c32511-6831-4a8d-a123-f0b5ced59033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.646393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c32511-6831-4a8d-a123-f0b5ced59033 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.646676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c32511-6831-4a8d-a123-f0b5ced59033 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.646952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c32511-6831-4a8d-a123-f0b5ced59033 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.647716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c32511-6831-4a8d-a123-f0b5ced59033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.649299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c32511-6831-4a8d-a123-f0b5ced59033 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.659152 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3491/7010] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:00 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:11:00.663191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b04b9-3f55-4963-836b-ed91c28d49e2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.673955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b04b9-3f55-4963-836b-ed91c28d49e2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.678787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5525e-e6e9-497f-b663-b99057750dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.679697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5525e-e6e9-497f-b663-b99057750dac admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.679978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5525e-e6e9-497f-b663-b99057750dac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.680252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5525e-e6e9-497f-b663-b99057750dac admin admin] PATH_INFO: `/v3/projects/c4dee4304a8c4994b1cf50bde8853bf8/users/8988948179bb4a6abb6ad2c44f09405b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.682245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5525e-e6e9-497f-b663-b99057750dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dee4304a8c4994b1cf50bde8853bf8, user_id=8988948179bb4a6abb6ad2c44f09405b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.684957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5525e-e6e9-497f-b663-b99057750dac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.695061 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3520/7011] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:00 2021] PUT /identity/v3/projects/c4dee4304a8c4994b1cf50bde8853bf8/users/8988948179bb4a6abb6ad2c44f09405b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:00.706709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13c12-6818-4e05-b3c2-5231d0847d28 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.707114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13c12-6818-4e05-b3c2-5231d0847d28 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.707449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13c12-6818-4e05-b3c2-5231d0847d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.733641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-25f13c12-6818-4e05-b3c2-5231d0847d28 None None] MFA Rules not processed for user `8988948179bb4a6abb6ad2c44f09405b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:00.734836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-25f13c12-6818-4e05-b3c2-5231d0847d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:00.804635 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3492/7012] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:00 2021] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:00.809625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5525e-e6e9-497f-b663-b99057750dac admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.866347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5525e-e6e9-497f-b663-b99057750dac admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.870710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fd6b1-a9c7-46b7-a93a-bf808ce5d9e6 tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45109102d8924385b6e9d3c7385af4cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '734f48230ca04e5290a8817613b7160d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.871389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fd6b1-a9c7-46b7-a93a-bf808ce5d9e6 tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.871679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fd6b1-a9c7-46b7-a93a-bf808ce5d9e6 tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.871957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fd6b1-a9c7-46b7-a93a-bf808ce5d9e6 tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.872679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fd6b1-a9c7-46b7-a93a-bf808ce5d9e6 tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.878448 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-cf5fd6b1-a9c7-46b7-a93a-bf808ce5d9e6 tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Nov 27 21:11:00.879605 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3521/7013] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:11:00 2021] POST /identity/v3/projects => generated 136 bytes in 71 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:11:00.884728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13c12-6818-4e05-b3c2-5231d0847d28 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.894527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13c12-6818-4e05-b3c2-5231d0847d28 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.899246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc823e-6eba-4359-b1d4-aad2497a672d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8988948179bb4a6abb6ad2c44f09405b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4dee4304a8c4994b1cf50bde8853bf8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.899927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc823e-6eba-4359-b1d4-aad2497a672d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.900218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc823e-6eba-4359-b1d4-aad2497a672d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.900501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc823e-6eba-4359-b1d4-aad2497a672d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.901202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc823e-6eba-4359-b1d4-aad2497a672d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.903059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc823e-6eba-4359-b1d4-aad2497a672d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.908963 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-68cc823e-6eba-4359-b1d4-aad2497a672d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Invalid input for field 'name': '' is too short Nov 27 21:11:00.908963 ncdv-master-1 devstack@keystone.service[90122]: Failed validating 'minLength' in schema['properties']['name']: Nov 27 21:11:00.908963 ncdv-master-1 devstack@keystone.service[90122]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 27 21:11:00.908963 ncdv-master-1 devstack@keystone.service[90122]: On instance['name']: Nov 27 21:11:00.908963 ncdv-master-1 devstack@keystone.service[90122]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Nov 27 21:11:00.910129 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3493/7014] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:11:00 2021] POST /identity/v3/projects => generated 283 bytes in 26 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 27 21:11:00.914653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fd6b1-a9c7-46b7-a93a-bf808ce5d9e6 tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.925488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fd6b1-a9c7-46b7-a93a-bf808ce5d9e6 tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.930195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a7e43-dd33-45bc-ad66-2eee0320ed4a tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8988948179bb4a6abb6ad2c44f09405b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4dee4304a8c4994b1cf50bde8853bf8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.930876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a7e43-dd33-45bc-ad66-2eee0320ed4a tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.931165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a7e43-dd33-45bc-ad66-2eee0320ed4a tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.931481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a7e43-dd33-45bc-ad66-2eee0320ed4a tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.932223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a7e43-dd33-45bc-ad66-2eee0320ed4a tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.934079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a7e43-dd33-45bc-ad66-2eee0320ed4a tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.939408 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-402a7e43-dd33-45bc-ad66-2eee0320ed4a tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 27 21:11:00.939408 ncdv-master-1 devstack@keystone.service[90123]: Failed validating 'maxLength' in schema['properties']['name']: Nov 27 21:11:00.939408 ncdv-master-1 devstack@keystone.service[90123]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 27 21:11:00.939408 ncdv-master-1 devstack@keystone.service[90123]: On instance['name']: Nov 27 21:11:00.939408 ncdv-master-1 devstack@keystone.service[90123]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 27 21:11:00.940594 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3522/7015] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:11:00 2021] POST /identity/v3/projects => generated 412 bytes in 26 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 27 21:11:00.945647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc823e-6eba-4359-b1d4-aad2497a672d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:00.956636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc823e-6eba-4359-b1d4-aad2497a672d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:00.961271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ab1af-3844-41b1-9e2e-6a5dada0eed5 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8988948179bb4a6abb6ad2c44f09405b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4dee4304a8c4994b1cf50bde8853bf8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:00.962128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ab1af-3844-41b1-9e2e-6a5dada0eed5 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:00.962416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ab1af-3844-41b1-9e2e-6a5dada0eed5 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:00.962810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ab1af-3844-41b1-9e2e-6a5dada0eed5 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] PATH_INFO: `/v3/projects/09526328a592450daed459bdde1fbff5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:00.970713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ab1af-3844-41b1-9e2e-6a5dada0eed5 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09526328a592450daed459bdde1fbff5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:00.972959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ab1af-3844-41b1-9e2e-6a5dada0eed5 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:00.987804 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-760ab1af-3844-41b1-9e2e-6a5dada0eed5 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Could not find project: 09526328a592450daed459bdde1fbff5.: keystone.exception.ProjectNotFound: Could not find project: 09526328a592450daed459bdde1fbff5. Nov 27 21:11:00.989263 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3494/7016] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:00 2021] DELETE /identity/v3/projects/09526328a592450daed459bdde1fbff5 => generated 113 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:11:00.994548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a7e43-dd33-45bc-ad66-2eee0320ed4a tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:01.005916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a7e43-dd33-45bc-ad66-2eee0320ed4a tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:01.010012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572fb40-9105-45b8-ba01-d991caeb603a tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45109102d8924385b6e9d3c7385af4cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '734f48230ca04e5290a8817613b7160d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:01.010636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572fb40-9105-45b8-ba01-d991caeb603a tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:01.010922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572fb40-9105-45b8-ba01-d991caeb603a tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:01.011195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572fb40-9105-45b8-ba01-d991caeb603a tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:01.012057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572fb40-9105-45b8-ba01-d991caeb603a tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] RBAC: Authorizing `identity:list_projects()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:01.018517 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-8572fb40-9105-45b8-ba01-d991caeb603a tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Nov 27 21:11:01.019656 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3523/7017] 10.222.0.21 () {58 vars in 1130 bytes} [Sat Nov 27 21:11:00 2021] GET /identity/v3/projects => generated 135 bytes in 26 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:11:01.024408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ab1af-3844-41b1-9e2e-6a5dada0eed5 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:01.034341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ab1af-3844-41b1-9e2e-6a5dada0eed5 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:01.038828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2c30b-1574-4be6-83f4-bdd7b9707f16 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8988948179bb4a6abb6ad2c44f09405b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4dee4304a8c4994b1cf50bde8853bf8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:01.039480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2c30b-1574-4be6-83f4-bdd7b9707f16 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:01.039764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2c30b-1574-4be6-83f4-bdd7b9707f16 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:01.040035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2c30b-1574-4be6-83f4-bdd7b9707f16 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:01.040723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2c30b-1574-4be6-83f4-bdd7b9707f16 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:01.042533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2c30b-1574-4be6-83f4-bdd7b9707f16 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:01.071894 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3495/7018] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:01 2021] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:01.075940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572fb40-9105-45b8-ba01-d991caeb603a tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:01.087112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572fb40-9105-45b8-ba01-d991caeb603a tempest-ProjectsNegativeStaticTestJSON-1520985014 tempest-ProjectsNegativeStaticTestJSON-1520985014-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:01.141707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ac634-dfcc-46a9-98d1-47311c11b35d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8988948179bb4a6abb6ad2c44f09405b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4dee4304a8c4994b1cf50bde8853bf8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:01.142279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ac634-dfcc-46a9-98d1-47311c11b35d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:01.142560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ac634-dfcc-46a9-98d1-47311c11b35d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:01.142836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ac634-dfcc-46a9-98d1-47311c11b35d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:01.143555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ac634-dfcc-46a9-98d1-47311c11b35d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:01.145390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ac634-dfcc-46a9-98d1-47311c11b35d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:01.162715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.sql.core [None req-480ac634-dfcc-46a9-98d1-47311c11b35d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1241597386' for key 'project.ixu_project_name_domain_id'") Nov 27 21:11:01.162715 ncdv-master-1 devstack@keystone.service[90123]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 27 21:11:01.162715 ncdv-master-1 devstack@keystone.service[90123]: [parameters: {'id': '97db1759e7674d6eb7772b5135936f04', 'name': 'tempest-project-dup-1241597386', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 27 21:11:01.162715 ncdv-master-1 devstack@keystone.service[90123]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90123) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 27 21:11:01.174233 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-480ac634-dfcc-46a9-98d1-47311c11b35d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1241597386, project id 97db1759e7674d6eb7772b5135936f04.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1241597386, project id 97db1759e7674d6eb7772b5135936f04. Nov 27 21:11:01.175559 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3524/7019] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:11:01 2021] POST /identity/v3/projects => generated 285 bytes in 100 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 27 21:11:01.180514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2c30b-1574-4be6-83f4-bdd7b9707f16 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:01.191448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2c30b-1574-4be6-83f4-bdd7b9707f16 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:01.196059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8988948179bb4a6abb6ad2c44f09405b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4dee4304a8c4994b1cf50bde8853bf8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:01.196899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:01.197179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:01.197453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] PATH_INFO: `/v3/projects/5047b99bf99b4686913566ffdbe05915` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:01.198649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5047b99bf99b4686913566ffdbe05915)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:01.200767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:01.246493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5047b99bf99b4686913566ffdbe05915', 'request_id': 'req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:01.252694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5047b99bf99b4686913566ffdbe05915', 'request_id': 'req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:01.259804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5047b99bf99b4686913566ffdbe05915', 'request_id': 'req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:01.269758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] The token cache is being invalidate because project 5047b99bf99b4686913566ffdbe05915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:01.270052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:01.270777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e15bf97-ce50-4e5e-a8d8-7dffbee0c380 tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:01.272411 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3496/7020] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:01 2021] DELETE /identity/v3/projects/5047b99bf99b4686913566ffdbe05915 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:11:01.277290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ac634-dfcc-46a9-98d1-47311c11b35d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:01.279823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-480ac634-dfcc-46a9-98d1-47311c11b35d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:01.345829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ac634-dfcc-46a9-98d1-47311c11b35d tempest-ProjectsNegativeStaticTestJSON-1671700918 tempest-ProjectsNegativeStaticTestJSON-1671700918-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:01.400791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:01.401657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:01.402058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:01.402335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] PATH_INFO: `/v3/users/45109102d8924385b6e9d3c7385af4cf` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:01.403584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45109102d8924385b6e9d3c7385af4cf)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:01.406346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:01.454633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45109102d8924385b6e9d3c7385af4cf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:01.462329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45109102d8924385b6e9d3c7385af4cf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:01.463181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45109102d8924385b6e9d3c7385af4cf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:01.470799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45109102d8924385b6e9d3c7385af4cf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:01.482033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45109102d8924385b6e9d3c7385af4cf'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:01.488006 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3525/7021] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:11:01 2021] DELETE /identity/v3/users/45109102d8924385b6e9d3c7385af4cf => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:01.492557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f15f5-9a8f-44b1-9457-f7fcc5e6c591 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:01.492846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f15f5-9a8f-44b1-9457-f7fcc5e6c591 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:01.493146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f15f5-9a8f-44b1-9457-f7fcc5e6c591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:01.511151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-360f15f5-9a8f-44b1-9457-f7fcc5e6c591 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:01.512635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-360f15f5-9a8f-44b1-9457-f7fcc5e6c591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:01.570004 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3497/7022] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:11:01.580511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:01.581893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:01.639645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072669-aa05-4441-b77d-aeb02d637616 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:01.643325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c45f2-4986-420f-bd80-6da6e1f97a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:01.643968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c45f2-4986-420f-bd80-6da6e1f97a03 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:01.644256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c45f2-4986-420f-bd80-6da6e1f97a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:01.644535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c45f2-4986-420f-bd80-6da6e1f97a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:01.653496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c45f2-4986-420f-bd80-6da6e1f97a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:01.655526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c45f2-4986-420f-bd80-6da6e1f97a03 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:01.667847 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3526/7023] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:11:01.926963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f15f5-9a8f-44b1-9457-f7fcc5e6c591 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:01.928446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-360f15f5-9a8f-44b1-9457-f7fcc5e6c591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:01.943086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f15f5-9a8f-44b1-9457-f7fcc5e6c591 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:01.947739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:01.948712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:01.948995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:01.949266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] PATH_INFO: `/v3/projects/734f48230ca04e5290a8817613b7160d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:01.950451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734f48230ca04e5290a8817613b7160d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:01.954609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:02.001443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734f48230ca04e5290a8817613b7160d', 'request_id': 'req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.008686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734f48230ca04e5290a8817613b7160d', 'request_id': 'req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.016482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734f48230ca04e5290a8817613b7160d', 'request_id': 'req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.028683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] The token cache is being invalidate because project 734f48230ca04e5290a8817613b7160d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:02.028974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.029632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b2bef98f-3f5f-41ac-be0d-ad66a5d667f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.032187 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3498/7024] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:01 2021] DELETE /identity/v3/projects/734f48230ca04e5290a8817613b7160d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:02.036172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c45f2-4986-420f-bd80-6da6e1f97a03 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:02.046884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c45f2-4986-420f-bd80-6da6e1f97a03 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:02.103345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:02.104204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:02.104490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:02.104790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] PATH_INFO: `/v3/users/8988948179bb4a6abb6ad2c44f09405b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:02.105928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8988948179bb4a6abb6ad2c44f09405b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:02.107879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:02.154428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8988948179bb4a6abb6ad2c44f09405b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.161323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8988948179bb4a6abb6ad2c44f09405b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.161981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8988948179bb4a6abb6ad2c44f09405b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.168851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8988948179bb4a6abb6ad2c44f09405b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.180915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8988948179bb4a6abb6ad2c44f09405b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.187379 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3527/7025] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:11:02 2021] DELETE /identity/v3/users/8988948179bb4a6abb6ad2c44f09405b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:02.408183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21282d0-c7e2-479d-8160-b67c983d3447 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:02.408555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21282d0-c7e2-479d-8160-b67c983d3447 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:02.408912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21282d0-c7e2-479d-8160-b67c983d3447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:02.427568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c21282d0-c7e2-479d-8160-b67c983d3447 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:02.428901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c21282d0-c7e2-479d-8160-b67c983d3447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:02.466110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:02.467617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:02.514354 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3499/7026] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:11:02 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:02.553023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d8e33-dc78-4c2a-92ad-c44fa637a7fb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:02.558111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:02.558977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:02.559296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:02.559575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] PATH_INFO: `/v3/projects/c4dee4304a8c4994b1cf50bde8853bf8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:02.560875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4dee4304a8c4994b1cf50bde8853bf8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:02.563098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:02.563864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21282d0-c7e2-479d-8160-b67c983d3447 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:02.565310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c21282d0-c7e2-479d-8160-b67c983d3447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:02.612226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4dee4304a8c4994b1cf50bde8853bf8', 'request_id': 'req-d054e7fd-9f87-4001-bf96-518097a99f5d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.620442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4dee4304a8c4994b1cf50bde8853bf8', 'request_id': 'req-d054e7fd-9f87-4001-bf96-518097a99f5d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.626689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4dee4304a8c4994b1cf50bde8853bf8', 'request_id': 'req-d054e7fd-9f87-4001-bf96-518097a99f5d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.637279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] The token cache is being invalidate because project c4dee4304a8c4994b1cf50bde8853bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:02.637566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.638335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d054e7fd-9f87-4001-bf96-518097a99f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:02.638503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21282d0-c7e2-479d-8160-b67c983d3447 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:02.640069 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3528/7027] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:02 2021] DELETE /identity/v3/projects/c4dee4304a8c4994b1cf50bde8853bf8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:02.646158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9da88-8475-42ae-8312-00ab7c9ec82e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:02.646455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9da88-8475-42ae-8312-00ab7c9ec82e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:02.646734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9da88-8475-42ae-8312-00ab7c9ec82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:02.665522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8ac9da88-8475-42ae-8312-00ab7c9ec82e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:02.666720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8ac9da88-8475-42ae-8312-00ab7c9ec82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:02.698400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3d6b6-69fc-457e-a614-821a83897a46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:02.699130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3d6b6-69fc-457e-a614-821a83897a46 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:02.699378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3d6b6-69fc-457e-a614-821a83897a46 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:02.699657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3d6b6-69fc-457e-a614-821a83897a46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:02.702633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-38e3d6b6-69fc-457e-a614-821a83897a46 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:02.728189 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3529/7028] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:02.736391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5728c-3cb5-4148-93fc-0ffa6e6531ff None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:02.736761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5728c-3cb5-4148-93fc-0ffa6e6531ff None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:02.737041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5728c-3cb5-4148-93fc-0ffa6e6531ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:02.755086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-40b5728c-3cb5-4148-93fc-0ffa6e6531ff None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:02.756440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-40b5728c-3cb5-4148-93fc-0ffa6e6531ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:02.762801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3d6b6-69fc-457e-a614-821a83897a46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:02.764469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3d6b6-69fc-457e-a614-821a83897a46 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:02.764583 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3530/7029] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:11:02.768734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5728c-3cb5-4148-93fc-0ffa6e6531ff None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:02.772784 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3500/7030] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:11:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:11:02.778059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5728c-3cb5-4148-93fc-0ffa6e6531ff None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:02.784953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd28c9b-4331-4cd0-aaf2-1f9290477f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:02.785695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd28c9b-4331-4cd0-aaf2-1f9290477f0e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:02.786049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd28c9b-4331-4cd0-aaf2-1f9290477f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:02.786510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd28c9b-4331-4cd0-aaf2-1f9290477f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:02.787376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd28c9b-4331-4cd0-aaf2-1f9290477f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:11:02.787881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd28c9b-4331-4cd0-aaf2-1f9290477f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:02.789790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd28c9b-4331-4cd0-aaf2-1f9290477f0e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:02.820275 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3531/7031] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:11:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:11:02.825106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3d6b6-69fc-457e-a614-821a83897a46 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:02.837780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3d6b6-69fc-457e-a614-821a83897a46 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:02.842929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b53e0-b1d7-4b0d-838d-2ee1a4182e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:02.843649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b53e0-b1d7-4b0d-838d-2ee1a4182e87 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:02.843935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b53e0-b1d7-4b0d-838d-2ee1a4182e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:02.844209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b53e0-b1d7-4b0d-838d-2ee1a4182e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:02.844920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b53e0-b1d7-4b0d-838d-2ee1a4182e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:02.848034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b53e0-b1d7-4b0d-838d-2ee1a4182e87 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:02.890684 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3501/7032] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:02 2021] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:02.895064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd28c9b-4331-4cd0-aaf2-1f9290477f0e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:02.905390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd28c9b-4331-4cd0-aaf2-1f9290477f0e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:02.985915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f203d-748d-404b-affd-c47dac323d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:02.986772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f203d-748d-404b-affd-c47dac323d53 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:02.987151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f203d-748d-404b-affd-c47dac323d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:02.987928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f203d-748d-404b-affd-c47dac323d53 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:02.988612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f203d-748d-404b-affd-c47dac323d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:02.990647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f203d-748d-404b-affd-c47dac323d53 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:03.021176 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3532/7033] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:11:02 2021] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:03.025308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b53e0-b1d7-4b0d-838d-2ee1a4182e87 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:03.037176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b53e0-b1d7-4b0d-838d-2ee1a4182e87 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:03.043644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77850e75-df4b-45e9-9d12-9482005d9491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:03.044602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850e75-df4b-45e9-9d12-9482005d9491 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:03.045582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850e75-df4b-45e9-9d12-9482005d9491 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:03.046019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77850e75-df4b-45e9-9d12-9482005d9491 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:03.046920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77850e75-df4b-45e9-9d12-9482005d9491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:03.048963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77850e75-df4b-45e9-9d12-9482005d9491 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:03.069131 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3502/7034] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:03.069562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f203d-748d-404b-affd-c47dac323d53 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:03.081496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f203d-748d-404b-affd-c47dac323d53 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:03.087596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fdc76-6c11-43ad-98fa-db624edcd16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:03.088477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fdc76-6c11-43ad-98fa-db624edcd16c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:03.088925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fdc76-6c11-43ad-98fa-db624edcd16c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:03.089483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fdc76-6c11-43ad-98fa-db624edcd16c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:03.090565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fdc76-6c11-43ad-98fa-db624edcd16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:03.092458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fdc76-6c11-43ad-98fa-db624edcd16c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:03.108876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77850e75-df4b-45e9-9d12-9482005d9491 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:03.115873 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3533/7035] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:03.125028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77850e75-df4b-45e9-9d12-9482005d9491 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:03.130497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc2a53-6e1a-4817-bfe0-0a7fca434fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:03.131624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc2a53-6e1a-4817-bfe0-0a7fca434fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:03.132069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc2a53-6e1a-4817-bfe0-0a7fca434fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:03.132576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc2a53-6e1a-4817-bfe0-0a7fca434fbb admin admin] PATH_INFO: `/v3/projects/c185ca8f2ebf48c6b6736aa3d875ddce/users/80417a8268f448d7b38ed6f27c209022/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:03.152257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc2a53-6e1a-4817-bfe0-0a7fca434fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c185ca8f2ebf48c6b6736aa3d875ddce, user_id=80417a8268f448d7b38ed6f27c209022, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:03.155604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc2a53-6e1a-4817-bfe0-0a7fca434fbb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:03.175714 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3503/7036] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:03 2021] PUT /identity/v3/projects/c185ca8f2ebf48c6b6736aa3d875ddce/users/80417a8268f448d7b38ed6f27c209022/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:03.193048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a61978-11cb-4429-95c5-a53bfffa8e60 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:03.193348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a61978-11cb-4429-95c5-a53bfffa8e60 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:03.193650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a61978-11cb-4429-95c5-a53bfffa8e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:03.234385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-15a61978-11cb-4429-95c5-a53bfffa8e60 None None] MFA Rules not processed for user `80417a8268f448d7b38ed6f27c209022`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:03.235605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-15a61978-11cb-4429-95c5-a53bfffa8e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:03.347307 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3534/7037] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:03 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:03.348778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc2a53-6e1a-4817-bfe0-0a7fca434fbb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:03.438412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc2a53-6e1a-4817-bfe0-0a7fca434fbb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:03.452891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d3ef-93e9-4e1d-b336-a461dd03458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:03.453574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d3ef-93e9-4e1d-b336-a461dd03458b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:03.453857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d3ef-93e9-4e1d-b336-a461dd03458b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:03.454139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7d3ef-93e9-4e1d-b336-a461dd03458b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:03.454855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7d3ef-93e9-4e1d-b336-a461dd03458b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:03.456826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7d3ef-93e9-4e1d-b336-a461dd03458b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:03.486596 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3504/7038] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:03 2021] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:03.491772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a61978-11cb-4429-95c5-a53bfffa8e60 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:03.503916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a61978-11cb-4429-95c5-a53bfffa8e60 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:03.575046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d44f45-d2a8-4a67-abf8-fbe259e9df9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:03.575326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d44f45-d2a8-4a67-abf8-fbe259e9df9a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:03.575665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d44f45-d2a8-4a67-abf8-fbe259e9df9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:03.576317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d44f45-d2a8-4a67-abf8-fbe259e9df9a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:03.577231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d44f45-d2a8-4a67-abf8-fbe259e9df9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:03.580545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d44f45-d2a8-4a67-abf8-fbe259e9df9a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:03.616232 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3535/7039] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:11:03 2021] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:03.621625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d3ef-93e9-4e1d-b336-a461dd03458b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:03.636328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7d3ef-93e9-4e1d-b336-a461dd03458b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:03.642591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d4ba5-fd74-4ca7-b993-b600cc7cd6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:03.645826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d4ba5-fd74-4ca7-b993-b600cc7cd6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:03.645826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d4ba5-fd74-4ca7-b993-b600cc7cd6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:03.645826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d4ba5-fd74-4ca7-b993-b600cc7cd6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:03.645826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d4ba5-fd74-4ca7-b993-b600cc7cd6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:03.646999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d4ba5-fd74-4ca7-b993-b600cc7cd6d7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:03.659168 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3505/7040] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:03.663516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d44f45-d2a8-4a67-abf8-fbe259e9df9a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:03.676236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d44f45-d2a8-4a67-abf8-fbe259e9df9a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:03.680971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb3e72-270b-4fd8-ba79-3675579d974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:03.681852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb3e72-270b-4fd8-ba79-3675579d974a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:03.682424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb3e72-270b-4fd8-ba79-3675579d974a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:03.682705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb3e72-270b-4fd8-ba79-3675579d974a admin admin] PATH_INFO: `/v3/projects/76bca9e5aa3a4fc98924ab0ef29351fe/users/cc00900b4a2b49e5b7b6c2c1c82d4249/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:03.700181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb3e72-270b-4fd8-ba79-3675579d974a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bca9e5aa3a4fc98924ab0ef29351fe, user_id=cc00900b4a2b49e5b7b6c2c1c82d4249, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:03.702885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb3e72-270b-4fd8-ba79-3675579d974a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:03.719699 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3536/7041] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:03 2021] PUT /identity/v3/projects/76bca9e5aa3a4fc98924ab0ef29351fe/users/cc00900b4a2b49e5b7b6c2c1c82d4249/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:03.723907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d4ba5-fd74-4ca7-b993-b600cc7cd6d7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:03.735691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d4ba5-fd74-4ca7-b993-b600cc7cd6d7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:03.801357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89261442-8b30-4878-9ab1-abec75cca64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:03.802141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89261442-8b30-4878-9ab1-abec75cca64c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:03.802431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89261442-8b30-4878-9ab1-abec75cca64c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:03.802726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89261442-8b30-4878-9ab1-abec75cca64c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:03.803842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89261442-8b30-4878-9ab1-abec75cca64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:03.805447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89261442-8b30-4878-9ab1-abec75cca64c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:03.817246 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3506/7042] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:03 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:03.821234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb3e72-270b-4fd8-ba79-3675579d974a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:03.835363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb3e72-270b-4fd8-ba79-3675579d974a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:03.841380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b659c5-54e9-484a-a030-4475ad0c463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:03.842581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b659c5-54e9-484a-a030-4475ad0c463a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:03.843035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b659c5-54e9-484a-a030-4475ad0c463a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:03.843625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b659c5-54e9-484a-a030-4475ad0c463a admin admin] PATH_INFO: `/v3/projects/76bca9e5aa3a4fc98924ab0ef29351fe/users/cc00900b4a2b49e5b7b6c2c1c82d4249/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:03.847755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b659c5-54e9-484a-a030-4475ad0c463a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76bca9e5aa3a4fc98924ab0ef29351fe, user_id=cc00900b4a2b49e5b7b6c2c1c82d4249, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:03.850508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b659c5-54e9-484a-a030-4475ad0c463a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:03.864761 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3537/7043] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:03 2021] PUT /identity/v3/projects/76bca9e5aa3a4fc98924ab0ef29351fe/users/cc00900b4a2b49e5b7b6c2c1c82d4249/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:03.877726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765e185-53ed-45ba-9422-149aaa5cf6ef None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:03.878150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765e185-53ed-45ba-9422-149aaa5cf6ef None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:03.878536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765e185-53ed-45ba-9422-149aaa5cf6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:03.910770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1765e185-53ed-45ba-9422-149aaa5cf6ef None None] MFA Rules not processed for user `cc00900b4a2b49e5b7b6c2c1c82d4249`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:03.912143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1765e185-53ed-45ba-9422-149aaa5cf6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:03.999371 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3507/7044] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:03 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:04.004431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b659c5-54e9-484a-a030-4475ad0c463a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:04.017592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b659c5-54e9-484a-a030-4475ad0c463a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:04.022281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bf09-5f9d-4190-aeb4-ed1d2bc3c08a tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc00900b4a2b49e5b7b6c2c1c82d4249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76bca9e5aa3a4fc98924ab0ef29351fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:04.022936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bf09-5f9d-4190-aeb4-ed1d2bc3c08a tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:04.023223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bf09-5f9d-4190-aeb4-ed1d2bc3c08a tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:04.023534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05bf09-5f9d-4190-aeb4-ed1d2bc3c08a tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:04.024251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05bf09-5f9d-4190-aeb4-ed1d2bc3c08a tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:04.026098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05bf09-5f9d-4190-aeb4-ed1d2bc3c08a tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:04.065647 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3538/7045] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:04 2021] POST /identity/v3/projects => generated 359 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:04.071125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765e185-53ed-45ba-9422-149aaa5cf6ef None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:04.137855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765e185-53ed-45ba-9422-149aaa5cf6ef None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:04.202848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedd330-de5b-46a6-9ad8-5569b168f9be tempest-ProjectsNegativeTestJSON-1208829618 tempest-ProjectsNegativeTestJSON-1208829618-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80417a8268f448d7b38ed6f27c209022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c185ca8f2ebf48c6b6736aa3d875ddce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:04.203765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedd330-de5b-46a6-9ad8-5569b168f9be tempest-ProjectsNegativeTestJSON-1208829618 tempest-ProjectsNegativeTestJSON-1208829618-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:04.204055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedd330-de5b-46a6-9ad8-5569b168f9be tempest-ProjectsNegativeTestJSON-1208829618 tempest-ProjectsNegativeTestJSON-1208829618-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:04.204337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedd330-de5b-46a6-9ad8-5569b168f9be tempest-ProjectsNegativeTestJSON-1208829618 tempest-ProjectsNegativeTestJSON-1208829618-project] PATH_INFO: `/v3/projects/2e880923b2e140738b85d9d251dbc9b7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:04.205734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedd330-de5b-46a6-9ad8-5569b168f9be tempest-ProjectsNegativeTestJSON-1208829618 tempest-ProjectsNegativeTestJSON-1208829618-project] RBAC: Authorizing `identity:delete_project(project_id=2e880923b2e140738b85d9d251dbc9b7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:04.216131 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-ebedd330-de5b-46a6-9ad8-5569b168f9be tempest-ProjectsNegativeTestJSON-1208829618 tempest-ProjectsNegativeTestJSON-1208829618-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Nov 27 21:11:04.220514 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3508/7046] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:04 2021] DELETE /identity/v3/projects/2e880923b2e140738b85d9d251dbc9b7 => generated 136 bytes in 148 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:11:04.221858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bf09-5f9d-4190-aeb4-ed1d2bc3c08a tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:04.314398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05bf09-5f9d-4190-aeb4-ed1d2bc3c08a tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:04.319189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc00900b4a2b49e5b7b6c2c1c82d4249', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76bca9e5aa3a4fc98924ab0ef29351fe', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:04.320102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:04.320529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:04.320879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] PATH_INFO: `/v3/projects/2e880923b2e140738b85d9d251dbc9b7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:04.322165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2e880923b2e140738b85d9d251dbc9b7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:04.325006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:04.385377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e880923b2e140738b85d9d251dbc9b7', 'request_id': 'req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:04.395528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e880923b2e140738b85d9d251dbc9b7', 'request_id': 'req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:04.407774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e880923b2e140738b85d9d251dbc9b7', 'request_id': 'req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:04.427332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] The token cache is being invalidate because project 2e880923b2e140738b85d9d251dbc9b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:04.427332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:04.427332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e4e4fbd3-6417-43cf-bb4a-4a0bdb63b686 tempest-ProjectsNegativeTestJSON-1852025540 tempest-ProjectsNegativeTestJSON-1852025540-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:04.428662 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3539/7047] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:04 2021] DELETE /identity/v3/projects/2e880923b2e140738b85d9d251dbc9b7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:04.433889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedd330-de5b-46a6-9ad8-5569b168f9be tempest-ProjectsNegativeTestJSON-1208829618 tempest-ProjectsNegativeTestJSON-1208829618-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:04.437115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ebedd330-de5b-46a6-9ad8-5569b168f9be tempest-ProjectsNegativeTestJSON-1208829618 tempest-ProjectsNegativeTestJSON-1208829618-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:04.512693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedd330-de5b-46a6-9ad8-5569b168f9be tempest-ProjectsNegativeTestJSON-1208829618 tempest-ProjectsNegativeTestJSON-1208829618-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:04.577968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:04.579128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:04.579449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:04.579738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] PATH_INFO: `/v3/users/80417a8268f448d7b38ed6f27c209022` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:04.580982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=80417a8268f448d7b38ed6f27c209022)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:04.582935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:04.641584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80417a8268f448d7b38ed6f27c209022'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:04.642267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80417a8268f448d7b38ed6f27c209022'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:04.656221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80417a8268f448d7b38ed6f27c209022'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:04.657475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80417a8268f448d7b38ed6f27c209022'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:04.668853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80417a8268f448d7b38ed6f27c209022'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:04.697830 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3509/7048] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:11:04 2021] DELETE /identity/v3/users/80417a8268f448d7b38ed6f27c209022 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:11:04.702541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff79c0-2dff-459d-b57e-44b9a22cb771 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:04.702541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff79c0-2dff-459d-b57e-44b9a22cb771 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:04.702541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff79c0-2dff-459d-b57e-44b9a22cb771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:04.721287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7cff79c0-2dff-459d-b57e-44b9a22cb771 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:04.723063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7cff79c0-2dff-459d-b57e-44b9a22cb771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:04.790640 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3540/7049] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:11:04.798571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:04.800051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:04.873524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0197549-d540-436a-b1a3-82692f31ae8b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:04.877885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5681-5c46-46aa-9f8d-e72c8e6e1e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:04.878627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5681-5c46-46aa-9f8d-e72c8e6e1e0e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:04.878915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5681-5c46-46aa-9f8d-e72c8e6e1e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:04.879188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5681-5c46-46aa-9f8d-e72c8e6e1e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:04.891740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd5681-5c46-46aa-9f8d-e72c8e6e1e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:04.893215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd5681-5c46-46aa-9f8d-e72c8e6e1e0e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:04.903190 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3510/7050] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:11:05.220459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff79c0-2dff-459d-b57e-44b9a22cb771 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:05.222101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7cff79c0-2dff-459d-b57e-44b9a22cb771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:05.240219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff79c0-2dff-459d-b57e-44b9a22cb771 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:05.246798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:05.248068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:05.248354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:05.248634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] PATH_INFO: `/v3/projects/c185ca8f2ebf48c6b6736aa3d875ddce` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:05.249900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c185ca8f2ebf48c6b6736aa3d875ddce)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:05.251999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:05.317971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c185ca8f2ebf48c6b6736aa3d875ddce', 'request_id': 'req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:05.330430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c185ca8f2ebf48c6b6736aa3d875ddce', 'request_id': 'req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:05.338192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c185ca8f2ebf48c6b6736aa3d875ddce', 'request_id': 'req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:05.356731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] The token cache is being invalidate because project c185ca8f2ebf48c6b6736aa3d875ddce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:05.357029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:05.357772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:05.362322 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3541/7051] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:05 2021] DELETE /identity/v3/projects/c185ca8f2ebf48c6b6736aa3d875ddce => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:05.363540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5681-5c46-46aa-9f8d-e72c8e6e1e0e service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:05.375802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5681-5c46-46aa-9f8d-e72c8e6e1e0e service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:05.442444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487beb-30f0-49c5-8c58-b6131aea8b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:05.443401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487beb-30f0-49c5-8c58-b6131aea8b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:05.443672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487beb-30f0-49c5-8c58-b6131aea8b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:05.443947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487beb-30f0-49c5-8c58-b6131aea8b31 admin admin] PATH_INFO: `/v3/users/cc00900b4a2b49e5b7b6c2c1c82d4249` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:05.445392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb487beb-30f0-49c5-8c58-b6131aea8b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc00900b4a2b49e5b7b6c2c1c82d4249)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:05.447642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb487beb-30f0-49c5-8c58-b6131aea8b31 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:05.502758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb487beb-30f0-49c5-8c58-b6131aea8b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc00900b4a2b49e5b7b6c2c1c82d4249'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:05.503681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb487beb-30f0-49c5-8c58-b6131aea8b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc00900b4a2b49e5b7b6c2c1c82d4249'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:05.512040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb487beb-30f0-49c5-8c58-b6131aea8b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc00900b4a2b49e5b7b6c2c1c82d4249'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:05.512705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb487beb-30f0-49c5-8c58-b6131aea8b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc00900b4a2b49e5b7b6c2c1c82d4249'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:05.521204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cb487beb-30f0-49c5-8c58-b6131aea8b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc00900b4a2b49e5b7b6c2c1c82d4249'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:05.547338 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3511/7052] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:11:05 2021] DELETE /identity/v3/users/cc00900b4a2b49e5b7b6c2c1c82d4249 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:05.858456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:05.860139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:05.879914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2ae0c-d2c5-4ee7-b88c-318f23d52807 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:05.954471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:05.955366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:05.955693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:05.955970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] PATH_INFO: `/v3/projects/76bca9e5aa3a4fc98924ab0ef29351fe` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:05.957290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=76bca9e5aa3a4fc98924ab0ef29351fe)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:05.959192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.017303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76bca9e5aa3a4fc98924ab0ef29351fe', 'request_id': 'req-8591af15-cb66-42dc-9bf2-dae13992d8ec'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:06.027225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76bca9e5aa3a4fc98924ab0ef29351fe', 'request_id': 'req-8591af15-cb66-42dc-9bf2-dae13992d8ec'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:06.034152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76bca9e5aa3a4fc98924ab0ef29351fe', 'request_id': 'req-8591af15-cb66-42dc-9bf2-dae13992d8ec'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:06.047786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] The token cache is being invalidate because project 76bca9e5aa3a4fc98924ab0ef29351fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:06.048119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:06.048778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8591af15-cb66-42dc-9bf2-dae13992d8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:06.050384 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3542/7053] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:05 2021] DELETE /identity/v3/projects/76bca9e5aa3a4fc98924ab0ef29351fe => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:06.057992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b884185-e03d-493f-bc19-2f79a3e056de None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.058360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b884185-e03d-493f-bc19-2f79a3e056de None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.058797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b884185-e03d-493f-bc19-2f79a3e056de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.080728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7b884185-e03d-493f-bc19-2f79a3e056de None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:06.082080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7b884185-e03d-493f-bc19-2f79a3e056de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:06.156768 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3512/7054] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:06.164430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5ce70-bacb-4fc5-a9ec-dacace61f870 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.164869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5ce70-bacb-4fc5-a9ec-dacace61f870 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.165249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5ce70-bacb-4fc5-a9ec-dacace61f870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.186040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f5e5ce70-bacb-4fc5-a9ec-dacace61f870 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:06.187525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f5e5ce70-bacb-4fc5-a9ec-dacace61f870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:06.198763 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3543/7055] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:11:06.199981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b884185-e03d-493f-bc19-2f79a3e056de None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.210380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b884185-e03d-493f-bc19-2f79a3e056de None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.215960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cd1f8-e43a-4c4a-8d6a-b998a70b372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.216946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cd1f8-e43a-4c4a-8d6a-b998a70b372d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.217326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cd1f8-e43a-4c4a-8d6a-b998a70b372d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.217700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cd1f8-e43a-4c4a-8d6a-b998a70b372d admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.218560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cd1f8-e43a-4c4a-8d6a-b998a70b372d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:11:06.218956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cd1f8-e43a-4c4a-8d6a-b998a70b372d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.220754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cd1f8-e43a-4c4a-8d6a-b998a70b372d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.233845 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3513/7056] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:11:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:11:06.238738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5ce70-bacb-4fc5-a9ec-dacace61f870 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.249014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5ce70-bacb-4fc5-a9ec-dacace61f870 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.253836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ccc18-e596-4ed1-907f-1df375c3da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.254485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ccc18-e596-4ed1-907f-1df375c3da00 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.254767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ccc18-e596-4ed1-907f-1df375c3da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.255042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ccc18-e596-4ed1-907f-1df375c3da00 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.255868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ccc18-e596-4ed1-907f-1df375c3da00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.257754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ccc18-e596-4ed1-907f-1df375c3da00 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.295799 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3544/7057] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:06 2021] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:06.300927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cd1f8-e43a-4c4a-8d6a-b998a70b372d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.312569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cd1f8-e43a-4c4a-8d6a-b998a70b372d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.374746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d6731-b9fc-4aab-b901-afe3086010de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.375460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d6731-b9fc-4aab-b901-afe3086010de admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.375717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d6731-b9fc-4aab-b901-afe3086010de admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.376152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d6731-b9fc-4aab-b901-afe3086010de admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.376742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d6731-b9fc-4aab-b901-afe3086010de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.378658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d6731-b9fc-4aab-b901-afe3086010de admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.410027 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3514/7058] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:11:06 2021] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:06.411235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ccc18-e596-4ed1-907f-1df375c3da00 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.423061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ccc18-e596-4ed1-907f-1df375c3da00 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.436273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0ab3a-0c4c-4f67-b804-cd3e66d3f9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.437023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0ab3a-0c4c-4f67-b804-cd3e66d3f9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.437463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0ab3a-0c4c-4f67-b804-cd3e66d3f9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.437736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0ab3a-0c4c-4f67-b804-cd3e66d3f9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.439340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0ab3a-0c4c-4f67-b804-cd3e66d3f9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.446696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0ab3a-0c4c-4f67-b804-cd3e66d3f9c6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.454184 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3545/7059] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:06 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:06.457978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d6731-b9fc-4aab-b901-afe3086010de admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.471332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d6731-b9fc-4aab-b901-afe3086010de admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.476193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf9ba4-78d3-4032-9e65-627236a348d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.476963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf9ba4-78d3-4032-9e65-627236a348d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.477313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf9ba4-78d3-4032-9e65-627236a348d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.477674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf9ba4-78d3-4032-9e65-627236a348d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.478572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf9ba4-78d3-4032-9e65-627236a348d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.480274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf9ba4-78d3-4032-9e65-627236a348d3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.491841 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3515/7060] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:06 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:11:06.495941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0ab3a-0c4c-4f67-b804-cd3e66d3f9c6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.506882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0ab3a-0c4c-4f67-b804-cd3e66d3f9c6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.516403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494e48e-fc0c-4a5f-8304-b277587a9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.517393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e48e-fc0c-4a5f-8304-b277587a9def admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.517740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e48e-fc0c-4a5f-8304-b277587a9def admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.518022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e48e-fc0c-4a5f-8304-b277587a9def admin admin] PATH_INFO: `/v3/projects/90e090dbcdb44f3a8e9abcf01a9ed8e2/users/a3983885908747759806973f4c8b3ea6/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.542769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494e48e-fc0c-4a5f-8304-b277587a9def admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e090dbcdb44f3a8e9abcf01a9ed8e2, user_id=a3983885908747759806973f4c8b3ea6, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.546122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494e48e-fc0c-4a5f-8304-b277587a9def admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.562105 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3546/7061] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:06 2021] PUT /identity/v3/projects/90e090dbcdb44f3a8e9abcf01a9ed8e2/users/a3983885908747759806973f4c8b3ea6/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:11:06.574348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89abf3-2b89-4161-8606-bd7e27d984ff None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.574912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89abf3-2b89-4161-8606-bd7e27d984ff None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.575309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89abf3-2b89-4161-8606-bd7e27d984ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.604999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-db89abf3-2b89-4161-8606-bd7e27d984ff None None] MFA Rules not processed for user `a3983885908747759806973f4c8b3ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:06.606211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-db89abf3-2b89-4161-8606-bd7e27d984ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:06.689389 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3516/7062] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:06 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:06.690250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494e48e-fc0c-4a5f-8304-b277587a9def admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.701352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494e48e-fc0c-4a5f-8304-b277587a9def admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.705751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010dcc5-1645-4303-935f-e5312cf9892a tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.706685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010dcc5-1645-4303-935f-e5312cf9892a tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.706973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010dcc5-1645-4303-935f-e5312cf9892a tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.707284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010dcc5-1645-4303-935f-e5312cf9892a tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.707974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010dcc5-1645-4303-935f-e5312cf9892a tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=a3983885908747759806973f4c8b3ea6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.709594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010dcc5-1645-4303-935f-e5312cf9892a tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.740645 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3547/7063] 10.222.0.21 () {60 vars in 1298 bytes} [Sat Nov 27 21:11:06 2021] POST /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2 => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:06.742060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89abf3-2b89-4161-8606-bd7e27d984ff None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.752800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89abf3-2b89-4161-8606-bd7e27d984ff None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.759273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e99c3-4882-417a-aa0a-0421ac04d0de tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.760541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e99c3-4882-417a-aa0a-0421ac04d0de tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.760905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e99c3-4882-417a-aa0a-0421ac04d0de tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.761252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e99c3-4882-417a-aa0a-0421ac04d0de tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/278583fc640749bf9992142c5f6dcf01` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.764227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e99c3-4882-417a-aa0a-0421ac04d0de tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=a3983885908747759806973f4c8b3ea6, credential_id=278583fc640749bf9992142c5f6dcf01)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.765726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e99c3-4882-417a-aa0a-0421ac04d0de tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.795962 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3517/7064] 10.222.0.21 () {58 vars in 1379 bytes} [Sat Nov 27 21:11:06 2021] DELETE /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/278583fc640749bf9992142c5f6dcf01 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:06.800197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010dcc5-1645-4303-935f-e5312cf9892a tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.809590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010dcc5-1645-4303-935f-e5312cf9892a tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.814800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4b227-f42d-4478-8139-fbdf6a4cd7e9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.815675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b227-f42d-4478-8139-fbdf6a4cd7e9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.815965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b227-f42d-4478-8139-fbdf6a4cd7e9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.816241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b227-f42d-4478-8139-fbdf6a4cd7e9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.816931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4b227-f42d-4478-8139-fbdf6a4cd7e9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=a3983885908747759806973f4c8b3ea6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.819344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4b227-f42d-4478-8139-fbdf6a4cd7e9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.839093 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3548/7065] 10.222.0.21 () {60 vars in 1298 bytes} [Sat Nov 27 21:11:06 2021] POST /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2 => generated 367 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:06.844828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e99c3-4882-417a-aa0a-0421ac04d0de tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.854685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e99c3-4882-417a-aa0a-0421ac04d0de tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.862894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24430032-92e5-49b5-a16e-c286353ed51e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.862894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24430032-92e5-49b5-a16e-c286353ed51e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.862894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24430032-92e5-49b5-a16e-c286353ed51e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.864001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24430032-92e5-49b5-a16e-c286353ed51e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/77daf5cefc0a467da54ac0c30d68c835` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.865041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24430032-92e5-49b5-a16e-c286353ed51e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=a3983885908747759806973f4c8b3ea6, credential_id=77daf5cefc0a467da54ac0c30d68c835)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.866635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24430032-92e5-49b5-a16e-c286353ed51e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.888568 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3518/7066] 10.222.0.21 () {58 vars in 1379 bytes} [Sat Nov 27 21:11:06 2021] DELETE /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/77daf5cefc0a467da54ac0c30d68c835 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:06.891688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4b227-f42d-4478-8139-fbdf6a4cd7e9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.901717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4b227-f42d-4478-8139-fbdf6a4cd7e9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.906012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184beb4e-8c31-42d3-95a6-9e5e9b3922f6 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.907105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184beb4e-8c31-42d3-95a6-9e5e9b3922f6 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.907521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184beb4e-8c31-42d3-95a6-9e5e9b3922f6 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.907870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184beb4e-8c31-42d3-95a6-9e5e9b3922f6 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/77daf5cefc0a467da54ac0c30d68c835` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.925383 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-184beb4e-8c31-42d3-95a6-9e5e9b3922f6 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Could not find credential: 5479215b58f9b6d8920f6458a28705820cc7160a1b682fa5b1ad215ecdd0288e.: keystone.exception.CredentialNotFound: Could not find credential: 5479215b58f9b6d8920f6458a28705820cc7160a1b682fa5b1ad215ecdd0288e. Nov 27 21:11:06.930690 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3549/7067] 10.222.0.21 () {58 vars in 1376 bytes} [Sat Nov 27 21:11:06 2021] GET /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/77daf5cefc0a467da54ac0c30d68c835 => generated 148 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 21:11:06.932133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24430032-92e5-49b5-a16e-c286353ed51e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.944504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24430032-92e5-49b5-a16e-c286353ed51e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.949243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fccc11-5821-4577-ac7a-6de7dfce44d9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.950125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fccc11-5821-4577-ac7a-6de7dfce44d9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.950402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fccc11-5821-4577-ac7a-6de7dfce44d9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.950675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fccc11-5821-4577-ac7a-6de7dfce44d9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.952566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fccc11-5821-4577-ac7a-6de7dfce44d9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=a3983885908747759806973f4c8b3ea6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.954154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fccc11-5821-4577-ac7a-6de7dfce44d9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:06.974271 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3519/7068] 10.222.0.21 () {60 vars in 1298 bytes} [Sat Nov 27 21:11:06 2021] POST /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2 => generated 367 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:06.975474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184beb4e-8c31-42d3-95a6-9e5e9b3922f6 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:06.985867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184beb4e-8c31-42d3-95a6-9e5e9b3922f6 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:06.990565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9b215-b2fd-48c3-99e2-ecc8863cc863 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:06.991545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9b215-b2fd-48c3-99e2-ecc8863cc863 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:06.991906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9b215-b2fd-48c3-99e2-ecc8863cc863 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:06.992258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9b215-b2fd-48c3-99e2-ecc8863cc863 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:06.993076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9b215-b2fd-48c3-99e2-ecc8863cc863 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=a3983885908747759806973f4c8b3ea6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:06.994974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9b215-b2fd-48c3-99e2-ecc8863cc863 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:07.015213 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3550/7069] 10.222.0.21 () {60 vars in 1298 bytes} [Sat Nov 27 21:11:06 2021] POST /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2 => generated 367 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:07.019365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fccc11-5821-4577-ac7a-6de7dfce44d9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:07.034459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fccc11-5821-4577-ac7a-6de7dfce44d9 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:07.039073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0106b-68a1-4a9f-ab9f-b473aee89ad2 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:07.039933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0106b-68a1-4a9f-ab9f-b473aee89ad2 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:07.040217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0106b-68a1-4a9f-ab9f-b473aee89ad2 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:07.040497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0106b-68a1-4a9f-ab9f-b473aee89ad2 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:07.041224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0106b-68a1-4a9f-ab9f-b473aee89ad2 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=a3983885908747759806973f4c8b3ea6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:07.043195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0106b-68a1-4a9f-ab9f-b473aee89ad2 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:07.062646 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3520/7070] 10.222.0.21 () {58 vars in 1277 bytes} [Sat Nov 27 21:11:07 2021] GET /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2 => generated 865 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:11:07.064270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9b215-b2fd-48c3-99e2-ecc8863cc863 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:07.075510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9b215-b2fd-48c3-99e2-ecc8863cc863 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:07.080140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85409206-5252-49c3-93fc-bb370409aa12 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:07.081187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85409206-5252-49c3-93fc-bb370409aa12 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:07.081486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85409206-5252-49c3-93fc-bb370409aa12 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:07.081769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85409206-5252-49c3-93fc-bb370409aa12 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/87363bb0efa346e7af93a2cd40d1466f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:07.083980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85409206-5252-49c3-93fc-bb370409aa12 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=a3983885908747759806973f4c8b3ea6, credential_id=87363bb0efa346e7af93a2cd40d1466f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:07.085418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85409206-5252-49c3-93fc-bb370409aa12 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:07.104610 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3551/7071] 10.222.0.21 () {58 vars in 1379 bytes} [Sat Nov 27 21:11:07 2021] DELETE /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/87363bb0efa346e7af93a2cd40d1466f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:07.109012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0106b-68a1-4a9f-ab9f-b473aee89ad2 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:07.120165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0106b-68a1-4a9f-ab9f-b473aee89ad2 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:07.125093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de662f8f-219c-435d-bfcf-af9966ec6736 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:07.127299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de662f8f-219c-435d-bfcf-af9966ec6736 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:07.127299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de662f8f-219c-435d-bfcf-af9966ec6736 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:07.127299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de662f8f-219c-435d-bfcf-af9966ec6736 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/9100b60fcd2d4be4a5aa90ae27ead672` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:07.128791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de662f8f-219c-435d-bfcf-af9966ec6736 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=a3983885908747759806973f4c8b3ea6, credential_id=9100b60fcd2d4be4a5aa90ae27ead672)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:07.130293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de662f8f-219c-435d-bfcf-af9966ec6736 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:07.151383 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3521/7072] 10.222.0.21 () {58 vars in 1379 bytes} [Sat Nov 27 21:11:07 2021] DELETE /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/9100b60fcd2d4be4a5aa90ae27ead672 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:07.155428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85409206-5252-49c3-93fc-bb370409aa12 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:07.165530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85409206-5252-49c3-93fc-bb370409aa12 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:07.170007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcfdbe-b5cd-4fc2-9a05-899561260747 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:07.170831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcfdbe-b5cd-4fc2-9a05-899561260747 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:07.171139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcfdbe-b5cd-4fc2-9a05-899561260747 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:07.171587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dcfdbe-b5cd-4fc2-9a05-899561260747 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:07.172546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcfdbe-b5cd-4fc2-9a05-899561260747 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=a3983885908747759806973f4c8b3ea6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:07.174050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dcfdbe-b5cd-4fc2-9a05-899561260747 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:07.195578 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3552/7073] 10.222.0.21 () {60 vars in 1298 bytes} [Sat Nov 27 21:11:07 2021] POST /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2 => generated 367 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:07.196811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de662f8f-219c-435d-bfcf-af9966ec6736 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:07.208737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de662f8f-219c-435d-bfcf-af9966ec6736 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:07.213734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f01d8-b08b-4dd0-9691-423754d6606d tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:07.214752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f01d8-b08b-4dd0-9691-423754d6606d tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:07.215038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f01d8-b08b-4dd0-9691-423754d6606d tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:07.215355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f01d8-b08b-4dd0-9691-423754d6606d tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/eb37d9aa6a9641149e0f660d1fac5b60` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:07.218116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f01d8-b08b-4dd0-9691-423754d6606d tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=a3983885908747759806973f4c8b3ea6, credential_id=eb37d9aa6a9641149e0f660d1fac5b60)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:07.219741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f01d8-b08b-4dd0-9691-423754d6606d tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:07.222899 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3522/7074] 10.222.0.21 () {58 vars in 1376 bytes} [Sat Nov 27 21:11:07 2021] GET /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/eb37d9aa6a9641149e0f660d1fac5b60 => generated 367 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:11:07.227594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcfdbe-b5cd-4fc2-9a05-899561260747 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:07.242125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dcfdbe-b5cd-4fc2-9a05-899561260747 tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:07.247211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f41c56-7913-4000-a253-334a5028bb2e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3983885908747759806973f4c8b3ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:07.248571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f41c56-7913-4000-a253-334a5028bb2e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:07.249076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f41c56-7913-4000-a253-334a5028bb2e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:07.249403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f41c56-7913-4000-a253-334a5028bb2e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/eb37d9aa6a9641149e0f660d1fac5b60` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:07.252844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f41c56-7913-4000-a253-334a5028bb2e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=a3983885908747759806973f4c8b3ea6, credential_id=eb37d9aa6a9641149e0f660d1fac5b60)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:07.253999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f41c56-7913-4000-a253-334a5028bb2e tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:07.272530 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3553/7075] 10.222.0.21 () {58 vars in 1379 bytes} [Sat Nov 27 21:11:07 2021] DELETE /identity/v3/users/a3983885908747759806973f4c8b3ea6/credentials/OS-EC2/eb37d9aa6a9641149e0f660d1fac5b60 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:07.277784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f01d8-b08b-4dd0-9691-423754d6606d tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:07.354021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f01d8-b08b-4dd0-9691-423754d6606d tempest-EC2CredentialsTest-257511894 tempest-EC2CredentialsTest-257511894-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:07.359159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:07.360180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:07.360436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:07.360707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] PATH_INFO: `/v3/users/a3983885908747759806973f4c8b3ea6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:07.363511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3983885908747759806973f4c8b3ea6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:07.365743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:07.435914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3983885908747759806973f4c8b3ea6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:07.437632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3983885908747759806973f4c8b3ea6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:07.452665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3983885908747759806973f4c8b3ea6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:07.454108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3983885908747759806973f4c8b3ea6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:07.463145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3983885908747759806973f4c8b3ea6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:07.482354 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3523/7076] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:11:07 2021] DELETE /identity/v3/users/a3983885908747759806973f4c8b3ea6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:11:07.486969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc0e6-2533-4f6e-97f0-aa1ff8717d15 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:07.487277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc0e6-2533-4f6e-97f0-aa1ff8717d15 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:07.487713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc0e6-2533-4f6e-97f0-aa1ff8717d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:07.513059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-495fc0e6-2533-4f6e-97f0-aa1ff8717d15 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:07.516025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-495fc0e6-2533-4f6e-97f0-aa1ff8717d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:07.585331 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3554/7077] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:07.595395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:07.596948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:07.666456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137aa3b-6120-405d-8ade-200164705979 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:07.672024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28cc6a-7779-4eb3-a5fe-45ea522f699f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:07.673574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28cc6a-7779-4eb3-a5fe-45ea522f699f service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:07.673960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28cc6a-7779-4eb3-a5fe-45ea522f699f service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:07.674336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28cc6a-7779-4eb3-a5fe-45ea522f699f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:07.687677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28cc6a-7779-4eb3-a5fe-45ea522f699f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:07.689542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28cc6a-7779-4eb3-a5fe-45ea522f699f service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:07.700519 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3524/7078] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:11:08.047434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc0e6-2533-4f6e-97f0-aa1ff8717d15 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:08.051776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-495fc0e6-2533-4f6e-97f0-aa1ff8717d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:08.067980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc0e6-2533-4f6e-97f0-aa1ff8717d15 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:08.080095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:08.080983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.081270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.081547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] PATH_INFO: `/v3/projects/90e090dbcdb44f3a8e9abcf01a9ed8e2` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.082798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e090dbcdb44f3a8e9abcf01a9ed8e2)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:08.085117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:08.143601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'request_id': 'req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:08.153024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'request_id': 'req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:08.160894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e090dbcdb44f3a8e9abcf01a9ed8e2', 'request_id': 'req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:08.173411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] The token cache is being invalidate because project 90e090dbcdb44f3a8e9abcf01a9ed8e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:08.173819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:08.174588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-518a231a-e8eb-4bd7-84f2-9ac901f7ac12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:08.182661 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3555/7079] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:08 2021] DELETE /identity/v3/projects/90e090dbcdb44f3a8e9abcf01a9ed8e2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:08.184713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139aec-c5a0-4477-8539-78e1a8663fa8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.185672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139aec-c5a0-4477-8539-78e1a8663fa8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.186141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139aec-c5a0-4477-8539-78e1a8663fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.205838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-31139aec-c5a0-4477-8539-78e1a8663fa8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:08.207163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-31139aec-c5a0-4477-8539-78e1a8663fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:08.271514 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3525/7080] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:08.279706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0819eb2-2858-4f1d-bd9d-1ff109bc4bc1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.280004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0819eb2-2858-4f1d-bd9d-1ff109bc4bc1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.280286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0819eb2-2858-4f1d-bd9d-1ff109bc4bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.307081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f0819eb2-2858-4f1d-bd9d-1ff109bc4bc1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:08.308389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f0819eb2-2858-4f1d-bd9d-1ff109bc4bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:08.316870 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3556/7081] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:08.321327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31139aec-c5a0-4477-8539-78e1a8663fa8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:08.333212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31139aec-c5a0-4477-8539-78e1a8663fa8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:08.338213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5448f3-ab9c-460d-838e-82f1b8e6605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:08.338903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5448f3-ab9c-460d-838e-82f1b8e6605b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.339189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5448f3-ab9c-460d-838e-82f1b8e6605b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.339508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5448f3-ab9c-460d-838e-82f1b8e6605b admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.340267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5448f3-ab9c-460d-838e-82f1b8e6605b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:11:08.340648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5448f3-ab9c-460d-838e-82f1b8e6605b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:08.342979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5448f3-ab9c-460d-838e-82f1b8e6605b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:08.357713 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3526/7082] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:11:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:11:08.362084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0819eb2-2858-4f1d-bd9d-1ff109bc4bc1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:08.372319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0819eb2-2858-4f1d-bd9d-1ff109bc4bc1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:08.377497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954243-12f3-4572-ab3f-fb8720d16c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:08.378178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954243-12f3-4572-ab3f-fb8720d16c19 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.378459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954243-12f3-4572-ab3f-fb8720d16c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.378732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954243-12f3-4572-ab3f-fb8720d16c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.379511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31954243-12f3-4572-ab3f-fb8720d16c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:08.381458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31954243-12f3-4572-ab3f-fb8720d16c19 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:08.420221 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3557/7083] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:08 2021] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:08.421771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5448f3-ab9c-460d-838e-82f1b8e6605b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:08.435189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5448f3-ab9c-460d-838e-82f1b8e6605b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:08.504616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb975-104e-43a5-8672-11998e9e0312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:08.507887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb975-104e-43a5-8672-11998e9e0312 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.507887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb975-104e-43a5-8672-11998e9e0312 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.507887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb975-104e-43a5-8672-11998e9e0312 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.507887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deb975-104e-43a5-8672-11998e9e0312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:08.509034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14deb975-104e-43a5-8672-11998e9e0312 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:08.533559 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3527/7084] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:11:08 2021] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:08.534582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954243-12f3-4572-ab3f-fb8720d16c19 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:08.545008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954243-12f3-4572-ab3f-fb8720d16c19 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:08.550428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bbd53-a109-4a31-9f6e-a691c929f44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:08.551353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bbd53-a109-4a31-9f6e-a691c929f44a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.551694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bbd53-a109-4a31-9f6e-a691c929f44a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.551979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bbd53-a109-4a31-9f6e-a691c929f44a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.552913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bbd53-a109-4a31-9f6e-a691c929f44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:08.554424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bbd53-a109-4a31-9f6e-a691c929f44a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:08.567329 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3558/7085] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:08 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:11:08.570985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb975-104e-43a5-8672-11998e9e0312 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:08.582273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14deb975-104e-43a5-8672-11998e9e0312 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:08.587188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc921a-1a34-44f1-9420-34ab4e6119ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:08.587890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc921a-1a34-44f1-9420-34ab4e6119ef admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.588177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc921a-1a34-44f1-9420-34ab4e6119ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.588462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc921a-1a34-44f1-9420-34ab4e6119ef admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.589202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc921a-1a34-44f1-9420-34ab4e6119ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:08.590814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc921a-1a34-44f1-9420-34ab4e6119ef admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:08.602143 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3528/7086] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:11:08.606323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bbd53-a109-4a31-9f6e-a691c929f44a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:08.617619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bbd53-a109-4a31-9f6e-a691c929f44a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:08.623477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9719a83-e0b5-4d59-bc15-19bdd6634843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:08.624342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9719a83-e0b5-4d59-bc15-19bdd6634843 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.624619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9719a83-e0b5-4d59-bc15-19bdd6634843 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.624904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9719a83-e0b5-4d59-bc15-19bdd6634843 admin admin] PATH_INFO: `/v3/projects/54c9b162de4a4339bdaeaa399cc1b226/users/025a1db87ca94deea22d70f820b08dc0/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.643437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9719a83-e0b5-4d59-bc15-19bdd6634843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c9b162de4a4339bdaeaa399cc1b226, user_id=025a1db87ca94deea22d70f820b08dc0, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:08.646115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9719a83-e0b5-4d59-bc15-19bdd6634843 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:08.665233 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3559/7087] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:08 2021] PUT /identity/v3/projects/54c9b162de4a4339bdaeaa399cc1b226/users/025a1db87ca94deea22d70f820b08dc0/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:08.677582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c892-43e3-4d59-baa2-3afe4063db28 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.677901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c892-43e3-4d59-baa2-3afe4063db28 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.678185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c892-43e3-4d59-baa2-3afe4063db28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.709256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0c92c892-43e3-4d59-baa2-3afe4063db28 None None] MFA Rules not processed for user `025a1db87ca94deea22d70f820b08dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:08.710468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0c92c892-43e3-4d59-baa2-3afe4063db28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:08.780799 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3529/7088] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:08 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:08.785137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9719a83-e0b5-4d59-bc15-19bdd6634843 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:08.861099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9719a83-e0b5-4d59-bc15-19bdd6634843 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:08.867185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325d815-8602-4b97-9558-f5b3c36541b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:08.867885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325d815-8602-4b97-9558-f5b3c36541b6 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.868174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325d815-8602-4b97-9558-f5b3c36541b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.868711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325d815-8602-4b97-9558-f5b3c36541b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.869444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325d815-8602-4b97-9558-f5b3c36541b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:08.871550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325d815-8602-4b97-9558-f5b3c36541b6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:08.906441 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3560/7089] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:08 2021] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:08.907917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92c892-43e3-4d59-baa2-3afe4063db28 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:08.920420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92c892-43e3-4d59-baa2-3afe4063db28 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:08.982461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cfaca-770d-41a6-a0d7-8ae46c561a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:08.983241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cfaca-770d-41a6-a0d7-8ae46c561a61 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:08.983625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cfaca-770d-41a6-a0d7-8ae46c561a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:08.983977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cfaca-770d-41a6-a0d7-8ae46c561a61 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:08.984709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cfaca-770d-41a6-a0d7-8ae46c561a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:08.987321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cfaca-770d-41a6-a0d7-8ae46c561a61 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:09.022860 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3530/7090] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:11:08 2021] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:09.026581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325d815-8602-4b97-9558-f5b3c36541b6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:09.043581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325d815-8602-4b97-9558-f5b3c36541b6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:09.048647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b51712-9b34-48d8-86c0-f6673905dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:09.049314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b51712-9b34-48d8-86c0-f6673905dc6b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:09.049597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b51712-9b34-48d8-86c0-f6673905dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:09.049870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b51712-9b34-48d8-86c0-f6673905dc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:09.050613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b51712-9b34-48d8-86c0-f6673905dc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:09.052546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b51712-9b34-48d8-86c0-f6673905dc6b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:09.066975 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3561/7091] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:09 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:11:09.068241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cfaca-770d-41a6-a0d7-8ae46c561a61 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:09.080715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cfaca-770d-41a6-a0d7-8ae46c561a61 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:09.085672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b95c1-69ae-46a1-afa8-170b5c27354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:09.086325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b95c1-69ae-46a1-afa8-170b5c27354a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:09.086605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b95c1-69ae-46a1-afa8-170b5c27354a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:09.086876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b95c1-69ae-46a1-afa8-170b5c27354a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:09.087642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b95c1-69ae-46a1-afa8-170b5c27354a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:09.089243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b95c1-69ae-46a1-afa8-170b5c27354a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:09.104327 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3531/7092] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:09 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:09.108263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b51712-9b34-48d8-86c0-f6673905dc6b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:09.119146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b51712-9b34-48d8-86c0-f6673905dc6b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:09.125168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040bd3e-58d7-4b0e-af4d-1020524b47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:09.126261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040bd3e-58d7-4b0e-af4d-1020524b47fe admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:09.126651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040bd3e-58d7-4b0e-af4d-1020524b47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:09.127029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040bd3e-58d7-4b0e-af4d-1020524b47fe admin admin] PATH_INFO: `/v3/projects/033eb4791fdc4637820a66f37ccbee0b/users/40dfbbc55b864ce183175bc984b0d646/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:09.143734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040bd3e-58d7-4b0e-af4d-1020524b47fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=033eb4791fdc4637820a66f37ccbee0b, user_id=40dfbbc55b864ce183175bc984b0d646, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:09.146925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040bd3e-58d7-4b0e-af4d-1020524b47fe admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:09.165436 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3562/7093] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:09 2021] PUT /identity/v3/projects/033eb4791fdc4637820a66f37ccbee0b/users/40dfbbc55b864ce183175bc984b0d646/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:11:09.177132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf30d5-1d50-47f9-8a7c-28730e845b8f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:09.178891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf30d5-1d50-47f9-8a7c-28730e845b8f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:09.179670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf30d5-1d50-47f9-8a7c-28730e845b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:09.211835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-76cf30d5-1d50-47f9-8a7c-28730e845b8f None None] MFA Rules not processed for user `40dfbbc55b864ce183175bc984b0d646`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:09.213070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-76cf30d5-1d50-47f9-8a7c-28730e845b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:09.315896 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3532/7094] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:09 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:11:09.330705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040bd3e-58d7-4b0e-af4d-1020524b47fe admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:09.332552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5040bd3e-58d7-4b0e-af4d-1020524b47fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:09.413026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040bd3e-58d7-4b0e-af4d-1020524b47fe admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:09.417656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15b61-72a2-471d-83ba-e21753f1d767 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:09.417913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15b61-72a2-471d-83ba-e21753f1d767 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:09.418009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15b61-72a2-471d-83ba-e21753f1d767 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:09.418843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15b61-72a2-471d-83ba-e21753f1d767 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:09.484477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e15b61-72a2-471d-83ba-e21753f1d767 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:09.485915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e15b61-72a2-471d-83ba-e21753f1d767 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:09.496827 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3563/7095] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:09 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:11:09.611149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf30d5-1d50-47f9-8a7c-28730e845b8f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:09.624716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf30d5-1d50-47f9-8a7c-28730e845b8f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:09.630283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539b05e-eac1-4a8e-a126-7e5318209e9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:09.630995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539b05e-eac1-4a8e-a126-7e5318209e9d service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:09.631313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539b05e-eac1-4a8e-a126-7e5318209e9d service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:09.631721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539b05e-eac1-4a8e-a126-7e5318209e9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:09.641565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539b05e-eac1-4a8e-a126-7e5318209e9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:09.643136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539b05e-eac1-4a8e-a126-7e5318209e9d service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:09.655020 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3533/7096] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:09 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:11:10.000191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15b61-72a2-471d-83ba-e21753f1d767 service glance] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:10.081272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15b61-72a2-471d-83ba-e21753f1d767 service glance] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:10.086208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:10.087184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:10.087562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:10.087907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] PATH_INFO: `/v3/users/025a1db87ca94deea22d70f820b08dc0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:10.089222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025a1db87ca94deea22d70f820b08dc0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:10.093969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:10.150692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025a1db87ca94deea22d70f820b08dc0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:10.160225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025a1db87ca94deea22d70f820b08dc0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:10.161165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025a1db87ca94deea22d70f820b08dc0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:10.171849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025a1db87ca94deea22d70f820b08dc0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:10.186652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025a1db87ca94deea22d70f820b08dc0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:10.194835 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3564/7097] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:11:09 2021] DELETE /identity/v3/users/025a1db87ca94deea22d70f820b08dc0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:11:10.199497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92e816-6b0e-4c10-83b2-1f98336ff2a8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:10.199799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92e816-6b0e-4c10-83b2-1f98336ff2a8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:10.200078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92e816-6b0e-4c10-83b2-1f98336ff2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:10.218914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1c92e816-6b0e-4c10-83b2-1f98336ff2a8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:10.220190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1c92e816-6b0e-4c10-83b2-1f98336ff2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:10.294533 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3534/7098] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:10.304438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:10.305870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:10.526348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c0e13-8b60-44f8-a971-d1a4d27bfcd3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:10.530715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e298144-b10f-4323-845c-889d2405efc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:10.531398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e298144-b10f-4323-845c-889d2405efc7 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:10.531689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e298144-b10f-4323-845c-889d2405efc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:10.531969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e298144-b10f-4323-845c-889d2405efc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:10.542357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e298144-b10f-4323-845c-889d2405efc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:10.543912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e298144-b10f-4323-845c-889d2405efc7 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:10.556043 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3565/7099] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:11:10.863463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92e816-6b0e-4c10-83b2-1f98336ff2a8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:10.864936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1c92e816-6b0e-4c10-83b2-1f98336ff2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:10.877770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92e816-6b0e-4c10-83b2-1f98336ff2a8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:10.882876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:10.883765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:10.884045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:10.884332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] PATH_INFO: `/v3/projects/54c9b162de4a4339bdaeaa399cc1b226` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:10.885518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c9b162de4a4339bdaeaa399cc1b226)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:10.890340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:10.948218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c9b162de4a4339bdaeaa399cc1b226', 'request_id': 'req-09ff8bc7-7e9a-472a-ae13-c49a653fa133'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:10.954949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c9b162de4a4339bdaeaa399cc1b226', 'request_id': 'req-09ff8bc7-7e9a-472a-ae13-c49a653fa133'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:10.962876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c9b162de4a4339bdaeaa399cc1b226', 'request_id': 'req-09ff8bc7-7e9a-472a-ae13-c49a653fa133'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:10.975869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] The token cache is being invalidate because project 54c9b162de4a4339bdaeaa399cc1b226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:10.976156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:10.976821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:10.978487 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3535/7100] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:10 2021] DELETE /identity/v3/projects/54c9b162de4a4339bdaeaa399cc1b226 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:10.983215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e298144-b10f-4323-845c-889d2405efc7 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:10.994182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e298144-b10f-4323-845c-889d2405efc7 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:11.069791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de57f68-e9cf-4656-8e4e-7826910b27ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:11.070654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de57f68-e9cf-4656-8e4e-7826910b27ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:11.070940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de57f68-e9cf-4656-8e4e-7826910b27ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:11.071212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de57f68-e9cf-4656-8e4e-7826910b27ef admin admin] PATH_INFO: `/v3/users/40dfbbc55b864ce183175bc984b0d646` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:11.072445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de57f68-e9cf-4656-8e4e-7826910b27ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=40dfbbc55b864ce183175bc984b0d646)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:11.074331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de57f68-e9cf-4656-8e4e-7826910b27ef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:11.125309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0de57f68-e9cf-4656-8e4e-7826910b27ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40dfbbc55b864ce183175bc984b0d646'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:11.137937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0de57f68-e9cf-4656-8e4e-7826910b27ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40dfbbc55b864ce183175bc984b0d646'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:11.139577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0de57f68-e9cf-4656-8e4e-7826910b27ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40dfbbc55b864ce183175bc984b0d646'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:11.148722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0de57f68-e9cf-4656-8e4e-7826910b27ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40dfbbc55b864ce183175bc984b0d646'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:11.170457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0de57f68-e9cf-4656-8e4e-7826910b27ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40dfbbc55b864ce183175bc984b0d646'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:11.180199 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3566/7101] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:11:10 2021] DELETE /identity/v3/users/40dfbbc55b864ce183175bc984b0d646 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:11.515066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:11.516576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:11.537036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff8bc7-7e9a-472a-ae13-c49a653fa133 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:11.609775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:11.609775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:11.610118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:11.610221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] PATH_INFO: `/v3/projects/033eb4791fdc4637820a66f37ccbee0b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:11.611470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=033eb4791fdc4637820a66f37ccbee0b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:11.613558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:11.664867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033eb4791fdc4637820a66f37ccbee0b', 'request_id': 'req-60f6bf23-3127-4f7f-9acb-33922f781fcc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:11.672360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033eb4791fdc4637820a66f37ccbee0b', 'request_id': 'req-60f6bf23-3127-4f7f-9acb-33922f781fcc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:11.681861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033eb4791fdc4637820a66f37ccbee0b', 'request_id': 'req-60f6bf23-3127-4f7f-9acb-33922f781fcc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:11.694421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] The token cache is being invalidate because project 033eb4791fdc4637820a66f37ccbee0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:11.694713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:11.695398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-60f6bf23-3127-4f7f-9acb-33922f781fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:11.702975 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3536/7102] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:11 2021] DELETE /identity/v3/projects/033eb4791fdc4637820a66f37ccbee0b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:11.704883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c940-1ad9-4f34-88cd-143af12c957d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:11.706953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c940-1ad9-4f34-88cd-143af12c957d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:11.706953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c940-1ad9-4f34-88cd-143af12c957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:11.725165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-44f6c940-1ad9-4f34-88cd-143af12c957d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:11.726621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-44f6c940-1ad9-4f34-88cd-143af12c957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:11.799396 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3567/7103] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:11.801206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d946b-c9a4-479e-99c1-7ddebda66d5d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:11.801568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d946b-c9a4-479e-99c1-7ddebda66d5d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:11.801944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d946b-c9a4-479e-99c1-7ddebda66d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:11.827171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d71d946b-c9a4-479e-99c1-7ddebda66d5d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:11.828502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d71d946b-c9a4-479e-99c1-7ddebda66d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:11.837096 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3537/7104] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:11:11.841895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6c940-1ad9-4f34-88cd-143af12c957d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:11.852688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6c940-1ad9-4f34-88cd-143af12c957d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:11.859619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41134cb-7539-4f19-b99a-34556a6246a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:11.860288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41134cb-7539-4f19-b99a-34556a6246a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:11.860568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41134cb-7539-4f19-b99a-34556a6246a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:11.860841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41134cb-7539-4f19-b99a-34556a6246a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:11.861626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41134cb-7539-4f19-b99a-34556a6246a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:11:11.861933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41134cb-7539-4f19-b99a-34556a6246a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:11.863551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41134cb-7539-4f19-b99a-34556a6246a9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:11.876811 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3568/7105] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:11:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:11:11.881415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d946b-c9a4-479e-99c1-7ddebda66d5d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:11.893150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d946b-c9a4-479e-99c1-7ddebda66d5d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:11.898086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7f345-199b-482d-85a4-edd3d0e18db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:11.898753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7f345-199b-482d-85a4-edd3d0e18db7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:11.899035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7f345-199b-482d-85a4-edd3d0e18db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:11.899337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7f345-199b-482d-85a4-edd3d0e18db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:11.900036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7f345-199b-482d-85a4-edd3d0e18db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:11.902110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7f345-199b-482d-85a4-edd3d0e18db7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:11.933764 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3538/7106] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:11 2021] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:11.938553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41134cb-7539-4f19-b99a-34556a6246a9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:11.949306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41134cb-7539-4f19-b99a-34556a6246a9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:12.014494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6bdc1-3c14-49ac-a5b0-879283d0ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:12.015204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6bdc1-3c14-49ac-a5b0-879283d0ebd3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:12.015545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6bdc1-3c14-49ac-a5b0-879283d0ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:12.015793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6bdc1-3c14-49ac-a5b0-879283d0ebd3 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:12.016492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6bdc1-3c14-49ac-a5b0-879283d0ebd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:12.018396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6bdc1-3c14-49ac-a5b0-879283d0ebd3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:12.041294 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3569/7107] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:11:11 2021] POST /identity/v3/users => generated 281 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:12.046040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7f345-199b-482d-85a4-edd3d0e18db7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:12.057574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7f345-199b-482d-85a4-edd3d0e18db7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:12.062957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227d6ae-61de-48ef-939f-1c3bc3f35b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:12.063731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227d6ae-61de-48ef-939f-1c3bc3f35b12 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:12.064008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227d6ae-61de-48ef-939f-1c3bc3f35b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:12.064281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227d6ae-61de-48ef-939f-1c3bc3f35b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:12.065560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227d6ae-61de-48ef-939f-1c3bc3f35b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:12.067203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227d6ae-61de-48ef-939f-1c3bc3f35b12 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:12.082660 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3539/7108] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:12 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:12.088738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6bdc1-3c14-49ac-a5b0-879283d0ebd3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:12.099877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6bdc1-3c14-49ac-a5b0-879283d0ebd3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:12.109249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f26d7c-7bba-4582-994b-0d5dff00b7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:12.109958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f26d7c-7bba-4582-994b-0d5dff00b7dc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:12.110240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f26d7c-7bba-4582-994b-0d5dff00b7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:12.110513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f26d7c-7bba-4582-994b-0d5dff00b7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:12.111283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f26d7c-7bba-4582-994b-0d5dff00b7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:12.112974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f26d7c-7bba-4582-994b-0d5dff00b7dc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:12.125153 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3570/7109] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:12 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:11:12.133947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227d6ae-61de-48ef-939f-1c3bc3f35b12 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:12.145952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227d6ae-61de-48ef-939f-1c3bc3f35b12 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:12.151034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867177d-f761-4590-b253-291e81652f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:12.152033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867177d-f761-4590-b253-291e81652f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:12.152318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867177d-f761-4590-b253-291e81652f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:12.152591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867177d-f761-4590-b253-291e81652f94 admin admin] PATH_INFO: `/v3/projects/5a524bb84d634e2996877a8de5fd901c/users/f499a2d3448a4884addaa02ebd6e4466/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:12.168722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867177d-f761-4590-b253-291e81652f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a524bb84d634e2996877a8de5fd901c, user_id=f499a2d3448a4884addaa02ebd6e4466, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:12.171960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867177d-f761-4590-b253-291e81652f94 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:12.184792 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3540/7110] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:12 2021] PUT /identity/v3/projects/5a524bb84d634e2996877a8de5fd901c/users/f499a2d3448a4884addaa02ebd6e4466/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:12.196161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeb894-7614-48d0-a3af-a09797c5f3bd None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:12.196449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeb894-7614-48d0-a3af-a09797c5f3bd None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:12.196724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeb894-7614-48d0-a3af-a09797c5f3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:12.223735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f3eeb894-7614-48d0-a3af-a09797c5f3bd None None] MFA Rules not processed for user `f499a2d3448a4884addaa02ebd6e4466`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:12.224937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f3eeb894-7614-48d0-a3af-a09797c5f3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:12.300387 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3571/7111] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:12 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:12.313016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867177d-f761-4590-b253-291e81652f94 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:12.374727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867177d-f761-4590-b253-291e81652f94 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:12.379631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:12.380491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:12.380775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:12.381049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] PATH_INFO: `/v3/users/f499a2d3448a4884addaa02ebd6e4466` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:12.382261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f499a2d3448a4884addaa02ebd6e4466)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:12.384237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:12.429162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f499a2d3448a4884addaa02ebd6e4466'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:12.429828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f499a2d3448a4884addaa02ebd6e4466'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:12.436823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f499a2d3448a4884addaa02ebd6e4466'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:12.437448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f499a2d3448a4884addaa02ebd6e4466'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:12.444396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f499a2d3448a4884addaa02ebd6e4466'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:12.461522 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3541/7112] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:11:12 2021] DELETE /identity/v3/users/f499a2d3448a4884addaa02ebd6e4466 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:12.465990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945a20-72e8-4b47-8848-c90aa12696f6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:12.466782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945a20-72e8-4b47-8848-c90aa12696f6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:12.467097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945a20-72e8-4b47-8848-c90aa12696f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:12.485056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3e945a20-72e8-4b47-8848-c90aa12696f6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:12.486240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3e945a20-72e8-4b47-8848-c90aa12696f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:12.541329 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3572/7113] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:11:12.551766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:12.553166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:12.612014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb8097-72cf-4cf4-8242-95993b54bef7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:12.615627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf2559-5486-4178-8840-c24853907cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:12.616271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf2559-5486-4178-8840-c24853907cce service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:12.616560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf2559-5486-4178-8840-c24853907cce service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:12.616844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf2559-5486-4178-8840-c24853907cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:12.626239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf2559-5486-4178-8840-c24853907cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:12.627737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf2559-5486-4178-8840-c24853907cce service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:12.638773 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3542/7114] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:11:12.902367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e945a20-72e8-4b47-8848-c90aa12696f6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:12.904372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3e945a20-72e8-4b47-8848-c90aa12696f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:12.916892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e945a20-72e8-4b47-8848-c90aa12696f6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:12.921528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:12.922373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:12.922650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:12.923160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] PATH_INFO: `/v3/projects/5a524bb84d634e2996877a8de5fd901c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:12.924595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a524bb84d634e2996877a8de5fd901c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:12.926475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:12.972849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a524bb84d634e2996877a8de5fd901c', 'request_id': 'req-86172de3-57d0-40d1-978b-d28c3664adaa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:12.979732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a524bb84d634e2996877a8de5fd901c', 'request_id': 'req-86172de3-57d0-40d1-978b-d28c3664adaa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:12.985939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a524bb84d634e2996877a8de5fd901c', 'request_id': 'req-86172de3-57d0-40d1-978b-d28c3664adaa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:12.996142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] The token cache is being invalidate because project 5a524bb84d634e2996877a8de5fd901c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:12.996425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:12.997058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-86172de3-57d0-40d1-978b-d28c3664adaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:12.999114 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3573/7115] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:12 2021] DELETE /identity/v3/projects/5a524bb84d634e2996877a8de5fd901c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:13.005572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdbe9d-71fb-4754-bbeb-a6d433b3dca7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.006053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdbe9d-71fb-4754-bbeb-a6d433b3dca7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.006156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdbe9d-71fb-4754-bbeb-a6d433b3dca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.024268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-85bdbe9d-71fb-4754-bbeb-a6d433b3dca7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:13.025487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-85bdbe9d-71fb-4754-bbeb-a6d433b3dca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:13.083024 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3543/7116] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:13.091937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3ed82-ef04-437d-816a-142ae3203392 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.092232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3ed82-ef04-437d-816a-142ae3203392 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.092568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3ed82-ef04-437d-816a-142ae3203392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.110448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b1e3ed82-ef04-437d-816a-142ae3203392 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:13.111682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b1e3ed82-ef04-437d-816a-142ae3203392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:13.120443 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3574/7117] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:13.125086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdbe9d-71fb-4754-bbeb-a6d433b3dca7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.134849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdbe9d-71fb-4754-bbeb-a6d433b3dca7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.140084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd45820-6710-451c-b61b-3d295cd6a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.140763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd45820-6710-451c-b61b-3d295cd6a9eb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.141042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd45820-6710-451c-b61b-3d295cd6a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.141316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd45820-6710-451c-b61b-3d295cd6a9eb admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.142070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd45820-6710-451c-b61b-3d295cd6a9eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:11:13.142372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd45820-6710-451c-b61b-3d295cd6a9eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.144017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd45820-6710-451c-b61b-3d295cd6a9eb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.158901 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3544/7118] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:11:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:11:13.160343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3ed82-ef04-437d-816a-142ae3203392 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.171131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3ed82-ef04-437d-816a-142ae3203392 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.176027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d810-a052-432b-af64-d07ec3cb5213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.176688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d810-a052-432b-af64-d07ec3cb5213 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.176968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d810-a052-432b-af64-d07ec3cb5213 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.177246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d810-a052-432b-af64-d07ec3cb5213 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.177960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3d810-a052-432b-af64-d07ec3cb5213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.179893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3d810-a052-432b-af64-d07ec3cb5213 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.207143 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3575/7119] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:13 2021] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:13.211134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd45820-6710-451c-b61b-3d295cd6a9eb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.221028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd45820-6710-451c-b61b-3d295cd6a9eb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.284897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce41ec-8efd-4c27-ac25-d4388754d7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.285567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce41ec-8efd-4c27-ac25-d4388754d7fd admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.285880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce41ec-8efd-4c27-ac25-d4388754d7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.286286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce41ec-8efd-4c27-ac25-d4388754d7fd admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.287048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce41ec-8efd-4c27-ac25-d4388754d7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.289013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce41ec-8efd-4c27-ac25-d4388754d7fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.311962 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3545/7120] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:11:13 2021] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:13.316096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d810-a052-432b-af64-d07ec3cb5213 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.328490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d810-a052-432b-af64-d07ec3cb5213 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.333448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a813e4-f586-4b24-ab51-8b9c7e154337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.334108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a813e4-f586-4b24-ab51-8b9c7e154337 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.334569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a813e4-f586-4b24-ab51-8b9c7e154337 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.334849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a813e4-f586-4b24-ab51-8b9c7e154337 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.335621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a813e4-f586-4b24-ab51-8b9c7e154337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.337201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a813e4-f586-4b24-ab51-8b9c7e154337 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.350952 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3576/7121] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:13.352153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce41ec-8efd-4c27-ac25-d4388754d7fd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.362741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce41ec-8efd-4c27-ac25-d4388754d7fd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.367799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b871149-80ae-47fe-8929-077fba67207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.368707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b871149-80ae-47fe-8929-077fba67207f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.369011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b871149-80ae-47fe-8929-077fba67207f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.369264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b871149-80ae-47fe-8929-077fba67207f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.370022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b871149-80ae-47fe-8929-077fba67207f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.371653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b871149-80ae-47fe-8929-077fba67207f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.381947 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3546/7122] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:13.386049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a813e4-f586-4b24-ab51-8b9c7e154337 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.396736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a813e4-f586-4b24-ab51-8b9c7e154337 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.401443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f16625-4c1b-4ad9-9714-5a1ea796be24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.402311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16625-4c1b-4ad9-9714-5a1ea796be24 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.402602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16625-4c1b-4ad9-9714-5a1ea796be24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.402879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16625-4c1b-4ad9-9714-5a1ea796be24 admin admin] PATH_INFO: `/v3/projects/78fad847ff924ac7ba87cac5b29cec53/users/7399b0a436d345b98dcb486e82f79620/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.418195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f16625-4c1b-4ad9-9714-5a1ea796be24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78fad847ff924ac7ba87cac5b29cec53, user_id=7399b0a436d345b98dcb486e82f79620, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.421389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f16625-4c1b-4ad9-9714-5a1ea796be24 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.439302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3577/7123] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:13 2021] PUT /identity/v3/projects/78fad847ff924ac7ba87cac5b29cec53/users/7399b0a436d345b98dcb486e82f79620/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:13.445508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b6a7-11ba-4a11-b39d-548a745443b3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.445859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b6a7-11ba-4a11-b39d-548a745443b3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.446162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240b6a7-11ba-4a11-b39d-548a745443b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.472956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7240b6a7-11ba-4a11-b39d-548a745443b3 None None] MFA Rules not processed for user `7399b0a436d345b98dcb486e82f79620`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:13.474261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7240b6a7-11ba-4a11-b39d-548a745443b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:13.539943 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3547/7124] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:13 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:11:13.545042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f16625-4c1b-4ad9-9714-5a1ea796be24 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.608457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f16625-4c1b-4ad9-9714-5a1ea796be24 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.613641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c168454-109c-4afa-bc53-70575b086897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.614434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168454-109c-4afa-bc53-70575b086897 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.614788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168454-109c-4afa-bc53-70575b086897 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.615075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c168454-109c-4afa-bc53-70575b086897 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.615971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c168454-109c-4afa-bc53-70575b086897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.617910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c168454-109c-4afa-bc53-70575b086897 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.646862 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3578/7125] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:13 2021] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:13.651023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b6a7-11ba-4a11-b39d-548a745443b3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.661543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240b6a7-11ba-4a11-b39d-548a745443b3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.716526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c512c8-789e-4789-98aa-c83f33ed3662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.717102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c512c8-789e-4789-98aa-c83f33ed3662 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.717384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c512c8-789e-4789-98aa-c83f33ed3662 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.717655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c512c8-789e-4789-98aa-c83f33ed3662 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.718379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c512c8-789e-4789-98aa-c83f33ed3662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.721071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c512c8-789e-4789-98aa-c83f33ed3662 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.742199 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3548/7126] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:11:13 2021] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:13.746387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c168454-109c-4afa-bc53-70575b086897 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.757314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c168454-109c-4afa-bc53-70575b086897 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.761973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846ede2-c4f7-4e18-99ae-ddb907916efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.762620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846ede2-c4f7-4e18-99ae-ddb907916efd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.762928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846ede2-c4f7-4e18-99ae-ddb907916efd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.763185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846ede2-c4f7-4e18-99ae-ddb907916efd admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.763946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846ede2-c4f7-4e18-99ae-ddb907916efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.765532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846ede2-c4f7-4e18-99ae-ddb907916efd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.776240 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3579/7127] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:13.780729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c512c8-789e-4789-98aa-c83f33ed3662 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.790746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c512c8-789e-4789-98aa-c83f33ed3662 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.801338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2997b-608a-4ac8-bf50-c8016a4c7c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.803135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2997b-608a-4ac8-bf50-c8016a4c7c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.803737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2997b-608a-4ac8-bf50-c8016a4c7c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.804025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2997b-608a-4ac8-bf50-c8016a4c7c24 admin admin] PATH_INFO: `/v3/projects/503ed502cb514d96811c50dfd6e3deaf/users/282e611682b84c46a2e02dd275ac95ee/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.820909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2997b-608a-4ac8-bf50-c8016a4c7c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=503ed502cb514d96811c50dfd6e3deaf, user_id=282e611682b84c46a2e02dd275ac95ee, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.823694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2997b-608a-4ac8-bf50-c8016a4c7c24 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.837258 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3549/7128] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:13 2021] PUT /identity/v3/projects/503ed502cb514d96811c50dfd6e3deaf/users/282e611682b84c46a2e02dd275ac95ee/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:13.841668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846ede2-c4f7-4e18-99ae-ddb907916efd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.851523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846ede2-c4f7-4e18-99ae-ddb907916efd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.906974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311dbb7-9adb-47d6-bcc8-31d09cdf5b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.907659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dbb7-9adb-47d6-bcc8-31d09cdf5b49 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.907946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dbb7-9adb-47d6-bcc8-31d09cdf5b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.908219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dbb7-9adb-47d6-bcc8-31d09cdf5b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.908936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311dbb7-9adb-47d6-bcc8-31d09cdf5b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.910545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311dbb7-9adb-47d6-bcc8-31d09cdf5b49 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.920575 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3580/7129] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:13 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:13.924607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2997b-608a-4ac8-bf50-c8016a4c7c24 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:13.934626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2997b-608a-4ac8-bf50-c8016a4c7c24 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:13.939163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6e91f-f3ba-4549-9cb6-52d806f3e8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:13.940052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e91f-f3ba-4549-9cb6-52d806f3e8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.940328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e91f-f3ba-4549-9cb6-52d806f3e8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.940594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e91f-f3ba-4549-9cb6-52d806f3e8b0 admin admin] PATH_INFO: `/v3/projects/503ed502cb514d96811c50dfd6e3deaf/users/282e611682b84c46a2e02dd275ac95ee/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.942578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6e91f-f3ba-4549-9cb6-52d806f3e8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=503ed502cb514d96811c50dfd6e3deaf, user_id=282e611682b84c46a2e02dd275ac95ee, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:13.945215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6e91f-f3ba-4549-9cb6-52d806f3e8b0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:13.955035 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3550/7130] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:13 2021] PUT /identity/v3/projects/503ed502cb514d96811c50dfd6e3deaf/users/282e611682b84c46a2e02dd275ac95ee/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:13.964990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87945ef1-94ca-4318-a7ec-96b606d62868 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:13.965276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87945ef1-94ca-4318-a7ec-96b606d62868 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:13.965552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87945ef1-94ca-4318-a7ec-96b606d62868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:13.991654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-87945ef1-94ca-4318-a7ec-96b606d62868 None None] MFA Rules not processed for user `282e611682b84c46a2e02dd275ac95ee`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:13.992768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-87945ef1-94ca-4318-a7ec-96b606d62868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:14.058731 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3581/7131] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:13 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:14.070386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6e91f-f3ba-4549-9cb6-52d806f3e8b0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:14.072143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6ee6e91f-f3ba-4549-9cb6-52d806f3e8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:14.129709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6e91f-f3ba-4549-9cb6-52d806f3e8b0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:14.133406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b4687-c37b-4293-9c90-0133cb52bb20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:14.134037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b4687-c37b-4293-9c90-0133cb52bb20 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:14.134319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b4687-c37b-4293-9c90-0133cb52bb20 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:14.134595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b4687-c37b-4293-9c90-0133cb52bb20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:14.143954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b4687-c37b-4293-9c90-0133cb52bb20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:14.145372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b4687-c37b-4293-9c90-0133cb52bb20 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:14.155116 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3551/7132] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:14 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:11:15.948827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87945ef1-94ca-4318-a7ec-96b606d62868 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:16.009643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87945ef1-94ca-4318-a7ec-96b606d62868 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:16.014281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:16.015132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:16.015448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:16.015724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] PATH_INFO: `/v3/users/7399b0a436d345b98dcb486e82f79620` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:16.016924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7399b0a436d345b98dcb486e82f79620)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:16.018834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:16.062923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7399b0a436d345b98dcb486e82f79620'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.070196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7399b0a436d345b98dcb486e82f79620'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.070830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7399b0a436d345b98dcb486e82f79620'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.077766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7399b0a436d345b98dcb486e82f79620'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.088959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7399b0a436d345b98dcb486e82f79620'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.095131 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3582/7133] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:11:15 2021] DELETE /identity/v3/users/7399b0a436d345b98dcb486e82f79620 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:16.099641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b06bf5-a0b8-4241-a873-c19f0968fd43 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:16.100162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b06bf5-a0b8-4241-a873-c19f0968fd43 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:16.100275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b06bf5-a0b8-4241-a873-c19f0968fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:16.118081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-44b06bf5-a0b8-4241-a873-c19f0968fd43 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:16.119553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-44b06bf5-a0b8-4241-a873-c19f0968fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:16.183822 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3552/7134] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:11:16.193725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:16.195133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:16.252568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbc613-92bf-4641-97aa-61056956f6e7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:16.256201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d10311-fdcd-440a-890b-0c82581f1dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:16.256857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d10311-fdcd-440a-890b-0c82581f1dbd service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:16.257162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d10311-fdcd-440a-890b-0c82581f1dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:16.257477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d10311-fdcd-440a-890b-0c82581f1dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:16.266293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d10311-fdcd-440a-890b-0c82581f1dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:16.267752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d10311-fdcd-440a-890b-0c82581f1dbd service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:16.277788 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3583/7135] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:11:16.544092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b06bf5-a0b8-4241-a873-c19f0968fd43 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:16.545532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-44b06bf5-a0b8-4241-a873-c19f0968fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:16.559377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b06bf5-a0b8-4241-a873-c19f0968fd43 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:16.564275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:16.565133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:16.566128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:16.566504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] PATH_INFO: `/v3/projects/78fad847ff924ac7ba87cac5b29cec53` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:16.567773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78fad847ff924ac7ba87cac5b29cec53)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:16.569706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:16.616095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78fad847ff924ac7ba87cac5b29cec53', 'request_id': 'req-65999ada-7322-4b39-9add-907d873280e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.622285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78fad847ff924ac7ba87cac5b29cec53', 'request_id': 'req-65999ada-7322-4b39-9add-907d873280e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.629300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78fad847ff924ac7ba87cac5b29cec53', 'request_id': 'req-65999ada-7322-4b39-9add-907d873280e4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.639538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] The token cache is being invalidate because project 78fad847ff924ac7ba87cac5b29cec53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:16.639823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.640429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.641927 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3553/7136] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:16 2021] DELETE /identity/v3/projects/78fad847ff924ac7ba87cac5b29cec53 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:16.645875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d10311-fdcd-440a-890b-0c82581f1dbd service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:16.656097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d10311-fdcd-440a-890b-0c82581f1dbd service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:16.711989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e0fb0-5b88-4d31-a8d0-df9f425aafeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:16.712766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e0fb0-5b88-4d31-a8d0-df9f425aafeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:16.713047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e0fb0-5b88-4d31-a8d0-df9f425aafeb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:16.713316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e0fb0-5b88-4d31-a8d0-df9f425aafeb admin admin] PATH_INFO: `/v3/users/282e611682b84c46a2e02dd275ac95ee` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:16.714491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e0fb0-5b88-4d31-a8d0-df9f425aafeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=282e611682b84c46a2e02dd275ac95ee)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:16.717071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e0fb0-5b88-4d31-a8d0-df9f425aafeb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:16.764190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ff0e0fb0-5b88-4d31-a8d0-df9f425aafeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '282e611682b84c46a2e02dd275ac95ee'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.771470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ff0e0fb0-5b88-4d31-a8d0-df9f425aafeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '282e611682b84c46a2e02dd275ac95ee'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.772095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ff0e0fb0-5b88-4d31-a8d0-df9f425aafeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '282e611682b84c46a2e02dd275ac95ee'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.779138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ff0e0fb0-5b88-4d31-a8d0-df9f425aafeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '282e611682b84c46a2e02dd275ac95ee'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.790452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ff0e0fb0-5b88-4d31-a8d0-df9f425aafeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '282e611682b84c46a2e02dd275ac95ee'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:16.796226 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3584/7137] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:11:16 2021] DELETE /identity/v3/users/282e611682b84c46a2e02dd275ac95ee => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:17.065396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:17.068595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:17.085285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65999ada-7322-4b39-9add-907d873280e4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:17.157302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a8e1-34c2-4298-b19d-ee7d48fbd5d5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.157804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a8e1-34c2-4298-b19d-ee7d48fbd5d5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.157912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42a8e1-34c2-4298-b19d-ee7d48fbd5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.163293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:17.164185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.164495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.164775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] PATH_INFO: `/v3/projects/503ed502cb514d96811c50dfd6e3deaf` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.166253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=503ed502cb514d96811c50dfd6e3deaf)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:17.168569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:17.179886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5e42a8e1-34c2-4298-b19d-ee7d48fbd5d5 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:17.181686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5e42a8e1-34c2-4298-b19d-ee7d48fbd5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:17.222271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503ed502cb514d96811c50dfd6e3deaf', 'request_id': 'req-f4958e45-ebd4-4cf2-9034-ab810bd18712'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:17.228580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503ed502cb514d96811c50dfd6e3deaf', 'request_id': 'req-f4958e45-ebd4-4cf2-9034-ab810bd18712'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:17.237972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503ed502cb514d96811c50dfd6e3deaf', 'request_id': 'req-f4958e45-ebd4-4cf2-9034-ab810bd18712'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:17.248360 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3585/7138] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:11:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:11:17.252301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] The token cache is being invalidate because project 503ed502cb514d96811c50dfd6e3deaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:17.253106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:17.254370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:17.256692 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3554/7139] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:17 2021] DELETE /identity/v3/projects/503ed502cb514d96811c50dfd6e3deaf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:17.264704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626f7a-8eb2-44be-a8f1-13f608bc65cd None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.265241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626f7a-8eb2-44be-a8f1-13f608bc65cd None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.265502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:17.265740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73626f7a-8eb2-44be-a8f1-13f608bc65cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.267070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:17.287828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-73626f7a-8eb2-44be-a8f1-13f608bc65cd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:17.289121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-73626f7a-8eb2-44be-a8f1-13f608bc65cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:17.344874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4958e45-ebd4-4cf2-9034-ab810bd18712 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:17.351632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ae62-c7d8-4901-bfef-1606a95548bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:17.352286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ae62-c7d8-4901-bfef-1606a95548bd service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.352421 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3586/7140] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:17.352615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ae62-c7d8-4901-bfef-1606a95548bd service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.353045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ae62-c7d8-4901-bfef-1606a95548bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.359755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3c55ae62-c7d8-4901-bfef-1606a95548bd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:17.361438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c383c2-3926-4ad4-b7e5-c91837518bc5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.361724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c383c2-3926-4ad4-b7e5-c91837518bc5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.362572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c383c2-3926-4ad4-b7e5-c91837518bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.381995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d7c383c2-3926-4ad4-b7e5-c91837518bc5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:17.383194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d7c383c2-3926-4ad4-b7e5-c91837518bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:17.393782 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3587/7141] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:11:17.398211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c383c2-3926-4ad4-b7e5-c91837518bc5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:17.408848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c383c2-3926-4ad4-b7e5-c91837518bc5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:17.415913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b169a-715e-427b-af01-f6b05d0b78d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:17.416719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b169a-715e-427b-af01-f6b05d0b78d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.416972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b169a-715e-427b-af01-f6b05d0b78d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.417171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b169a-715e-427b-af01-f6b05d0b78d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.418011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b169a-715e-427b-af01-f6b05d0b78d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:11:17.419288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b169a-715e-427b-af01-f6b05d0b78d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:17.420701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b169a-715e-427b-af01-f6b05d0b78d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:17.432422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55ae62-c7d8-4901-bfef-1606a95548bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:17.433451 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3588/7142] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:11:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:11:17.434198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55ae62-c7d8-4901-bfef-1606a95548bd service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:17.437517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b169a-715e-427b-af01-f6b05d0b78d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:17.447173 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3555/7143] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:11:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:11:17.448091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b169a-715e-427b-af01-f6b05d0b78d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:17.454882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c6bb7-b5a2-4db3-b0f2-136291226a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:17.455578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c6bb7-b5a2-4db3-b0f2-136291226a60 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.455861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c6bb7-b5a2-4db3-b0f2-136291226a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.456130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c6bb7-b5a2-4db3-b0f2-136291226a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.456839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c6bb7-b5a2-4db3-b0f2-136291226a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:17.458786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c6bb7-b5a2-4db3-b0f2-136291226a60 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:17.515453 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3589/7144] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:17 2021] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:17.518608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ae62-c7d8-4901-bfef-1606a95548bd service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:17.531408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ae62-c7d8-4901-bfef-1606a95548bd service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:17.595806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e2c14-6b75-40b3-b620-3f1ef81ba4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:17.596481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e2c14-6b75-40b3-b620-3f1ef81ba4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.596765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e2c14-6b75-40b3-b620-3f1ef81ba4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.597079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e2c14-6b75-40b3-b620-3f1ef81ba4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.597882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e2c14-6b75-40b3-b620-3f1ef81ba4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:17.599855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e2c14-6b75-40b3-b620-3f1ef81ba4a7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:17.627691 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3556/7145] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:11:17 2021] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:17.631716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c6bb7-b5a2-4db3-b0f2-136291226a60 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:17.642757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c6bb7-b5a2-4db3-b0f2-136291226a60 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:17.650901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abc917-f7c3-4357-b490-32b5774f585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:17.651761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abc917-f7c3-4357-b490-32b5774f585f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.652146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abc917-f7c3-4357-b490-32b5774f585f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.652494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abc917-f7c3-4357-b490-32b5774f585f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.653302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abc917-f7c3-4357-b490-32b5774f585f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:17.654989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abc917-f7c3-4357-b490-32b5774f585f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:17.667978 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3590/7146] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:17 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:11:17.672003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e2c14-6b75-40b3-b620-3f1ef81ba4a7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:17.691599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e2c14-6b75-40b3-b620-3f1ef81ba4a7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:17.699701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcc5ad-a456-4fba-a4b9-7537c9e4e117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:17.703618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc5ad-a456-4fba-a4b9-7537c9e4e117 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.710508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc5ad-a456-4fba-a4b9-7537c9e4e117 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.710893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcc5ad-a456-4fba-a4b9-7537c9e4e117 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.711780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcc5ad-a456-4fba-a4b9-7537c9e4e117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:17.713649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcc5ad-a456-4fba-a4b9-7537c9e4e117 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:17.724285 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3557/7147] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:17 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:11:17.728316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abc917-f7c3-4357-b490-32b5774f585f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:17.739616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abc917-f7c3-4357-b490-32b5774f585f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:17.745853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b0f01-f7ee-4840-a266-c38bef8a4077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:17.747761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b0f01-f7ee-4840-a266-c38bef8a4077 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.748283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b0f01-f7ee-4840-a266-c38bef8a4077 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.748728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b0f01-f7ee-4840-a266-c38bef8a4077 admin admin] PATH_INFO: `/v3/projects/bf6faeaa8093415dbcf10657bd44216a/users/5a498bb401e34808a263ebde34d72379/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.768481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b0f01-f7ee-4840-a266-c38bef8a4077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6faeaa8093415dbcf10657bd44216a, user_id=5a498bb401e34808a263ebde34d72379, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:17.771656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b0f01-f7ee-4840-a266-c38bef8a4077 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:17.787393 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3591/7148] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:17 2021] PUT /identity/v3/projects/bf6faeaa8093415dbcf10657bd44216a/users/5a498bb401e34808a263ebde34d72379/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:11:17.798005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5f6f-5c1b-4682-be80-8e8a60f6e95e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.798485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5f6f-5c1b-4682-be80-8e8a60f6e95e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.798833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5f6f-5c1b-4682-be80-8e8a60f6e95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:17.830148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-391a5f6f-5c1b-4682-be80-8e8a60f6e95e None None] MFA Rules not processed for user `5a498bb401e34808a263ebde34d72379`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:17.831442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-391a5f6f-5c1b-4682-be80-8e8a60f6e95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:17.912954 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3558/7149] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:17 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:17.926196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b0f01-f7ee-4840-a266-c38bef8a4077 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:17.927957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ba7b0f01-f7ee-4840-a266-c38bef8a4077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:17.992894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b0f01-f7ee-4840-a266-c38bef8a4077 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:17.998151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8222a-3744-461f-a2d6-b4f9331603d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:17.998940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8222a-3744-461f-a2d6-b4f9331603d0 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:17.999350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8222a-3744-461f-a2d6-b4f9331603d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:17.999732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8222a-3744-461f-a2d6-b4f9331603d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:18.012117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8222a-3744-461f-a2d6-b4f9331603d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:18.013734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8222a-3744-461f-a2d6-b4f9331603d0 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:18.023868 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3592/7150] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:17 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:11:30.275110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5f6f-5c1b-4682-be80-8e8a60f6e95e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:30.339424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5f6f-5c1b-4682-be80-8e8a60f6e95e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:30.344081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:30.344948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:30.345235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:30.345510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] PATH_INFO: `/v3/users/5a498bb401e34808a263ebde34d72379` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:30.346703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a498bb401e34808a263ebde34d72379)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:30.348665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:30.394034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a498bb401e34808a263ebde34d72379'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:30.394695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a498bb401e34808a263ebde34d72379'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:30.400825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a498bb401e34808a263ebde34d72379'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:30.401430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a498bb401e34808a263ebde34d72379'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:30.408132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a498bb401e34808a263ebde34d72379'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:30.424705 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3559/7151] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:11:30 2021] DELETE /identity/v3/users/5a498bb401e34808a263ebde34d72379 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:30.429286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444256-2499-4b46-aed5-409a44faa28c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:30.429764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444256-2499-4b46-aed5-409a44faa28c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:30.429873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444256-2499-4b46-aed5-409a44faa28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:30.447702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ba444256-2499-4b46-aed5-409a44faa28c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:30.448841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ba444256-2499-4b46-aed5-409a44faa28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:30.506235 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3593/7152] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:30.517362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:30.518773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:30.576705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409a2a4-84b0-4b32-80d1-c46f0991e678 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:30.580363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994ff4-e914-41d1-9fd5-7ab84b3fd820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:30.580997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994ff4-e914-41d1-9fd5-7ab84b3fd820 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:30.581274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994ff4-e914-41d1-9fd5-7ab84b3fd820 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:30.581542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994ff4-e914-41d1-9fd5-7ab84b3fd820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:30.590895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24994ff4-e914-41d1-9fd5-7ab84b3fd820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:30.592364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24994ff4-e914-41d1-9fd5-7ab84b3fd820 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:30.601599 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3560/7153] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:11:30.775121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba444256-2499-4b46-aed5-409a44faa28c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:30.777246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ba444256-2499-4b46-aed5-409a44faa28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:30.793141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba444256-2499-4b46-aed5-409a44faa28c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:30.798129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:30.798999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:30.799308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:30.799588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] PATH_INFO: `/v3/projects/bf6faeaa8093415dbcf10657bd44216a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:30.800807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6faeaa8093415dbcf10657bd44216a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:30.802708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:30.848804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6faeaa8093415dbcf10657bd44216a', 'request_id': 'req-fb04b170-bee8-4f37-97db-f907471f80cc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:30.855158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6faeaa8093415dbcf10657bd44216a', 'request_id': 'req-fb04b170-bee8-4f37-97db-f907471f80cc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:30.861249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6faeaa8093415dbcf10657bd44216a', 'request_id': 'req-fb04b170-bee8-4f37-97db-f907471f80cc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:30.871261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] The token cache is being invalidate because project bf6faeaa8093415dbcf10657bd44216a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:11:30.871563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:30.872181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb04b170-bee8-4f37-97db-f907471f80cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:11:30.873699 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3594/7154] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:11:30 2021] DELETE /identity/v3/projects/bf6faeaa8093415dbcf10657bd44216a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:30.879837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2c6b8-afe0-42e0-bb3f-ccfebdd4f196 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:30.880132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2c6b8-afe0-42e0-bb3f-ccfebdd4f196 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:30.880414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca2c6b8-afe0-42e0-bb3f-ccfebdd4f196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:30.898537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1ca2c6b8-afe0-42e0-bb3f-ccfebdd4f196 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:30.899778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1ca2c6b8-afe0-42e0-bb3f-ccfebdd4f196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:30.957372 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3561/7155] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:30.965071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3ba62-d94b-4e1a-a7f1-94ac4b1d4c84 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:30.965992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3ba62-d94b-4e1a-a7f1-94ac4b1d4c84 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:30.966270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3ba62-d94b-4e1a-a7f1-94ac4b1d4c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:30.984064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3ab3ba62-d94b-4e1a-a7f1-94ac4b1d4c84 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:30.985249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3ab3ba62-d94b-4e1a-a7f1-94ac4b1d4c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:30.993037 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3595/7156] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:30.997950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2c6b8-afe0-42e0-bb3f-ccfebdd4f196 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:31.007857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca2c6b8-afe0-42e0-bb3f-ccfebdd4f196 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:31.013257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eb3db-b88c-47b7-87cd-6bea7d85e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:31.013983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eb3db-b88c-47b7-87cd-6bea7d85e775 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:31.014365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eb3db-b88c-47b7-87cd-6bea7d85e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:31.014707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43eb3db-b88c-47b7-87cd-6bea7d85e775 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:31.015541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eb3db-b88c-47b7-87cd-6bea7d85e775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:11:31.015934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eb3db-b88c-47b7-87cd-6bea7d85e775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:31.017600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43eb3db-b88c-47b7-87cd-6bea7d85e775 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:31.029381 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3562/7157] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:11:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:11:31.033796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3ba62-d94b-4e1a-a7f1-94ac4b1d4c84 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:31.043462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3ba62-d94b-4e1a-a7f1-94ac4b1d4c84 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:31.048087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1638-704b-4f7a-8f26-76400f45b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:31.048743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1638-704b-4f7a-8f26-76400f45b6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:31.049027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1638-704b-4f7a-8f26-76400f45b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:31.049301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1638-704b-4f7a-8f26-76400f45b6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:31.050001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d1638-704b-4f7a-8f26-76400f45b6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:31.051934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d1638-704b-4f7a-8f26-76400f45b6b4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:31.081192 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3596/7158] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:11:31 2021] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:11:31.086723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eb3db-b88c-47b7-87cd-6bea7d85e775 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:31.100282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43eb3db-b88c-47b7-87cd-6bea7d85e775 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:31.170221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2c785-5274-48cc-b983-dd95c874f128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:31.170995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2c785-5274-48cc-b983-dd95c874f128 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:31.171396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2c785-5274-48cc-b983-dd95c874f128 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:31.171743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2c785-5274-48cc-b983-dd95c874f128 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:31.172533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2c785-5274-48cc-b983-dd95c874f128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:31.174602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2c785-5274-48cc-b983-dd95c874f128 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:31.195322 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3563/7159] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:11:31 2021] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:11:31.200287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1638-704b-4f7a-8f26-76400f45b6b4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:31.211001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1638-704b-4f7a-8f26-76400f45b6b4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:31.215719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979473eb-d649-4dba-a664-f59d7946ad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:31.216390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979473eb-d649-4dba-a664-f59d7946ad03 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:31.216673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979473eb-d649-4dba-a664-f59d7946ad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:31.216950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979473eb-d649-4dba-a664-f59d7946ad03 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:31.217718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979473eb-d649-4dba-a664-f59d7946ad03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:31.219417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979473eb-d649-4dba-a664-f59d7946ad03 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:31.231040 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3597/7160] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:31 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:31.235142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2c785-5274-48cc-b983-dd95c874f128 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:31.246182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2c785-5274-48cc-b983-dd95c874f128 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:31.251755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2074b-3f3a-4a41-8b40-034228287059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:31.252457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2074b-3f3a-4a41-8b40-034228287059 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:31.252747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2074b-3f3a-4a41-8b40-034228287059 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:31.253025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2074b-3f3a-4a41-8b40-034228287059 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:31.253766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2074b-3f3a-4a41-8b40-034228287059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:31.255410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2074b-3f3a-4a41-8b40-034228287059 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:31.267038 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3564/7161] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:11:31 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:11:31.271200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979473eb-d649-4dba-a664-f59d7946ad03 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:31.281618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979473eb-d649-4dba-a664-f59d7946ad03 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:31.286596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3b84e-18bf-4d76-98ef-cd2efa097028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:31.287530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b84e-18bf-4d76-98ef-cd2efa097028 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:31.287807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b84e-18bf-4d76-98ef-cd2efa097028 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:31.288073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b84e-18bf-4d76-98ef-cd2efa097028 admin admin] PATH_INFO: `/v3/projects/3f06361bf5e646249f7fa39d731d7a47/users/0e6f164420914553abcab066691530d4/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:31.306252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3b84e-18bf-4d76-98ef-cd2efa097028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f06361bf5e646249f7fa39d731d7a47, user_id=0e6f164420914553abcab066691530d4, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:31.309533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3b84e-18bf-4d76-98ef-cd2efa097028 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:31.322936 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3598/7162] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:11:31 2021] PUT /identity/v3/projects/3f06361bf5e646249f7fa39d731d7a47/users/0e6f164420914553abcab066691530d4/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:11:31.333413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12780c-c252-46b4-b735-fcc4af328314 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:31.333924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12780c-c252-46b4-b735-fcc4af328314 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:31.334018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12780c-c252-46b4-b735-fcc4af328314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:31.364693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8d12780c-c252-46b4-b735-fcc4af328314 None None] MFA Rules not processed for user `0e6f164420914553abcab066691530d4`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:31.365895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8d12780c-c252-46b4-b735-fcc4af328314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:31.392015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3b84e-18bf-4d76-98ef-cd2efa097028 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:31.393720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d9d3b84e-18bf-4d76-98ef-cd2efa097028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:31.441464 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3565/7163] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:31 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:31.452268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12780c-c252-46b4-b735-fcc4af328314 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:31.453810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8d12780c-c252-46b4-b735-fcc4af328314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:31.485381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3b84e-18bf-4d76-98ef-cd2efa097028 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:31.490975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7895448-de24-478b-be1f-b1f4cd0c5e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:31.491650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7895448-de24-478b-be1f-b1f4cd0c5e66 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:31.491931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7895448-de24-478b-be1f-b1f4cd0c5e66 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:31.492212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7895448-de24-478b-be1f-b1f4cd0c5e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:31.494389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b7895448-de24-478b-be1f-b1f4cd0c5e66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:31.509486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7895448-de24-478b-be1f-b1f4cd0c5e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:31.511032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7895448-de24-478b-be1f-b1f4cd0c5e66 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:31.513321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12780c-c252-46b4-b735-fcc4af328314 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:31.517277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d75c6-058d-4ba9-9fef-a4d7d4a6fe52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:31.517949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d75c6-058d-4ba9-9fef-a4d7d4a6fe52 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:31.518235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d75c6-058d-4ba9-9fef-a4d7d4a6fe52 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:31.518509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d75c6-058d-4ba9-9fef-a4d7d4a6fe52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:31.523690 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3599/7164] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:11:31.528775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d75c6-058d-4ba9-9fef-a4d7d4a6fe52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:31.530218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d75c6-058d-4ba9-9fef-a4d7d4a6fe52 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:31.539526 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3566/7165] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:31 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:11:33.686729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb73fa4-4095-4eb2-8a86-f6c5235fe0d8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:33.689164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb73fa4-4095-4eb2-8a86-f6c5235fe0d8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:33.689630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb73fa4-4095-4eb2-8a86-f6c5235fe0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:33.722234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3eb73fa4-4095-4eb2-8a86-f6c5235fe0d8 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:33.724220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3eb73fa4-4095-4eb2-8a86-f6c5235fe0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:33.798626 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3600/7166] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:11:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:33.816245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d75c6-058d-4ba9-9fef-a4d7d4a6fe52 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:33.818718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f02d75c6-058d-4ba9-9fef-a4d7d4a6fe52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:33.909467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d75c6-058d-4ba9-9fef-a4d7d4a6fe52 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:33.914914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1efe-7f48-4872-a4a5-dd98c3ac027c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:33.915836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1efe-7f48-4872-a4a5-dd98c3ac027c service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:33.916231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1efe-7f48-4872-a4a5-dd98c3ac027c service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:33.916575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1efe-7f48-4872-a4a5-dd98c3ac027c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:33.931285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc1efe-7f48-4872-a4a5-dd98c3ac027c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:33.932911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc1efe-7f48-4872-a4a5-dd98c3ac027c service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:33.944248 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3567/7167] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:11:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:11:42.890664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb73fa4-4095-4eb2-8a86-f6c5235fe0d8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:42.907573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb73fa4-4095-4eb2-8a86-f6c5235fe0d8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:42.916270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5c54b-2917-4c7a-ad67-b34f9bafe369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:42.917963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c54b-2917-4c7a-ad67-b34f9bafe369 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:42.918447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c54b-2917-4c7a-ad67-b34f9bafe369 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:42.918913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c54b-2917-4c7a-ad67-b34f9bafe369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:42.926260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f9d5c54b-2917-4c7a-ad67-b34f9bafe369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:42.951954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5c54b-2917-4c7a-ad67-b34f9bafe369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:42.957232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5c54b-2917-4c7a-ad67-b34f9bafe369 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:42.978006 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3601/7168] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:11:47.082497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc742ad-90a9-443c-a6a2-fb894a4b43d3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:47.083100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc742ad-90a9-443c-a6a2-fb894a4b43d3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:47.083358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc742ad-90a9-443c-a6a2-fb894a4b43d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:47.101112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-bbc742ad-90a9-443c-a6a2-fb894a4b43d3 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:47.102311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bbc742ad-90a9-443c-a6a2-fb894a4b43d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:47.110410 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3568/7169] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:11:47 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:47.131630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5c54b-2917-4c7a-ad67-b34f9bafe369 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:47.150494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5c54b-2917-4c7a-ad67-b34f9bafe369 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:47.156063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507af6f1-c08b-4f14-8589-bc5b481345e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:47.156722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507af6f1-c08b-4f14-8589-bc5b481345e8 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:47.157191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507af6f1-c08b-4f14-8589-bc5b481345e8 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:47.157479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507af6f1-c08b-4f14-8589-bc5b481345e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:47.166733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507af6f1-c08b-4f14-8589-bc5b481345e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:47.169064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507af6f1-c08b-4f14-8589-bc5b481345e8 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:47.193217 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3602/7170] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:11:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:11:48.843555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542750-79b6-4e7c-bad7-743d956a1dae None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:48.844026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542750-79b6-4e7c-bad7-743d956a1dae None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:48.844026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f542750-79b6-4e7c-bad7-743d956a1dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:48.867394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3f542750-79b6-4e7c-bad7-743d956a1dae None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:48.869055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3f542750-79b6-4e7c-bad7-743d956a1dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:48.879348 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3569/7171] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:11:48 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:48.894019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507af6f1-c08b-4f14-8589-bc5b481345e8 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:48.907149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507af6f1-c08b-4f14-8589-bc5b481345e8 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:48.913597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727fef5-6431-415a-8976-3e1fa7a8d41a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:48.914749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727fef5-6431-415a-8976-3e1fa7a8d41a service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:48.915336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727fef5-6431-415a-8976-3e1fa7a8d41a service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:48.915819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727fef5-6431-415a-8976-3e1fa7a8d41a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:48.928204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727fef5-6431-415a-8976-3e1fa7a8d41a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:48.930590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727fef5-6431-415a-8976-3e1fa7a8d41a service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:48.942037 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3603/7172] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:11:48 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:11:49.426890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de2b27-b485-46a5-87f3-7564530193cb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:49.427517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de2b27-b485-46a5-87f3-7564530193cb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:49.428022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de2b27-b485-46a5-87f3-7564530193cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:49.449381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c8de2b27-b485-46a5-87f3-7564530193cb None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:49.450891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c8de2b27-b485-46a5-87f3-7564530193cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:49.461456 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3570/7173] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:11:49 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:49.477825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727fef5-6431-415a-8976-3e1fa7a8d41a service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:49.502716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727fef5-6431-415a-8976-3e1fa7a8d41a service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:49.522650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21698c21-dab0-45fc-b75f-37882488f5c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:49.523300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698c21-dab0-45fc-b75f-37882488f5c0 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:49.523601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698c21-dab0-45fc-b75f-37882488f5c0 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:49.523867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698c21-dab0-45fc-b75f-37882488f5c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:49.541665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21698c21-dab0-45fc-b75f-37882488f5c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:49.543487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21698c21-dab0-45fc-b75f-37882488f5c0 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:49.553225 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3604/7174] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:11:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:11:51.358115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de2b27-b485-46a5-87f3-7564530193cb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:51.359830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c8de2b27-b485-46a5-87f3-7564530193cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:51.377358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de2b27-b485-46a5-87f3-7564530193cb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:51.382543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5ec66-dca1-4380-9c90-470aadc42dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:51.383208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5ec66-dca1-4380-9c90-470aadc42dbf service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:51.383782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5ec66-dca1-4380-9c90-470aadc42dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:51.383908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5ec66-dca1-4380-9c90-470aadc42dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:51.385697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-95a5ec66-dca1-4380-9c90-470aadc42dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:51.398971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5ec66-dca1-4380-9c90-470aadc42dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:51.400498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5ec66-dca1-4380-9c90-470aadc42dbf service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:51.411521 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3571/7175] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:51 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:11:53.729166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619b15a-af96-42b9-a8a3-8e4a096c7930 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:53.730728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619b15a-af96-42b9-a8a3-8e4a096c7930 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:53.731066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619b15a-af96-42b9-a8a3-8e4a096c7930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:53.750828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a619b15a-af96-42b9-a8a3-8e4a096c7930 None None] MFA Rules not processed for user `43d9798c04074bc9ac45eb33bf3adb46`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:11:53.752060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a619b15a-af96-42b9-a8a3-8e4a096c7930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:53.821590 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3605/7176] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:11:53 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:11:54.620429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5ec66-dca1-4380-9c90-470aadc42dbf service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:11:54.622111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-95a5ec66-dca1-4380-9c90-470aadc42dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:54.707870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5ec66-dca1-4380-9c90-470aadc42dbf service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:11:54.715388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387306de-17ba-45ef-a412-b9f5e2b6dd6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:11:54.716120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387306de-17ba-45ef-a412-b9f5e2b6dd6b service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:11:54.716470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387306de-17ba-45ef-a412-b9f5e2b6dd6b service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:11:54.716808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387306de-17ba-45ef-a412-b9f5e2b6dd6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:11:54.718637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-387306de-17ba-45ef-a412-b9f5e2b6dd6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:11:54.737701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387306de-17ba-45ef-a412-b9f5e2b6dd6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:11:54.740259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387306de-17ba-45ef-a412-b9f5e2b6dd6b service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:11:54.764911 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3572/7177] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:11:54 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:12:13.061575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801aafc-9626-4d1d-b33f-eec4bb7a28d1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:13.062136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801aafc-9626-4d1d-b33f-eec4bb7a28d1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:13.062246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801aafc-9626-4d1d-b33f-eec4bb7a28d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:13.080983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d801aafc-9626-4d1d-b33f-eec4bb7a28d1 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:12:13.082222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d801aafc-9626-4d1d-b33f-eec4bb7a28d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:13.090156 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3606/7178] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:12:13 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:12:13.116543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387306de-17ba-45ef-a412-b9f5e2b6dd6b service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:13.131505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387306de-17ba-45ef-a412-b9f5e2b6dd6b service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:13.137257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5768513-a9f6-4e22-a7b1-69e25cb85b78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:13.138021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5768513-a9f6-4e22-a7b1-69e25cb85b78 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:13.138397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5768513-a9f6-4e22-a7b1-69e25cb85b78 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:13.138792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5768513-a9f6-4e22-a7b1-69e25cb85b78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:13.147786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5768513-a9f6-4e22-a7b1-69e25cb85b78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:13.149555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5768513-a9f6-4e22-a7b1-69e25cb85b78 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:13.158080 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3573/7179] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:12:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:12:33.777849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801aafc-9626-4d1d-b33f-eec4bb7a28d1 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:33.801544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801aafc-9626-4d1d-b33f-eec4bb7a28d1 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:33.809813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7dc4e3-a10e-4e99-a4e1-7c19ab311e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:33.810485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dc4e3-a10e-4e99-a4e1-7c19ab311e70 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:33.810770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dc4e3-a10e-4e99-a4e1-7c19ab311e70 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:33.813736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dc4e3-a10e-4e99-a4e1-7c19ab311e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:33.816583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4d7dc4e3-a10e-4e99-a4e1-7c19ab311e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:33.842502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7dc4e3-a10e-4e99-a4e1-7c19ab311e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:33.844172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7dc4e3-a10e-4e99-a4e1-7c19ab311e70 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:33.872291 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3607/7180] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:12:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:12:34.781711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0f13d-dfc6-4bb9-88dc-769a0ab8bcee None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:34.782353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0f13d-dfc6-4bb9-88dc-769a0ab8bcee None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:34.782353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0f13d-dfc6-4bb9-88dc-769a0ab8bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:34.801624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-84f0f13d-dfc6-4bb9-88dc-769a0ab8bcee None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:12:34.803194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-84f0f13d-dfc6-4bb9-88dc-769a0ab8bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:34.816582 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3574/7181] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:12:34 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:12:34.835380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7dc4e3-a10e-4e99-a4e1-7c19ab311e70 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:34.850171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7dc4e3-a10e-4e99-a4e1-7c19ab311e70 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:34.857171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad003055-83f2-410d-ac72-31d15846bed8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:34.858049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003055-83f2-410d-ac72-31d15846bed8 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:34.858505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003055-83f2-410d-ac72-31d15846bed8 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:34.858954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad003055-83f2-410d-ac72-31d15846bed8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:34.873734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad003055-83f2-410d-ac72-31d15846bed8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:34.875400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad003055-83f2-410d-ac72-31d15846bed8 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:34.886206 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3608/7182] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:12:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:12:46.784210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1381e-96f8-4330-944a-5bb79d81f91c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:46.784846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1381e-96f8-4330-944a-5bb79d81f91c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:46.784846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1381e-96f8-4330-944a-5bb79d81f91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:46.803933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0ad1381e-96f8-4330-944a-5bb79d81f91c None None] MFA Rules not processed for user `43d9798c04074bc9ac45eb33bf3adb46`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:12:46.805166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0ad1381e-96f8-4330-944a-5bb79d81f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:46.815710 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3575/7183] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:12:46 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:12:51.324125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad003055-83f2-410d-ac72-31d15846bed8 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:51.328234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ad003055-83f2-410d-ac72-31d15846bed8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:51.357972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad003055-83f2-410d-ac72-31d15846bed8 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:51.374344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a743c-b8b7-4f71-ace5-ee0a4df10104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:51.375031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a743c-b8b7-4f71-ace5-ee0a4df10104 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:51.375341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a743c-b8b7-4f71-ace5-ee0a4df10104 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:51.375834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a743c-b8b7-4f71-ace5-ee0a4df10104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:51.378855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e25a743c-b8b7-4f71-ace5-ee0a4df10104 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:51.432653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a743c-b8b7-4f71-ace5-ee0a4df10104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:51.444912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a743c-b8b7-4f71-ace5-ee0a4df10104 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:51.490285 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3609/7184] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:12:51 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:12:53.317027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70fd5-3ea1-441c-9538-b48f674c909f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:53.317542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70fd5-3ea1-441c-9538-b48f674c909f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:53.317676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f70fd5-3ea1-441c-9538-b48f674c909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:53.336721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-57f70fd5-3ea1-441c-9538-b48f674c909f None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:12:53.338096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-57f70fd5-3ea1-441c-9538-b48f674c909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:53.346221 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3576/7185] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:12:53 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:12:53.361463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a743c-b8b7-4f71-ace5-ee0a4df10104 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:53.378319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a743c-b8b7-4f71-ace5-ee0a4df10104 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:53.388444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c019c61-e4ad-48fc-97a7-606954a72b3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:53.389520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c019c61-e4ad-48fc-97a7-606954a72b3f service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:53.390241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c019c61-e4ad-48fc-97a7-606954a72b3f service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:53.390590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c019c61-e4ad-48fc-97a7-606954a72b3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:53.406443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c019c61-e4ad-48fc-97a7-606954a72b3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:53.408270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c019c61-e4ad-48fc-97a7-606954a72b3f service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:53.444359 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3610/7186] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:12:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:12:58.766216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70fd5-3ea1-441c-9538-b48f674c909f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:58.846633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f70fd5-3ea1-441c-9538-b48f674c909f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:58.851543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:58.853022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:58.853304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:58.853576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] PATH_INFO: `/v3/users/0e6f164420914553abcab066691530d4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:58.854812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6f164420914553abcab066691530d4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:58.856847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:58.904544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6f164420914553abcab066691530d4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:12:58.905185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6f164420914553abcab066691530d4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:12:58.912232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6f164420914553abcab066691530d4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:12:58.912861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6f164420914553abcab066691530d4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:12:58.920375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6f164420914553abcab066691530d4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:12:58.936880 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3577/7187] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:12:58 2021] DELETE /identity/v3/users/0e6f164420914553abcab066691530d4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:12:58.941354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98447-51da-4419-9a04-d2b90116a2dd None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:58.941891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98447-51da-4419-9a04-d2b90116a2dd None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:58.941891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98447-51da-4419-9a04-d2b90116a2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:58.958909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c4b98447-51da-4419-9a04-d2b90116a2dd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:12:58.960236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c4b98447-51da-4419-9a04-d2b90116a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:59.019185 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3611/7188] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:12:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:12:59.034763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:59.036170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:59.097530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1994a04-8691-4b11-bcca-472da4664e54 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:59.101267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05eb807-839a-4655-8d0d-0951da831d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:59.102558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05eb807-839a-4655-8d0d-0951da831d49 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.102995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05eb807-839a-4655-8d0d-0951da831d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.103298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05eb807-839a-4655-8d0d-0951da831d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:59.113260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05eb807-839a-4655-8d0d-0951da831d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:59.114198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05eb807-839a-4655-8d0d-0951da831d49 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:59.125454 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3578/7189] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:12:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:12:59.302060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b98447-51da-4419-9a04-d2b90116a2dd None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:59.303664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c4b98447-51da-4419-9a04-d2b90116a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:59.317820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b98447-51da-4419-9a04-d2b90116a2dd None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:59.323994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:59.324852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.325134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.325408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] PATH_INFO: `/v3/projects/3f06361bf5e646249f7fa39d731d7a47` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:59.326605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f06361bf5e646249f7fa39d731d7a47)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:59.328616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:59.378780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f06361bf5e646249f7fa39d731d7a47', 'request_id': 'req-be14d99b-77ea-4e99-b3f9-e5336a0d4614'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:12:59.386068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f06361bf5e646249f7fa39d731d7a47', 'request_id': 'req-be14d99b-77ea-4e99-b3f9-e5336a0d4614'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:12:59.392326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f06361bf5e646249f7fa39d731d7a47', 'request_id': 'req-be14d99b-77ea-4e99-b3f9-e5336a0d4614'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:12:59.402641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] The token cache is being invalidate because project 3f06361bf5e646249f7fa39d731d7a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:12:59.402926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:12:59.403580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be14d99b-77ea-4e99-b3f9-e5336a0d4614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:12:59.405129 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3612/7190] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:12:59 2021] DELETE /identity/v3/projects/3f06361bf5e646249f7fa39d731d7a47 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:12:59.411878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca08b8-c860-40f0-bab2-118e99b4e2a4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.412171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca08b8-c860-40f0-bab2-118e99b4e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.412456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca08b8-c860-40f0-bab2-118e99b4e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:59.430264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-77ca08b8-c860-40f0-bab2-118e99b4e2a4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:12:59.431628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-77ca08b8-c860-40f0-bab2-118e99b4e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:59.490722 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3579/7191] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:12:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:12:59.498814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76944d-8f40-4f6a-ad9f-acdcea12d6c5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.499061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76944d-8f40-4f6a-ad9f-acdcea12d6c5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.499365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76944d-8f40-4f6a-ad9f-acdcea12d6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:59.517838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bd76944d-8f40-4f6a-ad9f-acdcea12d6c5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:12:59.519011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bd76944d-8f40-4f6a-ad9f-acdcea12d6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:59.527128 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3613/7192] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:12:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:12:59.531390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca08b8-c860-40f0-bab2-118e99b4e2a4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:59.540889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca08b8-c860-40f0-bab2-118e99b4e2a4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:59.545478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7c9a-3d41-4694-b6da-a166bdbdf45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:59.546150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7c9a-3d41-4694-b6da-a166bdbdf45f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.546440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7c9a-3d41-4694-b6da-a166bdbdf45f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.546721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7c9a-3d41-4694-b6da-a166bdbdf45f admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:59.547630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a7c9a-3d41-4694-b6da-a166bdbdf45f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:12:59.547944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a7c9a-3d41-4694-b6da-a166bdbdf45f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:59.549555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a7c9a-3d41-4694-b6da-a166bdbdf45f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:59.561387 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3580/7193] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:12:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:12:59.565325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76944d-8f40-4f6a-ad9f-acdcea12d6c5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:59.574827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76944d-8f40-4f6a-ad9f-acdcea12d6c5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:59.579490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c3224-14f2-4c63-96a1-b64659fcb864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:59.580123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c3224-14f2-4c63-96a1-b64659fcb864 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.580399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c3224-14f2-4c63-96a1-b64659fcb864 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.580671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c3224-14f2-4c63-96a1-b64659fcb864 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:59.581357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c3224-14f2-4c63-96a1-b64659fcb864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:59.583217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c3224-14f2-4c63-96a1-b64659fcb864 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:59.607400 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3614/7194] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:12:59 2021] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:12:59.611702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7c9a-3d41-4694-b6da-a166bdbdf45f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:59.622167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7c9a-3d41-4694-b6da-a166bdbdf45f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:59.676939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd3ae1-c39b-4a03-aeea-89808faa3eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:59.677636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd3ae1-c39b-4a03-aeea-89808faa3eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.678068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd3ae1-c39b-4a03-aeea-89808faa3eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.678352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd3ae1-c39b-4a03-aeea-89808faa3eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:59.679050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd3ae1-c39b-4a03-aeea-89808faa3eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:59.681536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd3ae1-c39b-4a03-aeea-89808faa3eb7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:59.702140 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3581/7195] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:12:59 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:12:59.705844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c3224-14f2-4c63-96a1-b64659fcb864 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:59.716187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c3224-14f2-4c63-96a1-b64659fcb864 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:59.720895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8b5e3-9cdb-478b-b650-6d6c5e5ad088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:59.721578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b5e3-9cdb-478b-b650-6d6c5e5ad088 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.721864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b5e3-9cdb-478b-b650-6d6c5e5ad088 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.722141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8b5e3-9cdb-478b-b650-6d6c5e5ad088 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:59.722901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8b5e3-9cdb-478b-b650-6d6c5e5ad088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:59.724540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8b5e3-9cdb-478b-b650-6d6c5e5ad088 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:59.735024 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3615/7196] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:12:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:12:59.738954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd3ae1-c39b-4a03-aeea-89808faa3eb7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:59.749765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd3ae1-c39b-4a03-aeea-89808faa3eb7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:59.754410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb55cd9-84e1-445f-be90-a2a2dcb0cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:59.755085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb55cd9-84e1-445f-be90-a2a2dcb0cf5f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.755416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb55cd9-84e1-445f-be90-a2a2dcb0cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.755698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb55cd9-84e1-445f-be90-a2a2dcb0cf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:59.756426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb55cd9-84e1-445f-be90-a2a2dcb0cf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:59.758983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb55cd9-84e1-445f-be90-a2a2dcb0cf5f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:59.768673 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3582/7197] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:12:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:12:59.772841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8b5e3-9cdb-478b-b650-6d6c5e5ad088 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:59.782639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8b5e3-9cdb-478b-b650-6d6c5e5ad088 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:59.787529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4463c4-db4c-4961-a9f7-8b3a5fea98cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:59.788386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4463c4-db4c-4961-a9f7-8b3a5fea98cd admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.788666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4463c4-db4c-4961-a9f7-8b3a5fea98cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.788940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4463c4-db4c-4961-a9f7-8b3a5fea98cd admin admin] PATH_INFO: `/v3/projects/2bc43ac9ba60464592b7d8b5433737a4/users/7ac7ee447e7d4cb9b6b8a7f167f38564/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:59.803042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4463c4-db4c-4961-a9f7-8b3a5fea98cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc43ac9ba60464592b7d8b5433737a4, user_id=7ac7ee447e7d4cb9b6b8a7f167f38564, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:12:59.806252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4463c4-db4c-4961-a9f7-8b3a5fea98cd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:12:59.818882 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3616/7198] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:12:59 2021] PUT /identity/v3/projects/2bc43ac9ba60464592b7d8b5433737a4/users/7ac7ee447e7d4cb9b6b8a7f167f38564/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:12:59.829528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769993b7-13d3-4802-9410-1e61a20e7b17 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.829815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769993b7-13d3-4802-9410-1e61a20e7b17 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.830091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769993b7-13d3-4802-9410-1e61a20e7b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:12:59.856881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-769993b7-13d3-4802-9410-1e61a20e7b17 None None] MFA Rules not processed for user `7ac7ee447e7d4cb9b6b8a7f167f38564`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:12:59.858112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-769993b7-13d3-4802-9410-1e61a20e7b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:59.920282 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3583/7199] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:12:59 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:12:59.931637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4463c4-db4c-4961-a9f7-8b3a5fea98cd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:12:59.933309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ad4463c4-db4c-4961-a9f7-8b3a5fea98cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:12:59.989174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4463c4-db4c-4961-a9f7-8b3a5fea98cd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:12:59.993941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba20703-359f-48fe-a161-d24d55dcd1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:12:59.994578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20703-359f-48fe-a161-d24d55dcd1db service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:12:59.994887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20703-359f-48fe-a161-d24d55dcd1db service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:12:59.995162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20703-359f-48fe-a161-d24d55dcd1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:00.003524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba20703-359f-48fe-a161-d24d55dcd1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:00.004903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba20703-359f-48fe-a161-d24d55dcd1db service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:00.013798 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3617/7200] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:12:59 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:06.357143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769993b7-13d3-4802-9410-1e61a20e7b17 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:06.424931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769993b7-13d3-4802-9410-1e61a20e7b17 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:06.429463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:06.430846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:06.431176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:06.431420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] PATH_INFO: `/v3/users/7ac7ee447e7d4cb9b6b8a7f167f38564` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:06.432656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac7ee447e7d4cb9b6b8a7f167f38564)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:06.434587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:06.482110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac7ee447e7d4cb9b6b8a7f167f38564'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:06.482787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac7ee447e7d4cb9b6b8a7f167f38564'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:06.489507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac7ee447e7d4cb9b6b8a7f167f38564'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:06.490143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac7ee447e7d4cb9b6b8a7f167f38564'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:06.497636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac7ee447e7d4cb9b6b8a7f167f38564'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:06.514781 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3584/7201] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:13:06 2021] DELETE /identity/v3/users/7ac7ee447e7d4cb9b6b8a7f167f38564 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:06.519334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305144-8ada-46c3-921c-9b73886482c5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:06.519860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305144-8ada-46c3-921c-9b73886482c5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:06.519860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305144-8ada-46c3-921c-9b73886482c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:06.536992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e3305144-8ada-46c3-921c-9b73886482c5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:06.538161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e3305144-8ada-46c3-921c-9b73886482c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:06.594284 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3618/7202] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:13:06.604195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:06.605624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:06.664475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e40e6-f1a1-4f43-aa2b-5f220b863652 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:06.668073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b80dc9-d320-473e-a8a2-ea0b0f97a399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:06.668738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80dc9-d320-473e-a8a2-ea0b0f97a399 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:06.669019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80dc9-d320-473e-a8a2-ea0b0f97a399 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:06.669583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b80dc9-d320-473e-a8a2-ea0b0f97a399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:06.681214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b80dc9-d320-473e-a8a2-ea0b0f97a399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:06.682786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b80dc9-d320-473e-a8a2-ea0b0f97a399 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:06.693870 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3585/7203] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:13:06.860874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3305144-8ada-46c3-921c-9b73886482c5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:06.862377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e3305144-8ada-46c3-921c-9b73886482c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:06.876462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3305144-8ada-46c3-921c-9b73886482c5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:06.881336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:06.882194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:06.883215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:06.883532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] PATH_INFO: `/v3/projects/2bc43ac9ba60464592b7d8b5433737a4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:06.885145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc43ac9ba60464592b7d8b5433737a4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:06.887039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:06.933499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc43ac9ba60464592b7d8b5433737a4', 'request_id': 'req-be2d7b19-12aa-4abc-a274-5ed6732d07d9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:06.940660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc43ac9ba60464592b7d8b5433737a4', 'request_id': 'req-be2d7b19-12aa-4abc-a274-5ed6732d07d9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:06.946789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc43ac9ba60464592b7d8b5433737a4', 'request_id': 'req-be2d7b19-12aa-4abc-a274-5ed6732d07d9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:06.956763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] The token cache is being invalidate because project 2bc43ac9ba60464592b7d8b5433737a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:13:06.957048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:06.957670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be2d7b19-12aa-4abc-a274-5ed6732d07d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:06.959201 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3619/7204] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:13:06 2021] DELETE /identity/v3/projects/2bc43ac9ba60464592b7d8b5433737a4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:06.965308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a33610-b191-4557-82e6-343c1ecce578 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:06.965602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a33610-b191-4557-82e6-343c1ecce578 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:06.965908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a33610-b191-4557-82e6-343c1ecce578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:06.983990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d7a33610-b191-4557-82e6-343c1ecce578 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:06.985201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d7a33610-b191-4557-82e6-343c1ecce578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:07.049040 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3586/7205] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:07.056873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20924e1d-607f-43e3-b6a0-4848f5eed970 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.057167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20924e1d-607f-43e3-b6a0-4848f5eed970 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.057447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20924e1d-607f-43e3-b6a0-4848f5eed970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.075659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-20924e1d-607f-43e3-b6a0-4848f5eed970 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:07.076854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-20924e1d-607f-43e3-b6a0-4848f5eed970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:07.084735 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3620/7206] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:07.089346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a33610-b191-4557-82e6-343c1ecce578 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.098911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a33610-b191-4557-82e6-343c1ecce578 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.104200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c816ed-c83e-43e9-8a1f-58ba6053737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.104842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c816ed-c83e-43e9-8a1f-58ba6053737b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.105130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c816ed-c83e-43e9-8a1f-58ba6053737b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.105406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c816ed-c83e-43e9-8a1f-58ba6053737b admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.106135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c816ed-c83e-43e9-8a1f-58ba6053737b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:13:07.106443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c816ed-c83e-43e9-8a1f-58ba6053737b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.108084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c816ed-c83e-43e9-8a1f-58ba6053737b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.119737 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3587/7207] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:13:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:13:07.123895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20924e1d-607f-43e3-b6a0-4848f5eed970 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.133170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20924e1d-607f-43e3-b6a0-4848f5eed970 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.138010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd9ec-a7de-4b74-9d27-83cf03ae76e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.138650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd9ec-a7de-4b74-9d27-83cf03ae76e9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.138927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd9ec-a7de-4b74-9d27-83cf03ae76e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.139198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd9ec-a7de-4b74-9d27-83cf03ae76e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.139932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efd9ec-a7de-4b74-9d27-83cf03ae76e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.141805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efd9ec-a7de-4b74-9d27-83cf03ae76e9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.168259 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3621/7208] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:13:07 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:07.172531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c816ed-c83e-43e9-8a1f-58ba6053737b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.182697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c816ed-c83e-43e9-8a1f-58ba6053737b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.236853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c7509-3e8f-420a-8c97-28d738e9de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.237429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7509-3e8f-420a-8c97-28d738e9de7f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.237709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7509-3e8f-420a-8c97-28d738e9de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.237981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7509-3e8f-420a-8c97-28d738e9de7f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.238665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c7509-3e8f-420a-8c97-28d738e9de7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.240601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c7509-3e8f-420a-8c97-28d738e9de7f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.259609 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3588/7209] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:13:07 2021] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:13:07.263846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd9ec-a7de-4b74-9d27-83cf03ae76e9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.274581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd9ec-a7de-4b74-9d27-83cf03ae76e9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.279347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dceba-2a0e-4ba0-b5a9-caed8c24dc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.280042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dceba-2a0e-4ba0-b5a9-caed8c24dc79 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.280345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dceba-2a0e-4ba0-b5a9-caed8c24dc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.280597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dceba-2a0e-4ba0-b5a9-caed8c24dc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.281349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dceba-2a0e-4ba0-b5a9-caed8c24dc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.282955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dceba-2a0e-4ba0-b5a9-caed8c24dc79 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.293962 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3622/7210] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:13:07.297914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c7509-3e8f-420a-8c97-28d738e9de7f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.307729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c7509-3e8f-420a-8c97-28d738e9de7f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.312700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93341b3-9a4f-4053-8bb1-40618c577ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.313337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93341b3-9a4f-4053-8bb1-40618c577ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.313618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93341b3-9a4f-4053-8bb1-40618c577ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.313890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93341b3-9a4f-4053-8bb1-40618c577ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.314629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93341b3-9a4f-4053-8bb1-40618c577ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.316239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93341b3-9a4f-4053-8bb1-40618c577ab3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.325798 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3589/7211] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:07 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:07.329853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dceba-2a0e-4ba0-b5a9-caed8c24dc79 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.340544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dceba-2a0e-4ba0-b5a9-caed8c24dc79 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.345206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e1d75-3d33-40a2-878a-44c4b9240d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.346082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e1d75-3d33-40a2-878a-44c4b9240d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.346369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e1d75-3d33-40a2-878a-44c4b9240d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.346649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e1d75-3d33-40a2-878a-44c4b9240d8c admin admin] PATH_INFO: `/v3/projects/cb3145e89af44609a08c102ae0ff2ef6/users/de8fba517e0246e2a2e3dd9586aa5f15/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.361574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e1d75-3d33-40a2-878a-44c4b9240d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3145e89af44609a08c102ae0ff2ef6, user_id=de8fba517e0246e2a2e3dd9586aa5f15, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.364257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e1d75-3d33-40a2-878a-44c4b9240d8c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.379938 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3623/7212] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:07 2021] PUT /identity/v3/projects/cb3145e89af44609a08c102ae0ff2ef6/users/de8fba517e0246e2a2e3dd9586aa5f15/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:07.391082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b98c10-a7a6-48f6-8589-b96f7dc5915e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.391615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b98c10-a7a6-48f6-8589-b96f7dc5915e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.391725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b98c10-a7a6-48f6-8589-b96f7dc5915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.418060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e0b98c10-a7a6-48f6-8589-b96f7dc5915e None None] MFA Rules not processed for user `de8fba517e0246e2a2e3dd9586aa5f15`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:07.419244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e0b98c10-a7a6-48f6-8589-b96f7dc5915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:07.480416 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3590/7213] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:07 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:07.484868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e1d75-3d33-40a2-878a-44c4b9240d8c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.544748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e1d75-3d33-40a2-878a-44c4b9240d8c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.549628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f6dd0-8e8c-44ac-bc6a-a13602215b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.550281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f6dd0-8e8c-44ac-bc6a-a13602215b8d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.550568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f6dd0-8e8c-44ac-bc6a-a13602215b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.550848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f6dd0-8e8c-44ac-bc6a-a13602215b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.551593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f6dd0-8e8c-44ac-bc6a-a13602215b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.553487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f6dd0-8e8c-44ac-bc6a-a13602215b8d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.578127 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3624/7214] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:13:07 2021] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:07.582675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b98c10-a7a6-48f6-8589-b96f7dc5915e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.593842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b98c10-a7a6-48f6-8589-b96f7dc5915e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.647268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d186ff-e9f8-44b1-b32c-aa7d628b4c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.647939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d186ff-e9f8-44b1-b32c-aa7d628b4c05 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.648805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d186ff-e9f8-44b1-b32c-aa7d628b4c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.649089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d186ff-e9f8-44b1-b32c-aa7d628b4c05 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.649781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d186ff-e9f8-44b1-b32c-aa7d628b4c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.651710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d186ff-e9f8-44b1-b32c-aa7d628b4c05 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.671968 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3591/7215] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:13:07 2021] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:07.676017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f6dd0-8e8c-44ac-bc6a-a13602215b8d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.686561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f6dd0-8e8c-44ac-bc6a-a13602215b8d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.691200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d15ae8-3800-4bda-9f62-09195d62f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.691889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d15ae8-3800-4bda-9f62-09195d62f232 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.692178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d15ae8-3800-4bda-9f62-09195d62f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.692459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d15ae8-3800-4bda-9f62-09195d62f232 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.693194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d15ae8-3800-4bda-9f62-09195d62f232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.694779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d15ae8-3800-4bda-9f62-09195d62f232 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.706379 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3625/7216] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:07.710437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d186ff-e9f8-44b1-b32c-aa7d628b4c05 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.720889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d186ff-e9f8-44b1-b32c-aa7d628b4c05 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.725550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2c628-30de-40b4-be92-a2753a84f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.726493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2c628-30de-40b4-be92-a2753a84f8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.726905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2c628-30de-40b4-be92-a2753a84f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.727185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2c628-30de-40b4-be92-a2753a84f8e4 admin admin] PATH_INFO: `/v3/projects/dea8240b1aba428ba7d40aaa68ae2fdf/users/228b2c94c93b4625b6e29beb84fe4ca2/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.744715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2c628-30de-40b4-be92-a2753a84f8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea8240b1aba428ba7d40aaa68ae2fdf, user_id=228b2c94c93b4625b6e29beb84fe4ca2, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.747424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2c628-30de-40b4-be92-a2753a84f8e4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.760553 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3592/7217] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:07 2021] PUT /identity/v3/projects/dea8240b1aba428ba7d40aaa68ae2fdf/users/228b2c94c93b4625b6e29beb84fe4ca2/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:07.764475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d15ae8-3800-4bda-9f62-09195d62f232 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.774562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d15ae8-3800-4bda-9f62-09195d62f232 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.833333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddf4c7-119f-421d-a577-1f6df8999019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.834004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddf4c7-119f-421d-a577-1f6df8999019 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.834284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddf4c7-119f-421d-a577-1f6df8999019 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.834563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddf4c7-119f-421d-a577-1f6df8999019 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.835325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddf4c7-119f-421d-a577-1f6df8999019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.836953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddf4c7-119f-421d-a577-1f6df8999019 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.847278 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3626/7218] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:07 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:07.851464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2c628-30de-40b4-be92-a2753a84f8e4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:07.861858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2c628-30de-40b4-be92-a2753a84f8e4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:07.866794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb1338-85e3-4d8f-b7ca-4c664f4901bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:07.868469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1338-85e3-4d8f-b7ca-4c664f4901bc admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.868782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1338-85e3-4d8f-b7ca-4c664f4901bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.869059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb1338-85e3-4d8f-b7ca-4c664f4901bc admin admin] PATH_INFO: `/v3/projects/dea8240b1aba428ba7d40aaa68ae2fdf/users/228b2c94c93b4625b6e29beb84fe4ca2/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.871075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb1338-85e3-4d8f-b7ca-4c664f4901bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea8240b1aba428ba7d40aaa68ae2fdf, user_id=228b2c94c93b4625b6e29beb84fe4ca2, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:07.873809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb1338-85e3-4d8f-b7ca-4c664f4901bc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:07.884943 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3593/7219] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:07 2021] PUT /identity/v3/projects/dea8240b1aba428ba7d40aaa68ae2fdf/users/228b2c94c93b4625b6e29beb84fe4ca2/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:13:07.966803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384c06f-0cb5-4581-ad79-a7d0b43e2984 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:07.967078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384c06f-0cb5-4581-ad79-a7d0b43e2984 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:07.967397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384c06f-0cb5-4581-ad79-a7d0b43e2984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:07.994196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c384c06f-0cb5-4581-ad79-a7d0b43e2984 None None] MFA Rules not processed for user `228b2c94c93b4625b6e29beb84fe4ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:07.995449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c384c06f-0cb5-4581-ad79-a7d0b43e2984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:08.060467 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3627/7220] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:07 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:08.071409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb1338-85e3-4d8f-b7ca-4c664f4901bc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:08.073053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49fb1338-85e3-4d8f-b7ca-4c664f4901bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:08.129921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb1338-85e3-4d8f-b7ca-4c664f4901bc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:08.134246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73338a58-540f-4002-90f4-b49846da58b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:08.134908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73338a58-540f-4002-90f4-b49846da58b8 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:08.135191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73338a58-540f-4002-90f4-b49846da58b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:08.135500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73338a58-540f-4002-90f4-b49846da58b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:08.189522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73338a58-540f-4002-90f4-b49846da58b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:08.190958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73338a58-540f-4002-90f4-b49846da58b8 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:08.199871 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3594/7221] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:08 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:10.707436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384c06f-0cb5-4581-ad79-a7d0b43e2984 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:10.719009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384c06f-0cb5-4581-ad79-a7d0b43e2984 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:10.722523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5580c-7f4b-45c3-b588-9ec2d293b182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:10.723146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5580c-7f4b-45c3-b588-9ec2d293b182 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:10.723453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5580c-7f4b-45c3-b588-9ec2d293b182 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:10.723728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5580c-7f4b-45c3-b588-9ec2d293b182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:10.732973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5580c-7f4b-45c3-b588-9ec2d293b182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:10.734375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5580c-7f4b-45c3-b588-9ec2d293b182 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:10.744333 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3628/7222] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:10 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:19.570387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73338a58-540f-4002-90f4-b49846da58b8 service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:19.571841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-73338a58-540f-4002-90f4-b49846da58b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:19.629109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73338a58-540f-4002-90f4-b49846da58b8 service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:19.632763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cb534-b3d8-499c-a369-29b178445083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:19.633395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cb534-b3d8-499c-a369-29b178445083 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:19.633677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cb534-b3d8-499c-a369-29b178445083 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:19.634060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cb534-b3d8-499c-a369-29b178445083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:19.635844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8a9cb534-b3d8-499c-a369-29b178445083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:19.692100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cb534-b3d8-499c-a369-29b178445083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:19.693545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cb534-b3d8-499c-a369-29b178445083 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:19.702519 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3595/7223] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:19 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:22.322501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5580c-7f4b-45c3-b588-9ec2d293b182 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:22.323946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-deb5580c-7f4b-45c3-b588-9ec2d293b182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:22.338848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5580c-7f4b-45c3-b588-9ec2d293b182 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:22.342516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ca13-effb-4151-bc24-a0c1ad127e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:22.343156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ca13-effb-4151-bc24-a0c1ad127e98 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:22.343474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ca13-effb-4151-bc24-a0c1ad127e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:22.343754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ca13-effb-4151-bc24-a0c1ad127e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:22.345480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6bf0ca13-effb-4151-bc24-a0c1ad127e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:22.410178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0ca13-effb-4151-bc24-a0c1ad127e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:22.411667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0ca13-effb-4151-bc24-a0c1ad127e98 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:22.421767 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3629/7224] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:13:25.179033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cb534-b3d8-499c-a369-29b178445083 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:25.191469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cb534-b3d8-499c-a369-29b178445083 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:25.197365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:25.198758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:25.199232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:25.199535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] PATH_INFO: `/v3/users/de8fba517e0246e2a2e3dd9586aa5f15` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:25.201483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8fba517e0246e2a2e3dd9586aa5f15)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:25.203710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:25.262376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8fba517e0246e2a2e3dd9586aa5f15'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:25.263050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8fba517e0246e2a2e3dd9586aa5f15'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:25.271938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8fba517e0246e2a2e3dd9586aa5f15'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:25.273177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8fba517e0246e2a2e3dd9586aa5f15'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:25.281259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8fba517e0246e2a2e3dd9586aa5f15'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:25.302419 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3596/7225] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:13:25 2021] DELETE /identity/v3/users/de8fba517e0246e2a2e3dd9586aa5f15 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:25.304178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c781c79-f2e6-4274-a845-d6aa92831ace None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:25.304655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c781c79-f2e6-4274-a845-d6aa92831ace None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:25.304767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c781c79-f2e6-4274-a845-d6aa92831ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:25.323666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9c781c79-f2e6-4274-a845-d6aa92831ace None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:25.324871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9c781c79-f2e6-4274-a845-d6aa92831ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:25.386498 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3630/7226] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:25.396489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:25.398012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:25.459550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db5982-e025-40ac-a5b8-2452c659a542 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:25.464041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c044fbe-7ada-43ae-a51a-955691196dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:25.464863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c044fbe-7ada-43ae-a51a-955691196dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:25.465036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c044fbe-7ada-43ae-a51a-955691196dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:25.465228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c044fbe-7ada-43ae-a51a-955691196dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:25.481201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c044fbe-7ada-43ae-a51a-955691196dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:25.481201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c044fbe-7ada-43ae-a51a-955691196dc9 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:25.486101 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3597/7227] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:13:25.836617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c781c79-f2e6-4274-a845-d6aa92831ace None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:25.839426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9c781c79-f2e6-4274-a845-d6aa92831ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:25.862160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c781c79-f2e6-4274-a845-d6aa92831ace None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:25.868047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:25.868964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:25.869248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:25.869525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] PATH_INFO: `/v3/projects/cb3145e89af44609a08c102ae0ff2ef6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:25.871767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb3145e89af44609a08c102ae0ff2ef6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:25.874344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:25.944241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3145e89af44609a08c102ae0ff2ef6', 'request_id': 'req-ab014933-2085-4ade-b1b8-3a7ce44c62a8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:25.955603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3145e89af44609a08c102ae0ff2ef6', 'request_id': 'req-ab014933-2085-4ade-b1b8-3a7ce44c62a8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:25.963843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3145e89af44609a08c102ae0ff2ef6', 'request_id': 'req-ab014933-2085-4ade-b1b8-3a7ce44c62a8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:25.978317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] The token cache is being invalidate because project cb3145e89af44609a08c102ae0ff2ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:13:25.978633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:25.979283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:25.981306 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3631/7228] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:13:25 2021] DELETE /identity/v3/projects/cb3145e89af44609a08c102ae0ff2ef6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:25.985053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c044fbe-7ada-43ae-a51a-955691196dc9 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:25.996982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c044fbe-7ada-43ae-a51a-955691196dc9 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:26.061931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d2d6d-b3ac-4e69-92cd-53c1ecc0429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:26.062843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2d6d-b3ac-4e69-92cd-53c1ecc0429d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:26.063193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2d6d-b3ac-4e69-92cd-53c1ecc0429d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:26.063566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2d6d-b3ac-4e69-92cd-53c1ecc0429d admin admin] PATH_INFO: `/v3/users/228b2c94c93b4625b6e29beb84fe4ca2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:26.064845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d2d6d-b3ac-4e69-92cd-53c1ecc0429d admin admin] RBAC: Authorizing `identity:delete_user(user_id=228b2c94c93b4625b6e29beb84fe4ca2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:26.066862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d2d6d-b3ac-4e69-92cd-53c1ecc0429d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:26.114645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8e4d2d6d-b3ac-4e69-92cd-53c1ecc0429d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228b2c94c93b4625b6e29beb84fe4ca2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:26.115334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8e4d2d6d-b3ac-4e69-92cd-53c1ecc0429d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228b2c94c93b4625b6e29beb84fe4ca2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:26.124837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8e4d2d6d-b3ac-4e69-92cd-53c1ecc0429d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228b2c94c93b4625b6e29beb84fe4ca2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:26.125517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8e4d2d6d-b3ac-4e69-92cd-53c1ecc0429d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228b2c94c93b4625b6e29beb84fe4ca2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:26.132666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-8e4d2d6d-b3ac-4e69-92cd-53c1ecc0429d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228b2c94c93b4625b6e29beb84fe4ca2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:26.149521 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3598/7229] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:13:25 2021] DELETE /identity/v3/users/228b2c94c93b4625b6e29beb84fe4ca2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:13:26.465541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:26.466983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:26.481135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab014933-2085-4ade-b1b8-3a7ce44c62a8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:26.591384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:26.592322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:26.592609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:26.592881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] PATH_INFO: `/v3/projects/dea8240b1aba428ba7d40aaa68ae2fdf` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:26.594090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea8240b1aba428ba7d40aaa68ae2fdf)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:26.596054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:26.656043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea8240b1aba428ba7d40aaa68ae2fdf', 'request_id': 'req-71ec7875-84db-427f-8e26-954f07bee03c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:26.667578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea8240b1aba428ba7d40aaa68ae2fdf', 'request_id': 'req-71ec7875-84db-427f-8e26-954f07bee03c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:26.682199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea8240b1aba428ba7d40aaa68ae2fdf', 'request_id': 'req-71ec7875-84db-427f-8e26-954f07bee03c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:26.699432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] The token cache is being invalidate because project dea8240b1aba428ba7d40aaa68ae2fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:13:26.699731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:26.700469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71ec7875-84db-427f-8e26-954f07bee03c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:26.706066 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3632/7230] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:13:26 2021] DELETE /identity/v3/projects/dea8240b1aba428ba7d40aaa68ae2fdf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:26.707855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b128d28-2578-48d8-a73e-eb659d990b24 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:26.708395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b128d28-2578-48d8-a73e-eb659d990b24 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:26.708395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b128d28-2578-48d8-a73e-eb659d990b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:26.726427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9b128d28-2578-48d8-a73e-eb659d990b24 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:26.727935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9b128d28-2578-48d8-a73e-eb659d990b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:26.804742 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3599/7231] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:26.813351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6ccba-15b6-41c1-a02c-2b7897dead20 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:26.813579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6ccba-15b6-41c1-a02c-2b7897dead20 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:26.814086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6ccba-15b6-41c1-a02c-2b7897dead20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:26.836705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ddb6ccba-15b6-41c1-a02c-2b7897dead20 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:26.838455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ddb6ccba-15b6-41c1-a02c-2b7897dead20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:26.846964 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3633/7232] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:13:26.852003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b128d28-2578-48d8-a73e-eb659d990b24 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:26.873486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b128d28-2578-48d8-a73e-eb659d990b24 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:26.881884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc894539-2601-4462-a63e-8364fbbd49c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:26.882535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc894539-2601-4462-a63e-8364fbbd49c2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:26.883107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc894539-2601-4462-a63e-8364fbbd49c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:26.883714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc894539-2601-4462-a63e-8364fbbd49c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:26.884174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc894539-2601-4462-a63e-8364fbbd49c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:13:26.884696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc894539-2601-4462-a63e-8364fbbd49c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:26.886328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc894539-2601-4462-a63e-8364fbbd49c2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:26.907372 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3600/7233] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:13:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:13:26.908915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6ccba-15b6-41c1-a02c-2b7897dead20 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:26.926230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6ccba-15b6-41c1-a02c-2b7897dead20 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:26.931909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6027c1-4060-479c-bbff-e74dd0978eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:26.932572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6027c1-4060-479c-bbff-e74dd0978eaf admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:26.932858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6027c1-4060-479c-bbff-e74dd0978eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:26.933133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6027c1-4060-479c-bbff-e74dd0978eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:26.934035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6027c1-4060-479c-bbff-e74dd0978eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:26.936038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6027c1-4060-479c-bbff-e74dd0978eaf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:26.981857 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3634/7234] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:13:26 2021] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:26.985658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc894539-2601-4462-a63e-8364fbbd49c2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:26.997976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc894539-2601-4462-a63e-8364fbbd49c2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:27.058969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae2585-5582-4570-804e-4ba22761e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:27.059676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae2585-5582-4570-804e-4ba22761e62f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.059961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae2585-5582-4570-804e-4ba22761e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.060235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae2585-5582-4570-804e-4ba22761e62f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.060943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae2585-5582-4570-804e-4ba22761e62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:27.062863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae2585-5582-4570-804e-4ba22761e62f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:27.085724 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3601/7235] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:13:26 2021] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:27.087737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6027c1-4060-479c-bbff-e74dd0978eaf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:27.098859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6027c1-4060-479c-bbff-e74dd0978eaf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:27.103719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e15b-0a24-4353-8fea-089b168c08d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:27.104459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e15b-0a24-4353-8fea-089b168c08d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.104753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e15b-0a24-4353-8fea-089b168c08d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.105035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60e15b-0a24-4353-8fea-089b168c08d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.105774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60e15b-0a24-4353-8fea-089b168c08d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:27.107407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60e15b-0a24-4353-8fea-089b168c08d4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:27.118202 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3635/7236] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:27 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:27.122590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae2585-5582-4570-804e-4ba22761e62f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:27.132430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae2585-5582-4570-804e-4ba22761e62f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:27.137809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379c918-8fce-4dd9-ac21-4c7a9c9689fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:27.138473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379c918-8fce-4dd9-ac21-4c7a9c9689fc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.138757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379c918-8fce-4dd9-ac21-4c7a9c9689fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.139030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379c918-8fce-4dd9-ac21-4c7a9c9689fc admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.139810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379c918-8fce-4dd9-ac21-4c7a9c9689fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:27.141416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379c918-8fce-4dd9-ac21-4c7a9c9689fc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:27.152673 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3602/7237] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:27 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:13:27.156810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e15b-0a24-4353-8fea-089b168c08d4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:27.167246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60e15b-0a24-4353-8fea-089b168c08d4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:27.172054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358daed7-ea73-4803-b653-7a06a6f79447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:27.173317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358daed7-ea73-4803-b653-7a06a6f79447 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.173317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358daed7-ea73-4803-b653-7a06a6f79447 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.173567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358daed7-ea73-4803-b653-7a06a6f79447 admin admin] PATH_INFO: `/v3/projects/0bc88343788b4679a01d48c5c6faf0df/users/2cd2f37b2251437ca0b97a8fdae9e3b9/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.189188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358daed7-ea73-4803-b653-7a06a6f79447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc88343788b4679a01d48c5c6faf0df, user_id=2cd2f37b2251437ca0b97a8fdae9e3b9, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:27.191873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358daed7-ea73-4803-b653-7a06a6f79447 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:27.205465 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3636/7238] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:27 2021] PUT /identity/v3/projects/0bc88343788b4679a01d48c5c6faf0df/users/2cd2f37b2251437ca0b97a8fdae9e3b9/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:27.216924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22ef1c-c7b4-4144-a605-d8ee9194a5db None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.217362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22ef1c-c7b4-4144-a605-d8ee9194a5db None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.217653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22ef1c-c7b4-4144-a605-d8ee9194a5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.245901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9d22ef1c-c7b4-4144-a605-d8ee9194a5db None None] MFA Rules not processed for user `2cd2f37b2251437ca0b97a8fdae9e3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:27.247145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9d22ef1c-c7b4-4144-a605-d8ee9194a5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:27.311130 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3603/7239] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:27 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:27.315431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358daed7-ea73-4803-b653-7a06a6f79447 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:27.381339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358daed7-ea73-4803-b653-7a06a6f79447 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:27.386880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e97d78-7c11-41e4-a63b-b5cc254ef90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:27.387814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e97d78-7c11-41e4-a63b-b5cc254ef90f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.388175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e97d78-7c11-41e4-a63b-b5cc254ef90f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.388518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e97d78-7c11-41e4-a63b-b5cc254ef90f admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.389304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e97d78-7c11-41e4-a63b-b5cc254ef90f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:27.391282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e97d78-7c11-41e4-a63b-b5cc254ef90f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:27.417605 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3637/7240] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:13:27 2021] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:27.421747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22ef1c-c7b4-4144-a605-d8ee9194a5db None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:27.438342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22ef1c-c7b4-4144-a605-d8ee9194a5db None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:27.496072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10464ed-32fe-4b6e-91f1-5d55a152e0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:27.496929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10464ed-32fe-4b6e-91f1-5d55a152e0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.497212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10464ed-32fe-4b6e-91f1-5d55a152e0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.498051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10464ed-32fe-4b6e-91f1-5d55a152e0e9 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.498767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10464ed-32fe-4b6e-91f1-5d55a152e0e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:27.500787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10464ed-32fe-4b6e-91f1-5d55a152e0e9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:27.525002 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3604/7241] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:13:27 2021] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:27.526440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e97d78-7c11-41e4-a63b-b5cc254ef90f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:27.536758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e97d78-7c11-41e4-a63b-b5cc254ef90f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:27.542184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26788d1-d7fd-472e-9b75-25da2abbc6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:27.542945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26788d1-d7fd-472e-9b75-25da2abbc6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.543323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26788d1-d7fd-472e-9b75-25da2abbc6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.543667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26788d1-d7fd-472e-9b75-25da2abbc6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.544465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26788d1-d7fd-472e-9b75-25da2abbc6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:27.546116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26788d1-d7fd-472e-9b75-25da2abbc6f5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:27.559339 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3638/7242] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:27 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:27.563567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10464ed-32fe-4b6e-91f1-5d55a152e0e9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:27.574387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10464ed-32fe-4b6e-91f1-5d55a152e0e9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:27.579234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42148b-fa77-442b-a4d4-1697389770b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:27.580140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42148b-fa77-442b-a4d4-1697389770b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.580420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42148b-fa77-442b-a4d4-1697389770b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.580693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42148b-fa77-442b-a4d4-1697389770b1 admin admin] PATH_INFO: `/v3/projects/403bedf6b5b945f994ab1139e5ecf1b4/users/3cda9dbd76f14395aec9e8231c7e99a9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.595371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42148b-fa77-442b-a4d4-1697389770b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403bedf6b5b945f994ab1139e5ecf1b4, user_id=3cda9dbd76f14395aec9e8231c7e99a9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:27.598049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42148b-fa77-442b-a4d4-1697389770b1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:27.612060 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3605/7243] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:27 2021] PUT /identity/v3/projects/403bedf6b5b945f994ab1139e5ecf1b4/users/3cda9dbd76f14395aec9e8231c7e99a9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:27.616115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26788d1-d7fd-472e-9b75-25da2abbc6f5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:27.626861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26788d1-d7fd-472e-9b75-25da2abbc6f5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:27.679943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55677384-343b-4105-b332-639dee59dc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:27.680696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55677384-343b-4105-b332-639dee59dc2e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.681529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55677384-343b-4105-b332-639dee59dc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.681904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55677384-343b-4105-b332-639dee59dc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.682716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55677384-343b-4105-b332-639dee59dc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:27.684555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55677384-343b-4105-b332-639dee59dc2e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:27.695038 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3639/7244] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:27 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:13:27.699432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42148b-fa77-442b-a4d4-1697389770b1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:27.711083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42148b-fa77-442b-a4d4-1697389770b1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:27.718807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9f56f-3013-4935-8b42-5396f69e749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:27.729126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9f56f-3013-4935-8b42-5396f69e749a admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.729780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9f56f-3013-4935-8b42-5396f69e749a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.730446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9f56f-3013-4935-8b42-5396f69e749a admin admin] PATH_INFO: `/v3/projects/403bedf6b5b945f994ab1139e5ecf1b4/users/3cda9dbd76f14395aec9e8231c7e99a9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.736612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9f56f-3013-4935-8b42-5396f69e749a admin admin] RBAC: Authorizing `identity:create_grant(project_id=403bedf6b5b945f994ab1139e5ecf1b4, user_id=3cda9dbd76f14395aec9e8231c7e99a9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:27.739836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9f56f-3013-4935-8b42-5396f69e749a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:27.752381 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3606/7245] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:27 2021] PUT /identity/v3/projects/403bedf6b5b945f994ab1139e5ecf1b4/users/3cda9dbd76f14395aec9e8231c7e99a9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:13:27.763689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356a369-614d-4167-8753-8a06cb1c7449 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:27.764069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356a369-614d-4167-8753-8a06cb1c7449 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:27.764428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356a369-614d-4167-8753-8a06cb1c7449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:27.819483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7356a369-614d-4167-8753-8a06cb1c7449 None None] MFA Rules not processed for user `3cda9dbd76f14395aec9e8231c7e99a9`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:27.821517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7356a369-614d-4167-8753-8a06cb1c7449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:27.905950 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3640/7246] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:27 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:13:27.917547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9f56f-3013-4935-8b42-5396f69e749a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:27.919905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3ca9f56f-3013-4935-8b42-5396f69e749a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:28.016757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9f56f-3013-4935-8b42-5396f69e749a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:28.022971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eab54-f79e-414a-8de5-0a48ef64ca81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:28.025054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eab54-f79e-414a-8de5-0a48ef64ca81 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:28.025350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eab54-f79e-414a-8de5-0a48ef64ca81 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:28.025631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03eab54-f79e-414a-8de5-0a48ef64ca81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:28.036853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03eab54-f79e-414a-8de5-0a48ef64ca81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:28.038536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03eab54-f79e-414a-8de5-0a48ef64ca81 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:28.050967 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3607/7247] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:27 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:28.106669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356a369-614d-4167-8753-8a06cb1c7449 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:28.108122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7356a369-614d-4167-8753-8a06cb1c7449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:28.136994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356a369-614d-4167-8753-8a06cb1c7449 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:28.141946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eedab-284d-4105-bd32-c405cf70165b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:28.142604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eedab-284d-4105-bd32-c405cf70165b service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:28.143573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eedab-284d-4105-bd32-c405cf70165b service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:28.151813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eedab-284d-4105-bd32-c405cf70165b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:28.240601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6eedab-284d-4105-bd32-c405cf70165b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:28.245581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6eedab-284d-4105-bd32-c405cf70165b service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:28.270958 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3641/7248] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:28 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:31.448706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eab54-f79e-414a-8de5-0a48ef64ca81 service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:31.450928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d03eab54-f79e-414a-8de5-0a48ef64ca81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:31.562857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03eab54-f79e-414a-8de5-0a48ef64ca81 service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:31.568673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:31.569981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:31.570262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:31.571899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] PATH_INFO: `/v3/users/8e803241af524277951e54959299c98e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:31.573145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e803241af524277951e54959299c98e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:31.575750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:31.634061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e803241af524277951e54959299c98e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:31.635468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e803241af524277951e54959299c98e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:31.644625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e803241af524277951e54959299c98e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:31.645346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e803241af524277951e54959299c98e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:31.654211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e803241af524277951e54959299c98e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:31.673012 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3608/7249] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:13:31 2021] DELETE /identity/v3/users/8e803241af524277951e54959299c98e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:31.894714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eedab-284d-4105-bd32-c405cf70165b service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:31.911079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eedab-284d-4105-bd32-c405cf70165b service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:31.944920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:31.948171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:32.017384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:32.018347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:32.018802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:32.019134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] PATH_INFO: `/v3/projects/49981e6330d04897a5b23f4ca0b9a934` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:32.020694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49981e6330d04897a5b23f4ca0b9a934)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:32.022671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:32.080416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38324c9-b631-4a48-8bc2-0946c30d51bf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:32.093163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff68a6e-25d3-4cc0-bcb8-d4616ea83e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:32.094400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff68a6e-25d3-4cc0-bcb8-d4616ea83e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:32.095881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff68a6e-25d3-4cc0-bcb8-d4616ea83e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:32.100423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff68a6e-25d3-4cc0-bcb8-d4616ea83e2f admin admin] PATH_INFO: `/v3/users/2cd2f37b2251437ca0b97a8fdae9e3b9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:32.105189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff68a6e-25d3-4cc0-bcb8-d4616ea83e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd2f37b2251437ca0b97a8fdae9e3b9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:32.107497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff68a6e-25d3-4cc0-bcb8-d4616ea83e2f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:32.118571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49981e6330d04897a5b23f4ca0b9a934', 'request_id': 'req-554a1059-9297-4d0b-990d-56d4e9cfc84f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.128236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49981e6330d04897a5b23f4ca0b9a934', 'request_id': 'req-554a1059-9297-4d0b-990d-56d4e9cfc84f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.139353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49981e6330d04897a5b23f4ca0b9a934', 'request_id': 'req-554a1059-9297-4d0b-990d-56d4e9cfc84f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.160896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] The token cache is being invalidate because project 49981e6330d04897a5b23f4ca0b9a934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:13:32.161361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.162230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.166520 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3642/7250] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:13:31 2021] DELETE /identity/v3/projects/49981e6330d04897a5b23f4ca0b9a934 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:13:32.173843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:32.175730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:32.208490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0ff68a6e-25d3-4cc0-bcb8-d4616ea83e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd2f37b2251437ca0b97a8fdae9e3b9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.211457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0ff68a6e-25d3-4cc0-bcb8-d4616ea83e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd2f37b2251437ca0b97a8fdae9e3b9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.233086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0ff68a6e-25d3-4cc0-bcb8-d4616ea83e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd2f37b2251437ca0b97a8fdae9e3b9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.234409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0ff68a6e-25d3-4cc0-bcb8-d4616ea83e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd2f37b2251437ca0b97a8fdae9e3b9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.248219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0ff68a6e-25d3-4cc0-bcb8-d4616ea83e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd2f37b2251437ca0b97a8fdae9e3b9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.259901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a1059-9297-4d0b-990d-56d4e9cfc84f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:32.265139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:32.266092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:32.266442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:32.266790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] PATH_INFO: `/v3/users/66800fa586a94ac48d8ae8f9a69e361c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:32.268601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66800fa586a94ac48d8ae8f9a69e361c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:32.270588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:32.273881 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3609/7251] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:13:31 2021] DELETE /identity/v3/users/2cd2f37b2251437ca0b97a8fdae9e3b9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:32.279769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4337-8608-4c92-9d50-9c0bdfb1cea7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:32.280756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4337-8608-4c92-9d50-9c0bdfb1cea7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:32.280756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4337-8608-4c92-9d50-9c0bdfb1cea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:32.301906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c8aa4337-8608-4c92-9d50-9c0bdfb1cea7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:32.303300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c8aa4337-8608-4c92-9d50-9c0bdfb1cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:32.341358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66800fa586a94ac48d8ae8f9a69e361c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.358300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66800fa586a94ac48d8ae8f9a69e361c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.359539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66800fa586a94ac48d8ae8f9a69e361c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.370098 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3610/7252] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:32.384868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66800fa586a94ac48d8ae8f9a69e361c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.391012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa4337-8608-4c92-9d50-9c0bdfb1cea7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:32.392927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c8aa4337-8608-4c92-9d50-9c0bdfb1cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:32.418160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66800fa586a94ac48d8ae8f9a69e361c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.428884 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3643/7253] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:13:32 2021] DELETE /identity/v3/users/66800fa586a94ac48d8ae8f9a69e361c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:32.513471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa4337-8608-4c92-9d50-9c0bdfb1cea7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:32.576048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf57bdf-a077-470b-9309-3469ef2d3455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:32.577152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf57bdf-a077-470b-9309-3469ef2d3455 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:32.577611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf57bdf-a077-470b-9309-3469ef2d3455 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:32.578498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf57bdf-a077-470b-9309-3469ef2d3455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:32.657693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:32.660126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:32.662290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf57bdf-a077-470b-9309-3469ef2d3455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:32.664259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf57bdf-a077-470b-9309-3469ef2d3455 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:32.676271 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3611/7254] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:32.685389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77803ac0-74a6-4de9-8fe9-5e72f0a4c8a3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:32.695810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:32.697930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:32.698210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:32.698492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] PATH_INFO: `/v3/projects/45d33ddc5be04cb1befef1cd37e34830` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:32.699799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d33ddc5be04cb1befef1cd37e34830)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:32.701752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:32.792216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d33ddc5be04cb1befef1cd37e34830', 'request_id': 'req-eac89cfb-b667-4132-9ecf-6fe10cebb489'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.802804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d33ddc5be04cb1befef1cd37e34830', 'request_id': 'req-eac89cfb-b667-4132-9ecf-6fe10cebb489'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.814379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d33ddc5be04cb1befef1cd37e34830', 'request_id': 'req-eac89cfb-b667-4132-9ecf-6fe10cebb489'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.827130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] The token cache is being invalidate because project 45d33ddc5be04cb1befef1cd37e34830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:13:32.827463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.828325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-eac89cfb-b667-4132-9ecf-6fe10cebb489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:32.830261 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3644/7255] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:13:32 2021] DELETE /identity/v3/projects/45d33ddc5be04cb1befef1cd37e34830 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:13:32.836478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d8f2-0102-4c8f-8520-5f642aa5b2e2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:32.837433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d8f2-0102-4c8f-8520-5f642aa5b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:32.838132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d8f2-0102-4c8f-8520-5f642aa5b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:32.857211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5346d8f2-0102-4c8f-8520-5f642aa5b2e2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:32.858983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5346d8f2-0102-4c8f-8520-5f642aa5b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:32.934135 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3612/7256] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:32.942486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb49400-55b1-42bd-b653-d7db246f7cdc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:32.942957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb49400-55b1-42bd-b653-d7db246f7cdc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:32.942957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb49400-55b1-42bd-b653-d7db246f7cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:32.965013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4eb49400-55b1-42bd-b653-d7db246f7cdc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:32.966327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4eb49400-55b1-42bd-b653-d7db246f7cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:32.974716 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3645/7257] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:32.979355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346d8f2-0102-4c8f-8520-5f642aa5b2e2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:32.994288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346d8f2-0102-4c8f-8520-5f642aa5b2e2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:33.003988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f3d26-b30a-4f4e-b55e-71ec4f75ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:33.004991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3d26-b30a-4f4e-b55e-71ec4f75ca0b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:33.005451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3d26-b30a-4f4e-b55e-71ec4f75ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:33.005900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f3d26-b30a-4f4e-b55e-71ec4f75ca0b admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:33.007198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f3d26-b30a-4f4e-b55e-71ec4f75ca0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:13:33.007549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f3d26-b30a-4f4e-b55e-71ec4f75ca0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:33.010199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f3d26-b30a-4f4e-b55e-71ec4f75ca0b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:33.027559 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3613/7258] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:13:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:13:33.029414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb49400-55b1-42bd-b653-d7db246f7cdc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:33.038565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb49400-55b1-42bd-b653-d7db246f7cdc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:33.043371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d37a8-97de-4976-b49a-4f55812a45f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:33.044015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d37a8-97de-4976-b49a-4f55812a45f4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:33.044294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d37a8-97de-4976-b49a-4f55812a45f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:33.044565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d37a8-97de-4976-b49a-4f55812a45f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:33.045268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d37a8-97de-4976-b49a-4f55812a45f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:33.047133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d37a8-97de-4976-b49a-4f55812a45f4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:33.078834 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3646/7259] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:13:33 2021] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:13:33.083229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f3d26-b30a-4f4e-b55e-71ec4f75ca0b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:33.094149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f3d26-b30a-4f4e-b55e-71ec4f75ca0b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:33.168264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71588e-eacf-467e-a512-3180f1c2fc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:33.168955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71588e-eacf-467e-a512-3180f1c2fc5f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:33.169477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71588e-eacf-467e-a512-3180f1c2fc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:33.169758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71588e-eacf-467e-a512-3180f1c2fc5f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:33.170472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71588e-eacf-467e-a512-3180f1c2fc5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:33.172646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71588e-eacf-467e-a512-3180f1c2fc5f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:33.199455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d37a8-97de-4976-b49a-4f55812a45f4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:33.201549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d81d37a8-97de-4976-b49a-4f55812a45f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:33.206109 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3614/7260] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:13:33 2021] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:33.215594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71588e-eacf-467e-a512-3180f1c2fc5f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:33.216609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d37a8-97de-4976-b49a-4f55812a45f4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:33.226371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:33.228104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:33.228811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:33.229384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] PATH_INFO: `/v3/projects/0bc88343788b4679a01d48c5c6faf0df` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:33.233564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc88343788b4679a01d48c5c6faf0df)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:33.237460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:33.240199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71588e-eacf-467e-a512-3180f1c2fc5f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:33.246807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75bc99-02bd-4fe0-9acc-ebd3b083fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:33.247596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75bc99-02bd-4fe0-9acc-ebd3b083fccf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:33.247914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75bc99-02bd-4fe0-9acc-ebd3b083fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:33.248221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75bc99-02bd-4fe0-9acc-ebd3b083fccf admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:33.248968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75bc99-02bd-4fe0-9acc-ebd3b083fccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:33.250614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75bc99-02bd-4fe0-9acc-ebd3b083fccf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:33.264126 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3615/7261] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:33 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:33.267776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75bc99-02bd-4fe0-9acc-ebd3b083fccf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:33.280923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75bc99-02bd-4fe0-9acc-ebd3b083fccf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:33.295445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc88343788b4679a01d48c5c6faf0df', 'request_id': 'req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.305206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc88343788b4679a01d48c5c6faf0df', 'request_id': 'req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.313782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc88343788b4679a01d48c5c6faf0df', 'request_id': 'req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.332461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] The token cache is being invalidate because project 0bc88343788b4679a01d48c5c6faf0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:13:33.333040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.333822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.335754 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3647/7262] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:13:33 2021] DELETE /identity/v3/projects/0bc88343788b4679a01d48c5c6faf0df => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:33.339641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:33.341169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:33.351574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0bc6c-73b4-41bc-af53-a081e45ca0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:33.352301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0bc6c-73b4-41bc-af53-a081e45ca0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:33.352586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0bc6c-73b4-41bc-af53-a081e45ca0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:33.352856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0bc6c-73b4-41bc-af53-a081e45ca0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:33.353598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0bc6c-73b4-41bc-af53-a081e45ca0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:33.355280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0bc6c-73b4-41bc-af53-a081e45ca0f5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:33.366359 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3616/7263] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:33 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:13:33.371120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0bc6c-73b4-41bc-af53-a081e45ca0f5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:33.372993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-68c0bc6c-73b4-41bc-af53-a081e45ca0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:33.388474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0bc6c-73b4-41bc-af53-a081e45ca0f5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:33.393324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35e764-1120-47f7-be3d-55a57297703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:33.394223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35e764-1120-47f7-be3d-55a57297703b admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:33.394503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35e764-1120-47f7-be3d-55a57297703b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:33.394780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35e764-1120-47f7-be3d-55a57297703b admin admin] PATH_INFO: `/v3/projects/6a99042a0a384a1489b1c4dd7942d30a/users/48dc931fd45648f4893b7b6903b8ce2d/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:33.410541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35e764-1120-47f7-be3d-55a57297703b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a99042a0a384a1489b1c4dd7942d30a, user_id=48dc931fd45648f4893b7b6903b8ce2d, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:33.413276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35e764-1120-47f7-be3d-55a57297703b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:33.418756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb15d2-9ffd-473d-a174-86eaa6928ff3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:33.424455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:33.425395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:33.425674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:33.426002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] PATH_INFO: `/v3/users/3cda9dbd76f14395aec9e8231c7e99a9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:33.427319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cda9dbd76f14395aec9e8231c7e99a9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:33.429287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:33.433510 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3617/7264] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:33 2021] PUT /identity/v3/projects/6a99042a0a384a1489b1c4dd7942d30a/users/48dc931fd45648f4893b7b6903b8ce2d/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:13:33.439112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad30121-e890-4af5-9b2d-bc9fda6b7ba5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:33.439680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad30121-e890-4af5-9b2d-bc9fda6b7ba5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:33.440892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad30121-e890-4af5-9b2d-bc9fda6b7ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:33.461622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9ad30121-e890-4af5-9b2d-bc9fda6b7ba5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:33.463947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9ad30121-e890-4af5-9b2d-bc9fda6b7ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:33.511494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cda9dbd76f14395aec9e8231c7e99a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.522482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cda9dbd76f14395aec9e8231c7e99a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.523945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cda9dbd76f14395aec9e8231c7e99a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.536019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cda9dbd76f14395aec9e8231c7e99a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.547991 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3618/7265] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:13:33.549082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cda9dbd76f14395aec9e8231c7e99a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.555041 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3648/7266] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:13:33 2021] DELETE /identity/v3/users/3cda9dbd76f14395aec9e8231c7e99a9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:13:33.558822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad30121-e890-4af5-9b2d-bc9fda6b7ba5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:33.560322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9ad30121-e890-4af5-9b2d-bc9fda6b7ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:33.635895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad30121-e890-4af5-9b2d-bc9fda6b7ba5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:33.701060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b875a-d0c2-41f8-9eb8-d1e9a037d3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:33.701819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b875a-d0c2-41f8-9eb8-d1e9a037d3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:33.702221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b875a-d0c2-41f8-9eb8-d1e9a037d3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:33.702444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b875a-d0c2-41f8-9eb8-d1e9a037d3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:33.782897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b875a-d0c2-41f8-9eb8-d1e9a037d3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:33.784690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b875a-d0c2-41f8-9eb8-d1e9a037d3d4 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:33.796675 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3619/7267] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:13:33.865042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:33.866826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:33.882108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94687479-dcbb-4966-82c9-4451553dc594 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:33.892884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:33.894536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:33.895715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:33.896247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] PATH_INFO: `/v3/projects/403bedf6b5b945f994ab1139e5ecf1b4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:33.898231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] RBAC: Authorizing `identity:delete_project(project_id=403bedf6b5b945f994ab1139e5ecf1b4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:33.901802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:33.961269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403bedf6b5b945f994ab1139e5ecf1b4', 'request_id': 'req-652b2572-27eb-42a8-b805-893d2e15b64a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.970831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403bedf6b5b945f994ab1139e5ecf1b4', 'request_id': 'req-652b2572-27eb-42a8-b805-893d2e15b64a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.978662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403bedf6b5b945f994ab1139e5ecf1b4', 'request_id': 'req-652b2572-27eb-42a8-b805-893d2e15b64a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.997330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] The token cache is being invalidate because project 403bedf6b5b945f994ab1139e5ecf1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:13:33.997622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:33.998476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-652b2572-27eb-42a8-b805-893d2e15b64a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:34.000514 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3649/7268] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:13:33 2021] DELETE /identity/v3/projects/403bedf6b5b945f994ab1139e5ecf1b4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:13:34.006826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482e672-f3f9-4557-913c-b21d74c653f6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.007271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482e672-f3f9-4557-913c-b21d74c653f6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.007645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482e672-f3f9-4557-913c-b21d74c653f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.028217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1482e672-f3f9-4557-913c-b21d74c653f6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:34.029458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1482e672-f3f9-4557-913c-b21d74c653f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:34.090431 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3620/7269] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:34.098143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5256d6-b265-4787-aded-7340b9c694b3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.098439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5256d6-b265-4787-aded-7340b9c694b3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.098747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5256d6-b265-4787-aded-7340b9c694b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.128129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ff5256d6-b265-4787-aded-7340b9c694b3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:34.129450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ff5256d6-b265-4787-aded-7340b9c694b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:34.144754 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3650/7270] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:34.149260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482e672-f3f9-4557-913c-b21d74c653f6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:34.158943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482e672-f3f9-4557-913c-b21d74c653f6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:34.163788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a24c81-ba1f-40a5-8e76-df721d3404fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:34.164454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24c81-ba1f-40a5-8e76-df721d3404fb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.164779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24c81-ba1f-40a5-8e76-df721d3404fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.165059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24c81-ba1f-40a5-8e76-df721d3404fb admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.165829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a24c81-ba1f-40a5-8e76-df721d3404fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:13:34.166139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a24c81-ba1f-40a5-8e76-df721d3404fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:34.167797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a24c81-ba1f-40a5-8e76-df721d3404fb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:34.179859 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3621/7271] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:13:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:13:34.184592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5256d6-b265-4787-aded-7340b9c694b3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:34.193964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5256d6-b265-4787-aded-7340b9c694b3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:34.199743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518743aa-f0e7-43c9-8c03-fa2aafb1f2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:34.200399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518743aa-f0e7-43c9-8c03-fa2aafb1f2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.200686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518743aa-f0e7-43c9-8c03-fa2aafb1f2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.200968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518743aa-f0e7-43c9-8c03-fa2aafb1f2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.202272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518743aa-f0e7-43c9-8c03-fa2aafb1f2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:34.204741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518743aa-f0e7-43c9-8c03-fa2aafb1f2f3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:34.232260 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3651/7272] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:13:34 2021] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:13:34.236892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a24c81-ba1f-40a5-8e76-df721d3404fb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:34.247747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a24c81-ba1f-40a5-8e76-df721d3404fb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:34.311926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3277a9a-a969-41f9-87c7-c63fccf1e14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:34.312616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277a9a-a969-41f9-87c7-c63fccf1e14c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.312905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277a9a-a969-41f9-87c7-c63fccf1e14c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.313184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277a9a-a969-41f9-87c7-c63fccf1e14c admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.313895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3277a9a-a969-41f9-87c7-c63fccf1e14c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:34.316303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3277a9a-a969-41f9-87c7-c63fccf1e14c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:34.346728 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3622/7273] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:13:34 2021] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:34.348307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518743aa-f0e7-43c9-8c03-fa2aafb1f2f3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:34.359483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518743aa-f0e7-43c9-8c03-fa2aafb1f2f3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:34.372638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992006-9ab6-4aad-9189-b9721ef4ebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:34.373315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992006-9ab6-4aad-9189-b9721ef4ebac admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.373596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992006-9ab6-4aad-9189-b9721ef4ebac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.373898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6992006-9ab6-4aad-9189-b9721ef4ebac admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.374634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992006-9ab6-4aad-9189-b9721ef4ebac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:34.376429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6992006-9ab6-4aad-9189-b9721ef4ebac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:34.388586 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3652/7274] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:34 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:34.392767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3277a9a-a969-41f9-87c7-c63fccf1e14c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:34.407750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3277a9a-a969-41f9-87c7-c63fccf1e14c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:34.413293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec06fe-afae-4f74-802c-b33600b9a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:34.414321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec06fe-afae-4f74-802c-b33600b9a5af admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.415198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec06fe-afae-4f74-802c-b33600b9a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.415544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec06fe-afae-4f74-802c-b33600b9a5af admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.416285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec06fe-afae-4f74-802c-b33600b9a5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:34.418010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec06fe-afae-4f74-802c-b33600b9a5af admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:34.437422 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3623/7275] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:34 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:34.442059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992006-9ab6-4aad-9189-b9721ef4ebac admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:34.453354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6992006-9ab6-4aad-9189-b9721ef4ebac admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:34.459755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918386b-1a80-4984-8425-81276f6fe849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:34.460655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918386b-1a80-4984-8425-81276f6fe849 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.460937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918386b-1a80-4984-8425-81276f6fe849 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.461209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918386b-1a80-4984-8425-81276f6fe849 admin admin] PATH_INFO: `/v3/projects/27044013bb53496982d1e275f135440a/users/e0f8be8999054dedba4bea8843820172/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.483302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918386b-1a80-4984-8425-81276f6fe849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27044013bb53496982d1e275f135440a, user_id=e0f8be8999054dedba4bea8843820172, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:34.485966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918386b-1a80-4984-8425-81276f6fe849 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:34.501590 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3653/7276] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:34 2021] PUT /identity/v3/projects/27044013bb53496982d1e275f135440a/users/e0f8be8999054dedba4bea8843820172/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:34.512941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc0a9-9ec2-4744-8e43-26106d8c43ef None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.513401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc0a9-9ec2-4744-8e43-26106d8c43ef None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.513819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebc0a9-9ec2-4744-8e43-26106d8c43ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.558689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ecebc0a9-9ec2-4744-8e43-26106d8c43ef None None] MFA Rules not processed for user `e0f8be8999054dedba4bea8843820172`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:34.560065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ecebc0a9-9ec2-4744-8e43-26106d8c43ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:34.669135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918386b-1a80-4984-8425-81276f6fe849 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:34.671590 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3624/7277] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:34 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:34.760715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918386b-1a80-4984-8425-81276f6fe849 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:34.765884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bffef-adcc-47cc-a318-bbb66ad713f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:34.766556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bffef-adcc-47cc-a318-bbb66ad713f9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.766848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bffef-adcc-47cc-a318-bbb66ad713f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.767122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bffef-adcc-47cc-a318-bbb66ad713f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.768035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bffef-adcc-47cc-a318-bbb66ad713f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:34.769956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bffef-adcc-47cc-a318-bbb66ad713f9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:34.804140 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3654/7278] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:13:34 2021] POST /identity/v3/projects => generated 399 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:13:34.808777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebc0a9-9ec2-4744-8e43-26106d8c43ef None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:34.827895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebc0a9-9ec2-4744-8e43-26106d8c43ef None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:34.913710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118851-bf76-4ee0-bafb-e41d17b23424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:34.914513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118851-bf76-4ee0-bafb-e41d17b23424 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.915082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118851-bf76-4ee0-bafb-e41d17b23424 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.915466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118851-bf76-4ee0-bafb-e41d17b23424 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.916253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4118851-bf76-4ee0-bafb-e41d17b23424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:34.918696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4118851-bf76-4ee0-bafb-e41d17b23424 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:34.945536 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3625/7279] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:13:34 2021] POST /identity/v3/users => generated 306 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:13:34.947571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bffef-adcc-47cc-a318-bbb66ad713f9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:34.963169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bffef-adcc-47cc-a318-bbb66ad713f9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:34.969996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c53537-e9ef-4d55-aecf-8d56568edb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:34.970971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53537-e9ef-4d55-aecf-8d56568edb7f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:34.971237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53537-e9ef-4d55-aecf-8d56568edb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:34.971697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53537-e9ef-4d55-aecf-8d56568edb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:34.972615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c53537-e9ef-4d55-aecf-8d56568edb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:34.974607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c53537-e9ef-4d55-aecf-8d56568edb7f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:34.989402 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3655/7280] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:34 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:34.995490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118851-bf76-4ee0-bafb-e41d17b23424 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:35.006549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118851-bf76-4ee0-bafb-e41d17b23424 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:35.016466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685366dd-406d-4942-9d4b-5ecd3f19c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:35.017850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685366dd-406d-4942-9d4b-5ecd3f19c220 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:35.018012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685366dd-406d-4942-9d4b-5ecd3f19c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:35.018368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685366dd-406d-4942-9d4b-5ecd3f19c220 admin admin] PATH_INFO: `/v3/projects/29f106e1c7dc4a628bbd1bd1d69885ab/users/400171af02554d0ba58abc5f169e686d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:35.037133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685366dd-406d-4942-9d4b-5ecd3f19c220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f106e1c7dc4a628bbd1bd1d69885ab, user_id=400171af02554d0ba58abc5f169e686d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:35.040656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685366dd-406d-4942-9d4b-5ecd3f19c220 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:35.059185 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3626/7281] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:34 2021] PUT /identity/v3/projects/29f106e1c7dc4a628bbd1bd1d69885ab/users/400171af02554d0ba58abc5f169e686d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:35.063243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c53537-e9ef-4d55-aecf-8d56568edb7f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:35.075166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c53537-e9ef-4d55-aecf-8d56568edb7f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:35.155058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165416e2-8a8a-49d1-b68c-a20f9a7a0307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:35.156051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165416e2-8a8a-49d1-b68c-a20f9a7a0307 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:35.156583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165416e2-8a8a-49d1-b68c-a20f9a7a0307 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:35.157091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165416e2-8a8a-49d1-b68c-a20f9a7a0307 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:35.157822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165416e2-8a8a-49d1-b68c-a20f9a7a0307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:35.159898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165416e2-8a8a-49d1-b68c-a20f9a7a0307 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:35.176848 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3656/7282] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:35 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:35.180933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685366dd-406d-4942-9d4b-5ecd3f19c220 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:35.193902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685366dd-406d-4942-9d4b-5ecd3f19c220 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:35.202105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfddf1d-60cf-4d87-a4c7-ed3f19a2ebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:35.203351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddf1d-60cf-4d87-a4c7-ed3f19a2ebb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:35.203858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddf1d-60cf-4d87-a4c7-ed3f19a2ebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:35.204309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfddf1d-60cf-4d87-a4c7-ed3f19a2ebb7 admin admin] PATH_INFO: `/v3/projects/29f106e1c7dc4a628bbd1bd1d69885ab/users/400171af02554d0ba58abc5f169e686d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:35.207469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfddf1d-60cf-4d87-a4c7-ed3f19a2ebb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f106e1c7dc4a628bbd1bd1d69885ab, user_id=400171af02554d0ba58abc5f169e686d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:35.212307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfddf1d-60cf-4d87-a4c7-ed3f19a2ebb7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:35.230331 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3627/7283] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:35 2021] PUT /identity/v3/projects/29f106e1c7dc4a628bbd1bd1d69885ab/users/400171af02554d0ba58abc5f169e686d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:13:35.241120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a1e18-e648-44de-8879-30f7eef8e4cf None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:35.241749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a1e18-e648-44de-8879-30f7eef8e4cf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:35.242415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a1e18-e648-44de-8879-30f7eef8e4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:35.280005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d18a1e18-e648-44de-8879-30f7eef8e4cf None None] MFA Rules not processed for user `400171af02554d0ba58abc5f169e686d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:35.285845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d18a1e18-e648-44de-8879-30f7eef8e4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:35.402360 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3657/7284] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:35 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:35.412031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfddf1d-60cf-4d87-a4c7-ed3f19a2ebb7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:35.413934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0dfddf1d-60cf-4d87-a4c7-ed3f19a2ebb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:35.512346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfddf1d-60cf-4d87-a4c7-ed3f19a2ebb7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:35.518458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3ab20-c0f1-449c-9bd0-502745ab3882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:35.520284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3ab20-c0f1-449c-9bd0-502745ab3882 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:35.520897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3ab20-c0f1-449c-9bd0-502745ab3882 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:35.522187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3ab20-c0f1-449c-9bd0-502745ab3882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:35.536342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3ab20-c0f1-449c-9bd0-502745ab3882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:35.538367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3ab20-c0f1-449c-9bd0-502745ab3882 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:35.564838 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3628/7285] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:35 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:35.662836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a1e18-e648-44de-8879-30f7eef8e4cf None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:35.675781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a1e18-e648-44de-8879-30f7eef8e4cf None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:35.680081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175404d-8e06-496f-9983-70eeb19af553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:35.680888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175404d-8e06-496f-9983-70eeb19af553 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:35.681168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175404d-8e06-496f-9983-70eeb19af553 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:35.681894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175404d-8e06-496f-9983-70eeb19af553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:35.787765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175404d-8e06-496f-9983-70eeb19af553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:35.789242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175404d-8e06-496f-9983-70eeb19af553 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:35.806471 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3658/7286] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:35 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:35.891178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3ab20-c0f1-449c-9bd0-502745ab3882 service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:35.893432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1df3ab20-c0f1-449c-9bd0-502745ab3882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:35.977536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3ab20-c0f1-449c-9bd0-502745ab3882 service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:35.982553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefaf47-98b6-4f1b-83c0-52073ed0cdc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:35.983456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefaf47-98b6-4f1b-83c0-52073ed0cdc1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:35.983878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefaf47-98b6-4f1b-83c0-52073ed0cdc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:35.984317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefaf47-98b6-4f1b-83c0-52073ed0cdc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:35.986333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0fefaf47-98b6-4f1b-83c0-52073ed0cdc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:36.059099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefaf47-98b6-4f1b-83c0-52073ed0cdc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:36.060835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefaf47-98b6-4f1b-83c0-52073ed0cdc1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:36.073948 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3629/7287] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:38.975527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df3544-38be-4646-8fb5-d10ad4d50620 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:38.976059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df3544-38be-4646-8fb5-d10ad4d50620 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:38.976059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df3544-38be-4646-8fb5-d10ad4d50620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:39.026970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f2df3544-38be-4646-8fb5-d10ad4d50620 None None] MFA Rules not processed for user `48dc931fd45648f4893b7b6903b8ce2d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:39.028260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f2df3544-38be-4646-8fb5-d10ad4d50620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:39.234753 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3659/7288] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:38 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:39.238556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefaf47-98b6-4f1b-83c0-52073ed0cdc1 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:39.240639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0fefaf47-98b6-4f1b-83c0-52073ed0cdc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:39.259236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefaf47-98b6-4f1b-83c0-52073ed0cdc1 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:39.267589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4241-8405-4da0-8213-ef25ca5af4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:39.268272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4241-8405-4da0-8213-ef25ca5af4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:39.268555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4241-8405-4da0-8213-ef25ca5af4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:39.268831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4241-8405-4da0-8213-ef25ca5af4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:39.269552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4241-8405-4da0-8213-ef25ca5af4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:39.271508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4241-8405-4da0-8213-ef25ca5af4b0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:39.309947 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3630/7289] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:13:39 2021] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:39.314596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df3544-38be-4646-8fb5-d10ad4d50620 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:39.329565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df3544-38be-4646-8fb5-d10ad4d50620 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:39.486797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cdf1d-4f88-4519-a81d-2c118c5501f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:39.487540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cdf1d-4f88-4519-a81d-2c118c5501f6 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:39.487810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cdf1d-4f88-4519-a81d-2c118c5501f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:39.488071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cdf1d-4f88-4519-a81d-2c118c5501f6 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:39.488786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cdf1d-4f88-4519-a81d-2c118c5501f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:39.490731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cdf1d-4f88-4519-a81d-2c118c5501f6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:39.530542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4241-8405-4da0-8213-ef25ca5af4b0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:39.531610 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3660/7290] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:13:39 2021] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:39.552907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4241-8405-4da0-8213-ef25ca5af4b0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:39.558630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa1b0-02a5-4794-be9b-75b5bde8ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:39.559852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa1b0-02a5-4794-be9b-75b5bde8ff37 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:39.560358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa1b0-02a5-4794-be9b-75b5bde8ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:39.561590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52daa1b0-02a5-4794-be9b-75b5bde8ff37 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:39.562340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daa1b0-02a5-4794-be9b-75b5bde8ff37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:39.564261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52daa1b0-02a5-4794-be9b-75b5bde8ff37 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:39.577799 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3631/7291] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:39 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:39.582091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cdf1d-4f88-4519-a81d-2c118c5501f6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:39.594682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cdf1d-4f88-4519-a81d-2c118c5501f6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:39.600664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfe97-53b0-4179-ba24-66100f830367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:39.602444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfe97-53b0-4179-ba24-66100f830367 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:39.602806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfe97-53b0-4179-ba24-66100f830367 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:39.603632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcfe97-53b0-4179-ba24-66100f830367 admin admin] PATH_INFO: `/v3/projects/0aefc004229844399f063a911bcc05b7/users/68af5d383d4149a89a0f87bdb735ccea/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:39.625717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcfe97-53b0-4179-ba24-66100f830367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aefc004229844399f063a911bcc05b7, user_id=68af5d383d4149a89a0f87bdb735ccea, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:39.628988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcfe97-53b0-4179-ba24-66100f830367 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:39.653158 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3661/7292] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:39 2021] PUT /identity/v3/projects/0aefc004229844399f063a911bcc05b7/users/68af5d383d4149a89a0f87bdb735ccea/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:39.657686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa1b0-02a5-4794-be9b-75b5bde8ff37 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:39.673819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52daa1b0-02a5-4794-be9b-75b5bde8ff37 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:39.761839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a94d95-359f-47f3-b387-a24c061cbfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:39.762673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a94d95-359f-47f3-b387-a24c061cbfbe admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:39.762888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a94d95-359f-47f3-b387-a24c061cbfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:39.763174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a94d95-359f-47f3-b387-a24c061cbfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:39.764082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a94d95-359f-47f3-b387-a24c061cbfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:39.765691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a94d95-359f-47f3-b387-a24c061cbfbe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:39.787313 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3632/7293] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:39 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:13:39.792639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfe97-53b0-4179-ba24-66100f830367 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:39.808589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcfe97-53b0-4179-ba24-66100f830367 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:39.821394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffcbcf-8b5a-44fd-be6f-dd4ade9fa066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:39.822499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffcbcf-8b5a-44fd-be6f-dd4ade9fa066 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:39.823097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffcbcf-8b5a-44fd-be6f-dd4ade9fa066 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:39.824295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffcbcf-8b5a-44fd-be6f-dd4ade9fa066 admin admin] PATH_INFO: `/v3/projects/0aefc004229844399f063a911bcc05b7/users/68af5d383d4149a89a0f87bdb735ccea/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:39.828485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffcbcf-8b5a-44fd-be6f-dd4ade9fa066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aefc004229844399f063a911bcc05b7, user_id=68af5d383d4149a89a0f87bdb735ccea, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:39.832198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffcbcf-8b5a-44fd-be6f-dd4ade9fa066 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:39.861011 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3662/7294] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:39 2021] PUT /identity/v3/projects/0aefc004229844399f063a911bcc05b7/users/68af5d383d4149a89a0f87bdb735ccea/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:40.493115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a94d95-359f-47f3-b387-a24c061cbfbe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:40.507658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a94d95-359f-47f3-b387-a24c061cbfbe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:40.664004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:40.665271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:40.665806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:40.666215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] PATH_INFO: `/v3/users/e0f8be8999054dedba4bea8843820172` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:40.670310 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f8be8999054dedba4bea8843820172)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:40.677156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:40.772735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f8be8999054dedba4bea8843820172'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:40.775613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f8be8999054dedba4bea8843820172'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:40.791983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f8be8999054dedba4bea8843820172'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:40.793328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f8be8999054dedba4bea8843820172'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:40.806312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f8be8999054dedba4bea8843820172'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:40.844581 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3633/7295] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:13:40 2021] DELETE /identity/v3/users/e0f8be8999054dedba4bea8843820172 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:40.849733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cc2b6-be20-4289-b98f-22657d688a64 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:40.850941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cc2b6-be20-4289-b98f-22657d688a64 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:40.851522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cc2b6-be20-4289-b98f-22657d688a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:40.902672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-221cc2b6-be20-4289-b98f-22657d688a64 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:40.902672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-221cc2b6-be20-4289-b98f-22657d688a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:41.039897 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3663/7296] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:13:41.062469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:41.064199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:41.070491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cc2b6-be20-4289-b98f-22657d688a64 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:41.072810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-221cc2b6-be20-4289-b98f-22657d688a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:41.082251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7049a-788b-4d4c-b2bb-634146d6629b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:41.096307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:41.097509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:41.098154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:41.098638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] PATH_INFO: `/v3/users/67ee436ffe774a1eb71cdb910112c7eb` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:41.102720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ee436ffe774a1eb71cdb910112c7eb)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:41.105544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:41.182537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ee436ffe774a1eb71cdb910112c7eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:41.183600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ee436ffe774a1eb71cdb910112c7eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:41.189244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cc2b6-be20-4289-b98f-22657d688a64 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:41.195189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d411-8a49-4cbd-a9ce-5b4a25e35607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:41.196522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d411-8a49-4cbd-a9ce-5b4a25e35607 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:41.196826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d411-8a49-4cbd-a9ce-5b4a25e35607 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:41.197157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d411-8a49-4cbd-a9ce-5b4a25e35607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:41.199367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-94a2d411-8a49-4cbd-a9ce-5b4a25e35607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:41.203296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ee436ffe774a1eb71cdb910112c7eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:41.204428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ee436ffe774a1eb71cdb910112c7eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:41.215303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ee436ffe774a1eb71cdb910112c7eb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:41.222731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2d411-8a49-4cbd-a9ce-5b4a25e35607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:41.224327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2d411-8a49-4cbd-a9ce-5b4a25e35607 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:41.238320 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3634/7297] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:13:41 2021] DELETE /identity/v3/users/67ee436ffe774a1eb71cdb910112c7eb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:41.252973 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3664/7298] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:13:41.630911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:41.632467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:41.737975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d411-8a49-4cbd-a9ce-5b4a25e35607 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:41.740919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-94a2d411-8a49-4cbd-a9ce-5b4a25e35607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:41.779818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d411-8a49-4cbd-a9ce-5b4a25e35607 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:41.824660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98e040-9500-476f-8907-83fe54135d97 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:41.844105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:41.845309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:41.845782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:41.846286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] PATH_INFO: `/v3/projects/4b756ba4e580446980b973ad0b42b9fe` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:41.847794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b756ba4e580446980b973ad0b42b9fe)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:41.850553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:41.903948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:41.907500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:41.907840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:41.908128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] PATH_INFO: `/v3/projects/27044013bb53496982d1e275f135440a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:41.910491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27044013bb53496982d1e275f135440a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:41.913613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:41.945282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b756ba4e580446980b973ad0b42b9fe', 'request_id': 'req-6fd58751-a4aa-457f-afef-6b48d7ef99e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:41.954787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b756ba4e580446980b973ad0b42b9fe', 'request_id': 'req-6fd58751-a4aa-457f-afef-6b48d7ef99e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:41.973667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b756ba4e580446980b973ad0b42b9fe', 'request_id': 'req-6fd58751-a4aa-457f-afef-6b48d7ef99e1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:41.992220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] The token cache is being invalidate because project 4b756ba4e580446980b973ad0b42b9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:13:41.994231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:41.995201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6fd58751-a4aa-457f-afef-6b48d7ef99e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:41.996399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27044013bb53496982d1e275f135440a', 'request_id': 'req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:42.002328 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3635/7299] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:13:41 2021] DELETE /identity/v3/projects/4b756ba4e580446980b973ad0b42b9fe => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:42.004927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b416-a80f-4b94-986c-4db7b252dcd7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:42.005497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b416-a80f-4b94-986c-4db7b252dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:42.006120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b416-a80f-4b94-986c-4db7b252dcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:42.010232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27044013bb53496982d1e275f135440a', 'request_id': 'req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:42.020543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27044013bb53496982d1e275f135440a', 'request_id': 'req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:42.037776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] The token cache is being invalidate because project 27044013bb53496982d1e275f135440a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:13:42.038777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:42.040169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:42.043541 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3665/7300] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:13:41 2021] DELETE /identity/v3/projects/27044013bb53496982d1e275f135440a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:42.047916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:42.051725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:42.076337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-14d6b416-a80f-4b94-986c-4db7b252dcd7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:42.085201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-14d6b416-a80f-4b94-986c-4db7b252dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:42.208926 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3636/7301] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:42.217293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139495c-9ce3-43b1-ac4c-55bb565038c7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:42.217579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139495c-9ce3-43b1-ac4c-55bb565038c7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:42.217861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139495c-9ce3-43b1-ac4c-55bb565038c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:42.221270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b71ae-cb97-4803-a3f0-0c7e6552ec92 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:42.237291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:42.240256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:42.240538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:42.241028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] PATH_INFO: `/v3/users/400171af02554d0ba58abc5f169e686d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:42.245456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=400171af02554d0ba58abc5f169e686d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:42.247724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:42.251802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8139495c-9ce3-43b1-ac4c-55bb565038c7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:42.253009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8139495c-9ce3-43b1-ac4c-55bb565038c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:42.272290 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3637/7302] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:13:42.280795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139495c-9ce3-43b1-ac4c-55bb565038c7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:42.296437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139495c-9ce3-43b1-ac4c-55bb565038c7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:42.321032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c288b-56b4-488e-b639-025d6b039b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:42.321032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c288b-56b4-488e-b639-025d6b039b83 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:42.321032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c288b-56b4-488e-b639-025d6b039b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:42.321032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c288b-56b4-488e-b639-025d6b039b83 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:42.321670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c288b-56b4-488e-b639-025d6b039b83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:13:42.321670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c288b-56b4-488e-b639-025d6b039b83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:42.322309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c288b-56b4-488e-b639-025d6b039b83 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:42.346050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400171af02554d0ba58abc5f169e686d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:42.364347 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3638/7303] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:13:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:13:42.365452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c288b-56b4-488e-b639-025d6b039b83 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:42.390875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c288b-56b4-488e-b639-025d6b039b83 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:42.400029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400171af02554d0ba58abc5f169e686d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:42.403008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400171af02554d0ba58abc5f169e686d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:42.412040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400171af02554d0ba58abc5f169e686d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:42.433148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf1446-dc00-4cd6-b91d-007a0df6a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:42.434243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1446-dc00-4cd6-b91d-007a0df6a0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:42.434781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1446-dc00-4cd6-b91d-007a0df6a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:42.435812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf1446-dc00-4cd6-b91d-007a0df6a0a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:42.436637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf1446-dc00-4cd6-b91d-007a0df6a0a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:42.452057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf1446-dc00-4cd6-b91d-007a0df6a0a8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:42.457737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400171af02554d0ba58abc5f169e686d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:42.470718 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3666/7304] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:13:42 2021] DELETE /identity/v3/users/400171af02554d0ba58abc5f169e686d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:42.493804 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3639/7305] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:13:42 2021] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:42.498018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:42.500584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:42.684307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4e409-ea5e-4f29-ac76-3a59a1dfa7c2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:42.786036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551971d-ddf5-4d9a-afde-b2a03fd38903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:42.786779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551971d-ddf5-4d9a-afde-b2a03fd38903 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:42.787064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551971d-ddf5-4d9a-afde-b2a03fd38903 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:42.787371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551971d-ddf5-4d9a-afde-b2a03fd38903 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:42.788087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551971d-ddf5-4d9a-afde-b2a03fd38903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:42.790816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551971d-ddf5-4d9a-afde-b2a03fd38903 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:42.817342 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3667/7306] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:13:42 2021] POST /identity/v3/users => generated 289 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:13:42.822149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf1446-dc00-4cd6-b91d-007a0df6a0a8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:42.834674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf1446-dc00-4cd6-b91d-007a0df6a0a8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:42.840086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a4ecf-a9f3-4d53-94a8-b2227a78873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:42.841045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4ecf-a9f3-4d53-94a8-b2227a78873b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:42.841600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4ecf-a9f3-4d53-94a8-b2227a78873b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:42.842117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a4ecf-a9f3-4d53-94a8-b2227a78873b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:42.843108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a4ecf-a9f3-4d53-94a8-b2227a78873b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:42.844911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a4ecf-a9f3-4d53-94a8-b2227a78873b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:42.857174 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3640/7307] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:42.861319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551971d-ddf5-4d9a-afde-b2a03fd38903 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:42.874842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551971d-ddf5-4d9a-afde-b2a03fd38903 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:42.881140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41153140-9f4b-47af-9d29-7185627074ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:42.882294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41153140-9f4b-47af-9d29-7185627074ac admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:42.882764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41153140-9f4b-47af-9d29-7185627074ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:42.883273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41153140-9f4b-47af-9d29-7185627074ac admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:42.884185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41153140-9f4b-47af-9d29-7185627074ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:42.885968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41153140-9f4b-47af-9d29-7185627074ac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:42.897396 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3668/7308] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:42.901772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a4ecf-a9f3-4d53-94a8-b2227a78873b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:42.913166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a4ecf-a9f3-4d53-94a8-b2227a78873b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:42.919170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aef59-8856-4039-b306-79b287f7c696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:42.920313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aef59-8856-4039-b306-79b287f7c696 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:42.920940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aef59-8856-4039-b306-79b287f7c696 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:42.921402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aef59-8856-4039-b306-79b287f7c696 admin admin] PATH_INFO: `/v3/projects/219be90852c0481aaad9862d1a485102/users/b771da0354414b239da0cad505f8ffe6/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:42.938381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31aef59-8856-4039-b306-79b287f7c696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219be90852c0481aaad9862d1a485102, user_id=b771da0354414b239da0cad505f8ffe6, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:42.941456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31aef59-8856-4039-b306-79b287f7c696 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:42.960661 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3641/7309] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:42 2021] PUT /identity/v3/projects/219be90852c0481aaad9862d1a485102/users/b771da0354414b239da0cad505f8ffe6/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:42.967675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66e9c2-374d-4ab6-8f82-cd4471af4fbc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:42.969206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66e9c2-374d-4ab6-8f82-cd4471af4fbc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:42.969740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66e9c2-374d-4ab6-8f82-cd4471af4fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:42.989268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aef59-8856-4039-b306-79b287f7c696 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:42.991288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e31aef59-8856-4039-b306-79b287f7c696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:43.004140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8a66e9c2-374d-4ab6-8f82-cd4471af4fbc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:43.006155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8a66e9c2-374d-4ab6-8f82-cd4471af4fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:43.083582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aef59-8856-4039-b306-79b287f7c696 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:43.093626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:43.094856 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3669/7310] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:43.098409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:43.098979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:43.099286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] PATH_INFO: `/v3/projects/29f106e1c7dc4a628bbd1bd1d69885ab` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:43.100852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f106e1c7dc4a628bbd1bd1d69885ab)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:43.103920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:43.116664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66e9c2-374d-4ab6-8f82-cd4471af4fbc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:43.118924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8a66e9c2-374d-4ab6-8f82-cd4471af4fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:43.198182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f106e1c7dc4a628bbd1bd1d69885ab', 'request_id': 'req-a935d6d1-5b87-4fa8-942c-a4a98f917edb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:43.209219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f106e1c7dc4a628bbd1bd1d69885ab', 'request_id': 'req-a935d6d1-5b87-4fa8-942c-a4a98f917edb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:43.221197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f106e1c7dc4a628bbd1bd1d69885ab', 'request_id': 'req-a935d6d1-5b87-4fa8-942c-a4a98f917edb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:43.250469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] The token cache is being invalidate because project 29f106e1c7dc4a628bbd1bd1d69885ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:13:43.250946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:43.256059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a935d6d1-5b87-4fa8-942c-a4a98f917edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:13:43.271780 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3642/7311] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:13:42 2021] DELETE /identity/v3/projects/29f106e1c7dc4a628bbd1bd1d69885ab => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:43.277321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66e9c2-374d-4ab6-8f82-cd4471af4fbc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:43.278802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab469-2a14-4cf7-aec3-1b8e387cc88d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:43.280652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab469-2a14-4cf7-aec3-1b8e387cc88d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:43.281232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab469-2a14-4cf7-aec3-1b8e387cc88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:43.338038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-31cab469-2a14-4cf7-aec3-1b8e387cc88d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:43.340958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-31cab469-2a14-4cf7-aec3-1b8e387cc88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:43.389947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15243999-5e6b-46a8-a308-495c0bef8074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:43.391926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15243999-5e6b-46a8-a308-495c0bef8074 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:43.391926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15243999-5e6b-46a8-a308-495c0bef8074 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:43.392230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15243999-5e6b-46a8-a308-495c0bef8074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:43.395246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-15243999-5e6b-46a8-a308-495c0bef8074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:43.496325 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3643/7312] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:43.504263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd588e44-1189-4ad0-9a52-29022db6ed4a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:43.505986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd588e44-1189-4ad0-9a52-29022db6ed4a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:43.506814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd588e44-1189-4ad0-9a52-29022db6ed4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:43.544483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fd588e44-1189-4ad0-9a52-29022db6ed4a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:43.545836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fd588e44-1189-4ad0-9a52-29022db6ed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:43.557653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15243999-5e6b-46a8-a308-495c0bef8074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:43.559585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15243999-5e6b-46a8-a308-495c0bef8074 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:43.562251 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3644/7313] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:43.566737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd588e44-1189-4ad0-9a52-29022db6ed4a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:43.582399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd588e44-1189-4ad0-9a52-29022db6ed4a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:43.588868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d972ce-81ee-4655-8c11-862592f56402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:43.589476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d972ce-81ee-4655-8c11-862592f56402 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:43.589759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d972ce-81ee-4655-8c11-862592f56402 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:43.590038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d972ce-81ee-4655-8c11-862592f56402 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:43.590828 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3670/7314] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:43.591245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d972ce-81ee-4655-8c11-862592f56402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:13:43.591245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d972ce-81ee-4655-8c11-862592f56402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:43.592916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d972ce-81ee-4655-8c11-862592f56402 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:43.611021 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3645/7315] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:13:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:13:43.613322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15243999-5e6b-46a8-a308-495c0bef8074 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:43.629705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15243999-5e6b-46a8-a308-495c0bef8074 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:43.643825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a4b40-91af-481d-b7fb-ce7e8c56f13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:43.646051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a4b40-91af-481d-b7fb-ce7e8c56f13a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:43.658204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a4b40-91af-481d-b7fb-ce7e8c56f13a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:43.659087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a4b40-91af-481d-b7fb-ce7e8c56f13a admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:43.660403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a4b40-91af-481d-b7fb-ce7e8c56f13a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:43.662790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a4b40-91af-481d-b7fb-ce7e8c56f13a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:43.705695 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3671/7316] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:13:43 2021] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:43.710130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d972ce-81ee-4655-8c11-862592f56402 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:43.740695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d972ce-81ee-4655-8c11-862592f56402 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:43.886503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293e321-2791-4259-a81b-134c69d65081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:43.890640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e321-2791-4259-a81b-134c69d65081 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:43.891020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e321-2791-4259-a81b-134c69d65081 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:43.891385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e321-2791-4259-a81b-134c69d65081 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:43.892116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293e321-2791-4259-a81b-134c69d65081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:43.895621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293e321-2791-4259-a81b-134c69d65081 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:43.934202 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3646/7317] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:13:43 2021] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:43.941195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a4b40-91af-481d-b7fb-ce7e8c56f13a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:43.957782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a4b40-91af-481d-b7fb-ce7e8c56f13a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:43.965733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad15fa-f278-48ee-a8fb-d05e41a66f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:43.966533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad15fa-f278-48ee-a8fb-d05e41a66f65 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:43.966882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad15fa-f278-48ee-a8fb-d05e41a66f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:43.967222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad15fa-f278-48ee-a8fb-d05e41a66f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:43.968306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad15fa-f278-48ee-a8fb-d05e41a66f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:43.970120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad15fa-f278-48ee-a8fb-d05e41a66f65 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:43.983217 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3672/7318] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:43 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:43.988962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293e321-2791-4259-a81b-134c69d65081 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:44.003843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293e321-2791-4259-a81b-134c69d65081 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:44.011902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7e449-146b-44fa-821e-4c3208c43752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:44.013129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7e449-146b-44fa-821e-4c3208c43752 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:44.013510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7e449-146b-44fa-821e-4c3208c43752 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:44.014003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7e449-146b-44fa-821e-4c3208c43752 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:44.016910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7e449-146b-44fa-821e-4c3208c43752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:44.021170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7e449-146b-44fa-821e-4c3208c43752 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:44.038384 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3647/7319] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:43 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:13:44.044447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad15fa-f278-48ee-a8fb-d05e41a66f65 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:44.064525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad15fa-f278-48ee-a8fb-d05e41a66f65 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:44.072550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3d60b-54b5-4e37-9a27-2fb5542cf416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:44.073780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3d60b-54b5-4e37-9a27-2fb5542cf416 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:44.074165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3d60b-54b5-4e37-9a27-2fb5542cf416 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:44.074539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3d60b-54b5-4e37-9a27-2fb5542cf416 admin admin] PATH_INFO: `/v3/projects/c346617e7aa44828af349d91bd2487eb/users/470174c865c547e48a55751015c69931/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:44.093569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3d60b-54b5-4e37-9a27-2fb5542cf416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c346617e7aa44828af349d91bd2487eb, user_id=470174c865c547e48a55751015c69931, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:44.098795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3d60b-54b5-4e37-9a27-2fb5542cf416 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:44.127066 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3673/7320] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:44 2021] PUT /identity/v3/projects/c346617e7aa44828af349d91bd2487eb/users/470174c865c547e48a55751015c69931/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:13:44.147367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef7181-3738-41d6-a3e0-6ff2e32b60c9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:44.147825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef7181-3738-41d6-a3e0-6ff2e32b60c9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:44.148232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef7181-3738-41d6-a3e0-6ff2e32b60c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:44.183631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-37ef7181-3738-41d6-a3e0-6ff2e32b60c9 None None] MFA Rules not processed for user `470174c865c547e48a55751015c69931`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:44.185148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-37ef7181-3738-41d6-a3e0-6ff2e32b60c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:44.297341 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3648/7321] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:44 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:44.301432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3d60b-54b5-4e37-9a27-2fb5542cf416 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:44.400563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3d60b-54b5-4e37-9a27-2fb5542cf416 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:44.408184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02687c9a-d17c-4f5f-ab02-b83cadb0b364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:44.408913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02687c9a-d17c-4f5f-ab02-b83cadb0b364 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:44.410079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02687c9a-d17c-4f5f-ab02-b83cadb0b364 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:44.410432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02687c9a-d17c-4f5f-ab02-b83cadb0b364 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:44.412242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02687c9a-d17c-4f5f-ab02-b83cadb0b364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:44.416495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02687c9a-d17c-4f5f-ab02-b83cadb0b364 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:44.462501 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3674/7322] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:13:44 2021] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:44.464088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef7181-3738-41d6-a3e0-6ff2e32b60c9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:44.485160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef7181-3738-41d6-a3e0-6ff2e32b60c9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:44.590450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bed244-0719-4cb4-9e9f-3ab6f4f5bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:44.591149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bed244-0719-4cb4-9e9f-3ab6f4f5bc84 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:44.591485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bed244-0719-4cb4-9e9f-3ab6f4f5bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:44.591757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bed244-0719-4cb4-9e9f-3ab6f4f5bc84 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:44.592560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bed244-0719-4cb4-9e9f-3ab6f4f5bc84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:44.595449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bed244-0719-4cb4-9e9f-3ab6f4f5bc84 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:44.645179 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3649/7323] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:13:44 2021] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:13:44.646780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02687c9a-d17c-4f5f-ab02-b83cadb0b364 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:44.700058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02687c9a-d17c-4f5f-ab02-b83cadb0b364 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:44.741496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028525e7-6708-4d70-be36-346f783c03db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:44.743000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028525e7-6708-4d70-be36-346f783c03db admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:44.743305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028525e7-6708-4d70-be36-346f783c03db admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:44.743581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028525e7-6708-4d70-be36-346f783c03db admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:44.745482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028525e7-6708-4d70-be36-346f783c03db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:44.747345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028525e7-6708-4d70-be36-346f783c03db admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:44.765842 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3675/7324] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:44 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:44.767000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bed244-0719-4cb4-9e9f-3ab6f4f5bc84 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:44.785831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bed244-0719-4cb4-9e9f-3ab6f4f5bc84 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:44.803358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290795a7-92a7-408d-8898-fb82d3a96e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:44.804615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290795a7-92a7-408d-8898-fb82d3a96e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:44.806470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290795a7-92a7-408d-8898-fb82d3a96e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:44.820150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290795a7-92a7-408d-8898-fb82d3a96e31 admin admin] PATH_INFO: `/v3/projects/5ca54dd09e9c4a9e903cc5cfa940ab9e/users/e88a65247b63408a865b55decf4591e2/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:44.883239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290795a7-92a7-408d-8898-fb82d3a96e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca54dd09e9c4a9e903cc5cfa940ab9e, user_id=e88a65247b63408a865b55decf4591e2, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:44.887334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290795a7-92a7-408d-8898-fb82d3a96e31 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:44.950925 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3650/7325] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:44 2021] PUT /identity/v3/projects/5ca54dd09e9c4a9e903cc5cfa940ab9e/users/e88a65247b63408a865b55decf4591e2/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:44.956287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028525e7-6708-4d70-be36-346f783c03db admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:44.971808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028525e7-6708-4d70-be36-346f783c03db admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:45.091047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8adf51-428e-4e47-9a6a-3b2642143d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:45.094392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8adf51-428e-4e47-9a6a-3b2642143d5b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:45.094691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8adf51-428e-4e47-9a6a-3b2642143d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:45.095015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8adf51-428e-4e47-9a6a-3b2642143d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:45.095811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8adf51-428e-4e47-9a6a-3b2642143d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:45.112500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8adf51-428e-4e47-9a6a-3b2642143d5b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:45.142618 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3676/7326] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:13:44 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:13:45.149786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290795a7-92a7-408d-8898-fb82d3a96e31 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:45.180560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290795a7-92a7-408d-8898-fb82d3a96e31 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:45.199191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1d063-39b6-47ae-87a5-bcca452d5503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:45.200755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1d063-39b6-47ae-87a5-bcca452d5503 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:45.201230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1d063-39b6-47ae-87a5-bcca452d5503 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:45.201706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1d063-39b6-47ae-87a5-bcca452d5503 admin admin] PATH_INFO: `/v3/projects/5ca54dd09e9c4a9e903cc5cfa940ab9e/users/e88a65247b63408a865b55decf4591e2/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:45.214944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1d063-39b6-47ae-87a5-bcca452d5503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca54dd09e9c4a9e903cc5cfa940ab9e, user_id=e88a65247b63408a865b55decf4591e2, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:45.221907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1d063-39b6-47ae-87a5-bcca452d5503 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:45.243771 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3651/7327] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:13:45 2021] PUT /identity/v3/projects/5ca54dd09e9c4a9e903cc5cfa940ab9e/users/e88a65247b63408a865b55decf4591e2/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:13:45.255504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8e697-8dc6-4e73-b2c1-94ac44c21b22 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:45.260028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8e697-8dc6-4e73-b2c1-94ac44c21b22 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:45.260546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8e697-8dc6-4e73-b2c1-94ac44c21b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:45.349112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-75a8e697-8dc6-4e73-b2c1-94ac44c21b22 None None] MFA Rules not processed for user `e88a65247b63408a865b55decf4591e2`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:45.352021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-75a8e697-8dc6-4e73-b2c1-94ac44c21b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:45.495431 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3677/7328] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:45 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:45.506835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1d063-39b6-47ae-87a5-bcca452d5503 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:45.509676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-01b1d063-39b6-47ae-87a5-bcca452d5503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:45.635868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1d063-39b6-47ae-87a5-bcca452d5503 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:45.648768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3feb8-a907-422e-a5fd-271185dc3ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:45.649604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3feb8-a907-422e-a5fd-271185dc3ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:45.650015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3feb8-a907-422e-a5fd-271185dc3ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:45.651734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3feb8-a907-422e-a5fd-271185dc3ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:45.791438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3feb8-a907-422e-a5fd-271185dc3ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:45.793171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3feb8-a907-422e-a5fd-271185dc3ef9 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:45.819887 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3652/7329] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:45 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:47.849923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8e697-8dc6-4e73-b2c1-94ac44c21b22 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:47.852577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-75a8e697-8dc6-4e73-b2c1-94ac44c21b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:48.075025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8e697-8dc6-4e73-b2c1-94ac44c21b22 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:48.081160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c474d3b-d55f-47d5-a0ac-a8b45300a700 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:48.082204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c474d3b-d55f-47d5-a0ac-a8b45300a700 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:48.082729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c474d3b-d55f-47d5-a0ac-a8b45300a700 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:48.083281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c474d3b-d55f-47d5-a0ac-a8b45300a700 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:48.085699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8c474d3b-d55f-47d5-a0ac-a8b45300a700 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:48.106772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c474d3b-d55f-47d5-a0ac-a8b45300a700 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:48.108586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c474d3b-d55f-47d5-a0ac-a8b45300a700 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:48.126200 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3678/7330] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:47 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:48.261051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bc9e3-41d7-4d44-b863-4afaf2784a89 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:48.261625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bc9e3-41d7-4d44-b863-4afaf2784a89 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:48.261797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bc9e3-41d7-4d44-b863-4afaf2784a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:48.329990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-428bc9e3-41d7-4d44-b863-4afaf2784a89 None None] MFA Rules not processed for user `68af5d383d4149a89a0f87bdb735ccea`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:48.331442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-428bc9e3-41d7-4d44-b863-4afaf2784a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:48.516388 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3653/7331] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:48 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:48.536502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c474d3b-d55f-47d5-a0ac-a8b45300a700 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:48.538369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8c474d3b-d55f-47d5-a0ac-a8b45300a700 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:48.770927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c474d3b-d55f-47d5-a0ac-a8b45300a700 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:48.795819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d6931-5f00-4e59-93cf-909f7a91e85a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:48.796786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d6931-5f00-4e59-93cf-909f7a91e85a service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:48.804264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d6931-5f00-4e59-93cf-909f7a91e85a service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:48.806050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d6931-5f00-4e59-93cf-909f7a91e85a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:48.845950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d6931-5f00-4e59-93cf-909f7a91e85a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:48.848079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d6931-5f00-4e59-93cf-909f7a91e85a service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:48.878762 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3679/7332] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:48 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:49.019838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ccfde-2090-495d-bf91-30449d80a17b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:49.021204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ccfde-2090-495d-bf91-30449d80a17b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:49.021714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ccfde-2090-495d-bf91-30449d80a17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:49.080106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b02ccfde-2090-495d-bf91-30449d80a17b None None] MFA Rules not processed for user `48dc931fd45648f4893b7b6903b8ce2d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:49.081407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b02ccfde-2090-495d-bf91-30449d80a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:49.338682 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3654/7333] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:49 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:49.894883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d6931-5f00-4e59-93cf-909f7a91e85a service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:49.897366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b64d6931-5f00-4e59-93cf-909f7a91e85a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:50.115422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d6931-5f00-4e59-93cf-909f7a91e85a service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:50.129700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f4c49-be3f-48ab-a490-a264dc7fc471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:50.130663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f4c49-be3f-48ab-a490-a264dc7fc471 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:50.131115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f4c49-be3f-48ab-a490-a264dc7fc471 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:50.131604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f4c49-be3f-48ab-a490-a264dc7fc471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:50.135590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bb6f4c49-be3f-48ab-a490-a264dc7fc471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:50.166002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f4c49-be3f-48ab-a490-a264dc7fc471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:50.169366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f4c49-be3f-48ab-a490-a264dc7fc471 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:50.222166 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3680/7334] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:49 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:51.446255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb689f69-995b-4258-8427-2dc827feddd5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:51.449684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb689f69-995b-4258-8427-2dc827feddd5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:51.450289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb689f69-995b-4258-8427-2dc827feddd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:51.491633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fb689f69-995b-4258-8427-2dc827feddd5 None None] MFA Rules not processed for user `b771da0354414b239da0cad505f8ffe6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:51.493704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fb689f69-995b-4258-8427-2dc827feddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:51.607479 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3655/7335] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:51 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:51.620423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f4c49-be3f-48ab-a490-a264dc7fc471 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:51.622489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bb6f4c49-be3f-48ab-a490-a264dc7fc471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:51.657769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f4c49-be3f-48ab-a490-a264dc7fc471 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:51.667829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13311d7-bc6f-45c3-8981-6200f79f1071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:51.668895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13311d7-bc6f-45c3-8981-6200f79f1071 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:51.669547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13311d7-bc6f-45c3-8981-6200f79f1071 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:51.670025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13311d7-bc6f-45c3-8981-6200f79f1071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:51.687852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13311d7-bc6f-45c3-8981-6200f79f1071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:51.698382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13311d7-bc6f-45c3-8981-6200f79f1071 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:51.715452 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3681/7336] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:51 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:13:54.390067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed3c34-a222-43b2-9238-ea7c60571637 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:54.411279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed3c34-a222-43b2-9238-ea7c60571637 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:54.412042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed3c34-a222-43b2-9238-ea7c60571637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:54.476796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-10ed3c34-a222-43b2-9238-ea7c60571637 None None] MFA Rules not processed for user `b771da0354414b239da0cad505f8ffe6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:13:54.482102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-10ed3c34-a222-43b2-9238-ea7c60571637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:54.509732 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3656/7337] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:13:54 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:13:59.681658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13311d7-bc6f-45c3-8981-6200f79f1071 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:13:59.684626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a13311d7-bc6f-45c3-8981-6200f79f1071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:13:59.701214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13311d7-bc6f-45c3-8981-6200f79f1071 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:13:59.705919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cb413-0200-4b77-9923-4ec36d0fda63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:13:59.706740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cb413-0200-4b77-9923-4ec36d0fda63 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:13:59.707135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cb413-0200-4b77-9923-4ec36d0fda63 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:13:59.707538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cb413-0200-4b77-9923-4ec36d0fda63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:13:59.721472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cb413-0200-4b77-9923-4ec36d0fda63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:13:59.722972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cb413-0200-4b77-9923-4ec36d0fda63 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:13:59.737095 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3682/7338] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:13:59 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:14:03.706222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed3c34-a222-43b2-9238-ea7c60571637 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:03.719724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed3c34-a222-43b2-9238-ea7c60571637 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:03.723397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb661fbe-28d5-4db6-bf3b-95c6a626ce91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:03.724055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb661fbe-28d5-4db6-bf3b-95c6a626ce91 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:03.724490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb661fbe-28d5-4db6-bf3b-95c6a626ce91 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:03.724936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb661fbe-28d5-4db6-bf3b-95c6a626ce91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:03.728283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cb661fbe-28d5-4db6-bf3b-95c6a626ce91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:03.797861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb661fbe-28d5-4db6-bf3b-95c6a626ce91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:03.799420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb661fbe-28d5-4db6-bf3b-95c6a626ce91 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:03.813883 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3657/7339] 10.222.0.21 () {60 vars in 1396 bytes} [Sat Nov 27 21:14:03 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:14:05.229972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3fe81-4abf-4de3-96fb-9de4ec8f0d40 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:05.230515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3fe81-4abf-4de3-96fb-9de4ec8f0d40 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:05.230515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3fe81-4abf-4de3-96fb-9de4ec8f0d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:05.254116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-00e3fe81-4abf-4de3-96fb-9de4ec8f0d40 None None] MFA Rules not processed for user `48dc931fd45648f4893b7b6903b8ce2d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:05.255512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-00e3fe81-4abf-4de3-96fb-9de4ec8f0d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:05.270041 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3683/7340] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:05 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:14:16.843387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb661fbe-28d5-4db6-bf3b-95c6a626ce91 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:16.902741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb661fbe-28d5-4db6-bf3b-95c6a626ce91 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:16.907242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:16.908115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:16.908395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:16.908670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] PATH_INFO: `/v3/users/470174c865c547e48a55751015c69931` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:16.909837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=470174c865c547e48a55751015c69931)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:16.911780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:16.956164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470174c865c547e48a55751015c69931'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:16.956754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470174c865c547e48a55751015c69931'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:16.963889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470174c865c547e48a55751015c69931'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:16.964561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470174c865c547e48a55751015c69931'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:16.971478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470174c865c547e48a55751015c69931'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:16.987821 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3658/7341] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:14:16 2021] DELETE /identity/v3/users/470174c865c547e48a55751015c69931 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:16.992584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1e92-51e3-4e3d-b60f-2d5d9b4aaf55 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:16.993652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1e92-51e3-4e3d-b60f-2d5d9b4aaf55 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:16.993652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b1e92-51e3-4e3d-b60f-2d5d9b4aaf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:17.014914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8a2b1e92-51e3-4e3d-b60f-2d5d9b4aaf55 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:17.016153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8a2b1e92-51e3-4e3d-b60f-2d5d9b4aaf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:17.072409 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3684/7342] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:14:17.082464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:17.083883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:17.144169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7799dd-1621-4bf0-b057-b95c25c84a76 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:17.148843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27822ad9-80a5-4eea-a63e-86958b9b0fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:17.149481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27822ad9-80a5-4eea-a63e-86958b9b0fde service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:17.149759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27822ad9-80a5-4eea-a63e-86958b9b0fde service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:17.150256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27822ad9-80a5-4eea-a63e-86958b9b0fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:17.159952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27822ad9-80a5-4eea-a63e-86958b9b0fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:17.161390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27822ad9-80a5-4eea-a63e-86958b9b0fde service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:17.171014 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3659/7343] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:14:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:14:17.826203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b1e92-51e3-4e3d-b60f-2d5d9b4aaf55 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:17.827718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8a2b1e92-51e3-4e3d-b60f-2d5d9b4aaf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:17.842762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b1e92-51e3-4e3d-b60f-2d5d9b4aaf55 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:17.848432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:17.849977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:17.850438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:17.850991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] PATH_INFO: `/v3/projects/c346617e7aa44828af349d91bd2487eb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:17.852990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c346617e7aa44828af349d91bd2487eb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:17.854970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:17.907530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c346617e7aa44828af349d91bd2487eb', 'request_id': 'req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:17.915216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c346617e7aa44828af349d91bd2487eb', 'request_id': 'req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:17.921531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c346617e7aa44828af349d91bd2487eb', 'request_id': 'req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:17.931781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] The token cache is being invalidate because project c346617e7aa44828af349d91bd2487eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:14:17.932069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:17.932843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:17.934593 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3685/7344] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:14:17 2021] DELETE /identity/v3/projects/c346617e7aa44828af349d91bd2487eb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:17.938590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27822ad9-80a5-4eea-a63e-86958b9b0fde service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:17.948883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27822ad9-80a5-4eea-a63e-86958b9b0fde service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:18.006261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2ebc5-245f-4aa7-a442-625b40da466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:18.007317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ebc5-245f-4aa7-a442-625b40da466c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:18.007666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ebc5-245f-4aa7-a442-625b40da466c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:18.008049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2ebc5-245f-4aa7-a442-625b40da466c admin admin] PATH_INFO: `/v3/users/e88a65247b63408a865b55decf4591e2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:18.009973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2ebc5-245f-4aa7-a442-625b40da466c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88a65247b63408a865b55decf4591e2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:18.012181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2ebc5-245f-4aa7-a442-625b40da466c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:18.059550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-44b2ebc5-245f-4aa7-a442-625b40da466c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88a65247b63408a865b55decf4591e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:18.060277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-44b2ebc5-245f-4aa7-a442-625b40da466c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88a65247b63408a865b55decf4591e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:18.068847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-44b2ebc5-245f-4aa7-a442-625b40da466c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88a65247b63408a865b55decf4591e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:18.069825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-44b2ebc5-245f-4aa7-a442-625b40da466c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88a65247b63408a865b55decf4591e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:18.082435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-44b2ebc5-245f-4aa7-a442-625b40da466c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88a65247b63408a865b55decf4591e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:18.105840 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3660/7345] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:14:17 2021] DELETE /identity/v3/users/e88a65247b63408a865b55decf4591e2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:18.486110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:18.488578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:18.506626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14fe82-dc8c-4657-8cd6-c346b80ef6ec admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:18.563862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:18.564715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:18.564998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:18.565273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] PATH_INFO: `/v3/projects/5ca54dd09e9c4a9e903cc5cfa940ab9e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:18.566459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca54dd09e9c4a9e903cc5cfa940ab9e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:18.568414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:18.614146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca54dd09e9c4a9e903cc5cfa940ab9e', 'request_id': 'req-495d53e0-71e8-4ffc-9548-db6a40b077cb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:18.622073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca54dd09e9c4a9e903cc5cfa940ab9e', 'request_id': 'req-495d53e0-71e8-4ffc-9548-db6a40b077cb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:18.628721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca54dd09e9c4a9e903cc5cfa940ab9e', 'request_id': 'req-495d53e0-71e8-4ffc-9548-db6a40b077cb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:18.639576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] The token cache is being invalidate because project 5ca54dd09e9c4a9e903cc5cfa940ab9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:14:18.639864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:18.640519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-495d53e0-71e8-4ffc-9548-db6a40b077cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:18.642143 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3686/7346] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:14:18 2021] DELETE /identity/v3/projects/5ca54dd09e9c4a9e903cc5cfa940ab9e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:18.647900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f592c10-8501-4b5f-8edf-2f1b047920e8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:18.648193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f592c10-8501-4b5f-8edf-2f1b047920e8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:18.648474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f592c10-8501-4b5f-8edf-2f1b047920e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:18.669195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6f592c10-8501-4b5f-8edf-2f1b047920e8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:18.670424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6f592c10-8501-4b5f-8edf-2f1b047920e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:18.734365 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3661/7347] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:14:18.744140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec51fd-7187-4ef3-99ce-6afd8b164d96 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:18.744515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec51fd-7187-4ef3-99ce-6afd8b164d96 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:18.744800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec51fd-7187-4ef3-99ce-6afd8b164d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:18.763213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f3ec51fd-7187-4ef3-99ce-6afd8b164d96 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:18.764526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f3ec51fd-7187-4ef3-99ce-6afd8b164d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:18.773211 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3687/7348] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:14:18.777418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f592c10-8501-4b5f-8edf-2f1b047920e8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:18.787183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f592c10-8501-4b5f-8edf-2f1b047920e8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:18.792480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9606dd-d612-45d7-9bbb-070f01ba3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:18.793134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9606dd-d612-45d7-9bbb-070f01ba3600 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:18.793418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9606dd-d612-45d7-9bbb-070f01ba3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:18.793696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9606dd-d612-45d7-9bbb-070f01ba3600 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:18.794433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9606dd-d612-45d7-9bbb-070f01ba3600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:14:18.794743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9606dd-d612-45d7-9bbb-070f01ba3600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:18.796396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9606dd-d612-45d7-9bbb-070f01ba3600 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:18.809011 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3662/7349] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:14:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:14:18.813554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec51fd-7187-4ef3-99ce-6afd8b164d96 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:18.823301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec51fd-7187-4ef3-99ce-6afd8b164d96 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:18.827722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee038f-e13a-4467-9859-1be2c78b7151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:18.828374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee038f-e13a-4467-9859-1be2c78b7151 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:18.828656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee038f-e13a-4467-9859-1be2c78b7151 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:18.828931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee038f-e13a-4467-9859-1be2c78b7151 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:18.829630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee038f-e13a-4467-9859-1be2c78b7151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:18.831699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee038f-e13a-4467-9859-1be2c78b7151 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:18.861595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3688/7350] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:14:18 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:14:18.862671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9606dd-d612-45d7-9bbb-070f01ba3600 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:18.874200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9606dd-d612-45d7-9bbb-070f01ba3600 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:18.930113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9a1f2-d544-42eb-b93e-a57634ff8d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:18.930801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9a1f2-d544-42eb-b93e-a57634ff8d56 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:18.931078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9a1f2-d544-42eb-b93e-a57634ff8d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:18.931388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9a1f2-d544-42eb-b93e-a57634ff8d56 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:18.932085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9a1f2-d544-42eb-b93e-a57634ff8d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:18.934017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9a1f2-d544-42eb-b93e-a57634ff8d56 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:18.952872 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3663/7351] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:14:18 2021] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:14:18.956884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee038f-e13a-4467-9859-1be2c78b7151 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:18.967439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee038f-e13a-4467-9859-1be2c78b7151 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:18.971964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca04fb-4717-4718-87ac-611886062ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:18.972608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca04fb-4717-4718-87ac-611886062ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:18.972887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca04fb-4717-4718-87ac-611886062ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:18.973158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca04fb-4717-4718-87ac-611886062ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:18.973882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca04fb-4717-4718-87ac-611886062ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:18.975485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca04fb-4717-4718-87ac-611886062ae5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:18.986591 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3689/7352] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:14:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:14:18.990420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9a1f2-d544-42eb-b93e-a57634ff8d56 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:19.000770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9a1f2-d544-42eb-b93e-a57634ff8d56 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:19.005441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8972e8-7551-48a7-ac34-927b196df10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:19.006082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8972e8-7551-48a7-ac34-927b196df10a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:19.006360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8972e8-7551-48a7-ac34-927b196df10a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:19.006630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8972e8-7551-48a7-ac34-927b196df10a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:19.007386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8972e8-7551-48a7-ac34-927b196df10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:19.008959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8972e8-7551-48a7-ac34-927b196df10a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:19.018529 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3664/7353] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:14:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:14:19.022548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca04fb-4717-4718-87ac-611886062ae5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:19.033575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca04fb-4717-4718-87ac-611886062ae5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:19.038521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35487b45-e97f-43e9-9dd2-f482460c46a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:19.039510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487b45-e97f-43e9-9dd2-f482460c46a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:19.040442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487b45-e97f-43e9-9dd2-f482460c46a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:19.040721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35487b45-e97f-43e9-9dd2-f482460c46a8 admin admin] PATH_INFO: `/v3/projects/ab36a8cb10744a429b3f957596b8d59b/users/fcca9aabcd6549f5914e1ca0ea5de31b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:19.055284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35487b45-e97f-43e9-9dd2-f482460c46a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab36a8cb10744a429b3f957596b8d59b, user_id=fcca9aabcd6549f5914e1ca0ea5de31b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:19.057921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35487b45-e97f-43e9-9dd2-f482460c46a8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:19.070857 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3690/7354] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:14:19 2021] PUT /identity/v3/projects/ab36a8cb10744a429b3f957596b8d59b/users/fcca9aabcd6549f5914e1ca0ea5de31b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:19.080988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173fc45-6a14-4801-9e91-f0ee1217bac0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:19.081499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173fc45-6a14-4801-9e91-f0ee1217bac0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:19.081708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173fc45-6a14-4801-9e91-f0ee1217bac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:19.108987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a173fc45-6a14-4801-9e91-f0ee1217bac0 None None] MFA Rules not processed for user `fcca9aabcd6549f5914e1ca0ea5de31b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:19.110231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a173fc45-6a14-4801-9e91-f0ee1217bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:19.174050 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3665/7355] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:19 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:14:19.184609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35487b45-e97f-43e9-9dd2-f482460c46a8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:19.186286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-35487b45-e97f-43e9-9dd2-f482460c46a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:19.245461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35487b45-e97f-43e9-9dd2-f482460c46a8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:19.249093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76d6ff-280a-44af-a22c-5472f6395144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:19.249734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d6ff-280a-44af-a22c-5472f6395144 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:19.250021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d6ff-280a-44af-a22c-5472f6395144 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:19.250301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d6ff-280a-44af-a22c-5472f6395144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:19.258968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76d6ff-280a-44af-a22c-5472f6395144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:19.260419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76d6ff-280a-44af-a22c-5472f6395144 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:19.269032 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3691/7356] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:14:19 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:14:19.293185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173fc45-6a14-4801-9e91-f0ee1217bac0 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:19.355044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173fc45-6a14-4801-9e91-f0ee1217bac0 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:19.359953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:19.360819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:19.361101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:19.361373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] PATH_INFO: `/v3/users/fcca9aabcd6549f5914e1ca0ea5de31b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:19.362579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcca9aabcd6549f5914e1ca0ea5de31b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:19.364570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:19.411850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcca9aabcd6549f5914e1ca0ea5de31b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:19.412518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcca9aabcd6549f5914e1ca0ea5de31b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:19.419487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcca9aabcd6549f5914e1ca0ea5de31b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:19.420122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcca9aabcd6549f5914e1ca0ea5de31b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:19.427045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcca9aabcd6549f5914e1ca0ea5de31b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:19.443735 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3666/7357] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:14:19 2021] DELETE /identity/v3/users/fcca9aabcd6549f5914e1ca0ea5de31b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:19.448957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef59358-6bdd-475d-a9c0-db580ff0fcf8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:19.449255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef59358-6bdd-475d-a9c0-db580ff0fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:19.449532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef59358-6bdd-475d-a9c0-db580ff0fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:19.467857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5ef59358-6bdd-475d-a9c0-db580ff0fcf8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:19.469065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5ef59358-6bdd-475d-a9c0-db580ff0fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:19.530657 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3692/7358] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:14:19.541028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:19.542749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:19.601046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db612519-debb-486d-8faa-071b8af2e32b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:19.604798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50309088-fba3-4661-904c-724971ea53f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:19.605438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309088-fba3-4661-904c-724971ea53f8 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:19.605717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309088-fba3-4661-904c-724971ea53f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:19.606018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50309088-fba3-4661-904c-724971ea53f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:19.615869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50309088-fba3-4661-904c-724971ea53f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:19.617550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50309088-fba3-4661-904c-724971ea53f8 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:19.627554 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3667/7359] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:14:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:14:19.948118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef59358-6bdd-475d-a9c0-db580ff0fcf8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:19.949640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5ef59358-6bdd-475d-a9c0-db580ff0fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:19.963335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef59358-6bdd-475d-a9c0-db580ff0fcf8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:19.972131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:19.973000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:19.973289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:19.973565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] PATH_INFO: `/v3/projects/ab36a8cb10744a429b3f957596b8d59b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:19.975216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab36a8cb10744a429b3f957596b8d59b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:19.977317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.024403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab36a8cb10744a429b3f957596b8d59b', 'request_id': 'req-ef45c419-1690-483d-9ec3-8a22115e855c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:20.031219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab36a8cb10744a429b3f957596b8d59b', 'request_id': 'req-ef45c419-1690-483d-9ec3-8a22115e855c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:20.037318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab36a8cb10744a429b3f957596b8d59b', 'request_id': 'req-ef45c419-1690-483d-9ec3-8a22115e855c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:20.047675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] The token cache is being invalidate because project ab36a8cb10744a429b3f957596b8d59b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:14:20.047959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:20.048593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ef45c419-1690-483d-9ec3-8a22115e855c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:20.050097 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3693/7360] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:14:19 2021] DELETE /identity/v3/projects/ab36a8cb10744a429b3f957596b8d59b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:20.056167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82194ac1-b325-4aff-8174-f10a6b5f838b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.056692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82194ac1-b325-4aff-8174-f10a6b5f838b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.056692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82194ac1-b325-4aff-8174-f10a6b5f838b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.075121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-82194ac1-b325-4aff-8174-f10a6b5f838b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:20.076364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-82194ac1-b325-4aff-8174-f10a6b5f838b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:20.134600 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3668/7361] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:14:20.142560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc47e9-09f4-45ac-9580-379e9ad150eb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.142874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc47e9-09f4-45ac-9580-379e9ad150eb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.143153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc47e9-09f4-45ac-9580-379e9ad150eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.161062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cafc47e9-09f4-45ac-9580-379e9ad150eb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:20.162247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cafc47e9-09f4-45ac-9580-379e9ad150eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:20.170491 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3694/7362] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:14:20.174692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82194ac1-b325-4aff-8174-f10a6b5f838b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.184914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82194ac1-b325-4aff-8174-f10a6b5f838b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.189570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba572a6-f701-44e6-ad76-76e53f901219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.190217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba572a6-f701-44e6-ad76-76e53f901219 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.190532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba572a6-f701-44e6-ad76-76e53f901219 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.190810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba572a6-f701-44e6-ad76-76e53f901219 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.191576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba572a6-f701-44e6-ad76-76e53f901219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:14:20.191887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba572a6-f701-44e6-ad76-76e53f901219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.193482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba572a6-f701-44e6-ad76-76e53f901219 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.205258 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3669/7363] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:14:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:14:20.209356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc47e9-09f4-45ac-9580-379e9ad150eb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.218360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc47e9-09f4-45ac-9580-379e9ad150eb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.222961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41593c85-2c61-46c3-867c-54b3be587e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.223692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593c85-2c61-46c3-867c-54b3be587e97 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.223971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593c85-2c61-46c3-867c-54b3be587e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.224243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41593c85-2c61-46c3-867c-54b3be587e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.224941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41593c85-2c61-46c3-867c-54b3be587e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.226802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41593c85-2c61-46c3-867c-54b3be587e97 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.252770 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3695/7364] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:14:20 2021] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:14:20.256659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba572a6-f701-44e6-ad76-76e53f901219 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.266457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba572a6-f701-44e6-ad76-76e53f901219 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.321403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf51e1-4bd1-4bc4-a439-47b14b3f388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.321994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf51e1-4bd1-4bc4-a439-47b14b3f388f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.322280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf51e1-4bd1-4bc4-a439-47b14b3f388f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.322560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf51e1-4bd1-4bc4-a439-47b14b3f388f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.323277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf51e1-4bd1-4bc4-a439-47b14b3f388f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.325209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf51e1-4bd1-4bc4-a439-47b14b3f388f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.344430 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3670/7365] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:14:20 2021] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:14:20.348663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41593c85-2c61-46c3-867c-54b3be587e97 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.359324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41593c85-2c61-46c3-867c-54b3be587e97 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.363864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bfe1d-854f-4925-9914-256d4354420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.364501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bfe1d-854f-4925-9914-256d4354420a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.364782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bfe1d-854f-4925-9914-256d4354420a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.365057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bfe1d-854f-4925-9914-256d4354420a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.365778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bfe1d-854f-4925-9914-256d4354420a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.367657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bfe1d-854f-4925-9914-256d4354420a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.378301 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3696/7366] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:14:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:14:20.382157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf51e1-4bd1-4bc4-a439-47b14b3f388f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.393511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf51e1-4bd1-4bc4-a439-47b14b3f388f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.398093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea6ddd-4854-4164-abfb-fba3c033203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.398761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea6ddd-4854-4164-abfb-fba3c033203a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.399593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea6ddd-4854-4164-abfb-fba3c033203a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.399908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea6ddd-4854-4164-abfb-fba3c033203a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.400673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea6ddd-4854-4164-abfb-fba3c033203a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.402252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea6ddd-4854-4164-abfb-fba3c033203a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.411923 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3671/7367] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:14:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:14:20.416502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bfe1d-854f-4925-9914-256d4354420a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.426247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bfe1d-854f-4925-9914-256d4354420a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.430935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4acb95-3341-4e4e-916d-43a86cd7067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.431843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4acb95-3341-4e4e-916d-43a86cd7067c admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.432125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4acb95-3341-4e4e-916d-43a86cd7067c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.432402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4acb95-3341-4e4e-916d-43a86cd7067c admin admin] PATH_INFO: `/v3/projects/587ce621728b4cb1b01fd53d69d45d4d/users/98c4fe50315d4fc0b0329e80802eee86/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.446570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4acb95-3341-4e4e-916d-43a86cd7067c admin admin] RBAC: Authorizing `identity:create_grant(project_id=587ce621728b4cb1b01fd53d69d45d4d, user_id=98c4fe50315d4fc0b0329e80802eee86, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.449221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4acb95-3341-4e4e-916d-43a86cd7067c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.462499 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3697/7368] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:14:20 2021] PUT /identity/v3/projects/587ce621728b4cb1b01fd53d69d45d4d/users/98c4fe50315d4fc0b0329e80802eee86/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:20.473108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470bcfa-e09f-42a7-ae41-61fdf769b15a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.473398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470bcfa-e09f-42a7-ae41-61fdf769b15a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.473674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470bcfa-e09f-42a7-ae41-61fdf769b15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.502485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3470bcfa-e09f-42a7-ae41-61fdf769b15a None None] MFA Rules not processed for user `98c4fe50315d4fc0b0329e80802eee86`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:20.503717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3470bcfa-e09f-42a7-ae41-61fdf769b15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:20.565645 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3672/7369] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:20 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:14:20.570251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4acb95-3341-4e4e-916d-43a86cd7067c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.629823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4acb95-3341-4e4e-916d-43a86cd7067c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.634428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad6914-0b86-4a3d-814e-5fe3716a6b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.635075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad6914-0b86-4a3d-814e-5fe3716a6b78 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.635388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad6914-0b86-4a3d-814e-5fe3716a6b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.635669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad6914-0b86-4a3d-814e-5fe3716a6b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.636375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad6914-0b86-4a3d-814e-5fe3716a6b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.638297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad6914-0b86-4a3d-814e-5fe3716a6b78 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.663083 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3698/7370] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:14:20 2021] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:14:20.667882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470bcfa-e09f-42a7-ae41-61fdf769b15a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.678337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470bcfa-e09f-42a7-ae41-61fdf769b15a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.732890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28f7e-87b8-411f-9f85-48ffff9dbf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.733580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28f7e-87b8-411f-9f85-48ffff9dbf63 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.733890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28f7e-87b8-411f-9f85-48ffff9dbf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.734161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28f7e-87b8-411f-9f85-48ffff9dbf63 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.734860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28f7e-87b8-411f-9f85-48ffff9dbf63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.736800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28f7e-87b8-411f-9f85-48ffff9dbf63 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.756408 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3673/7371] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:14:20 2021] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:14:20.760832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad6914-0b86-4a3d-814e-5fe3716a6b78 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.771094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad6914-0b86-4a3d-814e-5fe3716a6b78 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.776481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceae247-fd55-4eb7-a377-8e48401ae611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.777156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae247-fd55-4eb7-a377-8e48401ae611 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.777434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae247-fd55-4eb7-a377-8e48401ae611 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.777724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae247-fd55-4eb7-a377-8e48401ae611 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.778447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceae247-fd55-4eb7-a377-8e48401ae611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.780088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceae247-fd55-4eb7-a377-8e48401ae611 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.791344 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3699/7372] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:14:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:14:20.795379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28f7e-87b8-411f-9f85-48ffff9dbf63 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.805521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28f7e-87b8-411f-9f85-48ffff9dbf63 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.810765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b82776-f5c1-4648-8773-4819c2e2325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.811700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b82776-f5c1-4648-8773-4819c2e2325c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.811975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b82776-f5c1-4648-8773-4819c2e2325c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.812246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b82776-f5c1-4648-8773-4819c2e2325c admin admin] PATH_INFO: `/v3/projects/414235e15cdd46bfad72cceefb31d6f3/users/d7f39669871844cf88f46f072f46fe15/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.828711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b82776-f5c1-4648-8773-4819c2e2325c admin admin] RBAC: Authorizing `identity:create_grant(project_id=414235e15cdd46bfad72cceefb31d6f3, user_id=d7f39669871844cf88f46f072f46fe15, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.831420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b82776-f5c1-4648-8773-4819c2e2325c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.844183 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3674/7373] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:14:20 2021] PUT /identity/v3/projects/414235e15cdd46bfad72cceefb31d6f3/users/d7f39669871844cf88f46f072f46fe15/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:20.848106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceae247-fd55-4eb7-a377-8e48401ae611 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.857970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceae247-fd55-4eb7-a377-8e48401ae611 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.915827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feca6b9-aa37-4b9b-b6e5-2e8d53035351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.916598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feca6b9-aa37-4b9b-b6e5-2e8d53035351 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.916863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feca6b9-aa37-4b9b-b6e5-2e8d53035351 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.917153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feca6b9-aa37-4b9b-b6e5-2e8d53035351 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.917883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feca6b9-aa37-4b9b-b6e5-2e8d53035351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.919516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feca6b9-aa37-4b9b-b6e5-2e8d53035351 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.933410 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3700/7374] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:14:20 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:14:20.934510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b82776-f5c1-4648-8773-4819c2e2325c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:20.945244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b82776-f5c1-4648-8773-4819c2e2325c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:20.950506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa970d-e400-4fbe-8068-357c9b848238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:20.951416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa970d-e400-4fbe-8068-357c9b848238 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.951696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa970d-e400-4fbe-8068-357c9b848238 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.951967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa970d-e400-4fbe-8068-357c9b848238 admin admin] PATH_INFO: `/v3/projects/414235e15cdd46bfad72cceefb31d6f3/users/d7f39669871844cf88f46f072f46fe15/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:20.953923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa970d-e400-4fbe-8068-357c9b848238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414235e15cdd46bfad72cceefb31d6f3, user_id=d7f39669871844cf88f46f072f46fe15, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:20.956763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa970d-e400-4fbe-8068-357c9b848238 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:20.968133 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3675/7375] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:14:20 2021] PUT /identity/v3/projects/414235e15cdd46bfad72cceefb31d6f3/users/d7f39669871844cf88f46f072f46fe15/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:14:20.978760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74af71-5a2b-4a3d-8d69-b5e1da083928 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:20.978760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74af71-5a2b-4a3d-8d69-b5e1da083928 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:20.978760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74af71-5a2b-4a3d-8d69-b5e1da083928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:21.011509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ee74af71-5a2b-4a3d-8d69-b5e1da083928 None None] MFA Rules not processed for user `d7f39669871844cf88f46f072f46fe15`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:21.012740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ee74af71-5a2b-4a3d-8d69-b5e1da083928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:21.082463 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3701/7376] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:20 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:14:21.094774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa970d-e400-4fbe-8068-357c9b848238 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:21.096502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-32fa970d-e400-4fbe-8068-357c9b848238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:21.315069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa970d-e400-4fbe-8068-357c9b848238 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:21.320387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7f16a-20d1-46fd-92ba-db6b6a0005d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:21.321813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7f16a-20d1-46fd-92ba-db6b6a0005d8 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:21.322087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7f16a-20d1-46fd-92ba-db6b6a0005d8 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:21.322354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7f16a-20d1-46fd-92ba-db6b6a0005d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:21.376709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7f16a-20d1-46fd-92ba-db6b6a0005d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:21.378300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7f16a-20d1-46fd-92ba-db6b6a0005d8 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:21.389481 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3676/7377] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:14:21 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:14:25.030165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74af71-5a2b-4a3d-8d69-b5e1da083928 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:25.031726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ee74af71-5a2b-4a3d-8d69-b5e1da083928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:25.093923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74af71-5a2b-4a3d-8d69-b5e1da083928 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:25.097762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59aaa7-58e6-4d74-952f-1c89e9175323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:25.098436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59aaa7-58e6-4d74-952f-1c89e9175323 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:25.098724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59aaa7-58e6-4d74-952f-1c89e9175323 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:25.099004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59aaa7-58e6-4d74-952f-1c89e9175323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:25.110599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59aaa7-58e6-4d74-952f-1c89e9175323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:25.112190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59aaa7-58e6-4d74-952f-1c89e9175323 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:25.123728 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3702/7378] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:14:25 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:14:28.506047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2ee0-4802-4063-8362-6e40d84deed8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:28.506944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2ee0-4802-4063-8362-6e40d84deed8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:28.507427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2ee0-4802-4063-8362-6e40d84deed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:28.530628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-074e2ee0-4802-4063-8362-6e40d84deed8 None None] MFA Rules not processed for user `98c4fe50315d4fc0b0329e80802eee86`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:28.532317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-074e2ee0-4802-4063-8362-6e40d84deed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:28.543116 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3677/7379] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:28 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:14:30.170281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59aaa7-58e6-4d74-952f-1c89e9175323 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:30.172740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bd59aaa7-58e6-4d74-952f-1c89e9175323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:30.324483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59aaa7-58e6-4d74-952f-1c89e9175323 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:30.330201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533293-6482-49e3-992b-c70387c38fd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:30.331804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533293-6482-49e3-992b-c70387c38fd6 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:30.332267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533293-6482-49e3-992b-c70387c38fd6 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:30.332728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04533293-6482-49e3-992b-c70387c38fd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:30.334893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-04533293-6482-49e3-992b-c70387c38fd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:30.360880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04533293-6482-49e3-992b-c70387c38fd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:30.366936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04533293-6482-49e3-992b-c70387c38fd6 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:30.386238 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3703/7380] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:14:30 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:14:31.773585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e2ee0-4802-4063-8362-6e40d84deed8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:31.775556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-074e2ee0-4802-4063-8362-6e40d84deed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:31.869733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e2ee0-4802-4063-8362-6e40d84deed8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:31.875901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:31.877139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:31.877600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:31.878292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] PATH_INFO: `/v3/users/48dc931fd45648f4893b7b6903b8ce2d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:31.879787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48dc931fd45648f4893b7b6903b8ce2d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:31.881946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:31.961899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48dc931fd45648f4893b7b6903b8ce2d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:31.962660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48dc931fd45648f4893b7b6903b8ce2d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:31.972320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48dc931fd45648f4893b7b6903b8ce2d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:31.973767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48dc931fd45648f4893b7b6903b8ce2d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:31.981993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48dc931fd45648f4893b7b6903b8ce2d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:32.001377 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3678/7381] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:14:31 2021] DELETE /identity/v3/users/48dc931fd45648f4893b7b6903b8ce2d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:32.244145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533293-6482-49e3-992b-c70387c38fd6 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:32.262153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04533293-6482-49e3-992b-c70387c38fd6 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:32.341311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:32.342665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:32.343538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:32.343937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] PATH_INFO: `/v3/projects/6a99042a0a384a1489b1c4dd7942d30a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:32.345552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a99042a0a384a1489b1c4dd7942d30a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:32.347927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:32.402186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a99042a0a384a1489b1c4dd7942d30a', 'request_id': 'req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:32.410988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a99042a0a384a1489b1c4dd7942d30a', 'request_id': 'req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:32.422313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a99042a0a384a1489b1c4dd7942d30a', 'request_id': 'req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:32.435432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] The token cache is being invalidate because project 6a99042a0a384a1489b1c4dd7942d30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:14:32.435745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:32.436805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:32.438433 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3704/7382] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:14:32 2021] DELETE /identity/v3/projects/6a99042a0a384a1489b1c4dd7942d30a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:32.442452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:32.444226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:32.495325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d652560-643a-4cd7-a679-69b2157da539 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:32.601319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f858f-e01e-418c-ad92-2bcee76359f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:32.603135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f858f-e01e-418c-ad92-2bcee76359f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:32.603678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f858f-e01e-418c-ad92-2bcee76359f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:32.604456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f858f-e01e-418c-ad92-2bcee76359f2 admin admin] PATH_INFO: `/v3/users/68af5d383d4149a89a0f87bdb735ccea` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:32.605973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f858f-e01e-418c-ad92-2bcee76359f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68af5d383d4149a89a0f87bdb735ccea)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:32.608913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f858f-e01e-418c-ad92-2bcee76359f2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:32.674864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c8f858f-e01e-418c-ad92-2bcee76359f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68af5d383d4149a89a0f87bdb735ccea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:32.675811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c8f858f-e01e-418c-ad92-2bcee76359f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68af5d383d4149a89a0f87bdb735ccea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:32.686302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c8f858f-e01e-418c-ad92-2bcee76359f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68af5d383d4149a89a0f87bdb735ccea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:32.687956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c8f858f-e01e-418c-ad92-2bcee76359f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68af5d383d4149a89a0f87bdb735ccea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:32.697871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2c8f858f-e01e-418c-ad92-2bcee76359f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68af5d383d4149a89a0f87bdb735ccea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:32.719299 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3679/7383] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:14:32 2021] DELETE /identity/v3/users/68af5d383d4149a89a0f87bdb735ccea => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:33.050126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:33.052215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:33.082815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa27e2a-1ab0-4253-9aea-15eb1e8ed755 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:33.262234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:33.264621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:33.265565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:33.266197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] PATH_INFO: `/v3/projects/0aefc004229844399f063a911bcc05b7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:33.268909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aefc004229844399f063a911bcc05b7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:33.271926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:33.360940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aefc004229844399f063a911bcc05b7', 'request_id': 'req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:33.377438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aefc004229844399f063a911bcc05b7', 'request_id': 'req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:33.388693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aefc004229844399f063a911bcc05b7', 'request_id': 'req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:33.401185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] The token cache is being invalidate because project 0aefc004229844399f063a911bcc05b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:14:33.401791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:33.402818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:14:33.404851 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3705/7384] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:14:33 2021] DELETE /identity/v3/projects/0aefc004229844399f063a911bcc05b7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:14:40.639050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6cf36-11e8-4560-94b5-1829e829e552 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:40.639719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6cf36-11e8-4560-94b5-1829e829e552 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:40.639927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6cf36-11e8-4560-94b5-1829e829e552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:40.658239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-afd6cf36-11e8-4560-94b5-1829e829e552 None None] MFA Rules not processed for user `43d9798c04074bc9ac45eb33bf3adb46`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:40.659512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-afd6cf36-11e8-4560-94b5-1829e829e552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:40.712183 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3680/7385] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:40 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:14:40.975610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:14:40.977002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:41.034073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349d0d6-e746-4aa5-a1ef-4a9e06836b3c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:14:41.037627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990023f1-083f-4db9-bd1f-aee03f1b0024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:14:41.038258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990023f1-083f-4db9-bd1f-aee03f1b0024 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:41.038540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990023f1-083f-4db9-bd1f-aee03f1b0024 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:41.038813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990023f1-083f-4db9-bd1f-aee03f1b0024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:41.040555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-990023f1-083f-4db9-bd1f-aee03f1b0024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:41.052556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990023f1-083f-4db9-bd1f-aee03f1b0024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:14:41.053965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990023f1-083f-4db9-bd1f-aee03f1b0024 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:14:41.065660 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3706/7386] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:14:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:14:53.459541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154112b-c637-44e3-80e9-ca3b0d421924 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:14:53.460090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154112b-c637-44e3-80e9-ca3b0d421924 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:14:53.460207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154112b-c637-44e3-80e9-ca3b0d421924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:14:53.480351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e154112b-c637-44e3-80e9-ca3b0d421924 None None] MFA Rules not processed for user `43d9798c04074bc9ac45eb33bf3adb46`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:14:53.481530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e154112b-c637-44e3-80e9-ca3b0d421924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:14:53.488520 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3681/7387] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:14:53 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:15:11.383940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832ee6-1a22-44f2-86b5-c02245734271 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:11.384473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832ee6-1a22-44f2-86b5-c02245734271 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:11.384682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832ee6-1a22-44f2-86b5-c02245734271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:11.403379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-76832ee6-1a22-44f2-86b5-c02245734271 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:15:11.404574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-76832ee6-1a22-44f2-86b5-c02245734271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:11.460561 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3707/7388] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:15:11 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:15:11.507305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154112b-c637-44e3-80e9-ca3b0d421924 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:15:11.508729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e154112b-c637-44e3-80e9-ca3b0d421924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:11.577800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154112b-c637-44e3-80e9-ca3b0d421924 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:15:11.582610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a4eb-a3fc-47db-9e57-53c41cede427 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:15:11.583327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a4eb-a3fc-47db-9e57-53c41cede427 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:11.583573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a4eb-a3fc-47db-9e57-53c41cede427 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:11.583846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4a4eb-a3fc-47db-9e57-53c41cede427 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:11.591821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4a4eb-a3fc-47db-9e57-53c41cede427 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:15:11.593403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4a4eb-a3fc-47db-9e57-53c41cede427 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:15:11.601257 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3682/7389] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:15:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:15:37.201447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832ee6-1a22-44f2-86b5-c02245734271 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:15:37.202958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-76832ee6-1a22-44f2-86b5-c02245734271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:37.225053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832ee6-1a22-44f2-86b5-c02245734271 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:15:37.229137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c5562-d18b-454c-ba45-20230dfa304b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:15:37.229785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c5562-d18b-454c-ba45-20230dfa304b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:37.230042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c5562-d18b-454c-ba45-20230dfa304b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:37.230314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c5562-d18b-454c-ba45-20230dfa304b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:37.232052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e58c5562-d18b-454c-ba45-20230dfa304b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:37.301875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c5562-d18b-454c-ba45-20230dfa304b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:15:37.303324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c5562-d18b-454c-ba45-20230dfa304b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:15:37.325564 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3708/7390] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:15:37 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:15:39.208865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a4eb-a3fc-47db-9e57-53c41cede427 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:15:39.221498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4a4eb-a3fc-47db-9e57-53c41cede427 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:15:39.225156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493833-2d14-48b6-9f22-099052d77801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:15:39.225785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493833-2d14-48b6-9f22-099052d77801 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:39.226068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493833-2d14-48b6-9f22-099052d77801 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:39.226344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493833-2d14-48b6-9f22-099052d77801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:39.228145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dd493833-2d14-48b6-9f22-099052d77801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:39.244892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd493833-2d14-48b6-9f22-099052d77801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:15:39.246406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd493833-2d14-48b6-9f22-099052d77801 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:15:39.260748 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3683/7391] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:15:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:15:42.036675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286e65-425c-4ad9-b125-549a0d7fcc94 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:42.037138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286e65-425c-4ad9-b125-549a0d7fcc94 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:42.037252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286e65-425c-4ad9-b125-549a0d7fcc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:42.054746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7a286e65-425c-4ad9-b125-549a0d7fcc94 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:15:42.055973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7a286e65-425c-4ad9-b125-549a0d7fcc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:42.063693 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3709/7392] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:15:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:15:42.076985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493833-2d14-48b6-9f22-099052d77801 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:15:42.090346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493833-2d14-48b6-9f22-099052d77801 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:15:42.095453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e053227-c2f9-4abe-85e7-d86c23fb299c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:15:42.096095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e053227-c2f9-4abe-85e7-d86c23fb299c service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:42.096379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e053227-c2f9-4abe-85e7-d86c23fb299c service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:42.096656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e053227-c2f9-4abe-85e7-d86c23fb299c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:42.104853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e053227-c2f9-4abe-85e7-d86c23fb299c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:15:42.106429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e053227-c2f9-4abe-85e7-d86c23fb299c service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:15:42.114422 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3684/7393] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:15:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:15:42.947908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a286e65-425c-4ad9-b125-549a0d7fcc94 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:15:42.949315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7a286e65-425c-4ad9-b125-549a0d7fcc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:43.036719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a286e65-425c-4ad9-b125-549a0d7fcc94 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:15:43.043024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb8e29-c643-4315-9e84-fba363cb6816 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:15:43.043738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb8e29-c643-4315-9e84-fba363cb6816 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:43.044022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb8e29-c643-4315-9e84-fba363cb6816 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:43.044302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb8e29-c643-4315-9e84-fba363cb6816 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:43.046145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b7eb8e29-c643-4315-9e84-fba363cb6816 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:43.059745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb8e29-c643-4315-9e84-fba363cb6816 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:15:43.061811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb8e29-c643-4315-9e84-fba363cb6816 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:15:43.072618 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3710/7394] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:15:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:15:58.401843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e053227-c2f9-4abe-85e7-d86c23fb299c service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:15:58.414414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e053227-c2f9-4abe-85e7-d86c23fb299c service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:15:58.418008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611b3b3-3e0b-4330-a76a-186e3019db81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:15:58.418646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b3b3-3e0b-4330-a76a-186e3019db81 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:58.418930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b3b3-3e0b-4330-a76a-186e3019db81 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:58.419199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b3b3-3e0b-4330-a76a-186e3019db81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:58.421679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9611b3b3-3e0b-4330-a76a-186e3019db81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:58.503795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611b3b3-3e0b-4330-a76a-186e3019db81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:15:58.505242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611b3b3-3e0b-4330-a76a-186e3019db81 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:15:58.524654 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3685/7395] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:15:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:15:59.381647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68549140-48fd-4006-af40-115271572de5 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:59.382317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68549140-48fd-4006-af40-115271572de5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:59.382317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68549140-48fd-4006-af40-115271572de5 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:59.384312 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3711/7396] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 21:15:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:15:59.390305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad95b9-6701-427e-bc7f-746cd147e855 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:59.390595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad95b9-6701-427e-bc7f-746cd147e855 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:59.390873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad95b9-6701-427e-bc7f-746cd147e855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:59.409397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-61ad95b9-6701-427e-bc7f-746cd147e855 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:15:59.410635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-61ad95b9-6701-427e-bc7f-746cd147e855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:59.419195 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3686/7397] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:15:59 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:15:59.444309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68549140-48fd-4006-af40-115271572de5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:15:59.461055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68549140-48fd-4006-af40-115271572de5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:15:59.472251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96187abb-28c5-47e4-8a06-be3e19b8c74d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:15:59.473406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96187abb-28c5-47e4-8a06-be3e19b8c74d service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:59.474142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96187abb-28c5-47e4-8a06-be3e19b8c74d service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:59.474142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96187abb-28c5-47e4-8a06-be3e19b8c74d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:59.483821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96187abb-28c5-47e4-8a06-be3e19b8c74d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:15:59.485449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96187abb-28c5-47e4-8a06-be3e19b8c74d service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:15:59.496359 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3712/7398] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:15:59 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:15:59.707601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad95b9-6701-427e-bc7f-746cd147e855 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:15:59.723283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad95b9-6701-427e-bc7f-746cd147e855 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:15:59.732354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af33d79-9bf4-437c-97d3-91be5f059ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:15:59.733389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33d79-9bf4-437c-97d3-91be5f059ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:59.733672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33d79-9bf4-437c-97d3-91be5f059ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:59.733936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af33d79-9bf4-437c-97d3-91be5f059ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:59.735986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0af33d79-9bf4-437c-97d3-91be5f059ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:59.751058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af33d79-9bf4-437c-97d3-91be5f059ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:15:59.752826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af33d79-9bf4-437c-97d3-91be5f059ca6 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:15:59.765211 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3687/7399] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:15:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:15:59.880964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d6698-e8a8-4b17-9dc6-4d7dd8fee927 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:59.881249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d6698-e8a8-4b17-9dc6-4d7dd8fee927 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:59.881518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d6698-e8a8-4b17-9dc6-4d7dd8fee927 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:59.883311 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3713/7400] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 21:15:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:15:59.888765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e406af8-2137-4ede-846f-c9e3e3aed58f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:59.889059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e406af8-2137-4ede-846f-c9e3e3aed58f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:59.889340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e406af8-2137-4ede-846f-c9e3e3aed58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:59.908073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6e406af8-2137-4ede-846f-c9e3e3aed58f None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:15:59.909284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6e406af8-2137-4ede-846f-c9e3e3aed58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:15:59.917976 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3688/7401] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:15:59 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:15:59.939746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d6698-e8a8-4b17-9dc6-4d7dd8fee927 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:15:59.955579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d6698-e8a8-4b17-9dc6-4d7dd8fee927 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:15:59.960686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5aac0-5e55-425b-bf65-7886c9f13ce2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:15:59.961392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5aac0-5e55-425b-bf65-7886c9f13ce2 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:15:59.961749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5aac0-5e55-425b-bf65-7886c9f13ce2 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:15:59.962097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5aac0-5e55-425b-bf65-7886c9f13ce2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:15:59.971218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5aac0-5e55-425b-bf65-7886c9f13ce2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:15:59.972868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5aac0-5e55-425b-bf65-7886c9f13ce2 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:15:59.983563 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3714/7402] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:15:59 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:16:02.430461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e406af8-2137-4ede-846f-c9e3e3aed58f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:02.431949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6e406af8-2137-4ede-846f-c9e3e3aed58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:02.451108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e406af8-2137-4ede-846f-c9e3e3aed58f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:02.455908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5db6c9-c3c3-4726-95ab-1f8b8562c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:02.456868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5db6c9-c3c3-4726-95ab-1f8b8562c0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:02.457213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5db6c9-c3c3-4726-95ab-1f8b8562c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:02.457554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5db6c9-c3c3-4726-95ab-1f8b8562c0af admin admin] PATH_INFO: `/v3/users/43d9798c04074bc9ac45eb33bf3adb46` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:02.458813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5db6c9-c3c3-4726-95ab-1f8b8562c0af admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d9798c04074bc9ac45eb33bf3adb46)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:02.461440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5db6c9-c3c3-4726-95ab-1f8b8562c0af admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:02.508037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5d5db6c9-c3c3-4726-95ab-1f8b8562c0af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d9798c04074bc9ac45eb33bf3adb46'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:02.508705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5d5db6c9-c3c3-4726-95ab-1f8b8562c0af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d9798c04074bc9ac45eb33bf3adb46'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:02.517023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5d5db6c9-c3c3-4726-95ab-1f8b8562c0af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d9798c04074bc9ac45eb33bf3adb46'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:02.517833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5d5db6c9-c3c3-4726-95ab-1f8b8562c0af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d9798c04074bc9ac45eb33bf3adb46'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:02.525468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5d5db6c9-c3c3-4726-95ab-1f8b8562c0af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d9798c04074bc9ac45eb33bf3adb46'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:02.545668 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3689/7403] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:16:02 2021] DELETE /identity/v3/users/43d9798c04074bc9ac45eb33bf3adb46 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:16:02.711150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5aac0-5e55-425b-bf65-7886c9f13ce2 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:02.722604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5aac0-5e55-425b-bf65-7886c9f13ce2 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:02.778135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:02.778987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:02.779300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:02.779583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] PATH_INFO: `/v3/projects/4c38c1fb709545fbb6279c9ee1dafe5d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:02.780775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c38c1fb709545fbb6279c9ee1dafe5d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:02.782673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:02.827503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c38c1fb709545fbb6279c9ee1dafe5d', 'request_id': 'req-8c9a2e2a-8dbc-4749-963c-976275d9e517'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:02.834458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c38c1fb709545fbb6279c9ee1dafe5d', 'request_id': 'req-8c9a2e2a-8dbc-4749-963c-976275d9e517'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:02.840632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c38c1fb709545fbb6279c9ee1dafe5d', 'request_id': 'req-8c9a2e2a-8dbc-4749-963c-976275d9e517'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:02.850484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] The token cache is being invalidate because project 4c38c1fb709545fbb6279c9ee1dafe5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:16:02.850777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:02.851486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8c9a2e2a-8dbc-4749-963c-976275d9e517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:02.853146 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3715/7404] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:16:02 2021] DELETE /identity/v3/projects/4c38c1fb709545fbb6279c9ee1dafe5d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:16:02.859220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820e57-c9d3-4a5f-98f0-67f1a079f9e3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:02.859767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820e57-c9d3-4a5f-98f0-67f1a079f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:02.860019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820e57-c9d3-4a5f-98f0-67f1a079f9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:02.879408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-98820e57-c9d3-4a5f-98f0-67f1a079f9e3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:02.880604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-98820e57-c9d3-4a5f-98f0-67f1a079f9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:02.940591 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3690/7405] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:02.948306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0c249-8749-4c8d-ae22-600a8135da77 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:02.948592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0c249-8749-4c8d-ae22-600a8135da77 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:02.948867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0c249-8749-4c8d-ae22-600a8135da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:02.967843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-60d0c249-8749-4c8d-ae22-600a8135da77 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:02.969040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-60d0c249-8749-4c8d-ae22-600a8135da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:02.978633 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3716/7406] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:02.983571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98820e57-c9d3-4a5f-98f0-67f1a079f9e3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:02.993559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98820e57-c9d3-4a5f-98f0-67f1a079f9e3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:02.998228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044735-f018-48fd-9cad-45478adce2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:02.998876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044735-f018-48fd-9cad-45478adce2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:02.999162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044735-f018-48fd-9cad-45478adce2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:02.999475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044735-f018-48fd-9cad-45478adce2d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:03.000213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044735-f018-48fd-9cad-45478adce2d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:16:03.000523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044735-f018-48fd-9cad-45478adce2d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:03.002124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044735-f018-48fd-9cad-45478adce2d8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:03.013346 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3691/7407] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:16:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:16:03.017561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0c249-8749-4c8d-ae22-600a8135da77 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:03.026708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0c249-8749-4c8d-ae22-600a8135da77 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:03.031844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8d4d0-e981-4e9a-b39f-696c1c9b233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:03.032479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8d4d0-e981-4e9a-b39f-696c1c9b233d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:03.032759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8d4d0-e981-4e9a-b39f-696c1c9b233d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:03.033031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8d4d0-e981-4e9a-b39f-696c1c9b233d admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:03.033753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8d4d0-e981-4e9a-b39f-696c1c9b233d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:03.035655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8d4d0-e981-4e9a-b39f-696c1c9b233d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:03.060703 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3717/7408] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:16:03 2021] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:16:03.065567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044735-f018-48fd-9cad-45478adce2d8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:03.075663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044735-f018-48fd-9cad-45478adce2d8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:03.130994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b341-3e21-49a6-8daf-e904404d8f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:03.131611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b341-3e21-49a6-8daf-e904404d8f70 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:03.131894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b341-3e21-49a6-8daf-e904404d8f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:03.132166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b341-3e21-49a6-8daf-e904404d8f70 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:03.132847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621b341-3e21-49a6-8daf-e904404d8f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:03.134758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621b341-3e21-49a6-8daf-e904404d8f70 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:03.153303 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3692/7409] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:16:03 2021] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:16:03.158029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8d4d0-e981-4e9a-b39f-696c1c9b233d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:03.168064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8d4d0-e981-4e9a-b39f-696c1c9b233d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:03.173194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b31931-8a7b-4ade-8cd2-bb53186cbea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:03.173837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b31931-8a7b-4ade-8cd2-bb53186cbea0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:03.174120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b31931-8a7b-4ade-8cd2-bb53186cbea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:03.174393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b31931-8a7b-4ade-8cd2-bb53186cbea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:03.175149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b31931-8a7b-4ade-8cd2-bb53186cbea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:03.176740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b31931-8a7b-4ade-8cd2-bb53186cbea0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:03.186807 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3718/7410] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:16:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:16:03.190708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b341-3e21-49a6-8daf-e904404d8f70 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:03.200578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b341-3e21-49a6-8daf-e904404d8f70 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:03.205161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bda9a1-7eb5-480f-8243-adae88cdbf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:03.205807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bda9a1-7eb5-480f-8243-adae88cdbf8b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:03.206091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bda9a1-7eb5-480f-8243-adae88cdbf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:03.206369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bda9a1-7eb5-480f-8243-adae88cdbf8b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:03.207095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bda9a1-7eb5-480f-8243-adae88cdbf8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:03.208728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bda9a1-7eb5-480f-8243-adae88cdbf8b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:03.218897 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3693/7411] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:16:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:16:03.222725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b31931-8a7b-4ade-8cd2-bb53186cbea0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:03.233234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b31931-8a7b-4ade-8cd2-bb53186cbea0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:03.237892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec226d3-f422-48a8-85b3-8b0fe75be610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:03.238753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec226d3-f422-48a8-85b3-8b0fe75be610 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:03.239035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec226d3-f422-48a8-85b3-8b0fe75be610 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:03.239345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec226d3-f422-48a8-85b3-8b0fe75be610 admin admin] PATH_INFO: `/v3/projects/69498babf76b4a11b6e2c434cacd824d/users/71e3a17892634c79a907df7413c02684/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:03.253433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec226d3-f422-48a8-85b3-8b0fe75be610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69498babf76b4a11b6e2c434cacd824d, user_id=71e3a17892634c79a907df7413c02684, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:03.256109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec226d3-f422-48a8-85b3-8b0fe75be610 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:03.268741 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3719/7412] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:16:03 2021] PUT /identity/v3/projects/69498babf76b4a11b6e2c434cacd824d/users/71e3a17892634c79a907df7413c02684/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:16:03.273781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de3f7-6e57-40c7-a4a4-cd6b8d0e6ecd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:03.274074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de3f7-6e57-40c7-a4a4-cd6b8d0e6ecd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:03.274381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de3f7-6e57-40c7-a4a4-cd6b8d0e6ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:03.293162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f91de3f7-6e57-40c7-a4a4-cd6b8d0e6ecd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:03.294979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f91de3f7-6e57-40c7-a4a4-cd6b8d0e6ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:03.358365 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3694/7413] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:03.366281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec226d3-f422-48a8-85b3-8b0fe75be610 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:03.368030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6ec226d3-f422-48a8-85b3-8b0fe75be610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:03.431623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec226d3-f422-48a8-85b3-8b0fe75be610 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:03.436279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c71da-dc41-4b0e-9914-f5c632ea5d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:03.436977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c71da-dc41-4b0e-9914-f5c632ea5d0a service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:03.437333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c71da-dc41-4b0e-9914-f5c632ea5d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:03.437611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c71da-dc41-4b0e-9914-f5c632ea5d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:03.452439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c71da-dc41-4b0e-9914-f5c632ea5d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:03.453894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c71da-dc41-4b0e-9914-f5c632ea5d0a service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:03.463678 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3720/7414] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:16:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:16:04.164579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56728d2-88a6-493d-9771-fb4b12236f00 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:04.165127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56728d2-88a6-493d-9771-fb4b12236f00 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:04.165127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56728d2-88a6-493d-9771-fb4b12236f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:04.191355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b56728d2-88a6-493d-9771-fb4b12236f00 None None] MFA Rules not processed for user `71e3a17892634c79a907df7413c02684`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:04.192579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b56728d2-88a6-493d-9771-fb4b12236f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:04.256047 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3695/7415] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:04 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:04.269042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81267a93-8646-4ee2-b26c-a7877f235084 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:04.269577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81267a93-8646-4ee2-b26c-a7877f235084 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:04.269753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81267a93-8646-4ee2-b26c-a7877f235084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:04.288107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-81267a93-8646-4ee2-b26c-a7877f235084 None None] MFA Rules not processed for user `71e3a17892634c79a907df7413c02684`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:04.289316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-81267a93-8646-4ee2-b26c-a7877f235084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:04.297012 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3721/7416] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:04 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:04.310624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56728d2-88a6-493d-9771-fb4b12236f00 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:04.312062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b56728d2-88a6-493d-9771-fb4b12236f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:04.393058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56728d2-88a6-493d-9771-fb4b12236f00 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:04.399643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff778a0b-7761-4332-af18-69a5a1ef8dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:04.400237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff778a0b-7761-4332-af18-69a5a1ef8dcc service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:04.400512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff778a0b-7761-4332-af18-69a5a1ef8dcc service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:04.400784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff778a0b-7761-4332-af18-69a5a1ef8dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:04.409538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff778a0b-7761-4332-af18-69a5a1ef8dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:04.411131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff778a0b-7761-4332-af18-69a5a1ef8dcc service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:04.420607 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3696/7417] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:16:04 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:16:15.639562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49848-41f3-47dc-aa06-2922d471780c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:15.640166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49848-41f3-47dc-aa06-2922d471780c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:15.640166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49848-41f3-47dc-aa06-2922d471780c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:15.667614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-58a49848-41f3-47dc-aa06-2922d471780c None None] MFA Rules not processed for user `71e3a17892634c79a907df7413c02684`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:15.668854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-58a49848-41f3-47dc-aa06-2922d471780c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:15.692439 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3722/7418] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:15 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:15.741633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b15f1-918c-4111-866a-304329d6d217 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:15.742214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b15f1-918c-4111-866a-304329d6d217 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:15.742477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b15f1-918c-4111-866a-304329d6d217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:15.759690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-bd4b15f1-918c-4111-866a-304329d6d217 None None] MFA Rules not processed for user `71e3a17892634c79a907df7413c02684`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:15.760885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bd4b15f1-918c-4111-866a-304329d6d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:15.769165 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3697/7419] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:15 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:15.790691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a59a15-9a41-4d6b-815d-c19553c18879 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:15.790981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a59a15-9a41-4d6b-815d-c19553c18879 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:15.791297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a59a15-9a41-4d6b-815d-c19553c18879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:15.812985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a3a59a15-9a41-4d6b-815d-c19553c18879 None None] MFA Rules not processed for user `71e3a17892634c79a907df7413c02684`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:15.814203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a3a59a15-9a41-4d6b-815d-c19553c18879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:15.821293 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3723/7420] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:15 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:16:15.843229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922395a6-7941-47a4-af4f-56fc377ad615 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:15.843551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922395a6-7941-47a4-af4f-56fc377ad615 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:15.843832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922395a6-7941-47a4-af4f-56fc377ad615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:15.861106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-922395a6-7941-47a4-af4f-56fc377ad615 None None] MFA Rules not processed for user `71e3a17892634c79a907df7413c02684`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:15.862319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-922395a6-7941-47a4-af4f-56fc377ad615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:15.869421 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3698/7421] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:15 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:15.890732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c074-28ed-44e8-8f94-c2d5376f2f2f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:15.891021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c074-28ed-44e8-8f94-c2d5376f2f2f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:15.891365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921c074-28ed-44e8-8f94-c2d5376f2f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:15.908602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7921c074-28ed-44e8-8f94-c2d5376f2f2f None None] MFA Rules not processed for user `71e3a17892634c79a907df7413c02684`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:15.909787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7921c074-28ed-44e8-8f94-c2d5376f2f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:15.916784 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3724/7422] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:15 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:19.307328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922395a6-7941-47a4-af4f-56fc377ad615 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:19.327109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922395a6-7941-47a4-af4f-56fc377ad615 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:19.332333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84e463-eced-4da5-adcb-7d259256be32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:19.333256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84e463-eced-4da5-adcb-7d259256be32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:19.333566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84e463-eced-4da5-adcb-7d259256be32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:19.333842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84e463-eced-4da5-adcb-7d259256be32 admin admin] PATH_INFO: `/v3/users/71e3a17892634c79a907df7413c02684` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:19.335180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84e463-eced-4da5-adcb-7d259256be32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e3a17892634c79a907df7413c02684)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:19.337172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84e463-eced-4da5-adcb-7d259256be32 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:19.384523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b84e463-eced-4da5-adcb-7d259256be32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e3a17892634c79a907df7413c02684'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:19.385221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b84e463-eced-4da5-adcb-7d259256be32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e3a17892634c79a907df7413c02684'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:19.392918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b84e463-eced-4da5-adcb-7d259256be32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e3a17892634c79a907df7413c02684'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:19.393584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b84e463-eced-4da5-adcb-7d259256be32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e3a17892634c79a907df7413c02684'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:19.403415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9b84e463-eced-4da5-adcb-7d259256be32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e3a17892634c79a907df7413c02684'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:19.423177 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3699/7423] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:16:19 2021] DELETE /identity/v3/users/71e3a17892634c79a907df7413c02684 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:16:19.603236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921c074-28ed-44e8-8f94-c2d5376f2f2f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:19.619719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921c074-28ed-44e8-8f94-c2d5376f2f2f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:19.712762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:19.713815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:19.714175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:19.714451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] PATH_INFO: `/v3/projects/69498babf76b4a11b6e2c434cacd824d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:19.715864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69498babf76b4a11b6e2c434cacd824d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:19.717816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:19.766397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69498babf76b4a11b6e2c434cacd824d', 'request_id': 'req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:19.779215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69498babf76b4a11b6e2c434cacd824d', 'request_id': 'req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:19.789553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69498babf76b4a11b6e2c434cacd824d', 'request_id': 'req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:19.816315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] The token cache is being invalidate because project 69498babf76b4a11b6e2c434cacd824d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:16:19.816607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:19.817239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e65b6a3e-e885-430d-b7ee-a8b3c4edb6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:16:19.818835 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3725/7424] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:16:19 2021] DELETE /identity/v3/projects/69498babf76b4a11b6e2c434cacd824d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:16:19.825618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ca69-09fa-4532-904c-98274aca8027 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:19.826153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ca69-09fa-4532-904c-98274aca8027 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:19.826435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ca69-09fa-4532-904c-98274aca8027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:19.846391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f993ca69-09fa-4532-904c-98274aca8027 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:19.847666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f993ca69-09fa-4532-904c-98274aca8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:19.908394 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3700/7425] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:19.917701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef416799-d429-4576-a370-1dc360164c74 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:19.917990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef416799-d429-4576-a370-1dc360164c74 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:19.918772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef416799-d429-4576-a370-1dc360164c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:19.937940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ef416799-d429-4576-a370-1dc360164c74 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:19.939135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ef416799-d429-4576-a370-1dc360164c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:19.946958 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3726/7426] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:16:19.951067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993ca69-09fa-4532-904c-98274aca8027 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:19.960681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993ca69-09fa-4532-904c-98274aca8027 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:19.965151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0af19d-dedb-4d27-854c-587f2d8ab784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:19.965810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af19d-dedb-4d27-854c-587f2d8ab784 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:19.966088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af19d-dedb-4d27-854c-587f2d8ab784 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:19.966357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0af19d-dedb-4d27-854c-587f2d8ab784 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:19.967079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0af19d-dedb-4d27-854c-587f2d8ab784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:16:19.967420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0af19d-dedb-4d27-854c-587f2d8ab784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:19.968996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0af19d-dedb-4d27-854c-587f2d8ab784 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:19.980109 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3701/7427] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:16:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:16:19.984592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef416799-d429-4576-a370-1dc360164c74 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:19.993940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef416799-d429-4576-a370-1dc360164c74 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:19.999741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1210-ffa9-4f2c-b1e5-3fbe97ced4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:20.000535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1210-ffa9-4f2c-b1e5-3fbe97ced4be admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:20.000823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1210-ffa9-4f2c-b1e5-3fbe97ced4be admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:20.001099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1210-ffa9-4f2c-b1e5-3fbe97ced4be admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:20.001798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c1210-ffa9-4f2c-b1e5-3fbe97ced4be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:20.003706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c1210-ffa9-4f2c-b1e5-3fbe97ced4be admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:20.028506 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3727/7428] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:16:19 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:16:20.032668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0af19d-dedb-4d27-854c-587f2d8ab784 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:20.042424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0af19d-dedb-4d27-854c-587f2d8ab784 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:20.097012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89a6ee-0ede-4905-ba68-83607969c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:20.097667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89a6ee-0ede-4905-ba68-83607969c29c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:20.097945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89a6ee-0ede-4905-ba68-83607969c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:20.098215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89a6ee-0ede-4905-ba68-83607969c29c admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:20.098903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89a6ee-0ede-4905-ba68-83607969c29c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:20.100827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89a6ee-0ede-4905-ba68-83607969c29c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:20.120310 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3702/7429] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:16:20 2021] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:16:20.125044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1210-ffa9-4f2c-b1e5-3fbe97ced4be admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:20.135907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1210-ffa9-4f2c-b1e5-3fbe97ced4be admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:20.140661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158bed8-2bbf-4726-bd61-93e17c661842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:20.141314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158bed8-2bbf-4726-bd61-93e17c661842 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:20.141598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158bed8-2bbf-4726-bd61-93e17c661842 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:20.141874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158bed8-2bbf-4726-bd61-93e17c661842 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:20.142608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158bed8-2bbf-4726-bd61-93e17c661842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:20.144235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158bed8-2bbf-4726-bd61-93e17c661842 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:20.155199 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3728/7430] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:16:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:16:20.158944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89a6ee-0ede-4905-ba68-83607969c29c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:20.169293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89a6ee-0ede-4905-ba68-83607969c29c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:20.174164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753e27d-bb28-49b8-9c68-7f2fad45ad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:20.174811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753e27d-bb28-49b8-9c68-7f2fad45ad5f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:20.175094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753e27d-bb28-49b8-9c68-7f2fad45ad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:20.175406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753e27d-bb28-49b8-9c68-7f2fad45ad5f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:20.176135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753e27d-bb28-49b8-9c68-7f2fad45ad5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:20.177719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753e27d-bb28-49b8-9c68-7f2fad45ad5f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:20.187367 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3703/7431] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:16:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:16:20.191322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158bed8-2bbf-4726-bd61-93e17c661842 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:20.201202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158bed8-2bbf-4726-bd61-93e17c661842 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:20.207405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ed096-dc21-4add-b16c-9269fa7ff3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:20.208365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ed096-dc21-4add-b16c-9269fa7ff3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:20.209872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ed096-dc21-4add-b16c-9269fa7ff3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:20.209872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ed096-dc21-4add-b16c-9269fa7ff3ca admin admin] PATH_INFO: `/v3/projects/038952e512e24ad48321d19c3748ea74/users/f566d48105db4beeac8d39a5a03519a6/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:20.225402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ed096-dc21-4add-b16c-9269fa7ff3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=038952e512e24ad48321d19c3748ea74, user_id=f566d48105db4beeac8d39a5a03519a6, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:20.228386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ed096-dc21-4add-b16c-9269fa7ff3ca admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:20.245542 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3729/7432] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:16:20 2021] PUT /identity/v3/projects/038952e512e24ad48321d19c3748ea74/users/f566d48105db4beeac8d39a5a03519a6/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:16:20.255530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3285-fb01-4c41-82e0-2807f86b5355 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:20.255823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3285-fb01-4c41-82e0-2807f86b5355 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:20.256105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3285-fb01-4c41-82e0-2807f86b5355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:20.284326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f57b3285-fb01-4c41-82e0-2807f86b5355 None None] MFA Rules not processed for user `f566d48105db4beeac8d39a5a03519a6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:20.285600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f57b3285-fb01-4c41-82e0-2807f86b5355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:20.370922 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3704/7433] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:20 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:16:20.375332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e4f7-a304-4cf5-ba7d-65bc8397c64a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:20.375629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e4f7-a304-4cf5-ba7d-65bc8397c64a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:20.375911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90e4f7-a304-4cf5-ba7d-65bc8397c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:20.419153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ed90e4f7-a304-4cf5-ba7d-65bc8397c64a None None] MFA Rules not processed for user `f566d48105db4beeac8d39a5a03519a6`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:20.420485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ed90e4f7-a304-4cf5-ba7d-65bc8397c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:20.447300 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3730/7434] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:20 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:20.455113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b3285-fb01-4c41-82e0-2807f86b5355 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:20.456898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f57b3285-fb01-4c41-82e0-2807f86b5355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:20.550954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b3285-fb01-4c41-82e0-2807f86b5355 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:20.556487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a7ab9-4148-4262-ba6c-de34fdcf7ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:20.557127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7ab9-4148-4262-ba6c-de34fdcf7ae5 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:20.557413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7ab9-4148-4262-ba6c-de34fdcf7ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:20.557710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7ab9-4148-4262-ba6c-de34fdcf7ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:20.566059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a7ab9-4148-4262-ba6c-de34fdcf7ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:20.567722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a7ab9-4148-4262-ba6c-de34fdcf7ae5 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:20.576546 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3705/7435] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:16:20 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:16:20.902444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1bedb-3ae1-4f2f-a8cd-bec4b9b373ad None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:20.903497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1bedb-3ae1-4f2f-a8cd-bec4b9b373ad None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:20.903613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1bedb-3ae1-4f2f-a8cd-bec4b9b373ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:20.923503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-89e1bedb-3ae1-4f2f-a8cd-bec4b9b373ad None None] MFA Rules not processed for user `f566d48105db4beeac8d39a5a03519a6`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:16:20.924810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-89e1bedb-3ae1-4f2f-a8cd-bec4b9b373ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:20.931896 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3731/7436] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:16:20 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:16:46.065197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a7ab9-4148-4262-ba6c-de34fdcf7ae5 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:46.066718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e21a7ab9-4148-4262-ba6c-de34fdcf7ae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:46.149017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a7ab9-4148-4262-ba6c-de34fdcf7ae5 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:46.153644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715cc1-b7f8-4042-849a-d37fc97ecd3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:46.154400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715cc1-b7f8-4042-849a-d37fc97ecd3c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:46.154690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715cc1-b7f8-4042-849a-d37fc97ecd3c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:46.155107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715cc1-b7f8-4042-849a-d37fc97ecd3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:46.157242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3b715cc1-b7f8-4042-849a-d37fc97ecd3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:46.169204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715cc1-b7f8-4042-849a-d37fc97ecd3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:46.170641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715cc1-b7f8-4042-849a-d37fc97ecd3c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:46.180604 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3706/7437] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:16:46 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:16:56.237923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1bedb-3ae1-4f2f-a8cd-bec4b9b373ad None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:16:56.261153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1bedb-3ae1-4f2f-a8cd-bec4b9b373ad None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:16:56.266963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c54e1-42b2-4af3-b370-d2beb1f93ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:16:56.267669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c54e1-42b2-4af3-b370-d2beb1f93ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:16:56.267955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c54e1-42b2-4af3-b370-d2beb1f93ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:16:56.268231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c54e1-42b2-4af3-b370-d2beb1f93ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:16:56.270322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f03c54e1-42b2-4af3-b370-d2beb1f93ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:16:56.285414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c54e1-42b2-4af3-b370-d2beb1f93ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:16:56.286977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c54e1-42b2-4af3-b370-d2beb1f93ee7 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:16:56.299891 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3732/7438] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:16:56 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:05.581114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715cc1-b7f8-4042-849a-d37fc97ecd3c service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:05.651282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715cc1-b7f8-4042-849a-d37fc97ecd3c service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:05.656097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e0b74-d9b0-4dd7-b716-71be23168869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:05.657071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e0b74-d9b0-4dd7-b716-71be23168869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:05.657236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e0b74-d9b0-4dd7-b716-71be23168869 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:05.657511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e0b74-d9b0-4dd7-b716-71be23168869 admin admin] PATH_INFO: `/v3/users/f566d48105db4beeac8d39a5a03519a6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:05.658772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e0b74-d9b0-4dd7-b716-71be23168869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f566d48105db4beeac8d39a5a03519a6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:05.660789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e0b74-d9b0-4dd7-b716-71be23168869 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:05.674779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf1eed-0674-4d12-b0cd-0f02d00d1a2f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:05.675541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf1eed-0674-4d12-b0cd-0f02d00d1a2f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:05.675916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf1eed-0674-4d12-b0cd-0f02d00d1a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:05.698248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-afaf1eed-0674-4d12-b0cd-0f02d00d1a2f None None] MFA Rules not processed for user `98c4fe50315d4fc0b0329e80802eee86`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:05.700209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-afaf1eed-0674-4d12-b0cd-0f02d00d1a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:05.735055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-383e0b74-d9b0-4dd7-b716-71be23168869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f566d48105db4beeac8d39a5a03519a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:05.735768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-383e0b74-d9b0-4dd7-b716-71be23168869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f566d48105db4beeac8d39a5a03519a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:05.747568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-383e0b74-d9b0-4dd7-b716-71be23168869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f566d48105db4beeac8d39a5a03519a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:05.748213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-383e0b74-d9b0-4dd7-b716-71be23168869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f566d48105db4beeac8d39a5a03519a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:05.758366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-383e0b74-d9b0-4dd7-b716-71be23168869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f566d48105db4beeac8d39a5a03519a6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:05.778914 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3707/7439] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:05 2021] DELETE /identity/v3/users/f566d48105db4beeac8d39a5a03519a6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:05.780682 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3733/7440] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:05 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:05.783675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cc17d-0aae-4b96-b07e-7bfa5a8beacc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:05.784376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cc17d-0aae-4b96-b07e-7bfa5a8beacc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:05.784761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cc17d-0aae-4b96-b07e-7bfa5a8beacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:05.811798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3c6cc17d-0aae-4b96-b07e-7bfa5a8beacc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:05.813151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3c6cc17d-0aae-4b96-b07e-7bfa5a8beacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:05.888600 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3708/7441] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:17:05.894063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf1eed-0674-4d12-b0cd-0f02d00d1a2f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:05.895828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-afaf1eed-0674-4d12-b0cd-0f02d00d1a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:05.914197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf1eed-0674-4d12-b0cd-0f02d00d1a2f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:05.995295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deead597-52b9-41a4-8a9a-e443d55087ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:05.996994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead597-52b9-41a4-8a9a-e443d55087ba service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:05.997346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead597-52b9-41a4-8a9a-e443d55087ba service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:05.997687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead597-52b9-41a4-8a9a-e443d55087ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:06.010069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deead597-52b9-41a4-8a9a-e443d55087ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:06.012400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deead597-52b9-41a4-8a9a-e443d55087ba service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:06.024717 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3734/7442] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:06.355043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cc17d-0aae-4b96-b07e-7bfa5a8beacc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:06.357018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3c6cc17d-0aae-4b96-b07e-7bfa5a8beacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:06.371427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cc17d-0aae-4b96-b07e-7bfa5a8beacc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:06.378151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:06.381309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:06.381839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:06.382128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] PATH_INFO: `/v3/projects/038952e512e24ad48321d19c3748ea74` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:06.383790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=038952e512e24ad48321d19c3748ea74)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:06.386596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:06.475981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038952e512e24ad48321d19c3748ea74', 'request_id': 'req-2295a049-943c-47c1-8f97-8c7026003bec'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:06.487501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038952e512e24ad48321d19c3748ea74', 'request_id': 'req-2295a049-943c-47c1-8f97-8c7026003bec'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:06.500928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038952e512e24ad48321d19c3748ea74', 'request_id': 'req-2295a049-943c-47c1-8f97-8c7026003bec'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:06.516224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] The token cache is being invalidate because project 038952e512e24ad48321d19c3748ea74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:06.516780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:06.518529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:06.526312 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3709/7443] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:06 2021] DELETE /identity/v3/projects/038952e512e24ad48321d19c3748ea74 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:06.529239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618211d6-2983-4a0d-9547-ac3fcf7492ae None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:06.533130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618211d6-2983-4a0d-9547-ac3fcf7492ae None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:06.533813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618211d6-2983-4a0d-9547-ac3fcf7492ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:06.605947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-618211d6-2983-4a0d-9547-ac3fcf7492ae None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:06.606176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:06.607794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:06.609419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-618211d6-2983-4a0d-9547-ac3fcf7492ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:06.715738 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3735/7444] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:06.724393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4032-07c7-4f72-a7a3-3833dd610e1c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:06.724752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4032-07c7-4f72-a7a3-3833dd610e1c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:06.725039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4032-07c7-4f72-a7a3-3833dd610e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:06.736399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295a049-943c-47c1-8f97-8c7026003bec admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:06.743658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b5016-a2b5-407a-bda6-0fdd8cbf02a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:06.744938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5016-a2b5-407a-bda6-0fdd8cbf02a6 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:06.745330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5016-a2b5-407a-bda6-0fdd8cbf02a6 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:06.745750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b5016-a2b5-407a-bda6-0fdd8cbf02a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:06.748493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ed4b5016-a2b5-407a-bda6-0fdd8cbf02a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:06.750949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ce8e4032-07c7-4f72-a7a3-3833dd610e1c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:06.753003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ce8e4032-07c7-4f72-a7a3-3833dd610e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:06.764160 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3736/7445] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:17:06.765668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b5016-a2b5-407a-bda6-0fdd8cbf02a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:06.767767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b5016-a2b5-407a-bda6-0fdd8cbf02a6 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:06.768622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e4032-07c7-4f72-a7a3-3833dd610e1c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:06.781269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e4032-07c7-4f72-a7a3-3833dd610e1c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:06.788791 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3710/7446] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:06 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:17:06.789610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86390f88-dc61-401c-88e6-10101ec635ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:06.790281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86390f88-dc61-401c-88e6-10101ec635ab admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:06.790609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86390f88-dc61-401c-88e6-10101ec635ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:06.790894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86390f88-dc61-401c-88e6-10101ec635ab admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:06.791777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86390f88-dc61-401c-88e6-10101ec635ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:17:06.792082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86390f88-dc61-401c-88e6-10101ec635ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:06.794459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86390f88-dc61-401c-88e6-10101ec635ab admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:06.810448 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3737/7447] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:17:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:06.811994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b5016-a2b5-407a-bda6-0fdd8cbf02a6 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:06.824522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b5016-a2b5-407a-bda6-0fdd8cbf02a6 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:06.831124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bbf1a-31b0-488e-a57e-4d003a43afd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:06.832695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bbf1a-31b0-488e-a57e-4d003a43afd2 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:06.833156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bbf1a-31b0-488e-a57e-4d003a43afd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:06.833599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bbf1a-31b0-488e-a57e-4d003a43afd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:06.834470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bbf1a-31b0-488e-a57e-4d003a43afd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:06.837426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bbf1a-31b0-488e-a57e-4d003a43afd2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:06.876616 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3711/7448] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:06 2021] POST /identity/v3/projects => generated 363 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:06.878096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86390f88-dc61-401c-88e6-10101ec635ab admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:06.892947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86390f88-dc61-401c-88e6-10101ec635ab admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:06.984896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546d4b1-0b3d-49dd-950d-db429f847e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:06.985550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d4b1-0b3d-49dd-950d-db429f847e81 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:06.986945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d4b1-0b3d-49dd-950d-db429f847e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:06.986945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d4b1-0b3d-49dd-950d-db429f847e81 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:06.987200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546d4b1-0b3d-49dd-950d-db429f847e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:06.990006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546d4b1-0b3d-49dd-950d-db429f847e81 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:07.015313 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3738/7449] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:06 2021] POST /identity/v3/users => generated 282 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:07.018858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bbf1a-31b0-488e-a57e-4d003a43afd2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:07.030426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bbf1a-31b0-488e-a57e-4d003a43afd2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:07.035389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c007e-0c27-476d-8f23-b860009f1a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:07.036211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c007e-0c27-476d-8f23-b860009f1a37 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.036605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c007e-0c27-476d-8f23-b860009f1a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.036977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c007e-0c27-476d-8f23-b860009f1a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.037817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c007e-0c27-476d-8f23-b860009f1a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:07.039604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c007e-0c27-476d-8f23-b860009f1a37 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:07.051277 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3712/7450] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:07.055444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546d4b1-0b3d-49dd-950d-db429f847e81 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:07.066874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546d4b1-0b3d-49dd-950d-db429f847e81 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:07.074394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b2311-99d3-4c23-95ff-d5fe61c1da13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:07.075220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2311-99d3-4c23-95ff-d5fe61c1da13 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.075586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2311-99d3-4c23-95ff-d5fe61c1da13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.075980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2311-99d3-4c23-95ff-d5fe61c1da13 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.076748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b2311-99d3-4c23-95ff-d5fe61c1da13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:07.078870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b2311-99d3-4c23-95ff-d5fe61c1da13 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:07.094865 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3739/7451] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:07.096438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c007e-0c27-476d-8f23-b860009f1a37 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:07.106920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c007e-0c27-476d-8f23-b860009f1a37 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:07.112803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79a182-90ca-4483-a336-c3749e4bc26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:07.113909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79a182-90ca-4483-a336-c3749e4bc26c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.114368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79a182-90ca-4483-a336-c3749e4bc26c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.114644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79a182-90ca-4483-a336-c3749e4bc26c admin admin] PATH_INFO: `/v3/projects/a19f996909444bfeb728afa8e59b8de9/users/b6e9f466ac0b47a9ab5bf3ff28dff193/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.132491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79a182-90ca-4483-a336-c3749e4bc26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19f996909444bfeb728afa8e59b8de9, user_id=b6e9f466ac0b47a9ab5bf3ff28dff193, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:07.135504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79a182-90ca-4483-a336-c3749e4bc26c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:07.153883 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3713/7452] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:07 2021] PUT /identity/v3/projects/a19f996909444bfeb728afa8e59b8de9/users/b6e9f466ac0b47a9ab5bf3ff28dff193/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:07.164835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68f0c1-d8bb-47f0-850d-b92c2f2b675b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.165182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68f0c1-d8bb-47f0-850d-b92c2f2b675b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.165680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68f0c1-d8bb-47f0-850d-b92c2f2b675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.197689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cc68f0c1-d8bb-47f0-850d-b92c2f2b675b None None] MFA Rules not processed for user `b6e9f466ac0b47a9ab5bf3ff28dff193`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:07.199485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cc68f0c1-d8bb-47f0-850d-b92c2f2b675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:07.273990 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3740/7453] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:07 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:07.291374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79a182-90ca-4483-a336-c3749e4bc26c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:07.293530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1b79a182-90ca-4483-a336-c3749e4bc26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:07.381370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79a182-90ca-4483-a336-c3749e4bc26c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:07.389116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810164af-5039-4e69-af48-a0d5312720d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:07.389857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810164af-5039-4e69-af48-a0d5312720d8 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.390215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810164af-5039-4e69-af48-a0d5312720d8 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.390500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810164af-5039-4e69-af48-a0d5312720d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.403751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810164af-5039-4e69-af48-a0d5312720d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:07.405843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810164af-5039-4e69-af48-a0d5312720d8 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:07.424045 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3714/7454] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:07 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:07.449847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ceb742-4875-4736-9cf6-1056a8cbe390 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.450320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ceb742-4875-4736-9cf6-1056a8cbe390 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.450851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ceb742-4875-4736-9cf6-1056a8cbe390 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.453038 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3741/7455] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 21:17:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:17:07.458688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810164af-5039-4e69-af48-a0d5312720d8 service nova] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 21:17:07.472921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810164af-5039-4e69-af48-a0d5312720d8 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:07.482628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810164af-5039-4e69-af48-a0d5312720d8 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:07.487056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e2c49-4be8-407b-8f9b-547cacd4436f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9f466ac0b47a9ab5bf3ff28dff193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a19f996909444bfeb728afa8e59b8de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:07.487977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2c49-4be8-407b-8f9b-547cacd4436f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.488409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2c49-4be8-407b-8f9b-547cacd4436f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.488531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e2c49-4be8-407b-8f9b-547cacd4436f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] PATH_INFO: `/v3/projects/a19f996909444bfeb728afa8e59b8de9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.490014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e2c49-4be8-407b-8f9b-547cacd4436f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: Authorizing `identity:get_project(project_id=a19f996909444bfeb728afa8e59b8de9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:07.491887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e2c49-4be8-407b-8f9b-547cacd4436f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:07.493644 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3715/7456] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 21:17:07 2021] GET /identity/v3/projects/a19f996909444bfeb728afa8e59b8de9 => generated 363 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:17:07.523611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde5b1-4278-4f23-9e9f-47c1df9a677c None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.523988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde5b1-4278-4f23-9e9f-47c1df9a677c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.524343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde5b1-4278-4f23-9e9f-47c1df9a677c None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.526202 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3742/7457] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 21:17:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:17:07.531595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e2c49-4be8-407b-8f9b-547cacd4436f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 21:17:07.533330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cd8e2c49-4be8-407b-8f9b-547cacd4436f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:07.552633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e2c49-4be8-407b-8f9b-547cacd4436f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:07.562766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e2c49-4be8-407b-8f9b-547cacd4436f tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:07.568507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9469393-a655-446b-aac8-b227b0d0c048 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9f466ac0b47a9ab5bf3ff28dff193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a19f996909444bfeb728afa8e59b8de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:07.569640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9469393-a655-446b-aac8-b227b0d0c048 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.570024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9469393-a655-446b-aac8-b227b0d0c048 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.570488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9469393-a655-446b-aac8-b227b0d0c048 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] PATH_INFO: `/v3/projects/a19f996909444bfeb728afa8e59b8de9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.572226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9469393-a655-446b-aac8-b227b0d0c048 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: Authorizing `identity:get_project(project_id=a19f996909444bfeb728afa8e59b8de9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:07.575603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9469393-a655-446b-aac8-b227b0d0c048 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:07.579572 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3716/7458] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 21:17:07 2021] GET /identity/v3/projects/a19f996909444bfeb728afa8e59b8de9 => generated 363 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:07.621632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489dc68-186a-43b6-8337-f90e19f9b8a0 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.622037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489dc68-186a-43b6-8337-f90e19f9b8a0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.622559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489dc68-186a-43b6-8337-f90e19f9b8a0 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.625576 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3743/7459] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 21:17:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:17:07.631111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9469393-a655-446b-aac8-b227b0d0c048 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 21:17:07.658795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9469393-a655-446b-aac8-b227b0d0c048 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:07.669361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9469393-a655-446b-aac8-b227b0d0c048 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:07.674359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b66c6-0767-4d14-9678-a8801617b7a6 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9f466ac0b47a9ab5bf3ff28dff193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a19f996909444bfeb728afa8e59b8de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:07.675160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b66c6-0767-4d14-9678-a8801617b7a6 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.675511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b66c6-0767-4d14-9678-a8801617b7a6 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.675790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b66c6-0767-4d14-9678-a8801617b7a6 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] PATH_INFO: `/v3/projects/a19f996909444bfeb728afa8e59b8de9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.677010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b66c6-0767-4d14-9678-a8801617b7a6 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: Authorizing `identity:get_project(project_id=a19f996909444bfeb728afa8e59b8de9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:07.678898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b66c6-0767-4d14-9678-a8801617b7a6 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:07.680808 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3717/7460] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 21:17:07 2021] GET /identity/v3/projects/a19f996909444bfeb728afa8e59b8de9 => generated 363 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:17:07.723001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5b910-1953-4f03-9b9e-5de726888af7 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.723659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5b910-1953-4f03-9b9e-5de726888af7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.723659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5b910-1953-4f03-9b9e-5de726888af7 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.725568 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3744/7461] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 21:17:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:17:07.736501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b66c6-0767-4d14-9678-a8801617b7a6 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 21:17:07.761775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b66c6-0767-4d14-9678-a8801617b7a6 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:07.781733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b66c6-0767-4d14-9678-a8801617b7a6 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:07.786816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa4693-6efd-4bba-9ef4-09e7d5f2cd53 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9f466ac0b47a9ab5bf3ff28dff193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a19f996909444bfeb728afa8e59b8de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:07.788030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa4693-6efd-4bba-9ef4-09e7d5f2cd53 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.788621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa4693-6efd-4bba-9ef4-09e7d5f2cd53 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.789280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa4693-6efd-4bba-9ef4-09e7d5f2cd53 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] PATH_INFO: `/v3/projects/a19f996909444bfeb728afa8e59b8de9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.791360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa4693-6efd-4bba-9ef4-09e7d5f2cd53 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: Authorizing `identity:get_project(project_id=a19f996909444bfeb728afa8e59b8de9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:07.793959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa4693-6efd-4bba-9ef4-09e7d5f2cd53 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:07.795979 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3718/7462] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 21:17:07 2021] GET /identity/v3/projects/a19f996909444bfeb728afa8e59b8de9 => generated 363 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:17:07.845281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311575c-7c72-4f67-9abf-e525b8b8e833 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.845714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311575c-7c72-4f67-9abf-e525b8b8e833 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.846094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311575c-7c72-4f67-9abf-e525b8b8e833 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.848227 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3745/7463] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 21:17:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:17:07.853850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa4693-6efd-4bba-9ef4-09e7d5f2cd53 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 21:17:07.883510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa4693-6efd-4bba-9ef4-09e7d5f2cd53 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:07.904856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa4693-6efd-4bba-9ef4-09e7d5f2cd53 tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:07.916848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db45e66-57f2-4c25-99f1-f9b11570045e tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e9f466ac0b47a9ab5bf3ff28dff193', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a19f996909444bfeb728afa8e59b8de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:07.920240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db45e66-57f2-4c25-99f1-f9b11570045e tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:07.920806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db45e66-57f2-4c25-99f1-f9b11570045e tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:07.922329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db45e66-57f2-4c25-99f1-f9b11570045e tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] PATH_INFO: `/v3/projects/a19f996909444bfeb728afa8e59b8de9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:07.925010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db45e66-57f2-4c25-99f1-f9b11570045e tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: Authorizing `identity:get_project(project_id=a19f996909444bfeb728afa8e59b8de9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:07.928567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db45e66-57f2-4c25-99f1-f9b11570045e tempest-QuotasTestJSON-252148966 tempest-QuotasTestJSON-252148966-project] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:07.930524 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3719/7464] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 21:17:07 2021] GET /identity/v3/projects/a19f996909444bfeb728afa8e59b8de9 => generated 363 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:07.966068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311575c-7c72-4f67-9abf-e525b8b8e833 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:08.053841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311575c-7c72-4f67-9abf-e525b8b8e833 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:08.060767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:08.061750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:08.062104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:08.062620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] PATH_INFO: `/v3/users/b6e9f466ac0b47a9ab5bf3ff28dff193` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:08.064207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e9f466ac0b47a9ab5bf3ff28dff193)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:08.066387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:08.123978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e9f466ac0b47a9ab5bf3ff28dff193'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:08.135285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e9f466ac0b47a9ab5bf3ff28dff193'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:08.136210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e9f466ac0b47a9ab5bf3ff28dff193'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:08.144550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e9f466ac0b47a9ab5bf3ff28dff193'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:08.158047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e9f466ac0b47a9ab5bf3ff28dff193'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:08.166646 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3746/7465] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:07 2021] DELETE /identity/v3/users/b6e9f466ac0b47a9ab5bf3ff28dff193 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:08.171957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252c5dc-0692-4704-9647-bab44d494915 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:08.172254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252c5dc-0692-4704-9647-bab44d494915 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:08.172524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252c5dc-0692-4704-9647-bab44d494915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:08.191045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0252c5dc-0692-4704-9647-bab44d494915 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:08.192514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0252c5dc-0692-4704-9647-bab44d494915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:08.262158 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3720/7466] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:08.273637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:08.277610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:08.388207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc99751-5fcc-4ab1-bc00-4b3838553cf4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:08.399348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c9875-b1e6-40db-88a8-2ea869c27815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:08.403044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c9875-b1e6-40db-88a8-2ea869c27815 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:08.403455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c9875-b1e6-40db-88a8-2ea869c27815 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:08.403812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c9875-b1e6-40db-88a8-2ea869c27815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:08.421606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c9875-b1e6-40db-88a8-2ea869c27815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:08.423752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c9875-b1e6-40db-88a8-2ea869c27815 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:08.439792 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3747/7467] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:09.094562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252c5dc-0692-4704-9647-bab44d494915 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:09.099611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0252c5dc-0692-4704-9647-bab44d494915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:09.141386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252c5dc-0692-4704-9647-bab44d494915 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:09.152237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:09.167168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:09.168517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:09.168805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] PATH_INFO: `/v3/projects/a19f996909444bfeb728afa8e59b8de9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:09.170338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19f996909444bfeb728afa8e59b8de9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:09.172894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:09.250421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19f996909444bfeb728afa8e59b8de9', 'request_id': 'req-c41a50e4-8743-49da-af30-e52c18ca24b5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:09.257734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19f996909444bfeb728afa8e59b8de9', 'request_id': 'req-c41a50e4-8743-49da-af30-e52c18ca24b5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:09.270340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19f996909444bfeb728afa8e59b8de9', 'request_id': 'req-c41a50e4-8743-49da-af30-e52c18ca24b5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:09.288438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] The token cache is being invalidate because project a19f996909444bfeb728afa8e59b8de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:09.288723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:09.289545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c41a50e4-8743-49da-af30-e52c18ca24b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:09.291176 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3721/7468] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:09 2021] DELETE /identity/v3/projects/a19f996909444bfeb728afa8e59b8de9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:09.298553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9a91f-bcb8-451a-8751-6aaeeb4c8bf5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:09.299078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9a91f-bcb8-451a-8751-6aaeeb4c8bf5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:09.299985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9a91f-bcb8-451a-8751-6aaeeb4c8bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:09.325704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b3c9a91f-bcb8-451a-8751-6aaeeb4c8bf5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:09.327058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b3c9a91f-bcb8-451a-8751-6aaeeb4c8bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:09.411208 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3748/7469] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:09.413102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96c8c3-30db-41e1-ab84-c74c5375942e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:09.413391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96c8c3-30db-41e1-ab84-c74c5375942e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:09.413662 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96c8c3-30db-41e1-ab84-c74c5375942e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:09.439487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2e96c8c3-30db-41e1-ab84-c74c5375942e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:09.440730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2e96c8c3-30db-41e1-ab84-c74c5375942e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:09.450976 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3722/7470] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:09.455455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9a91f-bcb8-451a-8751-6aaeeb4c8bf5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:09.466007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9a91f-bcb8-451a-8751-6aaeeb4c8bf5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:09.471169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cb184-a994-4ad1-8062-29167a294b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:09.471830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cb184-a994-4ad1-8062-29167a294b61 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:09.472106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cb184-a994-4ad1-8062-29167a294b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:09.472384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cb184-a994-4ad1-8062-29167a294b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:09.473304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cb184-a994-4ad1-8062-29167a294b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:17:09.473619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cb184-a994-4ad1-8062-29167a294b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:09.475645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cb184-a994-4ad1-8062-29167a294b61 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:09.491715 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3749/7471] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:17:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:17:09.496687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96c8c3-30db-41e1-ab84-c74c5375942e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:09.517684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96c8c3-30db-41e1-ab84-c74c5375942e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:09.522744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc63cf-1a1f-433f-a6fc-935ba9e5c998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:09.524143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc63cf-1a1f-433f-a6fc-935ba9e5c998 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:09.524320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc63cf-1a1f-433f-a6fc-935ba9e5c998 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:09.524604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc63cf-1a1f-433f-a6fc-935ba9e5c998 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:09.525830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc63cf-1a1f-433f-a6fc-935ba9e5c998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:09.527846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc63cf-1a1f-433f-a6fc-935ba9e5c998 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:09.570556 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3723/7472] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:09 2021] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:09.574946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cb184-a994-4ad1-8062-29167a294b61 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:09.586038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cb184-a994-4ad1-8062-29167a294b61 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:09.653596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569ed3c-1f64-41f5-b863-1d9dfe0bc3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:09.654204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ed3c-1f64-41f5-b863-1d9dfe0bc3af admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:09.654558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ed3c-1f64-41f5-b863-1d9dfe0bc3af admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:09.654914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ed3c-1f64-41f5-b863-1d9dfe0bc3af admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:09.655752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569ed3c-1f64-41f5-b863-1d9dfe0bc3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:09.657867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569ed3c-1f64-41f5-b863-1d9dfe0bc3af admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:09.685992 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3750/7473] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:09 2021] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:09.690778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc63cf-1a1f-433f-a6fc-935ba9e5c998 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:09.702500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc63cf-1a1f-433f-a6fc-935ba9e5c998 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:09.708650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dc44a-eee7-47d4-b6a8-6ed16ce7c639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:09.708650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dc44a-eee7-47d4-b6a8-6ed16ce7c639 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:09.708650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dc44a-eee7-47d4-b6a8-6ed16ce7c639 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:09.709283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dc44a-eee7-47d4-b6a8-6ed16ce7c639 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:09.710108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dc44a-eee7-47d4-b6a8-6ed16ce7c639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:09.712257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9dc44a-eee7-47d4-b6a8-6ed16ce7c639 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:09.724531 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3724/7474] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:09 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:17:09.728583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569ed3c-1f64-41f5-b863-1d9dfe0bc3af admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:09.740580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569ed3c-1f64-41f5-b863-1d9dfe0bc3af admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:09.745738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c21c81-d21b-44cf-84ac-d686d04c47a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:09.746445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c21c81-d21b-44cf-84ac-d686d04c47a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:09.746735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c21c81-d21b-44cf-84ac-d686d04c47a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:09.747017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c21c81-d21b-44cf-84ac-d686d04c47a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:09.747924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c21c81-d21b-44cf-84ac-d686d04c47a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:09.749617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c21c81-d21b-44cf-84ac-d686d04c47a1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:09.764443 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3751/7475] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:09 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:09.765702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dc44a-eee7-47d4-b6a8-6ed16ce7c639 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:09.777411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dc44a-eee7-47d4-b6a8-6ed16ce7c639 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:09.782482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67e5cf-6204-466e-a26e-d637d5c00b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:09.783819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e5cf-6204-466e-a26e-d637d5c00b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:09.783819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e5cf-6204-466e-a26e-d637d5c00b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:09.784071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67e5cf-6204-466e-a26e-d637d5c00b3d admin admin] PATH_INFO: `/v3/projects/b505a883a825408698c3d922940ee1c0/users/7c8324b8572a407eb60a7930b819db67/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:09.805348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67e5cf-6204-466e-a26e-d637d5c00b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b505a883a825408698c3d922940ee1c0, user_id=7c8324b8572a407eb60a7930b819db67, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:09.808384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67e5cf-6204-466e-a26e-d637d5c00b3d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:09.824312 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3725/7476] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:09 2021] PUT /identity/v3/projects/b505a883a825408698c3d922940ee1c0/users/7c8324b8572a407eb60a7930b819db67/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:09.834911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2310c-132b-4187-9efa-84f09a9918f9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:09.835468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2310c-132b-4187-9efa-84f09a9918f9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:09.835857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2310c-132b-4187-9efa-84f09a9918f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:09.867291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-83d2310c-132b-4187-9efa-84f09a9918f9 None None] MFA Rules not processed for user `7c8324b8572a407eb60a7930b819db67`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:09.868535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-83d2310c-132b-4187-9efa-84f09a9918f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:09.962972 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3752/7477] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:09 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:17:09.978379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67e5cf-6204-466e-a26e-d637d5c00b3d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:09.982632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fa67e5cf-6204-466e-a26e-d637d5c00b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:10.073115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67e5cf-6204-466e-a26e-d637d5c00b3d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:10.079859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e98251-08a9-4aba-851c-6125f6370890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:10.080596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e98251-08a9-4aba-851c-6125f6370890 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:10.080948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e98251-08a9-4aba-851c-6125f6370890 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:10.081295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e98251-08a9-4aba-851c-6125f6370890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:10.092893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e98251-08a9-4aba-851c-6125f6370890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:10.097805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e98251-08a9-4aba-851c-6125f6370890 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:10.105968 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3726/7478] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:09 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:15.273736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2310c-132b-4187-9efa-84f09a9918f9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:15.334056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2310c-132b-4187-9efa-84f09a9918f9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:15.338648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:15.339544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:15.339833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:15.340109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] PATH_INFO: `/v3/users/7c8324b8572a407eb60a7930b819db67` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:15.341300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8324b8572a407eb60a7930b819db67)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:15.343218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:15.392358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8324b8572a407eb60a7930b819db67'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:15.399985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8324b8572a407eb60a7930b819db67'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:15.400901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8324b8572a407eb60a7930b819db67'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:15.408729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8324b8572a407eb60a7930b819db67'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:15.420802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8324b8572a407eb60a7930b819db67'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:15.426907 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3753/7479] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:15 2021] DELETE /identity/v3/users/7c8324b8572a407eb60a7930b819db67 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:15.431352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989676b-3c9d-4b4f-976a-dda5a85c3a1f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:15.431837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989676b-3c9d-4b4f-976a-dda5a85c3a1f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:15.431998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989676b-3c9d-4b4f-976a-dda5a85c3a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:15.450488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8989676b-3c9d-4b4f-976a-dda5a85c3a1f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:15.451856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8989676b-3c9d-4b4f-976a-dda5a85c3a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:15.512219 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3727/7480] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:15.522579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:15.523996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:15.582519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49505b-0630-4b87-ab43-81e6fb529226 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:15.586286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725f4cd-5364-4612-9538-8c5ba9e29950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:15.586931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725f4cd-5364-4612-9538-8c5ba9e29950 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:15.587215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725f4cd-5364-4612-9538-8c5ba9e29950 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:15.587530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725f4cd-5364-4612-9538-8c5ba9e29950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:15.596495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725f4cd-5364-4612-9538-8c5ba9e29950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:15.597920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725f4cd-5364-4612-9538-8c5ba9e29950 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:15.607855 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3754/7481] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:15.863373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989676b-3c9d-4b4f-976a-dda5a85c3a1f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:15.865082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8989676b-3c9d-4b4f-976a-dda5a85c3a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:15.877593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989676b-3c9d-4b4f-976a-dda5a85c3a1f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:15.882211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:15.883058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:15.883387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:15.883666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] PATH_INFO: `/v3/projects/b505a883a825408698c3d922940ee1c0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:15.885419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b505a883a825408698c3d922940ee1c0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:15.888183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:15.935297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b505a883a825408698c3d922940ee1c0', 'request_id': 'req-bf78be1e-48c3-46df-95f6-6a6c725d019b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:15.941617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b505a883a825408698c3d922940ee1c0', 'request_id': 'req-bf78be1e-48c3-46df-95f6-6a6c725d019b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:15.950298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b505a883a825408698c3d922940ee1c0', 'request_id': 'req-bf78be1e-48c3-46df-95f6-6a6c725d019b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:15.960531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] The token cache is being invalidate because project b505a883a825408698c3d922940ee1c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:15.960883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:15.961588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bf78be1e-48c3-46df-95f6-6a6c725d019b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:15.963521 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3728/7482] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:15 2021] DELETE /identity/v3/projects/b505a883a825408698c3d922940ee1c0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:15.968949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de6cde-af17-4ff6-b975-e13e4382ba6f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:15.969277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de6cde-af17-4ff6-b975-e13e4382ba6f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:15.969569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de6cde-af17-4ff6-b975-e13e4382ba6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:15.988258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-93de6cde-af17-4ff6-b975-e13e4382ba6f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:15.989585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-93de6cde-af17-4ff6-b975-e13e4382ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:16.049678 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3755/7483] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:16.057607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f57df2-ae1f-4028-9690-7a4a1e87f3db None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.058474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f57df2-ae1f-4028-9690-7a4a1e87f3db None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.059818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f57df2-ae1f-4028-9690-7a4a1e87f3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.078795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-61f57df2-ae1f-4028-9690-7a4a1e87f3db None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:16.080122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-61f57df2-ae1f-4028-9690-7a4a1e87f3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:16.089897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de6cde-af17-4ff6-b975-e13e4382ba6f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.090409 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3729/7484] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:16.091744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-93de6cde-af17-4ff6-b975-e13e4382ba6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:16.094595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f57df2-ae1f-4028-9690-7a4a1e87f3db None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.106938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f57df2-ae1f-4028-9690-7a4a1e87f3db None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.111906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d09d8d-ddbd-41ce-9d11-1339b3b92d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.112584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09d8d-ddbd-41ce-9d11-1339b3b92d9c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.112864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09d8d-ddbd-41ce-9d11-1339b3b92d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.113130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d09d8d-ddbd-41ce-9d11-1339b3b92d9c admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.113857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d09d8d-ddbd-41ce-9d11-1339b3b92d9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:17:16.114156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d09d8d-ddbd-41ce-9d11-1339b3b92d9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.116059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d09d8d-ddbd-41ce-9d11-1339b3b92d9c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.129582 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3730/7485] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:17:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:17:16.133904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d09d8d-ddbd-41ce-9d11-1339b3b92d9c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.144112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d09d8d-ddbd-41ce-9d11-1339b3b92d9c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.149502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7f2ef-c38f-4863-8639-0b8c56b8e02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.150320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f2ef-c38f-4863-8639-0b8c56b8e02b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.150754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f2ef-c38f-4863-8639-0b8c56b8e02b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.150894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f2ef-c38f-4863-8639-0b8c56b8e02b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.151648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7f2ef-c38f-4863-8639-0b8c56b8e02b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.153546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7f2ef-c38f-4863-8639-0b8c56b8e02b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.180260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de6cde-af17-4ff6-b975-e13e4382ba6f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.181039 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3731/7486] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:16 2021] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:17:16.185698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7f2ef-c38f-4863-8639-0b8c56b8e02b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.245146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924defff-16be-4b6b-9f8a-038079f759c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.245880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7f2ef-c38f-4863-8639-0b8c56b8e02b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.246295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924defff-16be-4b6b-9f8a-038079f759c5 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.246576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924defff-16be-4b6b-9f8a-038079f759c5 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.246851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924defff-16be-4b6b-9f8a-038079f759c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.248635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-924defff-16be-4b6b-9f8a-038079f759c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:16.250480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352bd7d-a94a-49fc-9fa5-b943c4bb5f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.251167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352bd7d-a94a-49fc-9fa5-b943c4bb5f2a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.251484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352bd7d-a94a-49fc-9fa5-b943c4bb5f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.251765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352bd7d-a94a-49fc-9fa5-b943c4bb5f2a admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.252471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352bd7d-a94a-49fc-9fa5-b943c4bb5f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.254452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352bd7d-a94a-49fc-9fa5-b943c4bb5f2a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.263101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924defff-16be-4b6b-9f8a-038079f759c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.264706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924defff-16be-4b6b-9f8a-038079f759c5 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.277579 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3732/7487] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:16 2021] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:17:16.278778 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3756/7488] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:16.281530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352bd7d-a94a-49fc-9fa5-b943c4bb5f2a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.292895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352bd7d-a94a-49fc-9fa5-b943c4bb5f2a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.297639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd6c48-eaf1-4117-81da-29d1900d755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.298285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6c48-eaf1-4117-81da-29d1900d755c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.298569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6c48-eaf1-4117-81da-29d1900d755c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.298853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6c48-eaf1-4117-81da-29d1900d755c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.299617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd6c48-eaf1-4117-81da-29d1900d755c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.301218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd6c48-eaf1-4117-81da-29d1900d755c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.312121 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3733/7489] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:16.316193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924defff-16be-4b6b-9f8a-038079f759c5 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.327487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924defff-16be-4b6b-9f8a-038079f759c5 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.332341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d8d04-7941-4326-b4d7-c4fdd028bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.333003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d8d04-7941-4326-b4d7-c4fdd028bf7d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.333349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d8d04-7941-4326-b4d7-c4fdd028bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.333628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d8d04-7941-4326-b4d7-c4fdd028bf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.334486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d8d04-7941-4326-b4d7-c4fdd028bf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.336128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d8d04-7941-4326-b4d7-c4fdd028bf7d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.346846 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3757/7490] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:16.350489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd6c48-eaf1-4117-81da-29d1900d755c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.360933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd6c48-eaf1-4117-81da-29d1900d755c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.365996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff090c-3e09-4fb6-869e-e34e66cf5d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.366921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff090c-3e09-4fb6-869e-e34e66cf5d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.367224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff090c-3e09-4fb6-869e-e34e66cf5d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.367608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff090c-3e09-4fb6-869e-e34e66cf5d52 admin admin] PATH_INFO: `/v3/projects/8a0453c1637f41fba303fae2bad24e42/users/b8f2eaec2cbd4cc1a14886d1118a163d/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.383412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff090c-3e09-4fb6-869e-e34e66cf5d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0453c1637f41fba303fae2bad24e42, user_id=b8f2eaec2cbd4cc1a14886d1118a163d, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.386153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff090c-3e09-4fb6-869e-e34e66cf5d52 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.399543 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3734/7491] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:16 2021] PUT /identity/v3/projects/8a0453c1637f41fba303fae2bad24e42/users/b8f2eaec2cbd4cc1a14886d1118a163d/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:16.411455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1a904-fd5a-435c-a4ae-c4147931a316 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.411749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1a904-fd5a-435c-a4ae-c4147931a316 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.412029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1a904-fd5a-435c-a4ae-c4147931a316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.439692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9dd1a904-fd5a-435c-a4ae-c4147931a316 None None] MFA Rules not processed for user `b8f2eaec2cbd4cc1a14886d1118a163d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:16.440932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9dd1a904-fd5a-435c-a4ae-c4147931a316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:16.503705 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3758/7492] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:16 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:16.508075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff090c-3e09-4fb6-869e-e34e66cf5d52 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.567941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff090c-3e09-4fb6-869e-e34e66cf5d52 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.572638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e3f2f-9bdb-4c6d-b272-66738f767daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.573335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3f2f-9bdb-4c6d-b272-66738f767daf admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.573621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3f2f-9bdb-4c6d-b272-66738f767daf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.573898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e3f2f-9bdb-4c6d-b272-66738f767daf admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.574606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e3f2f-9bdb-4c6d-b272-66738f767daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.576540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e3f2f-9bdb-4c6d-b272-66738f767daf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.602014 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3735/7493] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:16 2021] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:16.606727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1a904-fd5a-435c-a4ae-c4147931a316 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.620329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1a904-fd5a-435c-a4ae-c4147931a316 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.677087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123ebbf-530d-4813-9c87-07a5d7f2e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.677762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123ebbf-530d-4813-9c87-07a5d7f2e98b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.678048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123ebbf-530d-4813-9c87-07a5d7f2e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.678323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123ebbf-530d-4813-9c87-07a5d7f2e98b admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.679058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123ebbf-530d-4813-9c87-07a5d7f2e98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.680997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123ebbf-530d-4813-9c87-07a5d7f2e98b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.703393 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3759/7494] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:16 2021] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:17:16.704769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e3f2f-9bdb-4c6d-b272-66738f767daf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.715874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e3f2f-9bdb-4c6d-b272-66738f767daf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.721502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b8cff-e0fc-4094-b562-86c64401bdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.722196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b8cff-e0fc-4094-b562-86c64401bdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.722479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b8cff-e0fc-4094-b562-86c64401bdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.722751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b8cff-e0fc-4094-b562-86c64401bdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.723562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b8cff-e0fc-4094-b562-86c64401bdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.725162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b8cff-e0fc-4094-b562-86c64401bdd2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.736618 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3736/7495] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:16 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:16.740984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123ebbf-530d-4813-9c87-07a5d7f2e98b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.750724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123ebbf-530d-4813-9c87-07a5d7f2e98b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.755328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0caf5-ca67-40bc-875e-dcdb4b267ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.756191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0caf5-ca67-40bc-875e-dcdb4b267ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.756471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0caf5-ca67-40bc-875e-dcdb4b267ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.756741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0caf5-ca67-40bc-875e-dcdb4b267ca2 admin admin] PATH_INFO: `/v3/projects/23687557c6194cf188592d4dd8af730f/users/baf661c0d02d4f6084e00d8ef15efec5/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.771213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0caf5-ca67-40bc-875e-dcdb4b267ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23687557c6194cf188592d4dd8af730f, user_id=baf661c0d02d4f6084e00d8ef15efec5, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.773856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0caf5-ca67-40bc-875e-dcdb4b267ca2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.787286 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3760/7496] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:16 2021] PUT /identity/v3/projects/23687557c6194cf188592d4dd8af730f/users/baf661c0d02d4f6084e00d8ef15efec5/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:16.791165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b8cff-e0fc-4094-b562-86c64401bdd2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.803118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b8cff-e0fc-4094-b562-86c64401bdd2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.866280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0851-6c3f-431f-8aa5-5807e06918c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.866939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0851-6c3f-431f-8aa5-5807e06918c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.867222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0851-6c3f-431f-8aa5-5807e06918c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.867529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0851-6c3f-431f-8aa5-5807e06918c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.868268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a0851-6c3f-431f-8aa5-5807e06918c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.869868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a0851-6c3f-431f-8aa5-5807e06918c1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.879396 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3737/7497] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:16 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:16.883562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0caf5-ca67-40bc-875e-dcdb4b267ca2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:16.894225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0caf5-ca67-40bc-875e-dcdb4b267ca2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:16.898937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200879b-37a8-4d38-a4c3-27c22ee0aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:16.899845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200879b-37a8-4d38-a4c3-27c22ee0aa1a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.900160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200879b-37a8-4d38-a4c3-27c22ee0aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.900438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200879b-37a8-4d38-a4c3-27c22ee0aa1a admin admin] PATH_INFO: `/v3/projects/23687557c6194cf188592d4dd8af730f/users/baf661c0d02d4f6084e00d8ef15efec5/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.903049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200879b-37a8-4d38-a4c3-27c22ee0aa1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23687557c6194cf188592d4dd8af730f, user_id=baf661c0d02d4f6084e00d8ef15efec5, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:16.905706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200879b-37a8-4d38-a4c3-27c22ee0aa1a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:16.915958 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3761/7498] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:16 2021] PUT /identity/v3/projects/23687557c6194cf188592d4dd8af730f/users/baf661c0d02d4f6084e00d8ef15efec5/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:17:16.927154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b74df9-cd12-4af2-a5eb-5060277f5e8c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:16.927494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b74df9-cd12-4af2-a5eb-5060277f5e8c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:16.927778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b74df9-cd12-4af2-a5eb-5060277f5e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:16.953888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f7b74df9-cd12-4af2-a5eb-5060277f5e8c None None] MFA Rules not processed for user `baf661c0d02d4f6084e00d8ef15efec5`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:16.955089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f7b74df9-cd12-4af2-a5eb-5060277f5e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:17.021291 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3738/7499] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:16 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:17.026824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200879b-37a8-4d38-a4c3-27c22ee0aa1a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.037466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200879b-37a8-4d38-a4c3-27c22ee0aa1a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.042135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e3ec2-4628-4a32-a91b-9fa08350d4c9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.042780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e3ec2-4628-4a32-a91b-9fa08350d4c9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.043067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e3ec2-4628-4a32-a91b-9fa08350d4c9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.043379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e3ec2-4628-4a32-a91b-9fa08350d4c9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.044127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e3ec2-4628-4a32-a91b-9fa08350d4c9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.045745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e3ec2-4628-4a32-a91b-9fa08350d4c9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.060606 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3762/7500] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 21:17:17 2021] POST /identity/v3/domains => generated 275 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:17.064852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b74df9-cd12-4af2-a5eb-5060277f5e8c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.074498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b74df9-cd12-4af2-a5eb-5060277f5e8c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.129544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a933eb-95c3-48ae-920f-3ae5e221f68c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.130414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a933eb-95c3-48ae-920f-3ae5e221f68c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.130703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a933eb-95c3-48ae-920f-3ae5e221f68c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.130986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a933eb-95c3-48ae-920f-3ae5e221f68c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.131786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a933eb-95c3-48ae-920f-3ae5e221f68c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=51aa20ce212e46d89ff3603bed03ab27)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.132848 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-f4a933eb-95c3-48ae-920f-3ae5e221f68c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:17.132848 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:17:17.132848 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:17:17.133732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a933eb-95c3-48ae-920f-3ae5e221f68c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.169529 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3739/7501] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 21:17:17 2021] PUT /identity/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config => generated 138 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:17.174193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e3ec2-4628-4a32-a91b-9fa08350d4c9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.184995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e3ec2-4628-4a32-a91b-9fa08350d4c9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.189853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607028a2-167c-4364-a0f1-2b085ba90674 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.190690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607028a2-167c-4364-a0f1-2b085ba90674 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.190997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607028a2-167c-4364-a0f1-2b085ba90674 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.191289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607028a2-167c-4364-a0f1-2b085ba90674 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.192519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607028a2-167c-4364-a0f1-2b085ba90674 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=51aa20ce212e46d89ff3603bed03ab27, group=identity)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.193521 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-607028a2-167c-4364-a0f1-2b085ba90674 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:17.193521 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:17:17.193521 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:17:17.194390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607028a2-167c-4364-a0f1-2b085ba90674 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.201350 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3763/7502] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 21:17:17 2021] GET /identity/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config/identity => generated 45 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:17.205277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a933eb-95c3-48ae-920f-3ae5e221f68c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.215508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a933eb-95c3-48ae-920f-3ae5e221f68c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.220211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f51eab-4f2b-4744-b393-d7e0eecddde8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.221071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f51eab-4f2b-4744-b393-d7e0eecddde8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.221359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f51eab-4f2b-4744-b393-d7e0eecddde8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.221638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f51eab-4f2b-4744-b393-d7e0eecddde8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config/identity/driver` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.222858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f51eab-4f2b-4744-b393-d7e0eecddde8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=51aa20ce212e46d89ff3603bed03ab27, group=identity, option=driver)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.223920 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-39f51eab-4f2b-4744-b393-d7e0eecddde8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:17.223920 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:17:17.223920 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:17:17.224807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f51eab-4f2b-4744-b393-d7e0eecddde8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.230803 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3740/7503] 10.222.0.21 () {58 vars in 1295 bytes} [Sat Nov 27 21:17:17 2021] GET /identity/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config/identity/driver => generated 31 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:17.234674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607028a2-167c-4364-a0f1-2b085ba90674 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.244635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607028a2-167c-4364-a0f1-2b085ba90674 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.249767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401faa60-18b6-436c-887f-af67b9e4ecd1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.250585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401faa60-18b6-436c-887f-af67b9e4ecd1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.250868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401faa60-18b6-436c-887f-af67b9e4ecd1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.251142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401faa60-18b6-436c-887f-af67b9e4ecd1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config/ldap` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.252624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401faa60-18b6-436c-887f-af67b9e4ecd1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=51aa20ce212e46d89ff3603bed03ab27, group=ldap)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.254206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401faa60-18b6-436c-887f-af67b9e4ecd1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.258644 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3764/7504] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 21:17:17 2021] GET /identity/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config/ldap => generated 106 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:17.262997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f51eab-4f2b-4744-b393-d7e0eecddde8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.272910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f51eab-4f2b-4744-b393-d7e0eecddde8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.277453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf068bd-7567-4b4e-a9c3-05eb3cfd8577 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.278275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf068bd-7567-4b4e-a9c3-05eb3cfd8577 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.278585 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf068bd-7567-4b4e-a9c3-05eb3cfd8577 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.278858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf068bd-7567-4b4e-a9c3-05eb3cfd8577 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config/ldap/url` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.280076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf068bd-7567-4b4e-a9c3-05eb3cfd8577 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=51aa20ce212e46d89ff3603bed03ab27, group=ldap, option=url)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.281699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf068bd-7567-4b4e-a9c3-05eb3cfd8577 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.286243 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3741/7505] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 21:17:17 2021] GET /identity/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config/ldap/url => generated 46 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:17.289802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401faa60-18b6-436c-887f-af67b9e4ecd1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.299681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401faa60-18b6-436c-887f-af67b9e4ecd1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.304618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c95de8-4685-4b6b-b263-5bd156275ef2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.305515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c95de8-4685-4b6b-b263-5bd156275ef2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.305804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c95de8-4685-4b6b-b263-5bd156275ef2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.306090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c95de8-4685-4b6b-b263-5bd156275ef2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config/ldap/user_tree_dn` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.307388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c95de8-4685-4b6b-b263-5bd156275ef2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=51aa20ce212e46d89ff3603bed03ab27, group=ldap, option=user_tree_dn)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.309472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c95de8-4685-4b6b-b263-5bd156275ef2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.315676 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3765/7506] 10.222.0.21 () {58 vars in 1301 bytes} [Sat Nov 27 21:17:17 2021] GET /identity/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config/ldap/user_tree_dn => generated 63 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:17.319704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf068bd-7567-4b4e-a9c3-05eb3cfd8577 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.330225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf068bd-7567-4b4e-a9c3-05eb3cfd8577 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.334867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af3171-808a-43a5-84df-a47d95e075c6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.335735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af3171-808a-43a5-84df-a47d95e075c6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.336020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af3171-808a-43a5-84df-a47d95e075c6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.336298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af3171-808a-43a5-84df-a47d95e075c6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.336955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af3171-808a-43a5-84df-a47d95e075c6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=51aa20ce212e46d89ff3603bed03ab27)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.337970 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-97af3171-808a-43a5-84df-a47d95e075c6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:17.337970 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:17:17.337970 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:17:17.338850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af3171-808a-43a5-84df-a47d95e075c6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.347542 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3742/7507] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:17 2021] DELETE /identity/v3/domains/51aa20ce212e46d89ff3603bed03ab27/config => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:17.351519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c95de8-4685-4b6b-b263-5bd156275ef2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.361269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c95de8-4685-4b6b-b263-5bd156275ef2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.366197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.367025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.367342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.367625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/51aa20ce212e46d89ff3603bed03ab27` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.368958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=51aa20ce212e46d89ff3603bed03ab27)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.371135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.392001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.392980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.416628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.417334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.419983 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3766/7508] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:17:17 2021] PATCH /identity/v3/domains/51aa20ce212e46d89ff3603bed03ab27 => generated 276 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:17.423986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af3171-808a-43a5-84df-a47d95e075c6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.425739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-97af3171-808a-43a5-84df-a47d95e075c6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:17.439134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af3171-808a-43a5-84df-a47d95e075c6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.493876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.494733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.495552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.495833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/51aa20ce212e46d89ff3603bed03ab27` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.506040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=51aa20ce212e46d89ff3603bed03ab27)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.507699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.529774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.538983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.576551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27', 'request_id': 'req-7b556183-896f-4021-b429-d5beea988f4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.582820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27', 'request_id': 'req-7b556183-896f-4021-b429-d5beea988f4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.589958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27', 'request_id': 'req-7b556183-896f-4021-b429-d5beea988f4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.599711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] The token cache is being invalidate because project 51aa20ce212e46d89ff3603bed03ab27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:17.599995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.600628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.608030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27', 'request_id': 'req-7b556183-896f-4021-b429-d5beea988f4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.608666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27', 'request_id': 'req-7b556183-896f-4021-b429-d5beea988f4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.611753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '51aa20ce212e46d89ff3603bed03ab27', 'request_id': 'req-7b556183-896f-4021-b429-d5beea988f4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:17.617291 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3743/7509] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:17:17 2021] DELETE /identity/v3/domains/51aa20ce212e46d89ff3603bed03ab27 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:17.623170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.633294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0496a8-c2a6-4bfb-a47a-286a78c4779f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.689658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd95d5-0649-4d03-8601-6d419db35fa4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.690320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd95d5-0649-4d03-8601-6d419db35fa4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.690611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd95d5-0649-4d03-8601-6d419db35fa4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.690892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd95d5-0649-4d03-8601-6d419db35fa4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.691678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd95d5-0649-4d03-8601-6d419db35fa4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.693285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd95d5-0649-4d03-8601-6d419db35fa4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.710453 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3767/7510] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 21:17:17 2021] POST /identity/v3/domains => generated 276 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:17:17.711627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.713131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:17.738880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556183-896f-4021-b429-d5beea988f4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.798618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d7ad-6860-4f3c-9b5f-be6d1ea85cc7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.799672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d7ad-6860-4f3c-9b5f-be6d1ea85cc7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.799841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d7ad-6860-4f3c-9b5f-be6d1ea85cc7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.800057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d7ad-6860-4f3c-9b5f-be6d1ea85cc7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.800810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d7ad-6860-4f3c-9b5f-be6d1ea85cc7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=4464d10cfbfe4e80afab1c3ca9bb12de)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.802649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d7ad-6860-4f3c-9b5f-be6d1ea85cc7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.840106 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3744/7511] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 21:17:17 2021] PUT /identity/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config => generated 138 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:17:17.841551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd95d5-0649-4d03-8601-6d419db35fa4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.851732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd95d5-0649-4d03-8601-6d419db35fa4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.856932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420afa6d-4ce5-496e-91ef-989cb1127042 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.857762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420afa6d-4ce5-496e-91ef-989cb1127042 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.858049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420afa6d-4ce5-496e-91ef-989cb1127042 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.858329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420afa6d-4ce5-496e-91ef-989cb1127042 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.859094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420afa6d-4ce5-496e-91ef-989cb1127042 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=4464d10cfbfe4e80afab1c3ca9bb12de)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.860200 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-420afa6d-4ce5-496e-91ef-989cb1127042 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:17.860200 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:17:17.860200 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:17:17.861097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420afa6d-4ce5-496e-91ef-989cb1127042 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.894818 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3768/7512] 10.222.0.21 () {60 vars in 1270 bytes} [Sat Nov 27 21:17:17 2021] PATCH /identity/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config => generated 141 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:17:17.896192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d7ad-6860-4f3c-9b5f-be6d1ea85cc7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.906736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d7ad-6860-4f3c-9b5f-be6d1ea85cc7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.911415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7f23b-3c8c-4f49-8e7f-aab1161fab18 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.912244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7f23b-3c8c-4f49-8e7f-aab1161fab18 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.912532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7f23b-3c8c-4f49-8e7f-aab1161fab18 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.912813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7f23b-3c8c-4f49-8e7f-aab1161fab18 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.914026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7f23b-3c8c-4f49-8e7f-aab1161fab18 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4464d10cfbfe4e80afab1c3ca9bb12de)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.915666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7f23b-3c8c-4f49-8e7f-aab1161fab18 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.920684 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3745/7513] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:17:17 2021] GET /identity/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config => generated 141 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:17:17.924476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420afa6d-4ce5-496e-91ef-989cb1127042 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.934426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420afa6d-4ce5-496e-91ef-989cb1127042 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.939041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e58f3-c967-4eb9-bbc4-50f1b41fa5a7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.939904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e58f3-c967-4eb9-bbc4-50f1b41fa5a7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.940192 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e58f3-c967-4eb9-bbc4-50f1b41fa5a7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.940471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e58f3-c967-4eb9-bbc4-50f1b41fa5a7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.941136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e58f3-c967-4eb9-bbc4-50f1b41fa5a7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=4464d10cfbfe4e80afab1c3ca9bb12de)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.942136 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-6c3e58f3-c967-4eb9-bbc4-50f1b41fa5a7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:17.942136 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:17:17.942136 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:17:17.943013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e58f3-c967-4eb9-bbc4-50f1b41fa5a7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.951536 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3769/7514] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:17 2021] DELETE /identity/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config => generated 0 bytes in 27 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:17.955410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7f23b-3c8c-4f49-8e7f-aab1161fab18 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:17.966052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7f23b-3c8c-4f49-8e7f-aab1161fab18 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:17.970776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07388264-7bed-44b1-9659-544c0c8242a6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:17.971631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07388264-7bed-44b1-9659-544c0c8242a6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:17.971920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07388264-7bed-44b1-9659-544c0c8242a6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:17.972201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07388264-7bed-44b1-9659-544c0c8242a6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:17.973409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07388264-7bed-44b1-9659-544c0c8242a6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4464d10cfbfe4e80afab1c3ca9bb12de)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:17.975002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07388264-7bed-44b1-9659-544c0c8242a6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:17.987233 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-07388264-7bed-44b1-9659-544c0c8242a6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Could not find any options in domain configuration for domain 4464d10cfbfe4e80afab1c3ca9bb12de.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 4464d10cfbfe4e80afab1c3ca9bb12de. Nov 27 21:17:17.988444 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3746/7515] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:17:17 2021] GET /identity/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config => generated 151 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:17:17.992481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e58f3-c967-4eb9-bbc4-50f1b41fa5a7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.002730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e58f3-c967-4eb9-bbc4-50f1b41fa5a7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.007533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8b570-85fb-4702-8b79-f992b494a0b5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.008519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8b570-85fb-4702-8b79-f992b494a0b5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.008810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8b570-85fb-4702-8b79-f992b494a0b5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.009095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8b570-85fb-4702-8b79-f992b494a0b5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.009761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8b570-85fb-4702-8b79-f992b494a0b5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=4464d10cfbfe4e80afab1c3ca9bb12de)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.011377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8b570-85fb-4702-8b79-f992b494a0b5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.017022 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3770/7516] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:17 2021] DELETE /identity/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de/config => generated 0 bytes in 25 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:18.020868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07388264-7bed-44b1-9659-544c0c8242a6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.031998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07388264-7bed-44b1-9659-544c0c8242a6 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.036692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.037535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.037822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.038101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.039469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4464d10cfbfe4e80afab1c3ca9bb12de)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.041074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.061840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.062468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.085999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.086626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.089613 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3747/7517] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:17:18 2021] PATCH /identity/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de => generated 277 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:18.093748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8b570-85fb-4702-8b79-f992b494a0b5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.095455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d6b8b570-85fb-4702-8b79-f992b494a0b5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:18.108576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8b570-85fb-4702-8b79-f992b494a0b5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.162161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.163007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.163324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.163606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.174343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4464d10cfbfe4e80afab1c3ca9bb12de)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.175983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.197664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.207175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.245188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de', 'request_id': 'req-9c376e5f-e86d-4331-8787-1c8ce161f7b4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.251698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de', 'request_id': 'req-9c376e5f-e86d-4331-8787-1c8ce161f7b4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.258362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de', 'request_id': 'req-9c376e5f-e86d-4331-8787-1c8ce161f7b4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.268976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] The token cache is being invalidate because project 4464d10cfbfe4e80afab1c3ca9bb12de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:18.269267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.269910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.277603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de', 'request_id': 'req-9c376e5f-e86d-4331-8787-1c8ce161f7b4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.278247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de', 'request_id': 'req-9c376e5f-e86d-4331-8787-1c8ce161f7b4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.278867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4464d10cfbfe4e80afab1c3ca9bb12de', 'request_id': 'req-9c376e5f-e86d-4331-8787-1c8ce161f7b4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.286746 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3771/7518] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:17:18 2021] DELETE /identity/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:18.291856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.301715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cc725-0dd8-40d7-856a-19c023350428 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.360249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66251344-0ed7-4206-b0e0-8076c5201fa5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.360820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251344-0ed7-4206-b0e0-8076c5201fa5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.361104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251344-0ed7-4206-b0e0-8076c5201fa5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.361375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66251344-0ed7-4206-b0e0-8076c5201fa5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.362116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66251344-0ed7-4206-b0e0-8076c5201fa5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.363739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66251344-0ed7-4206-b0e0-8076c5201fa5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.379485 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3748/7519] 10.222.0.21 () {60 vars in 1148 bytes} [Sat Nov 27 21:17:18 2021] POST /identity/v3/domains => generated 276 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:18.383925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.385406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:18.398248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c376e5f-e86d-4331-8787-1c8ce161f7b4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.454702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc4042-770c-4fe6-be5b-01b818f0ae70 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.455587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4042-770c-4fe6-be5b-01b818f0ae70 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.455877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4042-770c-4fe6-be5b-01b818f0ae70 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.456160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4042-770c-4fe6-be5b-01b818f0ae70 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/d415ed04c556411e9f70f95a22412686/config` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.456933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc4042-770c-4fe6-be5b-01b818f0ae70 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=d415ed04c556411e9f70f95a22412686)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.457929 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-13fc4042-770c-4fe6-be5b-01b818f0ae70 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:18.457929 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:17:18.457929 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:17:18.458848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc4042-770c-4fe6-be5b-01b818f0ae70 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.490404 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3772/7520] 10.222.0.21 () {60 vars in 1268 bytes} [Sat Nov 27 21:17:18 2021] PUT /identity/v3/domains/d415ed04c556411e9f70f95a22412686/config => generated 138 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:18.494477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66251344-0ed7-4206-b0e0-8076c5201fa5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.504799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66251344-0ed7-4206-b0e0-8076c5201fa5 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.509465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb9f2f-b1b7-4062-bfe4-5ed7e257229e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.510309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb9f2f-b1b7-4062-bfe4-5ed7e257229e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.511085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb9f2f-b1b7-4062-bfe4-5ed7e257229e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.511405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb9f2f-b1b7-4062-bfe4-5ed7e257229e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.512158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb9f2f-b1b7-4062-bfe4-5ed7e257229e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d415ed04c556411e9f70f95a22412686, group=identity)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.513214 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-67fb9f2f-b1b7-4062-bfe4-5ed7e257229e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_domain_config failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:18.513214 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:17:18.513214 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:17:18.514097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb9f2f-b1b7-4062-bfe4-5ed7e257229e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.541622 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3749/7521] 10.222.0.21 () {60 vars in 1296 bytes} [Sat Nov 27 21:17:18 2021] PATCH /identity/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity => generated 177 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:18.545724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc4042-770c-4fe6-be5b-01b818f0ae70 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.555633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc4042-770c-4fe6-be5b-01b818f0ae70 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.560354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafb5c6-a8bf-4f28-b3a4-c5cba5bb737d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.561205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafb5c6-a8bf-4f28-b3a4-c5cba5bb737d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.561487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafb5c6-a8bf-4f28-b3a4-c5cba5bb737d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.561762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafb5c6-a8bf-4f28-b3a4-c5cba5bb737d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity/driver` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.562499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafb5c6-a8bf-4f28-b3a4-c5cba5bb737d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d415ed04c556411e9f70f95a22412686, group=identity, option=driver)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.564102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafb5c6-a8bf-4f28-b3a4-c5cba5bb737d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.585784 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3773/7522] 10.222.0.21 () {60 vars in 1317 bytes} [Sat Nov 27 21:17:18 2021] PATCH /identity/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity/driver => generated 177 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:18.590729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb9f2f-b1b7-4062-bfe4-5ed7e257229e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.600801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb9f2f-b1b7-4062-bfe4-5ed7e257229e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.605421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18d590-a427-46fc-858f-6b33b9e8b0a4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.606262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18d590-a427-46fc-858f-6b33b9e8b0a4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.606541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18d590-a427-46fc-858f-6b33b9e8b0a4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.606837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18d590-a427-46fc-858f-6b33b9e8b0a4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity/driver` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.607523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18d590-a427-46fc-858f-6b33b9e8b0a4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d415ed04c556411e9f70f95a22412686, group=identity, option=driver)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.609144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18d590-a427-46fc-858f-6b33b9e8b0a4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.624376 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3750/7523] 10.222.0.21 () {58 vars in 1298 bytes} [Sat Nov 27 21:17:18 2021] DELETE /identity/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity/driver => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:18.628169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafb5c6-a8bf-4f28-b3a4-c5cba5bb737d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.638740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafb5c6-a8bf-4f28-b3a4-c5cba5bb737d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.643428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1739d1-3d6a-4cdd-b83f-c90ecdd9603e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.644313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1739d1-3d6a-4cdd-b83f-c90ecdd9603e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.644593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1739d1-3d6a-4cdd-b83f-c90ecdd9603e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.644869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1739d1-3d6a-4cdd-b83f-c90ecdd9603e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity/driver` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.646095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1739d1-3d6a-4cdd-b83f-c90ecdd9603e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d415ed04c556411e9f70f95a22412686, group=identity, option=driver)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.647717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1739d1-3d6a-4cdd-b83f-c90ecdd9603e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.661242 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-fe1739d1-3d6a-4cdd-b83f-c90ecdd9603e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Could not find option driver in group identity in domain configuration for domain d415ed04c556411e9f70f95a22412686.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain d415ed04c556411e9f70f95a22412686. Nov 27 21:17:18.662438 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3774/7524] 10.222.0.21 () {58 vars in 1295 bytes} [Sat Nov 27 21:17:18 2021] GET /identity/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity/driver => generated 171 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 27 21:17:18.666206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18d590-a427-46fc-858f-6b33b9e8b0a4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.676952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18d590-a427-46fc-858f-6b33b9e8b0a4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.681712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec99270-68f2-448e-a2a3-5fd12852b7e1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.682734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99270-68f2-448e-a2a3-5fd12852b7e1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.683015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99270-68f2-448e-a2a3-5fd12852b7e1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.683320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec99270-68f2-448e-a2a3-5fd12852b7e1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.684005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec99270-68f2-448e-a2a3-5fd12852b7e1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d415ed04c556411e9f70f95a22412686, group=identity)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.685604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec99270-68f2-448e-a2a3-5fd12852b7e1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.701646 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3751/7525] 10.222.0.21 () {58 vars in 1277 bytes} [Sat Nov 27 21:17:18 2021] DELETE /identity/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:18.705700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1739d1-3d6a-4cdd-b83f-c90ecdd9603e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.716165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1739d1-3d6a-4cdd-b83f-c90ecdd9603e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.720784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defedb7d-21cf-4380-8150-f38e4f495b02 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.721618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defedb7d-21cf-4380-8150-f38e4f495b02 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.721903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defedb7d-21cf-4380-8150-f38e4f495b02 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.722181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defedb7d-21cf-4380-8150-f38e4f495b02 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.723547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defedb7d-21cf-4380-8150-f38e4f495b02 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d415ed04c556411e9f70f95a22412686, group=identity)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.725135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defedb7d-21cf-4380-8150-f38e4f495b02 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.741428 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-defedb7d-21cf-4380-8150-f38e4f495b02 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Could not find group identity in domain configuration for domain d415ed04c556411e9f70f95a22412686.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain d415ed04c556411e9f70f95a22412686. Nov 27 21:17:18.742643 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3775/7526] 10.222.0.21 () {58 vars in 1274 bytes} [Sat Nov 27 21:17:18 2021] GET /identity/v3/domains/d415ed04c556411e9f70f95a22412686/config/identity => generated 154 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:17:18.746742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec99270-68f2-448e-a2a3-5fd12852b7e1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.756782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec99270-68f2-448e-a2a3-5fd12852b7e1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.761454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39ca84-08c6-4478-84ab-e06bfd2de6ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.762272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39ca84-08c6-4478-84ab-e06bfd2de6ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.762560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39ca84-08c6-4478-84ab-e06bfd2de6ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.762852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39ca84-08c6-4478-84ab-e06bfd2de6ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/d415ed04c556411e9f70f95a22412686/config` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.763558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39ca84-08c6-4478-84ab-e06bfd2de6ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d415ed04c556411e9f70f95a22412686)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.765160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39ca84-08c6-4478-84ab-e06bfd2de6ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.773867 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3752/7527] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:18 2021] DELETE /identity/v3/domains/d415ed04c556411e9f70f95a22412686/config => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:18.778285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defedb7d-21cf-4380-8150-f38e4f495b02 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.788452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defedb7d-21cf-4380-8150-f38e4f495b02 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.793900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.794720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.795000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.795302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/d415ed04c556411e9f70f95a22412686` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.796623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d415ed04c556411e9f70f95a22412686)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.798191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.818589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd415ed04c556411e9f70f95a22412686'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.819347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd415ed04c556411e9f70f95a22412686'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.843124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd415ed04c556411e9f70f95a22412686'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.843782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd415ed04c556411e9f70f95a22412686'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.846166 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3776/7528] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:17:18 2021] PATCH /identity/v3/domains/d415ed04c556411e9f70f95a22412686 => generated 277 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:18.850207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39ca84-08c6-4478-84ab-e06bfd2de6ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:18.851908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7a39ca84-08c6-4478-84ab-e06bfd2de6ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:18.865826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39ca84-08c6-4478-84ab-e06bfd2de6ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:18.922193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:18.923052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:18.923372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:18.923650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/d415ed04c556411e9f70f95a22412686` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:18.934374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d415ed04c556411e9f70f95a22412686)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:18.936040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:18.958134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd415ed04c556411e9f70f95a22412686'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:18.968456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd415ed04c556411e9f70f95a22412686'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:19.007889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd415ed04c556411e9f70f95a22412686', 'request_id': 'req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:19.019423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd415ed04c556411e9f70f95a22412686', 'request_id': 'req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:19.027909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd415ed04c556411e9f70f95a22412686', 'request_id': 'req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:19.038753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] The token cache is being invalidate because project d415ed04c556411e9f70f95a22412686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:19.039044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:19.039736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:19.046879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd415ed04c556411e9f70f95a22412686', 'request_id': 'req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:19.047558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd415ed04c556411e9f70f95a22412686', 'request_id': 'req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:19.050716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd415ed04c556411e9f70f95a22412686', 'request_id': 'req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:19.056267 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3753/7529] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:17:18 2021] DELETE /identity/v3/domains/d415ed04c556411e9f70f95a22412686 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:19.061579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.071742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852308a0-3959-4135-811e-f76dfbeb655f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.132127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893268c3-a917-4c11-aa1c-db7f2b235429 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.132912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893268c3-a917-4c11-aa1c-db7f2b235429 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.133311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893268c3-a917-4c11-aa1c-db7f2b235429 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.133682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893268c3-a917-4c11-aa1c-db7f2b235429 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.134432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893268c3-a917-4c11-aa1c-db7f2b235429 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.136185 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-893268c3-a917-4c11-aa1c-db7f2b235429 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_domain_config_default failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:19.136185 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(msg) Nov 27 21:17:19.136185 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:17:19.137323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893268c3-a917-4c11-aa1c-db7f2b235429 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.142228 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3777/7530] 10.222.0.21 () {58 vars in 1172 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/default => generated 1527 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:19.146464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.147982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:19.161103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfbbc1-0ae9-4909-9d41-e0cb414eac4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.166321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad186d-b46b-4188-9551-d115cdb2325e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.167431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad186d-b46b-4188-9551-d115cdb2325e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.167783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad186d-b46b-4188-9551-d115cdb2325e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.168125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad186d-b46b-4188-9551-d115cdb2325e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.168863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad186d-b46b-4188-9551-d115cdb2325e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.169972 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-1cad186d-b46b-4188-9551-d115cdb2325e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_domain_config_default failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:17:19.169972 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:17:19.169972 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:17:19.171030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad186d-b46b-4188-9551-d115cdb2325e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.172428 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3754/7531] 10.222.0.21 () {58 vars in 1199 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.176397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893268c3-a917-4c11-aa1c-db7f2b235429 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.186226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893268c3-a917-4c11-aa1c-db7f2b235429 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.190795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82419221-7fda-40ca-84a6-38617ddfec4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.191590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82419221-7fda-40ca-84a6-38617ddfec4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.191874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82419221-7fda-40ca-84a6-38617ddfec4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.192147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82419221-7fda-40ca-84a6-38617ddfec4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.192812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82419221-7fda-40ca-84a6-38617ddfec4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.194380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82419221-7fda-40ca-84a6-38617ddfec4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.195525 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3778/7532] 10.222.0.21 () {58 vars in 1220 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:19.200163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad186d-b46b-4188-9551-d115cdb2325e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.210034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad186d-b46b-4188-9551-d115cdb2325e tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.215231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4066c0-ac8d-436c-9c4e-cf8f006a40ca tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.216032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4066c0-ac8d-436c-9c4e-cf8f006a40ca tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.216312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4066c0-ac8d-436c-9c4e-cf8f006a40ca tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.216587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4066c0-ac8d-436c-9c4e-cf8f006a40ca tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.217393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4066c0-ac8d-436c-9c4e-cf8f006a40ca tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.218982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4066c0-ac8d-436c-9c4e-cf8f006a40ca tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.220116 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3755/7533] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.223932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82419221-7fda-40ca-84a6-38617ddfec4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.233706 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82419221-7fda-40ca-84a6-38617ddfec4a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.238302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdd990-68e9-4d4b-86e3-52e7ce6f1195 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.239034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdd990-68e9-4d4b-86e3-52e7ce6f1195 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.239359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdd990-68e9-4d4b-86e3-52e7ce6f1195 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.239878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdd990-68e9-4d4b-86e3-52e7ce6f1195 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.240545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdd990-68e9-4d4b-86e3-52e7ce6f1195 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.242107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdd990-68e9-4d4b-86e3-52e7ce6f1195 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.243666 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3779/7534] 10.222.0.21 () {58 vars in 1187 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:19.247765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4066c0-ac8d-436c-9c4e-cf8f006a40ca tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.257896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4066c0-ac8d-436c-9c4e-cf8f006a40ca tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.263142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a32b3-b818-488b-b311-eb08f3ff4789 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.263938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a32b3-b818-488b-b311-eb08f3ff4789 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.264219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a32b3-b818-488b-b311-eb08f3ff4789 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.264497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a32b3-b818-488b-b311-eb08f3ff4789 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.265166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a32b3-b818-488b-b311-eb08f3ff4789 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.266764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a32b3-b818-488b-b311-eb08f3ff4789 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.268030 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3756/7535] 10.222.0.21 () {58 vars in 1199 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.271965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdd990-68e9-4d4b-86e3-52e7ce6f1195 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.282728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdd990-68e9-4d4b-86e3-52e7ce6f1195 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.287527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98163c5-7076-41ca-8792-850c2dd06df8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.288290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98163c5-7076-41ca-8792-850c2dd06df8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.288583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98163c5-7076-41ca-8792-850c2dd06df8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.288863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98163c5-7076-41ca-8792-850c2dd06df8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.289551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98163c5-7076-41ca-8792-850c2dd06df8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.291175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98163c5-7076-41ca-8792-850c2dd06df8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.292397 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3780/7536] 10.222.0.21 () {58 vars in 1202 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.296220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a32b3-b818-488b-b311-eb08f3ff4789 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.306501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a32b3-b818-488b-b311-eb08f3ff4789 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.311278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe923975-6198-405d-beb1-52049b704fe4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.312259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe923975-6198-405d-beb1-52049b704fe4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.312553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe923975-6198-405d-beb1-52049b704fe4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.312834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe923975-6198-405d-beb1-52049b704fe4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.313506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe923975-6198-405d-beb1-52049b704fe4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.315107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe923975-6198-405d-beb1-52049b704fe4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.316525 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3757/7537] 10.222.0.21 () {58 vars in 1208 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.320512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98163c5-7076-41ca-8792-850c2dd06df8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.331784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98163c5-7076-41ca-8792-850c2dd06df8 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.336732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef30b79-f8f9-4057-912a-4d7272d4a7d9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.337501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef30b79-f8f9-4057-912a-4d7272d4a7d9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.337782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef30b79-f8f9-4057-912a-4d7272d4a7d9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.338058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef30b79-f8f9-4057-912a-4d7272d4a7d9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.339385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef30b79-f8f9-4057-912a-4d7272d4a7d9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.340966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef30b79-f8f9-4057-912a-4d7272d4a7d9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.342246 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3781/7538] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:19.345894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe923975-6198-405d-beb1-52049b704fe4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.355786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe923975-6198-405d-beb1-52049b704fe4 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.360440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a289186-39ca-448a-9377-76488f03e963 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.361197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289186-39ca-448a-9377-76488f03e963 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.361486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289186-39ca-448a-9377-76488f03e963 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.361759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289186-39ca-448a-9377-76488f03e963 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.362449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a289186-39ca-448a-9377-76488f03e963 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.364079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a289186-39ca-448a-9377-76488f03e963 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.365519 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3758/7539] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.369454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef30b79-f8f9-4057-912a-4d7272d4a7d9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.380449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef30b79-f8f9-4057-912a-4d7272d4a7d9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.386518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6fdb8-f327-4912-b46b-8d5a7cafb257 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.387475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6fdb8-f327-4912-b46b-8d5a7cafb257 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.387768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6fdb8-f327-4912-b46b-8d5a7cafb257 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.388049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6fdb8-f327-4912-b46b-8d5a7cafb257 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.388725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6fdb8-f327-4912-b46b-8d5a7cafb257 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.390331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6fdb8-f327-4912-b46b-8d5a7cafb257 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.394759 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3782/7540] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:19.395719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a289186-39ca-448a-9377-76488f03e963 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.407021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a289186-39ca-448a-9377-76488f03e963 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.411750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca079790-c1c9-4800-b24a-d34e8aac60a2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.412524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca079790-c1c9-4800-b24a-d34e8aac60a2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.412802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca079790-c1c9-4800-b24a-d34e8aac60a2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.413081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca079790-c1c9-4800-b24a-d34e8aac60a2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.413819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca079790-c1c9-4800-b24a-d34e8aac60a2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.418047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca079790-c1c9-4800-b24a-d34e8aac60a2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.420257 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3759/7541] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.425375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6fdb8-f327-4912-b46b-8d5a7cafb257 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.435849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6fdb8-f327-4912-b46b-8d5a7cafb257 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.441067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45be88-3a1b-41ce-926a-efdfe0a4c36f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.441924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45be88-3a1b-41ce-926a-efdfe0a4c36f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.442267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45be88-3a1b-41ce-926a-efdfe0a4c36f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.442603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45be88-3a1b-41ce-926a-efdfe0a4c36f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.443373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45be88-3a1b-41ce-926a-efdfe0a4c36f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.444985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45be88-3a1b-41ce-926a-efdfe0a4c36f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.446145 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3783/7542] 10.222.0.21 () {58 vars in 1235 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.450950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca079790-c1c9-4800-b24a-d34e8aac60a2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.460771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca079790-c1c9-4800-b24a-d34e8aac60a2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.465435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f89f06-2761-4738-9646-b4ecce9f07cc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.466194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89f06-2761-4738-9646-b4ecce9f07cc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.466473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89f06-2761-4738-9646-b4ecce9f07cc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.466746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89f06-2761-4738-9646-b4ecce9f07cc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.467440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f89f06-2761-4738-9646-b4ecce9f07cc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.469031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f89f06-2761-4738-9646-b4ecce9f07cc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.470200 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3760/7543] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.474002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45be88-3a1b-41ce-926a-efdfe0a4c36f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.483692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45be88-3a1b-41ce-926a-efdfe0a4c36f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.488317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a61a0-36eb-4b09-b3da-43e7316407ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.489070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a61a0-36eb-4b09-b3da-43e7316407ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.489352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a61a0-36eb-4b09-b3da-43e7316407ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.489881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a61a0-36eb-4b09-b3da-43e7316407ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.490546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a61a0-36eb-4b09-b3da-43e7316407ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.492150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a61a0-36eb-4b09-b3da-43e7316407ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.493245 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3784/7544] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:19.498199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f89f06-2761-4738-9646-b4ecce9f07cc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.508608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f89f06-2761-4738-9646-b4ecce9f07cc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.513980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372694-8fb7-4316-b2db-d70b25d97569 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.514836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372694-8fb7-4316-b2db-d70b25d97569 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.515195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372694-8fb7-4316-b2db-d70b25d97569 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.515575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372694-8fb7-4316-b2db-d70b25d97569 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.516305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b372694-8fb7-4316-b2db-d70b25d97569 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.518096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b372694-8fb7-4316-b2db-d70b25d97569 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.519439 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3761/7545] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.523445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a61a0-36eb-4b09-b3da-43e7316407ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.533434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a61a0-36eb-4b09-b3da-43e7316407ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.538050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e896f-fd9a-4563-ab93-b3fcee5bf75d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.538819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e896f-fd9a-4563-ab93-b3fcee5bf75d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.539099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e896f-fd9a-4563-ab93-b3fcee5bf75d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.539410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e896f-fd9a-4563-ab93-b3fcee5bf75d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.540098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e896f-fd9a-4563-ab93-b3fcee5bf75d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.541666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e896f-fd9a-4563-ab93-b3fcee5bf75d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.542803 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3785/7546] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.546615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372694-8fb7-4316-b2db-d70b25d97569 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.557099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372694-8fb7-4316-b2db-d70b25d97569 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.562887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbad0c-8cd7-4c6b-aaae-1defea2557f7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.563775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbad0c-8cd7-4c6b-aaae-1defea2557f7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.564061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbad0c-8cd7-4c6b-aaae-1defea2557f7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.564367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbbad0c-8cd7-4c6b-aaae-1defea2557f7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.565198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbad0c-8cd7-4c6b-aaae-1defea2557f7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.566800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbbad0c-8cd7-4c6b-aaae-1defea2557f7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.568176 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3762/7547] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.572017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e896f-fd9a-4563-ab93-b3fcee5bf75d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.583107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e896f-fd9a-4563-ab93-b3fcee5bf75d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.587835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10703a-4d24-4613-882c-9d95477ac657 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.588684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10703a-4d24-4613-882c-9d95477ac657 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.588968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10703a-4d24-4613-882c-9d95477ac657 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.589243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10703a-4d24-4613-882c-9d95477ac657 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.589906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10703a-4d24-4613-882c-9d95477ac657 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.591502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10703a-4d24-4613-882c-9d95477ac657 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.592594 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3786/7548] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:19.596317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbad0c-8cd7-4c6b-aaae-1defea2557f7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.606110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbbad0c-8cd7-4c6b-aaae-1defea2557f7 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.610767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266c0e2-e1cd-4b85-a620-d36576748dfb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.611588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266c0e2-e1cd-4b85-a620-d36576748dfb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.611870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266c0e2-e1cd-4b85-a620-d36576748dfb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.612143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266c0e2-e1cd-4b85-a620-d36576748dfb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.612802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266c0e2-e1cd-4b85-a620-d36576748dfb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.614373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266c0e2-e1cd-4b85-a620-d36576748dfb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.615847 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3763/7549] 10.222.0.21 () {58 vars in 1268 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.619564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10703a-4d24-4613-882c-9d95477ac657 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.629723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10703a-4d24-4613-882c-9d95477ac657 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.634329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba384f73-c9ad-48f6-a30e-01fec7b28fc9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.635085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba384f73-c9ad-48f6-a30e-01fec7b28fc9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.635405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba384f73-c9ad-48f6-a30e-01fec7b28fc9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.636272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba384f73-c9ad-48f6-a30e-01fec7b28fc9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.636936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba384f73-c9ad-48f6-a30e-01fec7b28fc9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.638533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba384f73-c9ad-48f6-a30e-01fec7b28fc9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.639664 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3787/7550] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.643441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266c0e2-e1cd-4b85-a620-d36576748dfb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.653919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266c0e2-e1cd-4b85-a620-d36576748dfb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.658922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fcbab-fd39-4336-acf1-b61c04db959a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.659782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fcbab-fd39-4336-acf1-b61c04db959a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.660066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fcbab-fd39-4336-acf1-b61c04db959a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.660345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fcbab-fd39-4336-acf1-b61c04db959a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.661091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fcbab-fd39-4336-acf1-b61c04db959a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.662804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fcbab-fd39-4336-acf1-b61c04db959a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.664096 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3764/7551] 10.222.0.21 () {58 vars in 1256 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.668610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba384f73-c9ad-48f6-a30e-01fec7b28fc9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.678465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba384f73-c9ad-48f6-a30e-01fec7b28fc9 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.683824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c14f13-8bad-49fa-a806-82496d4ab0bd tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.684474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c14f13-8bad-49fa-a806-82496d4ab0bd tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.684757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c14f13-8bad-49fa-a806-82496d4ab0bd tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.685090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c14f13-8bad-49fa-a806-82496d4ab0bd tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.685742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c14f13-8bad-49fa-a806-82496d4ab0bd tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.687560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c14f13-8bad-49fa-a806-82496d4ab0bd tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.688497 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3788/7552] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:19.692201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fcbab-fd39-4336-acf1-b61c04db959a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.703363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fcbab-fd39-4336-acf1-b61c04db959a tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.708785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b8960-ed48-48b5-a194-302acb754955 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.709600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b8960-ed48-48b5-a194-302acb754955 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.710012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b8960-ed48-48b5-a194-302acb754955 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.710301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b8960-ed48-48b5-a194-302acb754955 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.710984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b8960-ed48-48b5-a194-302acb754955 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.712663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b8960-ed48-48b5-a194-302acb754955 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.713886 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3765/7553] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:19.717793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c14f13-8bad-49fa-a806-82496d4ab0bd tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.728116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c14f13-8bad-49fa-a806-82496d4ab0bd tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.732924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9aba6-35b5-4e27-9d9f-34959ac8b465 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.733695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9aba6-35b5-4e27-9d9f-34959ac8b465 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.734004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9aba6-35b5-4e27-9d9f-34959ac8b465 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.734284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9aba6-35b5-4e27-9d9f-34959ac8b465 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.734946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9aba6-35b5-4e27-9d9f-34959ac8b465 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.736558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9aba6-35b5-4e27-9d9f-34959ac8b465 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.737797 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3789/7554] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.741811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b8960-ed48-48b5-a194-302acb754955 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.752772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b8960-ed48-48b5-a194-302acb754955 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.757364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4b9b8-515c-47b5-9b4b-6e04aa55b1ea tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.758142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4b9b8-515c-47b5-9b4b-6e04aa55b1ea tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.758421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4b9b8-515c-47b5-9b4b-6e04aa55b1ea tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.758695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4b9b8-515c-47b5-9b4b-6e04aa55b1ea tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.759395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4b9b8-515c-47b5-9b4b-6e04aa55b1ea tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.761595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4b9b8-515c-47b5-9b4b-6e04aa55b1ea tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.762836 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3766/7555] 10.222.0.21 () {58 vars in 1253 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.766751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9aba6-35b5-4e27-9d9f-34959ac8b465 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.776797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9aba6-35b5-4e27-9d9f-34959ac8b465 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.782138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91452942-2e53-4323-8d1b-64e081c3c232 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.782935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452942-2e53-4323-8d1b-64e081c3c232 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.783295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452942-2e53-4323-8d1b-64e081c3c232 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.783854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452942-2e53-4323-8d1b-64e081c3c232 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.784201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91452942-2e53-4323-8d1b-64e081c3c232 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.785795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91452942-2e53-4323-8d1b-64e081c3c232 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.787285 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3790/7556] 10.222.0.21 () {58 vars in 1289 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.790860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4b9b8-515c-47b5-9b4b-6e04aa55b1ea tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.801221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4b9b8-515c-47b5-9b4b-6e04aa55b1ea tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.806032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9e1e9-5b87-4943-8b71-6d57d6b0ee0b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.806811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9e1e9-5b87-4943-8b71-6d57d6b0ee0b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.807096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9e1e9-5b87-4943-8b71-6d57d6b0ee0b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.807969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9e1e9-5b87-4943-8b71-6d57d6b0ee0b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.808637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9e1e9-5b87-4943-8b71-6d57d6b0ee0b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.810233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9e1e9-5b87-4943-8b71-6d57d6b0ee0b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.811467 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3767/7557] 10.222.0.21 () {58 vars in 1256 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.815580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91452942-2e53-4323-8d1b-64e081c3c232 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.825963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91452942-2e53-4323-8d1b-64e081c3c232 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.830693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229230fb-b7de-42e6-a78b-17fb278d66af tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.831513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229230fb-b7de-42e6-a78b-17fb278d66af tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.831804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229230fb-b7de-42e6-a78b-17fb278d66af tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.832083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229230fb-b7de-42e6-a78b-17fb278d66af tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.832766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229230fb-b7de-42e6-a78b-17fb278d66af tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.834355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229230fb-b7de-42e6-a78b-17fb278d66af tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.835507 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3791/7558] 10.222.0.21 () {58 vars in 1265 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.839490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9e1e9-5b87-4943-8b71-6d57d6b0ee0b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.849312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9e1e9-5b87-4943-8b71-6d57d6b0ee0b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.853973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc6753-e953-4bde-babb-961622982374 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.855357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc6753-e953-4bde-babb-961622982374 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.855643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc6753-e953-4bde-babb-961622982374 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.855921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc6753-e953-4bde-babb-961622982374 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.856586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc6753-e953-4bde-babb-961622982374 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.858178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc6753-e953-4bde-babb-961622982374 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.859430 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3768/7559] 10.222.0.21 () {58 vars in 1307 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.863340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229230fb-b7de-42e6-a78b-17fb278d66af tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.874142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229230fb-b7de-42e6-a78b-17fb278d66af tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.879118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd063d1-ed4e-4f3d-9475-11f62235ed41 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.879958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd063d1-ed4e-4f3d-9475-11f62235ed41 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.880249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd063d1-ed4e-4f3d-9475-11f62235ed41 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.880531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd063d1-ed4e-4f3d-9475-11f62235ed41 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.881328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd063d1-ed4e-4f3d-9475-11f62235ed41 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.882924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd063d1-ed4e-4f3d-9475-11f62235ed41 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.886800 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3792/7560] 10.222.0.21 () {58 vars in 1289 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.887991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc6753-e953-4bde-babb-961622982374 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.898015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc6753-e953-4bde-babb-961622982374 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.902891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c5f1d-3d7b-40ac-a72f-6c85298a9908 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.903807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5f1d-3d7b-40ac-a72f-6c85298a9908 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.904223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5f1d-3d7b-40ac-a72f-6c85298a9908 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.904528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c5f1d-3d7b-40ac-a72f-6c85298a9908 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.905276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c5f1d-3d7b-40ac-a72f-6c85298a9908 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.906958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c5f1d-3d7b-40ac-a72f-6c85298a9908 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.908530 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3769/7561] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.912318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd063d1-ed4e-4f3d-9475-11f62235ed41 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.922533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd063d1-ed4e-4f3d-9475-11f62235ed41 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.927308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af58eb-907d-4fac-a6e1-5df1df2711bc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.928425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af58eb-907d-4fac-a6e1-5df1df2711bc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.928715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af58eb-907d-4fac-a6e1-5df1df2711bc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.928993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af58eb-907d-4fac-a6e1-5df1df2711bc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.929659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af58eb-907d-4fac-a6e1-5df1df2711bc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.931275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af58eb-907d-4fac-a6e1-5df1df2711bc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.933107 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3793/7562] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:19.936763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c5f1d-3d7b-40ac-a72f-6c85298a9908 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.946547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c5f1d-3d7b-40ac-a72f-6c85298a9908 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.951351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa44fbb-9bda-468b-abf8-462f056aebe1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.952123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44fbb-9bda-468b-abf8-462f056aebe1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.952420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44fbb-9bda-468b-abf8-462f056aebe1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.952698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44fbb-9bda-468b-abf8-462f056aebe1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.953363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa44fbb-9bda-468b-abf8-462f056aebe1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.954963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa44fbb-9bda-468b-abf8-462f056aebe1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.956216 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3770/7563] 10.222.0.21 () {58 vars in 1241 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.960055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af58eb-907d-4fac-a6e1-5df1df2711bc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.970318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af58eb-907d-4fac-a6e1-5df1df2711bc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:19.975045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff961159-775e-4c4e-9395-29c1b789625c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:19.975853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff961159-775e-4c4e-9395-29c1b789625c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:19.976140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff961159-775e-4c4e-9395-29c1b789625c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:19.976445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff961159-775e-4c4e-9395-29c1b789625c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:19.977114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff961159-775e-4c4e-9395-29c1b789625c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:19.978694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff961159-775e-4c4e-9395-29c1b789625c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:19.980509 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3794/7564] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:19.984303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa44fbb-9bda-468b-abf8-462f056aebe1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:19.994595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa44fbb-9bda-468b-abf8-462f056aebe1 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.000445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9bd52-baf6-4216-a8ff-9f4f00ec87e3 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.001298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9bd52-baf6-4216-a8ff-9f4f00ec87e3 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.001590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9bd52-baf6-4216-a8ff-9f4f00ec87e3 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.001865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9bd52-baf6-4216-a8ff-9f4f00ec87e3 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.002527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9bd52-baf6-4216-a8ff-9f4f00ec87e3 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.004215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9bd52-baf6-4216-a8ff-9f4f00ec87e3 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.005471 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3771/7565] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:19 2021] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:20.009316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff961159-775e-4c4e-9395-29c1b789625c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.019488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff961159-775e-4c4e-9395-29c1b789625c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.024275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93ef39-05ce-40a5-bdde-2f8e1df857ec tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.025142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93ef39-05ce-40a5-bdde-2f8e1df857ec tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.025502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93ef39-05ce-40a5-bdde-2f8e1df857ec tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.025855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93ef39-05ce-40a5-bdde-2f8e1df857ec tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.026667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93ef39-05ce-40a5-bdde-2f8e1df857ec tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.028351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93ef39-05ce-40a5-bdde-2f8e1df857ec tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.029690 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3795/7566] 10.222.0.21 () {58 vars in 1253 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.033462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9bd52-baf6-4216-a8ff-9f4f00ec87e3 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.044038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9bd52-baf6-4216-a8ff-9f4f00ec87e3 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.048724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9683a-fbed-4048-9948-975dfe4cbf7d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.049504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9683a-fbed-4048-9948-975dfe4cbf7d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.049786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9683a-fbed-4048-9948-975dfe4cbf7d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.050063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9683a-fbed-4048-9948-975dfe4cbf7d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.050727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9683a-fbed-4048-9948-975dfe4cbf7d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.052346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9683a-fbed-4048-9948-975dfe4cbf7d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.056289 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3772/7567] 10.222.0.21 () {58 vars in 1256 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.058016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93ef39-05ce-40a5-bdde-2f8e1df857ec tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.067726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93ef39-05ce-40a5-bdde-2f8e1df857ec tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.072481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c38a5f-d673-4a4e-8374-12190b83eb5c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.073275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c38a5f-d673-4a4e-8374-12190b83eb5c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.073559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c38a5f-d673-4a4e-8374-12190b83eb5c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.073834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c38a5f-d673-4a4e-8374-12190b83eb5c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.074524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c38a5f-d673-4a4e-8374-12190b83eb5c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.076118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c38a5f-d673-4a4e-8374-12190b83eb5c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.077217 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3796/7568] 10.222.0.21 () {58 vars in 1250 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.081028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9683a-fbed-4048-9948-975dfe4cbf7d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.090778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9683a-fbed-4048-9948-975dfe4cbf7d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.095395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5324a3b-48f1-4b34-abb3-7b770387e02d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.096218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5324a3b-48f1-4b34-abb3-7b770387e02d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.096521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5324a3b-48f1-4b34-abb3-7b770387e02d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.096868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5324a3b-48f1-4b34-abb3-7b770387e02d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.097559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5324a3b-48f1-4b34-abb3-7b770387e02d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.099822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5324a3b-48f1-4b34-abb3-7b770387e02d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.101180 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3773/7569] 10.222.0.21 () {58 vars in 1256 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.106080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c38a5f-d673-4a4e-8374-12190b83eb5c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.119327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c38a5f-d673-4a4e-8374-12190b83eb5c tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.125388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd336bd-0a58-4be8-a932-6e2edbd5c39b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.126263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd336bd-0a58-4be8-a932-6e2edbd5c39b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.126623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd336bd-0a58-4be8-a932-6e2edbd5c39b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.126893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd336bd-0a58-4be8-a932-6e2edbd5c39b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.127813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd336bd-0a58-4be8-a932-6e2edbd5c39b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.129630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd336bd-0a58-4be8-a932-6e2edbd5c39b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.130930 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3797/7570] 10.222.0.21 () {58 vars in 1292 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:20.135447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5324a3b-48f1-4b34-abb3-7b770387e02d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.145243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5324a3b-48f1-4b34-abb3-7b770387e02d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.149809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173b77d-d35b-4699-a7a8-0e98d6012efb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.150569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173b77d-d35b-4699-a7a8-0e98d6012efb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.150851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173b77d-d35b-4699-a7a8-0e98d6012efb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.151796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173b77d-d35b-4699-a7a8-0e98d6012efb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.152467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173b77d-d35b-4699-a7a8-0e98d6012efb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.154059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173b77d-d35b-4699-a7a8-0e98d6012efb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.155457 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3774/7571] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.159220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd336bd-0a58-4be8-a932-6e2edbd5c39b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.170172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd336bd-0a58-4be8-a932-6e2edbd5c39b tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.175400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635c2c7-96e8-4620-8a89-d240c2f6b627 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.176179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635c2c7-96e8-4620-8a89-d240c2f6b627 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.176467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635c2c7-96e8-4620-8a89-d240c2f6b627 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.176751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635c2c7-96e8-4620-8a89-d240c2f6b627 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.177422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635c2c7-96e8-4620-8a89-d240c2f6b627 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.179022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635c2c7-96e8-4620-8a89-d240c2f6b627 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.180215 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3798/7572] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.184226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173b77d-d35b-4699-a7a8-0e98d6012efb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.194540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173b77d-d35b-4699-a7a8-0e98d6012efb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.199512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baee8e-ebb5-4da2-948b-9488dd8d33de tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.200276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baee8e-ebb5-4da2-948b-9488dd8d33de tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.200561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baee8e-ebb5-4da2-948b-9488dd8d33de tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.200863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baee8e-ebb5-4da2-948b-9488dd8d33de tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.201522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baee8e-ebb5-4da2-948b-9488dd8d33de tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.203127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baee8e-ebb5-4da2-948b-9488dd8d33de tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.204375 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3775/7573] 10.222.0.21 () {58 vars in 1211 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.208293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635c2c7-96e8-4620-8a89-d240c2f6b627 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.218674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635c2c7-96e8-4620-8a89-d240c2f6b627 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.223377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe597976-05b3-4abb-bf6b-ba59d66d1260 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.224187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597976-05b3-4abb-bf6b-ba59d66d1260 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.224537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597976-05b3-4abb-bf6b-ba59d66d1260 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.224876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597976-05b3-4abb-bf6b-ba59d66d1260 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.225634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe597976-05b3-4abb-bf6b-ba59d66d1260 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.227209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe597976-05b3-4abb-bf6b-ba59d66d1260 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.228354 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3799/7574] 10.222.0.21 () {58 vars in 1226 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:20.232789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baee8e-ebb5-4da2-948b-9488dd8d33de tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.242652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baee8e-ebb5-4da2-948b-9488dd8d33de tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.247764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539ecef-d47b-4ef8-8aac-f6858a54dca2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.248030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539ecef-d47b-4ef8-8aac-f6858a54dca2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.248314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539ecef-d47b-4ef8-8aac-f6858a54dca2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.248616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539ecef-d47b-4ef8-8aac-f6858a54dca2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.249277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539ecef-d47b-4ef8-8aac-f6858a54dca2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.250941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539ecef-d47b-4ef8-8aac-f6858a54dca2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.252305 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3776/7575] 10.222.0.21 () {58 vars in 1214 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.256149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe597976-05b3-4abb-bf6b-ba59d66d1260 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.266458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe597976-05b3-4abb-bf6b-ba59d66d1260 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.271554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c5b49-dc1b-4b0f-ae54-ad36a375ed26 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.272559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5b49-dc1b-4b0f-ae54-ad36a375ed26 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.272857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5b49-dc1b-4b0f-ae54-ad36a375ed26 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.273195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c5b49-dc1b-4b0f-ae54-ad36a375ed26 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.274033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c5b49-dc1b-4b0f-ae54-ad36a375ed26 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.275749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c5b49-dc1b-4b0f-ae54-ad36a375ed26 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.280354 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3800/7576] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.281517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539ecef-d47b-4ef8-8aac-f6858a54dca2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.292483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539ecef-d47b-4ef8-8aac-f6858a54dca2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.297260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731967b0-5535-43e7-b0cf-b40eb6296dbb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.298032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731967b0-5535-43e7-b0cf-b40eb6296dbb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.298316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731967b0-5535-43e7-b0cf-b40eb6296dbb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.298613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731967b0-5535-43e7-b0cf-b40eb6296dbb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.299303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731967b0-5535-43e7-b0cf-b40eb6296dbb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.300930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731967b0-5535-43e7-b0cf-b40eb6296dbb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.302149 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3777/7577] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:20.306226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c5b49-dc1b-4b0f-ae54-ad36a375ed26 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.317411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c5b49-dc1b-4b0f-ae54-ad36a375ed26 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.323653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4686d9-7e47-4132-b845-374db43f4ddc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.324435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4686d9-7e47-4132-b845-374db43f4ddc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.324837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4686d9-7e47-4132-b845-374db43f4ddc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.325123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4686d9-7e47-4132-b845-374db43f4ddc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.325825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4686d9-7e47-4132-b845-374db43f4ddc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.327493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4686d9-7e47-4132-b845-374db43f4ddc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.328630 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3801/7578] 10.222.0.21 () {58 vars in 1238 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.332710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731967b0-5535-43e7-b0cf-b40eb6296dbb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.343086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731967b0-5535-43e7-b0cf-b40eb6296dbb tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.347741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6edb2-450a-4746-8742-dc3ab8c163cf tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.348520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6edb2-450a-4746-8742-dc3ab8c163cf tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.348833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6edb2-450a-4746-8742-dc3ab8c163cf tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.349110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6edb2-450a-4746-8742-dc3ab8c163cf tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.349806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6edb2-450a-4746-8742-dc3ab8c163cf tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.351429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6edb2-450a-4746-8742-dc3ab8c163cf tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.352783 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3778/7579] 10.222.0.21 () {58 vars in 1259 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.357257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4686d9-7e47-4132-b845-374db43f4ddc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.368319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4686d9-7e47-4132-b845-374db43f4ddc tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.373705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09ae49-1c3e-4194-bfc6-b568d397d3ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.374553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09ae49-1c3e-4194-bfc6-b568d397d3ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.374791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09ae49-1c3e-4194-bfc6-b568d397d3ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.375075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09ae49-1c3e-4194-bfc6-b568d397d3ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.376117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09ae49-1c3e-4194-bfc6-b568d397d3ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.377721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09ae49-1c3e-4194-bfc6-b568d397d3ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.382136 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3802/7580] 10.222.0.21 () {58 vars in 1262 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:20.383481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6edb2-450a-4746-8742-dc3ab8c163cf tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.394317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6edb2-450a-4746-8742-dc3ab8c163cf tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.399463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de85816-7c78-4ac9-9bd6-a4b8726ac371 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.400515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de85816-7c78-4ac9-9bd6-a4b8726ac371 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.400733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de85816-7c78-4ac9-9bd6-a4b8726ac371 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.401577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de85816-7c78-4ac9-9bd6-a4b8726ac371 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.402541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de85816-7c78-4ac9-9bd6-a4b8726ac371 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.405002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de85816-7c78-4ac9-9bd6-a4b8726ac371 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.409646 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3779/7581] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.410571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09ae49-1c3e-4194-bfc6-b568d397d3ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.421793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09ae49-1c3e-4194-bfc6-b568d397d3ee tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.426637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32d489-9e00-4eae-beda-e1daf9b35e16 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.427485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d489-9e00-4eae-beda-e1daf9b35e16 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.427778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d489-9e00-4eae-beda-e1daf9b35e16 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.428195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32d489-9e00-4eae-beda-e1daf9b35e16 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.428998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32d489-9e00-4eae-beda-e1daf9b35e16 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.430612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32d489-9e00-4eae-beda-e1daf9b35e16 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.434870 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3803/7582] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 27 21:17:20.436311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de85816-7c78-4ac9-9bd6-a4b8726ac371 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.447621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de85816-7c78-4ac9-9bd6-a4b8726ac371 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.453913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e5fc3-6d6f-4765-a2a2-59a4681d8c4d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.454721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5fc3-6d6f-4765-a2a2-59a4681d8c4d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.455007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5fc3-6d6f-4765-a2a2-59a4681d8c4d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.455324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e5fc3-6d6f-4765-a2a2-59a4681d8c4d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.456003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e5fc3-6d6f-4765-a2a2-59a4681d8c4d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.457614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e5fc3-6d6f-4765-a2a2-59a4681d8c4d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.461947 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3780/7583] 10.222.0.21 () {58 vars in 1277 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:17:20.467806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32d489-9e00-4eae-beda-e1daf9b35e16 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.478190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32d489-9e00-4eae-beda-e1daf9b35e16 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.483640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda62c14-eec3-463f-927b-9b377635a026 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.484481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62c14-eec3-463f-927b-9b377635a026 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.484764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62c14-eec3-463f-927b-9b377635a026 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.485161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda62c14-eec3-463f-927b-9b377635a026 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/d415ed04c556411e9f70f95a22412686` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.493275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda62c14-eec3-463f-927b-9b377635a026 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 21:17:20.502206 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-bda62c14-eec3-463f-927b-9b377635a026 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Could not find domain: d415ed04c556411e9f70f95a22412686.: keystone.exception.DomainNotFound: Could not find domain: d415ed04c556411e9f70f95a22412686. Nov 27 21:17:20.503404 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3804/7584] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:17:20 2021] PATCH /identity/v3/domains/d415ed04c556411e9f70f95a22412686 => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:17:20.507497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e5fc3-6d6f-4765-a2a2-59a4681d8c4d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.518091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e5fc3-6d6f-4765-a2a2-59a4681d8c4d tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.522912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c03e44-c722-4b73-b95a-1bc48dd2ec9f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.523789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03e44-c722-4b73-b95a-1bc48dd2ec9f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.524072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03e44-c722-4b73-b95a-1bc48dd2ec9f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.524345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03e44-c722-4b73-b95a-1bc48dd2ec9f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.532671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c03e44-c722-4b73-b95a-1bc48dd2ec9f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 21:17:20.541872 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-54c03e44-c722-4b73-b95a-1bc48dd2ec9f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Could not find domain: 4464d10cfbfe4e80afab1c3ca9bb12de.: keystone.exception.DomainNotFound: Could not find domain: 4464d10cfbfe4e80afab1c3ca9bb12de. Nov 27 21:17:20.543056 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3781/7585] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:17:20 2021] PATCH /identity/v3/domains/4464d10cfbfe4e80afab1c3ca9bb12de => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:17:20.547277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda62c14-eec3-463f-927b-9b377635a026 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.557517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda62c14-eec3-463f-927b-9b377635a026 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.562323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e8b88-b4dc-4b30-8537-616493c0d3d2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf661c0d02d4f6084e00d8ef15efec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23687557c6194cf188592d4dd8af730f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.563167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8b88-b4dc-4b30-8537-616493c0d3d2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.563513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8b88-b4dc-4b30-8537-616493c0d3d2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.563796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8b88-b4dc-4b30-8537-616493c0d3d2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] PATH_INFO: `/v3/domains/51aa20ce212e46d89ff3603bed03ab27` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.570886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e8b88-b4dc-4b30-8537-616493c0d3d2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 27 21:17:20.580335 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-605e8b88-b4dc-4b30-8537-616493c0d3d2 tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Could not find domain: 51aa20ce212e46d89ff3603bed03ab27.: keystone.exception.DomainNotFound: Could not find domain: 51aa20ce212e46d89ff3603bed03ab27. Nov 27 21:17:20.584494 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3805/7586] 10.222.0.21 () {60 vars in 1248 bytes} [Sat Nov 27 21:17:20 2021] PATCH /identity/v3/domains/51aa20ce212e46d89ff3603bed03ab27 => generated 112 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:17:20.585633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c03e44-c722-4b73-b95a-1bc48dd2ec9f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.587522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-54c03e44-c722-4b73-b95a-1bc48dd2ec9f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:20.653695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c03e44-c722-4b73-b95a-1bc48dd2ec9f tempest-DomainConfigurationTestJSON-1738763166 tempest-DomainConfigurationTestJSON-1738763166-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.658728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.659627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.659961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.660184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] PATH_INFO: `/v3/users/b8f2eaec2cbd4cc1a14886d1118a163d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.661621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f2eaec2cbd4cc1a14886d1118a163d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.663857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.711562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f2eaec2cbd4cc1a14886d1118a163d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:20.712295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f2eaec2cbd4cc1a14886d1118a163d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:20.720314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f2eaec2cbd4cc1a14886d1118a163d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:20.721317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f2eaec2cbd4cc1a14886d1118a163d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:20.728140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f2eaec2cbd4cc1a14886d1118a163d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:20.747899 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3782/7587] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:20 2021] DELETE /identity/v3/users/b8f2eaec2cbd4cc1a14886d1118a163d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:20.752441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde381-1974-4ba0-a484-01520daae35c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.752729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde381-1974-4ba0-a484-01520daae35c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.753001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde381-1974-4ba0-a484-01520daae35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.771967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-42cde381-1974-4ba0-a484-01520daae35c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:20.773328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-42cde381-1974-4ba0-a484-01520daae35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:20.832937 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3806/7588] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:20.845906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:20.847835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:20.918032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7cb27-2bdb-4c62-8f8b-9fca4e5f8e0f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:20.922308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabde0a-0f17-4f81-9140-71650e8afce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:20.922956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabde0a-0f17-4f81-9140-71650e8afce5 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:20.923242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabde0a-0f17-4f81-9140-71650e8afce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:20.923551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabde0a-0f17-4f81-9140-71650e8afce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:20.934852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabde0a-0f17-4f81-9140-71650e8afce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:20.936408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabde0a-0f17-4f81-9140-71650e8afce5 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:20.946967 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3783/7589] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:21.421338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde381-1974-4ba0-a484-01520daae35c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:21.423366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-42cde381-1974-4ba0-a484-01520daae35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:21.437998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde381-1974-4ba0-a484-01520daae35c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:21.443197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:21.444466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:21.444931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:21.445377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] PATH_INFO: `/v3/projects/8a0453c1637f41fba303fae2bad24e42` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:21.446781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0453c1637f41fba303fae2bad24e42)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:21.449859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:21.518567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0453c1637f41fba303fae2bad24e42', 'request_id': 'req-d1eb5502-2e79-4b1e-b71e-998f982fdfee'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:21.527457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0453c1637f41fba303fae2bad24e42', 'request_id': 'req-d1eb5502-2e79-4b1e-b71e-998f982fdfee'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:21.539290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0453c1637f41fba303fae2bad24e42', 'request_id': 'req-d1eb5502-2e79-4b1e-b71e-998f982fdfee'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:21.551645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] The token cache is being invalidate because project 8a0453c1637f41fba303fae2bad24e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:21.551944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:21.552729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:21.554229 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3807/7590] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:21 2021] DELETE /identity/v3/projects/8a0453c1637f41fba303fae2bad24e42 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:21.558073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabde0a-0f17-4f81-9140-71650e8afce5 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:21.568714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabde0a-0f17-4f81-9140-71650e8afce5 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:21.630957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87903f3b-87b0-45ea-a747-22e307260c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:21.632648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87903f3b-87b0-45ea-a747-22e307260c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:21.633113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87903f3b-87b0-45ea-a747-22e307260c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:21.633561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87903f3b-87b0-45ea-a747-22e307260c49 admin admin] PATH_INFO: `/v3/users/baf661c0d02d4f6084e00d8ef15efec5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:21.634985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87903f3b-87b0-45ea-a747-22e307260c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf661c0d02d4f6084e00d8ef15efec5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:21.637513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87903f3b-87b0-45ea-a747-22e307260c49 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:21.689757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-87903f3b-87b0-45ea-a747-22e307260c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf661c0d02d4f6084e00d8ef15efec5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:21.690495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-87903f3b-87b0-45ea-a747-22e307260c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf661c0d02d4f6084e00d8ef15efec5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:21.698630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-87903f3b-87b0-45ea-a747-22e307260c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf661c0d02d4f6084e00d8ef15efec5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:21.699437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-87903f3b-87b0-45ea-a747-22e307260c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf661c0d02d4f6084e00d8ef15efec5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:21.706596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-87903f3b-87b0-45ea-a747-22e307260c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf661c0d02d4f6084e00d8ef15efec5'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:21.725770 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3784/7591] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:21 2021] DELETE /identity/v3/users/baf661c0d02d4f6084e00d8ef15efec5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:22.007445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.008878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:22.025617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb5502-2e79-4b1e-b71e-998f982fdfee admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:22.087966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:22.088881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.089169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.090033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] PATH_INFO: `/v3/projects/23687557c6194cf188592d4dd8af730f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.091290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23687557c6194cf188592d4dd8af730f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:22.093223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:22.141910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23687557c6194cf188592d4dd8af730f', 'request_id': 'req-16a8b1cf-502c-419e-90cb-73b1035521b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:22.149380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23687557c6194cf188592d4dd8af730f', 'request_id': 'req-16a8b1cf-502c-419e-90cb-73b1035521b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:22.156268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23687557c6194cf188592d4dd8af730f', 'request_id': 'req-16a8b1cf-502c-419e-90cb-73b1035521b9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:22.166034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] The token cache is being invalidate because project 23687557c6194cf188592d4dd8af730f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:22.166318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:22.166935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-16a8b1cf-502c-419e-90cb-73b1035521b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:22.168506 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3808/7592] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:22 2021] DELETE /identity/v3/projects/23687557c6194cf188592d4dd8af730f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:22.177771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ad857-ae4d-43eb-926a-5900a48b4e97 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.178055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ad857-ae4d-43eb-926a-5900a48b4e97 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.178329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ad857-ae4d-43eb-926a-5900a48b4e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.196194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c88ad857-ae4d-43eb-926a-5900a48b4e97 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:22.197446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c88ad857-ae4d-43eb-926a-5900a48b4e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:22.254429 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3785/7593] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:22.262948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5b0e5-f01a-46a9-bb77-628b426429ad None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.263234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5b0e5-f01a-46a9-bb77-628b426429ad None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.263531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5b0e5-f01a-46a9-bb77-628b426429ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.281955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e4b5b0e5-f01a-46a9-bb77-628b426429ad None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:22.283116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e4b5b0e5-f01a-46a9-bb77-628b426429ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:22.290902 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3809/7594] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:22.295090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ad857-ae4d-43eb-926a-5900a48b4e97 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.304725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ad857-ae4d-43eb-926a-5900a48b4e97 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:22.309425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f228b-8e3f-40c0-b06a-358e11d84557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:22.310016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f228b-8e3f-40c0-b06a-358e11d84557 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.310297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f228b-8e3f-40c0-b06a-358e11d84557 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.310567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f228b-8e3f-40c0-b06a-358e11d84557 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.311354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f228b-8e3f-40c0-b06a-358e11d84557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:17:22.312075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f228b-8e3f-40c0-b06a-358e11d84557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:22.313697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f228b-8e3f-40c0-b06a-358e11d84557 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:22.329468 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3786/7595] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:17:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:17:22.330847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5b0e5-f01a-46a9-bb77-628b426429ad None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.341078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5b0e5-f01a-46a9-bb77-628b426429ad None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:22.345756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acffef-10a4-4eba-968d-ceb9a8bdca37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:22.346400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acffef-10a4-4eba-968d-ceb9a8bdca37 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.346684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acffef-10a4-4eba-968d-ceb9a8bdca37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.346963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34acffef-10a4-4eba-968d-ceb9a8bdca37 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.347707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acffef-10a4-4eba-968d-ceb9a8bdca37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:22.349598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34acffef-10a4-4eba-968d-ceb9a8bdca37 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:22.376625 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3810/7596] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:22 2021] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:22.380693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f228b-8e3f-40c0-b06a-358e11d84557 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.391476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f228b-8e3f-40c0-b06a-358e11d84557 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:22.452410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9282b8-cc30-4ecf-be96-5c51ed04ffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:22.453058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9282b8-cc30-4ecf-be96-5c51ed04ffd4 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.453340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9282b8-cc30-4ecf-be96-5c51ed04ffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.453616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9282b8-cc30-4ecf-be96-5c51ed04ffd4 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.454316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9282b8-cc30-4ecf-be96-5c51ed04ffd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:22.456280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9282b8-cc30-4ecf-be96-5c51ed04ffd4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:22.476321 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3787/7597] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:22 2021] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:22.480379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acffef-10a4-4eba-968d-ceb9a8bdca37 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.490852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34acffef-10a4-4eba-968d-ceb9a8bdca37 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:22.496348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018aa7d-7040-451b-af00-25293d61f4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:22.497062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018aa7d-7040-451b-af00-25293d61f4de admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.497353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018aa7d-7040-451b-af00-25293d61f4de admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.497632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018aa7d-7040-451b-af00-25293d61f4de admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.498395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018aa7d-7040-451b-af00-25293d61f4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:22.500300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018aa7d-7040-451b-af00-25293d61f4de admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:22.510547 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3811/7598] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:22 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:22.514895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9282b8-cc30-4ecf-be96-5c51ed04ffd4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.526119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9282b8-cc30-4ecf-be96-5c51ed04ffd4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:22.532382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e29a4-83db-45f0-9319-2cc6458479d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:22.533039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e29a4-83db-45f0-9319-2cc6458479d5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.533325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e29a4-83db-45f0-9319-2cc6458479d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.533608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e29a4-83db-45f0-9319-2cc6458479d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.534337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e29a4-83db-45f0-9319-2cc6458479d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:22.535992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e29a4-83db-45f0-9319-2cc6458479d5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:22.545953 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3788/7599] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:22 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:22.550082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018aa7d-7040-451b-af00-25293d61f4de admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.560745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018aa7d-7040-451b-af00-25293d61f4de admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:22.565322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c296bf-2677-447e-a411-80e4f74929e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:22.566191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c296bf-2677-447e-a411-80e4f74929e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.566474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c296bf-2677-447e-a411-80e4f74929e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.566751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c296bf-2677-447e-a411-80e4f74929e1 admin admin] PATH_INFO: `/v3/projects/2b3acc06be03426eb83f8755908d4ea7/users/9a170fcdd88340a8853396cc16c78f90/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.581641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c296bf-2677-447e-a411-80e4f74929e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3acc06be03426eb83f8755908d4ea7, user_id=9a170fcdd88340a8853396cc16c78f90, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:22.584536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c296bf-2677-447e-a411-80e4f74929e1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:22.599599 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3812/7600] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:22 2021] PUT /identity/v3/projects/2b3acc06be03426eb83f8755908d4ea7/users/9a170fcdd88340a8853396cc16c78f90/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:22.610439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d47f06-2e72-4917-ad1a-7ded7fcb268b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.610739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d47f06-2e72-4917-ad1a-7ded7fcb268b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.611044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d47f06-2e72-4917-ad1a-7ded7fcb268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.638023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c3d47f06-2e72-4917-ad1a-7ded7fcb268b None None] MFA Rules not processed for user `9a170fcdd88340a8853396cc16c78f90`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:22.639212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c3d47f06-2e72-4917-ad1a-7ded7fcb268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:22.701545 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3789/7601] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:22 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:22.705964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c296bf-2677-447e-a411-80e4f74929e1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.767839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c296bf-2677-447e-a411-80e4f74929e1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:22.772548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570d1b3-8bf6-4ad4-b301-0b98c2e7e393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:22.773201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570d1b3-8bf6-4ad4-b301-0b98c2e7e393 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.773487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570d1b3-8bf6-4ad4-b301-0b98c2e7e393 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.773764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570d1b3-8bf6-4ad4-b301-0b98c2e7e393 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.774470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570d1b3-8bf6-4ad4-b301-0b98c2e7e393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:22.776414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570d1b3-8bf6-4ad4-b301-0b98c2e7e393 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:22.801347 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3813/7602] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:22 2021] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:17:22.805386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d47f06-2e72-4917-ad1a-7ded7fcb268b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.816754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d47f06-2e72-4917-ad1a-7ded7fcb268b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:22.871863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b229e5-64a8-4ea6-8e22-cbfd0159381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:22.872524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b229e5-64a8-4ea6-8e22-cbfd0159381d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.872807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b229e5-64a8-4ea6-8e22-cbfd0159381d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.873082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b229e5-64a8-4ea6-8e22-cbfd0159381d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.873782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b229e5-64a8-4ea6-8e22-cbfd0159381d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:22.875742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b229e5-64a8-4ea6-8e22-cbfd0159381d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:22.895000 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3790/7603] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:22 2021] POST /identity/v3/users => generated 301 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:22.899260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570d1b3-8bf6-4ad4-b301-0b98c2e7e393 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.909824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570d1b3-8bf6-4ad4-b301-0b98c2e7e393 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:22.914838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcacd6-6518-4b11-b45c-54d508abfca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:22.915536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcacd6-6518-4b11-b45c-54d508abfca8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.915827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcacd6-6518-4b11-b45c-54d508abfca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.916108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcacd6-6518-4b11-b45c-54d508abfca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.916840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcacd6-6518-4b11-b45c-54d508abfca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:22.918917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcacd6-6518-4b11-b45c-54d508abfca8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:22.930491 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3814/7604] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:22.935218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b229e5-64a8-4ea6-8e22-cbfd0159381d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.945078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b229e5-64a8-4ea6-8e22-cbfd0159381d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:22.949673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206eae1-29a3-4ef3-ad68-36e41b8428f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:22.950532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206eae1-29a3-4ef3-ad68-36e41b8428f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:22.950807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206eae1-29a3-4ef3-ad68-36e41b8428f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:22.951074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206eae1-29a3-4ef3-ad68-36e41b8428f8 admin admin] PATH_INFO: `/v3/projects/7a36cbb3cef04a2fa1b9156890ffc365/users/1bcd4e6fba4045b0bf16c22f4f92c7c2/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:22.965222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206eae1-29a3-4ef3-ad68-36e41b8428f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a36cbb3cef04a2fa1b9156890ffc365, user_id=1bcd4e6fba4045b0bf16c22f4f92c7c2, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:22.967918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206eae1-29a3-4ef3-ad68-36e41b8428f8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:22.981006 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3791/7605] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:22 2021] PUT /identity/v3/projects/7a36cbb3cef04a2fa1b9156890ffc365/users/1bcd4e6fba4045b0bf16c22f4f92c7c2/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:17:22.984851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcacd6-6518-4b11-b45c-54d508abfca8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:22.999970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcacd6-6518-4b11-b45c-54d508abfca8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:23.054169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a524a8-e89c-4f72-bbe0-71fbf67a832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:23.054824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a524a8-e89c-4f72-bbe0-71fbf67a832a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:23.055107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a524a8-e89c-4f72-bbe0-71fbf67a832a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:23.055417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a524a8-e89c-4f72-bbe0-71fbf67a832a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:23.056191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a524a8-e89c-4f72-bbe0-71fbf67a832a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:23.057791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a524a8-e89c-4f72-bbe0-71fbf67a832a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:23.067715 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3815/7606] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:22 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:23.071759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206eae1-29a3-4ef3-ad68-36e41b8428f8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:23.081987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206eae1-29a3-4ef3-ad68-36e41b8428f8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:23.086622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499affad-ac3d-4834-8bf5-a4df3b236b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:23.087531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499affad-ac3d-4834-8bf5-a4df3b236b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:23.087815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499affad-ac3d-4834-8bf5-a4df3b236b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:23.088093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499affad-ac3d-4834-8bf5-a4df3b236b4c admin admin] PATH_INFO: `/v3/projects/7a36cbb3cef04a2fa1b9156890ffc365/users/1bcd4e6fba4045b0bf16c22f4f92c7c2/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:23.090098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499affad-ac3d-4834-8bf5-a4df3b236b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a36cbb3cef04a2fa1b9156890ffc365, user_id=1bcd4e6fba4045b0bf16c22f4f92c7c2, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:23.092793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499affad-ac3d-4834-8bf5-a4df3b236b4c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:23.103039 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3792/7607] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:23 2021] PUT /identity/v3/projects/7a36cbb3cef04a2fa1b9156890ffc365/users/1bcd4e6fba4045b0bf16c22f4f92c7c2/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:23.114898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db08de-31e7-41bc-8929-956b06f726bc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:23.115472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db08de-31e7-41bc-8929-956b06f726bc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:23.115782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db08de-31e7-41bc-8929-956b06f726bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:23.142119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f8db08de-31e7-41bc-8929-956b06f726bc None None] MFA Rules not processed for user `1bcd4e6fba4045b0bf16c22f4f92c7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:23.143332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f8db08de-31e7-41bc-8929-956b06f726bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:23.208016 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3816/7608] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:23 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:23.218608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499affad-ac3d-4834-8bf5-a4df3b236b4c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:23.220863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-499affad-ac3d-4834-8bf5-a4df3b236b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:23.278088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499affad-ac3d-4834-8bf5-a4df3b236b4c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:23.281926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0465c23-daed-4dcf-8abe-47bc28619694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:23.282583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0465c23-daed-4dcf-8abe-47bc28619694 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:23.282865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0465c23-daed-4dcf-8abe-47bc28619694 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:23.283139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0465c23-daed-4dcf-8abe-47bc28619694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:23.340368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0465c23-daed-4dcf-8abe-47bc28619694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:23.341792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0465c23-daed-4dcf-8abe-47bc28619694 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:23.350786 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3793/7609] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:23 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:25.058245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db08de-31e7-41bc-8929-956b06f726bc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:25.079557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db08de-31e7-41bc-8929-956b06f726bc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:25.088568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5aaf87-81b7-48bc-bc6b-cd27f11b3331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:25.089326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aaf87-81b7-48bc-bc6b-cd27f11b3331 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:25.090268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aaf87-81b7-48bc-bc6b-cd27f11b3331 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:25.090553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5aaf87-81b7-48bc-bc6b-cd27f11b3331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:25.106079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5aaf87-81b7-48bc-bc6b-cd27f11b3331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:25.107638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5aaf87-81b7-48bc-bc6b-cd27f11b3331 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:25.118272 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3817/7610] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:25 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:27.667027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0465c23-daed-4dcf-8abe-47bc28619694 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:27.728597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0465c23-daed-4dcf-8abe-47bc28619694 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:27.733906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:27.734767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:27.735053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:27.735378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] PATH_INFO: `/v3/users/9a170fcdd88340a8853396cc16c78f90` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:27.736576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a170fcdd88340a8853396cc16c78f90)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:27.738513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:27.785308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a170fcdd88340a8853396cc16c78f90'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:27.785956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a170fcdd88340a8853396cc16c78f90'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:27.793635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a170fcdd88340a8853396cc16c78f90'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:27.794264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a170fcdd88340a8853396cc16c78f90'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:27.801075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a170fcdd88340a8853396cc16c78f90'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:27.818183 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3794/7611] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:27 2021] DELETE /identity/v3/users/9a170fcdd88340a8853396cc16c78f90 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:27.822847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b259-46d9-4f2e-aebc-2f38258c664b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:27.823348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b259-46d9-4f2e-aebc-2f38258c664b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:27.823462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b259-46d9-4f2e-aebc-2f38258c664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:27.840890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6b92b259-46d9-4f2e-aebc-2f38258c664b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:27.842067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6b92b259-46d9-4f2e-aebc-2f38258c664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:27.899279 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3818/7612] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:27.910046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:27.911482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:27.969720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9921e-eca8-4d3a-87c8-4462d415e580 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:27.973390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdbfc9-57b9-405b-accc-9ff9056fddc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:27.974026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdbfc9-57b9-405b-accc-9ff9056fddc0 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:27.974307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdbfc9-57b9-405b-accc-9ff9056fddc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:27.974581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdbfc9-57b9-405b-accc-9ff9056fddc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:27.984243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdbfc9-57b9-405b-accc-9ff9056fddc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:27.985672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdbfc9-57b9-405b-accc-9ff9056fddc0 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:27.995201 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3795/7613] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:28.160495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b259-46d9-4f2e-aebc-2f38258c664b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:28.161974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6b92b259-46d9-4f2e-aebc-2f38258c664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:28.176310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b259-46d9-4f2e-aebc-2f38258c664b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:28.181108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:28.182412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:28.182709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:28.182985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] PATH_INFO: `/v3/projects/2b3acc06be03426eb83f8755908d4ea7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:28.184277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3acc06be03426eb83f8755908d4ea7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:28.186116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:28.232410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3acc06be03426eb83f8755908d4ea7', 'request_id': 'req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.239416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3acc06be03426eb83f8755908d4ea7', 'request_id': 'req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.245729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3acc06be03426eb83f8755908d4ea7', 'request_id': 'req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.255769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] The token cache is being invalidate because project 2b3acc06be03426eb83f8755908d4ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:28.256056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.256680 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.258194 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3819/7614] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:28 2021] DELETE /identity/v3/projects/2b3acc06be03426eb83f8755908d4ea7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:28.262654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdbfc9-57b9-405b-accc-9ff9056fddc0 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:28.272148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdbfc9-57b9-405b-accc-9ff9056fddc0 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:28.327559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e74285-88e8-46d5-ac07-ca0dae787d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:28.328417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e74285-88e8-46d5-ac07-ca0dae787d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:28.329028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e74285-88e8-46d5-ac07-ca0dae787d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:28.329305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e74285-88e8-46d5-ac07-ca0dae787d38 admin admin] PATH_INFO: `/v3/users/1bcd4e6fba4045b0bf16c22f4f92c7c2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:28.330491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e74285-88e8-46d5-ac07-ca0dae787d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bcd4e6fba4045b0bf16c22f4f92c7c2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:28.332489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e74285-88e8-46d5-ac07-ca0dae787d38 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:28.378860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86e74285-88e8-46d5-ac07-ca0dae787d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bcd4e6fba4045b0bf16c22f4f92c7c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.379530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86e74285-88e8-46d5-ac07-ca0dae787d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bcd4e6fba4045b0bf16c22f4f92c7c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.388069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86e74285-88e8-46d5-ac07-ca0dae787d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bcd4e6fba4045b0bf16c22f4f92c7c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.388706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86e74285-88e8-46d5-ac07-ca0dae787d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bcd4e6fba4045b0bf16c22f4f92c7c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.396053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-86e74285-88e8-46d5-ac07-ca0dae787d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bcd4e6fba4045b0bf16c22f4f92c7c2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.414294 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3796/7615] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:28 2021] DELETE /identity/v3/users/1bcd4e6fba4045b0bf16c22f4f92c7c2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:28.676588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:28.678119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:28.692119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fba3f-f576-4320-b4ea-7b7c0d67fc7d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:28.751815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:28.753789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:28.754069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:28.754343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] PATH_INFO: `/v3/projects/7a36cbb3cef04a2fa1b9156890ffc365` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:28.755588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a36cbb3cef04a2fa1b9156890ffc365)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:28.757612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:28.803545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a36cbb3cef04a2fa1b9156890ffc365', 'request_id': 'req-670ca9c4-4913-4019-b97a-4791529376b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.810981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a36cbb3cef04a2fa1b9156890ffc365', 'request_id': 'req-670ca9c4-4913-4019-b97a-4791529376b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.817264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a36cbb3cef04a2fa1b9156890ffc365', 'request_id': 'req-670ca9c4-4913-4019-b97a-4791529376b8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.827783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] The token cache is being invalidate because project 7a36cbb3cef04a2fa1b9156890ffc365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:28.828349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.828777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-670ca9c4-4913-4019-b97a-4791529376b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:28.830342 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3820/7616] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:28 2021] DELETE /identity/v3/projects/7a36cbb3cef04a2fa1b9156890ffc365 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:28.836143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e62a6b-469e-4881-a0f7-0ec1e5170e9d None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:28.836593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e62a6b-469e-4881-a0f7-0ec1e5170e9d None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:28.836722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e62a6b-469e-4881-a0f7-0ec1e5170e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:28.854546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d7e62a6b-469e-4881-a0f7-0ec1e5170e9d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:28.855805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d7e62a6b-469e-4881-a0f7-0ec1e5170e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:28.914070 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3797/7617] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:28.922375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cc041-83c1-4be0-848d-4e401fdf607f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:28.922573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cc041-83c1-4be0-848d-4e401fdf607f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:28.922944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cc041-83c1-4be0-848d-4e401fdf607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:28.941905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-247cc041-83c1-4be0-848d-4e401fdf607f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:28.943117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-247cc041-83c1-4be0-848d-4e401fdf607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:28.952117 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3821/7618] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:17:28.956267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e62a6b-469e-4881-a0f7-0ec1e5170e9d None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:28.967400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e62a6b-469e-4881-a0f7-0ec1e5170e9d None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:28.972096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1337c2-52a1-4e4f-94b1-c7df274b7a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:28.972759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1337c2-52a1-4e4f-94b1-c7df274b7a65 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:28.973343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1337c2-52a1-4e4f-94b1-c7df274b7a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:28.973626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1337c2-52a1-4e4f-94b1-c7df274b7a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:28.974360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1337c2-52a1-4e4f-94b1-c7df274b7a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:17:28.974670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1337c2-52a1-4e4f-94b1-c7df274b7a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:28.976318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1337c2-52a1-4e4f-94b1-c7df274b7a65 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:28.989784 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3798/7619] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:17:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:28.994124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cc041-83c1-4be0-848d-4e401fdf607f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.004097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cc041-83c1-4be0-848d-4e401fdf607f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.008799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fd780-1cb8-401e-a78b-42d659074195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.009451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fd780-1cb8-401e-a78b-42d659074195 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.009735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fd780-1cb8-401e-a78b-42d659074195 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.010015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fd780-1cb8-401e-a78b-42d659074195 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.010718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fd780-1cb8-401e-a78b-42d659074195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.012668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fd780-1cb8-401e-a78b-42d659074195 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.037630 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3822/7620] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:28 2021] POST /identity/v3/projects => generated 411 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:29.041712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1337c2-52a1-4e4f-94b1-c7df274b7a65 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.052410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1337c2-52a1-4e4f-94b1-c7df274b7a65 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.110841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec21a6-d92c-40bd-9bee-6d68b588e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.111455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec21a6-d92c-40bd-9bee-6d68b588e2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.111743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec21a6-d92c-40bd-9bee-6d68b588e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.112024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec21a6-d92c-40bd-9bee-6d68b588e2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.112725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec21a6-d92c-40bd-9bee-6d68b588e2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.114921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec21a6-d92c-40bd-9bee-6d68b588e2c2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.137552 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3799/7621] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:29 2021] POST /identity/v3/users => generated 306 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:29.139041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fd780-1cb8-401e-a78b-42d659074195 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.149266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fd780-1cb8-401e-a78b-42d659074195 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.154459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ca8a0-3314-4b10-92ab-e9420f8ebcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.155111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ca8a0-3314-4b10-92ab-e9420f8ebcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.155434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ca8a0-3314-4b10-92ab-e9420f8ebcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.155715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ca8a0-3314-4b10-92ab-e9420f8ebcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.156481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ca8a0-3314-4b10-92ab-e9420f8ebcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.158065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ca8a0-3314-4b10-92ab-e9420f8ebcf6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.168971 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3823/7622] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:29.172855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec21a6-d92c-40bd-9bee-6d68b588e2c2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.182905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec21a6-d92c-40bd-9bee-6d68b588e2c2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.187569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69f6e3-2898-4f6c-a1ea-e982bbf14011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.188217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69f6e3-2898-4f6c-a1ea-e982bbf14011 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.188502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69f6e3-2898-4f6c-a1ea-e982bbf14011 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.188779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69f6e3-2898-4f6c-a1ea-e982bbf14011 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.189539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69f6e3-2898-4f6c-a1ea-e982bbf14011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.191132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69f6e3-2898-4f6c-a1ea-e982bbf14011 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.200992 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3800/7623] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:29.205075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ca8a0-3314-4b10-92ab-e9420f8ebcf6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.215539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ca8a0-3314-4b10-92ab-e9420f8ebcf6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.220105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3170b3d-1790-40de-af02-f6ac9f163b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.220964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170b3d-1790-40de-af02-f6ac9f163b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.221247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170b3d-1790-40de-af02-f6ac9f163b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.221520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170b3d-1790-40de-af02-f6ac9f163b41 admin admin] PATH_INFO: `/v3/projects/4bb381fba03949e993e7afab121d6811/users/c46b7b6c3c4e423f9dfca198161b2beb/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.236582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3170b3d-1790-40de-af02-f6ac9f163b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb381fba03949e993e7afab121d6811, user_id=c46b7b6c3c4e423f9dfca198161b2beb, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.239445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3170b3d-1790-40de-af02-f6ac9f163b41 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.252268 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3824/7624] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:29 2021] PUT /identity/v3/projects/4bb381fba03949e993e7afab121d6811/users/c46b7b6c3c4e423f9dfca198161b2beb/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:29.262462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36506ad9-0eae-4956-9c54-8838f55a6666 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.262782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36506ad9-0eae-4956-9c54-8838f55a6666 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.263063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36506ad9-0eae-4956-9c54-8838f55a6666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.289534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-36506ad9-0eae-4956-9c54-8838f55a6666 None None] MFA Rules not processed for user `c46b7b6c3c4e423f9dfca198161b2beb`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:29.290752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-36506ad9-0eae-4956-9c54-8838f55a6666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:29.354031 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3801/7625] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:29 2021] POST /identity/v3/auth/tokens => generated 3278 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:29.359111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3170b3d-1790-40de-af02-f6ac9f163b41 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.421979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3170b3d-1790-40de-af02-f6ac9f163b41 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.429012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c70553-66b3-4de6-90eb-5ab83318e9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.429012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c70553-66b3-4de6-90eb-5ab83318e9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.429012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c70553-66b3-4de6-90eb-5ab83318e9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.429012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c70553-66b3-4de6-90eb-5ab83318e9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.429490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c70553-66b3-4de6-90eb-5ab83318e9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.430686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c70553-66b3-4de6-90eb-5ab83318e9b4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.457141 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3825/7626] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:29 2021] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:29.460960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36506ad9-0eae-4956-9c54-8838f55a6666 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.472248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36506ad9-0eae-4956-9c54-8838f55a6666 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.528847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535d19e-aec3-4853-a3c4-68cd39ce3adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.529522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535d19e-aec3-4853-a3c4-68cd39ce3adb admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.529810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535d19e-aec3-4853-a3c4-68cd39ce3adb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.530089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535d19e-aec3-4853-a3c4-68cd39ce3adb admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.530828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535d19e-aec3-4853-a3c4-68cd39ce3adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.532788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535d19e-aec3-4853-a3c4-68cd39ce3adb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.551849 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3802/7627] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:29 2021] POST /identity/v3/users => generated 311 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:29.555814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c70553-66b3-4de6-90eb-5ab83318e9b4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.565927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c70553-66b3-4de6-90eb-5ab83318e9b4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.570579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598974f7-e46f-4f61-a5b1-06e791a7f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.571231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598974f7-e46f-4f61-a5b1-06e791a7f5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.571548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598974f7-e46f-4f61-a5b1-06e791a7f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.571831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598974f7-e46f-4f61-a5b1-06e791a7f5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.572557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598974f7-e46f-4f61-a5b1-06e791a7f5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.574697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598974f7-e46f-4f61-a5b1-06e791a7f5a8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.585057 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3826/7628] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:29.588906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535d19e-aec3-4853-a3c4-68cd39ce3adb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.599468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535d19e-aec3-4853-a3c4-68cd39ce3adb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.604139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3edbf-9be7-4937-abf5-8a8b31ec7339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.605027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3edbf-9be7-4937-abf5-8a8b31ec7339 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.605303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3edbf-9be7-4937-abf5-8a8b31ec7339 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.605574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3edbf-9be7-4937-abf5-8a8b31ec7339 admin admin] PATH_INFO: `/v3/projects/2bda412c4b774d67a0dbb704b4a7daf5/users/ff878333ef7e483881b99a4a36c97b8d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.620488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3edbf-9be7-4937-abf5-8a8b31ec7339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bda412c4b774d67a0dbb704b4a7daf5, user_id=ff878333ef7e483881b99a4a36c97b8d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.623158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3edbf-9be7-4937-abf5-8a8b31ec7339 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.636404 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3803/7629] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:29 2021] PUT /identity/v3/projects/2bda412c4b774d67a0dbb704b4a7daf5/users/ff878333ef7e483881b99a4a36c97b8d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:29.640308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598974f7-e46f-4f61-a5b1-06e791a7f5a8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.650101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598974f7-e46f-4f61-a5b1-06e791a7f5a8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.704961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51f225-d7ed-49e5-9d6c-985b966fb8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.705553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51f225-d7ed-49e5-9d6c-985b966fb8de admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.705840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51f225-d7ed-49e5-9d6c-985b966fb8de admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.706115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51f225-d7ed-49e5-9d6c-985b966fb8de admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.706844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51f225-d7ed-49e5-9d6c-985b966fb8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.708467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51f225-d7ed-49e5-9d6c-985b966fb8de admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.718813 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3827/7630] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:29 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:29.722675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3edbf-9be7-4937-abf5-8a8b31ec7339 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.732882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3edbf-9be7-4937-abf5-8a8b31ec7339 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.737577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83e7e1-45e2-4506-9886-267bef483ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.738448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e7e1-45e2-4506-9886-267bef483ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.738733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e7e1-45e2-4506-9886-267bef483ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.739011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e7e1-45e2-4506-9886-267bef483ea7 admin admin] PATH_INFO: `/v3/projects/2bda412c4b774d67a0dbb704b4a7daf5/users/ff878333ef7e483881b99a4a36c97b8d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.741303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83e7e1-45e2-4506-9886-267bef483ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bda412c4b774d67a0dbb704b4a7daf5, user_id=ff878333ef7e483881b99a4a36c97b8d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.743986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83e7e1-45e2-4506-9886-267bef483ea7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.754037 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3804/7631] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:29 2021] PUT /identity/v3/projects/2bda412c4b774d67a0dbb704b4a7daf5/users/ff878333ef7e483881b99a4a36c97b8d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:29.765407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663685-9293-4d86-ba07-40c5d5aa9d62 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.765691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663685-9293-4d86-ba07-40c5d5aa9d62 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.765968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663685-9293-4d86-ba07-40c5d5aa9d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.791993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fd663685-9293-4d86-ba07-40c5d5aa9d62 None None] MFA Rules not processed for user `ff878333ef7e483881b99a4a36c97b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:29.793266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fd663685-9293-4d86-ba07-40c5d5aa9d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:29.860098 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3828/7632] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:29 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:29.871427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83e7e1-45e2-4506-9886-267bef483ea7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:29.873212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6d83e7e1-45e2-4506-9886-267bef483ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:29.931026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83e7e1-45e2-4506-9886-267bef483ea7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:29.935210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4792534-f9a5-4f06-9982-a82ec610a446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:29.935870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4792534-f9a5-4f06-9982-a82ec610a446 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:29.936154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4792534-f9a5-4f06-9982-a82ec610a446 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:29.936430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4792534-f9a5-4f06-9982-a82ec610a446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:29.945363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4792534-f9a5-4f06-9982-a82ec610a446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:29.946800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4792534-f9a5-4f06-9982-a82ec610a446 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:29.957093 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3805/7633] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:29 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:31.625922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd663685-9293-4d86-ba07-40c5d5aa9d62 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:31.686711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd663685-9293-4d86-ba07-40c5d5aa9d62 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:31.691086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:31.691963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:31.692239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:31.692510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] PATH_INFO: `/v3/users/c46b7b6c3c4e423f9dfca198161b2beb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:31.693691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46b7b6c3c4e423f9dfca198161b2beb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:31.695627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:31.739948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46b7b6c3c4e423f9dfca198161b2beb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:31.747184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46b7b6c3c4e423f9dfca198161b2beb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:31.747906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46b7b6c3c4e423f9dfca198161b2beb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:31.754683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46b7b6c3c4e423f9dfca198161b2beb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:31.767177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46b7b6c3c4e423f9dfca198161b2beb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:31.773087 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3829/7634] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:31 2021] DELETE /identity/v3/users/c46b7b6c3c4e423f9dfca198161b2beb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:31.778449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a60ed-dbfb-4dd0-80a9-d0aa0a822584 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:31.778929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a60ed-dbfb-4dd0-80a9-d0aa0a822584 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:31.779245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a60ed-dbfb-4dd0-80a9-d0aa0a822584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:31.797235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b21a60ed-dbfb-4dd0-80a9-d0aa0a822584 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:31.798538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b21a60ed-dbfb-4dd0-80a9-d0aa0a822584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:31.858150 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3806/7635] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:31.868572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:31.870084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:31.928473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cf903-4f75-4cfa-b70e-bc40d87db422 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:31.932195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f55952-7e9b-4eb3-8558-f33b5d856bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:31.932865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f55952-7e9b-4eb3-8558-f33b5d856bfa service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:31.933147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f55952-7e9b-4eb3-8558-f33b5d856bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:31.933422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f55952-7e9b-4eb3-8558-f33b5d856bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:31.942298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f55952-7e9b-4eb3-8558-f33b5d856bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:31.943768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f55952-7e9b-4eb3-8558-f33b5d856bfa service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:31.953555 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3830/7636] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:32.210319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a60ed-dbfb-4dd0-80a9-d0aa0a822584 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:32.211869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b21a60ed-dbfb-4dd0-80a9-d0aa0a822584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:32.225001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a60ed-dbfb-4dd0-80a9-d0aa0a822584 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:32.229845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:32.230696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:32.230971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:32.231238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] PATH_INFO: `/v3/projects/4bb381fba03949e993e7afab121d6811` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:32.232838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb381fba03949e993e7afab121d6811)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:32.234840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:32.280253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb381fba03949e993e7afab121d6811', 'request_id': 'req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.286161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb381fba03949e993e7afab121d6811', 'request_id': 'req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.293296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb381fba03949e993e7afab121d6811', 'request_id': 'req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.303161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] The token cache is being invalidate because project 4bb381fba03949e993e7afab121d6811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:32.303474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.304089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.305593 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3807/7637] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:32 2021] DELETE /identity/v3/projects/4bb381fba03949e993e7afab121d6811 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:32.310216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f55952-7e9b-4eb3-8558-f33b5d856bfa service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:32.320377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f55952-7e9b-4eb3-8558-f33b5d856bfa service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:32.376704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64654f90-bb4f-4f39-9957-02b8e65268d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:32.377508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64654f90-bb4f-4f39-9957-02b8e65268d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:32.377789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64654f90-bb4f-4f39-9957-02b8e65268d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:32.378063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64654f90-bb4f-4f39-9957-02b8e65268d7 admin admin] PATH_INFO: `/v3/users/ff878333ef7e483881b99a4a36c97b8d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:32.379307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64654f90-bb4f-4f39-9957-02b8e65268d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff878333ef7e483881b99a4a36c97b8d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:32.381264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64654f90-bb4f-4f39-9957-02b8e65268d7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:32.429253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-64654f90-bb4f-4f39-9957-02b8e65268d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff878333ef7e483881b99a4a36c97b8d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.438098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-64654f90-bb4f-4f39-9957-02b8e65268d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff878333ef7e483881b99a4a36c97b8d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.438741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-64654f90-bb4f-4f39-9957-02b8e65268d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff878333ef7e483881b99a4a36c97b8d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.445586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-64654f90-bb4f-4f39-9957-02b8e65268d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff878333ef7e483881b99a4a36c97b8d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.460541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-64654f90-bb4f-4f39-9957-02b8e65268d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff878333ef7e483881b99a4a36c97b8d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.466367 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3831/7638] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:32 2021] DELETE /identity/v3/users/ff878333ef7e483881b99a4a36c97b8d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:32.671424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:32.672997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:32.686679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e2fb1-e2e8-4d50-9292-8b42cfea1d29 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:32.750714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:32.751632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:32.751920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:32.752196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] PATH_INFO: `/v3/projects/2bda412c4b774d67a0dbb704b4a7daf5` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:32.753593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bda412c4b774d67a0dbb704b4a7daf5)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:32.755556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:32.803556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bda412c4b774d67a0dbb704b4a7daf5', 'request_id': 'req-dd817107-4593-4b92-a7fd-613d4d7618e0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.810434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bda412c4b774d67a0dbb704b4a7daf5', 'request_id': 'req-dd817107-4593-4b92-a7fd-613d4d7618e0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.818245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bda412c4b774d67a0dbb704b4a7daf5', 'request_id': 'req-dd817107-4593-4b92-a7fd-613d4d7618e0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.828760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] The token cache is being invalidate because project 2bda412c4b774d67a0dbb704b4a7daf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:32.829049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.829714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-dd817107-4593-4b92-a7fd-613d4d7618e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:32.831356 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3808/7639] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:32 2021] DELETE /identity/v3/projects/2bda412c4b774d67a0dbb704b4a7daf5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:32.837196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7704ee-9947-48c8-a96d-862e33ad5d07 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:32.837690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7704ee-9947-48c8-a96d-862e33ad5d07 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:32.837864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7704ee-9947-48c8-a96d-862e33ad5d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:32.856556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1f7704ee-9947-48c8-a96d-862e33ad5d07 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:32.857796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1f7704ee-9947-48c8-a96d-862e33ad5d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:32.920655 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3832/7640] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:32.928915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ff73-6d59-4af1-b38c-a80d4208d94a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:32.929198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ff73-6d59-4af1-b38c-a80d4208d94a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:32.929475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ff73-6d59-4af1-b38c-a80d4208d94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:32.949894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-17b4ff73-6d59-4af1-b38c-a80d4208d94a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:32.951286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-17b4ff73-6d59-4af1-b38c-a80d4208d94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:32.959693 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3809/7641] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:17:32.964031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7704ee-9947-48c8-a96d-862e33ad5d07 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:32.975280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7704ee-9947-48c8-a96d-862e33ad5d07 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:32.980362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398f75-3c46-4952-85f8-93d41a8da30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:32.981142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398f75-3c46-4952-85f8-93d41a8da30d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:32.981525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398f75-3c46-4952-85f8-93d41a8da30d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:32.981900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398f75-3c46-4952-85f8-93d41a8da30d admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:32.982747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb398f75-3c46-4952-85f8-93d41a8da30d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:17:32.983180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb398f75-3c46-4952-85f8-93d41a8da30d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:32.984916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb398f75-3c46-4952-85f8-93d41a8da30d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:32.999013 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3833/7642] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:17:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:17:33.002952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4ff73-6d59-4af1-b38c-a80d4208d94a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.013188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4ff73-6d59-4af1-b38c-a80d4208d94a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.021012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c174502-a925-4ae2-b143-38b2f85b2584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.021710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174502-a925-4ae2-b143-38b2f85b2584 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.021999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174502-a925-4ae2-b143-38b2f85b2584 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.022280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174502-a925-4ae2-b143-38b2f85b2584 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.022999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c174502-a925-4ae2-b143-38b2f85b2584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.024998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c174502-a925-4ae2-b143-38b2f85b2584 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.055776 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3810/7643] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:33 2021] POST /identity/v3/projects => generated 351 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:33.057357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398f75-3c46-4952-85f8-93d41a8da30d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.075125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398f75-3c46-4952-85f8-93d41a8da30d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.133256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668af6-cdb8-481a-bba9-655cd5cafe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.133998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668af6-cdb8-481a-bba9-655cd5cafe1d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.134282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668af6-cdb8-481a-bba9-655cd5cafe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.134553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f668af6-cdb8-481a-bba9-655cd5cafe1d admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.135258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f668af6-cdb8-481a-bba9-655cd5cafe1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.137862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f668af6-cdb8-481a-bba9-655cd5cafe1d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.160474 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3834/7644] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:33 2021] POST /identity/v3/users => generated 276 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:33.161561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c174502-a925-4ae2-b143-38b2f85b2584 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.172448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c174502-a925-4ae2-b143-38b2f85b2584 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.177077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127d742-e984-4bf6-a85e-b2a955498e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.177731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d742-e984-4bf6-a85e-b2a955498e09 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.178011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d742-e984-4bf6-a85e-b2a955498e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.178282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d742-e984-4bf6-a85e-b2a955498e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.179004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127d742-e984-4bf6-a85e-b2a955498e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.180651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127d742-e984-4bf6-a85e-b2a955498e09 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.191982 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3811/7645] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:17:33.195884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668af6-cdb8-481a-bba9-655cd5cafe1d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.206364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f668af6-cdb8-481a-bba9-655cd5cafe1d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.211526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dc670-a36a-46f1-bacb-c43dc69ec69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.212311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dc670-a36a-46f1-bacb-c43dc69ec69f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.212628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dc670-a36a-46f1-bacb-c43dc69ec69f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.212900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dc670-a36a-46f1-bacb-c43dc69ec69f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.213627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586dc670-a36a-46f1-bacb-c43dc69ec69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.216017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586dc670-a36a-46f1-bacb-c43dc69ec69f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.231595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3835/7646] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:33 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:33.233181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127d742-e984-4bf6-a85e-b2a955498e09 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.243548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127d742-e984-4bf6-a85e-b2a955498e09 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.248797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b11a00-c6dc-4b7a-88c0-c5eba3417dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.249671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b11a00-c6dc-4b7a-88c0-c5eba3417dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.249952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b11a00-c6dc-4b7a-88c0-c5eba3417dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.250228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b11a00-c6dc-4b7a-88c0-c5eba3417dbe admin admin] PATH_INFO: `/v3/projects/b6237bea2e334fe3a8aac46dd4ae6fde/users/e5974cc6ebbb4c7aa10bef146187780a/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.271280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b11a00-c6dc-4b7a-88c0-c5eba3417dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6237bea2e334fe3a8aac46dd4ae6fde, user_id=e5974cc6ebbb4c7aa10bef146187780a, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.274139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b11a00-c6dc-4b7a-88c0-c5eba3417dbe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.288092 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3812/7647] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:33 2021] PUT /identity/v3/projects/b6237bea2e334fe3a8aac46dd4ae6fde/users/e5974cc6ebbb4c7aa10bef146187780a/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:33.300056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a023b-3f8e-462d-bbe9-a67ce5141450 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.300465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a023b-3f8e-462d-bbe9-a67ce5141450 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.300626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a023b-3f8e-462d-bbe9-a67ce5141450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.331014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a06a023b-3f8e-462d-bbe9-a67ce5141450 None None] MFA Rules not processed for user `e5974cc6ebbb4c7aa10bef146187780a`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:33.332351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a06a023b-3f8e-462d-bbe9-a67ce5141450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:33.397632 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3836/7648] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:33 2021] POST /identity/v3/auth/tokens => generated 3218 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:33.403419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b11a00-c6dc-4b7a-88c0-c5eba3417dbe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.467439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b11a00-c6dc-4b7a-88c0-c5eba3417dbe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.472284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd10464-9a5e-43e9-80e0-fe4596545af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.472946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10464-9a5e-43e9-80e0-fe4596545af0 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.473232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10464-9a5e-43e9-80e0-fe4596545af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.473514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10464-9a5e-43e9-80e0-fe4596545af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.474213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd10464-9a5e-43e9-80e0-fe4596545af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.476193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd10464-9a5e-43e9-80e0-fe4596545af0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.510108 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3813/7649] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:33 2021] POST /identity/v3/projects => generated 357 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:33.514026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a023b-3f8e-462d-bbe9-a67ce5141450 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.525376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a023b-3f8e-462d-bbe9-a67ce5141450 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.552333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd10464-9a5e-43e9-80e0-fe4596545af0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.554210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5bd10464-9a5e-43e9-80e0-fe4596545af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:33.652186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12381c-86d3-42a6-8d02-b1b8c1805081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.652983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12381c-86d3-42a6-8d02-b1b8c1805081 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.653321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12381c-86d3-42a6-8d02-b1b8c1805081 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.653589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12381c-86d3-42a6-8d02-b1b8c1805081 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.654617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12381c-86d3-42a6-8d02-b1b8c1805081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.656746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12381c-86d3-42a6-8d02-b1b8c1805081 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.666043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd10464-9a5e-43e9-80e0-fe4596545af0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.685052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3174d-1e9c-4fe6-91ef-4bd83435ff0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.686255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3174d-1e9c-4fe6-91ef-4bd83435ff0b service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.686541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3174d-1e9c-4fe6-91ef-4bd83435ff0b service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.686820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3174d-1e9c-4fe6-91ef-4bd83435ff0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.687484 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3837/7650] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:33 2021] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:17:33.693054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f4c3174d-1e9c-4fe6-91ef-4bd83435ff0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:33.693666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12381c-86d3-42a6-8d02-b1b8c1805081 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.708107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12381c-86d3-42a6-8d02-b1b8c1805081 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.710633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3174d-1e9c-4fe6-91ef-4bd83435ff0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.715301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3174d-1e9c-4fe6-91ef-4bd83435ff0b service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.717347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704743-54b8-4f0e-bc64-d2084c40ef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.718717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704743-54b8-4f0e-bc64-d2084c40ef65 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.719722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704743-54b8-4f0e-bc64-d2084c40ef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.720302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704743-54b8-4f0e-bc64-d2084c40ef65 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.721348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19704743-54b8-4f0e-bc64-d2084c40ef65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.723984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19704743-54b8-4f0e-bc64-d2084c40ef65 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.738680 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3838/7651] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:33 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:33.740607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704743-54b8-4f0e-bc64-d2084c40ef65 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.751445 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3814/7652] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:33.754864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704743-54b8-4f0e-bc64-d2084c40ef65 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.760086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76914a6c-d955-4172-a7a3-b22c655ececb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.761068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914a6c-d955-4172-a7a3-b22c655ececb admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.761305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914a6c-d955-4172-a7a3-b22c655ececb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.761586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76914a6c-d955-4172-a7a3-b22c655ececb admin admin] PATH_INFO: `/v3/projects/7786550fa88a41158e9f8aa6f329c813/users/a05c9431e671451e8b6b904cf9617fa8/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.779220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76914a6c-d955-4172-a7a3-b22c655ececb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7786550fa88a41158e9f8aa6f329c813, user_id=a05c9431e671451e8b6b904cf9617fa8, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.782102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76914a6c-d955-4172-a7a3-b22c655ececb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.805937 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3839/7653] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:33 2021] PUT /identity/v3/projects/7786550fa88a41158e9f8aa6f329c813/users/a05c9431e671451e8b6b904cf9617fa8/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:33.811099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3174d-1e9c-4fe6-91ef-4bd83435ff0b service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.825825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3174d-1e9c-4fe6-91ef-4bd83435ff0b service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.888580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af8d4b-9ac0-4879-bda5-a1814f60ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.889368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af8d4b-9ac0-4879-bda5-a1814f60ad7b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.889653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af8d4b-9ac0-4879-bda5-a1814f60ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.889925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af8d4b-9ac0-4879-bda5-a1814f60ad7b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.890657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af8d4b-9ac0-4879-bda5-a1814f60ad7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.892320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af8d4b-9ac0-4879-bda5-a1814f60ad7b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.905639 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3815/7654] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:33 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:33.906797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76914a6c-d955-4172-a7a3-b22c655ececb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:33.916903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76914a6c-d955-4172-a7a3-b22c655ececb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:33.922152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34324a-87d5-4301-aa07-ba2a4a5fcc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:33.923046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34324a-87d5-4301-aa07-ba2a4a5fcc4a admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.923368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34324a-87d5-4301-aa07-ba2a4a5fcc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.923828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34324a-87d5-4301-aa07-ba2a4a5fcc4a admin admin] PATH_INFO: `/v3/projects/7786550fa88a41158e9f8aa6f329c813/users/a05c9431e671451e8b6b904cf9617fa8/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.925805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34324a-87d5-4301-aa07-ba2a4a5fcc4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7786550fa88a41158e9f8aa6f329c813, user_id=a05c9431e671451e8b6b904cf9617fa8, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:33.928474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34324a-87d5-4301-aa07-ba2a4a5fcc4a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:33.938807 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3840/7655] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:33 2021] PUT /identity/v3/projects/7786550fa88a41158e9f8aa6f329c813/users/a05c9431e671451e8b6b904cf9617fa8/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:33.948924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc0e9-38aa-4a37-bd92-5fa9a8a112b8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:33.949221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc0e9-38aa-4a37-bd92-5fa9a8a112b8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:33.949501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc0e9-38aa-4a37-bd92-5fa9a8a112b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:33.976894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-217fc0e9-38aa-4a37-bd92-5fa9a8a112b8 None None] MFA Rules not processed for user `a05c9431e671451e8b6b904cf9617fa8`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:33.978166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-217fc0e9-38aa-4a37-bd92-5fa9a8a112b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:34.051650 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3816/7656] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:33 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:17:34.056914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34324a-87d5-4301-aa07-ba2a4a5fcc4a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:34.068506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34324a-87d5-4301-aa07-ba2a4a5fcc4a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:34.073675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4085499-f88a-48ca-8d9c-43c3f00a8507 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c9431e671451e8b6b904cf9617fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7786550fa88a41158e9f8aa6f329c813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:34.074329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4085499-f88a-48ca-8d9c-43c3f00a8507 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:34.074716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4085499-f88a-48ca-8d9c-43c3f00a8507 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:34.074998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4085499-f88a-48ca-8d9c-43c3f00a8507 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:34.076667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4085499-f88a-48ca-8d9c-43c3f00a8507 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:17:34.076667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4085499-f88a-48ca-8d9c-43c3f00a8507 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:34.077695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4085499-f88a-48ca-8d9c-43c3f00a8507 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:34.101398 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3841/7657] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:17:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:34.101630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fc0e9-38aa-4a37-bd92-5fa9a8a112b8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:34.112933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fc0e9-38aa-4a37-bd92-5fa9a8a112b8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:34.122429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3bb8e-8551-49f4-a8de-e7de8a2439b2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c9431e671451e8b6b904cf9617fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7786550fa88a41158e9f8aa6f329c813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:34.123145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3bb8e-8551-49f4-a8de-e7de8a2439b2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:34.123507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3bb8e-8551-49f4-a8de-e7de8a2439b2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:34.123789 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3bb8e-8551-49f4-a8de-e7de8a2439b2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:34.125352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3bb8e-8551-49f4-a8de-e7de8a2439b2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:34.127434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3bb8e-8551-49f4-a8de-e7de8a2439b2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:34.162808 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3817/7658] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:34 2021] POST /identity/v3/projects => generated 348 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:34.167931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4085499-f88a-48ca-8d9c-43c3f00a8507 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:34.179191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4085499-f88a-48ca-8d9c-43c3f00a8507 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:34.240978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76aa6c-946d-490b-a76d-d7d62401182c tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c9431e671451e8b6b904cf9617fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7786550fa88a41158e9f8aa6f329c813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:34.241565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76aa6c-946d-490b-a76d-d7d62401182c tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:34.241852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76aa6c-946d-490b-a76d-d7d62401182c tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:34.242132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76aa6c-946d-490b-a76d-d7d62401182c tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:34.242872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76aa6c-946d-490b-a76d-d7d62401182c tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:17:34.243179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76aa6c-946d-490b-a76d-d7d62401182c tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:34.244807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76aa6c-946d-490b-a76d-d7d62401182c tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:34.257125 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3842/7659] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:17:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:17:34.267171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3bb8e-8551-49f4-a8de-e7de8a2439b2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:34.268966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c0e3bb8e-8551-49f4-a8de-e7de8a2439b2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:34.332630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3bb8e-8551-49f4-a8de-e7de8a2439b2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:34.336665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a3466-a9f4-43c4-8a08-3a85212d5243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:34.337395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3466-a9f4-43c4-8a08-3a85212d5243 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:34.337748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3466-a9f4-43c4-8a08-3a85212d5243 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:34.338098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a3466-a9f4-43c4-8a08-3a85212d5243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:34.348059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a3466-a9f4-43c4-8a08-3a85212d5243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:34.349517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a3466-a9f4-43c4-8a08-3a85212d5243 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:34.360116 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3818/7660] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:34 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:34.498274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76aa6c-946d-490b-a76d-d7d62401182c tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:34.509019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76aa6c-946d-490b-a76d-d7d62401182c tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:34.514047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05c9431e671451e8b6b904cf9617fa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7786550fa88a41158e9f8aa6f329c813', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:34.515501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:34.515501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:34.524327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] PATH_INFO: `/v3/projects/9b92167f6de845caa68b7b7453444b4c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:34.525924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b92167f6de845caa68b7b7453444b4c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:34.528471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:34.578561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b92167f6de845caa68b7b7453444b4c', 'request_id': 'req-cdb08424-c79f-42fb-828c-76538279c7e2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:34.585841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b92167f6de845caa68b7b7453444b4c', 'request_id': 'req-cdb08424-c79f-42fb-828c-76538279c7e2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:34.593172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b92167f6de845caa68b7b7453444b4c', 'request_id': 'req-cdb08424-c79f-42fb-828c-76538279c7e2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:34.603207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] The token cache is being invalidate because project 9b92167f6de845caa68b7b7453444b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:34.603527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:34.604195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-cdb08424-c79f-42fb-828c-76538279c7e2 tempest-QuotasTest-1874124959 tempest-QuotasTest-1874124959-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:34.606318 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3843/7661] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:34 2021] DELETE /identity/v3/projects/9b92167f6de845caa68b7b7453444b4c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:34.748084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a3466-a9f4-43c4-8a08-3a85212d5243 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:34.811532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a3466-a9f4-43c4-8a08-3a85212d5243 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:34.865661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:34.866520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:34.866803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:34.867077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] PATH_INFO: `/v3/users/e5974cc6ebbb4c7aa10bef146187780a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:34.868296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5974cc6ebbb4c7aa10bef146187780a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:34.870226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:34.914300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5974cc6ebbb4c7aa10bef146187780a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:34.914945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5974cc6ebbb4c7aa10bef146187780a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:34.922152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5974cc6ebbb4c7aa10bef146187780a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:34.922761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5974cc6ebbb4c7aa10bef146187780a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:34.929438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5974cc6ebbb4c7aa10bef146187780a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:34.945700 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3819/7662] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:34 2021] DELETE /identity/v3/users/e5974cc6ebbb4c7aa10bef146187780a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:34.950707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e2af-fdc2-4997-ac65-ba4d98c1f8dc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:34.951210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e2af-fdc2-4997-ac65-ba4d98c1f8dc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:34.951353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e2af-fdc2-4997-ac65-ba4d98c1f8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:34.969151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9a13e2af-fdc2-4997-ac65-ba4d98c1f8dc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:34.970352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9a13e2af-fdc2-4997-ac65-ba4d98c1f8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:35.028021 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3844/7663] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:35.038083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:35.039525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:35.097743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2248781-7937-4309-b7ac-56e4d9be7c96 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:35.101520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0ad68-9d1b-4850-a323-916ad1f7d57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:35.102157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ad68-9d1b-4850-a323-916ad1f7d57e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:35.102446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ad68-9d1b-4850-a323-916ad1f7d57e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:35.102726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0ad68-9d1b-4850-a323-916ad1f7d57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:35.112680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0ad68-9d1b-4850-a323-916ad1f7d57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:35.114131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0ad68-9d1b-4850-a323-916ad1f7d57e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:35.124706 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3820/7664] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:35.384173 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13e2af-fdc2-4997-ac65-ba4d98c1f8dc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:35.386480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9a13e2af-fdc2-4997-ac65-ba4d98c1f8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:35.405844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13e2af-fdc2-4997-ac65-ba4d98c1f8dc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:35.410671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:35.411578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:35.411868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:35.412175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] PATH_INFO: `/v3/projects/b6237bea2e334fe3a8aac46dd4ae6fde` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:35.413558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6237bea2e334fe3a8aac46dd4ae6fde)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:35.415662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:35.474698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6237bea2e334fe3a8aac46dd4ae6fde', 'request_id': 'req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:35.483858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6237bea2e334fe3a8aac46dd4ae6fde', 'request_id': 'req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:35.493355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6237bea2e334fe3a8aac46dd4ae6fde', 'request_id': 'req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:35.504211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] The token cache is being invalidate because project b6237bea2e334fe3a8aac46dd4ae6fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:35.504508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:35.505166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:35.506774 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3845/7665] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:35 2021] DELETE /identity/v3/projects/b6237bea2e334fe3a8aac46dd4ae6fde => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:35.510756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0ad68-9d1b-4850-a323-916ad1f7d57e service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:35.524293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0ad68-9d1b-4850-a323-916ad1f7d57e service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:35.580365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f5a9a-c487-4439-86d1-59a78b8a6a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:35.581159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f5a9a-c487-4439-86d1-59a78b8a6a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:35.581421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f5a9a-c487-4439-86d1-59a78b8a6a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:35.581695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f5a9a-c487-4439-86d1-59a78b8a6a07 admin admin] PATH_INFO: `/v3/users/a05c9431e671451e8b6b904cf9617fa8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:35.582886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f5a9a-c487-4439-86d1-59a78b8a6a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05c9431e671451e8b6b904cf9617fa8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:35.584850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f5a9a-c487-4439-86d1-59a78b8a6a07 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:35.633128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad7f5a9a-c487-4439-86d1-59a78b8a6a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05c9431e671451e8b6b904cf9617fa8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:35.633786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad7f5a9a-c487-4439-86d1-59a78b8a6a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05c9431e671451e8b6b904cf9617fa8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:35.641791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad7f5a9a-c487-4439-86d1-59a78b8a6a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05c9431e671451e8b6b904cf9617fa8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:35.642499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad7f5a9a-c487-4439-86d1-59a78b8a6a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05c9431e671451e8b6b904cf9617fa8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:35.649474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad7f5a9a-c487-4439-86d1-59a78b8a6a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05c9431e671451e8b6b904cf9617fa8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:35.667286 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3821/7666] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:35 2021] DELETE /identity/v3/users/a05c9431e671451e8b6b904cf9617fa8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:35.945983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:35.947555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:35.964513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7b3f1-0b27-4d32-a6e6-f34615a9d45a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:36.041312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:36.042280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:36.042642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:36.042953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] PATH_INFO: `/v3/projects/7786550fa88a41158e9f8aa6f329c813` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:36.045327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7786550fa88a41158e9f8aa6f329c813)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:36.048702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:36.094658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7786550fa88a41158e9f8aa6f329c813', 'request_id': 'req-6d25e400-4e67-409c-9a0a-1387fe97c59e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:36.102061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7786550fa88a41158e9f8aa6f329c813', 'request_id': 'req-6d25e400-4e67-409c-9a0a-1387fe97c59e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:36.109221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7786550fa88a41158e9f8aa6f329c813', 'request_id': 'req-6d25e400-4e67-409c-9a0a-1387fe97c59e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:36.120073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] The token cache is being invalidate because project 7786550fa88a41158e9f8aa6f329c813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:36.120474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:36.121194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6d25e400-4e67-409c-9a0a-1387fe97c59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:36.123052 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3846/7667] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:35 2021] DELETE /identity/v3/projects/7786550fa88a41158e9f8aa6f329c813 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:36.129906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980167a-ce7a-4e2f-9f08-b55aeff91f55 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:36.130423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980167a-ce7a-4e2f-9f08-b55aeff91f55 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:36.130540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980167a-ce7a-4e2f-9f08-b55aeff91f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:36.149101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4980167a-ce7a-4e2f-9f08-b55aeff91f55 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:36.150338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4980167a-ce7a-4e2f-9f08-b55aeff91f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:36.210399 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3822/7668] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:36.219368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c48e1-6e7e-45ca-8245-85586842ae89 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:36.219783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c48e1-6e7e-45ca-8245-85586842ae89 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:36.220147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c48e1-6e7e-45ca-8245-85586842ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:36.240921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-441c48e1-6e7e-45ca-8245-85586842ae89 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:36.242212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-441c48e1-6e7e-45ca-8245-85586842ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:36.250873 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3847/7669] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:36.255010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980167a-ce7a-4e2f-9f08-b55aeff91f55 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:36.265791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980167a-ce7a-4e2f-9f08-b55aeff91f55 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:36.271220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db1db9-2dc6-48ef-845e-bc572895b2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:36.271882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db1db9-2dc6-48ef-845e-bc572895b2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:36.272203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db1db9-2dc6-48ef-845e-bc572895b2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:36.272464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db1db9-2dc6-48ef-845e-bc572895b2a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:36.273193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db1db9-2dc6-48ef-845e-bc572895b2a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:17:36.273495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db1db9-2dc6-48ef-845e-bc572895b2a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:36.275110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db1db9-2dc6-48ef-845e-bc572895b2a8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:36.291436 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3823/7670] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:17:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:17:36.293731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c48e1-6e7e-45ca-8245-85586842ae89 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:36.306769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c48e1-6e7e-45ca-8245-85586842ae89 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:36.312021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e373e9-1c6b-4282-b1e7-e8474590e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:36.312699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e373e9-1c6b-4282-b1e7-e8474590e161 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:36.313076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e373e9-1c6b-4282-b1e7-e8474590e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:36.313357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e373e9-1c6b-4282-b1e7-e8474590e161 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:36.314070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e373e9-1c6b-4282-b1e7-e8474590e161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:36.316210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e373e9-1c6b-4282-b1e7-e8474590e161 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:36.344945 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3848/7671] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:36 2021] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:36.348401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db1db9-2dc6-48ef-845e-bc572895b2a8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:36.358220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db1db9-2dc6-48ef-845e-bc572895b2a8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:36.420248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e640431-da3e-46ab-89f1-d7c58f0c2f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:36.420943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e640431-da3e-46ab-89f1-d7c58f0c2f34 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:36.421229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e640431-da3e-46ab-89f1-d7c58f0c2f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:36.421502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e640431-da3e-46ab-89f1-d7c58f0c2f34 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:36.422316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e640431-da3e-46ab-89f1-d7c58f0c2f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:36.424716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e640431-da3e-46ab-89f1-d7c58f0c2f34 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:36.451542 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3824/7672] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:36 2021] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:36.455497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e373e9-1c6b-4282-b1e7-e8474590e161 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:36.467129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e373e9-1c6b-4282-b1e7-e8474590e161 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:36.474584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2d913-5860-4299-b905-091c31da00a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:36.475303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d913-5860-4299-b905-091c31da00a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:36.475613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d913-5860-4299-b905-091c31da00a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:36.475866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2d913-5860-4299-b905-091c31da00a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:36.476737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2d913-5860-4299-b905-091c31da00a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:36.478345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2d913-5860-4299-b905-091c31da00a4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:36.489828 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3849/7673] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:36 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:17:36.493765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e640431-da3e-46ab-89f1-d7c58f0c2f34 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:36.505068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e640431-da3e-46ab-89f1-d7c58f0c2f34 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:36.508813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f70092-fce2-49cf-90a4-b2021bb00299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:36.509494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f70092-fce2-49cf-90a4-b2021bb00299 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:36.509756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f70092-fce2-49cf-90a4-b2021bb00299 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:36.510029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f70092-fce2-49cf-90a4-b2021bb00299 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:36.510760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f70092-fce2-49cf-90a4-b2021bb00299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:36.513052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f70092-fce2-49cf-90a4-b2021bb00299 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:36.525439 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3825/7674] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:36.530088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2d913-5860-4299-b905-091c31da00a4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:36.541913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2d913-5860-4299-b905-091c31da00a4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:36.546967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc39c5-ca12-4d50-aefa-435ca36bc447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:36.547901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc39c5-ca12-4d50-aefa-435ca36bc447 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:36.548217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc39c5-ca12-4d50-aefa-435ca36bc447 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:36.548467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc39c5-ca12-4d50-aefa-435ca36bc447 admin admin] PATH_INFO: `/v3/projects/b1f72b0a292342919738705f8ea12286/users/6bac01afd0154b2a87d180bf3fcd6e7d/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:36.564040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc39c5-ca12-4d50-aefa-435ca36bc447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f72b0a292342919738705f8ea12286, user_id=6bac01afd0154b2a87d180bf3fcd6e7d, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:36.566867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc39c5-ca12-4d50-aefa-435ca36bc447 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:36.582421 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3850/7675] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:36 2021] PUT /identity/v3/projects/b1f72b0a292342919738705f8ea12286/users/6bac01afd0154b2a87d180bf3fcd6e7d/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:36.596786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939577c-7a6d-4e33-874f-3d396147aad4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:36.597283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939577c-7a6d-4e33-874f-3d396147aad4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:36.597571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939577c-7a6d-4e33-874f-3d396147aad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:36.628155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6939577c-7a6d-4e33-874f-3d396147aad4 None None] MFA Rules not processed for user `6bac01afd0154b2a87d180bf3fcd6e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:36.629398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6939577c-7a6d-4e33-874f-3d396147aad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:36.694158 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3826/7676] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:36 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:36.704278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc39c5-ca12-4d50-aefa-435ca36bc447 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:36.706102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-68fc39c5-ca12-4d50-aefa-435ca36bc447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:36.766758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc39c5-ca12-4d50-aefa-435ca36bc447 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:36.770611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c2a0d-23ed-435d-a381-402f389199d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:36.771286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c2a0d-23ed-435d-a381-402f389199d4 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:36.771581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c2a0d-23ed-435d-a381-402f389199d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:36.771920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c2a0d-23ed-435d-a381-402f389199d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:36.781383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c2a0d-23ed-435d-a381-402f389199d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:36.782823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c2a0d-23ed-435d-a381-402f389199d4 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:36.791954 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3851/7677] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:36 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:37.936218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14905f51-da17-4950-a764-0c40a783373b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:37.937157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14905f51-da17-4950-a764-0c40a783373b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:37.937442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14905f51-da17-4950-a764-0c40a783373b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:37.957484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-14905f51-da17-4950-a764-0c40a783373b None None] MFA Rules not processed for user `b771da0354414b239da0cad505f8ffe6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:37.958719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-14905f51-da17-4950-a764-0c40a783373b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:38.045707 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3827/7678] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:37 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:47.204161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c2a0d-23ed-435d-a381-402f389199d4 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:47.269434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c2a0d-23ed-435d-a381-402f389199d4 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:47.273950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:47.274808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:47.275090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:47.275403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] PATH_INFO: `/v3/users/6bac01afd0154b2a87d180bf3fcd6e7d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:47.276587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bac01afd0154b2a87d180bf3fcd6e7d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:47.278544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:47.324585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bac01afd0154b2a87d180bf3fcd6e7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:47.332540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bac01afd0154b2a87d180bf3fcd6e7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:47.333291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bac01afd0154b2a87d180bf3fcd6e7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:47.341057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bac01afd0154b2a87d180bf3fcd6e7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:47.352401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bac01afd0154b2a87d180bf3fcd6e7d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:47.359008 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3852/7679] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:17:47 2021] DELETE /identity/v3/users/6bac01afd0154b2a87d180bf3fcd6e7d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:17:47.363597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1991e1-e4b0-4222-9c85-24744ca0358b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:47.364115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1991e1-e4b0-4222-9c85-24744ca0358b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:47.364229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1991e1-e4b0-4222-9c85-24744ca0358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:47.382374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-eb1991e1-e4b0-4222-9c85-24744ca0358b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:47.383618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eb1991e1-e4b0-4222-9c85-24744ca0358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:47.451119 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3828/7680] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:47.461145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:47.462540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:47.524252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fb7a-da22-4ca6-bb9c-b5e0c292522f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:47.530118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9452b0-a64e-482d-aa00-a21a7ced95b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:47.532403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9452b0-a64e-482d-aa00-a21a7ced95b5 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:47.533370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9452b0-a64e-482d-aa00-a21a7ced95b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:47.533370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9452b0-a64e-482d-aa00-a21a7ced95b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:47.545698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9452b0-a64e-482d-aa00-a21a7ced95b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:47.547367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9452b0-a64e-482d-aa00-a21a7ced95b5 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:47.558167 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3853/7681] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:17:47.724818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1991e1-e4b0-4222-9c85-24744ca0358b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:47.726233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eb1991e1-e4b0-4222-9c85-24744ca0358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:47.742856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1991e1-e4b0-4222-9c85-24744ca0358b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:47.749159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:47.750003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:47.750308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:47.750622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] PATH_INFO: `/v3/projects/b1f72b0a292342919738705f8ea12286` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:47.751826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f72b0a292342919738705f8ea12286)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:47.753655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:47.799073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f72b0a292342919738705f8ea12286', 'request_id': 'req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:47.805072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f72b0a292342919738705f8ea12286', 'request_id': 'req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:47.812810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f72b0a292342919738705f8ea12286', 'request_id': 'req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:47.822630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] The token cache is being invalidate because project b1f72b0a292342919738705f8ea12286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:17:47.822913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:47.823545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f2a12c48-a70a-4b68-9c23-10f2dce4f4cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:17:47.825386 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3829/7682] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:17:47 2021] DELETE /identity/v3/projects/b1f72b0a292342919738705f8ea12286 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:17:47.830996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917cdc-d69b-40a6-a96d-1d6a0ef81ba7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:47.831316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917cdc-d69b-40a6-a96d-1d6a0ef81ba7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:47.831598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f917cdc-d69b-40a6-a96d-1d6a0ef81ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:47.849954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4f917cdc-d69b-40a6-a96d-1d6a0ef81ba7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:47.851141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4f917cdc-d69b-40a6-a96d-1d6a0ef81ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:47.906992 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3854/7683] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:47.915420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d1c75-7cc9-4906-8c74-47999a0b3208 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:47.915748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d1c75-7cc9-4906-8c74-47999a0b3208 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:47.916013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d1c75-7cc9-4906-8c74-47999a0b3208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:47.935960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4c6d1c75-7cc9-4906-8c74-47999a0b3208 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:47.937268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4c6d1c75-7cc9-4906-8c74-47999a0b3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:47.945144 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3830/7684] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:47.949373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f917cdc-d69b-40a6-a96d-1d6a0ef81ba7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:47.959010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f917cdc-d69b-40a6-a96d-1d6a0ef81ba7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:47.963914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972723e0-8863-4ce4-82c6-164b5d7bd6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:47.964559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972723e0-8863-4ce4-82c6-164b5d7bd6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:47.964841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972723e0-8863-4ce4-82c6-164b5d7bd6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:47.965115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972723e0-8863-4ce4-82c6-164b5d7bd6d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:47.966367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972723e0-8863-4ce4-82c6-164b5d7bd6d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:17:47.966681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972723e0-8863-4ce4-82c6-164b5d7bd6d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:47.968350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972723e0-8863-4ce4-82c6-164b5d7bd6d9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:47.979510 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3855/7685] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:17:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:17:47.984733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d1c75-7cc9-4906-8c74-47999a0b3208 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:47.994248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d1c75-7cc9-4906-8c74-47999a0b3208 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:47.999374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab14bd-8de2-4a57-9eec-e50da487f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:48.000022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab14bd-8de2-4a57-9eec-e50da487f6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:48.000303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab14bd-8de2-4a57-9eec-e50da487f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:48.000602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab14bd-8de2-4a57-9eec-e50da487f6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:48.001312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab14bd-8de2-4a57-9eec-e50da487f6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:48.003215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab14bd-8de2-4a57-9eec-e50da487f6c4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:48.030231 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3831/7686] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:17:47 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:17:48.034406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972723e0-8863-4ce4-82c6-164b5d7bd6d9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:48.045238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972723e0-8863-4ce4-82c6-164b5d7bd6d9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:48.099385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d2e53-a16f-4fdd-85fa-3f34e76be8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:48.100043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d2e53-a16f-4fdd-85fa-3f34e76be8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:48.100324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d2e53-a16f-4fdd-85fa-3f34e76be8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:48.100599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d2e53-a16f-4fdd-85fa-3f34e76be8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:48.101315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d2e53-a16f-4fdd-85fa-3f34e76be8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:48.103201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d2e53-a16f-4fdd-85fa-3f34e76be8f8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:48.122994 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3856/7687] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:17:48 2021] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:17:48.127325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab14bd-8de2-4a57-9eec-e50da487f6c4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:48.137971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab14bd-8de2-4a57-9eec-e50da487f6c4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:48.142546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af0067-754b-42a5-b935-d11454964c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:48.143190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0067-754b-42a5-b935-d11454964c8e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:48.143502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0067-754b-42a5-b935-d11454964c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:48.143779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0067-754b-42a5-b935-d11454964c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:48.144500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af0067-754b-42a5-b935-d11454964c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:48.146321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af0067-754b-42a5-b935-d11454964c8e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:48.156930 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3832/7688] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:48.160873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d2e53-a16f-4fdd-85fa-3f34e76be8f8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:48.171153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d2e53-a16f-4fdd-85fa-3f34e76be8f8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:48.175769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a3ae2-3fc3-4e23-91a8-42ed1ca2a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:48.176413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a3ae2-3fc3-4e23-91a8-42ed1ca2a346 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:48.176698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a3ae2-3fc3-4e23-91a8-42ed1ca2a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:48.176975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a3ae2-3fc3-4e23-91a8-42ed1ca2a346 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:48.177701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a3ae2-3fc3-4e23-91a8-42ed1ca2a346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:48.179292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a3ae2-3fc3-4e23-91a8-42ed1ca2a346 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:48.188933 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3857/7689] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:17:48 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:17:48.192536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af0067-754b-42a5-b935-d11454964c8e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:48.203142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af0067-754b-42a5-b935-d11454964c8e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:48.208256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cd59b-5da2-4594-b0ac-ba88c4e0ba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:48.209131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cd59b-5da2-4594-b0ac-ba88c4e0ba2c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:48.209417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cd59b-5da2-4594-b0ac-ba88c4e0ba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:48.209695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cd59b-5da2-4594-b0ac-ba88c4e0ba2c admin admin] PATH_INFO: `/v3/projects/e439cc4adc1746b0bd083fc3ff1b68e6/users/56040d758583450f973da7a939b139f8/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:48.225815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cd59b-5da2-4594-b0ac-ba88c4e0ba2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e439cc4adc1746b0bd083fc3ff1b68e6, user_id=56040d758583450f973da7a939b139f8, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:48.228600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cd59b-5da2-4594-b0ac-ba88c4e0ba2c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:48.242112 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3833/7690] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:17:48 2021] PUT /identity/v3/projects/e439cc4adc1746b0bd083fc3ff1b68e6/users/56040d758583450f973da7a939b139f8/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:17:48.252379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533cbc0-e4d3-4c71-b6da-e459600c9b16 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:48.252885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533cbc0-e4d3-4c71-b6da-e459600c9b16 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:48.253013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533cbc0-e4d3-4c71-b6da-e459600c9b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:48.282594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e533cbc0-e4d3-4c71-b6da-e459600c9b16 None None] MFA Rules not processed for user `56040d758583450f973da7a939b139f8`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:17:48.284171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e533cbc0-e4d3-4c71-b6da-e459600c9b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:48.348411 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3858/7691] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:17:48 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:17:48.358866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cd59b-5da2-4594-b0ac-ba88c4e0ba2c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:17:48.360993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2e8cd59b-5da2-4594-b0ac-ba88c4e0ba2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:17:48.423950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cd59b-5da2-4594-b0ac-ba88c4e0ba2c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:17:48.433657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e7e70-2f43-4820-a281-78b4391f8093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:17:48.435101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7e70-2f43-4820-a281-78b4391f8093 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:17:48.435533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7e70-2f43-4820-a281-78b4391f8093 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:17:48.435912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e7e70-2f43-4820-a281-78b4391f8093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:17:48.445973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e7e70-2f43-4820-a281-78b4391f8093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:17:48.447536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e7e70-2f43-4820-a281-78b4391f8093 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:17:48.457421 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3834/7692] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:17:48 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:03.892397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533cbc0-e4d3-4c71-b6da-e459600c9b16 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:03.954445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533cbc0-e4d3-4c71-b6da-e459600c9b16 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:03.959362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:03.960249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:03.960534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:03.960811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] PATH_INFO: `/v3/users/56040d758583450f973da7a939b139f8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:03.962035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56040d758583450f973da7a939b139f8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:03.964000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:04.009627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56040d758583450f973da7a939b139f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:04.016973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56040d758583450f973da7a939b139f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:04.017664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56040d758583450f973da7a939b139f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:04.024611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56040d758583450f973da7a939b139f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:04.036116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56040d758583450f973da7a939b139f8'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:04.041853 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3859/7693] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:03 2021] DELETE /identity/v3/users/56040d758583450f973da7a939b139f8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:04.046863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061b6dc-5f68-453f-995e-55e9656c4cfe None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.047362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061b6dc-5f68-453f-995e-55e9656c4cfe None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.047554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061b6dc-5f68-453f-995e-55e9656c4cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.064927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f061b6dc-5f68-453f-995e-55e9656c4cfe None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:04.066113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f061b6dc-5f68-453f-995e-55e9656c4cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:04.123524 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3835/7694] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:04.133258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:04.134677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:04.191364 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826970e5-7f0d-4f91-b09a-75ca993d3f00 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:04.194926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c80c6-7d97-475b-bf71-2c8815a37bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:04.195592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c80c6-7d97-475b-bf71-2c8815a37bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.195875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c80c6-7d97-475b-bf71-2c8815a37bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.196149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c80c6-7d97-475b-bf71-2c8815a37bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.205165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c80c6-7d97-475b-bf71-2c8815a37bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:04.206575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c80c6-7d97-475b-bf71-2c8815a37bf0 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:04.216441 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3860/7695] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:04.384644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061b6dc-5f68-453f-995e-55e9656c4cfe None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:04.386074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f061b6dc-5f68-453f-995e-55e9656c4cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:04.403107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061b6dc-5f68-453f-995e-55e9656c4cfe None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:04.410842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:04.411735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.412007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.412269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] PATH_INFO: `/v3/projects/e439cc4adc1746b0bd083fc3ff1b68e6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.413472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e439cc4adc1746b0bd083fc3ff1b68e6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:04.415453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:04.465865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e439cc4adc1746b0bd083fc3ff1b68e6', 'request_id': 'req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:04.472035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e439cc4adc1746b0bd083fc3ff1b68e6', 'request_id': 'req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:04.478935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e439cc4adc1746b0bd083fc3ff1b68e6', 'request_id': 'req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:04.489940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] The token cache is being invalidate because project e439cc4adc1746b0bd083fc3ff1b68e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:04.490226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:04.490857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cef0c4cc-38e0-4398-86fc-8a48cd5c5cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:04.492429 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3836/7696] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:04 2021] DELETE /identity/v3/projects/e439cc4adc1746b0bd083fc3ff1b68e6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:04.500054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def55117-85e1-458e-b169-3bfff8806999 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.500340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def55117-85e1-458e-b169-3bfff8806999 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.500617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def55117-85e1-458e-b169-3bfff8806999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.518310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-def55117-85e1-458e-b169-3bfff8806999 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:04.519520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-def55117-85e1-458e-b169-3bfff8806999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:04.577337 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3861/7697] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:18:04.584743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a1ac9-0279-4497-b1b2-2965cbe9d9b8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.585034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a1ac9-0279-4497-b1b2-2965cbe9d9b8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.585309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a1ac9-0279-4497-b1b2-2965cbe9d9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.603885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-700a1ac9-0279-4497-b1b2-2965cbe9d9b8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:04.605666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-700a1ac9-0279-4497-b1b2-2965cbe9d9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:04.613516 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3837/7698] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:04.617871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def55117-85e1-458e-b169-3bfff8806999 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:04.627694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def55117-85e1-458e-b169-3bfff8806999 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:04.632737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272c15b-0805-4a08-a7a3-bd673be769ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:04.633384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272c15b-0805-4a08-a7a3-bd673be769ea admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.633668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272c15b-0805-4a08-a7a3-bd673be769ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.633948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272c15b-0805-4a08-a7a3-bd673be769ea admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.634677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272c15b-0805-4a08-a7a3-bd673be769ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:18:04.634982 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272c15b-0805-4a08-a7a3-bd673be769ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:04.636641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272c15b-0805-4a08-a7a3-bd673be769ea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:04.647843 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3862/7699] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:18:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:18:04.652574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a1ac9-0279-4497-b1b2-2965cbe9d9b8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:04.661633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a1ac9-0279-4497-b1b2-2965cbe9d9b8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:04.666350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17824b86-5359-46fe-9fd5-1195c22304c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:04.666988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824b86-5359-46fe-9fd5-1195c22304c7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.667299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824b86-5359-46fe-9fd5-1195c22304c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.668179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824b86-5359-46fe-9fd5-1195c22304c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.668874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17824b86-5359-46fe-9fd5-1195c22304c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:04.670817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17824b86-5359-46fe-9fd5-1195c22304c7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:04.702259 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3838/7700] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:04 2021] POST /identity/v3/projects => generated 351 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:04.704088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272c15b-0805-4a08-a7a3-bd673be769ea admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:04.715130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272c15b-0805-4a08-a7a3-bd673be769ea admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:04.769650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bff8b-a33b-4df6-95e2-b6d6166a08ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:04.770343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bff8b-a33b-4df6-95e2-b6d6166a08ad admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.770624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bff8b-a33b-4df6-95e2-b6d6166a08ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.770906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bff8b-a33b-4df6-95e2-b6d6166a08ad admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.771641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bff8b-a33b-4df6-95e2-b6d6166a08ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:04.773541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bff8b-a33b-4df6-95e2-b6d6166a08ad admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:04.793131 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3863/7701] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:04 2021] POST /identity/v3/users => generated 276 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:04.797362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17824b86-5359-46fe-9fd5-1195c22304c7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:04.807520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17824b86-5359-46fe-9fd5-1195c22304c7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:04.812117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd88d1-28c8-4fa0-b561-55cc9a2e4672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:04.812759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd88d1-28c8-4fa0-b561-55cc9a2e4672 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.813038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd88d1-28c8-4fa0-b561-55cc9a2e4672 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.813307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd88d1-28c8-4fa0-b561-55cc9a2e4672 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.814030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd88d1-28c8-4fa0-b561-55cc9a2e4672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:04.815654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd88d1-28c8-4fa0-b561-55cc9a2e4672 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:04.826219 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3839/7702] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:04 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:04.830052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bff8b-a33b-4df6-95e2-b6d6166a08ad admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:04.840542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bff8b-a33b-4df6-95e2-b6d6166a08ad admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:04.845167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b06076-6936-415a-8e99-cff12bea5261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:04.845811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b06076-6936-415a-8e99-cff12bea5261 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.846096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b06076-6936-415a-8e99-cff12bea5261 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.846376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b06076-6936-415a-8e99-cff12bea5261 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.847099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b06076-6936-415a-8e99-cff12bea5261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:04.848715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b06076-6936-415a-8e99-cff12bea5261 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:04.858249 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3864/7703] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:04 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:04.862008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd88d1-28c8-4fa0-b561-55cc9a2e4672 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:04.872120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd88d1-28c8-4fa0-b561-55cc9a2e4672 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:04.876745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e37f2-a7a9-4f3a-8d30-147aa3c4012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:04.877613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e37f2-a7a9-4f3a-8d30-147aa3c4012c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.877964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e37f2-a7a9-4f3a-8d30-147aa3c4012c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.878155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e37f2-a7a9-4f3a-8d30-147aa3c4012c admin admin] PATH_INFO: `/v3/projects/c0b315fe3ee34801a5d7937df078dddd/users/072f44bf078c45309337925064a1fc5b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.893082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e37f2-a7a9-4f3a-8d30-147aa3c4012c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b315fe3ee34801a5d7937df078dddd, user_id=072f44bf078c45309337925064a1fc5b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:04.895771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e37f2-a7a9-4f3a-8d30-147aa3c4012c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:04.908953 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3840/7704] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:04 2021] PUT /identity/v3/projects/c0b315fe3ee34801a5d7937df078dddd/users/072f44bf078c45309337925064a1fc5b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:18:04.919746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4693c-b215-46e3-8ef4-1bf532bdac7c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:04.920279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4693c-b215-46e3-8ef4-1bf532bdac7c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:04.920279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4693c-b215-46e3-8ef4-1bf532bdac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:04.948348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fbf4693c-b215-46e3-8ef4-1bf532bdac7c None None] MFA Rules not processed for user `072f44bf078c45309337925064a1fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:04.949639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fbf4693c-b215-46e3-8ef4-1bf532bdac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:05.018767 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3865/7705] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:04 2021] POST /identity/v3/auth/tokens => generated 3218 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:05.029324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e37f2-a7a9-4f3a-8d30-147aa3c4012c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:05.031042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ee2e37f2-a7a9-4f3a-8d30-147aa3c4012c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:05.088927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e37f2-a7a9-4f3a-8d30-147aa3c4012c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:05.093184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52b3e1-a533-4d6d-9fe6-0696690c775a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:05.093824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52b3e1-a533-4d6d-9fe6-0696690c775a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:05.094112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52b3e1-a533-4d6d-9fe6-0696690c775a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:05.094997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52b3e1-a533-4d6d-9fe6-0696690c775a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:05.103276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52b3e1-a533-4d6d-9fe6-0696690c775a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:05.104709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52b3e1-a533-4d6d-9fe6-0696690c775a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:05.114058 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3841/7706] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:05 2021] GET /identity/v3/auth/tokens => generated 3218 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:06.944059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4693c-b215-46e3-8ef4-1bf532bdac7c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:07.014912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4693c-b215-46e3-8ef4-1bf532bdac7c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:07.019723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:07.020615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.020899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.021175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] PATH_INFO: `/v3/users/072f44bf078c45309337925064a1fc5b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.022505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=072f44bf078c45309337925064a1fc5b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:07.024863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:07.069416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072f44bf078c45309337925064a1fc5b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:07.076729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072f44bf078c45309337925064a1fc5b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:07.077383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072f44bf078c45309337925064a1fc5b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:07.087060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072f44bf078c45309337925064a1fc5b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:07.100031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072f44bf078c45309337925064a1fc5b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:07.105818 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3866/7707] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:06 2021] DELETE /identity/v3/users/072f44bf078c45309337925064a1fc5b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:07.110320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdf0f1-f0b7-44a8-9d77-722d2d3b6777 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.110809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdf0f1-f0b7-44a8-9d77-722d2d3b6777 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.110962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdf0f1-f0b7-44a8-9d77-722d2d3b6777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.127653 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5ccdf0f1-f0b7-44a8-9d77-722d2d3b6777 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:07.128831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5ccdf0f1-f0b7-44a8-9d77-722d2d3b6777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:07.185691 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3842/7708] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:07.195612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:07.197030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:07.257124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0aa80-0766-4b5b-85d5-66060a060d9d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:07.260960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bf5a3-b827-4c8e-bf8f-fd7a247a133a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:07.262130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf5a3-b827-4c8e-bf8f-fd7a247a133a service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.262415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf5a3-b827-4c8e-bf8f-fd7a247a133a service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.262691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bf5a3-b827-4c8e-bf8f-fd7a247a133a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.271891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bf5a3-b827-4c8e-bf8f-fd7a247a133a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:07.273313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bf5a3-b827-4c8e-bf8f-fd7a247a133a service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:07.283154 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3867/7709] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:07.448319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdf0f1-f0b7-44a8-9d77-722d2d3b6777 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:07.450315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5ccdf0f1-f0b7-44a8-9d77-722d2d3b6777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:07.462430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdf0f1-f0b7-44a8-9d77-722d2d3b6777 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:07.467007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:07.467907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.468186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.468461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] PATH_INFO: `/v3/projects/c0b315fe3ee34801a5d7937df078dddd` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.469917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b315fe3ee34801a5d7937df078dddd)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:07.471943 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:07.517660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b315fe3ee34801a5d7937df078dddd', 'request_id': 'req-e09105b5-2fe1-4a76-a613-eae772696826'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:07.523654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b315fe3ee34801a5d7937df078dddd', 'request_id': 'req-e09105b5-2fe1-4a76-a613-eae772696826'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:07.530553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b315fe3ee34801a5d7937df078dddd', 'request_id': 'req-e09105b5-2fe1-4a76-a613-eae772696826'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:07.540428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] The token cache is being invalidate because project c0b315fe3ee34801a5d7937df078dddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:07.540714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:07.541338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e09105b5-2fe1-4a76-a613-eae772696826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:07.542891 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3843/7710] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:07 2021] DELETE /identity/v3/projects/c0b315fe3ee34801a5d7937df078dddd => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:07.548866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325f96-7040-4fba-82c1-84868fdeed4a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.549154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325f96-7040-4fba-82c1-84868fdeed4a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.549457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325f96-7040-4fba-82c1-84868fdeed4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.567887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-57325f96-7040-4fba-82c1-84868fdeed4a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:07.569087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-57325f96-7040-4fba-82c1-84868fdeed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:07.625475 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3868/7711] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:18:07.633431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a84f38-1e2e-47c2-b58f-8333b1e597d7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.633718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a84f38-1e2e-47c2-b58f-8333b1e597d7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.633997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a84f38-1e2e-47c2-b58f-8333b1e597d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.652839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-14a84f38-1e2e-47c2-b58f-8333b1e597d7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:07.654025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-14a84f38-1e2e-47c2-b58f-8333b1e597d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:07.661896 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3844/7712] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:07.665970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57325f96-7040-4fba-82c1-84868fdeed4a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:07.676101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57325f96-7040-4fba-82c1-84868fdeed4a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:07.680697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1a2d-8209-468b-875a-3b8a478e4262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:07.681337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1a2d-8209-468b-875a-3b8a478e4262 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.681623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1a2d-8209-468b-875a-3b8a478e4262 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.681899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1a2d-8209-468b-875a-3b8a478e4262 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.682623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec1a2d-8209-468b-875a-3b8a478e4262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:18:07.682929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec1a2d-8209-468b-875a-3b8a478e4262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:07.685160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec1a2d-8209-468b-875a-3b8a478e4262 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:07.696535 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3869/7713] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:18:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:18:07.700694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a84f38-1e2e-47c2-b58f-8333b1e597d7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:07.709685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a84f38-1e2e-47c2-b58f-8333b1e597d7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:07.714289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d3b79-54ff-492e-92b7-a0c7e8f16186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:07.714925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d3b79-54ff-492e-92b7-a0c7e8f16186 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.715204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d3b79-54ff-492e-92b7-a0c7e8f16186 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.715505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d3b79-54ff-492e-92b7-a0c7e8f16186 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.716196 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d3b79-54ff-492e-92b7-a0c7e8f16186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:07.718081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d3b79-54ff-492e-92b7-a0c7e8f16186 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:07.743122 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3845/7714] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:07 2021] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:07.747746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1a2d-8209-468b-875a-3b8a478e4262 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:07.757534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1a2d-8209-468b-875a-3b8a478e4262 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:07.810824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499856b-b8f7-45a0-b822-f383c17cc4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:07.811503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499856b-b8f7-45a0-b822-f383c17cc4db admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.811791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499856b-b8f7-45a0-b822-f383c17cc4db admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.812069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499856b-b8f7-45a0-b822-f383c17cc4db admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.812758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499856b-b8f7-45a0-b822-f383c17cc4db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:07.814658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499856b-b8f7-45a0-b822-f383c17cc4db admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:07.833378 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3870/7715] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:07 2021] POST /identity/v3/users => generated 283 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:07.837428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d3b79-54ff-492e-92b7-a0c7e8f16186 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:07.848636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d3b79-54ff-492e-92b7-a0c7e8f16186 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:07.853239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae978d08-ba35-4fbd-9d32-4d357e2aed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:07.853894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae978d08-ba35-4fbd-9d32-4d357e2aed51 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.854176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae978d08-ba35-4fbd-9d32-4d357e2aed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.854441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae978d08-ba35-4fbd-9d32-4d357e2aed51 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.855794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae978d08-ba35-4fbd-9d32-4d357e2aed51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:07.857383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae978d08-ba35-4fbd-9d32-4d357e2aed51 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:07.873981 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3846/7716] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:07 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:18:07.875115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499856b-b8f7-45a0-b822-f383c17cc4db admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:07.884972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499856b-b8f7-45a0-b822-f383c17cc4db admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:07.889714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f40b0-1f50-4620-b87c-e8647858fb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:07.890370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f40b0-1f50-4620-b87c-e8647858fb93 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.890653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f40b0-1f50-4620-b87c-e8647858fb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.890929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f40b0-1f50-4620-b87c-e8647858fb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.891730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f40b0-1f50-4620-b87c-e8647858fb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:07.893312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f40b0-1f50-4620-b87c-e8647858fb93 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:07.903484 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3871/7717] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:07.907580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae978d08-ba35-4fbd-9d32-4d357e2aed51 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:07.918341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae978d08-ba35-4fbd-9d32-4d357e2aed51 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:07.923736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32580fc-0771-4ab3-8bb7-c15a7f192545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:07.924623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32580fc-0771-4ab3-8bb7-c15a7f192545 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.924906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32580fc-0771-4ab3-8bb7-c15a7f192545 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.925188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32580fc-0771-4ab3-8bb7-c15a7f192545 admin admin] PATH_INFO: `/v3/projects/bba36fea764c44289eef1eef41bf7571/users/90cd21f12cdf4e85b053a7169a040c24/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.942262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32580fc-0771-4ab3-8bb7-c15a7f192545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba36fea764c44289eef1eef41bf7571, user_id=90cd21f12cdf4e85b053a7169a040c24, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:07.944950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32580fc-0771-4ab3-8bb7-c15a7f192545 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:07.957648 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3847/7718] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:07 2021] PUT /identity/v3/projects/bba36fea764c44289eef1eef41bf7571/users/90cd21f12cdf4e85b053a7169a040c24/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:07.968673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15192-855d-4b7d-8c50-a6a9a6188de2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:07.969171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15192-855d-4b7d-8c50-a6a9a6188de2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:07.969283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db15192-855d-4b7d-8c50-a6a9a6188de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:07.996764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2db15192-855d-4b7d-8c50-a6a9a6188de2 None None] MFA Rules not processed for user `90cd21f12cdf4e85b053a7169a040c24`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:07.998047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2db15192-855d-4b7d-8c50-a6a9a6188de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:08.061969 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3872/7719] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:07 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:18:08.066535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32580fc-0771-4ab3-8bb7-c15a7f192545 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:08.128061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32580fc-0771-4ab3-8bb7-c15a7f192545 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:08.132711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd941b-7abe-4aad-983b-d3a2481fec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:08.133358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd941b-7abe-4aad-983b-d3a2481fec6a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:08.133642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd941b-7abe-4aad-983b-d3a2481fec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:08.133921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd941b-7abe-4aad-983b-d3a2481fec6a admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:08.134628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd941b-7abe-4aad-983b-d3a2481fec6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:08.136578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd941b-7abe-4aad-983b-d3a2481fec6a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:08.160184 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3848/7720] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:08 2021] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:18:08.164431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db15192-855d-4b7d-8c50-a6a9a6188de2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:08.175727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db15192-855d-4b7d-8c50-a6a9a6188de2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:08.229248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788e4b1-d20d-468b-a2d2-367a117fc681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:08.230536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788e4b1-d20d-468b-a2d2-367a117fc681 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:08.230829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788e4b1-d20d-468b-a2d2-367a117fc681 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:08.231107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788e4b1-d20d-468b-a2d2-367a117fc681 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:08.231841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788e4b1-d20d-468b-a2d2-367a117fc681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:08.233778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788e4b1-d20d-468b-a2d2-367a117fc681 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:08.252964 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3873/7721] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:08 2021] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:18:08.256691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd941b-7abe-4aad-983b-d3a2481fec6a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:08.267880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd941b-7abe-4aad-983b-d3a2481fec6a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:08.272833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d41104-ab5e-4325-8c0a-7e35fedea733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:08.273483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41104-ab5e-4325-8c0a-7e35fedea733 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:08.273763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41104-ab5e-4325-8c0a-7e35fedea733 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:08.274036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d41104-ab5e-4325-8c0a-7e35fedea733 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:08.274762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d41104-ab5e-4325-8c0a-7e35fedea733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:08.276387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d41104-ab5e-4325-8c0a-7e35fedea733 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:08.287138 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3849/7722] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:08.291234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788e4b1-d20d-468b-a2d2-367a117fc681 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:08.301580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788e4b1-d20d-468b-a2d2-367a117fc681 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:08.306156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732573c-66e7-426e-b231-6ec2c993b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:08.307015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732573c-66e7-426e-b231-6ec2c993b388 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:08.307333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732573c-66e7-426e-b231-6ec2c993b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:08.307611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732573c-66e7-426e-b231-6ec2c993b388 admin admin] PATH_INFO: `/v3/projects/460ca32fea244b2389efbf86553c560d/users/f93b0f0afd2a4f3eb41206cc67764c98/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:08.321919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732573c-66e7-426e-b231-6ec2c993b388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460ca32fea244b2389efbf86553c560d, user_id=f93b0f0afd2a4f3eb41206cc67764c98, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:08.324612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732573c-66e7-426e-b231-6ec2c993b388 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:08.337591 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3874/7723] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:08 2021] PUT /identity/v3/projects/460ca32fea244b2389efbf86553c560d/users/f93b0f0afd2a4f3eb41206cc67764c98/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:08.341934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d41104-ab5e-4325-8c0a-7e35fedea733 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:08.352074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d41104-ab5e-4325-8c0a-7e35fedea733 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:08.407159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bec56-87a0-4bac-b2b7-c58c8cf2bdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:08.407785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bec56-87a0-4bac-b2b7-c58c8cf2bdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:08.408067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bec56-87a0-4bac-b2b7-c58c8cf2bdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:08.408337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bec56-87a0-4bac-b2b7-c58c8cf2bdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:08.409064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bec56-87a0-4bac-b2b7-c58c8cf2bdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:08.410813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bec56-87a0-4bac-b2b7-c58c8cf2bdc8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:08.421610 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3850/7724] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:08 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:08.425877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732573c-66e7-426e-b231-6ec2c993b388 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:08.436130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732573c-66e7-426e-b231-6ec2c993b388 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:08.440735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57babbdb-10f8-4ada-8911-bc3b7819fc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:08.441612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57babbdb-10f8-4ada-8911-bc3b7819fc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:08.441900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57babbdb-10f8-4ada-8911-bc3b7819fc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:08.442174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57babbdb-10f8-4ada-8911-bc3b7819fc34 admin admin] PATH_INFO: `/v3/projects/460ca32fea244b2389efbf86553c560d/users/f93b0f0afd2a4f3eb41206cc67764c98/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:08.444196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57babbdb-10f8-4ada-8911-bc3b7819fc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460ca32fea244b2389efbf86553c560d, user_id=f93b0f0afd2a4f3eb41206cc67764c98, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:08.446818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57babbdb-10f8-4ada-8911-bc3b7819fc34 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:08.457525 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3875/7725] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:08 2021] PUT /identity/v3/projects/460ca32fea244b2389efbf86553c560d/users/f93b0f0afd2a4f3eb41206cc67764c98/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:18:08.468171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bac2e-4006-4681-918e-b37372d66b48 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:08.468459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bac2e-4006-4681-918e-b37372d66b48 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:08.468733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bac2e-4006-4681-918e-b37372d66b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:08.495018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-371bac2e-4006-4681-918e-b37372d66b48 None None] MFA Rules not processed for user `f93b0f0afd2a4f3eb41206cc67764c98`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:08.496290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-371bac2e-4006-4681-918e-b37372d66b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:08.562536 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3851/7726] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:08 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:08.573201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57babbdb-10f8-4ada-8911-bc3b7819fc34 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:08.575675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-57babbdb-10f8-4ada-8911-bc3b7819fc34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:08.654149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57babbdb-10f8-4ada-8911-bc3b7819fc34 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:08.657961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05934bd6-0e39-4cc8-9e86-097c6fcebef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:08.658539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05934bd6-0e39-4cc8-9e86-097c6fcebef2 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:08.658831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05934bd6-0e39-4cc8-9e86-097c6fcebef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:08.659114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05934bd6-0e39-4cc8-9e86-097c6fcebef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:08.668327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05934bd6-0e39-4cc8-9e86-097c6fcebef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:08.670462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05934bd6-0e39-4cc8-9e86-097c6fcebef2 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:08.683862 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3876/7727] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:08 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:08.841618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bac2e-4006-4681-918e-b37372d66b48 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:08.905219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bac2e-4006-4681-918e-b37372d66b48 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:08.909801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:08.910599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:08.910880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:08.911152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] PATH_INFO: `/v3/users/90cd21f12cdf4e85b053a7169a040c24` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:08.912387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=90cd21f12cdf4e85b053a7169a040c24)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:08.914314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:08.962752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90cd21f12cdf4e85b053a7169a040c24'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:08.963432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90cd21f12cdf4e85b053a7169a040c24'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:08.971007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90cd21f12cdf4e85b053a7169a040c24'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:08.971667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90cd21f12cdf4e85b053a7169a040c24'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:08.978796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90cd21f12cdf4e85b053a7169a040c24'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:08.996556 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3852/7728] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:08 2021] DELETE /identity/v3/users/90cd21f12cdf4e85b053a7169a040c24 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:09.000951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27a310-cdc5-434a-8418-3c22e79ffb09 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:09.001444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27a310-cdc5-434a-8418-3c22e79ffb09 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:09.001573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27a310-cdc5-434a-8418-3c22e79ffb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:09.020320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7e27a310-cdc5-434a-8418-3c22e79ffb09 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:09.021577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7e27a310-cdc5-434a-8418-3c22e79ffb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:09.078735 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3877/7729] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:09.088756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:09.090285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:09.152009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe66a5d-4e77-4e76-b878-ea52454c3f0e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:09.155731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb17ef-5696-4163-8338-e3c74960d39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:09.156373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb17ef-5696-4163-8338-e3c74960d39e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:09.156656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb17ef-5696-4163-8338-e3c74960d39e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:09.156933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb17ef-5696-4163-8338-e3c74960d39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:09.165840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb17ef-5696-4163-8338-e3c74960d39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:09.167240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb17ef-5696-4163-8338-e3c74960d39e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:09.177283 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3853/7730] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:09.437126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27a310-cdc5-434a-8418-3c22e79ffb09 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:09.438544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7e27a310-cdc5-434a-8418-3c22e79ffb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:09.451575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27a310-cdc5-434a-8418-3c22e79ffb09 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:09.457211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:09.458096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:09.458375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:09.458875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] PATH_INFO: `/v3/projects/bba36fea764c44289eef1eef41bf7571` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:09.460253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba36fea764c44289eef1eef41bf7571)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:09.462159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:09.525508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba36fea764c44289eef1eef41bf7571', 'request_id': 'req-0e4577d5-6c73-49db-be18-b748471ce591'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:09.532558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba36fea764c44289eef1eef41bf7571', 'request_id': 'req-0e4577d5-6c73-49db-be18-b748471ce591'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:09.538907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba36fea764c44289eef1eef41bf7571', 'request_id': 'req-0e4577d5-6c73-49db-be18-b748471ce591'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:09.549937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] The token cache is being invalidate because project bba36fea764c44289eef1eef41bf7571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:09.550253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:09.550901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:09.552465 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3878/7731] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:09 2021] DELETE /identity/v3/projects/bba36fea764c44289eef1eef41bf7571 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:09.556331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb17ef-5696-4163-8338-e3c74960d39e service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:09.566609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb17ef-5696-4163-8338-e3c74960d39e service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:09.622637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ae691-a817-4f32-a2a5-af1ae2c6dbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:09.623535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ae691-a817-4f32-a2a5-af1ae2c6dbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:09.623820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ae691-a817-4f32-a2a5-af1ae2c6dbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:09.624097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ae691-a817-4f32-a2a5-af1ae2c6dbd6 admin admin] PATH_INFO: `/v3/users/f93b0f0afd2a4f3eb41206cc67764c98` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:09.625284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ae691-a817-4f32-a2a5-af1ae2c6dbd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93b0f0afd2a4f3eb41206cc67764c98)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:09.627212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ae691-a817-4f32-a2a5-af1ae2c6dbd6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:09.671207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-274ae691-a817-4f32-a2a5-af1ae2c6dbd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93b0f0afd2a4f3eb41206cc67764c98'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:09.671907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-274ae691-a817-4f32-a2a5-af1ae2c6dbd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93b0f0afd2a4f3eb41206cc67764c98'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:09.678661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-274ae691-a817-4f32-a2a5-af1ae2c6dbd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93b0f0afd2a4f3eb41206cc67764c98'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:09.679350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-274ae691-a817-4f32-a2a5-af1ae2c6dbd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93b0f0afd2a4f3eb41206cc67764c98'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:09.685979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-274ae691-a817-4f32-a2a5-af1ae2c6dbd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93b0f0afd2a4f3eb41206cc67764c98'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:09.702498 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3854/7732] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:09 2021] DELETE /identity/v3/users/f93b0f0afd2a4f3eb41206cc67764c98 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:09.960055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:09.961528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:09.976181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4577d5-6c73-49db-be18-b748471ce591 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.034908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.035851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.036135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.036409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] PATH_INFO: `/v3/projects/460ca32fea244b2389efbf86553c560d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.037645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460ca32fea244b2389efbf86553c560d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.039567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.085498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460ca32fea244b2389efbf86553c560d', 'request_id': 'req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:10.093221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460ca32fea244b2389efbf86553c560d', 'request_id': 'req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:10.099355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460ca32fea244b2389efbf86553c560d', 'request_id': 'req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:10.109490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] The token cache is being invalidate because project 460ca32fea244b2389efbf86553c560d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:10.109774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:10.110396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b47f4cf4-4eb4-4c8f-a6ae-3e46f552e7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:10.111986 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3879/7733] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:09 2021] DELETE /identity/v3/projects/460ca32fea244b2389efbf86553c560d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:10.121189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf8931-c5ac-4d9f-9bfe-41267da143b9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.121483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf8931-c5ac-4d9f-9bfe-41267da143b9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.121768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf8931-c5ac-4d9f-9bfe-41267da143b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.140690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c4cf8931-c5ac-4d9f-9bfe-41267da143b9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:10.141941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c4cf8931-c5ac-4d9f-9bfe-41267da143b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:10.202263 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3855/7734] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:10.211389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e2030-9990-467b-9e34-3f93c2e25bee None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.211682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e2030-9990-467b-9e34-3f93c2e25bee None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.211965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e2030-9990-467b-9e34-3f93c2e25bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.230750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6e8e2030-9990-467b-9e34-3f93c2e25bee None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:10.231925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6e8e2030-9990-467b-9e34-3f93c2e25bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:10.240210 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3880/7735] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:10.244313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf8931-c5ac-4d9f-9bfe-41267da143b9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:10.254128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf8931-c5ac-4d9f-9bfe-41267da143b9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.258712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20a7cd-846c-4284-867c-1a52d2c198b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.259400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20a7cd-846c-4284-867c-1a52d2c198b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.259681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20a7cd-846c-4284-867c-1a52d2c198b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.259953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20a7cd-846c-4284-867c-1a52d2c198b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.260680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20a7cd-846c-4284-867c-1a52d2c198b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:18:10.260991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20a7cd-846c-4284-867c-1a52d2c198b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.263082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20a7cd-846c-4284-867c-1a52d2c198b4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.274552 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3856/7736] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:18:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:18:10.279580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e2030-9990-467b-9e34-3f93c2e25bee None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:10.289124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e2030-9990-467b-9e34-3f93c2e25bee None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.294537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d0426-abdc-4cbd-9727-8c988a074710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.295191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d0426-abdc-4cbd-9727-8c988a074710 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.295508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d0426-abdc-4cbd-9727-8c988a074710 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.295790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d0426-abdc-4cbd-9727-8c988a074710 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.296503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d0426-abdc-4cbd-9727-8c988a074710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.298397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d0426-abdc-4cbd-9727-8c988a074710 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.323794 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3881/7737] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:10 2021] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:10.328048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20a7cd-846c-4284-867c-1a52d2c198b4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:10.337874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20a7cd-846c-4284-867c-1a52d2c198b4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.392132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1f302-808d-4693-be9f-cc588fee15fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.392790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1f302-808d-4693-be9f-cc588fee15fd admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.393070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1f302-808d-4693-be9f-cc588fee15fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.393349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1f302-808d-4693-be9f-cc588fee15fd admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.394037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1f302-808d-4693-be9f-cc588fee15fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.395983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1f302-808d-4693-be9f-cc588fee15fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.415421 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3857/7738] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:10 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:18:10.420100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d0426-abdc-4cbd-9727-8c988a074710 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:10.430633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d0426-abdc-4cbd-9727-8c988a074710 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.435521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3a8a5-ced1-453b-85d5-8ac517d81426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.436178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3a8a5-ced1-453b-85d5-8ac517d81426 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.436458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3a8a5-ced1-453b-85d5-8ac517d81426 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.436729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3a8a5-ced1-453b-85d5-8ac517d81426 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.437456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3a8a5-ced1-453b-85d5-8ac517d81426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.439042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3a8a5-ced1-453b-85d5-8ac517d81426 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.449630 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3882/7739] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:10 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:10.453631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1f302-808d-4693-be9f-cc588fee15fd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:10.463695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1f302-808d-4693-be9f-cc588fee15fd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.468807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca881e5a-ee2c-4ab7-9a94-b3519c061471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.469452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881e5a-ee2c-4ab7-9a94-b3519c061471 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.469736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881e5a-ee2c-4ab7-9a94-b3519c061471 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.470010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881e5a-ee2c-4ab7-9a94-b3519c061471 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.470741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca881e5a-ee2c-4ab7-9a94-b3519c061471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.472364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca881e5a-ee2c-4ab7-9a94-b3519c061471 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.482615 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3858/7740] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:10.486558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3a8a5-ced1-453b-85d5-8ac517d81426 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:10.497024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3a8a5-ced1-453b-85d5-8ac517d81426 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.501633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40753b0c-500d-4a74-8da1-456f4ff47bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.502518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40753b0c-500d-4a74-8da1-456f4ff47bad admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.502797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40753b0c-500d-4a74-8da1-456f4ff47bad admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.503092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40753b0c-500d-4a74-8da1-456f4ff47bad admin admin] PATH_INFO: `/v3/projects/75fdab8ebf224c2a82632ae32d48717f/users/04ba246f65534140bb1bc2d3d54725e4/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.517031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40753b0c-500d-4a74-8da1-456f4ff47bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fdab8ebf224c2a82632ae32d48717f, user_id=04ba246f65534140bb1bc2d3d54725e4, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.519690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40753b0c-500d-4a74-8da1-456f4ff47bad admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.533337 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3883/7741] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:10 2021] PUT /identity/v3/projects/75fdab8ebf224c2a82632ae32d48717f/users/04ba246f65534140bb1bc2d3d54725e4/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:18:10.543996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdcc0-1740-4931-95c9-a49ed606e239 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.544294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdcc0-1740-4931-95c9-a49ed606e239 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.544581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cdcc0-1740-4931-95c9-a49ed606e239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.570655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-db3cdcc0-1740-4931-95c9-a49ed606e239 None None] MFA Rules not processed for user `04ba246f65534140bb1bc2d3d54725e4`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:10.571938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-db3cdcc0-1740-4931-95c9-a49ed606e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:10.633688 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3859/7742] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:10 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:10.638692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40753b0c-500d-4a74-8da1-456f4ff47bad admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:10.698090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40753b0c-500d-4a74-8da1-456f4ff47bad admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.702817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869f870-8827-4c27-b8f4-ec8cae8fe3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.703489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869f870-8827-4c27-b8f4-ec8cae8fe3df admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.703784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869f870-8827-4c27-b8f4-ec8cae8fe3df admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.704062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869f870-8827-4c27-b8f4-ec8cae8fe3df admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.704770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869f870-8827-4c27-b8f4-ec8cae8fe3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.706675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869f870-8827-4c27-b8f4-ec8cae8fe3df admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.731217 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3884/7743] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:10 2021] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:10.735322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdcc0-1740-4931-95c9-a49ed606e239 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:10.746802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cdcc0-1740-4931-95c9-a49ed606e239 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.800494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6428e7-3c17-45e7-b0a4-2374e2217131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.801169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6428e7-3c17-45e7-b0a4-2374e2217131 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.801437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6428e7-3c17-45e7-b0a4-2374e2217131 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.801708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6428e7-3c17-45e7-b0a4-2374e2217131 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.802399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6428e7-3c17-45e7-b0a4-2374e2217131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.804348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6428e7-3c17-45e7-b0a4-2374e2217131 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.824526 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3860/7744] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:10 2021] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:10.828480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869f870-8827-4c27-b8f4-ec8cae8fe3df admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:10.839073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869f870-8827-4c27-b8f4-ec8cae8fe3df admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.844126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d804d-7dea-4e9a-a985-c848ac0e5869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.844788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d804d-7dea-4e9a-a985-c848ac0e5869 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.845151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d804d-7dea-4e9a-a985-c848ac0e5869 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.845507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d804d-7dea-4e9a-a985-c848ac0e5869 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.846334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d804d-7dea-4e9a-a985-c848ac0e5869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.848223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d804d-7dea-4e9a-a985-c848ac0e5869 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.859569 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3885/7745] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:10.863551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6428e7-3c17-45e7-b0a4-2374e2217131 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:10.875324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6428e7-3c17-45e7-b0a4-2374e2217131 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.880187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdc4f5-a203-4800-ab3f-a28cd601e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.881088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdc4f5-a203-4800-ab3f-a28cd601e6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.881372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdc4f5-a203-4800-ab3f-a28cd601e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.881647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdc4f5-a203-4800-ab3f-a28cd601e6c4 admin admin] PATH_INFO: `/v3/projects/5a9653c5b20f48a1af7dca0b679dde2c/users/4eefdcb67ead441c9b989ec0eef56098/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.900768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdc4f5-a203-4800-ab3f-a28cd601e6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9653c5b20f48a1af7dca0b679dde2c, user_id=4eefdcb67ead441c9b989ec0eef56098, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.903524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdc4f5-a203-4800-ab3f-a28cd601e6c4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.916200 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3861/7746] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:10 2021] PUT /identity/v3/projects/5a9653c5b20f48a1af7dca0b679dde2c/users/4eefdcb67ead441c9b989ec0eef56098/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:18:10.920665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d804d-7dea-4e9a-a985-c848ac0e5869 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:10.930425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d804d-7dea-4e9a-a985-c848ac0e5869 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:10.985054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe7a60-88dc-4e88-81cf-478c9a18e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:10.985846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe7a60-88dc-4e88-81cf-478c9a18e536 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:10.986058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe7a60-88dc-4e88-81cf-478c9a18e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:10.986375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe7a60-88dc-4e88-81cf-478c9a18e536 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:10.987233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe7a60-88dc-4e88-81cf-478c9a18e536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:10.988822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe7a60-88dc-4e88-81cf-478c9a18e536 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:10.999509 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3886/7747] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:10 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:11.003559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdc4f5-a203-4800-ab3f-a28cd601e6c4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:11.014356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdc4f5-a203-4800-ab3f-a28cd601e6c4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:11.019021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5399b35-f26f-4c30-ae0f-612d627de71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:11.019924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5399b35-f26f-4c30-ae0f-612d627de71c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:11.020201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5399b35-f26f-4c30-ae0f-612d627de71c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:11.020472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5399b35-f26f-4c30-ae0f-612d627de71c admin admin] PATH_INFO: `/v3/projects/5a9653c5b20f48a1af7dca0b679dde2c/users/4eefdcb67ead441c9b989ec0eef56098/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:11.022442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5399b35-f26f-4c30-ae0f-612d627de71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9653c5b20f48a1af7dca0b679dde2c, user_id=4eefdcb67ead441c9b989ec0eef56098, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:11.025120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5399b35-f26f-4c30-ae0f-612d627de71c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:11.035595 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3862/7748] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:11 2021] PUT /identity/v3/projects/5a9653c5b20f48a1af7dca0b679dde2c/users/4eefdcb67ead441c9b989ec0eef56098/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:18:11.047431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f674980-d7ac-4bb8-a07e-dd6a226bfb97 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:11.047906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f674980-d7ac-4bb8-a07e-dd6a226bfb97 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:11.048074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f674980-d7ac-4bb8-a07e-dd6a226bfb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:11.080820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5f674980-d7ac-4bb8-a07e-dd6a226bfb97 None None] MFA Rules not processed for user `4eefdcb67ead441c9b989ec0eef56098`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:11.082056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f674980-d7ac-4bb8-a07e-dd6a226bfb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:11.149821 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3887/7749] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:11 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:11.161944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5399b35-f26f-4c30-ae0f-612d627de71c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:11.163726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a5399b35-f26f-4c30-ae0f-612d627de71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:11.221478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5399b35-f26f-4c30-ae0f-612d627de71c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:11.225181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672c70a-d5c6-45dc-8499-d9f5e006de73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:11.225811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672c70a-d5c6-45dc-8499-d9f5e006de73 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:11.226094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672c70a-d5c6-45dc-8499-d9f5e006de73 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:11.226375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672c70a-d5c6-45dc-8499-d9f5e006de73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:11.235372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672c70a-d5c6-45dc-8499-d9f5e006de73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:11.236865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672c70a-d5c6-45dc-8499-d9f5e006de73 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:11.246843 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3863/7750] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:11 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:11.528704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f674980-d7ac-4bb8-a07e-dd6a226bfb97 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:11.537956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f674980-d7ac-4bb8-a07e-dd6a226bfb97 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:11.543095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065fa9c-3f0b-449e-92f0-25f55b73f5d1 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefdcb67ead441c9b989ec0eef56098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9653c5b20f48a1af7dca0b679dde2c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:11.543775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065fa9c-3f0b-449e-92f0-25f55b73f5d1 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:11.544062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065fa9c-3f0b-449e-92f0-25f55b73f5d1 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:11.544342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065fa9c-3f0b-449e-92f0-25f55b73f5d1 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:11.545079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065fa9c-3f0b-449e-92f0-25f55b73f5d1 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:18:11.545388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065fa9c-3f0b-449e-92f0-25f55b73f5d1 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:11.546985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065fa9c-3f0b-449e-92f0-25f55b73f5d1 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:11.558801 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3888/7751] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:18:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:18:11.562608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672c70a-d5c6-45dc-8499-d9f5e006de73 service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:11.571722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672c70a-d5c6-45dc-8499-d9f5e006de73 service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:11.576292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895c57-3d02-4325-8e41-9b070aee6450 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefdcb67ead441c9b989ec0eef56098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9653c5b20f48a1af7dca0b679dde2c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:11.576921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895c57-3d02-4325-8e41-9b070aee6450 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:11.577203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895c57-3d02-4325-8e41-9b070aee6450 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:11.577479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895c57-3d02-4325-8e41-9b070aee6450 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:11.578162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895c57-3d02-4325-8e41-9b070aee6450 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:11.580087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895c57-3d02-4325-8e41-9b070aee6450 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:11.604192 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3864/7752] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:11 2021] POST /identity/v3/projects => generated 355 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:11.608639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065fa9c-3f0b-449e-92f0-25f55b73f5d1 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:11.618661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065fa9c-3f0b-449e-92f0-25f55b73f5d1 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:11.672954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d88b3-ac3a-4d39-800a-597011fb4263 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefdcb67ead441c9b989ec0eef56098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9653c5b20f48a1af7dca0b679dde2c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:11.673649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d88b3-ac3a-4d39-800a-597011fb4263 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:11.673936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d88b3-ac3a-4d39-800a-597011fb4263 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:11.674613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d88b3-ac3a-4d39-800a-597011fb4263 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:11.675538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d88b3-ac3a-4d39-800a-597011fb4263 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:18:11.675851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d88b3-ac3a-4d39-800a-597011fb4263 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:11.677440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d88b3-ac3a-4d39-800a-597011fb4263 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:11.689140 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3889/7753] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:18:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:18:11.721443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895c57-3d02-4325-8e41-9b070aee6450 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:11.732429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895c57-3d02-4325-8e41-9b070aee6450 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:11.737090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eefdcb67ead441c9b989ec0eef56098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9653c5b20f48a1af7dca0b679dde2c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:11.737961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:11.738251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:11.738530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] PATH_INFO: `/v3/projects/37dc796a726345ec92f468ea0b0a6415` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:11.740027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37dc796a726345ec92f468ea0b0a6415)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:11.741953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:11.787302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dc796a726345ec92f468ea0b0a6415', 'request_id': 'req-4b8ee820-5fdf-419d-8f71-fab57b442be0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:11.794152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dc796a726345ec92f468ea0b0a6415', 'request_id': 'req-4b8ee820-5fdf-419d-8f71-fab57b442be0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:11.801401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dc796a726345ec92f468ea0b0a6415', 'request_id': 'req-4b8ee820-5fdf-419d-8f71-fab57b442be0'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:11.812061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] The token cache is being invalidate because project 37dc796a726345ec92f468ea0b0a6415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:11.812350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:11.812992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4b8ee820-5fdf-419d-8f71-fab57b442be0 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:11.814913 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3865/7754] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:11 2021] DELETE /identity/v3/projects/37dc796a726345ec92f468ea0b0a6415 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:11.990592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d88b3-ac3a-4d39-800a-597011fb4263 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:11.992309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-793d88b3-ac3a-4d39-800a-597011fb4263 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:12.055306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d88b3-ac3a-4d39-800a-597011fb4263 tempest-VolumeQuotaClassesTest-219203557 tempest-VolumeQuotaClassesTest-219203557-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:12.109993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:12.110867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:12.111148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:12.111472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] PATH_INFO: `/v3/users/04ba246f65534140bb1bc2d3d54725e4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:12.112726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ba246f65534140bb1bc2d3d54725e4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:12.114915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:12.161122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ba246f65534140bb1bc2d3d54725e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.169225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ba246f65534140bb1bc2d3d54725e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.169941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ba246f65534140bb1bc2d3d54725e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.178769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ba246f65534140bb1bc2d3d54725e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.191023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ba246f65534140bb1bc2d3d54725e4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.196945 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3890/7755] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:11 2021] DELETE /identity/v3/users/04ba246f65534140bb1bc2d3d54725e4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:12.202041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9efcb-f311-4a6e-a98f-5a952681ccf4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:12.202329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9efcb-f311-4a6e-a98f-5a952681ccf4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:12.202623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9efcb-f311-4a6e-a98f-5a952681ccf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:12.219836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a4a9efcb-f311-4a6e-a98f-5a952681ccf4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:12.221035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a4a9efcb-f311-4a6e-a98f-5a952681ccf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:12.279262 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3866/7756] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:12.289453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:12.290851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:12.349014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55b275-6bac-404f-87a6-87f2dddab3d9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:12.352616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ca7de-2c3f-4c6d-9a02-11cfb027fb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:12.353259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ca7de-2c3f-4c6d-9a02-11cfb027fb24 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:12.353552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ca7de-2c3f-4c6d-9a02-11cfb027fb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:12.353831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ca7de-2c3f-4c6d-9a02-11cfb027fb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:12.362849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ca7de-2c3f-4c6d-9a02-11cfb027fb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:12.364575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ca7de-2c3f-4c6d-9a02-11cfb027fb24 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:12.373925 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3891/7757] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:18:12.635383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9efcb-f311-4a6e-a98f-5a952681ccf4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:12.637541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a4a9efcb-f311-4a6e-a98f-5a952681ccf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:12.649876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9efcb-f311-4a6e-a98f-5a952681ccf4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:12.654835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:12.655726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:12.656012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:12.656292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] PATH_INFO: `/v3/projects/75fdab8ebf224c2a82632ae32d48717f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:12.658260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75fdab8ebf224c2a82632ae32d48717f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:12.660259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:12.706411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75fdab8ebf224c2a82632ae32d48717f', 'request_id': 'req-561c8e82-1cd5-4604-829c-bf13ba7f63b4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.712606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75fdab8ebf224c2a82632ae32d48717f', 'request_id': 'req-561c8e82-1cd5-4604-829c-bf13ba7f63b4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.720497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75fdab8ebf224c2a82632ae32d48717f', 'request_id': 'req-561c8e82-1cd5-4604-829c-bf13ba7f63b4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.735517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] The token cache is being invalidate because project 75fdab8ebf224c2a82632ae32d48717f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:12.736075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.736605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.738183 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3867/7758] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:12 2021] DELETE /identity/v3/projects/75fdab8ebf224c2a82632ae32d48717f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:12.742420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ca7de-2c3f-4c6d-9a02-11cfb027fb24 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:12.752316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ca7de-2c3f-4c6d-9a02-11cfb027fb24 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:12.807008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61698c82-ea52-4834-aee0-fc71014e43ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:12.807923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61698c82-ea52-4834-aee0-fc71014e43ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:12.808234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61698c82-ea52-4834-aee0-fc71014e43ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:12.808509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61698c82-ea52-4834-aee0-fc71014e43ac admin admin] PATH_INFO: `/v3/users/4eefdcb67ead441c9b989ec0eef56098` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:12.809726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61698c82-ea52-4834-aee0-fc71014e43ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eefdcb67ead441c9b989ec0eef56098)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:12.811675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61698c82-ea52-4834-aee0-fc71014e43ac admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:12.854512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61698c82-ea52-4834-aee0-fc71014e43ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eefdcb67ead441c9b989ec0eef56098'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.862130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61698c82-ea52-4834-aee0-fc71014e43ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eefdcb67ead441c9b989ec0eef56098'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.862775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61698c82-ea52-4834-aee0-fc71014e43ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eefdcb67ead441c9b989ec0eef56098'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.869769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61698c82-ea52-4834-aee0-fc71014e43ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eefdcb67ead441c9b989ec0eef56098'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.881566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-61698c82-ea52-4834-aee0-fc71014e43ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eefdcb67ead441c9b989ec0eef56098'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:12.887269 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3892/7759] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:12 2021] DELETE /identity/v3/users/4eefdcb67ead441c9b989ec0eef56098 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:18:13.150867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:13.152963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:13.166034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c8e82-1cd5-4604-829c-bf13ba7f63b4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:13.223471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:13.224322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:13.224603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:13.224874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] PATH_INFO: `/v3/projects/5a9653c5b20f48a1af7dca0b679dde2c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:13.226062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9653c5b20f48a1af7dca0b679dde2c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:13.228040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:13.274856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9653c5b20f48a1af7dca0b679dde2c', 'request_id': 'req-df1be4b0-efb0-4568-89af-24191dbaeafa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:13.281473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9653c5b20f48a1af7dca0b679dde2c', 'request_id': 'req-df1be4b0-efb0-4568-89af-24191dbaeafa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:13.288724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9653c5b20f48a1af7dca0b679dde2c', 'request_id': 'req-df1be4b0-efb0-4568-89af-24191dbaeafa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:13.298834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] The token cache is being invalidate because project 5a9653c5b20f48a1af7dca0b679dde2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:13.299132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:13.299767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-df1be4b0-efb0-4568-89af-24191dbaeafa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:13.301322 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3868/7760] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:13 2021] DELETE /identity/v3/projects/5a9653c5b20f48a1af7dca0b679dde2c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:13.306904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284edec0-d9a2-490d-9ebe-82a3258abb8c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:13.307402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284edec0-d9a2-490d-9ebe-82a3258abb8c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:13.307480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284edec0-d9a2-490d-9ebe-82a3258abb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:13.328698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-284edec0-d9a2-490d-9ebe-82a3258abb8c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:13.329906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-284edec0-d9a2-490d-9ebe-82a3258abb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:13.387142 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3893/7761] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:13.472738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bddd8a-561c-4adc-bec6-d4e18646a5ca None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:13.473022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bddd8a-561c-4adc-bec6-d4e18646a5ca None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:13.473292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bddd8a-561c-4adc-bec6-d4e18646a5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:13.491790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-57bddd8a-561c-4adc-bec6-d4e18646a5ca None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:13.492976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-57bddd8a-561c-4adc-bec6-d4e18646a5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:13.501292 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3869/7762] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:13.505423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284edec0-d9a2-490d-9ebe-82a3258abb8c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:13.515664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284edec0-d9a2-490d-9ebe-82a3258abb8c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:13.520182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dc249-1470-4f6f-89ce-12c35c7ed90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:13.520825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc249-1470-4f6f-89ce-12c35c7ed90b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:13.521106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc249-1470-4f6f-89ce-12c35c7ed90b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:13.521381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc249-1470-4f6f-89ce-12c35c7ed90b admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:13.522103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dc249-1470-4f6f-89ce-12c35c7ed90b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:18:13.522406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dc249-1470-4f6f-89ce-12c35c7ed90b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:13.524037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dc249-1470-4f6f-89ce-12c35c7ed90b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:13.535215 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3894/7763] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:18:13.539471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bddd8a-561c-4adc-bec6-d4e18646a5ca None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:13.548587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bddd8a-561c-4adc-bec6-d4e18646a5ca None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:13.553242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393cbe-6fb7-490f-945d-1b3ac9ead0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:13.553879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393cbe-6fb7-490f-945d-1b3ac9ead0fe admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:13.554162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393cbe-6fb7-490f-945d-1b3ac9ead0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:13.554436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3393cbe-6fb7-490f-945d-1b3ac9ead0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:13.555143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3393cbe-6fb7-490f-945d-1b3ac9ead0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:13.557058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3393cbe-6fb7-490f-945d-1b3ac9ead0fe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:13.582843 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3870/7764] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:13 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:18:13.586994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dc249-1470-4f6f-89ce-12c35c7ed90b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:13.596688 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dc249-1470-4f6f-89ce-12c35c7ed90b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:13.650140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6046912-ce52-4369-b483-70a1d6d7f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:13.650783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6046912-ce52-4369-b483-70a1d6d7f65f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:13.651063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6046912-ce52-4369-b483-70a1d6d7f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:13.651366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6046912-ce52-4369-b483-70a1d6d7f65f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:13.652083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6046912-ce52-4369-b483-70a1d6d7f65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:13.653964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6046912-ce52-4369-b483-70a1d6d7f65f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:13.673446 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3895/7765] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:13 2021] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:13.677718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393cbe-6fb7-490f-945d-1b3ac9ead0fe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:13.688574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3393cbe-6fb7-490f-945d-1b3ac9ead0fe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:13.693204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaab1d-0a6f-4629-9ff2-43a5cb6996c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:13.693850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaab1d-0a6f-4629-9ff2-43a5cb6996c0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:13.694136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaab1d-0a6f-4629-9ff2-43a5cb6996c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:13.694414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aaab1d-0a6f-4629-9ff2-43a5cb6996c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:13.695142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aaab1d-0a6f-4629-9ff2-43a5cb6996c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:13.696765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aaab1d-0a6f-4629-9ff2-43a5cb6996c0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:13.707700 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3871/7766] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:18:13.712027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6046912-ce52-4369-b483-70a1d6d7f65f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:13.724335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6046912-ce52-4369-b483-70a1d6d7f65f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:13.729416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de1659-871b-41b8-947c-fcb791850a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:13.730605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de1659-871b-41b8-947c-fcb791850a11 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:13.730867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de1659-871b-41b8-947c-fcb791850a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:13.731141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de1659-871b-41b8-947c-fcb791850a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:13.731906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de1659-871b-41b8-947c-fcb791850a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:13.733494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de1659-871b-41b8-947c-fcb791850a11 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:13.743795 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3896/7767] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:13 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:18:13.748637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaab1d-0a6f-4629-9ff2-43a5cb6996c0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:13.758631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aaab1d-0a6f-4629-9ff2-43a5cb6996c0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:13.763191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462dff5-a81e-48d0-b4ca-cda674a2a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:13.764069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462dff5-a81e-48d0-b4ca-cda674a2a982 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:13.764348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462dff5-a81e-48d0-b4ca-cda674a2a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:13.764616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462dff5-a81e-48d0-b4ca-cda674a2a982 admin admin] PATH_INFO: `/v3/projects/1ca7a3e04250448faf5f1c9959ff56e7/users/2d55b7433cc74fd68422cc9152ab1b0f/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:13.778548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462dff5-a81e-48d0-b4ca-cda674a2a982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca7a3e04250448faf5f1c9959ff56e7, user_id=2d55b7433cc74fd68422cc9152ab1b0f, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:13.781223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462dff5-a81e-48d0-b4ca-cda674a2a982 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:13.793481 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3872/7768] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:13 2021] PUT /identity/v3/projects/1ca7a3e04250448faf5f1c9959ff56e7/users/2d55b7433cc74fd68422cc9152ab1b0f/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:13.803435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11cb30-e719-4c02-bb57-99c78fd3d05d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:13.803731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11cb30-e719-4c02-bb57-99c78fd3d05d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:13.804007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11cb30-e719-4c02-bb57-99c78fd3d05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:13.830624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7d11cb30-e719-4c02-bb57-99c78fd3d05d None None] MFA Rules not processed for user `2d55b7433cc74fd68422cc9152ab1b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:13.831968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7d11cb30-e719-4c02-bb57-99c78fd3d05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:13.893376 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3897/7769] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:13 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:13.897839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462dff5-a81e-48d0-b4ca-cda674a2a982 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:13.957378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462dff5-a81e-48d0-b4ca-cda674a2a982 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:13.962129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841a4b5-4ed2-42e3-a876-c601a74525ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:13.962696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841a4b5-4ed2-42e3-a876-c601a74525ea admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:13.962981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841a4b5-4ed2-42e3-a876-c601a74525ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:13.963272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841a4b5-4ed2-42e3-a876-c601a74525ea admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:13.964044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841a4b5-4ed2-42e3-a876-c601a74525ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:13.965953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841a4b5-4ed2-42e3-a876-c601a74525ea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:13.990697 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3873/7770] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:13 2021] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:13.994705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11cb30-e719-4c02-bb57-99c78fd3d05d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:14.005847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11cb30-e719-4c02-bb57-99c78fd3d05d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:14.065509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2e741-1460-4851-b8e0-8c98ee711157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:14.066174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2e741-1460-4851-b8e0-8c98ee711157 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.066454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2e741-1460-4851-b8e0-8c98ee711157 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.066731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2e741-1460-4851-b8e0-8c98ee711157 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.067459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2e741-1460-4851-b8e0-8c98ee711157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:14.069365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2e741-1460-4851-b8e0-8c98ee711157 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:14.088481 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3898/7771] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:13 2021] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:14.093058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841a4b5-4ed2-42e3-a876-c601a74525ea admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:14.103426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841a4b5-4ed2-42e3-a876-c601a74525ea admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:14.108753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705bb9d-8682-4ff0-98cf-a4fbef505fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:14.109405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705bb9d-8682-4ff0-98cf-a4fbef505fab admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.109692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705bb9d-8682-4ff0-98cf-a4fbef505fab admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.109967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705bb9d-8682-4ff0-98cf-a4fbef505fab admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.110696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705bb9d-8682-4ff0-98cf-a4fbef505fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:14.112396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705bb9d-8682-4ff0-98cf-a4fbef505fab admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:14.123022 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3874/7772] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:14.126825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2e741-1460-4851-b8e0-8c98ee711157 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:14.136599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2e741-1460-4851-b8e0-8c98ee711157 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:14.141140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873172f-671e-4e76-8b19-9d8a8ba6da07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:14.141793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873172f-671e-4e76-8b19-9d8a8ba6da07 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.142058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873172f-671e-4e76-8b19-9d8a8ba6da07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.142333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873172f-671e-4e76-8b19-9d8a8ba6da07 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.143054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873172f-671e-4e76-8b19-9d8a8ba6da07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:14.144689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873172f-671e-4e76-8b19-9d8a8ba6da07 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:14.154892 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3899/7773] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:14.158788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705bb9d-8682-4ff0-98cf-a4fbef505fab admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:14.169175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705bb9d-8682-4ff0-98cf-a4fbef505fab admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:14.173901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191392e8-b243-4587-a703-14977abfbcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:14.174738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191392e8-b243-4587-a703-14977abfbcc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.175027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191392e8-b243-4587-a703-14977abfbcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.175335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191392e8-b243-4587-a703-14977abfbcc6 admin admin] PATH_INFO: `/v3/projects/fb04fe2f0b4945e896947ad1fd0250c5/users/131f11230e7142e7a7b688fcd245add4/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.189501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191392e8-b243-4587-a703-14977abfbcc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb04fe2f0b4945e896947ad1fd0250c5, user_id=131f11230e7142e7a7b688fcd245add4, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:14.192250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191392e8-b243-4587-a703-14977abfbcc6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:14.205428 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3875/7774] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:14 2021] PUT /identity/v3/projects/fb04fe2f0b4945e896947ad1fd0250c5/users/131f11230e7142e7a7b688fcd245add4/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:14.216002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2dc2c-9b22-477a-ace1-e8f3701936ca None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.216231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2dc2c-9b22-477a-ace1-e8f3701936ca None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.216505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2dc2c-9b22-477a-ace1-e8f3701936ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.243813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-94b2dc2c-9b22-477a-ace1-e8f3701936ca None None] MFA Rules not processed for user `131f11230e7142e7a7b688fcd245add4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:14.244999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-94b2dc2c-9b22-477a-ace1-e8f3701936ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:14.309215 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3900/7775] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:14 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:14.313980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191392e8-b243-4587-a703-14977abfbcc6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:14.377693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191392e8-b243-4587-a703-14977abfbcc6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:14.382295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45a4a7-c342-4100-87d2-7dd3c9782a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:14.382952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45a4a7-c342-4100-87d2-7dd3c9782a93 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.383227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45a4a7-c342-4100-87d2-7dd3c9782a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.383529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45a4a7-c342-4100-87d2-7dd3c9782a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.384228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45a4a7-c342-4100-87d2-7dd3c9782a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:14.386169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45a4a7-c342-4100-87d2-7dd3c9782a93 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:14.411004 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3876/7776] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:14 2021] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:14.415542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2dc2c-9b22-477a-ace1-e8f3701936ca None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:14.427632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2dc2c-9b22-477a-ace1-e8f3701936ca None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:14.483976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c36616-7cc0-42a7-80ce-79fdf7c79180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:14.484577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36616-7cc0-42a7-80ce-79fdf7c79180 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.484865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36616-7cc0-42a7-80ce-79fdf7c79180 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.485140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36616-7cc0-42a7-80ce-79fdf7c79180 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.485842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c36616-7cc0-42a7-80ce-79fdf7c79180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:14.487815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c36616-7cc0-42a7-80ce-79fdf7c79180 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:14.509982 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3901/7777] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:14 2021] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:18:14.511750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45a4a7-c342-4100-87d2-7dd3c9782a93 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:14.521869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45a4a7-c342-4100-87d2-7dd3c9782a93 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:14.526513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ab6f-0e42-433b-a079-4251e08d06ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:14.527899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ab6f-0e42-433b-a079-4251e08d06ef admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.528182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ab6f-0e42-433b-a079-4251e08d06ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.528455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ab6f-0e42-433b-a079-4251e08d06ef admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.529176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122ab6f-0e42-433b-a079-4251e08d06ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:14.530762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122ab6f-0e42-433b-a079-4251e08d06ef admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:14.546809 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3877/7778] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:14.548056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c36616-7cc0-42a7-80ce-79fdf7c79180 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:14.557900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c36616-7cc0-42a7-80ce-79fdf7c79180 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:14.562895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abf2a0-7118-4279-a237-1aa702374c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:14.563806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf2a0-7118-4279-a237-1aa702374c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.564090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf2a0-7118-4279-a237-1aa702374c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.564365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf2a0-7118-4279-a237-1aa702374c25 admin admin] PATH_INFO: `/v3/projects/44e4d170eb464f11ac4744367557384a/users/b324fd74720549d8b45a44465b2a271b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.579840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abf2a0-7118-4279-a237-1aa702374c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e4d170eb464f11ac4744367557384a, user_id=b324fd74720549d8b45a44465b2a271b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:14.582467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abf2a0-7118-4279-a237-1aa702374c25 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:14.595570 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3902/7779] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:14 2021] PUT /identity/v3/projects/44e4d170eb464f11ac4744367557384a/users/b324fd74720549d8b45a44465b2a271b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:14.599413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ab6f-0e42-433b-a079-4251e08d06ef admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:14.609248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ab6f-0e42-433b-a079-4251e08d06ef admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:14.664061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef6b61-9298-4e1f-874b-325ba861084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:14.664722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef6b61-9298-4e1f-874b-325ba861084c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.665008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef6b61-9298-4e1f-874b-325ba861084c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.665287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef6b61-9298-4e1f-874b-325ba861084c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.666013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef6b61-9298-4e1f-874b-325ba861084c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:14.667658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef6b61-9298-4e1f-874b-325ba861084c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:14.677267 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3878/7780] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:14.681330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abf2a0-7118-4279-a237-1aa702374c25 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:14.691446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abf2a0-7118-4279-a237-1aa702374c25 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:14.696032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317cfc8-cbbd-46f6-99b7-5335a3b85081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:14.696893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317cfc8-cbbd-46f6-99b7-5335a3b85081 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.697174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317cfc8-cbbd-46f6-99b7-5335a3b85081 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.697444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317cfc8-cbbd-46f6-99b7-5335a3b85081 admin admin] PATH_INFO: `/v3/projects/44e4d170eb464f11ac4744367557384a/users/b324fd74720549d8b45a44465b2a271b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.699943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317cfc8-cbbd-46f6-99b7-5335a3b85081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e4d170eb464f11ac4744367557384a, user_id=b324fd74720549d8b45a44465b2a271b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:14.702545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317cfc8-cbbd-46f6-99b7-5335a3b85081 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:14.712352 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3903/7781] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:14 2021] PUT /identity/v3/projects/44e4d170eb464f11ac4744367557384a/users/b324fd74720549d8b45a44465b2a271b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:14.723683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8f19b-8a6e-469f-a2b5-59f8ac515b3e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.723977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8f19b-8a6e-469f-a2b5-59f8ac515b3e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.724257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8f19b-8a6e-469f-a2b5-59f8ac515b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.750052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f4f8f19b-8a6e-469f-a2b5-59f8ac515b3e None None] MFA Rules not processed for user `b324fd74720549d8b45a44465b2a271b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:14.751175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f4f8f19b-8a6e-469f-a2b5-59f8ac515b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:14.818850 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3879/7782] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:14 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:14.829217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317cfc8-cbbd-46f6-99b7-5335a3b85081 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:14.830902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3317cfc8-cbbd-46f6-99b7-5335a3b85081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:14.888311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317cfc8-cbbd-46f6-99b7-5335a3b85081 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:14.892013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0ee2b-44e5-456f-a9e8-1af013c2cc83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:14.892642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0ee2b-44e5-456f-a9e8-1af013c2cc83 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:14.892926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0ee2b-44e5-456f-a9e8-1af013c2cc83 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:14.893202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0ee2b-44e5-456f-a9e8-1af013c2cc83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:14.902825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0ee2b-44e5-456f-a9e8-1af013c2cc83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:14.905269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0ee2b-44e5-456f-a9e8-1af013c2cc83 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:14.916183 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3904/7783] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:14 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:15.356922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8f19b-8a6e-469f-a2b5-59f8ac515b3e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:15.358399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f4f8f19b-8a6e-469f-a2b5-59f8ac515b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:15.373389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8f19b-8a6e-469f-a2b5-59f8ac515b3e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:15.376952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f00ec3-bf25-46aa-8d2c-4d754f6ae579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:15.377599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f00ec3-bf25-46aa-8d2c-4d754f6ae579 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:15.377885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f00ec3-bf25-46aa-8d2c-4d754f6ae579 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:15.378160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f00ec3-bf25-46aa-8d2c-4d754f6ae579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:15.436840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f00ec3-bf25-46aa-8d2c-4d754f6ae579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:15.438325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f00ec3-bf25-46aa-8d2c-4d754f6ae579 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:15.447390 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3880/7784] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:15 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:19.361662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0ee2b-44e5-456f-a9e8-1af013c2cc83 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:19.372745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0ee2b-44e5-456f-a9e8-1af013c2cc83 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:19.376352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a679-3d47-43c4-99ab-ba8d0e8c1ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:19.376983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a679-3d47-43c4-99ab-ba8d0e8c1ede service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:19.377266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a679-3d47-43c4-99ab-ba8d0e8c1ede service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:19.377539 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a679-3d47-43c4-99ab-ba8d0e8c1ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:19.433012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a679-3d47-43c4-99ab-ba8d0e8c1ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:19.434448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a679-3d47-43c4-99ab-ba8d0e8c1ede service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:19.443174 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3905/7785] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:19 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:21.422775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f00ec3-bf25-46aa-8d2c-4d754f6ae579 service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:21.484208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f00ec3-bf25-46aa-8d2c-4d754f6ae579 service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:21.488775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:21.489901 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:21.490187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:21.490460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] PATH_INFO: `/v3/users/2d55b7433cc74fd68422cc9152ab1b0f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:21.491691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d55b7433cc74fd68422cc9152ab1b0f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:21.493606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:21.536814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d55b7433cc74fd68422cc9152ab1b0f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:21.537498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d55b7433cc74fd68422cc9152ab1b0f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:21.544853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d55b7433cc74fd68422cc9152ab1b0f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:21.545657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d55b7433cc74fd68422cc9152ab1b0f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:21.552494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d55b7433cc74fd68422cc9152ab1b0f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:21.569106 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3881/7786] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:21 2021] DELETE /identity/v3/users/2d55b7433cc74fd68422cc9152ab1b0f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:21.573649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867eb12-2417-4302-8750-973d8cc323ce None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:21.574097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867eb12-2417-4302-8750-973d8cc323ce None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:21.574207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867eb12-2417-4302-8750-973d8cc323ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:21.592074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a867eb12-2417-4302-8750-973d8cc323ce None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:21.593268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a867eb12-2417-4302-8750-973d8cc323ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:21.652268 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3906/7787] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:21.662270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:21.663718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:21.722436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f799232-bc21-41b8-895a-f4f3e877e3a3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:21.726214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a084a0-6f30-4917-8a0d-28e37883afb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:21.726857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a084a0-6f30-4917-8a0d-28e37883afb6 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:21.727138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a084a0-6f30-4917-8a0d-28e37883afb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:21.727453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a084a0-6f30-4917-8a0d-28e37883afb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:21.737303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a084a0-6f30-4917-8a0d-28e37883afb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:21.738736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a084a0-6f30-4917-8a0d-28e37883afb6 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:21.749022 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3882/7788] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:22.009136 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867eb12-2417-4302-8750-973d8cc323ce None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:22.011074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a867eb12-2417-4302-8750-973d8cc323ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:22.023311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867eb12-2417-4302-8750-973d8cc323ce None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:22.028658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:22.029514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:22.029798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:22.030084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] PATH_INFO: `/v3/projects/1ca7a3e04250448faf5f1c9959ff56e7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:22.032285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca7a3e04250448faf5f1c9959ff56e7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:22.034991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:22.085942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca7a3e04250448faf5f1c9959ff56e7', 'request_id': 'req-c1b994c1-0cfc-49ea-97e1-e2c25876f516'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.093424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca7a3e04250448faf5f1c9959ff56e7', 'request_id': 'req-c1b994c1-0cfc-49ea-97e1-e2c25876f516'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.099588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca7a3e04250448faf5f1c9959ff56e7', 'request_id': 'req-c1b994c1-0cfc-49ea-97e1-e2c25876f516'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.109238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] The token cache is being invalidate because project 1ca7a3e04250448faf5f1c9959ff56e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:22.109519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.110144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.111763 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3907/7789] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:22 2021] DELETE /identity/v3/projects/1ca7a3e04250448faf5f1c9959ff56e7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:18:22.115944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a084a0-6f30-4917-8a0d-28e37883afb6 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:22.125395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a084a0-6f30-4917-8a0d-28e37883afb6 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:22.179131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:22.180008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:22.180292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:22.180564 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] PATH_INFO: `/v3/users/131f11230e7142e7a7b688fcd245add4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:22.181729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131f11230e7142e7a7b688fcd245add4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:22.183827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:22.228526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131f11230e7142e7a7b688fcd245add4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.229192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131f11230e7142e7a7b688fcd245add4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.236029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131f11230e7142e7a7b688fcd245add4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.236642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131f11230e7142e7a7b688fcd245add4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.243528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131f11230e7142e7a7b688fcd245add4'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.259624 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3883/7790] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:22 2021] DELETE /identity/v3/users/131f11230e7142e7a7b688fcd245add4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:22.526868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:22.528519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:22.554488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b994c1-0cfc-49ea-97e1-e2c25876f516 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:22.614871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:22.615682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:22.615962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:22.616236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] PATH_INFO: `/v3/projects/fb04fe2f0b4945e896947ad1fd0250c5` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:22.617463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb04fe2f0b4945e896947ad1fd0250c5)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:22.619411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:22.668152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb04fe2f0b4945e896947ad1fd0250c5', 'request_id': 'req-1187249f-9856-4562-ae67-7e22053f1395'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.678015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb04fe2f0b4945e896947ad1fd0250c5', 'request_id': 'req-1187249f-9856-4562-ae67-7e22053f1395'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.684988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb04fe2f0b4945e896947ad1fd0250c5', 'request_id': 'req-1187249f-9856-4562-ae67-7e22053f1395'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.696896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] The token cache is being invalidate because project fb04fe2f0b4945e896947ad1fd0250c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:22.697190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.698124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.700675 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3908/7791] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:22 2021] DELETE /identity/v3/projects/fb04fe2f0b4945e896947ad1fd0250c5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:22.704782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:22.706245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:22.719761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c55cb-72bf-4c5b-991f-0852aae86546 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:22.774845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c73b55-3a9e-48cd-a9b1-2ad2b9cbb6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:22.775736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c73b55-3a9e-48cd-a9b1-2ad2b9cbb6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:22.776044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c73b55-3a9e-48cd-a9b1-2ad2b9cbb6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:22.776473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c73b55-3a9e-48cd-a9b1-2ad2b9cbb6bd admin admin] PATH_INFO: `/v3/users/b324fd74720549d8b45a44465b2a271b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:22.777784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c73b55-3a9e-48cd-a9b1-2ad2b9cbb6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b324fd74720549d8b45a44465b2a271b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:22.779750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c73b55-3a9e-48cd-a9b1-2ad2b9cbb6bd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:22.828338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c3c73b55-3a9e-48cd-a9b1-2ad2b9cbb6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b324fd74720549d8b45a44465b2a271b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.829001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c3c73b55-3a9e-48cd-a9b1-2ad2b9cbb6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b324fd74720549d8b45a44465b2a271b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.836449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c3c73b55-3a9e-48cd-a9b1-2ad2b9cbb6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b324fd74720549d8b45a44465b2a271b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.837082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c3c73b55-3a9e-48cd-a9b1-2ad2b9cbb6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b324fd74720549d8b45a44465b2a271b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.845114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c3c73b55-3a9e-48cd-a9b1-2ad2b9cbb6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b324fd74720549d8b45a44465b2a271b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:22.862982 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3884/7792] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:22 2021] DELETE /identity/v3/users/b324fd74720549d8b45a44465b2a271b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:23.167616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:23.169041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:23.181367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187249f-9856-4562-ae67-7e22053f1395 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:23.240715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:23.241584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.241913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.242188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] PATH_INFO: `/v3/projects/44e4d170eb464f11ac4744367557384a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.243444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e4d170eb464f11ac4744367557384a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:23.245422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:23.292384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e4d170eb464f11ac4744367557384a', 'request_id': 'req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:23.299509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e4d170eb464f11ac4744367557384a', 'request_id': 'req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:23.305597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e4d170eb464f11ac4744367557384a', 'request_id': 'req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:23.320843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] The token cache is being invalidate because project 44e4d170eb464f11ac4744367557384a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:23.321152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:23.322172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-979a0ed8-bd9c-48b3-b8e8-6feeab29c7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:23.324278 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3909/7793] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:23 2021] DELETE /identity/v3/projects/44e4d170eb464f11ac4744367557384a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:23.330982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236672-f54d-466f-9a28-6945f34a3bcd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.331370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236672-f54d-466f-9a28-6945f34a3bcd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.331712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236672-f54d-466f-9a28-6945f34a3bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.349731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-22236672-f54d-466f-9a28-6945f34a3bcd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:23.350937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-22236672-f54d-466f-9a28-6945f34a3bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:23.415966 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3885/7794] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:23.425212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa556a88-97a8-4523-b0a3-85a2401b33a7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.425608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa556a88-97a8-4523-b0a3-85a2401b33a7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.425948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa556a88-97a8-4523-b0a3-85a2401b33a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.444650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-aa556a88-97a8-4523-b0a3-85a2401b33a7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:23.446046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-aa556a88-97a8-4523-b0a3-85a2401b33a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:23.455068 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3910/7795] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:23.459307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22236672-f54d-466f-9a28-6945f34a3bcd None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:23.469677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22236672-f54d-466f-9a28-6945f34a3bcd None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:23.474400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983148e-cd6e-40d5-8cfa-0672088d7d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:23.475179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983148e-cd6e-40d5-8cfa-0672088d7d74 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.475500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983148e-cd6e-40d5-8cfa-0672088d7d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.475773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983148e-cd6e-40d5-8cfa-0672088d7d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.476533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983148e-cd6e-40d5-8cfa-0672088d7d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:18:23.476845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983148e-cd6e-40d5-8cfa-0672088d7d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:23.478450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983148e-cd6e-40d5-8cfa-0672088d7d74 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:23.491009 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3886/7796] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:18:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:18:23.495137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa556a88-97a8-4523-b0a3-85a2401b33a7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:23.504661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa556a88-97a8-4523-b0a3-85a2401b33a7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:23.509741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ecfa-faf0-43d1-a637-0e497d888b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:23.511004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ecfa-faf0-43d1-a637-0e497d888b4c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.511415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ecfa-faf0-43d1-a637-0e497d888b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.511760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77ecfa-faf0-43d1-a637-0e497d888b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.512564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77ecfa-faf0-43d1-a637-0e497d888b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:23.514522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77ecfa-faf0-43d1-a637-0e497d888b4c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:23.542297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3911/7797] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:23 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:23.546450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983148e-cd6e-40d5-8cfa-0672088d7d74 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:23.556738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983148e-cd6e-40d5-8cfa-0672088d7d74 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:23.612403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5fa00-6f86-446b-a6c3-b53be0cd4c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:23.613069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5fa00-6f86-446b-a6c3-b53be0cd4c40 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.613354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5fa00-6f86-446b-a6c3-b53be0cd4c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.613632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5fa00-6f86-446b-a6c3-b53be0cd4c40 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.614594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5fa00-6f86-446b-a6c3-b53be0cd4c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:23.616560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5fa00-6f86-446b-a6c3-b53be0cd4c40 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:23.636586 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3887/7798] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:23 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:18:23.640762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ecfa-faf0-43d1-a637-0e497d888b4c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:23.651002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77ecfa-faf0-43d1-a637-0e497d888b4c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:23.656159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bfab8-794d-4e05-8a57-cd8da7381a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:23.656811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bfab8-794d-4e05-8a57-cd8da7381a0c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.657090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bfab8-794d-4e05-8a57-cd8da7381a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.657374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bfab8-794d-4e05-8a57-cd8da7381a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.658108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bfab8-794d-4e05-8a57-cd8da7381a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:23.659743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bfab8-794d-4e05-8a57-cd8da7381a0c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:23.669823 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3912/7799] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:18:23.673541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5fa00-6f86-446b-a6c3-b53be0cd4c40 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:23.683517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5fa00-6f86-446b-a6c3-b53be0cd4c40 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:23.688465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08b538-1797-4df6-b46d-70771c695763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:23.689231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b538-1797-4df6-b46d-70771c695763 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.689517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b538-1797-4df6-b46d-70771c695763 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.690091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b538-1797-4df6-b46d-70771c695763 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.691077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08b538-1797-4df6-b46d-70771c695763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:23.697433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08b538-1797-4df6-b46d-70771c695763 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:23.707715 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3888/7800] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:23 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:23.711786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bfab8-794d-4e05-8a57-cd8da7381a0c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:23.722125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bfab8-794d-4e05-8a57-cd8da7381a0c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:23.726783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d50e12-9c2d-4ce0-91e5-1981c8d5197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:23.727690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d50e12-9c2d-4ce0-91e5-1981c8d5197e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.727970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d50e12-9c2d-4ce0-91e5-1981c8d5197e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.728242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d50e12-9c2d-4ce0-91e5-1981c8d5197e admin admin] PATH_INFO: `/v3/projects/d54429e07fac428fa9ba2be3ac7bb890/users/f4d521e07662474eae54efe6617156d0/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.742631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d50e12-9c2d-4ce0-91e5-1981c8d5197e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54429e07fac428fa9ba2be3ac7bb890, user_id=f4d521e07662474eae54efe6617156d0, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:23.745355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d50e12-9c2d-4ce0-91e5-1981c8d5197e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:23.760002 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3913/7801] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:23 2021] PUT /identity/v3/projects/d54429e07fac428fa9ba2be3ac7bb890/users/f4d521e07662474eae54efe6617156d0/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:18:23.772241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2b7e2-36b7-4c09-8c84-100e06cbc62a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.772570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2b7e2-36b7-4c09-8c84-100e06cbc62a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.772837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2b7e2-36b7-4c09-8c84-100e06cbc62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.799928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-edd2b7e2-36b7-4c09-8c84-100e06cbc62a None None] MFA Rules not processed for user `f4d521e07662474eae54efe6617156d0`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:23.801121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-edd2b7e2-36b7-4c09-8c84-100e06cbc62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:23.831491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d50e12-9c2d-4ce0-91e5-1981c8d5197e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:23.833154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-03d50e12-9c2d-4ce0-91e5-1981c8d5197e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:23.869011 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3889/7802] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:23 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:23.873799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2b7e2-36b7-4c09-8c84-100e06cbc62a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:23.906729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d50e12-9c2d-4ce0-91e5-1981c8d5197e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:23.912294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b8f99-8cd7-40a6-89dd-98965f4fe16c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:23.913018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b8f99-8cd7-40a6-89dd-98965f4fe16c service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.913327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b8f99-8cd7-40a6-89dd-98965f4fe16c service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.913605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b8f99-8cd7-40a6-89dd-98965f4fe16c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.915431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-025b8f99-8cd7-40a6-89dd-98965f4fe16c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:23.929249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b8f99-8cd7-40a6-89dd-98965f4fe16c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:23.930870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b8f99-8cd7-40a6-89dd-98965f4fe16c service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:23.940825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2b7e2-36b7-4c09-8c84-100e06cbc62a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:23.943821 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3914/7803] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:23 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:18:23.945612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb39d9-efd2-4594-9487-096f080102a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:23.946265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb39d9-efd2-4594-9487-096f080102a7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:23.946575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb39d9-efd2-4594-9487-096f080102a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:23.946849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb39d9-efd2-4594-9487-096f080102a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:23.947737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb39d9-efd2-4594-9487-096f080102a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:23.950360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb39d9-efd2-4594-9487-096f080102a7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:23.979837 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3890/7804] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:23 2021] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:18:23.981030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b8f99-8cd7-40a6-89dd-98965f4fe16c service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:23.992365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b8f99-8cd7-40a6-89dd-98965f4fe16c service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:24.055078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36d67-ac3a-4917-a256-562026da1f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:24.055973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36d67-ac3a-4917-a256-562026da1f4e admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:24.056409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36d67-ac3a-4917-a256-562026da1f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:24.057808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36d67-ac3a-4917-a256-562026da1f4e admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:24.058080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d36d67-ac3a-4917-a256-562026da1f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:24.060046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d36d67-ac3a-4917-a256-562026da1f4e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:24.084421 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3915/7805] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:23 2021] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:24.089038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb39d9-efd2-4594-9487-096f080102a7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:24.100268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb39d9-efd2-4594-9487-096f080102a7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:24.105486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b74cd-d6e0-4253-9725-d545eb14a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:24.106156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b74cd-d6e0-4253-9725-d545eb14a436 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:24.106442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b74cd-d6e0-4253-9725-d545eb14a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:24.106719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b74cd-d6e0-4253-9725-d545eb14a436 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:24.107503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b74cd-d6e0-4253-9725-d545eb14a436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:24.108669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36d67-ac3a-4917-a256-562026da1f4e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:24.109199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b74cd-d6e0-4253-9725-d545eb14a436 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:24.110504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-57d36d67-ac3a-4917-a256-562026da1f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:24.121286 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3891/7806] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:24 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:24.125525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b74cd-d6e0-4253-9725-d545eb14a436 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:24.138474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b74cd-d6e0-4253-9725-d545eb14a436 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:24.144363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc428d86-b1c0-497f-8c03-9c296686668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:24.145283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428d86-b1c0-497f-8c03-9c296686668d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:24.145569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428d86-b1c0-497f-8c03-9c296686668d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:24.145846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428d86-b1c0-497f-8c03-9c296686668d admin admin] PATH_INFO: `/v3/projects/a75952a730c64635a5925861ac429cc4/users/bf844f48e3b34cedb7b5fd2e71030bc9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:24.161045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc428d86-b1c0-497f-8c03-9c296686668d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75952a730c64635a5925861ac429cc4, user_id=bf844f48e3b34cedb7b5fd2e71030bc9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:24.163770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc428d86-b1c0-497f-8c03-9c296686668d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:24.178063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36d67-ac3a-4917-a256-562026da1f4e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:24.178675 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3892/7807] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:24 2021] PUT /identity/v3/projects/a75952a730c64635a5925861ac429cc4/users/bf844f48e3b34cedb7b5fd2e71030bc9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:18:24.183195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc428d86-b1c0-497f-8c03-9c296686668d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:24.229070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe5378-6258-40ae-a44d-a924fc9e580b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:24.230860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe5378-6258-40ae-a44d-a924fc9e580b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:24.231204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe5378-6258-40ae-a44d-a924fc9e580b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:24.231513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe5378-6258-40ae-a44d-a924fc9e580b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:24.233324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-62fe5378-6258-40ae-a44d-a924fc9e580b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:24.248036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe5378-6258-40ae-a44d-a924fc9e580b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:24.249474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe5378-6258-40ae-a44d-a924fc9e580b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:24.249667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc428d86-b1c0-497f-8c03-9c296686668d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:24.254306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f4a2e-8e79-43cb-a052-2e11ff4f317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:24.254958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4a2e-8e79-43cb-a052-2e11ff4f317f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:24.255238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4a2e-8e79-43cb-a052-2e11ff4f317f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:24.255547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4a2e-8e79-43cb-a052-2e11ff4f317f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:24.256270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f4a2e-8e79-43cb-a052-2e11ff4f317f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:24.257871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f4a2e-8e79-43cb-a052-2e11ff4f317f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:24.259882 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3916/7808] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:24 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:24.270868 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3893/7809] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:24 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:18:24.272033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe5378-6258-40ae-a44d-a924fc9e580b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:24.283141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe5378-6258-40ae-a44d-a924fc9e580b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:24.287818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf44de-15d6-4435-a892-2a9fd9a4d97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:24.288687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf44de-15d6-4435-a892-2a9fd9a4d97f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:24.288965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf44de-15d6-4435-a892-2a9fd9a4d97f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:24.289236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf44de-15d6-4435-a892-2a9fd9a4d97f admin admin] PATH_INFO: `/v3/projects/a75952a730c64635a5925861ac429cc4/users/bf844f48e3b34cedb7b5fd2e71030bc9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:24.291206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf44de-15d6-4435-a892-2a9fd9a4d97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75952a730c64635a5925861ac429cc4, user_id=bf844f48e3b34cedb7b5fd2e71030bc9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:24.294400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf44de-15d6-4435-a892-2a9fd9a4d97f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:24.304558 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3917/7810] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:24 2021] PUT /identity/v3/projects/a75952a730c64635a5925861ac429cc4/users/bf844f48e3b34cedb7b5fd2e71030bc9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:24.315341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d862d38-37f2-4188-99a2-cf12494b8d07 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:24.315806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d862d38-37f2-4188-99a2-cf12494b8d07 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:24.316083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d862d38-37f2-4188-99a2-cf12494b8d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:24.343362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0d862d38-37f2-4188-99a2-cf12494b8d07 None None] MFA Rules not processed for user `bf844f48e3b34cedb7b5fd2e71030bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:24.344676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0d862d38-37f2-4188-99a2-cf12494b8d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:24.353228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872faf9-c0a5-49dd-a466-59f12fcc09f7 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:24.353529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872faf9-c0a5-49dd-a466-59f12fcc09f7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:24.353810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872faf9-c0a5-49dd-a466-59f12fcc09f7 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:24.356359 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3918/7811] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 21:18:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 27 21:18:24.360997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258a0b5-987d-4ba3-8b8a-89a92a406a21 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:24.361286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258a0b5-987d-4ba3-8b8a-89a92a406a21 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:24.361567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258a0b5-987d-4ba3-8b8a-89a92a406a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:24.389974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7258a0b5-987d-4ba3-8b8a-89a92a406a21 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:24.391267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7258a0b5-987d-4ba3-8b8a-89a92a406a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:24.416260 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3894/7812] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:24 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:24.427010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d862d38-37f2-4188-99a2-cf12494b8d07 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:24.428833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0d862d38-37f2-4188-99a2-cf12494b8d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:24.459173 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3919/7813] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:18:24 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:18:24.480983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258a0b5-987d-4ba3-8b8a-89a92a406a21 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:24.489356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d862d38-37f2-4188-99a2-cf12494b8d07 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:24.493560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb4272-6c27-45c6-b33b-c6ebce257a6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:24.494196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258a0b5-987d-4ba3-8b8a-89a92a406a21 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:24.494347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb4272-6c27-45c6-b33b-c6ebce257a6e service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:24.494533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb4272-6c27-45c6-b33b-c6ebce257a6e service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:24.495443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb4272-6c27-45c6-b33b-c6ebce257a6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:24.499863 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82f21b-0867-4d03-be68-f7dbc68aafae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:24.500500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f21b-0867-4d03-be68-f7dbc68aafae service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:24.500784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f21b-0867-4d03-be68-f7dbc68aafae service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:24.501063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f21b-0867-4d03-be68-f7dbc68aafae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:24.509577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82f21b-0867-4d03-be68-f7dbc68aafae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:24.511193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82f21b-0867-4d03-be68-f7dbc68aafae service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:24.520735 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3920/7814] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:24 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:18:24.552306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb4272-6c27-45c6-b33b-c6ebce257a6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:24.553758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb4272-6c27-45c6-b33b-c6ebce257a6e service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:24.563712 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3895/7815] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:24 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:18:27.082744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82f21b-0867-4d03-be68-f7dbc68aafae service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:27.146178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82f21b-0867-4d03-be68-f7dbc68aafae service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:27.151010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:27.151893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:27.152174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:27.152443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] PATH_INFO: `/v3/users/f4d521e07662474eae54efe6617156d0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:27.153644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d521e07662474eae54efe6617156d0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:27.155587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:27.201077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d521e07662474eae54efe6617156d0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.207952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d521e07662474eae54efe6617156d0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.208566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d521e07662474eae54efe6617156d0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.215264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d521e07662474eae54efe6617156d0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.226447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d521e07662474eae54efe6617156d0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.232775 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3921/7816] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:27 2021] DELETE /identity/v3/users/f4d521e07662474eae54efe6617156d0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:27.237444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74f58f-4f8a-4c4f-a305-75a91aa3855c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:27.237926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74f58f-4f8a-4c4f-a305-75a91aa3855c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:27.238011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74f58f-4f8a-4c4f-a305-75a91aa3855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:27.255471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0d74f58f-4f8a-4c4f-a305-75a91aa3855c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:27.256646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0d74f58f-4f8a-4c4f-a305-75a91aa3855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:27.314022 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3896/7817] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:27.324030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:27.325458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:27.384267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834853-f53e-45ff-bb34-2defa362e750 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:27.387940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c0b4-fdc0-4aba-9b43-90eb3b44ad68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:27.388580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c0b4-fdc0-4aba-9b43-90eb3b44ad68 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:27.388892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c0b4-fdc0-4aba-9b43-90eb3b44ad68 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:27.389169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4c0b4-fdc0-4aba-9b43-90eb3b44ad68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:27.398239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4c0b4-fdc0-4aba-9b43-90eb3b44ad68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:27.399698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4c0b4-fdc0-4aba-9b43-90eb3b44ad68 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:27.409044 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3922/7818] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:18:27.714658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74f58f-4f8a-4c4f-a305-75a91aa3855c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:27.716233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0d74f58f-4f8a-4c4f-a305-75a91aa3855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:27.730287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74f58f-4f8a-4c4f-a305-75a91aa3855c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:27.744603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:27.745610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:27.745982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:27.746329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] PATH_INFO: `/v3/projects/d54429e07fac428fa9ba2be3ac7bb890` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:27.747907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54429e07fac428fa9ba2be3ac7bb890)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:27.750685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:27.799621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54429e07fac428fa9ba2be3ac7bb890', 'request_id': 'req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.805640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54429e07fac428fa9ba2be3ac7bb890', 'request_id': 'req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.813076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54429e07fac428fa9ba2be3ac7bb890', 'request_id': 'req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.823071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] The token cache is being invalidate because project d54429e07fac428fa9ba2be3ac7bb890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:27.823393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.824019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.825551 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3897/7819] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:27 2021] DELETE /identity/v3/projects/d54429e07fac428fa9ba2be3ac7bb890 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:27.829479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c0b4-fdc0-4aba-9b43-90eb3b44ad68 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:27.848068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4c0b4-fdc0-4aba-9b43-90eb3b44ad68 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:27.902659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e7ce8-90c5-4044-9ecd-f5780b172449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:27.903545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e7ce8-90c5-4044-9ecd-f5780b172449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:27.903825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e7ce8-90c5-4044-9ecd-f5780b172449 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:27.904097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e7ce8-90c5-4044-9ecd-f5780b172449 admin admin] PATH_INFO: `/v3/users/bf844f48e3b34cedb7b5fd2e71030bc9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:27.905350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e7ce8-90c5-4044-9ecd-f5780b172449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf844f48e3b34cedb7b5fd2e71030bc9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:27.908262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e7ce8-90c5-4044-9ecd-f5780b172449 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:27.954958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be7e7ce8-90c5-4044-9ecd-f5780b172449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf844f48e3b34cedb7b5fd2e71030bc9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.961797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be7e7ce8-90c5-4044-9ecd-f5780b172449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf844f48e3b34cedb7b5fd2e71030bc9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.962437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be7e7ce8-90c5-4044-9ecd-f5780b172449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf844f48e3b34cedb7b5fd2e71030bc9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.969702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be7e7ce8-90c5-4044-9ecd-f5780b172449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf844f48e3b34cedb7b5fd2e71030bc9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.981442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-be7e7ce8-90c5-4044-9ecd-f5780b172449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf844f48e3b34cedb7b5fd2e71030bc9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:27.987141 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3923/7820] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:27 2021] DELETE /identity/v3/users/bf844f48e3b34cedb7b5fd2e71030bc9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:28.251467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:28.252930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:28.266203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5d75c-78c3-41ab-abb9-19f3134af7ea admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:28.324372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:28.325227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:28.325511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:28.325786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] PATH_INFO: `/v3/projects/a75952a730c64635a5925861ac429cc4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:28.326968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75952a730c64635a5925861ac429cc4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:28.328924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:28.374220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75952a730c64635a5925861ac429cc4', 'request_id': 'req-27edb007-d1aa-45ea-b412-ef580a5ba798'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:28.380228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75952a730c64635a5925861ac429cc4', 'request_id': 'req-27edb007-d1aa-45ea-b412-ef580a5ba798'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:28.387304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75952a730c64635a5925861ac429cc4', 'request_id': 'req-27edb007-d1aa-45ea-b412-ef580a5ba798'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:28.397802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] The token cache is being invalidate because project a75952a730c64635a5925861ac429cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:28.398137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:28.398790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27edb007-d1aa-45ea-b412-ef580a5ba798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:28.400391 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3898/7821] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:28 2021] DELETE /identity/v3/projects/a75952a730c64635a5925861ac429cc4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:28.406768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c4dd6-ed2e-4313-941f-af8fafddc0f3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:28.407234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c4dd6-ed2e-4313-941f-af8fafddc0f3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:28.407356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c4dd6-ed2e-4313-941f-af8fafddc0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:28.427833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-684c4dd6-ed2e-4313-941f-af8fafddc0f3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:28.429081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-684c4dd6-ed2e-4313-941f-af8fafddc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:28.488325 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3924/7822] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:28.496487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaaff6-3494-4ee1-b6b6-edc7eb5f04b2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:28.496773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaaff6-3494-4ee1-b6b6-edc7eb5f04b2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:28.497050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaaff6-3494-4ee1-b6b6-edc7eb5f04b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:28.516899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2aeaaff6-3494-4ee1-b6b6-edc7eb5f04b2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:28.518059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2aeaaff6-3494-4ee1-b6b6-edc7eb5f04b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:28.526631 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3899/7823] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:28.530968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c4dd6-ed2e-4313-941f-af8fafddc0f3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:28.540572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c4dd6-ed2e-4313-941f-af8fafddc0f3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:28.545921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85db03-9e4c-40ec-b33c-f975209f0676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:28.546565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85db03-9e4c-40ec-b33c-f975209f0676 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:28.546845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85db03-9e4c-40ec-b33c-f975209f0676 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:28.547118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85db03-9e4c-40ec-b33c-f975209f0676 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:28.547876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85db03-9e4c-40ec-b33c-f975209f0676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:18:28.548182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85db03-9e4c-40ec-b33c-f975209f0676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:28.549767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85db03-9e4c-40ec-b33c-f975209f0676 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:28.560929 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3925/7824] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:18:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:18:28.565135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaaff6-3494-4ee1-b6b6-edc7eb5f04b2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:28.574376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaaff6-3494-4ee1-b6b6-edc7eb5f04b2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:28.579079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321907-98f3-41e9-b5da-fbb02e95abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:28.579759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321907-98f3-41e9-b5da-fbb02e95abfa admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:28.580043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321907-98f3-41e9-b5da-fbb02e95abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:28.580377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321907-98f3-41e9-b5da-fbb02e95abfa admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:28.581082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321907-98f3-41e9-b5da-fbb02e95abfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:28.582977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321907-98f3-41e9-b5da-fbb02e95abfa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:28.608495 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3900/7825] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:28 2021] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:28.612987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85db03-9e4c-40ec-b33c-f975209f0676 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:28.623124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85db03-9e4c-40ec-b33c-f975209f0676 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:28.677349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11a1f0-bb21-436e-802c-cb8ac99512bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:28.678007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11a1f0-bb21-436e-802c-cb8ac99512bf admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:28.678293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11a1f0-bb21-436e-802c-cb8ac99512bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:28.678570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11a1f0-bb21-436e-802c-cb8ac99512bf admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:28.679274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11a1f0-bb21-436e-802c-cb8ac99512bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:28.681201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11a1f0-bb21-436e-802c-cb8ac99512bf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:28.700752 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3926/7826] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:28 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:28.704790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321907-98f3-41e9-b5da-fbb02e95abfa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:28.715459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321907-98f3-41e9-b5da-fbb02e95abfa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:28.720153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4a6ef-7f77-4699-a4b7-6f3277ae58af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:28.720791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4a6ef-7f77-4699-a4b7-6f3277ae58af admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:28.721075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4a6ef-7f77-4699-a4b7-6f3277ae58af admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:28.721353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4a6ef-7f77-4699-a4b7-6f3277ae58af admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:28.722086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4a6ef-7f77-4699-a4b7-6f3277ae58af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:28.723786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4a6ef-7f77-4699-a4b7-6f3277ae58af admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:28.735472 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3901/7827] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:18:28.740971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11a1f0-bb21-436e-802c-cb8ac99512bf admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:28.750920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11a1f0-bb21-436e-802c-cb8ac99512bf admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:28.755542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74681677-8cdb-49ce-9147-21dd23232c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:28.756193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74681677-8cdb-49ce-9147-21dd23232c29 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:28.756475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74681677-8cdb-49ce-9147-21dd23232c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:28.756753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74681677-8cdb-49ce-9147-21dd23232c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:28.757478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74681677-8cdb-49ce-9147-21dd23232c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:28.759065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74681677-8cdb-49ce-9147-21dd23232c29 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:28.769443 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3927/7828] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:28.773406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4a6ef-7f77-4699-a4b7-6f3277ae58af admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:28.783962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4a6ef-7f77-4699-a4b7-6f3277ae58af admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:28.789009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b83dc4-e6c7-4819-ae87-8d04d95c36d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:28.789888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b83dc4-e6c7-4819-ae87-8d04d95c36d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:28.790198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b83dc4-e6c7-4819-ae87-8d04d95c36d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:28.790438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b83dc4-e6c7-4819-ae87-8d04d95c36d8 admin admin] PATH_INFO: `/v3/projects/2017a682ca354efb855b24073b3d494c/users/3867437fbb4e4d799a225a07de794cac/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:28.805073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b83dc4-e6c7-4819-ae87-8d04d95c36d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2017a682ca354efb855b24073b3d494c, user_id=3867437fbb4e4d799a225a07de794cac, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:28.807808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b83dc4-e6c7-4819-ae87-8d04d95c36d8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:28.821342 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3902/7829] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:28 2021] PUT /identity/v3/projects/2017a682ca354efb855b24073b3d494c/users/3867437fbb4e4d799a225a07de794cac/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:28.832819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e0d9-53b6-41e3-bc9d-6ab346702474 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:28.833187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e0d9-53b6-41e3-bc9d-6ab346702474 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:28.833537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e0d9-53b6-41e3-bc9d-6ab346702474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:28.861348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c8b3e0d9-53b6-41e3-bc9d-6ab346702474 None None] MFA Rules not processed for user `3867437fbb4e4d799a225a07de794cac`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:28.862559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c8b3e0d9-53b6-41e3-bc9d-6ab346702474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:28.930496 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3928/7830] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:28 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:18:28.941220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b83dc4-e6c7-4819-ae87-8d04d95c36d8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:28.943046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-29b83dc4-e6c7-4819-ae87-8d04d95c36d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:29.001683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b83dc4-e6c7-4819-ae87-8d04d95c36d8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:29.005543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aff5d2-5b73-45be-9f55-49b041f727f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:29.006185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff5d2-5b73-45be-9f55-49b041f727f1 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:29.006471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff5d2-5b73-45be-9f55-49b041f727f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:29.006747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aff5d2-5b73-45be-9f55-49b041f727f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:29.015663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aff5d2-5b73-45be-9f55-49b041f727f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:29.017100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aff5d2-5b73-45be-9f55-49b041f727f1 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:29.025918 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3903/7831] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:28 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:35.879942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3e0d9-53b6-41e3-bc9d-6ab346702474 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:35.940796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3e0d9-53b6-41e3-bc9d-6ab346702474 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:35.945401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:35.946464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:35.946745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:35.947023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] PATH_INFO: `/v3/users/3867437fbb4e4d799a225a07de794cac` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:35.948264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3867437fbb4e4d799a225a07de794cac)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:35.950180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:35.998120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3867437fbb4e4d799a225a07de794cac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:36.005277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3867437fbb4e4d799a225a07de794cac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:36.006113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3867437fbb4e4d799a225a07de794cac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:36.013641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3867437fbb4e4d799a225a07de794cac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:36.024868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3867437fbb4e4d799a225a07de794cac'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:36.030869 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3929/7832] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:35 2021] DELETE /identity/v3/users/3867437fbb4e4d799a225a07de794cac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:18:36.035501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d1142-753e-4ffc-bdb2-25eb589e74c2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:36.035958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d1142-753e-4ffc-bdb2-25eb589e74c2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:36.036043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d1142-753e-4ffc-bdb2-25eb589e74c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:36.053481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9e7d1142-753e-4ffc-bdb2-25eb589e74c2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:36.054673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9e7d1142-753e-4ffc-bdb2-25eb589e74c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:36.112492 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3904/7833] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:36.123211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:36.124644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:36.183843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e3b2c-70cc-4a71-8ee5-f44a91730b40 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:36.187508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae92a8-b957-4fd4-ae09-8ed0ab52078d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:36.188148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae92a8-b957-4fd4-ae09-8ed0ab52078d service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:36.188432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae92a8-b957-4fd4-ae09-8ed0ab52078d service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:36.188707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae92a8-b957-4fd4-ae09-8ed0ab52078d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:36.197721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae92a8-b957-4fd4-ae09-8ed0ab52078d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:36.199138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae92a8-b957-4fd4-ae09-8ed0ab52078d service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:36.208502 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3930/7834] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:18:36.488504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d1142-753e-4ffc-bdb2-25eb589e74c2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:36.490268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9e7d1142-753e-4ffc-bdb2-25eb589e74c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:36.504104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d1142-753e-4ffc-bdb2-25eb589e74c2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:36.508746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:36.509600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:36.509930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:36.510205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] PATH_INFO: `/v3/projects/2017a682ca354efb855b24073b3d494c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:36.511588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2017a682ca354efb855b24073b3d494c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:36.513393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:36.559671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2017a682ca354efb855b24073b3d494c', 'request_id': 'req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:36.565650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2017a682ca354efb855b24073b3d494c', 'request_id': 'req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:36.572998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2017a682ca354efb855b24073b3d494c', 'request_id': 'req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:36.583446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] The token cache is being invalidate because project 2017a682ca354efb855b24073b3d494c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:36.583730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:36.584377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0baaa5c2-bd43-47d3-a74b-fe15ed75a638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:36.585939 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3905/7835] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:36 2021] DELETE /identity/v3/projects/2017a682ca354efb855b24073b3d494c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:36.592336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd305dc-57f5-44f0-a291-f0cf3aa86c75 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:36.592719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd305dc-57f5-44f0-a291-f0cf3aa86c75 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:36.593003 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd305dc-57f5-44f0-a291-f0cf3aa86c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:36.611625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1fd305dc-57f5-44f0-a291-f0cf3aa86c75 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:36.612795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1fd305dc-57f5-44f0-a291-f0cf3aa86c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:36.669560 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3931/7836] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:18:36.677607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec909-3dcc-4443-b958-2b848eee2a9f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:36.677899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec909-3dcc-4443-b958-2b848eee2a9f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:36.678179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec909-3dcc-4443-b958-2b848eee2a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:36.696753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-843ec909-3dcc-4443-b958-2b848eee2a9f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:36.697969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-843ec909-3dcc-4443-b958-2b848eee2a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:36.705877 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3906/7837] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:36.710023 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd305dc-57f5-44f0-a291-f0cf3aa86c75 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:36.719989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd305dc-57f5-44f0-a291-f0cf3aa86c75 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:36.724542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1008e-d454-4d16-8446-384566b5af3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:36.725183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1008e-d454-4d16-8446-384566b5af3a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:36.725466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1008e-d454-4d16-8446-384566b5af3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:36.725742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1008e-d454-4d16-8446-384566b5af3a admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:36.726499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1008e-d454-4d16-8446-384566b5af3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:18:36.726806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1008e-d454-4d16-8446-384566b5af3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:36.728431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1008e-d454-4d16-8446-384566b5af3a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:36.740960 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3932/7838] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:18:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:18:36.745212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec909-3dcc-4443-b958-2b848eee2a9f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:36.754367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec909-3dcc-4443-b958-2b848eee2a9f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:36.759076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8f10-a8d1-45a1-9b6e-8d8b0e864a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:36.759765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8f10-a8d1-45a1-9b6e-8d8b0e864a47 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:36.760044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8f10-a8d1-45a1-9b6e-8d8b0e864a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:36.760313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8f10-a8d1-45a1-9b6e-8d8b0e864a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:36.761004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd8f10-a8d1-45a1-9b6e-8d8b0e864a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:36.762932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd8f10-a8d1-45a1-9b6e-8d8b0e864a47 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:36.788989 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3907/7839] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:36 2021] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:18:36.793740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1008e-d454-4d16-8446-384566b5af3a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:36.804291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1008e-d454-4d16-8446-384566b5af3a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:36.858069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf136ccd-8bb5-4684-8dbf-98742160525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:36.858698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf136ccd-8bb5-4684-8dbf-98742160525d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:36.858964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf136ccd-8bb5-4684-8dbf-98742160525d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:36.859239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf136ccd-8bb5-4684-8dbf-98742160525d admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:36.860044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf136ccd-8bb5-4684-8dbf-98742160525d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:36.861938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf136ccd-8bb5-4684-8dbf-98742160525d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:36.880863 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3933/7840] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:36 2021] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:18:36.884921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8f10-a8d1-45a1-9b6e-8d8b0e864a47 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:36.894996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8f10-a8d1-45a1-9b6e-8d8b0e864a47 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:36.899804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230144b1-7828-4207-bc6f-238cb31e6cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:36.901007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230144b1-7828-4207-bc6f-238cb31e6cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:36.901286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230144b1-7828-4207-bc6f-238cb31e6cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:36.901555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230144b1-7828-4207-bc6f-238cb31e6cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:36.902272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230144b1-7828-4207-bc6f-238cb31e6cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:36.903905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230144b1-7828-4207-bc6f-238cb31e6cb6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:36.914032 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3908/7841] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:36.918513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf136ccd-8bb5-4684-8dbf-98742160525d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:36.928216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf136ccd-8bb5-4684-8dbf-98742160525d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:36.933125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095563b-967b-4084-9023-1c4f8a30f4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:36.933769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095563b-967b-4084-9023-1c4f8a30f4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:36.934057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095563b-967b-4084-9023-1c4f8a30f4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:36.934337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095563b-967b-4084-9023-1c4f8a30f4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:36.935097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095563b-967b-4084-9023-1c4f8a30f4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:36.936729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095563b-967b-4084-9023-1c4f8a30f4e3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:36.946858 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3934/7842] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:36 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:36.951356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230144b1-7828-4207-bc6f-238cb31e6cb6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:36.961329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230144b1-7828-4207-bc6f-238cb31e6cb6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:36.966724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da0dee-b155-4cbb-981c-7fc3dd4ca5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:36.967646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da0dee-b155-4cbb-981c-7fc3dd4ca5aa admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:36.967926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da0dee-b155-4cbb-981c-7fc3dd4ca5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:36.968201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da0dee-b155-4cbb-981c-7fc3dd4ca5aa admin admin] PATH_INFO: `/v3/projects/28a177f11d9942a8a518569075cf5578/users/756f825c3dca46609964845883f98077/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:36.982405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da0dee-b155-4cbb-981c-7fc3dd4ca5aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a177f11d9942a8a518569075cf5578, user_id=756f825c3dca46609964845883f98077, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:36.985101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da0dee-b155-4cbb-981c-7fc3dd4ca5aa admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:36.998024 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3909/7843] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:36 2021] PUT /identity/v3/projects/28a177f11d9942a8a518569075cf5578/users/756f825c3dca46609964845883f98077/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:37.009407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96675e0-7846-4670-a8b1-d553daf800ae None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:37.009709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96675e0-7846-4670-a8b1-d553daf800ae None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:37.010565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96675e0-7846-4670-a8b1-d553daf800ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:37.040320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d96675e0-7846-4670-a8b1-d553daf800ae None None] MFA Rules not processed for user `756f825c3dca46609964845883f98077`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:37.041535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d96675e0-7846-4670-a8b1-d553daf800ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:37.108823 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3935/7844] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:37 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:37.121115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da0dee-b155-4cbb-981c-7fc3dd4ca5aa admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:37.122979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-65da0dee-b155-4cbb-981c-7fc3dd4ca5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:37.190896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da0dee-b155-4cbb-981c-7fc3dd4ca5aa admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:37.194612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2b904-9f81-4751-b1fe-3a04c4ade50d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:37.195276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b904-9f81-4751-b1fe-3a04c4ade50d service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:37.195562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b904-9f81-4751-b1fe-3a04c4ade50d service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:37.195836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2b904-9f81-4751-b1fe-3a04c4ade50d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:37.204575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2b904-9f81-4751-b1fe-3a04c4ade50d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:37.206011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2b904-9f81-4751-b1fe-3a04c4ade50d service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:37.215538 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3910/7845] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:37 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:48.110274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96675e0-7846-4670-a8b1-d553daf800ae None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:48.175555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96675e0-7846-4670-a8b1-d553daf800ae None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:48.180180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:48.181112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:48.181403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:48.183840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] PATH_INFO: `/v3/users/756f825c3dca46609964845883f98077` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:48.183840 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=756f825c3dca46609964845883f98077)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:48.184970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:48.233854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756f825c3dca46609964845883f98077'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:48.242191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756f825c3dca46609964845883f98077'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:48.242814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756f825c3dca46609964845883f98077'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:48.250129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756f825c3dca46609964845883f98077'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:48.262991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756f825c3dca46609964845883f98077'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:48.269144 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3936/7846] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:48 2021] DELETE /identity/v3/users/756f825c3dca46609964845883f98077 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:48.273616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc835d1b-6ff1-4d54-912f-687eed468122 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:48.274106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc835d1b-6ff1-4d54-912f-687eed468122 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:48.274202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc835d1b-6ff1-4d54-912f-687eed468122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:48.293410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-dc835d1b-6ff1-4d54-912f-687eed468122 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:48.295451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dc835d1b-6ff1-4d54-912f-687eed468122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:48.331333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:48.333461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:48.360024 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3911/7847] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:48.371997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc835d1b-6ff1-4d54-912f-687eed468122 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:48.373710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dc835d1b-6ff1-4d54-912f-687eed468122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:48.424962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27191242-4c67-4c89-b91e-bcd6b37bc78f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:48.434818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6589258-0ef5-4cf2-85c4-33a378ef6dca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:48.435515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6589258-0ef5-4cf2-85c4-33a378ef6dca service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:48.435798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6589258-0ef5-4cf2-85c4-33a378ef6dca service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:48.436072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6589258-0ef5-4cf2-85c4-33a378ef6dca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:48.438233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f6589258-0ef5-4cf2-85c4-33a378ef6dca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:48.444004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc835d1b-6ff1-4d54-912f-687eed468122 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:48.449002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915aa5d-6aaf-4b9c-b3ba-c2298531a500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:48.450520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915aa5d-6aaf-4b9c-b3ba-c2298531a500 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:48.450955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915aa5d-6aaf-4b9c-b3ba-c2298531a500 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:48.451414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915aa5d-6aaf-4b9c-b3ba-c2298531a500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:48.454600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6589258-0ef5-4cf2-85c4-33a378ef6dca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:48.456394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6589258-0ef5-4cf2-85c4-33a378ef6dca service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:48.465315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915aa5d-6aaf-4b9c-b3ba-c2298531a500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:48.468168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915aa5d-6aaf-4b9c-b3ba-c2298531a500 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:48.472415 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3937/7848] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:48 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:18:48.480487 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3912/7849] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:48.778080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6589258-0ef5-4cf2-85c4-33a378ef6dca service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:48.779694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f6589258-0ef5-4cf2-85c4-33a378ef6dca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:48.800533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6589258-0ef5-4cf2-85c4-33a378ef6dca service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:48.806433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:48.807676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:48.807877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:48.808226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] PATH_INFO: `/v3/projects/28a177f11d9942a8a518569075cf5578` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:48.809830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a177f11d9942a8a518569075cf5578)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:48.811855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:48.870665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a177f11d9942a8a518569075cf5578', 'request_id': 'req-71f024be-eb9a-4cb3-a8f7-557214294dda'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:48.879811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a177f11d9942a8a518569075cf5578', 'request_id': 'req-71f024be-eb9a-4cb3-a8f7-557214294dda'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:48.887406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a177f11d9942a8a518569075cf5578', 'request_id': 'req-71f024be-eb9a-4cb3-a8f7-557214294dda'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:48.898939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] The token cache is being invalidate because project 28a177f11d9942a8a518569075cf5578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:18:48.901018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:48.901713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-71f024be-eb9a-4cb3-a8f7-557214294dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:48.903594 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3938/7850] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:48 2021] DELETE /identity/v3/projects/28a177f11d9942a8a518569075cf5578 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:48.909344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d619709-82c9-48fc-8c32-5216a1d772ed None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:48.910034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d619709-82c9-48fc-8c32-5216a1d772ed None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:48.910421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d619709-82c9-48fc-8c32-5216a1d772ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:48.934262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2d619709-82c9-48fc-8c32-5216a1d772ed None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:48.935723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2d619709-82c9-48fc-8c32-5216a1d772ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:49.049898 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3913/7851] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:49.063964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eb980-a26d-4dea-9fba-5fa25514d2eb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:49.064254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eb980-a26d-4dea-9fba-5fa25514d2eb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:49.064531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22eb980-a26d-4dea-9fba-5fa25514d2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:49.084969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e22eb980-a26d-4dea-9fba-5fa25514d2eb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:49.086363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e22eb980-a26d-4dea-9fba-5fa25514d2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:49.095132 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3939/7852] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:18:49.099513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d619709-82c9-48fc-8c32-5216a1d772ed None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:49.109988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d619709-82c9-48fc-8c32-5216a1d772ed None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:49.116223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37e15d-3b7a-4f0d-bd24-63c6211a5507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:49.117112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37e15d-3b7a-4f0d-bd24-63c6211a5507 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:49.117478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37e15d-3b7a-4f0d-bd24-63c6211a5507 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:49.117775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37e15d-3b7a-4f0d-bd24-63c6211a5507 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:49.118624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37e15d-3b7a-4f0d-bd24-63c6211a5507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:18:49.118977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37e15d-3b7a-4f0d-bd24-63c6211a5507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:49.120941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37e15d-3b7a-4f0d-bd24-63c6211a5507 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:49.137774 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3914/7853] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:18:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:18:49.138854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22eb980-a26d-4dea-9fba-5fa25514d2eb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:49.151468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22eb980-a26d-4dea-9fba-5fa25514d2eb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:49.157805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a513b6-83c4-4fb1-a576-467f7bd78c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:49.158766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a513b6-83c4-4fb1-a576-467f7bd78c3d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:49.159177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a513b6-83c4-4fb1-a576-467f7bd78c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:49.159634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a513b6-83c4-4fb1-a576-467f7bd78c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:49.160718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a513b6-83c4-4fb1-a576-467f7bd78c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:49.162916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a513b6-83c4-4fb1-a576-467f7bd78c3d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:49.189955 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3940/7854] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:18:49 2021] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:18:49.194095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37e15d-3b7a-4f0d-bd24-63c6211a5507 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:49.204548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37e15d-3b7a-4f0d-bd24-63c6211a5507 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:49.263030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b810a7d-d79d-4885-b50a-2706a0f1b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:49.263769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b810a7d-d79d-4885-b50a-2706a0f1b821 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:49.264030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b810a7d-d79d-4885-b50a-2706a0f1b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:49.264433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b810a7d-d79d-4885-b50a-2706a0f1b821 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:49.265234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b810a7d-d79d-4885-b50a-2706a0f1b821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:49.267346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b810a7d-d79d-4885-b50a-2706a0f1b821 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:49.292626 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3915/7855] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:18:49 2021] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:18:49.294365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a513b6-83c4-4fb1-a576-467f7bd78c3d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:49.304818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a513b6-83c4-4fb1-a576-467f7bd78c3d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:49.310517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecffec-366e-4b98-86c4-0c424d376d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:49.311332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecffec-366e-4b98-86c4-0c424d376d27 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:49.311582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecffec-366e-4b98-86c4-0c424d376d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:49.311973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecffec-366e-4b98-86c4-0c424d376d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:49.312777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecffec-366e-4b98-86c4-0c424d376d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:49.314586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecffec-366e-4b98-86c4-0c424d376d27 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:49.326547 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3941/7856] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:49.330072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b810a7d-d79d-4885-b50a-2706a0f1b821 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:49.341189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b810a7d-d79d-4885-b50a-2706a0f1b821 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:49.345952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21db08-fdb6-45ea-904c-f092e65375e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:49.346614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21db08-fdb6-45ea-904c-f092e65375e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:49.346900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21db08-fdb6-45ea-904c-f092e65375e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:49.347206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21db08-fdb6-45ea-904c-f092e65375e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:49.348040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21db08-fdb6-45ea-904c-f092e65375e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:49.349650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21db08-fdb6-45ea-904c-f092e65375e2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:49.362709 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3916/7857] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:18:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:18:49.364230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecffec-366e-4b98-86c4-0c424d376d27 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:49.375116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecffec-366e-4b98-86c4-0c424d376d27 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:49.381062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c64bf4-36e8-4dde-be73-e7e12485816e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:49.382059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64bf4-36e8-4dde-be73-e7e12485816e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:49.382417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64bf4-36e8-4dde-be73-e7e12485816e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:49.382773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64bf4-36e8-4dde-be73-e7e12485816e admin admin] PATH_INFO: `/v3/projects/f11c0a31ba3a4673a42499d8426c122d/users/33d06d0e376348e1aee75912024ff556/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:49.400596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c64bf4-36e8-4dde-be73-e7e12485816e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11c0a31ba3a4673a42499d8426c122d, user_id=33d06d0e376348e1aee75912024ff556, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:49.403300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c64bf4-36e8-4dde-be73-e7e12485816e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:49.416712 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3942/7858] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:18:49 2021] PUT /identity/v3/projects/f11c0a31ba3a4673a42499d8426c122d/users/33d06d0e376348e1aee75912024ff556/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:49.427436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51029-9913-4c31-877c-d04d4b724958 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:49.427737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51029-9913-4c31-877c-d04d4b724958 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:49.428070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51029-9913-4c31-877c-d04d4b724958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:49.455630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c8d51029-9913-4c31-877c-d04d4b724958 None None] MFA Rules not processed for user `33d06d0e376348e1aee75912024ff556`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:49.456846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c8d51029-9913-4c31-877c-d04d4b724958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:49.519312 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3917/7859] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:49 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:49.529110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c64bf4-36e8-4dde-be73-e7e12485816e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:49.530747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-50c64bf4-36e8-4dde-be73-e7e12485816e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:49.592288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c64bf4-36e8-4dde-be73-e7e12485816e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:49.595966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbb37f-fb10-469e-93bb-2efe54fdf7cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:49.596604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbb37f-fb10-469e-93bb-2efe54fdf7cc service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:49.596889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbb37f-fb10-469e-93bb-2efe54fdf7cc service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:49.597167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbb37f-fb10-469e-93bb-2efe54fdf7cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:49.605346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbb37f-fb10-469e-93bb-2efe54fdf7cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:49.606766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cbb37f-fb10-469e-93bb-2efe54fdf7cc service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:49.615654 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3943/7860] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:49 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:52.853763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d51029-9913-4c31-877c-d04d4b724958 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:52.855232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c8d51029-9913-4c31-877c-d04d4b724958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:52.929548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d51029-9913-4c31-877c-d04d4b724958 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:52.935975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d3f88-2887-4c1d-b0c3-4acc1b487da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:52.936625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3f88-2887-4c1d-b0c3-4acc1b487da9 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:52.936913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3f88-2887-4c1d-b0c3-4acc1b487da9 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:52.937197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3f88-2887-4c1d-b0c3-4acc1b487da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:52.938962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-075d3f88-2887-4c1d-b0c3-4acc1b487da9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:52.996262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d3f88-2887-4c1d-b0c3-4acc1b487da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:52.997878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d3f88-2887-4c1d-b0c3-4acc1b487da9 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:53.006848 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3918/7861] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:52 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:59.181654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbb37f-fb10-469e-93bb-2efe54fdf7cc service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:59.242293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbb37f-fb10-469e-93bb-2efe54fdf7cc service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:59.246845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:59.247734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:59.248018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:59.248294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] PATH_INFO: `/v3/users/33d06d0e376348e1aee75912024ff556` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:59.249478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d06d0e376348e1aee75912024ff556)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:59.251407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:59.297031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d06d0e376348e1aee75912024ff556'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:59.304620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d06d0e376348e1aee75912024ff556'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:59.305360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d06d0e376348e1aee75912024ff556'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:59.312627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d06d0e376348e1aee75912024ff556'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:59.323961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d06d0e376348e1aee75912024ff556'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:18:59.330074 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3944/7862] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:18:59 2021] DELETE /identity/v3/users/33d06d0e376348e1aee75912024ff556 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:18:59.334674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4fd49-3a73-4aa8-8cd5-6b77010df563 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:59.335154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4fd49-3a73-4aa8-8cd5-6b77010df563 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:59.335397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4fd49-3a73-4aa8-8cd5-6b77010df563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:59.355958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1dd4fd49-3a73-4aa8-8cd5-6b77010df563 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:18:59.357154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1dd4fd49-3a73-4aa8-8cd5-6b77010df563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:59.421620 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3919/7863] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:18:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:18:59.436387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:59.437891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:59.507290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc394da-c4f3-4935-80ce-36a4020a3d50 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:59.511748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86da4a1-b862-4a4d-be8a-113fae6c07dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:59.512396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86da4a1-b862-4a4d-be8a-113fae6c07dd service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:59.512676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86da4a1-b862-4a4d-be8a-113fae6c07dd service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:59.513101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86da4a1-b862-4a4d-be8a-113fae6c07dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:59.522635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86da4a1-b862-4a4d-be8a-113fae6c07dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:59.524134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86da4a1-b862-4a4d-be8a-113fae6c07dd service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:18:59.537016 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3945/7864] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:18:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:18:59.943374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4fd49-3a73-4aa8-8cd5-6b77010df563 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:18:59.944794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1dd4fd49-3a73-4aa8-8cd5-6b77010df563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:18:59.957962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4fd49-3a73-4aa8-8cd5-6b77010df563 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:18:59.964834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:18:59.965397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:18:59.965676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:18:59.965946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] PATH_INFO: `/v3/projects/f11c0a31ba3a4673a42499d8426c122d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:18:59.967166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11c0a31ba3a4673a42499d8426c122d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:18:59.969320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:00.018962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11c0a31ba3a4673a42499d8426c122d', 'request_id': 'req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:00.025661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11c0a31ba3a4673a42499d8426c122d', 'request_id': 'req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:00.032737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11c0a31ba3a4673a42499d8426c122d', 'request_id': 'req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:00.042934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] The token cache is being invalidate because project f11c0a31ba3a4673a42499d8426c122d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:19:00.043216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:00.043869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f4efb4f9-7af8-4015-8336-7a82ca5fe2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:00.045461 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3920/7865] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:18:59 2021] DELETE /identity/v3/projects/f11c0a31ba3a4673a42499d8426c122d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:19:00.051206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dee3cf-4a87-4b6f-83f9-8d70a6a16ba5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:00.051530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dee3cf-4a87-4b6f-83f9-8d70a6a16ba5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:00.051838 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dee3cf-4a87-4b6f-83f9-8d70a6a16ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:00.070268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c1dee3cf-4a87-4b6f-83f9-8d70a6a16ba5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:00.072071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c1dee3cf-4a87-4b6f-83f9-8d70a6a16ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:00.128447 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3946/7866] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:19:00.136685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd758c-7074-4ef6-be7f-34ffe8425f70 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:00.136996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd758c-7074-4ef6-be7f-34ffe8425f70 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:00.137272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd758c-7074-4ef6-be7f-34ffe8425f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:00.155207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-dddd758c-7074-4ef6-be7f-34ffe8425f70 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:00.156417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-dddd758c-7074-4ef6-be7f-34ffe8425f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:00.164277 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3921/7867] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:19:00.168820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dee3cf-4a87-4b6f-83f9-8d70a6a16ba5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:00.178356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dee3cf-4a87-4b6f-83f9-8d70a6a16ba5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:00.183907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052349c-2aca-47b7-9123-fc89b535a791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:00.184661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052349c-2aca-47b7-9123-fc89b535a791 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:00.185021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052349c-2aca-47b7-9123-fc89b535a791 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:00.185349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052349c-2aca-47b7-9123-fc89b535a791 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:00.186230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052349c-2aca-47b7-9123-fc89b535a791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:19:00.186565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052349c-2aca-47b7-9123-fc89b535a791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:00.188168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052349c-2aca-47b7-9123-fc89b535a791 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:00.199917 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3947/7868] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:19:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:19:00.204212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd758c-7074-4ef6-be7f-34ffe8425f70 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:00.213892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd758c-7074-4ef6-be7f-34ffe8425f70 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:00.219482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe74dfd-0624-40b3-93e6-dafb61a83c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:00.220138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74dfd-0624-40b3-93e6-dafb61a83c65 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:00.220438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74dfd-0624-40b3-93e6-dafb61a83c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:00.220742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74dfd-0624-40b3-93e6-dafb61a83c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:00.222720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe74dfd-0624-40b3-93e6-dafb61a83c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:00.223387 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe74dfd-0624-40b3-93e6-dafb61a83c65 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:00.250118 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3922/7869] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:19:00 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:19:00.253474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052349c-2aca-47b7-9123-fc89b535a791 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:00.263495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052349c-2aca-47b7-9123-fc89b535a791 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:00.317114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ea146-44e6-46c3-b084-6cf0a9f68776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:00.317701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ea146-44e6-46c3-b084-6cf0a9f68776 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:00.317990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ea146-44e6-46c3-b084-6cf0a9f68776 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:00.318267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ea146-44e6-46c3-b084-6cf0a9f68776 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:00.318990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ea146-44e6-46c3-b084-6cf0a9f68776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:00.320940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ea146-44e6-46c3-b084-6cf0a9f68776 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:00.340008 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3948/7870] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:19:00 2021] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:19:00.343988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe74dfd-0624-40b3-93e6-dafb61a83c65 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:00.354936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe74dfd-0624-40b3-93e6-dafb61a83c65 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:00.359573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606438f2-f01e-419e-a638-39dcb286b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:00.360225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606438f2-f01e-419e-a638-39dcb286b78a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:00.360509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606438f2-f01e-419e-a638-39dcb286b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:00.360783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606438f2-f01e-419e-a638-39dcb286b78a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:00.361511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606438f2-f01e-419e-a638-39dcb286b78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:00.363111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606438f2-f01e-419e-a638-39dcb286b78a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:00.374160 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3923/7871] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:19:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:19:00.377896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ea146-44e6-46c3-b084-6cf0a9f68776 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:00.387805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ea146-44e6-46c3-b084-6cf0a9f68776 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:00.392402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc35cfd-9a01-43d7-a2cd-81ddf6714d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:00.393041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc35cfd-9a01-43d7-a2cd-81ddf6714d2b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:00.393320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc35cfd-9a01-43d7-a2cd-81ddf6714d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:00.393590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc35cfd-9a01-43d7-a2cd-81ddf6714d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:00.394310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc35cfd-9a01-43d7-a2cd-81ddf6714d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:00.395916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc35cfd-9a01-43d7-a2cd-81ddf6714d2b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:00.405455 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3949/7872] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:19:00 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:19:00.409237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606438f2-f01e-419e-a638-39dcb286b78a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:00.420996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606438f2-f01e-419e-a638-39dcb286b78a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:00.425931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d73bd6-e7a4-427c-9dbc-c3ea14af6e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:00.426834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73bd6-e7a4-427c-9dbc-c3ea14af6e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:00.427114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73bd6-e7a4-427c-9dbc-c3ea14af6e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:00.427416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73bd6-e7a4-427c-9dbc-c3ea14af6e4e admin admin] PATH_INFO: `/v3/projects/05afa0d2a44144078e3fa7d820a95510/users/6e49ff29764540ae95d8b9d0f9d4fbfa/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:00.442661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d73bd6-e7a4-427c-9dbc-c3ea14af6e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05afa0d2a44144078e3fa7d820a95510, user_id=6e49ff29764540ae95d8b9d0f9d4fbfa, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:00.445437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d73bd6-e7a4-427c-9dbc-c3ea14af6e4e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:00.458585 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3924/7873] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:19:00 2021] PUT /identity/v3/projects/05afa0d2a44144078e3fa7d820a95510/users/6e49ff29764540ae95d8b9d0f9d4fbfa/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:19:00.463754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea49c84-9f25-4f4b-b657-dadd1be63475 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:00.464042 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea49c84-9f25-4f4b-b657-dadd1be63475 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:00.464317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea49c84-9f25-4f4b-b657-dadd1be63475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:00.482765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1ea49c84-9f25-4f4b-b657-dadd1be63475 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:00.484017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1ea49c84-9f25-4f4b-b657-dadd1be63475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:00.545214 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3950/7874] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:19:00.555068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d73bd6-e7a4-427c-9dbc-c3ea14af6e4e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:00.557454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-19d73bd6-e7a4-427c-9dbc-c3ea14af6e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:00.618939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d73bd6-e7a4-427c-9dbc-c3ea14af6e4e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:00.622633 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee857664-f839-4012-be90-33c600a459c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:00.623303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee857664-f839-4012-be90-33c600a459c8 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:00.623731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee857664-f839-4012-be90-33c600a459c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:00.624020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee857664-f839-4012-be90-33c600a459c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:00.632966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee857664-f839-4012-be90-33c600a459c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:00.635007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee857664-f839-4012-be90-33c600a459c8 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:00.644407 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3925/7875] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:19:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:19:01.281139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ed61c-6d3b-489f-b832-7c558c187519 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:01.281630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ed61c-6d3b-489f-b832-7c558c187519 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:01.281821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ed61c-6d3b-489f-b832-7c558c187519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:01.309959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-462ed61c-6d3b-489f-b832-7c558c187519 None None] MFA Rules not processed for user `6e49ff29764540ae95d8b9d0f9d4fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:01.311229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-462ed61c-6d3b-489f-b832-7c558c187519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:01.377969 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3951/7876] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:01 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:19:01.388034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee857664-f839-4012-be90-33c600a459c8 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:01.389578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ee857664-f839-4012-be90-33c600a459c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:01.452554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee857664-f839-4012-be90-33c600a459c8 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:01.456226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca379-d74c-429d-a9e3-c3f00befa21e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:01.456871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca379-d74c-429d-a9e3-c3f00befa21e service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:01.457150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca379-d74c-429d-a9e3-c3f00befa21e service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:01.457421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca379-d74c-429d-a9e3-c3f00befa21e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:01.466503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dca379-d74c-429d-a9e3-c3f00befa21e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:01.467976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dca379-d74c-429d-a9e3-c3f00befa21e service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:01.476988 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3926/7877] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:19:01 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:19:14.532768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915509-b7d7-460d-8c5b-2ec9211dcdab None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:14.533335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915509-b7d7-460d-8c5b-2ec9211dcdab None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:14.533335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915509-b7d7-460d-8c5b-2ec9211dcdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:14.552413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b3915509-b7d7-460d-8c5b-2ec9211dcdab None None] MFA Rules not processed for user `6e49ff29764540ae95d8b9d0f9d4fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:14.553709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b3915509-b7d7-460d-8c5b-2ec9211dcdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:14.562413 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3952/7878] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:14 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:19:14.793166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca379-d74c-429d-a9e3-c3f00befa21e service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:14.794559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-93dca379-d74c-429d-a9e3-c3f00befa21e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:14.809032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca379-d74c-429d-a9e3-c3f00befa21e service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:14.812583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd184e-94e3-4ac1-b087-72f5605df944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:14.813201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd184e-94e3-4ac1-b087-72f5605df944 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:14.813480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd184e-94e3-4ac1-b087-72f5605df944 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:14.813751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd184e-94e3-4ac1-b087-72f5605df944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:14.815451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3ffd184e-94e3-4ac1-b087-72f5605df944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:14.826623 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd184e-94e3-4ac1-b087-72f5605df944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:14.828104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd184e-94e3-4ac1-b087-72f5605df944 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:14.838485 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3927/7879] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:19:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:19:23.669026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3915509-b7d7-460d-8c5b-2ec9211dcdab None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:23.670424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b3915509-b7d7-460d-8c5b-2ec9211dcdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:23.744613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3915509-b7d7-460d-8c5b-2ec9211dcdab None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:23.749985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227ed85-632a-462a-afed-a27184d5e88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:23.750627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ed85-632a-462a-afed-a27184d5e88b service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:23.750910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ed85-632a-462a-afed-a27184d5e88b service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:23.751187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ed85-632a-462a-afed-a27184d5e88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:23.752955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c227ed85-632a-462a-afed-a27184d5e88b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:23.809632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227ed85-632a-462a-afed-a27184d5e88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:23.811213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227ed85-632a-462a-afed-a27184d5e88b service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:23.820716 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3953/7880] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:19:23 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:19:46.730021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd184e-94e3-4ac1-b087-72f5605df944 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:46.747419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd184e-94e3-4ac1-b087-72f5605df944 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:46.755029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cc5cf-5741-4a5b-80ee-4475caa8738a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:46.755769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cc5cf-5741-4a5b-80ee-4475caa8738a service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:46.756100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cc5cf-5741-4a5b-80ee-4475caa8738a service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:46.757452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cc5cf-5741-4a5b-80ee-4475caa8738a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:46.759645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7b7cc5cf-5741-4a5b-80ee-4475caa8738a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:46.835811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cc5cf-5741-4a5b-80ee-4475caa8738a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:46.837461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cc5cf-5741-4a5b-80ee-4475caa8738a service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:46.849110 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3928/7881] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:19:46 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:19:48.033229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227ed85-632a-462a-afed-a27184d5e88b service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:48.048103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227ed85-632a-462a-afed-a27184d5e88b service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:48.055788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494311-24ff-4b5f-8ea2-32f6f07f90e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:48.056175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494311-24ff-4b5f-8ea2-32f6f07f90e3 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:48.056521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494311-24ff-4b5f-8ea2-32f6f07f90e3 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:48.056861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494311-24ff-4b5f-8ea2-32f6f07f90e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:48.058915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7e494311-24ff-4b5f-8ea2-32f6f07f90e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:48.074070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e494311-24ff-4b5f-8ea2-32f6f07f90e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:48.075798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e494311-24ff-4b5f-8ea2-32f6f07f90e3 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:48.090492 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3954/7882] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:19:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:19:50.409751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cc5cf-5741-4a5b-80ee-4475caa8738a service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:50.411162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7b7cc5cf-5741-4a5b-80ee-4475caa8738a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:50.481793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cc5cf-5741-4a5b-80ee-4475caa8738a service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:50.486928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95821900-1589-41ba-8449-ce3cc9e8d240 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:50.487583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95821900-1589-41ba-8449-ce3cc9e8d240 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:50.487917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95821900-1589-41ba-8449-ce3cc9e8d240 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:50.488442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95821900-1589-41ba-8449-ce3cc9e8d240 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:50.490195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-95821900-1589-41ba-8449-ce3cc9e8d240 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:50.504644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95821900-1589-41ba-8449-ce3cc9e8d240 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:50.506223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95821900-1589-41ba-8449-ce3cc9e8d240 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:50.518583 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3929/7883] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:19:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:19:52.233363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494311-24ff-4b5f-8ea2-32f6f07f90e3 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:52.245641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494311-24ff-4b5f-8ea2-32f6f07f90e3 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:52.249703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651cd0b-1a42-4326-ad4c-16ebe35ee6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:52.250348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651cd0b-1a42-4326-ad4c-16ebe35ee6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:52.250632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651cd0b-1a42-4326-ad4c-16ebe35ee6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:52.250915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651cd0b-1a42-4326-ad4c-16ebe35ee6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:52.252710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4651cd0b-1a42-4326-ad4c-16ebe35ee6e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:52.265273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651cd0b-1a42-4326-ad4c-16ebe35ee6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:52.266709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651cd0b-1a42-4326-ad4c-16ebe35ee6e8 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:52.276968 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3955/7884] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:19:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:19:56.028007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95821900-1589-41ba-8449-ce3cc9e8d240 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:56.030682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-95821900-1589-41ba-8449-ce3cc9e8d240 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:56.060047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95821900-1589-41ba-8449-ce3cc9e8d240 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:56.069437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6941a09-5717-4833-b52b-2ad7a06dfa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:56.070404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6941a09-5717-4833-b52b-2ad7a06dfa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:56.070733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6941a09-5717-4833-b52b-2ad7a06dfa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:56.071154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6941a09-5717-4833-b52b-2ad7a06dfa89 admin admin] PATH_INFO: `/v3/users/b771da0354414b239da0cad505f8ffe6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:56.072857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6941a09-5717-4833-b52b-2ad7a06dfa89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b771da0354414b239da0cad505f8ffe6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:56.075070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6941a09-5717-4833-b52b-2ad7a06dfa89 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:56.135012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e6941a09-5717-4833-b52b-2ad7a06dfa89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b771da0354414b239da0cad505f8ffe6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:56.136894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e6941a09-5717-4833-b52b-2ad7a06dfa89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b771da0354414b239da0cad505f8ffe6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:56.146225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e6941a09-5717-4833-b52b-2ad7a06dfa89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b771da0354414b239da0cad505f8ffe6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:56.147719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e6941a09-5717-4833-b52b-2ad7a06dfa89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b771da0354414b239da0cad505f8ffe6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:56.158645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e6941a09-5717-4833-b52b-2ad7a06dfa89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b771da0354414b239da0cad505f8ffe6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:56.177738 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3930/7885] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:19:56 2021] DELETE /identity/v3/users/b771da0354414b239da0cad505f8ffe6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:19:56.452965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651cd0b-1a42-4326-ad4c-16ebe35ee6e8 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:56.463963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651cd0b-1a42-4326-ad4c-16ebe35ee6e8 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:56.529217 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:56.530139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:56.531404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:56.531717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] PATH_INFO: `/v3/projects/219be90852c0481aaad9862d1a485102` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:56.533002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] RBAC: Authorizing `identity:delete_project(project_id=219be90852c0481aaad9862d1a485102)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:56.534949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:56.581263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219be90852c0481aaad9862d1a485102', 'request_id': 'req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:56.588745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219be90852c0481aaad9862d1a485102', 'request_id': 'req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:56.595090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219be90852c0481aaad9862d1a485102', 'request_id': 'req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:56.605894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] The token cache is being invalidate because project 219be90852c0481aaad9862d1a485102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:19:56.606200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:56.606839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f5e2fc4c-045d-4c73-bf0d-fc2e88cfd06b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:56.612579 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3956/7886] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:19:56 2021] DELETE /identity/v3/projects/219be90852c0481aaad9862d1a485102 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:19:56.614575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d7994-947b-471a-ba35-6d728204af56 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:56.614945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d7994-947b-471a-ba35-6d728204af56 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:56.615804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d7994-947b-471a-ba35-6d728204af56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:56.634561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-771d7994-947b-471a-ba35-6d728204af56 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:56.635953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-771d7994-947b-471a-ba35-6d728204af56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:56.701855 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3931/7887] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:19:56.710410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cf752-c936-4fe2-99dd-85632b009ff5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:56.710704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cf752-c936-4fe2-99dd-85632b009ff5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:56.710997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cf752-c936-4fe2-99dd-85632b009ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:56.729131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-272cf752-c936-4fe2-99dd-85632b009ff5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:56.730329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-272cf752-c936-4fe2-99dd-85632b009ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:56.738835 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3957/7888] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:19:56.743072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d7994-947b-471a-ba35-6d728204af56 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:56.754058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d7994-947b-471a-ba35-6d728204af56 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:56.759589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ce7b5-e11b-42df-9c24-631cbd388aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:56.760250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ce7b5-e11b-42df-9c24-631cbd388aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:56.760536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ce7b5-e11b-42df-9c24-631cbd388aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:56.760813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ce7b5-e11b-42df-9c24-631cbd388aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:56.761550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ce7b5-e11b-42df-9c24-631cbd388aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:19:56.761857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ce7b5-e11b-42df-9c24-631cbd388aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:56.763491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ce7b5-e11b-42df-9c24-631cbd388aa8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:56.781423 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3932/7889] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:19:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:19:56.782858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cf752-c936-4fe2-99dd-85632b009ff5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:56.793585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cf752-c936-4fe2-99dd-85632b009ff5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:56.799113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086658cf-91dc-4316-bc8b-79f2166ec74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:56.799683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086658cf-91dc-4316-bc8b-79f2166ec74e admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:56.800019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086658cf-91dc-4316-bc8b-79f2166ec74e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:56.800302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086658cf-91dc-4316-bc8b-79f2166ec74e admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:56.801096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086658cf-91dc-4316-bc8b-79f2166ec74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:56.803645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086658cf-91dc-4316-bc8b-79f2166ec74e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:56.831378 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3958/7890] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:19:56 2021] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:19:56.835753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ce7b5-e11b-42df-9c24-631cbd388aa8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:56.846107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ce7b5-e11b-42df-9c24-631cbd388aa8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:56.904533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7162498-d3c7-4307-8df6-9fae9d6faa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:56.905509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162498-d3c7-4307-8df6-9fae9d6faa8d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:56.905736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162498-d3c7-4307-8df6-9fae9d6faa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:56.906379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7162498-d3c7-4307-8df6-9fae9d6faa8d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:56.907205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7162498-d3c7-4307-8df6-9fae9d6faa8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:56.909165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7162498-d3c7-4307-8df6-9fae9d6faa8d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:56.932297 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3933/7891] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:19:56 2021] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:19:56.934716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086658cf-91dc-4316-bc8b-79f2166ec74e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:56.945513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086658cf-91dc-4316-bc8b-79f2166ec74e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:56.950106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef9aba-d527-46cd-90fb-d6ec44c43a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:56.950758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef9aba-d527-46cd-90fb-d6ec44c43a48 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:56.951043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef9aba-d527-46cd-90fb-d6ec44c43a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:56.951368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef9aba-d527-46cd-90fb-d6ec44c43a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:56.952391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef9aba-d527-46cd-90fb-d6ec44c43a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:56.954299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef9aba-d527-46cd-90fb-d6ec44c43a48 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:56.966383 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3959/7892] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:19:56 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:19:56.970424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7162498-d3c7-4307-8df6-9fae9d6faa8d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:56.980675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7162498-d3c7-4307-8df6-9fae9d6faa8d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:56.986301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0c94f-1a0b-4a59-8284-e22dc672e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:56.986677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0c94f-1a0b-4a59-8284-e22dc672e7bd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:56.986938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0c94f-1a0b-4a59-8284-e22dc672e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:56.987243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0c94f-1a0b-4a59-8284-e22dc672e7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:56.988319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0c94f-1a0b-4a59-8284-e22dc672e7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:56.989946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0c94f-1a0b-4a59-8284-e22dc672e7bd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:57.002875 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3934/7893] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:19:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:19:57.007720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef9aba-d527-46cd-90fb-d6ec44c43a48 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:57.018082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef9aba-d527-46cd-90fb-d6ec44c43a48 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:57.027293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd00d1-d54b-4b66-8db8-b4193277b00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:57.028185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd00d1-d54b-4b66-8db8-b4193277b00d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:57.028473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd00d1-d54b-4b66-8db8-b4193277b00d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:57.028799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd00d1-d54b-4b66-8db8-b4193277b00d admin admin] PATH_INFO: `/v3/projects/027923027e4747d18a5fbb28baa3f9d7/users/621c578e6a9f4b0e82f7accfd2ef8aef/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:57.045645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd00d1-d54b-4b66-8db8-b4193277b00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=027923027e4747d18a5fbb28baa3f9d7, user_id=621c578e6a9f4b0e82f7accfd2ef8aef, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:57.048404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd00d1-d54b-4b66-8db8-b4193277b00d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:57.065325 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3960/7894] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:19:57 2021] PUT /identity/v3/projects/027923027e4747d18a5fbb28baa3f9d7/users/621c578e6a9f4b0e82f7accfd2ef8aef/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:19:57.076594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46915ac-5180-4248-b4cd-a1236b03ff27 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:57.079598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46915ac-5180-4248-b4cd-a1236b03ff27 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:57.080002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46915ac-5180-4248-b4cd-a1236b03ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:57.122641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f46915ac-5180-4248-b4cd-a1236b03ff27 None None] MFA Rules not processed for user `621c578e6a9f4b0e82f7accfd2ef8aef`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:57.124525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f46915ac-5180-4248-b4cd-a1236b03ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:57.197176 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3935/7895] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:57 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:19:57.210826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd00d1-d54b-4b66-8db8-b4193277b00d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:57.212854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7ebd00d1-d54b-4b66-8db8-b4193277b00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:57.293689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd00d1-d54b-4b66-8db8-b4193277b00d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:57.299583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24429c45-54f7-4b80-b7f7-9d51c2cdacd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:57.300262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429c45-54f7-4b80-b7f7-9d51c2cdacd2 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:57.300572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429c45-54f7-4b80-b7f7-9d51c2cdacd2 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:57.300903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24429c45-54f7-4b80-b7f7-9d51c2cdacd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:57.310130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24429c45-54f7-4b80-b7f7-9d51c2cdacd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:57.311763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24429c45-54f7-4b80-b7f7-9d51c2cdacd2 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:57.320846 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3961/7896] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:19:57 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:19:57.503351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46915ac-5180-4248-b4cd-a1236b03ff27 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:57.565649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46915ac-5180-4248-b4cd-a1236b03ff27 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:57.571414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:57.572300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:57.572578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:57.572846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] PATH_INFO: `/v3/users/621c578e6a9f4b0e82f7accfd2ef8aef` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:57.574066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621c578e6a9f4b0e82f7accfd2ef8aef)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:57.576039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:57.624411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621c578e6a9f4b0e82f7accfd2ef8aef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:57.625144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621c578e6a9f4b0e82f7accfd2ef8aef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:57.632398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621c578e6a9f4b0e82f7accfd2ef8aef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:57.633286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621c578e6a9f4b0e82f7accfd2ef8aef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:57.640247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621c578e6a9f4b0e82f7accfd2ef8aef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:57.657640 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3936/7897] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:19:57 2021] DELETE /identity/v3/users/621c578e6a9f4b0e82f7accfd2ef8aef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:19:57.663063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ab09-51aa-4c32-8c0c-1c4144deafc8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:57.663625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ab09-51aa-4c32-8c0c-1c4144deafc8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:57.663625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ab09-51aa-4c32-8c0c-1c4144deafc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:57.681001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3503ab09-51aa-4c32-8c0c-1c4144deafc8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:57.682200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3503ab09-51aa-4c32-8c0c-1c4144deafc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:57.741235 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3962/7898] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:19:57.751141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:57.752616 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:57.811634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fabab3-7f90-48f1-9791-f9be5995eea2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:57.815002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df122a35-4aa3-431d-a356-95bf6c73c581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:57.815684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122a35-4aa3-431d-a356-95bf6c73c581 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:57.815973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122a35-4aa3-431d-a356-95bf6c73c581 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:57.816255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122a35-4aa3-431d-a356-95bf6c73c581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:57.826145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df122a35-4aa3-431d-a356-95bf6c73c581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:57.827640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df122a35-4aa3-431d-a356-95bf6c73c581 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:57.837923 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3937/7899] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:19:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:19:58.152156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503ab09-51aa-4c32-8c0c-1c4144deafc8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:58.153285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3503ab09-51aa-4c32-8c0c-1c4144deafc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:58.167750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503ab09-51aa-4c32-8c0c-1c4144deafc8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:58.173221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:58.174428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:58.174778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:58.175129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] PATH_INFO: `/v3/projects/027923027e4747d18a5fbb28baa3f9d7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:58.176501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027923027e4747d18a5fbb28baa3f9d7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:58.178542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:58.227357 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027923027e4747d18a5fbb28baa3f9d7', 'request_id': 'req-7f4b13d2-a151-46f7-8773-f02292ae8b53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:58.234664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027923027e4747d18a5fbb28baa3f9d7', 'request_id': 'req-7f4b13d2-a151-46f7-8773-f02292ae8b53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:58.241441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027923027e4747d18a5fbb28baa3f9d7', 'request_id': 'req-7f4b13d2-a151-46f7-8773-f02292ae8b53'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:58.251745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] The token cache is being invalidate because project 027923027e4747d18a5fbb28baa3f9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:19:58.252039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:58.252690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7f4b13d2-a151-46f7-8773-f02292ae8b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:19:58.254447 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3963/7900] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:19:58 2021] DELETE /identity/v3/projects/027923027e4747d18a5fbb28baa3f9d7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:19:58.263631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddb160-6dfa-429b-ac2d-ad153f141678 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:58.264137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddb160-6dfa-429b-ac2d-ad153f141678 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:58.264244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddb160-6dfa-429b-ac2d-ad153f141678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:58.283524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-49ddb160-6dfa-429b-ac2d-ad153f141678 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:58.284973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49ddb160-6dfa-429b-ac2d-ad153f141678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:58.348194 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3938/7901] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:19:58.356319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2e6a5-cee8-4ac8-a9c1-c1f45b8d7625 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:58.356611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2e6a5-cee8-4ac8-a9c1-c1f45b8d7625 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:58.356890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2e6a5-cee8-4ac8-a9c1-c1f45b8d7625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:58.376273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-27d2e6a5-cee8-4ac8-a9c1-c1f45b8d7625 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:58.377403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-27d2e6a5-cee8-4ac8-a9c1-c1f45b8d7625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:58.386030 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3964/7902] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:19:58.390241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddb160-6dfa-429b-ac2d-ad153f141678 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:58.399835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddb160-6dfa-429b-ac2d-ad153f141678 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:58.404672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88934e-7606-45c7-b59a-44ca1bc4b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:58.405331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88934e-7606-45c7-b59a-44ca1bc4b328 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:58.405608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88934e-7606-45c7-b59a-44ca1bc4b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:58.405874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88934e-7606-45c7-b59a-44ca1bc4b328 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:58.406609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88934e-7606-45c7-b59a-44ca1bc4b328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:19:58.406914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88934e-7606-45c7-b59a-44ca1bc4b328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:58.408596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88934e-7606-45c7-b59a-44ca1bc4b328 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:58.421245 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3939/7903] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:19:58.426100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2e6a5-cee8-4ac8-a9c1-c1f45b8d7625 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:58.436076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2e6a5-cee8-4ac8-a9c1-c1f45b8d7625 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:58.447862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360adcba-1721-4d1a-bd25-abad97e219ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:58.448691 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360adcba-1721-4d1a-bd25-abad97e219ce admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:58.449011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360adcba-1721-4d1a-bd25-abad97e219ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:58.449700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360adcba-1721-4d1a-bd25-abad97e219ce admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:58.452244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360adcba-1721-4d1a-bd25-abad97e219ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:58.454396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360adcba-1721-4d1a-bd25-abad97e219ce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:58.481294 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3965/7904] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:19:58 2021] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:19:58.485455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88934e-7606-45c7-b59a-44ca1bc4b328 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:58.496210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88934e-7606-45c7-b59a-44ca1bc4b328 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:58.554985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723380c-da51-42c9-a809-ebb476be8da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:58.555687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723380c-da51-42c9-a809-ebb476be8da6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:58.555972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723380c-da51-42c9-a809-ebb476be8da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:58.556249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723380c-da51-42c9-a809-ebb476be8da6 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:58.556960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723380c-da51-42c9-a809-ebb476be8da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:58.558905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723380c-da51-42c9-a809-ebb476be8da6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:58.582143 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3940/7905] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:19:58 2021] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:19:58.583359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360adcba-1721-4d1a-bd25-abad97e219ce admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:58.593707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360adcba-1721-4d1a-bd25-abad97e219ce admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:58.598312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9af0d6-07d2-405b-8b6e-d25fb13a69d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:58.599065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9af0d6-07d2-405b-8b6e-d25fb13a69d1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:58.599381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9af0d6-07d2-405b-8b6e-d25fb13a69d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:58.599659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9af0d6-07d2-405b-8b6e-d25fb13a69d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:58.600417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9af0d6-07d2-405b-8b6e-d25fb13a69d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:58.602163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9af0d6-07d2-405b-8b6e-d25fb13a69d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:58.616796 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3966/7906] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:19:58 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:19:58.619234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723380c-da51-42c9-a809-ebb476be8da6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:58.630084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723380c-da51-42c9-a809-ebb476be8da6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:58.635492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d0849-4d2b-489e-99d7-b65e45efb6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:58.636151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d0849-4d2b-489e-99d7-b65e45efb6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:58.636432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d0849-4d2b-489e-99d7-b65e45efb6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:58.636708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d0849-4d2b-489e-99d7-b65e45efb6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:58.637439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d0849-4d2b-489e-99d7-b65e45efb6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:58.639070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d0849-4d2b-489e-99d7-b65e45efb6c2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:58.652643 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3941/7907] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:19:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:19:58.654743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9af0d6-07d2-405b-8b6e-d25fb13a69d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:58.667698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9af0d6-07d2-405b-8b6e-d25fb13a69d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:58.673124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c71b99-6a3c-4426-81d4-d9449c0d2a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:58.674346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c71b99-6a3c-4426-81d4-d9449c0d2a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:58.674424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c71b99-6a3c-4426-81d4-d9449c0d2a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:58.674671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c71b99-6a3c-4426-81d4-d9449c0d2a97 admin admin] PATH_INFO: `/v3/projects/de31559dcbb04501a2f65b7114b86bf7/users/60deb773a81b4d6d9117da3a4ba19ef1/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:58.701766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c71b99-6a3c-4426-81d4-d9449c0d2a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de31559dcbb04501a2f65b7114b86bf7, user_id=60deb773a81b4d6d9117da3a4ba19ef1, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:58.704600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c71b99-6a3c-4426-81d4-d9449c0d2a97 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:58.721877 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3967/7908] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:19:58 2021] PUT /identity/v3/projects/de31559dcbb04501a2f65b7114b86bf7/users/60deb773a81b4d6d9117da3a4ba19ef1/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:19:58.791399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364b712-f169-4c08-933a-1754a89b1216 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:58.793161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364b712-f169-4c08-933a-1754a89b1216 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:58.793161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364b712-f169-4c08-933a-1754a89b1216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:58.819599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6364b712-f169-4c08-933a-1754a89b1216 None None] MFA Rules not processed for user `60deb773a81b4d6d9117da3a4ba19ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:58.820814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6364b712-f169-4c08-933a-1754a89b1216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:58.889812 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3942/7909] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:58 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:19:58.890353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c71b99-6a3c-4426-81d4-d9449c0d2a97 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:58.959897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c71b99-6a3c-4426-81d4-d9449c0d2a97 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:58.965449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3803c0-3f5b-4fc0-b03c-09a88c95a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:58.966115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3803c0-3f5b-4fc0-b03c-09a88c95a1ce admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:58.966424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3803c0-3f5b-4fc0-b03c-09a88c95a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:58.966703 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3803c0-3f5b-4fc0-b03c-09a88c95a1ce admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:58.967443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3803c0-3f5b-4fc0-b03c-09a88c95a1ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:58.969347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3803c0-3f5b-4fc0-b03c-09a88c95a1ce admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:59.004853 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3968/7910] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:19:58 2021] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:19:59.006141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364b712-f169-4c08-933a-1754a89b1216 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:59.019973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364b712-f169-4c08-933a-1754a89b1216 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:59.077784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f6cee-087e-447b-a0c2-3226dd1de88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:59.078462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6cee-087e-447b-a0c2-3226dd1de88d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:59.078745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6cee-087e-447b-a0c2-3226dd1de88d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:59.079020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6cee-087e-447b-a0c2-3226dd1de88d admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:59.079757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f6cee-087e-447b-a0c2-3226dd1de88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:59.081928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f6cee-087e-447b-a0c2-3226dd1de88d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:59.105683 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3943/7911] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:19:59 2021] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:19:59.109669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3803c0-3f5b-4fc0-b03c-09a88c95a1ce admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:59.123365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3803c0-3f5b-4fc0-b03c-09a88c95a1ce admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:59.138910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d78bdd-4b09-403c-b0f7-c80ac951811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:59.139861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d78bdd-4b09-403c-b0f7-c80ac951811a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:59.139976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d78bdd-4b09-403c-b0f7-c80ac951811a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:59.140171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d78bdd-4b09-403c-b0f7-c80ac951811a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:59.140911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d78bdd-4b09-403c-b0f7-c80ac951811a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:59.142528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d78bdd-4b09-403c-b0f7-c80ac951811a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:59.155076 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3969/7912] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:19:59 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:19:59.164153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f6cee-087e-447b-a0c2-3226dd1de88d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:59.178410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f6cee-087e-447b-a0c2-3226dd1de88d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:59.183932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc702e-0da6-4491-821c-e4fccebdc021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:59.184833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc702e-0da6-4491-821c-e4fccebdc021 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:59.185120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc702e-0da6-4491-821c-e4fccebdc021 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:59.185400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc702e-0da6-4491-821c-e4fccebdc021 admin admin] PATH_INFO: `/v3/projects/412dad68bf7644518589e62f05ef34ca/users/9a0869dc47964e42a528a0ba192382b1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:59.202522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc702e-0da6-4491-821c-e4fccebdc021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412dad68bf7644518589e62f05ef34ca, user_id=9a0869dc47964e42a528a0ba192382b1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:59.205330 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc702e-0da6-4491-821c-e4fccebdc021 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:59.226019 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3944/7913] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:19:59 2021] PUT /identity/v3/projects/412dad68bf7644518589e62f05ef34ca/users/9a0869dc47964e42a528a0ba192382b1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:19:59.227624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d78bdd-4b09-403c-b0f7-c80ac951811a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:59.238394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d78bdd-4b09-403c-b0f7-c80ac951811a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:59.306045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e977c69-6713-449a-81ab-e7055aece08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:59.306837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977c69-6713-449a-81ab-e7055aece08b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:59.307185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977c69-6713-449a-81ab-e7055aece08b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:59.307673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e977c69-6713-449a-81ab-e7055aece08b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:59.308628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e977c69-6713-449a-81ab-e7055aece08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:59.311103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e977c69-6713-449a-81ab-e7055aece08b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:59.331956 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3970/7914] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:19:59 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:19:59.334984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc702e-0da6-4491-821c-e4fccebdc021 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:59.348665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc702e-0da6-4491-821c-e4fccebdc021 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:59.357624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292483a1-9b33-4cc6-9864-83fb1d304c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:59.358530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292483a1-9b33-4cc6-9864-83fb1d304c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:59.358816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292483a1-9b33-4cc6-9864-83fb1d304c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:59.359094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292483a1-9b33-4cc6-9864-83fb1d304c7b admin admin] PATH_INFO: `/v3/projects/412dad68bf7644518589e62f05ef34ca/users/9a0869dc47964e42a528a0ba192382b1/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:59.361688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292483a1-9b33-4cc6-9864-83fb1d304c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=412dad68bf7644518589e62f05ef34ca, user_id=9a0869dc47964e42a528a0ba192382b1, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:59.365219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292483a1-9b33-4cc6-9864-83fb1d304c7b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:59.379793 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3945/7915] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:19:59 2021] PUT /identity/v3/projects/412dad68bf7644518589e62f05ef34ca/users/9a0869dc47964e42a528a0ba192382b1/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:19:59.389965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d073e-e1e7-449a-b027-aba8e5658b1c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:59.390460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d073e-e1e7-449a-b027-aba8e5658b1c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:59.390847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d073e-e1e7-449a-b027-aba8e5658b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:59.437221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-166d073e-e1e7-449a-b027-aba8e5658b1c None None] MFA Rules not processed for user `9a0869dc47964e42a528a0ba192382b1`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:19:59.439226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-166d073e-e1e7-449a-b027-aba8e5658b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:19:59.532901 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3971/7916] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:19:59 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:19:59.538297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292483a1-9b33-4cc6-9864-83fb1d304c7b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:59.553113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292483a1-9b33-4cc6-9864-83fb1d304c7b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:59.559648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb4f3-c1be-415a-b0f7-c0a39bcca995 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a0869dc47964e42a528a0ba192382b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412dad68bf7644518589e62f05ef34ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:59.560994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb4f3-c1be-415a-b0f7-c0a39bcca995 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:59.561624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb4f3-c1be-415a-b0f7-c0a39bcca995 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:59.562516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdb4f3-c1be-415a-b0f7-c0a39bcca995 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:59.563870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdb4f3-c1be-415a-b0f7-c0a39bcca995 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:59.566733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdb4f3-c1be-415a-b0f7-c0a39bcca995 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:59.644534 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3946/7917] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:19:59 2021] POST /identity/v3/projects => generated 360 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:19:59.644673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d073e-e1e7-449a-b027-aba8e5658b1c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:59.661545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d073e-e1e7-449a-b027-aba8e5658b1c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:59.801113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c68df-6aca-40ff-a16b-a3e79c5ee532 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a0869dc47964e42a528a0ba192382b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412dad68bf7644518589e62f05ef34ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:59.803695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c68df-6aca-40ff-a16b-a3e79c5ee532 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:59.804876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c68df-6aca-40ff-a16b-a3e79c5ee532 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:59.805359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c68df-6aca-40ff-a16b-a3e79c5ee532 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] PATH_INFO: `/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags/tempest-tag-1935520703` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:59.807678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c68df-6aca-40ff-a16b-a3e79c5ee532 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=8aa651ddd6dd49e4a495022438f1abf7, value=tempest-tag-1935520703)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:59.811016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c68df-6aca-40ff-a16b-a3e79c5ee532 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:59.887281 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-fd8c68df-6aca-40ff-a16b-a3e79c5ee532 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1935520703. To ensure interoperability, identifiers should be a valid uuid. Nov 27 21:19:59.887281 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 27 21:19:59.887281 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:19:59.894729 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3972/7918] 10.222.0.21 () {60 vars in 1332 bytes} [Sat Nov 27 21:19:59 2021] PUT /identity/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags/tempest-tag-1935520703 => generated 0 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 291 bytes (2 switches on core 0) Nov 27 21:19:59.899129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb4f3-c1be-415a-b0f7-c0a39bcca995 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:59.911978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdb4f3-c1be-415a-b0f7-c0a39bcca995 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:59.918910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5ba88-7ee8-4d32-97d9-274165f96e62 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a0869dc47964e42a528a0ba192382b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412dad68bf7644518589e62f05ef34ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:59.920691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5ba88-7ee8-4d32-97d9-274165f96e62 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:59.921246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5ba88-7ee8-4d32-97d9-274165f96e62 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:59.921829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5ba88-7ee8-4d32-97d9-274165f96e62 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] PATH_INFO: `/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags/tempest-tag-1935520703` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:59.938211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5ba88-7ee8-4d32-97d9-274165f96e62 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=8aa651ddd6dd49e4a495022438f1abf7, value=tempest-tag-1935520703)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:59.940998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5ba88-7ee8-4d32-97d9-274165f96e62 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:19:59.956172 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3947/7919] 10.222.0.21 () {58 vars in 1313 bytes} [Sat Nov 27 21:19:59 2021] GET /identity/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags/tempest-tag-1935520703 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:19:59.962276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c68df-6aca-40ff-a16b-a3e79c5ee532 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:19:59.979123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c68df-6aca-40ff-a16b-a3e79c5ee532 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:19:59.985151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba7a6f-80dd-409e-a00a-82334cef1ff7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a0869dc47964e42a528a0ba192382b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412dad68bf7644518589e62f05ef34ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:19:59.986679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7a6f-80dd-409e-a00a-82334cef1ff7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:19:59.988325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7a6f-80dd-409e-a00a-82334cef1ff7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:19:59.988779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7a6f-80dd-409e-a00a-82334cef1ff7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] PATH_INFO: `/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:19:59.994911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba7a6f-80dd-409e-a00a-82334cef1ff7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=8aa651ddd6dd49e4a495022438f1abf7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:19:59.997393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba7a6f-80dd-409e-a00a-82334cef1ff7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:00.080751 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3973/7920] 10.222.0.21 () {60 vars in 1264 bytes} [Sat Nov 27 21:19:59 2021] PUT /identity/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags => generated 140 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:00.083810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5ba88-7ee8-4d32-97d9-274165f96e62 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:00.100325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5ba88-7ee8-4d32-97d9-274165f96e62 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:00.120999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3559-c475-48eb-a3f8-17c8686a12e7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a0869dc47964e42a528a0ba192382b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412dad68bf7644518589e62f05ef34ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:00.122129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3559-c475-48eb-a3f8-17c8686a12e7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:00.122255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3559-c475-48eb-a3f8-17c8686a12e7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:00.122506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3559-c475-48eb-a3f8-17c8686a12e7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] PATH_INFO: `/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:00.148422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c3559-c475-48eb-a3f8-17c8686a12e7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=8aa651ddd6dd49e4a495022438f1abf7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:00.150643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c3559-c475-48eb-a3f8-17c8686a12e7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:00.207973 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3948/7921] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:20:00 2021] GET /identity/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags => generated 140 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:00.209772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba7a6f-80dd-409e-a00a-82334cef1ff7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:00.228362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba7a6f-80dd-409e-a00a-82334cef1ff7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:00.244327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4b9f-3ab8-4b02-ad41-ba9208f2333c tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a0869dc47964e42a528a0ba192382b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412dad68bf7644518589e62f05ef34ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:00.244975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4b9f-3ab8-4b02-ad41-ba9208f2333c tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:00.246116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4b9f-3ab8-4b02-ad41-ba9208f2333c tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:00.247718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4b9f-3ab8-4b02-ad41-ba9208f2333c tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] PATH_INFO: `/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags/tempest-tag-204835242` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:00.251435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c4b9f-3ab8-4b02-ad41-ba9208f2333c tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=8aa651ddd6dd49e4a495022438f1abf7, value=tempest-tag-204835242)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:00.264853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c4b9f-3ab8-4b02-ad41-ba9208f2333c tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:00.343110 ncdv-master-1 devstack@keystone.service[90123]: WARNING py.warnings [None req-523c4b9f-3ab8-4b02-ad41-ba9208f2333c tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-204835242. To ensure interoperability, identifiers should be a valid uuid. Nov 27 21:20:00.343110 ncdv-master-1 devstack@keystone.service[90123]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 27 21:20:00.343110 ncdv-master-1 devstack@keystone.service[90123]: Nov 27 21:20:00.355230 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3974/7922] 10.222.0.21 () {58 vars in 1313 bytes} [Sat Nov 27 21:20:00 2021] DELETE /identity/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags/tempest-tag-204835242 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:00.356782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3559-c475-48eb-a3f8-17c8686a12e7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:00.371929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c3559-c475-48eb-a3f8-17c8686a12e7 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:00.380432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca471645-ef83-4515-ac60-c9e0ef5da7e4 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a0869dc47964e42a528a0ba192382b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412dad68bf7644518589e62f05ef34ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:00.381681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471645-ef83-4515-ac60-c9e0ef5da7e4 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:00.382315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471645-ef83-4515-ac60-c9e0ef5da7e4 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:00.382657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471645-ef83-4515-ac60-c9e0ef5da7e4 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] PATH_INFO: `/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags/tempest-tag-204835242` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:00.397474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca471645-ef83-4515-ac60-c9e0ef5da7e4 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=8aa651ddd6dd49e4a495022438f1abf7, value=tempest-tag-204835242)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:00.400716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca471645-ef83-4515-ac60-c9e0ef5da7e4 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:00.432766 ncdv-master-1 devstack@keystone.service[90122]: WARNING keystone.server.flask.application [None req-ca471645-ef83-4515-ac60-c9e0ef5da7e4 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Could not find project tag: tempest-tag-204835242.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-204835242. Nov 27 21:20:00.435303 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3949/7923] 10.222.0.21 () {58 vars in 1310 bytes} [Sat Nov 27 21:20:00 2021] GET /identity/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags/tempest-tag-204835242 => generated 106 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:20:00.438297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4b9f-3ab8-4b02-ad41-ba9208f2333c tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:00.452878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4b9f-3ab8-4b02-ad41-ba9208f2333c tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:00.464962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d04a7c-e647-41e3-9a88-11790eb9d147 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a0869dc47964e42a528a0ba192382b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412dad68bf7644518589e62f05ef34ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:00.465964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d04a7c-e647-41e3-9a88-11790eb9d147 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:00.466330 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d04a7c-e647-41e3-9a88-11790eb9d147 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:00.466692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d04a7c-e647-41e3-9a88-11790eb9d147 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] PATH_INFO: `/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:00.468055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d04a7c-e647-41e3-9a88-11790eb9d147 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=8aa651ddd6dd49e4a495022438f1abf7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:00.470448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d04a7c-e647-41e3-9a88-11790eb9d147 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:00.536180 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3975/7924] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:20:00 2021] DELETE /identity/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:00.538848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca471645-ef83-4515-ac60-c9e0ef5da7e4 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:00.549417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca471645-ef83-4515-ac60-c9e0ef5da7e4 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:00.554888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fee78e-e207-46d0-af69-889d4d6ea4e3 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a0869dc47964e42a528a0ba192382b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412dad68bf7644518589e62f05ef34ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:00.556427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee78e-e207-46d0-af69-889d4d6ea4e3 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:00.556727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee78e-e207-46d0-af69-889d4d6ea4e3 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:00.557324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee78e-e207-46d0-af69-889d4d6ea4e3 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] PATH_INFO: `/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:00.576160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fee78e-e207-46d0-af69-889d4d6ea4e3 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=8aa651ddd6dd49e4a495022438f1abf7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:00.578283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fee78e-e207-46d0-af69-889d4d6ea4e3 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:00.626934 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3950/7925] 10.222.0.21 () {58 vars in 1244 bytes} [Sat Nov 27 21:20:00 2021] GET /identity/v3/projects/8aa651ddd6dd49e4a495022438f1abf7/tags => generated 66 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 27 21:20:00.628643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d04a7c-e647-41e3-9a88-11790eb9d147 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:00.639469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d04a7c-e647-41e3-9a88-11790eb9d147 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:00.647388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a0869dc47964e42a528a0ba192382b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '412dad68bf7644518589e62f05ef34ca', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:00.648290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:00.648554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:00.650954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] PATH_INFO: `/v3/projects/8aa651ddd6dd49e4a495022438f1abf7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:00.652484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8aa651ddd6dd49e4a495022438f1abf7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:00.654434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:00.751485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa651ddd6dd49e4a495022438f1abf7', 'request_id': 'req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:00.762412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa651ddd6dd49e4a495022438f1abf7', 'request_id': 'req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:00.781689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa651ddd6dd49e4a495022438f1abf7', 'request_id': 'req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:00.796278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] The token cache is being invalidate because project 8aa651ddd6dd49e4a495022438f1abf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:00.796761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:00.797566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-50cb2b52-2381-46e7-b16f-8b1a3f8bfe8f tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:00.799548 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3976/7926] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:00 2021] DELETE /identity/v3/projects/8aa651ddd6dd49e4a495022438f1abf7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:00.805104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fee78e-e207-46d0-af69-889d4d6ea4e3 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:00.807355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-86fee78e-e207-46d0-af69-889d4d6ea4e3 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:00.940221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fee78e-e207-46d0-af69-889d4d6ea4e3 tempest-IdentityV3ProjectTagsTest-363451622 tempest-IdentityV3ProjectTagsTest-363451622-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:01.065152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:01.066806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:01.067339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:01.068225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] PATH_INFO: `/v3/users/60deb773a81b4d6d9117da3a4ba19ef1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:01.069186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60deb773a81b4d6d9117da3a4ba19ef1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:01.072303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:01.162003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60deb773a81b4d6d9117da3a4ba19ef1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:01.163622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60deb773a81b4d6d9117da3a4ba19ef1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:01.178568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60deb773a81b4d6d9117da3a4ba19ef1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:01.181786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60deb773a81b4d6d9117da3a4ba19ef1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:01.201928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60deb773a81b4d6d9117da3a4ba19ef1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:01.230541 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3951/7927] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:00 2021] DELETE /identity/v3/users/60deb773a81b4d6d9117da3a4ba19ef1 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:01.235306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6896b-792d-4c36-a2a4-8c8fcc820e89 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:01.235306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6896b-792d-4c36-a2a4-8c8fcc820e89 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:01.235976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6896b-792d-4c36-a2a4-8c8fcc820e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:01.259730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-44d6896b-792d-4c36-a2a4-8c8fcc820e89 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:01.261654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-44d6896b-792d-4c36-a2a4-8c8fcc820e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:01.348093 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3977/7928] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:01.359608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:01.361887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:01.456544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd4f35-f9fe-446a-b0c0-c3cd9cf1aea8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:01.465166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6645f-89ce-4a59-beb4-24fbdee35d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:01.465857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6645f-89ce-4a59-beb4-24fbdee35d77 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:01.466145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6645f-89ce-4a59-beb4-24fbdee35d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:01.466431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6645f-89ce-4a59-beb4-24fbdee35d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:01.478678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6645f-89ce-4a59-beb4-24fbdee35d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:01.480229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6645f-89ce-4a59-beb4-24fbdee35d77 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:01.493125 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3952/7929] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:01.874386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6896b-792d-4c36-a2a4-8c8fcc820e89 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:01.876085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-44d6896b-792d-4c36-a2a4-8c8fcc820e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:01.894098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6896b-792d-4c36-a2a4-8c8fcc820e89 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:01.900219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:01.901235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:01.901588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:01.901934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] PATH_INFO: `/v3/projects/de31559dcbb04501a2f65b7114b86bf7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:01.903285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=de31559dcbb04501a2f65b7114b86bf7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:01.905393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:01.966999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de31559dcbb04501a2f65b7114b86bf7', 'request_id': 'req-c2c177eb-af92-4784-89ac-8ea816e90a8c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:01.975574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de31559dcbb04501a2f65b7114b86bf7', 'request_id': 'req-c2c177eb-af92-4784-89ac-8ea816e90a8c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:01.983091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de31559dcbb04501a2f65b7114b86bf7', 'request_id': 'req-c2c177eb-af92-4784-89ac-8ea816e90a8c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:01.997290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] The token cache is being invalidate because project de31559dcbb04501a2f65b7114b86bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:01.997290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:01.997833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c2c177eb-af92-4784-89ac-8ea816e90a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:01.999866 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3978/7930] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:01 2021] DELETE /identity/v3/projects/de31559dcbb04501a2f65b7114b86bf7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:02.003765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6645f-89ce-4a59-beb4-24fbdee35d77 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:02.014624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6645f-89ce-4a59-beb4-24fbdee35d77 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:02.081654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:02.082675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:02.083060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:02.083437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] PATH_INFO: `/v3/users/9a0869dc47964e42a528a0ba192382b1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:02.084849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0869dc47964e42a528a0ba192382b1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:02.086931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:02.154518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0869dc47964e42a528a0ba192382b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:02.155214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0869dc47964e42a528a0ba192382b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:02.166747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0869dc47964e42a528a0ba192382b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:02.167756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0869dc47964e42a528a0ba192382b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:02.176870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0869dc47964e42a528a0ba192382b1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:02.200606 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3953/7931] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:02 2021] DELETE /identity/v3/users/9a0869dc47964e42a528a0ba192382b1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:02.651898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ee38a-47f6-490b-8cda-c4184e73f3b6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:02.652717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ee38a-47f6-490b-8cda-c4184e73f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:02.653155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ee38a-47f6-490b-8cda-c4184e73f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:02.679464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-655ee38a-47f6-490b-8cda-c4184e73f3b6 None None] MFA Rules not processed for user `98c4fe50315d4fc0b0329e80802eee86`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:02.683160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-655ee38a-47f6-490b-8cda-c4184e73f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:02.684370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:02.689911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:02.784130 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3979/7932] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:02 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:02.801510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ff4b8-ae95-41e5-afc9-a5c1cce92a30 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:02.808432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:02.809305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:02.809760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:02.810190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] PATH_INFO: `/v3/projects/412dad68bf7644518589e62f05ef34ca` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:02.811706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] RBAC: Authorizing `identity:delete_project(project_id=412dad68bf7644518589e62f05ef34ca)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:02.814435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:02.896207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412dad68bf7644518589e62f05ef34ca', 'request_id': 'req-a5bddd7c-d968-415c-a904-174bbc4c517e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:02.906422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412dad68bf7644518589e62f05ef34ca', 'request_id': 'req-a5bddd7c-d968-415c-a904-174bbc4c517e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:02.922547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412dad68bf7644518589e62f05ef34ca', 'request_id': 'req-a5bddd7c-d968-415c-a904-174bbc4c517e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:02.949223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] The token cache is being invalidate because project 412dad68bf7644518589e62f05ef34ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:02.950520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:02.951498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a5bddd7c-d968-415c-a904-174bbc4c517e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:02.954503 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3954/7933] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:02 2021] DELETE /identity/v3/projects/412dad68bf7644518589e62f05ef34ca => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:02.962744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f83b9-6651-4368-a5ae-0f7372a8dcae None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:02.963070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f83b9-6651-4368-a5ae-0f7372a8dcae None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:02.963338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f83b9-6651-4368-a5ae-0f7372a8dcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:02.996228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4f3f83b9-6651-4368-a5ae-0f7372a8dcae None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:02.997684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4f3f83b9-6651-4368-a5ae-0f7372a8dcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:03.071349 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3980/7934] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:03.078122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6ab4f-76fe-4073-b660-f5406b9f498c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.078416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6ab4f-76fe-4073-b660-f5406b9f498c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.078722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6ab4f-76fe-4073-b660-f5406b9f498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.106524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-49a6ab4f-76fe-4073-b660-f5406b9f498c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:03.107784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49a6ab4f-76fe-4073-b660-f5406b9f498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:03.118823 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3955/7935] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:03.122878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f83b9-6651-4368-a5ae-0f7372a8dcae None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:03.133315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f83b9-6651-4368-a5ae-0f7372a8dcae None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:03.138814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66894db8-d36e-48d3-b703-b23fa0cd35bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:03.140001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66894db8-d36e-48d3-b703-b23fa0cd35bb admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.140455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66894db8-d36e-48d3-b703-b23fa0cd35bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.140751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66894db8-d36e-48d3-b703-b23fa0cd35bb admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.143898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66894db8-d36e-48d3-b703-b23fa0cd35bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:03.144165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66894db8-d36e-48d3-b703-b23fa0cd35bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:03.145785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66894db8-d36e-48d3-b703-b23fa0cd35bb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:03.159460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6ab4f-76fe-4073-b660-f5406b9f498c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:03.163296 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3981/7936] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:03.163462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49a6ab4f-76fe-4073-b660-f5406b9f498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:03.165826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66894db8-d36e-48d3-b703-b23fa0cd35bb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:03.179068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66894db8-d36e-48d3-b703-b23fa0cd35bb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:03.185984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d3561-c3bd-4e7c-b22a-c3f0fe7f8462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:03.186673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d3561-c3bd-4e7c-b22a-c3f0fe7f8462 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.186970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d3561-c3bd-4e7c-b22a-c3f0fe7f8462 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.187276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d3561-c3bd-4e7c-b22a-c3f0fe7f8462 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.188008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d3561-c3bd-4e7c-b22a-c3f0fe7f8462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:03.190607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d3561-c3bd-4e7c-b22a-c3f0fe7f8462 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:03.223409 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3982/7937] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:03 2021] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:03.227449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d3561-c3bd-4e7c-b22a-c3f0fe7f8462 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:03.229609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6ab4f-76fe-4073-b660-f5406b9f498c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:03.284336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2900e0-a521-46c8-9024-c1515c601805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:03.284991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2900e0-a521-46c8-9024-c1515c601805 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.285270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2900e0-a521-46c8-9024-c1515c601805 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.285722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2900e0-a521-46c8-9024-c1515c601805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.287499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7c2900e0-a521-46c8-9024-c1515c601805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:03.297941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d3561-c3bd-4e7c-b22a-c3f0fe7f8462 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:03.304552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2900e0-a521-46c8-9024-c1515c601805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:03.304812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ed4f8-1012-45fe-bbd6-eb3e2aa4db30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:03.305605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed4f8-1012-45fe-bbd6-eb3e2aa4db30 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.305873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed4f8-1012-45fe-bbd6-eb3e2aa4db30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.306239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed4f8-1012-45fe-bbd6-eb3e2aa4db30 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.306699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2900e0-a521-46c8-9024-c1515c601805 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:03.306993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ed4f8-1012-45fe-bbd6-eb3e2aa4db30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:03.308964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ed4f8-1012-45fe-bbd6-eb3e2aa4db30 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:03.331455 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3956/7938] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:20:03.340549 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3983/7939] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:03 2021] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:03.343142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2900e0-a521-46c8-9024-c1515c601805 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:03.356381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2900e0-a521-46c8-9024-c1515c601805 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:03.362471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a265e07-69b9-4a0e-b3ab-b397eb04b973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:03.363578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a265e07-69b9-4a0e-b3ab-b397eb04b973 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.364015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a265e07-69b9-4a0e-b3ab-b397eb04b973 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.364465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a265e07-69b9-4a0e-b3ab-b397eb04b973 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.365247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a265e07-69b9-4a0e-b3ab-b397eb04b973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:03.367114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a265e07-69b9-4a0e-b3ab-b397eb04b973 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:03.383302 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3957/7940] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:03 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:03.388419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ed4f8-1012-45fe-bbd6-eb3e2aa4db30 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:03.399600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ed4f8-1012-45fe-bbd6-eb3e2aa4db30 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:03.405005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918524d-85d6-4afc-bcfe-697497af998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:03.405421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918524d-85d6-4afc-bcfe-697497af998c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.405759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918524d-85d6-4afc-bcfe-697497af998c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.405979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918524d-85d6-4afc-bcfe-697497af998c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.407024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918524d-85d6-4afc-bcfe-697497af998c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:03.408470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918524d-85d6-4afc-bcfe-697497af998c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:03.421689 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3984/7941] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:03 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:03.426007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a265e07-69b9-4a0e-b3ab-b397eb04b973 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:03.453419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a265e07-69b9-4a0e-b3ab-b397eb04b973 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:03.458799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf629a20-f98b-4519-a099-cf4df5d7ce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:03.460701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf629a20-f98b-4519-a099-cf4df5d7ce6b admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.461009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf629a20-f98b-4519-a099-cf4df5d7ce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.461287 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf629a20-f98b-4519-a099-cf4df5d7ce6b admin admin] PATH_INFO: `/v3/projects/fe05b8cfa9f04d3a833f81f0eb77dfc8/users/a5a18af83cd54c619363f6c122b28137/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.481896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf629a20-f98b-4519-a099-cf4df5d7ce6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe05b8cfa9f04d3a833f81f0eb77dfc8, user_id=a5a18af83cd54c619363f6c122b28137, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:03.484895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf629a20-f98b-4519-a099-cf4df5d7ce6b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:03.500499 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3958/7942] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:03 2021] PUT /identity/v3/projects/fe05b8cfa9f04d3a833f81f0eb77dfc8/users/a5a18af83cd54c619363f6c122b28137/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:03.512400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11a0cd-4094-4067-8834-f89c657f9ea5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.512765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11a0cd-4094-4067-8834-f89c657f9ea5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.513350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11a0cd-4094-4067-8834-f89c657f9ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.545737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4d11a0cd-4094-4067-8834-f89c657f9ea5 None None] MFA Rules not processed for user `a5a18af83cd54c619363f6c122b28137`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:03.547541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4d11a0cd-4094-4067-8834-f89c657f9ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:03.626791 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3985/7943] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:03 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:03.631966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf629a20-f98b-4519-a099-cf4df5d7ce6b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:03.723610 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf629a20-f98b-4519-a099-cf4df5d7ce6b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:03.729730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111ded-88d5-4218-b8d0-a630b4008568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:03.730405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111ded-88d5-4218-b8d0-a630b4008568 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.730680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111ded-88d5-4218-b8d0-a630b4008568 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.730962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0111ded-88d5-4218-b8d0-a630b4008568 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.731715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0111ded-88d5-4218-b8d0-a630b4008568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:03.734905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0111ded-88d5-4218-b8d0-a630b4008568 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:03.782228 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3959/7944] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:03 2021] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:03.784736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11a0cd-4094-4067-8834-f89c657f9ea5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:03.800546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11a0cd-4094-4067-8834-f89c657f9ea5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:03.862443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07f538-364d-4d43-b42a-eb509e9a004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:03.863599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07f538-364d-4d43-b42a-eb509e9a004f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.863886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07f538-364d-4d43-b42a-eb509e9a004f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.864162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07f538-364d-4d43-b42a-eb509e9a004f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.864877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07f538-364d-4d43-b42a-eb509e9a004f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:03.867406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07f538-364d-4d43-b42a-eb509e9a004f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:03.891437 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3986/7945] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:03 2021] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:03.894142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111ded-88d5-4218-b8d0-a630b4008568 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:03.904862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0111ded-88d5-4218-b8d0-a630b4008568 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:03.910500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1171f95-c332-4b8a-b4c7-c67dceab967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:03.911168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1171f95-c332-4b8a-b4c7-c67dceab967a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.911877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1171f95-c332-4b8a-b4c7-c67dceab967a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.912671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1171f95-c332-4b8a-b4c7-c67dceab967a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.913420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1171f95-c332-4b8a-b4c7-c67dceab967a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:03.915326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1171f95-c332-4b8a-b4c7-c67dceab967a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:03.927315 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3960/7946] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:03 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:03.931690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07f538-364d-4d43-b42a-eb509e9a004f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:03.944739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07f538-364d-4d43-b42a-eb509e9a004f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:03.951224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0d2f7-c67c-41e1-bd28-f8893b781e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:03.952410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d2f7-c67c-41e1-bd28-f8893b781e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:03.952891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d2f7-c67c-41e1-bd28-f8893b781e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:03.953449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d2f7-c67c-41e1-bd28-f8893b781e98 admin admin] PATH_INFO: `/v3/projects/a292f998186e45ffb35d08c596e62667/users/e6519e87aca6444a902efbb320e28df7/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:03.973872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0d2f7-c67c-41e1-bd28-f8893b781e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a292f998186e45ffb35d08c596e62667, user_id=e6519e87aca6444a902efbb320e28df7, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:03.982583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0d2f7-c67c-41e1-bd28-f8893b781e98 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.009402 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3987/7947] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:03 2021] PUT /identity/v3/projects/a292f998186e45ffb35d08c596e62667/users/e6519e87aca6444a902efbb320e28df7/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:04.013091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1171f95-c332-4b8a-b4c7-c67dceab967a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.034376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1171f95-c332-4b8a-b4c7-c67dceab967a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.137705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ab0cf-d0f5-4138-82ab-58d6ae0f15cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.138515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ab0cf-d0f5-4138-82ab-58d6ae0f15cd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.138902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ab0cf-d0f5-4138-82ab-58d6ae0f15cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.139312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ab0cf-d0f5-4138-82ab-58d6ae0f15cd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.140491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ab0cf-d0f5-4138-82ab-58d6ae0f15cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.142094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ab0cf-d0f5-4138-82ab-58d6ae0f15cd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.154439 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3961/7948] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:04 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:20:04.159617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0d2f7-c67c-41e1-bd28-f8893b781e98 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.172372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0d2f7-c67c-41e1-bd28-f8893b781e98 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.181137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18e919-41ee-429a-b6c1-9f570f28b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.183519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18e919-41ee-429a-b6c1-9f570f28b41e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.183519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18e919-41ee-429a-b6c1-9f570f28b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.183519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18e919-41ee-429a-b6c1-9f570f28b41e admin admin] PATH_INFO: `/v3/projects/a292f998186e45ffb35d08c596e62667/users/e6519e87aca6444a902efbb320e28df7/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.186905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18e919-41ee-429a-b6c1-9f570f28b41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a292f998186e45ffb35d08c596e62667, user_id=e6519e87aca6444a902efbb320e28df7, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.189570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18e919-41ee-429a-b6c1-9f570f28b41e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.203335 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3988/7949] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:04 2021] PUT /identity/v3/projects/a292f998186e45ffb35d08c596e62667/users/e6519e87aca6444a902efbb320e28df7/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:04.213199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ecbd6-50b9-4ffc-bdd3-f7b2148d4eb2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.213715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ecbd6-50b9-4ffc-bdd3-f7b2148d4eb2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.215581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ecbd6-50b9-4ffc-bdd3-f7b2148d4eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.248772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c98ecbd6-50b9-4ffc-bdd3-f7b2148d4eb2 None None] MFA Rules not processed for user `e6519e87aca6444a902efbb320e28df7`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:04.250223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c98ecbd6-50b9-4ffc-bdd3-f7b2148d4eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:04.351922 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3962/7950] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:04 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:04.353655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18e919-41ee-429a-b6c1-9f570f28b41e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.372614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18e919-41ee-429a-b6c1-9f570f28b41e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.379745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397724fc-c796-4ad6-8e8d-fca8886b6a3d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.380432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397724fc-c796-4ad6-8e8d-fca8886b6a3d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.381177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397724fc-c796-4ad6-8e8d-fca8886b6a3d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.381616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397724fc-c796-4ad6-8e8d-fca8886b6a3d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.383617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397724fc-c796-4ad6-8e8d-fca8886b6a3d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.386727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397724fc-c796-4ad6-8e8d-fca8886b6a3d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.414320 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3989/7951] 10.222.0.21 () {60 vars in 1151 bytes} [Sat Nov 27 21:20:04 2021] POST /identity/v3/services => generated 239 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:04.418977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ecbd6-50b9-4ffc-bdd3-f7b2148d4eb2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.439166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ecbd6-50b9-4ffc-bdd3-f7b2148d4eb2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.468847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10413ed-9c95-4b63-823a-adac595c8054 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.469715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10413ed-9c95-4b63-823a-adac595c8054 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.470050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10413ed-9c95-4b63-823a-adac595c8054 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.470409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10413ed-9c95-4b63-823a-adac595c8054 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services/df12dfe5ee6c432ebeaa6dbf339abcb8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.471145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10413ed-9c95-4b63-823a-adac595c8054 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:delete_service(service_id=df12dfe5ee6c432ebeaa6dbf339abcb8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.473128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10413ed-9c95-4b63-823a-adac595c8054 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.502879 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3963/7952] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:04 2021] DELETE /identity/v3/services/df12dfe5ee6c432ebeaa6dbf339abcb8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:04.507750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397724fc-c796-4ad6-8e8d-fca8886b6a3d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.518361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397724fc-c796-4ad6-8e8d-fca8886b6a3d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.533139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7a2de-f437-43d0-9436-75e5385b5dbd tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.533900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7a2de-f437-43d0-9436-75e5385b5dbd tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.534198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7a2de-f437-43d0-9436-75e5385b5dbd tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.534477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7a2de-f437-43d0-9436-75e5385b5dbd tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.535215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7a2de-f437-43d0-9436-75e5385b5dbd tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.537769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7a2de-f437-43d0-9436-75e5385b5dbd tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.555108 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3990/7953] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:04 2021] POST /identity/v3/services => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:04.561970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10413ed-9c95-4b63-823a-adac595c8054 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.573291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10413ed-9c95-4b63-823a-adac595c8054 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.588766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1f5a-c09d-4149-a2d0-1fd72498133f tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.589749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1f5a-c09d-4149-a2d0-1fd72498133f tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `PATCH` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.590554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1f5a-c09d-4149-a2d0-1fd72498133f tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.590554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1f5a-c09d-4149-a2d0-1fd72498133f tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services/100254e2b34d4d54bd9f823438216c0d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.591352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1f5a-c09d-4149-a2d0-1fd72498133f tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:update_service(service_id=100254e2b34d4d54bd9f823438216c0d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.592471 ncdv-master-1 devstack@keystone.service[90122]: WARNING py.warnings [None req-2e1a1f5a-c09d-4149-a2d0-1fd72498133f tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:update_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 27 21:20:04.592471 ncdv-master-1 devstack@keystone.service[90122]: warnings.warn(msg) Nov 27 21:20:04.592471 ncdv-master-1 devstack@keystone.service[90122]: Nov 27 21:20:04.593902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1f5a-c09d-4149-a2d0-1fd72498133f tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.618377 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3964/7954] 10.222.0.21 () {60 vars in 1251 bytes} [Sat Nov 27 21:20:04 2021] PATCH /identity/v3/services/100254e2b34d4d54bd9f823438216c0d => generated 282 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:04.623068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7a2de-f437-43d0-9436-75e5385b5dbd tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.637814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7a2de-f437-43d0-9436-75e5385b5dbd tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.654666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c0de7-301d-4fc2-96aa-4a96a9c29cc3 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.655685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0de7-301d-4fc2-96aa-4a96a9c29cc3 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.655956 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0de7-301d-4fc2-96aa-4a96a9c29cc3 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.656273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0de7-301d-4fc2-96aa-4a96a9c29cc3 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services/100254e2b34d4d54bd9f823438216c0d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.656891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c0de7-301d-4fc2-96aa-4a96a9c29cc3 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:get_service(service_id=100254e2b34d4d54bd9f823438216c0d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.658832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c0de7-301d-4fc2-96aa-4a96a9c29cc3 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.665835 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3991/7955] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:20:04 2021] GET /identity/v3/services/100254e2b34d4d54bd9f823438216c0d => generated 282 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:04.670143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1f5a-c09d-4149-a2d0-1fd72498133f tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.683743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1f5a-c09d-4149-a2d0-1fd72498133f tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.688492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318dc1c-b762-4b02-b1a4-23522f7b5e0a tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.689415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318dc1c-b762-4b02-b1a4-23522f7b5e0a tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.689770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318dc1c-b762-4b02-b1a4-23522f7b5e0a tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.690112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318dc1c-b762-4b02-b1a4-23522f7b5e0a tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services/100254e2b34d4d54bd9f823438216c0d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.690843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318dc1c-b762-4b02-b1a4-23522f7b5e0a tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:delete_service(service_id=100254e2b34d4d54bd9f823438216c0d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.692594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318dc1c-b762-4b02-b1a4-23522f7b5e0a tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.715366 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3965/7956] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:04 2021] DELETE /identity/v3/services/100254e2b34d4d54bd9f823438216c0d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:04.719684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c0de7-301d-4fc2-96aa-4a96a9c29cc3 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.729784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c0de7-301d-4fc2-96aa-4a96a9c29cc3 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.745594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a5348-5215-4ca8-aadb-dbfd18b63cca tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.746476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a5348-5215-4ca8-aadb-dbfd18b63cca tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.746766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a5348-5215-4ca8-aadb-dbfd18b63cca tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.747047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a5348-5215-4ca8-aadb-dbfd18b63cca tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services/100254e2b34d4d54bd9f823438216c0d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.747746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a5348-5215-4ca8-aadb-dbfd18b63cca tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:get_service(service_id=100254e2b34d4d54bd9f823438216c0d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.753289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a5348-5215-4ca8-aadb-dbfd18b63cca tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.777253 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-056a5348-5215-4ca8-aadb-dbfd18b63cca tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Could not find service: 100254e2b34d4d54bd9f823438216c0d.: keystone.exception.ServiceNotFound: Could not find service: 100254e2b34d4d54bd9f823438216c0d. Nov 27 21:20:04.778648 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3992/7957] 10.222.0.21 () {58 vars in 1229 bytes} [Sat Nov 27 21:20:04 2021] GET /identity/v3/services/100254e2b34d4d54bd9f823438216c0d => generated 113 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 27 21:20:04.784479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318dc1c-b762-4b02-b1a4-23522f7b5e0a tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.797250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318dc1c-b762-4b02-b1a4-23522f7b5e0a tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.802849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ecaf1-a711-4e2a-84da-38a8e4e9f843 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.803918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ecaf1-a711-4e2a-84da-38a8e4e9f843 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.804237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ecaf1-a711-4e2a-84da-38a8e4e9f843 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.804562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ecaf1-a711-4e2a-84da-38a8e4e9f843 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.805394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ecaf1-a711-4e2a-84da-38a8e4e9f843 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.807278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ecaf1-a711-4e2a-84da-38a8e4e9f843 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.833276 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3966/7958] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:04 2021] POST /identity/v3/services => generated 273 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:04.837732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a5348-5215-4ca8-aadb-dbfd18b63cca tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.851151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a5348-5215-4ca8-aadb-dbfd18b63cca tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.910618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b8625-949e-4aba-9d17-fad1a4bcfab2 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.911410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8625-949e-4aba-9d17-fad1a4bcfab2 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.911702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8625-949e-4aba-9d17-fad1a4bcfab2 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.912089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b8625-949e-4aba-9d17-fad1a4bcfab2 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.912844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b8625-949e-4aba-9d17-fad1a4bcfab2 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.914611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b8625-949e-4aba-9d17-fad1a4bcfab2 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:04.934268 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3993/7959] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:04 2021] POST /identity/v3/services => generated 273 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:04.938243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ecaf1-a711-4e2a-84da-38a8e4e9f843 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:04.966278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ecaf1-a711-4e2a-84da-38a8e4e9f843 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:04.985759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba020f44-2368-40e2-8963-0a85e89a6005 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:04.986718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba020f44-2368-40e2-8963-0a85e89a6005 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:04.987309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba020f44-2368-40e2-8963-0a85e89a6005 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:04.988164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba020f44-2368-40e2-8963-0a85e89a6005 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:04.989126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba020f44-2368-40e2-8963-0a85e89a6005 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:04.992809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba020f44-2368-40e2-8963-0a85e89a6005 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:05.028217 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3967/7960] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:04 2021] POST /identity/v3/services => generated 275 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:05.029276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b8625-949e-4aba-9d17-fad1a4bcfab2 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:05.043238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b8625-949e-4aba-9d17-fad1a4bcfab2 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:05.071038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d6b64-a89c-4ac7-8934-0cd4131d9617 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:05.071742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d6b64-a89c-4ac7-8934-0cd4131d9617 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:05.072021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d6b64-a89c-4ac7-8934-0cd4131d9617 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:05.072860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d6b64-a89c-4ac7-8934-0cd4131d9617 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:05.073567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d6b64-a89c-4ac7-8934-0cd4131d9617 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:05.079154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d6b64-a89c-4ac7-8934-0cd4131d9617 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:05.088639 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3994/7961] 10.222.0.21 () {58 vars in 1130 bytes} [Sat Nov 27 21:20:05 2021] GET /identity/v3/services => generated 2976 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:20:05.095522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba020f44-2368-40e2-8963-0a85e89a6005 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:05.108839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba020f44-2368-40e2-8963-0a85e89a6005 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:05.114698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75f7aa-d7ee-43c6-8175-a915239a35f7 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:05.115951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75f7aa-d7ee-43c6-8175-a915239a35f7 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:05.116236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75f7aa-d7ee-43c6-8175-a915239a35f7 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:05.116517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75f7aa-d7ee-43c6-8175-a915239a35f7 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:05.117258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75f7aa-d7ee-43c6-8175-a915239a35f7 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-88672650) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:05.117565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75f7aa-d7ee-43c6-8175-a915239a35f7 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:05.119979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75f7aa-d7ee-43c6-8175-a915239a35f7 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:05.134686 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3968/7962] 10.222.0.21 () {58 vars in 1217 bytes} [Sat Nov 27 21:20:05 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-88672650 => generated 414 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:05.138596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d6b64-a89c-4ac7-8934-0cd4131d9617 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:05.153188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d6b64-a89c-4ac7-8934-0cd4131d9617 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:05.159681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1136f2-a62d-45d5-86b5-437917ee904c tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:05.160356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1136f2-a62d-45d5-86b5-437917ee904c tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:05.160643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1136f2-a62d-45d5-86b5-437917ee904c tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:05.160928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1136f2-a62d-45d5-86b5-437917ee904c tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:05.161661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1136f2-a62d-45d5-86b5-437917ee904c tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-672212234) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:05.162075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1136f2-a62d-45d5-86b5-437917ee904c tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:05.163898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1136f2-a62d-45d5-86b5-437917ee904c tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:05.171969 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3995/7963] 10.222.0.21 () {58 vars in 1219 bytes} [Sat Nov 27 21:20:05 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-672212234 => generated 415 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:05.174494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75f7aa-d7ee-43c6-8175-a915239a35f7 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:05.188219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75f7aa-d7ee-43c6-8175-a915239a35f7 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:05.195012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763d47c-7e27-4b0b-9ea1-7a4283414dab tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:05.195849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763d47c-7e27-4b0b-9ea1-7a4283414dab tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:05.196236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763d47c-7e27-4b0b-9ea1-7a4283414dab tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:05.196618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763d47c-7e27-4b0b-9ea1-7a4283414dab tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:05.204397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763d47c-7e27-4b0b-9ea1-7a4283414dab tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1842675003) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:05.204773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763d47c-7e27-4b0b-9ea1-7a4283414dab tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:05.206483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763d47c-7e27-4b0b-9ea1-7a4283414dab tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:05.214972 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3969/7964] 10.222.0.21 () {58 vars in 1221 bytes} [Sat Nov 27 21:20:05 2021] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1842675003 => generated 418 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:05.216438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1136f2-a62d-45d5-86b5-437917ee904c tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:05.227501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1136f2-a62d-45d5-86b5-437917ee904c tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:05.232519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cab7f-eb13-48fb-9cb4-9bfc96612193 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:05.233695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cab7f-eb13-48fb-9cb4-9bfc96612193 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:05.234079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cab7f-eb13-48fb-9cb4-9bfc96612193 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:05.234448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cab7f-eb13-48fb-9cb4-9bfc96612193 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services/6001551f35ed4df4966a7ceeaaf27541` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:05.235301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6cab7f-eb13-48fb-9cb4-9bfc96612193 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6001551f35ed4df4966a7ceeaaf27541)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:05.237556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6cab7f-eb13-48fb-9cb4-9bfc96612193 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:05.275710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763d47c-7e27-4b0b-9ea1-7a4283414dab tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:05.276362 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3996/7965] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:05 2021] DELETE /identity/v3/services/6001551f35ed4df4966a7ceeaaf27541 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:05.287012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763d47c-7e27-4b0b-9ea1-7a4283414dab tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:05.312811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549de982-e62b-40e4-91ac-e32b66405397 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:05.313652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549de982-e62b-40e4-91ac-e32b66405397 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:05.313931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549de982-e62b-40e4-91ac-e32b66405397 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:05.314204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549de982-e62b-40e4-91ac-e32b66405397 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services/a43eb741c3f94e80af615f223035e9e8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:05.315484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549de982-e62b-40e4-91ac-e32b66405397 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a43eb741c3f94e80af615f223035e9e8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:05.318026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549de982-e62b-40e4-91ac-e32b66405397 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:05.348064 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3970/7966] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:05 2021] DELETE /identity/v3/services/a43eb741c3f94e80af615f223035e9e8 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:05.352245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cab7f-eb13-48fb-9cb4-9bfc96612193 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:05.368102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6cab7f-eb13-48fb-9cb4-9bfc96612193 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:05.393951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2308fdf-d4ca-4e72-8f83-33bb0597010d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6519e87aca6444a902efbb320e28df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a292f998186e45ffb35d08c596e62667', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:05.395288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2308fdf-d4ca-4e72-8f83-33bb0597010d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:05.395288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2308fdf-d4ca-4e72-8f83-33bb0597010d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:05.396026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2308fdf-d4ca-4e72-8f83-33bb0597010d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] PATH_INFO: `/v3/services/c57a966e4dae4bebbf3d3dfc52c7ea62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:05.396856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2308fdf-d4ca-4e72-8f83-33bb0597010d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c57a966e4dae4bebbf3d3dfc52c7ea62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:05.398565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2308fdf-d4ca-4e72-8f83-33bb0597010d tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:05.438364 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3997/7967] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:05 2021] DELETE /identity/v3/services/c57a966e4dae4bebbf3d3dfc52c7ea62 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:05.444171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549de982-e62b-40e4-91ac-e32b66405397 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:05.550154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549de982-e62b-40e4-91ac-e32b66405397 tempest-ServicesTestJSON-491766553 tempest-ServicesTestJSON-491766553-project-admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:05.583445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:05.584490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:05.584786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:05.585074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] PATH_INFO: `/v3/users/a5a18af83cd54c619363f6c122b28137` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:05.586558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a18af83cd54c619363f6c122b28137)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:05.589058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:05.658882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a18af83cd54c619363f6c122b28137'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:05.659762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a18af83cd54c619363f6c122b28137'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:05.672480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a18af83cd54c619363f6c122b28137'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:05.673120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a18af83cd54c619363f6c122b28137'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:05.683059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a18af83cd54c619363f6c122b28137'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:05.702967 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3971/7968] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:05 2021] DELETE /identity/v3/users/a5a18af83cd54c619363f6c122b28137 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:05.707552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34992d-f8d1-4863-a158-84ce033f589b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:05.707841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34992d-f8d1-4863-a158-84ce033f589b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:05.708115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34992d-f8d1-4863-a158-84ce033f589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:05.727326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6c34992d-f8d1-4863-a158-84ce033f589b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:05.728547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6c34992d-f8d1-4863-a158-84ce033f589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:05.796417 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3998/7969] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:05.807359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:05.809069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:05.909776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebed92c-cfa7-4fe2-821f-438bfdb5b89c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:05.915945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d1a9-42bf-4224-bd08-2cf7c2e9ceb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:05.916621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d1a9-42bf-4224-bd08-2cf7c2e9ceb7 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:05.916907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d1a9-42bf-4224-bd08-2cf7c2e9ceb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:05.917187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3d1a9-42bf-4224-bd08-2cf7c2e9ceb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:05.930090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3d1a9-42bf-4224-bd08-2cf7c2e9ceb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:05.932701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3d1a9-42bf-4224-bd08-2cf7c2e9ceb7 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:05.947702 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3972/7970] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:20:06.367722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34992d-f8d1-4863-a158-84ce033f589b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:06.370244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6c34992d-f8d1-4863-a158-84ce033f589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:06.388312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34992d-f8d1-4863-a158-84ce033f589b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:06.394842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:06.396135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:06.397868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:06.398304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] PATH_INFO: `/v3/projects/fe05b8cfa9f04d3a833f81f0eb77dfc8` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:06.401611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe05b8cfa9f04d3a833f81f0eb77dfc8)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:06.403667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:06.471472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe05b8cfa9f04d3a833f81f0eb77dfc8', 'request_id': 'req-7eadf7ad-fe0d-4f20-b145-668f771302eb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:06.484375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe05b8cfa9f04d3a833f81f0eb77dfc8', 'request_id': 'req-7eadf7ad-fe0d-4f20-b145-668f771302eb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:06.503007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe05b8cfa9f04d3a833f81f0eb77dfc8', 'request_id': 'req-7eadf7ad-fe0d-4f20-b145-668f771302eb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:06.523057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] The token cache is being invalidate because project fe05b8cfa9f04d3a833f81f0eb77dfc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:06.523612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:06.524659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:06.526593 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 3999/7971] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:06 2021] DELETE /identity/v3/projects/fe05b8cfa9f04d3a833f81f0eb77dfc8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:06.530335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d1a9-42bf-4224-bd08-2cf7c2e9ceb7 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:06.545598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3d1a9-42bf-4224-bd08-2cf7c2e9ceb7 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:06.611413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ea246-702b-4f0c-a55e-6e85852fe2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:06.613309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ea246-702b-4f0c-a55e-6e85852fe2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:06.613309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ea246-702b-4f0c-a55e-6e85852fe2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:06.613631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ea246-702b-4f0c-a55e-6e85852fe2a8 admin admin] PATH_INFO: `/v3/users/e6519e87aca6444a902efbb320e28df7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:06.615759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ea246-702b-4f0c-a55e-6e85852fe2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6519e87aca6444a902efbb320e28df7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:06.617687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ea246-702b-4f0c-a55e-6e85852fe2a8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:06.688006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-473ea246-702b-4f0c-a55e-6e85852fe2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6519e87aca6444a902efbb320e28df7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:06.688848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-473ea246-702b-4f0c-a55e-6e85852fe2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6519e87aca6444a902efbb320e28df7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:06.700102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-473ea246-702b-4f0c-a55e-6e85852fe2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6519e87aca6444a902efbb320e28df7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:06.700818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-473ea246-702b-4f0c-a55e-6e85852fe2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6519e87aca6444a902efbb320e28df7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:06.712190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-473ea246-702b-4f0c-a55e-6e85852fe2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6519e87aca6444a902efbb320e28df7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:06.732220 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3973/7972] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:06 2021] DELETE /identity/v3/users/e6519e87aca6444a902efbb320e28df7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:07.130536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:07.132176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:07.145424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadf7ad-fe0d-4f20-b145-668f771302eb admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:07.213413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:07.214663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.214950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.215282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] PATH_INFO: `/v3/projects/a292f998186e45ffb35d08c596e62667` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.216873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a292f998186e45ffb35d08c596e62667)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:07.219941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:07.272508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a292f998186e45ffb35d08c596e62667', 'request_id': 'req-dd812be1-b099-4468-b098-eb6ee06d584a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:07.280816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a292f998186e45ffb35d08c596e62667', 'request_id': 'req-dd812be1-b099-4468-b098-eb6ee06d584a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:07.288540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a292f998186e45ffb35d08c596e62667', 'request_id': 'req-dd812be1-b099-4468-b098-eb6ee06d584a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:07.299573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] The token cache is being invalidate because project a292f998186e45ffb35d08c596e62667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:07.299992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:07.300716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-dd812be1-b099-4468-b098-eb6ee06d584a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:07.303595 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4000/7973] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:07 2021] DELETE /identity/v3/projects/a292f998186e45ffb35d08c596e62667 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:07.311750 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec513e7-8f9d-4699-aeca-7286b03cc320 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.312246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec513e7-8f9d-4699-aeca-7286b03cc320 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.312350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec513e7-8f9d-4699-aeca-7286b03cc320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.332553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cec513e7-8f9d-4699-aeca-7286b03cc320 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:07.334458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cec513e7-8f9d-4699-aeca-7286b03cc320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:07.410395 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3974/7974] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:07.420711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967cc8-f0f9-4349-b323-f7bff52f9057 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.421280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967cc8-f0f9-4349-b323-f7bff52f9057 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.421280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967cc8-f0f9-4349-b323-f7bff52f9057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.444250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-08967cc8-f0f9-4349-b323-f7bff52f9057 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:07.445862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-08967cc8-f0f9-4349-b323-f7bff52f9057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:07.454716 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4001/7975] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:07.459724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec513e7-8f9d-4699-aeca-7286b03cc320 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:07.469899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec513e7-8f9d-4699-aeca-7286b03cc320 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:07.476382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d515c-4599-44dd-8ccd-a63f079afc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:07.477096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d515c-4599-44dd-8ccd-a63f079afc60 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.477378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d515c-4599-44dd-8ccd-a63f079afc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.477659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d515c-4599-44dd-8ccd-a63f079afc60 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.478412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d515c-4599-44dd-8ccd-a63f079afc60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:07.478718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d515c-4599-44dd-8ccd-a63f079afc60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:07.480417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d515c-4599-44dd-8ccd-a63f079afc60 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:07.493476 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3975/7976] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:07.497999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08967cc8-f0f9-4349-b323-f7bff52f9057 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:07.508119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08967cc8-f0f9-4349-b323-f7bff52f9057 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:07.513111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef612b-4f67-4990-8206-8e2de7f0f12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:07.513784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef612b-4f67-4990-8206-8e2de7f0f12d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.514067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef612b-4f67-4990-8206-8e2de7f0f12d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.514343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef612b-4f67-4990-8206-8e2de7f0f12d admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.515074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef612b-4f67-4990-8206-8e2de7f0f12d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:07.517083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef612b-4f67-4990-8206-8e2de7f0f12d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:07.547636 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4002/7977] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:07 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:07.551130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d515c-4599-44dd-8ccd-a63f079afc60 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:07.561880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d515c-4599-44dd-8ccd-a63f079afc60 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:07.622836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce3c46-8752-4613-b3a2-1aafb12af738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:07.623478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce3c46-8752-4613-b3a2-1aafb12af738 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.623752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce3c46-8752-4613-b3a2-1aafb12af738 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.624109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce3c46-8752-4613-b3a2-1aafb12af738 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.624734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce3c46-8752-4613-b3a2-1aafb12af738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:07.626709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce3c46-8752-4613-b3a2-1aafb12af738 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:07.652504 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3976/7978] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:07 2021] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:07.654319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef612b-4f67-4990-8206-8e2de7f0f12d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:07.666228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef612b-4f67-4990-8206-8e2de7f0f12d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:07.671212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8c1ce-ca5b-4f9b-8318-5dda23019aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:07.672022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c1ce-ca5b-4f9b-8318-5dda23019aff admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.672376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c1ce-ca5b-4f9b-8318-5dda23019aff admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.672754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c1ce-ca5b-4f9b-8318-5dda23019aff admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.673571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8c1ce-ca5b-4f9b-8318-5dda23019aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:07.675374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8c1ce-ca5b-4f9b-8318-5dda23019aff admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:07.689994 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4003/7979] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:07.691289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce3c46-8752-4613-b3a2-1aafb12af738 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:07.702068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce3c46-8752-4613-b3a2-1aafb12af738 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:07.706862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f67c5-5817-4900-bb85-cd1cb5513f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:07.707692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f67c5-5817-4900-bb85-cd1cb5513f22 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.708067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f67c5-5817-4900-bb85-cd1cb5513f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.708347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f67c5-5817-4900-bb85-cd1cb5513f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.709695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f67c5-5817-4900-bb85-cd1cb5513f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:07.711320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f67c5-5817-4900-bb85-cd1cb5513f22 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:07.724996 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3977/7980] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:07.726227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8c1ce-ca5b-4f9b-8318-5dda23019aff admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:07.737353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8c1ce-ca5b-4f9b-8318-5dda23019aff admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:07.742370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e15290-9222-459e-8a93-5b6ae86158bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:07.743390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e15290-9222-459e-8a93-5b6ae86158bc admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.743672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e15290-9222-459e-8a93-5b6ae86158bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.744005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e15290-9222-459e-8a93-5b6ae86158bc admin admin] PATH_INFO: `/v3/projects/a1c5c9e52d2d4f5eab8ab98dd0c95539/users/74118fd022ef438bbe2f85bd3b78adff/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.761094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e15290-9222-459e-8a93-5b6ae86158bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c5c9e52d2d4f5eab8ab98dd0c95539, user_id=74118fd022ef438bbe2f85bd3b78adff, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:07.763792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e15290-9222-459e-8a93-5b6ae86158bc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:07.777075 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4004/7981] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:07 2021] PUT /identity/v3/projects/a1c5c9e52d2d4f5eab8ab98dd0c95539/users/74118fd022ef438bbe2f85bd3b78adff/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:07.787358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187bae-aa25-4b99-b01b-70a269de92e2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.787696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187bae-aa25-4b99-b01b-70a269de92e2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.787986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa187bae-aa25-4b99-b01b-70a269de92e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.814619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fa187bae-aa25-4b99-b01b-70a269de92e2 None None] MFA Rules not processed for user `74118fd022ef438bbe2f85bd3b78adff`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:07.816085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fa187bae-aa25-4b99-b01b-70a269de92e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:07.885947 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3978/7982] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:07 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:07.890928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e15290-9222-459e-8a93-5b6ae86158bc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:07.901555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e15290-9222-459e-8a93-5b6ae86158bc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:07.906171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bc790-aaa1-4318-8e9d-e05fb6648989 tempest-DefaultDomainTestJSON-544848365 tempest-DefaultDomainTestJSON-544848365-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74118fd022ef438bbe2f85bd3b78adff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1c5c9e52d2d4f5eab8ab98dd0c95539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:07.907079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bc790-aaa1-4318-8e9d-e05fb6648989 tempest-DefaultDomainTestJSON-544848365 tempest-DefaultDomainTestJSON-544848365-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.907484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bc790-aaa1-4318-8e9d-e05fb6648989 tempest-DefaultDomainTestJSON-544848365 tempest-DefaultDomainTestJSON-544848365-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.907792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bc790-aaa1-4318-8e9d-e05fb6648989 tempest-DefaultDomainTestJSON-544848365 tempest-DefaultDomainTestJSON-544848365-project] PATH_INFO: `/v3/domains/default` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.909016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bc790-aaa1-4318-8e9d-e05fb6648989 tempest-DefaultDomainTestJSON-544848365 tempest-DefaultDomainTestJSON-544848365-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:07.910694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bc790-aaa1-4318-8e9d-e05fb6648989 tempest-DefaultDomainTestJSON-544848365 tempest-DefaultDomainTestJSON-544848365-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:07.912396 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4005/7983] 10.222.0.21 () {58 vars in 1151 bytes} [Sat Nov 27 21:20:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:20:07.916918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa187bae-aa25-4b99-b01b-70a269de92e2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:07.979305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa187bae-aa25-4b99-b01b-70a269de92e2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:07.983881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:07.984745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:07.985021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:07.985302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] PATH_INFO: `/v3/users/74118fd022ef438bbe2f85bd3b78adff` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:07.986514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74118fd022ef438bbe2f85bd3b78adff)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:07.988740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:08.034464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74118fd022ef438bbe2f85bd3b78adff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:08.035155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74118fd022ef438bbe2f85bd3b78adff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:08.042612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74118fd022ef438bbe2f85bd3b78adff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:08.043337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74118fd022ef438bbe2f85bd3b78adff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:08.050327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74118fd022ef438bbe2f85bd3b78adff'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:08.068749 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3979/7984] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:07 2021] DELETE /identity/v3/users/74118fd022ef438bbe2f85bd3b78adff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:08.073668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecbee2-2d23-47f5-96a4-657054d14855 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:08.073957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecbee2-2d23-47f5-96a4-657054d14855 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:08.074234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecbee2-2d23-47f5-96a4-657054d14855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:08.092786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e4ecbee2-2d23-47f5-96a4-657054d14855 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:08.093978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e4ecbee2-2d23-47f5-96a4-657054d14855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:08.151354 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4006/7985] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:08.161243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:08.162745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:08.221153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ceb32-94db-4828-806d-8f6eb60fb8a1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:08.224885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f9188-5878-489f-be23-0680d26a23a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:08.225528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f9188-5878-489f-be23-0680d26a23a8 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:08.225814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f9188-5878-489f-be23-0680d26a23a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:08.226093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f9188-5878-489f-be23-0680d26a23a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:08.235124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f9188-5878-489f-be23-0680d26a23a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:08.236595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f9188-5878-489f-be23-0680d26a23a8 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:08.246733 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3980/7986] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:08.513984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecbee2-2d23-47f5-96a4-657054d14855 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:08.515992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e4ecbee2-2d23-47f5-96a4-657054d14855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:08.535880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecbee2-2d23-47f5-96a4-657054d14855 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:08.545805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:08.546673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:08.546942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:08.547222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] PATH_INFO: `/v3/projects/a1c5c9e52d2d4f5eab8ab98dd0c95539` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:08.548474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c5c9e52d2d4f5eab8ab98dd0c95539)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:08.550378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:08.598429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c5c9e52d2d4f5eab8ab98dd0c95539', 'request_id': 'req-c61333af-6da1-4a22-ab96-72dafd633d82'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:08.606491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c5c9e52d2d4f5eab8ab98dd0c95539', 'request_id': 'req-c61333af-6da1-4a22-ab96-72dafd633d82'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:08.613391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c5c9e52d2d4f5eab8ab98dd0c95539', 'request_id': 'req-c61333af-6da1-4a22-ab96-72dafd633d82'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:08.624337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] The token cache is being invalidate because project a1c5c9e52d2d4f5eab8ab98dd0c95539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:08.624628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:08.625268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c61333af-6da1-4a22-ab96-72dafd633d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:08.626845 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4007/7987] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:08 2021] DELETE /identity/v3/projects/a1c5c9e52d2d4f5eab8ab98dd0c95539 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:08.632574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e635809-3466-4597-aa48-7311dad367ea None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:08.633068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e635809-3466-4597-aa48-7311dad367ea None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:08.633159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e635809-3466-4597-aa48-7311dad367ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:08.650321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3e635809-3466-4597-aa48-7311dad367ea None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:08.651539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3e635809-3466-4597-aa48-7311dad367ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:08.709186 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3981/7988] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:08.716904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8c87-4707-428e-bfda-54cd8821ec5f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:08.717200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8c87-4707-428e-bfda-54cd8821ec5f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:08.717484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8c87-4707-428e-bfda-54cd8821ec5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:08.736422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-64ca8c87-4707-428e-bfda-54cd8821ec5f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:08.737620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-64ca8c87-4707-428e-bfda-54cd8821ec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:08.746421 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4008/7989] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:08.750535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e635809-3466-4597-aa48-7311dad367ea None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:08.760285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e635809-3466-4597-aa48-7311dad367ea None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:08.764923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a6986-398a-47d8-b1bd-3363c5096b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:08.765567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a6986-398a-47d8-b1bd-3363c5096b97 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:08.765879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a6986-398a-47d8-b1bd-3363c5096b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:08.766159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a6986-398a-47d8-b1bd-3363c5096b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:08.766892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a6986-398a-47d8-b1bd-3363c5096b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:08.767201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a6986-398a-47d8-b1bd-3363c5096b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:08.768913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a6986-398a-47d8-b1bd-3363c5096b97 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:08.780534 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3982/7990] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:08.784558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca8c87-4707-428e-bfda-54cd8821ec5f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:08.794324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca8c87-4707-428e-bfda-54cd8821ec5f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:08.799211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a27b8-9a60-4227-8b0c-b454b88eb31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:08.799881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a27b8-9a60-4227-8b0c-b454b88eb31c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:08.800161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a27b8-9a60-4227-8b0c-b454b88eb31c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:08.800434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a27b8-9a60-4227-8b0c-b454b88eb31c admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:08.801133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a27b8-9a60-4227-8b0c-b454b88eb31c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:08.803723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a27b8-9a60-4227-8b0c-b454b88eb31c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:08.828435 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4009/7991] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:08 2021] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:08.832654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a6986-398a-47d8-b1bd-3363c5096b97 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:08.845428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a6986-398a-47d8-b1bd-3363c5096b97 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:08.903072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be7ed8-67da-447e-af18-bf669e12f184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:08.903765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7ed8-67da-447e-af18-bf669e12f184 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:08.904052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7ed8-67da-447e-af18-bf669e12f184 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:08.904327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7ed8-67da-447e-af18-bf669e12f184 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:08.905026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be7ed8-67da-447e-af18-bf669e12f184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:08.906983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be7ed8-67da-447e-af18-bf669e12f184 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:08.927431 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3983/7992] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:08 2021] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:08.931570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a27b8-9a60-4227-8b0c-b454b88eb31c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:08.941816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a27b8-9a60-4227-8b0c-b454b88eb31c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:08.946490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb400bab-ecab-45bc-8c77-74a1a38c5f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:08.947141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb400bab-ecab-45bc-8c77-74a1a38c5f76 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:08.947465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb400bab-ecab-45bc-8c77-74a1a38c5f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:08.947813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb400bab-ecab-45bc-8c77-74a1a38c5f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:08.948548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb400bab-ecab-45bc-8c77-74a1a38c5f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:08.950131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb400bab-ecab-45bc-8c77-74a1a38c5f76 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:08.960931 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4010/7993] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:08.964611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be7ed8-67da-447e-af18-bf669e12f184 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:08.975057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be7ed8-67da-447e-af18-bf669e12f184 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:08.979775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b3a26-e0f0-4c27-b4e2-700a7676dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:08.980421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3a26-e0f0-4c27-b4e2-700a7676dafd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:08.980706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3a26-e0f0-4c27-b4e2-700a7676dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:08.980986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b3a26-e0f0-4c27-b4e2-700a7676dafd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:08.981711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b3a26-e0f0-4c27-b4e2-700a7676dafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:08.983333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b3a26-e0f0-4c27-b4e2-700a7676dafd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:08.993400 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3984/7994] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:08 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:20:08.997340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb400bab-ecab-45bc-8c77-74a1a38c5f76 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:09.007176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb400bab-ecab-45bc-8c77-74a1a38c5f76 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:09.011853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e74d5-f8b6-448e-ba47-afdff3f3af4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:09.012722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e74d5-f8b6-448e-ba47-afdff3f3af4f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.013007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e74d5-f8b6-448e-ba47-afdff3f3af4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.013287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e74d5-f8b6-448e-ba47-afdff3f3af4f admin admin] PATH_INFO: `/v3/projects/bd8e93c20cf94bbd856807e8fcac5721/users/6e948a8bffff40e68e46b0c031e47e87/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.028030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e74d5-f8b6-448e-ba47-afdff3f3af4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8e93c20cf94bbd856807e8fcac5721, user_id=6e948a8bffff40e68e46b0c031e47e87, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:09.030903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e74d5-f8b6-448e-ba47-afdff3f3af4f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:09.043932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4011/7995] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:08 2021] PUT /identity/v3/projects/bd8e93c20cf94bbd856807e8fcac5721/users/6e948a8bffff40e68e46b0c031e47e87/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:09.054768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e6bac-edf5-4fbc-ac00-f9e258f3fe87 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.055066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e6bac-edf5-4fbc-ac00-f9e258f3fe87 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.055379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e6bac-edf5-4fbc-ac00-f9e258f3fe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.081457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-798e6bac-edf5-4fbc-ac00-f9e258f3fe87 None None] MFA Rules not processed for user `6e948a8bffff40e68e46b0c031e47e87`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:09.082666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-798e6bac-edf5-4fbc-ac00-f9e258f3fe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:09.151510 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3985/7996] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:09 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:09.152663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e74d5-f8b6-448e-ba47-afdff3f3af4f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:09.213338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e74d5-f8b6-448e-ba47-afdff3f3af4f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:09.217959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5471c-dd6a-493d-8da7-a2ad668a49f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:09.218641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5471c-dd6a-493d-8da7-a2ad668a49f1 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.218931 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5471c-dd6a-493d-8da7-a2ad668a49f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.219214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5471c-dd6a-493d-8da7-a2ad668a49f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.219976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5471c-dd6a-493d-8da7-a2ad668a49f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:09.221881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5471c-dd6a-493d-8da7-a2ad668a49f1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:09.246470 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4012/7997] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:09 2021] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:09.250448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e6bac-edf5-4fbc-ac00-f9e258f3fe87 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:09.261619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e6bac-edf5-4fbc-ac00-f9e258f3fe87 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:09.315567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6d70d-4d7b-482a-bb10-e5e148e5764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:09.316235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d70d-4d7b-482a-bb10-e5e148e5764b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.316526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d70d-4d7b-482a-bb10-e5e148e5764b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.316806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d70d-4d7b-482a-bb10-e5e148e5764b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.317546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6d70d-4d7b-482a-bb10-e5e148e5764b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:09.319994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6d70d-4d7b-482a-bb10-e5e148e5764b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:09.339838 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3986/7998] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:09 2021] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:09.343822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5471c-dd6a-493d-8da7-a2ad668a49f1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:09.354191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5471c-dd6a-493d-8da7-a2ad668a49f1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:09.358926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743c02f-757d-4578-92ce-d94800913162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:09.359610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743c02f-757d-4578-92ce-d94800913162 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.359899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743c02f-757d-4578-92ce-d94800913162 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.360177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743c02f-757d-4578-92ce-d94800913162 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.360908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743c02f-757d-4578-92ce-d94800913162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:09.362504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743c02f-757d-4578-92ce-d94800913162 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:09.373101 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4013/7999] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:09.376799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6d70d-4d7b-482a-bb10-e5e148e5764b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:09.387197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6d70d-4d7b-482a-bb10-e5e148e5764b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:09.391931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a15a51-724b-469a-907f-435037d93fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:09.392630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15a51-724b-469a-907f-435037d93fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.392914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15a51-724b-469a-907f-435037d93fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.393192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a15a51-724b-469a-907f-435037d93fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.393922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a15a51-724b-469a-907f-435037d93fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:09.395557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a15a51-724b-469a-907f-435037d93fa0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:09.405841 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3987/8000] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:09.409543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743c02f-757d-4578-92ce-d94800913162 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:09.419444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743c02f-757d-4578-92ce-d94800913162 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:09.430271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246349b0-37d7-4824-8de9-a3a0093b9972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:09.431610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246349b0-37d7-4824-8de9-a3a0093b9972 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.431894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246349b0-37d7-4824-8de9-a3a0093b9972 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.432172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246349b0-37d7-4824-8de9-a3a0093b9972 admin admin] PATH_INFO: `/v3/projects/9f5bf9ae10684067b8e65a08560f7d2e/users/95bf9f6023e74506a53b63cc22a29971/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.447665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246349b0-37d7-4824-8de9-a3a0093b9972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5bf9ae10684067b8e65a08560f7d2e, user_id=95bf9f6023e74506a53b63cc22a29971, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:09.450374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246349b0-37d7-4824-8de9-a3a0093b9972 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:09.463886 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4014/8001] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:09 2021] PUT /identity/v3/projects/9f5bf9ae10684067b8e65a08560f7d2e/users/95bf9f6023e74506a53b63cc22a29971/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:09.474305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0823-ec44-4fa3-8068-b883638b0f72 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.474601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0823-ec44-4fa3-8068-b883638b0f72 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.474885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0823-ec44-4fa3-8068-b883638b0f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.501942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d04a0823-ec44-4fa3-8068-b883638b0f72 None None] MFA Rules not processed for user `95bf9f6023e74506a53b63cc22a29971`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:09.503304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d04a0823-ec44-4fa3-8068-b883638b0f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:09.567222 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3988/8002] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:09 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:09.572981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246349b0-37d7-4824-8de9-a3a0093b9972 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:09.644597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246349b0-37d7-4824-8de9-a3a0093b9972 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:09.648809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81079f3c-17c2-410d-94c3-e5ed9c9f729e tempest-IdentityV3ProjectsTest-1477221878 tempest-IdentityV3ProjectsTest-1477221878-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e948a8bffff40e68e46b0c031e47e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd8e93c20cf94bbd856807e8fcac5721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:09.649671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079f3c-17c2-410d-94c3-e5ed9c9f729e tempest-IdentityV3ProjectsTest-1477221878 tempest-IdentityV3ProjectsTest-1477221878-project] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.649961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079f3c-17c2-410d-94c3-e5ed9c9f729e tempest-IdentityV3ProjectsTest-1477221878 tempest-IdentityV3ProjectsTest-1477221878-project] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.650262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079f3c-17c2-410d-94c3-e5ed9c9f729e tempest-IdentityV3ProjectsTest-1477221878 tempest-IdentityV3ProjectsTest-1477221878-project] PATH_INFO: `/v3/users/6e948a8bffff40e68e46b0c031e47e87/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.651548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81079f3c-17c2-410d-94c3-e5ed9c9f729e tempest-IdentityV3ProjectsTest-1477221878 tempest-IdentityV3ProjectsTest-1477221878-project] RBAC: Authorizing `identity:list_user_projects(user_id=6e948a8bffff40e68e46b0c031e47e87)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:09.653342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81079f3c-17c2-410d-94c3-e5ed9c9f729e tempest-IdentityV3ProjectsTest-1477221878 tempest-IdentityV3ProjectsTest-1477221878-project] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:09.690942 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4015/8003] 10.222.0.21 () {58 vars in 1247 bytes} [Sat Nov 27 21:20:09 2021] GET /identity/v3/users/6e948a8bffff40e68e46b0c031e47e87/projects => generated 517 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:09.696353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3d810-c667-464c-ba08-280dc5660908 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.696817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3d810-c667-464c-ba08-280dc5660908 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.696817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3d810-c667-464c-ba08-280dc5660908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.724339 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2aa3d810-c667-464c-ba08-280dc5660908 None None] MFA Rules not processed for user `6e948a8bffff40e68e46b0c031e47e87`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:09.725542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2aa3d810-c667-464c-ba08-280dc5660908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:09.732994 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3989/8004] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:09 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:09.737618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4a1f-c97b-418d-b9a5-d692efc4bea1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.738165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4a1f-c97b-418d-b9a5-d692efc4bea1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.738440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4a1f-c97b-418d-b9a5-d692efc4bea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.758285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-583a4a1f-c97b-418d-b9a5-d692efc4bea1 None None] MFA Rules not processed for user `6e948a8bffff40e68e46b0c031e47e87`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:09.759520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-583a4a1f-c97b-418d-b9a5-d692efc4bea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:09.800422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.models.token_model [None req-583a4a1f-c97b-418d-b9a5-d692efc4bea1 None None] User 6e948a8bffff40e68e46b0c031e47e87 has no access to project 9f5bf9ae10684067b8e65a08560f7d2e {{(pid=90123) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Nov 27 21:20:09.805175 ncdv-master-1 devstack@keystone.service[90123]: WARNING keystone.server.flask.application [None req-583a4a1f-c97b-418d-b9a5-d692efc4bea1 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.21: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 27 21:20:09.806596 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4016/8005] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:09 2021] POST /identity/v3/auth/tokens => generated 109 bytes in 70 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 27 21:20:09.811835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3d810-c667-464c-ba08-280dc5660908 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:09.876524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3d810-c667-464c-ba08-280dc5660908 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:09.881686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:09.882542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.882828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.883095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] PATH_INFO: `/v3/users/6e948a8bffff40e68e46b0c031e47e87` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.884346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e948a8bffff40e68e46b0c031e47e87)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:09.886255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:09.930347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e948a8bffff40e68e46b0c031e47e87'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:09.930996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e948a8bffff40e68e46b0c031e47e87'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:09.937729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e948a8bffff40e68e46b0c031e47e87'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:09.938350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e948a8bffff40e68e46b0c031e47e87'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:09.945003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e948a8bffff40e68e46b0c031e47e87'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:09.961156 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3990/8006] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:09 2021] DELETE /identity/v3/users/6e948a8bffff40e68e46b0c031e47e87 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:09.965737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82db73f-448d-450f-81cd-3eed04371603 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:09.966021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82db73f-448d-450f-81cd-3eed04371603 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:09.966297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82db73f-448d-450f-81cd-3eed04371603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:09.984054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a82db73f-448d-450f-81cd-3eed04371603 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:09.985159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a82db73f-448d-450f-81cd-3eed04371603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:10.041212 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4017/8007] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:10.051156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:10.053179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:10.109993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7b2c5-8513-40d1-807a-75fa19742a5a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:10.113874 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13d691-1eca-4cb8-b3bb-cf5c8d028797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:10.114507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13d691-1eca-4cb8-b3bb-cf5c8d028797 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:10.114799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13d691-1eca-4cb8-b3bb-cf5c8d028797 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:10.115648 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13d691-1eca-4cb8-b3bb-cf5c8d028797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:10.124768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13d691-1eca-4cb8-b3bb-cf5c8d028797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:10.126188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13d691-1eca-4cb8-b3bb-cf5c8d028797 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:10.135550 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3991/8008] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:10.399010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82db73f-448d-450f-81cd-3eed04371603 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:10.400601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a82db73f-448d-450f-81cd-3eed04371603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:10.414247 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82db73f-448d-450f-81cd-3eed04371603 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:10.418609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:10.419895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:10.420143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:10.420486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] PATH_INFO: `/v3/projects/bd8e93c20cf94bbd856807e8fcac5721` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:10.422415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8e93c20cf94bbd856807e8fcac5721)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:10.429602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:10.471059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8e93c20cf94bbd856807e8fcac5721', 'request_id': 'req-e8e125c2-6267-4034-ab71-e328f5697086'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:10.479049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8e93c20cf94bbd856807e8fcac5721', 'request_id': 'req-e8e125c2-6267-4034-ab71-e328f5697086'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:10.485634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8e93c20cf94bbd856807e8fcac5721', 'request_id': 'req-e8e125c2-6267-4034-ab71-e328f5697086'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:10.495901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] The token cache is being invalidate because project bd8e93c20cf94bbd856807e8fcac5721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:10.496208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:10.496878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:10.498416 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4018/8009] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:10 2021] DELETE /identity/v3/projects/bd8e93c20cf94bbd856807e8fcac5721 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:10.504175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13d691-1eca-4cb8-b3bb-cf5c8d028797 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:10.513848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13d691-1eca-4cb8-b3bb-cf5c8d028797 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:10.568462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f6e33-4f8c-4533-b0e3-d6b344132c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:10.569240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f6e33-4f8c-4533-b0e3-d6b344132c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:10.569526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f6e33-4f8c-4533-b0e3-d6b344132c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:10.569805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f6e33-4f8c-4533-b0e3-d6b344132c85 admin admin] PATH_INFO: `/v3/users/95bf9f6023e74506a53b63cc22a29971` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:10.571001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f6e33-4f8c-4533-b0e3-d6b344132c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95bf9f6023e74506a53b63cc22a29971)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:10.572985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f6e33-4f8c-4533-b0e3-d6b344132c85 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:10.618715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d95f6e33-4f8c-4533-b0e3-d6b344132c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bf9f6023e74506a53b63cc22a29971'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:10.619420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d95f6e33-4f8c-4533-b0e3-d6b344132c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bf9f6023e74506a53b63cc22a29971'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:10.625587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d95f6e33-4f8c-4533-b0e3-d6b344132c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bf9f6023e74506a53b63cc22a29971'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:10.626225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d95f6e33-4f8c-4533-b0e3-d6b344132c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bf9f6023e74506a53b63cc22a29971'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:10.633222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d95f6e33-4f8c-4533-b0e3-d6b344132c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bf9f6023e74506a53b63cc22a29971'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:10.651233 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3992/8010] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:10 2021] DELETE /identity/v3/users/95bf9f6023e74506a53b63cc22a29971 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:10.921791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:10.923624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:10.938126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e125c2-6267-4034-ab71-e328f5697086 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:10.996572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:10.997429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:10.997715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:10.997991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] PATH_INFO: `/v3/projects/9f5bf9ae10684067b8e65a08560f7d2e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:10.999191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5bf9ae10684067b8e65a08560f7d2e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.001135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.046583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5bf9ae10684067b8e65a08560f7d2e', 'request_id': 'req-28ac51fc-3898-4c0d-8d09-9fcc4019e533'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:11.053907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5bf9ae10684067b8e65a08560f7d2e', 'request_id': 'req-28ac51fc-3898-4c0d-8d09-9fcc4019e533'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:11.060800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5bf9ae10684067b8e65a08560f7d2e', 'request_id': 'req-28ac51fc-3898-4c0d-8d09-9fcc4019e533'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:11.071219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] The token cache is being invalidate because project 9f5bf9ae10684067b8e65a08560f7d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:11.071535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:11.072163 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-28ac51fc-3898-4c0d-8d09-9fcc4019e533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:11.073750 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4019/8011] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:10 2021] DELETE /identity/v3/projects/9f5bf9ae10684067b8e65a08560f7d2e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:11.079474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be0526-3528-4c33-b79b-f3998fef651b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.079947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be0526-3528-4c33-b79b-f3998fef651b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.080039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be0526-3528-4c33-b79b-f3998fef651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.097203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f6be0526-3528-4c33-b79b-f3998fef651b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:11.098317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f6be0526-3528-4c33-b79b-f3998fef651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:11.155789 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3993/8012] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:11.163749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5934f74-c280-406f-a782-e634458f9d96 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.164044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5934f74-c280-406f-a782-e634458f9d96 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.164321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5934f74-c280-406f-a782-e634458f9d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.182663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c5934f74-c280-406f-a782-e634458f9d96 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:11.183894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c5934f74-c280-406f-a782-e634458f9d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:11.191727 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4020/8013] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:11.196350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be0526-3528-4c33-b79b-f3998fef651b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.205944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be0526-3528-4c33-b79b-f3998fef651b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.210604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c29e59-4509-463d-9168-f49a08d2e0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.211272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c29e59-4509-463d-9168-f49a08d2e0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.211579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c29e59-4509-463d-9168-f49a08d2e0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.211856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c29e59-4509-463d-9168-f49a08d2e0e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.212587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c29e59-4509-463d-9168-f49a08d2e0e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:11.212896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c29e59-4509-463d-9168-f49a08d2e0e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.214534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c29e59-4509-463d-9168-f49a08d2e0e5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.226427 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3994/8014] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:20:11.230744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5934f74-c280-406f-a782-e634458f9d96 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.240668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5934f74-c280-406f-a782-e634458f9d96 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.245338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5173a0f-c538-45d8-996d-c42e4d3d5093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.245975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5173a0f-c538-45d8-996d-c42e4d3d5093 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.246258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5173a0f-c538-45d8-996d-c42e4d3d5093 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.246535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5173a0f-c538-45d8-996d-c42e4d3d5093 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.247244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5173a0f-c538-45d8-996d-c42e4d3d5093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.249160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5173a0f-c538-45d8-996d-c42e4d3d5093 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.277891 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4021/8015] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:11 2021] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:11.279017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c29e59-4509-463d-9168-f49a08d2e0e5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.288885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c29e59-4509-463d-9168-f49a08d2e0e5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.346569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddadfe-b68b-46ff-960f-f3af37001020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.347320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddadfe-b68b-46ff-960f-f3af37001020 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.347577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddadfe-b68b-46ff-960f-f3af37001020 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.347875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddadfe-b68b-46ff-960f-f3af37001020 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.348620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddadfe-b68b-46ff-960f-f3af37001020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.351032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddadfe-b68b-46ff-960f-f3af37001020 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.374751 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3995/8016] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:11 2021] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:11.376229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5173a0f-c538-45d8-996d-c42e4d3d5093 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.387051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5173a0f-c538-45d8-996d-c42e4d3d5093 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.391660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815759-b701-4eab-a794-0ee75340e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.392313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815759-b701-4eab-a794-0ee75340e7ad admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.392611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815759-b701-4eab-a794-0ee75340e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.392862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5815759-b701-4eab-a794-0ee75340e7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.393592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5815759-b701-4eab-a794-0ee75340e7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.395167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5815759-b701-4eab-a794-0ee75340e7ad admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.405415 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4022/8017] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:11.409584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddadfe-b68b-46ff-960f-f3af37001020 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.419923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddadfe-b68b-46ff-960f-f3af37001020 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.425304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc26907-463c-4be4-9488-58741c1973ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.426290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26907-463c-4be4-9488-58741c1973ea admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.426584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26907-463c-4be4-9488-58741c1973ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.426835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc26907-463c-4be4-9488-58741c1973ea admin admin] PATH_INFO: `/v3/projects/1bd85b231751413d9414b592fac22b24/users/101ee791ab56496f9cf5ebc01bec1aa7/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.443581 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc26907-463c-4be4-9488-58741c1973ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd85b231751413d9414b592fac22b24, user_id=101ee791ab56496f9cf5ebc01bec1aa7, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.446468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc26907-463c-4be4-9488-58741c1973ea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.460101 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3996/8018] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:11 2021] PUT /identity/v3/projects/1bd85b231751413d9414b592fac22b24/users/101ee791ab56496f9cf5ebc01bec1aa7/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:11.463909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815759-b701-4eab-a794-0ee75340e7ad admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.473588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5815759-b701-4eab-a794-0ee75340e7ad admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.530835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba56e8-7ef1-473c-a9d1-75b39d4ed11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.531568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba56e8-7ef1-473c-a9d1-75b39d4ed11c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.531857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba56e8-7ef1-473c-a9d1-75b39d4ed11c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.532139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba56e8-7ef1-473c-a9d1-75b39d4ed11c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.532869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba56e8-7ef1-473c-a9d1-75b39d4ed11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.534467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba56e8-7ef1-473c-a9d1-75b39d4ed11c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.545751 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4023/8019] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:11 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:11.549971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc26907-463c-4be4-9488-58741c1973ea admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.561280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc26907-463c-4be4-9488-58741c1973ea admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.566102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7b5df-6161-45c4-a064-1a0312211893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.566976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7b5df-6161-45c4-a064-1a0312211893 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.567276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7b5df-6161-45c4-a064-1a0312211893 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.567572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7b5df-6161-45c4-a064-1a0312211893 admin admin] PATH_INFO: `/v3/projects/1bd85b231751413d9414b592fac22b24/users/101ee791ab56496f9cf5ebc01bec1aa7/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.569590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7b5df-6161-45c4-a064-1a0312211893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd85b231751413d9414b592fac22b24, user_id=101ee791ab56496f9cf5ebc01bec1aa7, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.572311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7b5df-6161-45c4-a064-1a0312211893 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.582515 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3997/8020] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:11 2021] PUT /identity/v3/projects/1bd85b231751413d9414b592fac22b24/users/101ee791ab56496f9cf5ebc01bec1aa7/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:11.593901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13dc64-de7e-4a17-9dfe-8bd5e9f040f8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.594161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13dc64-de7e-4a17-9dfe-8bd5e9f040f8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.594435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13dc64-de7e-4a17-9dfe-8bd5e9f040f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.622345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-af13dc64-de7e-4a17-9dfe-8bd5e9f040f8 None None] MFA Rules not processed for user `101ee791ab56496f9cf5ebc01bec1aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:11.623596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-af13dc64-de7e-4a17-9dfe-8bd5e9f040f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:11.696332 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4024/8021] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:11 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:11.701116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7b5df-6161-45c4-a064-1a0312211893 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.763832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7b5df-6161-45c4-a064-1a0312211893 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.768650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f134d9d-00ce-46b9-a334-978c54951775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.769296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f134d9d-00ce-46b9-a334-978c54951775 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.769577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f134d9d-00ce-46b9-a334-978c54951775 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.769848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f134d9d-00ce-46b9-a334-978c54951775 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.770553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f134d9d-00ce-46b9-a334-978c54951775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.772485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f134d9d-00ce-46b9-a334-978c54951775 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.798693 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3998/8022] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:11 2021] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:11.803333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13dc64-de7e-4a17-9dfe-8bd5e9f040f8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.813722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13dc64-de7e-4a17-9dfe-8bd5e9f040f8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.870387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231c1c0-a759-4c6d-81be-0055e7c61688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.870970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c1c0-a759-4c6d-81be-0055e7c61688 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.871274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c1c0-a759-4c6d-81be-0055e7c61688 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.871560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231c1c0-a759-4c6d-81be-0055e7c61688 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.872275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231c1c0-a759-4c6d-81be-0055e7c61688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.874174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231c1c0-a759-4c6d-81be-0055e7c61688 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.894215 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4025/8023] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:11 2021] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:11.900679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f134d9d-00ce-46b9-a334-978c54951775 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.910903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f134d9d-00ce-46b9-a334-978c54951775 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.916965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682fa96-015f-4d8e-85bc-db0b4e74c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.917707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fa96-015f-4d8e-85bc-db0b4e74c950 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.918049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fa96-015f-4d8e-85bc-db0b4e74c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.918388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fa96-015f-4d8e-85bc-db0b4e74c950 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.919191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682fa96-015f-4d8e-85bc-db0b4e74c950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.920900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682fa96-015f-4d8e-85bc-db0b4e74c950 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.934309 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 3999/8024] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:11.935679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231c1c0-a759-4c6d-81be-0055e7c61688 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.946344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231c1c0-a759-4c6d-81be-0055e7c61688 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.951340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebfe85-4675-495a-a0e7-759711085fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.952006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebfe85-4675-495a-a0e7-759711085fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.952336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebfe85-4675-495a-a0e7-759711085fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.952638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebfe85-4675-495a-a0e7-759711085fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:11.953505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebfe85-4675-495a-a0e7-759711085fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:11.955575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebfe85-4675-495a-a0e7-759711085fe5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:11.966803 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4026/8025] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:11 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:11.971149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682fa96-015f-4d8e-85bc-db0b4e74c950 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:11.983244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682fa96-015f-4d8e-85bc-db0b4e74c950 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:11.988979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da35e8-f6d5-4bc6-b1de-c7ff2d926413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:11.990089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da35e8-f6d5-4bc6-b1de-c7ff2d926413 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:11.990526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da35e8-f6d5-4bc6-b1de-c7ff2d926413 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:11.990965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da35e8-f6d5-4bc6-b1de-c7ff2d926413 admin admin] PATH_INFO: `/v3/projects/b409751fd4914dedaa15e5c1f4ebfa13/users/4a544443c3c241fe8af21d45bc44ebc4/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:12.011036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da35e8-f6d5-4bc6-b1de-c7ff2d926413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b409751fd4914dedaa15e5c1f4ebfa13, user_id=4a544443c3c241fe8af21d45bc44ebc4, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:12.014203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da35e8-f6d5-4bc6-b1de-c7ff2d926413 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:12.030986 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4000/8026] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:11 2021] PUT /identity/v3/projects/b409751fd4914dedaa15e5c1f4ebfa13/users/4a544443c3c241fe8af21d45bc44ebc4/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:12.041890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b870-b0c5-4b2e-bee7-4e7414bf2ea7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:12.042176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b870-b0c5-4b2e-bee7-4e7414bf2ea7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:12.042452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b870-b0c5-4b2e-bee7-4e7414bf2ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:12.068961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9037b870-b0c5-4b2e-bee7-4e7414bf2ea7 None None] MFA Rules not processed for user `4a544443c3c241fe8af21d45bc44ebc4`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:12.070170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9037b870-b0c5-4b2e-bee7-4e7414bf2ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:12.135020 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4027/8027] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:12 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:12.146993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da35e8-f6d5-4bc6-b1de-c7ff2d926413 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:12.148769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b4da35e8-f6d5-4bc6-b1de-c7ff2d926413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:12.215234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da35e8-f6d5-4bc6-b1de-c7ff2d926413 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:12.218953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacad29e-156e-4c2b-b74e-11a7aecaf109 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:12.219619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad29e-156e-4c2b-b74e-11a7aecaf109 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:12.219902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad29e-156e-4c2b-b74e-11a7aecaf109 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:12.220175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad29e-156e-4c2b-b74e-11a7aecaf109 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:12.279147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacad29e-156e-4c2b-b74e-11a7aecaf109 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:12.280673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacad29e-156e-4c2b-b74e-11a7aecaf109 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:12.289924 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4001/8028] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:12 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:12.753197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037b870-b0c5-4b2e-bee7-4e7414bf2ea7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:12.813127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037b870-b0c5-4b2e-bee7-4e7414bf2ea7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:12.818455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:12.819363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:12.819666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:12.819939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] PATH_INFO: `/v3/users/101ee791ab56496f9cf5ebc01bec1aa7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:12.821160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=101ee791ab56496f9cf5ebc01bec1aa7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:12.823148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:12.867418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101ee791ab56496f9cf5ebc01bec1aa7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:12.874434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101ee791ab56496f9cf5ebc01bec1aa7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:12.875091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101ee791ab56496f9cf5ebc01bec1aa7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:12.882640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101ee791ab56496f9cf5ebc01bec1aa7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:12.893878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101ee791ab56496f9cf5ebc01bec1aa7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:12.899702 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4028/8029] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:12 2021] DELETE /identity/v3/users/101ee791ab56496f9cf5ebc01bec1aa7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:12.904255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffa61c-5efb-490d-bec5-833f5e838d22 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:12.904543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffa61c-5efb-490d-bec5-833f5e838d22 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:12.904819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffa61c-5efb-490d-bec5-833f5e838d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:12.922092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-88ffa61c-5efb-490d-bec5-833f5e838d22 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:12.923302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-88ffa61c-5efb-490d-bec5-833f5e838d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:12.981152 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4002/8030] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:12.992379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:12.993555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:13.051751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95740e66-34d9-4f4d-8b5b-0ac4e68a49fa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:13.056055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c859a5-3f80-4d0f-bc45-1d597f28bc93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:13.056697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c859a5-3f80-4d0f-bc45-1d597f28bc93 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:13.056983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c859a5-3f80-4d0f-bc45-1d597f28bc93 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:13.057262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c859a5-3f80-4d0f-bc45-1d597f28bc93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:13.066327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c859a5-3f80-4d0f-bc45-1d597f28bc93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:13.067793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c859a5-3f80-4d0f-bc45-1d597f28bc93 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:13.077282 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4029/8031] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:13.389491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffa61c-5efb-490d-bec5-833f5e838d22 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:13.391632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-88ffa61c-5efb-490d-bec5-833f5e838d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:13.405698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffa61c-5efb-490d-bec5-833f5e838d22 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:13.410486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:13.411423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:13.412164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:13.412431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] PATH_INFO: `/v3/projects/1bd85b231751413d9414b592fac22b24` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:13.413609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bd85b231751413d9414b592fac22b24)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:13.416538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:13.477333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bd85b231751413d9414b592fac22b24', 'request_id': 'req-7bf30490-be35-4282-b850-73e895df7937'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:13.483977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bd85b231751413d9414b592fac22b24', 'request_id': 'req-7bf30490-be35-4282-b850-73e895df7937'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:13.492266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bd85b231751413d9414b592fac22b24', 'request_id': 'req-7bf30490-be35-4282-b850-73e895df7937'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:13.503020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] The token cache is being invalidate because project 1bd85b231751413d9414b592fac22b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:13.503466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:13.504127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:13.505726 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4003/8032] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:13 2021] DELETE /identity/v3/projects/1bd85b231751413d9414b592fac22b24 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:13.509641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c859a5-3f80-4d0f-bc45-1d597f28bc93 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:13.519183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c859a5-3f80-4d0f-bc45-1d597f28bc93 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:13.577534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b24ed2-8502-4af6-bb8d-c0e278708464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:13.578442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b24ed2-8502-4af6-bb8d-c0e278708464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:13.578757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b24ed2-8502-4af6-bb8d-c0e278708464 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:13.579128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b24ed2-8502-4af6-bb8d-c0e278708464 admin admin] PATH_INFO: `/v3/users/4a544443c3c241fe8af21d45bc44ebc4` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:13.580449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b24ed2-8502-4af6-bb8d-c0e278708464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a544443c3c241fe8af21d45bc44ebc4)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:13.582341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b24ed2-8502-4af6-bb8d-c0e278708464 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:13.639772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a7b24ed2-8502-4af6-bb8d-c0e278708464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a544443c3c241fe8af21d45bc44ebc4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:13.648809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a7b24ed2-8502-4af6-bb8d-c0e278708464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a544443c3c241fe8af21d45bc44ebc4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:13.649413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a7b24ed2-8502-4af6-bb8d-c0e278708464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a544443c3c241fe8af21d45bc44ebc4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:13.657580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a7b24ed2-8502-4af6-bb8d-c0e278708464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a544443c3c241fe8af21d45bc44ebc4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:13.669675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-a7b24ed2-8502-4af6-bb8d-c0e278708464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a544443c3c241fe8af21d45bc44ebc4'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:13.675500 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4030/8033] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:13 2021] DELETE /identity/v3/users/4a544443c3c241fe8af21d45bc44ebc4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:13.947029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:13.948507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:13.962432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf30490-be35-4282-b850-73e895df7937 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:14.019379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:14.020227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.020511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.020785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] PATH_INFO: `/v3/projects/b409751fd4914dedaa15e5c1f4ebfa13` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.022546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b409751fd4914dedaa15e5c1f4ebfa13)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:14.024501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:14.069850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b409751fd4914dedaa15e5c1f4ebfa13', 'request_id': 'req-55cb2298-6cab-498b-9662-74308ad866bb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:14.075840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b409751fd4914dedaa15e5c1f4ebfa13', 'request_id': 'req-55cb2298-6cab-498b-9662-74308ad866bb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:14.082989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b409751fd4914dedaa15e5c1f4ebfa13', 'request_id': 'req-55cb2298-6cab-498b-9662-74308ad866bb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:14.092688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] The token cache is being invalidate because project b409751fd4914dedaa15e5c1f4ebfa13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:14.092969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:14.093584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-55cb2298-6cab-498b-9662-74308ad866bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:14.095101 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4004/8034] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:13 2021] DELETE /identity/v3/projects/b409751fd4914dedaa15e5c1f4ebfa13 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:14.100940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a974d-eac6-42c2-9ede-bce61749d24a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.101415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a974d-eac6-42c2-9ede-bce61749d24a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.101555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a974d-eac6-42c2-9ede-bce61749d24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.120810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b64a974d-eac6-42c2-9ede-bce61749d24a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:14.122017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b64a974d-eac6-42c2-9ede-bce61749d24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:14.179059 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4031/8035] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:14.186912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae3ffc-9956-4c8d-b8a7-f7ba0de2ba69 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.187198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae3ffc-9956-4c8d-b8a7-f7ba0de2ba69 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.187499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae3ffc-9956-4c8d-b8a7-f7ba0de2ba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.206011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-82ae3ffc-9956-4c8d-b8a7-f7ba0de2ba69 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:14.207205 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-82ae3ffc-9956-4c8d-b8a7-f7ba0de2ba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:14.215214 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4005/8036] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:14.219182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a974d-eac6-42c2-9ede-bce61749d24a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:14.229239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a974d-eac6-42c2-9ede-bce61749d24a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:14.233929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110567e2-13e1-45aa-b8b3-a48531073cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:14.234578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110567e2-13e1-45aa-b8b3-a48531073cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.234867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110567e2-13e1-45aa-b8b3-a48531073cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.235145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110567e2-13e1-45aa-b8b3-a48531073cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.235926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110567e2-13e1-45aa-b8b3-a48531073cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:14.236235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110567e2-13e1-45aa-b8b3-a48531073cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:14.238082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110567e2-13e1-45aa-b8b3-a48531073cc3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:14.249889 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4032/8037] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:14.254236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae3ffc-9956-4c8d-b8a7-f7ba0de2ba69 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:14.264590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae3ffc-9956-4c8d-b8a7-f7ba0de2ba69 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:14.269303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41be2a8-df20-428d-9790-a83d77af375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:14.269954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41be2a8-df20-428d-9790-a83d77af375d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.270237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41be2a8-df20-428d-9790-a83d77af375d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.270515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41be2a8-df20-428d-9790-a83d77af375d admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.271362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41be2a8-df20-428d-9790-a83d77af375d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:14.273268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41be2a8-df20-428d-9790-a83d77af375d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:14.297486 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4006/8038] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:14 2021] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:14.301780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110567e2-13e1-45aa-b8b3-a48531073cc3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:14.312349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110567e2-13e1-45aa-b8b3-a48531073cc3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:14.368905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac285c8-a87c-44b6-983c-7f01d9531353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:14.369679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac285c8-a87c-44b6-983c-7f01d9531353 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.369964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac285c8-a87c-44b6-983c-7f01d9531353 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.370252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac285c8-a87c-44b6-983c-7f01d9531353 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.370936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac285c8-a87c-44b6-983c-7f01d9531353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:14.372987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac285c8-a87c-44b6-983c-7f01d9531353 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:14.396495 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4033/8039] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:14 2021] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:14.397724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41be2a8-df20-428d-9790-a83d77af375d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:14.408117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41be2a8-df20-428d-9790-a83d77af375d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:14.413239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e51fe-7178-4b1c-a198-d3b652605aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:14.413895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e51fe-7178-4b1c-a198-d3b652605aff admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.414174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e51fe-7178-4b1c-a198-d3b652605aff admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.414448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e51fe-7178-4b1c-a198-d3b652605aff admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.415173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e51fe-7178-4b1c-a198-d3b652605aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:14.416812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e51fe-7178-4b1c-a198-d3b652605aff admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:14.429396 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4007/8040] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:14.433907 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac285c8-a87c-44b6-983c-7f01d9531353 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:14.451150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac285c8-a87c-44b6-983c-7f01d9531353 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:14.456308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cc9c5-62e8-4935-b480-9350ac1edef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:14.456984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cc9c5-62e8-4935-b480-9350ac1edef5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.457271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cc9c5-62e8-4935-b480-9350ac1edef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.457553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cc9c5-62e8-4935-b480-9350ac1edef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.458290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cc9c5-62e8-4935-b480-9350ac1edef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:14.459986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cc9c5-62e8-4935-b480-9350ac1edef5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:14.470029 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4034/8041] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:14.474889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e51fe-7178-4b1c-a198-d3b652605aff admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:14.484985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e51fe-7178-4b1c-a198-d3b652605aff admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:14.490503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e56a13-b8c4-4de8-932a-61ef2cf5d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:14.491445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56a13-b8c4-4de8-932a-61ef2cf5d1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.491725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56a13-b8c4-4de8-932a-61ef2cf5d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.491995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56a13-b8c4-4de8-932a-61ef2cf5d1b5 admin admin] PATH_INFO: `/v3/projects/64426e9c387844e98716461e5f162da8/users/07f1361deb4b476ba440fcd49a531911/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.506868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e56a13-b8c4-4de8-932a-61ef2cf5d1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64426e9c387844e98716461e5f162da8, user_id=07f1361deb4b476ba440fcd49a531911, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:14.509705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e56a13-b8c4-4de8-932a-61ef2cf5d1b5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:14.522319 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4008/8042] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:14 2021] PUT /identity/v3/projects/64426e9c387844e98716461e5f162da8/users/07f1361deb4b476ba440fcd49a531911/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:14.533471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51417f62-8d60-44bb-b490-89cdbd5b8d06 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.533747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51417f62-8d60-44bb-b490-89cdbd5b8d06 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.534028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51417f62-8d60-44bb-b490-89cdbd5b8d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.560677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-51417f62-8d60-44bb-b490-89cdbd5b8d06 None None] MFA Rules not processed for user `07f1361deb4b476ba440fcd49a531911`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:14.561870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-51417f62-8d60-44bb-b490-89cdbd5b8d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:14.624827 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4035/8043] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:14 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:14.636594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e56a13-b8c4-4de8-932a-61ef2cf5d1b5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:14.638281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-31e56a13-b8c4-4de8-932a-61ef2cf5d1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:14.697430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e56a13-b8c4-4de8-932a-61ef2cf5d1b5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:14.701129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1354089-43a6-4d31-ad00-12f39c4ceaa2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:14.701767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354089-43a6-4d31-ad00-12f39c4ceaa2 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.702049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354089-43a6-4d31-ad00-12f39c4ceaa2 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.702323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1354089-43a6-4d31-ad00-12f39c4ceaa2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.710403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1354089-43a6-4d31-ad00-12f39c4ceaa2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:14.711862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1354089-43a6-4d31-ad00-12f39c4ceaa2 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:14.720454 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4009/8044] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:14 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:14.894795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51417f62-8d60-44bb-b490-89cdbd5b8d06 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:14.959402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51417f62-8d60-44bb-b490-89cdbd5b8d06 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:14.963886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:14.964762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:14.965037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:14.965310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] PATH_INFO: `/v3/users/07f1361deb4b476ba440fcd49a531911` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:14.966502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f1361deb4b476ba440fcd49a531911)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:14.968570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:15.017936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f1361deb4b476ba440fcd49a531911'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:15.025578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f1361deb4b476ba440fcd49a531911'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:15.026278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f1361deb4b476ba440fcd49a531911'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:15.033006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f1361deb4b476ba440fcd49a531911'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:15.044867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f1361deb4b476ba440fcd49a531911'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:15.050562 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4036/8045] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:14 2021] DELETE /identity/v3/users/07f1361deb4b476ba440fcd49a531911 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:15.055213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc20d28-faee-4170-a735-876378f358ba None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:15.055547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc20d28-faee-4170-a735-876378f358ba None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:15.055851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc20d28-faee-4170-a735-876378f358ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:15.072594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-4cc20d28-faee-4170-a735-876378f358ba None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:15.073811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4cc20d28-faee-4170-a735-876378f358ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:15.135809 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4010/8046] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:15.146273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:15.147786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:15.204626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49c3d7-95d8-4396-8807-c322983869a0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:15.208318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70ab64-b61e-4411-82c5-d8be84987c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:15.209584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70ab64-b61e-4411-82c5-d8be84987c04 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:15.209868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70ab64-b61e-4411-82c5-d8be84987c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:15.210138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70ab64-b61e-4411-82c5-d8be84987c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:15.218968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70ab64-b61e-4411-82c5-d8be84987c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:15.220423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70ab64-b61e-4411-82c5-d8be84987c04 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:15.229706 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4037/8047] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:15.493132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc20d28-faee-4170-a735-876378f358ba None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:15.495009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4cc20d28-faee-4170-a735-876378f358ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:15.510625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc20d28-faee-4170-a735-876378f358ba None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:15.515955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:15.516716 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:15.517024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:15.517267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] PATH_INFO: `/v3/projects/64426e9c387844e98716461e5f162da8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:15.518489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64426e9c387844e98716461e5f162da8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:15.520512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:15.569949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64426e9c387844e98716461e5f162da8', 'request_id': 'req-c313e02e-7637-44f2-8f25-afb9e7eeb625'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:15.576421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64426e9c387844e98716461e5f162da8', 'request_id': 'req-c313e02e-7637-44f2-8f25-afb9e7eeb625'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:15.583437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64426e9c387844e98716461e5f162da8', 'request_id': 'req-c313e02e-7637-44f2-8f25-afb9e7eeb625'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:15.593704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] The token cache is being invalidate because project 64426e9c387844e98716461e5f162da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:15.593989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:15.594651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c313e02e-7637-44f2-8f25-afb9e7eeb625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:15.596455 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4011/8048] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:15 2021] DELETE /identity/v3/projects/64426e9c387844e98716461e5f162da8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:15.601967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38014af5-68fc-44db-b115-b1acbd18d63b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:15.602252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38014af5-68fc-44db-b115-b1acbd18d63b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:15.602529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38014af5-68fc-44db-b115-b1acbd18d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:15.621064 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-38014af5-68fc-44db-b115-b1acbd18d63b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:15.622299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-38014af5-68fc-44db-b115-b1acbd18d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:15.682526 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4038/8049] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:15.690621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb14188-b437-46b4-9f49-e9507433d5e5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:15.690907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb14188-b437-46b4-9f49-e9507433d5e5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:15.691185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb14188-b437-46b4-9f49-e9507433d5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:15.710738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-beb14188-b437-46b4-9f49-e9507433d5e5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:15.712105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-beb14188-b437-46b4-9f49-e9507433d5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:15.720371 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4012/8050] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:15.724685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38014af5-68fc-44db-b115-b1acbd18d63b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:15.734271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38014af5-68fc-44db-b115-b1acbd18d63b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:15.739292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0c114-e1a7-4172-b873-9755bf0926f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:15.740457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c114-e1a7-4172-b873-9755bf0926f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:15.740738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c114-e1a7-4172-b873-9755bf0926f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:15.741014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0c114-e1a7-4172-b873-9755bf0926f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:15.741748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0c114-e1a7-4172-b873-9755bf0926f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:15.742055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0c114-e1a7-4172-b873-9755bf0926f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:15.743747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0c114-e1a7-4172-b873-9755bf0926f2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:15.759364 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4039/8051] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:20:15.760730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb14188-b437-46b4-9f49-e9507433d5e5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:15.770043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb14188-b437-46b4-9f49-e9507433d5e5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:15.774919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e584430-12cf-4207-8bb9-4b8b33a796f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:15.775545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e584430-12cf-4207-8bb9-4b8b33a796f7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:15.775832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e584430-12cf-4207-8bb9-4b8b33a796f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:15.776112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e584430-12cf-4207-8bb9-4b8b33a796f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:15.776829 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e584430-12cf-4207-8bb9-4b8b33a796f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:15.778743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e584430-12cf-4207-8bb9-4b8b33a796f7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:15.806463 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4013/8052] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:15 2021] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:15.810759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0c114-e1a7-4172-b873-9755bf0926f2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:15.821698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0c114-e1a7-4172-b873-9755bf0926f2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:15.879122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437278d-8160-4216-9fbd-d4cf6504bf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:15.879832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437278d-8160-4216-9fbd-d4cf6504bf7d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:15.880117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437278d-8160-4216-9fbd-d4cf6504bf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:15.880951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437278d-8160-4216-9fbd-d4cf6504bf7d admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:15.881667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437278d-8160-4216-9fbd-d4cf6504bf7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:15.883609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437278d-8160-4216-9fbd-d4cf6504bf7d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:15.906483 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4040/8053] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:15 2021] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:15.908147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e584430-12cf-4207-8bb9-4b8b33a796f7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:15.918917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e584430-12cf-4207-8bb9-4b8b33a796f7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:15.923937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cfe62-3c86-4999-847d-5a8b623d47b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:15.924725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cfe62-3c86-4999-847d-5a8b623d47b9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:15.925083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cfe62-3c86-4999-847d-5a8b623d47b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:15.925450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cfe62-3c86-4999-847d-5a8b623d47b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:15.926433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cfe62-3c86-4999-847d-5a8b623d47b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:15.928704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cfe62-3c86-4999-847d-5a8b623d47b9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:15.944147 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4014/8054] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:15 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:15.945388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437278d-8160-4216-9fbd-d4cf6504bf7d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:15.955454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437278d-8160-4216-9fbd-d4cf6504bf7d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:15.960463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93963-2db0-4c4e-a5b1-b37994ed4680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:15.961227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93963-2db0-4c4e-a5b1-b37994ed4680 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:15.961587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93963-2db0-4c4e-a5b1-b37994ed4680 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:15.961933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93963-2db0-4c4e-a5b1-b37994ed4680 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:15.962737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d93963-2db0-4c4e-a5b1-b37994ed4680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:15.964437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d93963-2db0-4c4e-a5b1-b37994ed4680 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:15.975218 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4041/8055] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:15.979765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cfe62-3c86-4999-847d-5a8b623d47b9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:15.991680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cfe62-3c86-4999-847d-5a8b623d47b9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:15.996569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46167d50-47b7-47e9-a008-63eba908a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:15.997535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46167d50-47b7-47e9-a008-63eba908a45e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:15.997751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46167d50-47b7-47e9-a008-63eba908a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:15.998025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46167d50-47b7-47e9-a008-63eba908a45e admin admin] PATH_INFO: `/v3/projects/60a81b3d1dd9409081cfd1c5d8a48ce7/users/e86f9adfd3be4def9c90d029cc3b687b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:16.012515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46167d50-47b7-47e9-a008-63eba908a45e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a81b3d1dd9409081cfd1c5d8a48ce7, user_id=e86f9adfd3be4def9c90d029cc3b687b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:16.015169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46167d50-47b7-47e9-a008-63eba908a45e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:16.028957 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4015/8056] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:15 2021] PUT /identity/v3/projects/60a81b3d1dd9409081cfd1c5d8a48ce7/users/e86f9adfd3be4def9c90d029cc3b687b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:16.040790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3cb23-2437-42c5-aec0-a560d399d41b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:16.041086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3cb23-2437-42c5-aec0-a560d399d41b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:16.041370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3cb23-2437-42c5-aec0-a560d399d41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:16.068110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-94f3cb23-2437-42c5-aec0-a560d399d41b None None] MFA Rules not processed for user `e86f9adfd3be4def9c90d029cc3b687b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:16.069442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-94f3cb23-2437-42c5-aec0-a560d399d41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:16.137621 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4042/8057] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:16 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:16.139030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46167d50-47b7-47e9-a008-63eba908a45e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:16.204329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46167d50-47b7-47e9-a008-63eba908a45e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:16.209754 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923bfee-8c90-4a94-b211-588b9f4dc4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:16.210471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923bfee-8c90-4a94-b211-588b9f4dc4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:16.210762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923bfee-8c90-4a94-b211-588b9f4dc4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:16.211366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923bfee-8c90-4a94-b211-588b9f4dc4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:16.211774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923bfee-8c90-4a94-b211-588b9f4dc4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:16.213697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923bfee-8c90-4a94-b211-588b9f4dc4d0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:16.240233 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4016/8058] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:16 2021] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:16.244183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3cb23-2437-42c5-aec0-a560d399d41b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:16.255636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3cb23-2437-42c5-aec0-a560d399d41b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:16.311859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fac6a-21fd-4b75-b9e4-62346dac3d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:16.312530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fac6a-21fd-4b75-b9e4-62346dac3d8b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:16.312810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fac6a-21fd-4b75-b9e4-62346dac3d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:16.313082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fac6a-21fd-4b75-b9e4-62346dac3d8b admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:16.313791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fac6a-21fd-4b75-b9e4-62346dac3d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:16.315727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fac6a-21fd-4b75-b9e4-62346dac3d8b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:16.336598 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4043/8059] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:16 2021] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:16.340547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923bfee-8c90-4a94-b211-588b9f4dc4d0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:16.354557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923bfee-8c90-4a94-b211-588b9f4dc4d0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:16.359482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b44f94-db0b-466c-b0f3-c2af9817418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:16.360293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b44f94-db0b-466c-b0f3-c2af9817418e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:16.360647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b44f94-db0b-466c-b0f3-c2af9817418e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:16.361009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b44f94-db0b-466c-b0f3-c2af9817418e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:16.361962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b44f94-db0b-466c-b0f3-c2af9817418e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:16.363946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b44f94-db0b-466c-b0f3-c2af9817418e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:16.379293 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4017/8060] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:16 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:16.381339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fac6a-21fd-4b75-b9e4-62346dac3d8b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:16.392780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fac6a-21fd-4b75-b9e4-62346dac3d8b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:16.398030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89d2c4-e639-454d-8a8c-fa6a1302c2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:16.398917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d2c4-e639-454d-8a8c-fa6a1302c2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:16.399209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d2c4-e639-454d-8a8c-fa6a1302c2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:16.399552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89d2c4-e639-454d-8a8c-fa6a1302c2ea admin admin] PATH_INFO: `/v3/projects/088ba60f4f184ce8a6e1fbc6c9f5aac0/users/ddffc1e1621d471ba25ee0ddfc897d2e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:16.414957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89d2c4-e639-454d-8a8c-fa6a1302c2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=088ba60f4f184ce8a6e1fbc6c9f5aac0, user_id=ddffc1e1621d471ba25ee0ddfc897d2e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:16.417661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89d2c4-e639-454d-8a8c-fa6a1302c2ea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:16.432204 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4044/8061] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:16 2021] PUT /identity/v3/projects/088ba60f4f184ce8a6e1fbc6c9f5aac0/users/ddffc1e1621d471ba25ee0ddfc897d2e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:16.436268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b44f94-db0b-466c-b0f3-c2af9817418e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:16.449638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b44f94-db0b-466c-b0f3-c2af9817418e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:16.507655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d5d1e-1037-4860-a243-709ed2b1bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:16.508379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d5d1e-1037-4860-a243-709ed2b1bfab admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:16.508536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d5d1e-1037-4860-a243-709ed2b1bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:16.508816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d5d1e-1037-4860-a243-709ed2b1bfab admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:16.509748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d5d1e-1037-4860-a243-709ed2b1bfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:16.511185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d5d1e-1037-4860-a243-709ed2b1bfab admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:16.522167 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4018/8062] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:16 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:20:16.526264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89d2c4-e639-454d-8a8c-fa6a1302c2ea admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:16.537301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89d2c4-e639-454d-8a8c-fa6a1302c2ea admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:16.542084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68060e-b32f-4073-a52f-22254d7ef93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:16.542962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68060e-b32f-4073-a52f-22254d7ef93e admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:16.543273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68060e-b32f-4073-a52f-22254d7ef93e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:16.543557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68060e-b32f-4073-a52f-22254d7ef93e admin admin] PATH_INFO: `/v3/projects/088ba60f4f184ce8a6e1fbc6c9f5aac0/users/ddffc1e1621d471ba25ee0ddfc897d2e/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:16.545612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68060e-b32f-4073-a52f-22254d7ef93e admin admin] RBAC: Authorizing `identity:create_grant(project_id=088ba60f4f184ce8a6e1fbc6c9f5aac0, user_id=ddffc1e1621d471ba25ee0ddfc897d2e, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:16.548319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68060e-b32f-4073-a52f-22254d7ef93e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:16.558592 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4045/8063] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:16 2021] PUT /identity/v3/projects/088ba60f4f184ce8a6e1fbc6c9f5aac0/users/ddffc1e1621d471ba25ee0ddfc897d2e/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:16.568674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5101e-54b7-482c-a39a-2c6d7facd13c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:16.568991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5101e-54b7-482c-a39a-2c6d7facd13c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:16.569272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5101e-54b7-482c-a39a-2c6d7facd13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:16.596473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f8a5101e-54b7-482c-a39a-2c6d7facd13c None None] MFA Rules not processed for user `ddffc1e1621d471ba25ee0ddfc897d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:16.597798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f8a5101e-54b7-482c-a39a-2c6d7facd13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:16.668025 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4019/8064] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:16 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:16.678533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68060e-b32f-4073-a52f-22254d7ef93e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:16.680371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6b68060e-b32f-4073-a52f-22254d7ef93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:16.738924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68060e-b32f-4073-a52f-22254d7ef93e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:16.743169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f692921-c9c0-4582-bfe2-3166dbfce83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:16.744276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f692921-c9c0-4582-bfe2-3166dbfce83d service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:16.744276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f692921-c9c0-4582-bfe2-3166dbfce83d service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:16.744456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f692921-c9c0-4582-bfe2-3166dbfce83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:16.753850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f692921-c9c0-4582-bfe2-3166dbfce83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:16.755820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f692921-c9c0-4582-bfe2-3166dbfce83d service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:16.765586 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4046/8065] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:16 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:18.696867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5101e-54b7-482c-a39a-2c6d7facd13c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:18.698673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f8a5101e-54b7-482c-a39a-2c6d7facd13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:18.713899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5101e-54b7-482c-a39a-2c6d7facd13c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:18.717660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e377e41-f59d-4e71-a388-d8c4cc7228cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:18.718353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377e41-f59d-4e71-a388-d8c4cc7228cf service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:18.718637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377e41-f59d-4e71-a388-d8c4cc7228cf service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:18.718911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377e41-f59d-4e71-a388-d8c4cc7228cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:18.774583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e377e41-f59d-4e71-a388-d8c4cc7228cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:18.776089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e377e41-f59d-4e71-a388-d8c4cc7228cf service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:18.786118 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4020/8066] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:18 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:19.542643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f692921-c9c0-4582-bfe2-3166dbfce83d service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:19.604623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f692921-c9c0-4582-bfe2-3166dbfce83d service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:19.609653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:19.610520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:19.610808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:19.611084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] PATH_INFO: `/v3/users/e86f9adfd3be4def9c90d029cc3b687b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:19.612328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86f9adfd3be4def9c90d029cc3b687b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:19.615189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:19.660103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86f9adfd3be4def9c90d029cc3b687b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:19.667379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86f9adfd3be4def9c90d029cc3b687b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:19.668029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86f9adfd3be4def9c90d029cc3b687b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:19.674799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86f9adfd3be4def9c90d029cc3b687b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:19.686711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86f9adfd3be4def9c90d029cc3b687b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:19.692482 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4047/8067] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:19 2021] DELETE /identity/v3/users/e86f9adfd3be4def9c90d029cc3b687b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:19.697184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4ef6-7ad8-40f8-ac19-9f7b0fbbf5d4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:19.697643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4ef6-7ad8-40f8-ac19-9f7b0fbbf5d4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:19.697758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4ef6-7ad8-40f8-ac19-9f7b0fbbf5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:19.714234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1fba4ef6-7ad8-40f8-ac19-9f7b0fbbf5d4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:19.715403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1fba4ef6-7ad8-40f8-ac19-9f7b0fbbf5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:19.772203 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4021/8068] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:19.782056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:19.783475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:19.840761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411b146-8535-4e4e-bc57-16c606f96220 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:19.844586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e62e0-da2f-4918-bff4-4b1234565b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:19.845231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e62e0-da2f-4918-bff4-4b1234565b5a service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:19.845514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e62e0-da2f-4918-bff4-4b1234565b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:19.845791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e62e0-da2f-4918-bff4-4b1234565b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:19.855350 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e62e0-da2f-4918-bff4-4b1234565b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:19.856763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e62e0-da2f-4918-bff4-4b1234565b5a service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:19.866811 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4048/8069] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:20:20.130354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba4ef6-7ad8-40f8-ac19-9f7b0fbbf5d4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:20.131812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1fba4ef6-7ad8-40f8-ac19-9f7b0fbbf5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:20.144440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba4ef6-7ad8-40f8-ac19-9f7b0fbbf5d4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:20.149964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:20.150987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:20.151297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:20.151579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] PATH_INFO: `/v3/projects/60a81b3d1dd9409081cfd1c5d8a48ce7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:20.152780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a81b3d1dd9409081cfd1c5d8a48ce7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:20.154734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:20.200068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a81b3d1dd9409081cfd1c5d8a48ce7', 'request_id': 'req-c0bebb05-457f-4f6e-8f6f-7581309644af'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.206066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a81b3d1dd9409081cfd1c5d8a48ce7', 'request_id': 'req-c0bebb05-457f-4f6e-8f6f-7581309644af'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.213912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a81b3d1dd9409081cfd1c5d8a48ce7', 'request_id': 'req-c0bebb05-457f-4f6e-8f6f-7581309644af'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.224482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] The token cache is being invalidate because project 60a81b3d1dd9409081cfd1c5d8a48ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:20.224771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.225412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.226969 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4022/8070] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:20 2021] DELETE /identity/v3/projects/60a81b3d1dd9409081cfd1c5d8a48ce7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:20.230941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e62e0-da2f-4918-bff4-4b1234565b5a service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:20.240841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e62e0-da2f-4918-bff4-4b1234565b5a service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:20.295377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3608b-5d9c-439e-bf5d-b6d38ffb232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:20.296233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3608b-5d9c-439e-bf5d-b6d38ffb232c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:20.296512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3608b-5d9c-439e-bf5d-b6d38ffb232c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:20.296784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3608b-5d9c-439e-bf5d-b6d38ffb232c admin admin] PATH_INFO: `/v3/users/ddffc1e1621d471ba25ee0ddfc897d2e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:20.297957 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3608b-5d9c-439e-bf5d-b6d38ffb232c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddffc1e1621d471ba25ee0ddfc897d2e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:20.299894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3608b-5d9c-439e-bf5d-b6d38ffb232c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:20.344695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94a3608b-5d9c-439e-bf5d-b6d38ffb232c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddffc1e1621d471ba25ee0ddfc897d2e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.352130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94a3608b-5d9c-439e-bf5d-b6d38ffb232c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddffc1e1621d471ba25ee0ddfc897d2e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.352793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94a3608b-5d9c-439e-bf5d-b6d38ffb232c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddffc1e1621d471ba25ee0ddfc897d2e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.359608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94a3608b-5d9c-439e-bf5d-b6d38ffb232c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddffc1e1621d471ba25ee0ddfc897d2e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.371103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-94a3608b-5d9c-439e-bf5d-b6d38ffb232c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddffc1e1621d471ba25ee0ddfc897d2e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.376834 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4049/8071] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:20 2021] DELETE /identity/v3/users/ddffc1e1621d471ba25ee0ddfc897d2e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:20.637204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:20.638696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:20.654738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bebb05-457f-4f6e-8f6f-7581309644af admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:20.711465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:20.712321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:20.712604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:20.712880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] PATH_INFO: `/v3/projects/088ba60f4f184ce8a6e1fbc6c9f5aac0` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:20.714107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=088ba60f4f184ce8a6e1fbc6c9f5aac0)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:20.716053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:20.759753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088ba60f4f184ce8a6e1fbc6c9f5aac0', 'request_id': 'req-b67dab26-a387-434c-bd15-32c75d1be306'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.765652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088ba60f4f184ce8a6e1fbc6c9f5aac0', 'request_id': 'req-b67dab26-a387-434c-bd15-32c75d1be306'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.773144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088ba60f4f184ce8a6e1fbc6c9f5aac0', 'request_id': 'req-b67dab26-a387-434c-bd15-32c75d1be306'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.782957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] The token cache is being invalidate because project 088ba60f4f184ce8a6e1fbc6c9f5aac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:20.783242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.783888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b67dab26-a387-434c-bd15-32c75d1be306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:20.785395 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4023/8072] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:20 2021] DELETE /identity/v3/projects/088ba60f4f184ce8a6e1fbc6c9f5aac0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:20.791074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978725c7-3bfa-4104-89fb-53592e52d882 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:20.791586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978725c7-3bfa-4104-89fb-53592e52d882 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:20.791732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978725c7-3bfa-4104-89fb-53592e52d882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:20.810312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-978725c7-3bfa-4104-89fb-53592e52d882 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:20.811537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-978725c7-3bfa-4104-89fb-53592e52d882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:20.868840 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4050/8073] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:20.876694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba4787-12ea-4984-831d-ac456cf3f15a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:20.876988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba4787-12ea-4984-831d-ac456cf3f15a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:20.877296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba4787-12ea-4984-831d-ac456cf3f15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:20.897501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-45ba4787-12ea-4984-831d-ac456cf3f15a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:20.898699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-45ba4787-12ea-4984-831d-ac456cf3f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:20.906577 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4024/8074] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:20.910654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978725c7-3bfa-4104-89fb-53592e52d882 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:20.921086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978725c7-3bfa-4104-89fb-53592e52d882 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:20.925800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d8a4d-429a-4920-9b8f-6ab1f3c93037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:20.926449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d8a4d-429a-4920-9b8f-6ab1f3c93037 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:20.926731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d8a4d-429a-4920-9b8f-6ab1f3c93037 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:20.927622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d8a4d-429a-4920-9b8f-6ab1f3c93037 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:20.928348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d8a4d-429a-4920-9b8f-6ab1f3c93037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:20.928653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d8a4d-429a-4920-9b8f-6ab1f3c93037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:20.930243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d8a4d-429a-4920-9b8f-6ab1f3c93037 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:20.942060 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4051/8075] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:20.947270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba4787-12ea-4984-831d-ac456cf3f15a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:20.957753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba4787-12ea-4984-831d-ac456cf3f15a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:20.962682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea96d42-2387-4613-a62b-c2597ad51c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:20.963431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea96d42-2387-4613-a62b-c2597ad51c83 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:20.963720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea96d42-2387-4613-a62b-c2597ad51c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:20.964071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea96d42-2387-4613-a62b-c2597ad51c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:20.964782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea96d42-2387-4613-a62b-c2597ad51c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:20.966756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea96d42-2387-4613-a62b-c2597ad51c83 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:20.992079 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4025/8076] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:20 2021] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:20.996429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d8a4d-429a-4920-9b8f-6ab1f3c93037 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:21.007071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d8a4d-429a-4920-9b8f-6ab1f3c93037 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:21.061347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594926d-012c-463e-b727-02901c7464fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:21.062068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594926d-012c-463e-b727-02901c7464fd admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.062356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594926d-012c-463e-b727-02901c7464fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.062643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594926d-012c-463e-b727-02901c7464fd admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.063385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594926d-012c-463e-b727-02901c7464fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:21.065340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594926d-012c-463e-b727-02901c7464fd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:21.084988 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4052/8077] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:20 2021] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:21.089077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea96d42-2387-4613-a62b-c2597ad51c83 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:21.099028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea96d42-2387-4613-a62b-c2597ad51c83 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:21.103659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db850c-882f-4194-87ca-0bc455aa80a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:21.104322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db850c-882f-4194-87ca-0bc455aa80a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.104602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db850c-882f-4194-87ca-0bc455aa80a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.104878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db850c-882f-4194-87ca-0bc455aa80a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.105607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db850c-882f-4194-87ca-0bc455aa80a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:21.107189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db850c-882f-4194-87ca-0bc455aa80a7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:21.117973 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4026/8078] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:21.121926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594926d-012c-463e-b727-02901c7464fd admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:21.132280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594926d-012c-463e-b727-02901c7464fd admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:21.136953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd0b86-c569-44c5-9cb4-11a89d46ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:21.137608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd0b86-c569-44c5-9cb4-11a89d46ddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.137883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd0b86-c569-44c5-9cb4-11a89d46ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.138161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd0b86-c569-44c5-9cb4-11a89d46ddb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.138887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd0b86-c569-44c5-9cb4-11a89d46ddb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:21.140509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd0b86-c569-44c5-9cb4-11a89d46ddb2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:21.150122 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4053/8079] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:21.154183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db850c-882f-4194-87ca-0bc455aa80a7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:21.164471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db850c-882f-4194-87ca-0bc455aa80a7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:21.169092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6ec09-a3d6-4909-a386-95e41a70489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:21.169949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6ec09-a3d6-4909-a386-95e41a70489b admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.170571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6ec09-a3d6-4909-a386-95e41a70489b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.170848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6ec09-a3d6-4909-a386-95e41a70489b admin admin] PATH_INFO: `/v3/projects/00a6c63fac464b7ebc0904761d3c1c45/users/e99713a24d934332ba4103ddbf57a93c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.185466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6ec09-a3d6-4909-a386-95e41a70489b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a6c63fac464b7ebc0904761d3c1c45, user_id=e99713a24d934332ba4103ddbf57a93c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:21.188163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6ec09-a3d6-4909-a386-95e41a70489b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:21.200432 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4027/8080] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:21 2021] PUT /identity/v3/projects/00a6c63fac464b7ebc0904761d3c1c45/users/e99713a24d934332ba4103ddbf57a93c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:21.211308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429702eb-0945-42f7-92fb-3f1add260da3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.211603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429702eb-0945-42f7-92fb-3f1add260da3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.211906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429702eb-0945-42f7-92fb-3f1add260da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.239985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-429702eb-0945-42f7-92fb-3f1add260da3 None None] MFA Rules not processed for user `e99713a24d934332ba4103ddbf57a93c`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:21.241206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-429702eb-0945-42f7-92fb-3f1add260da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:21.304500 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4054/8081] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:21 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:21.309004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6ec09-a3d6-4909-a386-95e41a70489b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:21.369604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6ec09-a3d6-4909-a386-95e41a70489b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:21.375158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f4a2f-8833-4610-8104-d91a89ac4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:21.376109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f4a2f-8833-4610-8104-d91a89ac4435 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.376400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f4a2f-8833-4610-8104-d91a89ac4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.376683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f4a2f-8833-4610-8104-d91a89ac4435 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.377389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f4a2f-8833-4610-8104-d91a89ac4435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:21.379329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f4a2f-8833-4610-8104-d91a89ac4435 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:21.406814 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4028/8082] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:21 2021] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:21.408033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429702eb-0945-42f7-92fb-3f1add260da3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:21.418965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429702eb-0945-42f7-92fb-3f1add260da3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:21.474721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c17d6-7814-4277-b77f-fa823ae9d03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:21.475434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c17d6-7814-4277-b77f-fa823ae9d03f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.475724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c17d6-7814-4277-b77f-fa823ae9d03f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.476005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c17d6-7814-4277-b77f-fa823ae9d03f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.476708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c17d6-7814-4277-b77f-fa823ae9d03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:21.478622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c17d6-7814-4277-b77f-fa823ae9d03f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:21.498906 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4055/8083] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:21 2021] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:21.502923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f4a2f-8833-4610-8104-d91a89ac4435 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:21.513190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f4a2f-8833-4610-8104-d91a89ac4435 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:21.517925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7679de5-66af-46ae-806b-67822e9fdddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:21.518577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7679de5-66af-46ae-806b-67822e9fdddb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.518872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7679de5-66af-46ae-806b-67822e9fdddb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.519150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7679de5-66af-46ae-806b-67822e9fdddb admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.519920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7679de5-66af-46ae-806b-67822e9fdddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:21.521547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7679de5-66af-46ae-806b-67822e9fdddb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:21.531834 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4029/8084] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:21.535740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c17d6-7814-4277-b77f-fa823ae9d03f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:21.545985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c17d6-7814-4277-b77f-fa823ae9d03f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:21.550628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58793b-214d-4aad-ada7-974e19737c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:21.551529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58793b-214d-4aad-ada7-974e19737c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.552410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58793b-214d-4aad-ada7-974e19737c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.552709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58793b-214d-4aad-ada7-974e19737c26 admin admin] PATH_INFO: `/v3/projects/006a789524654205ae9fe2a4b0122772/users/417612835735479590eaca820d80166d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.566795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58793b-214d-4aad-ada7-974e19737c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006a789524654205ae9fe2a4b0122772, user_id=417612835735479590eaca820d80166d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:21.569526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58793b-214d-4aad-ada7-974e19737c26 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:21.582172 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4056/8085] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:21 2021] PUT /identity/v3/projects/006a789524654205ae9fe2a4b0122772/users/417612835735479590eaca820d80166d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:21.586512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7679de5-66af-46ae-806b-67822e9fdddb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:21.596285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7679de5-66af-46ae-806b-67822e9fdddb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:21.651772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6e5db-770f-487b-9c44-7016e7182e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:21.652358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e5db-770f-487b-9c44-7016e7182e6a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.652639 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e5db-770f-487b-9c44-7016e7182e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.652911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6e5db-770f-487b-9c44-7016e7182e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.653636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6e5db-770f-487b-9c44-7016e7182e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:21.655226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6e5db-770f-487b-9c44-7016e7182e6a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:21.665454 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4030/8086] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:21 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:20:21.669555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58793b-214d-4aad-ada7-974e19737c26 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:21.679755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58793b-214d-4aad-ada7-974e19737c26 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:21.684429 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce1e61-49e1-4e2c-9af5-c38e564667a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:21.685294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce1e61-49e1-4e2c-9af5-c38e564667a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.685578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce1e61-49e1-4e2c-9af5-c38e564667a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.685853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce1e61-49e1-4e2c-9af5-c38e564667a7 admin admin] PATH_INFO: `/v3/projects/006a789524654205ae9fe2a4b0122772/users/417612835735479590eaca820d80166d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.687885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce1e61-49e1-4e2c-9af5-c38e564667a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=006a789524654205ae9fe2a4b0122772, user_id=417612835735479590eaca820d80166d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:21.690526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce1e61-49e1-4e2c-9af5-c38e564667a7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:21.700748 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4057/8087] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:21 2021] PUT /identity/v3/projects/006a789524654205ae9fe2a4b0122772/users/417612835735479590eaca820d80166d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:21.711150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5a26-10a2-4c9e-9f5f-fec104cd1d2b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.711497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5a26-10a2-4c9e-9f5f-fec104cd1d2b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.711745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5a26-10a2-4c9e-9f5f-fec104cd1d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.738240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8e1d5a26-10a2-4c9e-9f5f-fec104cd1d2b None None] MFA Rules not processed for user `417612835735479590eaca820d80166d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:21.739445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8e1d5a26-10a2-4c9e-9f5f-fec104cd1d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:21.804988 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4031/8088] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:21 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:21.815797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce1e61-49e1-4e2c-9af5-c38e564667a7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:21.817553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e1ce1e61-49e1-4e2c-9af5-c38e564667a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:21.877368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce1e61-49e1-4e2c-9af5-c38e564667a7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:21.881071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaa6b7-e010-4596-be79-045abc7fe142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:21.881711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaa6b7-e010-4596-be79-045abc7fe142 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:21.881997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaa6b7-e010-4596-be79-045abc7fe142 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:21.882274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaa6b7-e010-4596-be79-045abc7fe142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:21.891200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaa6b7-e010-4596-be79-045abc7fe142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:21.892658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaa6b7-e010-4596-be79-045abc7fe142 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:21.902493 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4058/8089] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:21 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:23.938916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d5a26-10a2-4c9e-9f5f-fec104cd1d2b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:24.000424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d5a26-10a2-4c9e-9f5f-fec104cd1d2b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:24.005587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:24.006406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:24.006686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:24.006957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] PATH_INFO: `/v3/users/e99713a24d934332ba4103ddbf57a93c` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:24.008256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99713a24d934332ba4103ddbf57a93c)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:24.010121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:24.054338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99713a24d934332ba4103ddbf57a93c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.054991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99713a24d934332ba4103ddbf57a93c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.061400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99713a24d934332ba4103ddbf57a93c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.062017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99713a24d934332ba4103ddbf57a93c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.069379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99713a24d934332ba4103ddbf57a93c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.087386 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4032/8090] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:23 2021] DELETE /identity/v3/users/e99713a24d934332ba4103ddbf57a93c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:24.092044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aa180-deaa-4176-a8e3-74687d60b19f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:24.092500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aa180-deaa-4176-a8e3-74687d60b19f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:24.092589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aa180-deaa-4176-a8e3-74687d60b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:24.109807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-698aa180-deaa-4176-a8e3-74687d60b19f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:24.110995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-698aa180-deaa-4176-a8e3-74687d60b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:24.171672 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4059/8091] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:24.182402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:24.183897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:24.242314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdcd2e-e58f-4738-97cd-c51399bf27ac admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:24.246053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5f386-fd8b-4cf0-a747-8d4d88ee8daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:24.246661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5f386-fd8b-4cf0-a747-8d4d88ee8daf service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:24.246940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5f386-fd8b-4cf0-a747-8d4d88ee8daf service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:24.247229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5f386-fd8b-4cf0-a747-8d4d88ee8daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:24.258684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5f386-fd8b-4cf0-a747-8d4d88ee8daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:24.261214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5f386-fd8b-4cf0-a747-8d4d88ee8daf service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:24.272220 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4033/8092] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:24.535399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698aa180-deaa-4176-a8e3-74687d60b19f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:24.537827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-698aa180-deaa-4176-a8e3-74687d60b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:24.550372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698aa180-deaa-4176-a8e3-74687d60b19f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:24.555656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:24.556511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:24.556815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:24.557125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] PATH_INFO: `/v3/projects/00a6c63fac464b7ebc0904761d3c1c45` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:24.558313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a6c63fac464b7ebc0904761d3c1c45)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:24.560229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:24.606548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a6c63fac464b7ebc0904761d3c1c45', 'request_id': 'req-13d56664-538d-47be-b7ba-f0ab3cf96c62'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.617736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a6c63fac464b7ebc0904761d3c1c45', 'request_id': 'req-13d56664-538d-47be-b7ba-f0ab3cf96c62'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.624528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a6c63fac464b7ebc0904761d3c1c45', 'request_id': 'req-13d56664-538d-47be-b7ba-f0ab3cf96c62'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.634708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] The token cache is being invalidate because project 00a6c63fac464b7ebc0904761d3c1c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:24.635100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.635779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.637318 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4060/8093] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:24 2021] DELETE /identity/v3/projects/00a6c63fac464b7ebc0904761d3c1c45 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:24.641690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5f386-fd8b-4cf0-a747-8d4d88ee8daf service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:24.651929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5f386-fd8b-4cf0-a747-8d4d88ee8daf service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:24.707352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71932400-7174-429e-9c32-5841460cc89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:24.708713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71932400-7174-429e-9c32-5841460cc89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:24.709005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71932400-7174-429e-9c32-5841460cc89f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:24.709282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71932400-7174-429e-9c32-5841460cc89f admin admin] PATH_INFO: `/v3/users/417612835735479590eaca820d80166d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:24.710474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71932400-7174-429e-9c32-5841460cc89f admin admin] RBAC: Authorizing `identity:delete_user(user_id=417612835735479590eaca820d80166d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:24.712454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71932400-7174-429e-9c32-5841460cc89f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:24.757881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71932400-7174-429e-9c32-5841460cc89f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417612835735479590eaca820d80166d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.758558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71932400-7174-429e-9c32-5841460cc89f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417612835735479590eaca820d80166d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.765236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71932400-7174-429e-9c32-5841460cc89f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417612835735479590eaca820d80166d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.765925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71932400-7174-429e-9c32-5841460cc89f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417612835735479590eaca820d80166d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.773153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-71932400-7174-429e-9c32-5841460cc89f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417612835735479590eaca820d80166d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:24.790092 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4034/8094] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:24 2021] DELETE /identity/v3/users/417612835735479590eaca820d80166d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:24.957149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:24.959547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:24.974989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d56664-538d-47be-b7ba-f0ab3cf96c62 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.032375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.033233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.033514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.033787 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] PATH_INFO: `/v3/projects/006a789524654205ae9fe2a4b0122772` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.035006 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=006a789524654205ae9fe2a4b0122772)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.036939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.081315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '006a789524654205ae9fe2a4b0122772', 'request_id': 'req-39028e89-c1b9-4aa6-86b4-5c41ed515933'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:25.089040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '006a789524654205ae9fe2a4b0122772', 'request_id': 'req-39028e89-c1b9-4aa6-86b4-5c41ed515933'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:25.095110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '006a789524654205ae9fe2a4b0122772', 'request_id': 'req-39028e89-c1b9-4aa6-86b4-5c41ed515933'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:25.105162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] The token cache is being invalidate because project 006a789524654205ae9fe2a4b0122772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:25.105447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:25.106091 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-39028e89-c1b9-4aa6-86b4-5c41ed515933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:25.107666 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4061/8095] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:24 2021] DELETE /identity/v3/projects/006a789524654205ae9fe2a4b0122772 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:25.113847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9715af-49ac-4978-b05e-0cdaabcd6b69 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.114332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9715af-49ac-4978-b05e-0cdaabcd6b69 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.114438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9715af-49ac-4978-b05e-0cdaabcd6b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.132344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6e9715af-49ac-4978-b05e-0cdaabcd6b69 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:25.133548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6e9715af-49ac-4978-b05e-0cdaabcd6b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:25.191194 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4035/8096] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:25.199645 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41668fc-205a-4ad5-8581-fae26648d9f2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.199934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41668fc-205a-4ad5-8581-fae26648d9f2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.200232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41668fc-205a-4ad5-8581-fae26648d9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.218363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f41668fc-205a-4ad5-8581-fae26648d9f2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:25.219631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f41668fc-205a-4ad5-8581-fae26648d9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:25.227375 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4062/8097] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:25.231348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9715af-49ac-4978-b05e-0cdaabcd6b69 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:25.241361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9715af-49ac-4978-b05e-0cdaabcd6b69 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.245906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107046cb-a793-4c6c-80b6-e54831a53a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.246552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107046cb-a793-4c6c-80b6-e54831a53a6f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.246836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107046cb-a793-4c6c-80b6-e54831a53a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.247135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107046cb-a793-4c6c-80b6-e54831a53a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.247903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107046cb-a793-4c6c-80b6-e54831a53a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:25.248214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107046cb-a793-4c6c-80b6-e54831a53a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.249821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107046cb-a793-4c6c-80b6-e54831a53a6f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.261633 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4036/8098] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:20:25.266598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41668fc-205a-4ad5-8581-fae26648d9f2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:25.276476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41668fc-205a-4ad5-8581-fae26648d9f2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.281128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b672a4-6d5d-4f26-9dfa-7e84e30a51ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.281767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b672a4-6d5d-4f26-9dfa-7e84e30a51ca admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.282047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b672a4-6d5d-4f26-9dfa-7e84e30a51ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.282320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b672a4-6d5d-4f26-9dfa-7e84e30a51ca admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.283025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b672a4-6d5d-4f26-9dfa-7e84e30a51ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.284945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b672a4-6d5d-4f26-9dfa-7e84e30a51ca admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.309407 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4063/8099] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:25 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:25.313454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107046cb-a793-4c6c-80b6-e54831a53a6f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:25.324470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107046cb-a793-4c6c-80b6-e54831a53a6f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.387690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b882f-112b-4382-aebd-7cd2ce36dd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.388273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b882f-112b-4382-aebd-7cd2ce36dd4a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.388558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b882f-112b-4382-aebd-7cd2ce36dd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.388835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b882f-112b-4382-aebd-7cd2ce36dd4a admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.389534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b882f-112b-4382-aebd-7cd2ce36dd4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.391493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b882f-112b-4382-aebd-7cd2ce36dd4a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.410438 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4037/8100] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:25 2021] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:25.414638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b672a4-6d5d-4f26-9dfa-7e84e30a51ca admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:25.424852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b672a4-6d5d-4f26-9dfa-7e84e30a51ca admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.430028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d556e-f2c4-42cf-9364-71195ec5ec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.430689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d556e-f2c4-42cf-9364-71195ec5ec03 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.430973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d556e-f2c4-42cf-9364-71195ec5ec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.431263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d556e-f2c4-42cf-9364-71195ec5ec03 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.432011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d556e-f2c4-42cf-9364-71195ec5ec03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.433612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d556e-f2c4-42cf-9364-71195ec5ec03 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.445025 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4064/8101] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:25.453252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b882f-112b-4382-aebd-7cd2ce36dd4a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:25.464247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b882f-112b-4382-aebd-7cd2ce36dd4a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.468921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4b9f8-7d56-4961-ad09-adc8937ced72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.469577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4b9f8-7d56-4961-ad09-adc8937ced72 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.469858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4b9f8-7d56-4961-ad09-adc8937ced72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.470134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4b9f8-7d56-4961-ad09-adc8937ced72 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.470860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4b9f8-7d56-4961-ad09-adc8937ced72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.472499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4b9f8-7d56-4961-ad09-adc8937ced72 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.482328 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4038/8102] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:25.486472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d556e-f2c4-42cf-9364-71195ec5ec03 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:25.497000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d556e-f2c4-42cf-9364-71195ec5ec03 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.501572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b24ac3-de79-4805-9e70-dcf3527b8c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.502437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b24ac3-de79-4805-9e70-dcf3527b8c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.502719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b24ac3-de79-4805-9e70-dcf3527b8c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.502992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b24ac3-de79-4805-9e70-dcf3527b8c69 admin admin] PATH_INFO: `/v3/projects/5a71a6fb013d43e79c863687345cda56/users/6d0885a19129448aa60a61957d906604/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.517669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b24ac3-de79-4805-9e70-dcf3527b8c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a71a6fb013d43e79c863687345cda56, user_id=6d0885a19129448aa60a61957d906604, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.520464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b24ac3-de79-4805-9e70-dcf3527b8c69 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.533047 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4065/8103] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:25 2021] PUT /identity/v3/projects/5a71a6fb013d43e79c863687345cda56/users/6d0885a19129448aa60a61957d906604/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:25.543914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128591c-d91e-4cf5-b3bf-c56755358d1e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.544235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128591c-d91e-4cf5-b3bf-c56755358d1e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.544518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128591c-d91e-4cf5-b3bf-c56755358d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.571691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3128591c-d91e-4cf5-b3bf-c56755358d1e None None] MFA Rules not processed for user `6d0885a19129448aa60a61957d906604`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:25.572897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3128591c-d91e-4cf5-b3bf-c56755358d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:25.634757 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4039/8104] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:25 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:25.639446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b24ac3-de79-4805-9e70-dcf3527b8c69 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:25.698979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b24ac3-de79-4805-9e70-dcf3527b8c69 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.703641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d3507-c3d9-4a9c-8898-20c9b415ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.704287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3507-c3d9-4a9c-8898-20c9b415ef73 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.704573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3507-c3d9-4a9c-8898-20c9b415ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.704851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3507-c3d9-4a9c-8898-20c9b415ef73 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.705554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d3507-c3d9-4a9c-8898-20c9b415ef73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.707652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d3507-c3d9-4a9c-8898-20c9b415ef73 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.731707 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4066/8105] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:25 2021] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:25.735719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128591c-d91e-4cf5-b3bf-c56755358d1e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:25.747238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128591c-d91e-4cf5-b3bf-c56755358d1e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.802700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4da7f-9ef1-49de-906e-a2c55f3f2548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.803451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4da7f-9ef1-49de-906e-a2c55f3f2548 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.803737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4da7f-9ef1-49de-906e-a2c55f3f2548 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.804016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4da7f-9ef1-49de-906e-a2c55f3f2548 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.804725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4da7f-9ef1-49de-906e-a2c55f3f2548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.807264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4da7f-9ef1-49de-906e-a2c55f3f2548 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.826701 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4040/8106] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:25 2021] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:25.830754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d3507-c3d9-4a9c-8898-20c9b415ef73 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:25.841069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d3507-c3d9-4a9c-8898-20c9b415ef73 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.845757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4adb77-98bf-4931-8b03-27534815e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.846444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4adb77-98bf-4931-8b03-27534815e852 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.846726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4adb77-98bf-4931-8b03-27534815e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.846999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4adb77-98bf-4931-8b03-27534815e852 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.847795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4adb77-98bf-4931-8b03-27534815e852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.849903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4adb77-98bf-4931-8b03-27534815e852 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.860524 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4067/8107] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:20:25.865404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4da7f-9ef1-49de-906e-a2c55f3f2548 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:25.875055 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4da7f-9ef1-49de-906e-a2c55f3f2548 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.879706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a0e82-16de-474a-9ba9-1832bebf271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.880589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a0e82-16de-474a-9ba9-1832bebf271f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.880873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a0e82-16de-474a-9ba9-1832bebf271f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.881152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a0e82-16de-474a-9ba9-1832bebf271f admin admin] PATH_INFO: `/v3/projects/a7e26109b6e94087b638eb7f81a508a1/users/bd87494842814794846f1cb90285d99b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.895582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a0e82-16de-474a-9ba9-1832bebf271f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e26109b6e94087b638eb7f81a508a1, user_id=bd87494842814794846f1cb90285d99b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.898234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a0e82-16de-474a-9ba9-1832bebf271f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.910674 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4041/8108] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:25 2021] PUT /identity/v3/projects/a7e26109b6e94087b638eb7f81a508a1/users/bd87494842814794846f1cb90285d99b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:25.915164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4adb77-98bf-4931-8b03-27534815e852 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:25.925103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4adb77-98bf-4931-8b03-27534815e852 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:25.979753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c1551-69b7-47e2-8600-b6917af912a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:25.980414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c1551-69b7-47e2-8600-b6917af912a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:25.980702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c1551-69b7-47e2-8600-b6917af912a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:25.980986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c1551-69b7-47e2-8600-b6917af912a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:25.981713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c1551-69b7-47e2-8600-b6917af912a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:25.983327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c1551-69b7-47e2-8600-b6917af912a8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:25.993675 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4068/8109] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:25.997862 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a0e82-16de-474a-9ba9-1832bebf271f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:26.008028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a0e82-16de-474a-9ba9-1832bebf271f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:26.012847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16acec-4f02-420c-bf7c-4bb2c3d55ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:26.013748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16acec-4f02-420c-bf7c-4bb2c3d55ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:26.014391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16acec-4f02-420c-bf7c-4bb2c3d55ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:26.014679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16acec-4f02-420c-bf7c-4bb2c3d55ffc admin admin] PATH_INFO: `/v3/projects/a7e26109b6e94087b638eb7f81a508a1/users/bd87494842814794846f1cb90285d99b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:26.016685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16acec-4f02-420c-bf7c-4bb2c3d55ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e26109b6e94087b638eb7f81a508a1, user_id=bd87494842814794846f1cb90285d99b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:26.019419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16acec-4f02-420c-bf7c-4bb2c3d55ffc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:26.029392 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4042/8110] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:25 2021] PUT /identity/v3/projects/a7e26109b6e94087b638eb7f81a508a1/users/bd87494842814794846f1cb90285d99b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:26.039916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a7619-8bb8-4719-b92f-7afb4f0e46f6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:26.040203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a7619-8bb8-4719-b92f-7afb4f0e46f6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:26.040498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a7619-8bb8-4719-b92f-7afb4f0e46f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:26.068401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-751a7619-8bb8-4719-b92f-7afb4f0e46f6 None None] MFA Rules not processed for user `bd87494842814794846f1cb90285d99b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:26.069600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-751a7619-8bb8-4719-b92f-7afb4f0e46f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:26.140084 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4069/8111] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:26 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:26.151495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16acec-4f02-420c-bf7c-4bb2c3d55ffc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:26.153236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6a16acec-4f02-420c-bf7c-4bb2c3d55ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:26.210712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16acec-4f02-420c-bf7c-4bb2c3d55ffc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:26.214327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d9ddd-faa3-4f48-a838-1f68fe2b682a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:26.214952 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9ddd-faa3-4f48-a838-1f68fe2b682a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:26.215232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9ddd-faa3-4f48-a838-1f68fe2b682a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:26.215531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9ddd-faa3-4f48-a838-1f68fe2b682a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:26.224772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d9ddd-faa3-4f48-a838-1f68fe2b682a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:26.226221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d9ddd-faa3-4f48-a838-1f68fe2b682a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:26.235636 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4043/8112] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:26 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:20:27.931707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a7619-8bb8-4719-b92f-7afb4f0e46f6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:27.994239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a7619-8bb8-4719-b92f-7afb4f0e46f6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:27.998741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:27.999641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:27.999925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:28.000202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] PATH_INFO: `/v3/users/6d0885a19129448aa60a61957d906604` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:28.001405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0885a19129448aa60a61957d906604)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:28.003338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:28.046228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0885a19129448aa60a61957d906604'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.053972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0885a19129448aa60a61957d906604'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.054596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0885a19129448aa60a61957d906604'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.061315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0885a19129448aa60a61957d906604'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.072446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0885a19129448aa60a61957d906604'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.078128 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4070/8113] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:27 2021] DELETE /identity/v3/users/6d0885a19129448aa60a61957d906604 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:28.082812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d7423-7083-4161-9aff-4f0a2b385352 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:28.083298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d7423-7083-4161-9aff-4f0a2b385352 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:28.083415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d7423-7083-4161-9aff-4f0a2b385352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:28.102557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0a3d7423-7083-4161-9aff-4f0a2b385352 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:28.103791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0a3d7423-7083-4161-9aff-4f0a2b385352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:28.163777 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4044/8114] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:28.173675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:28.175069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:28.233112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145d5bd-fb6f-4dcf-a244-7531b62422a0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:28.236743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f342f-6ad3-459a-a717-9956f3d2e02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:28.237377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f342f-6ad3-459a-a717-9956f3d2e02e service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:28.237934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f342f-6ad3-459a-a717-9956f3d2e02e service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:28.238189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f342f-6ad3-459a-a717-9956f3d2e02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:28.247709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f342f-6ad3-459a-a717-9956f3d2e02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:28.249130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f342f-6ad3-459a-a717-9956f3d2e02e service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:28.258544 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4071/8115] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:20:28.518675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d7423-7083-4161-9aff-4f0a2b385352 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:28.520169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0a3d7423-7083-4161-9aff-4f0a2b385352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:28.533702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d7423-7083-4161-9aff-4f0a2b385352 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:28.539957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:28.540812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:28.541096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:28.541356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] PATH_INFO: `/v3/projects/5a71a6fb013d43e79c863687345cda56` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:28.543099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a71a6fb013d43e79c863687345cda56)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:28.545079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:28.590445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a71a6fb013d43e79c863687345cda56', 'request_id': 'req-b38443e3-0054-4156-9d8a-feed81c36fec'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.596621 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a71a6fb013d43e79c863687345cda56', 'request_id': 'req-b38443e3-0054-4156-9d8a-feed81c36fec'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.604222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a71a6fb013d43e79c863687345cda56', 'request_id': 'req-b38443e3-0054-4156-9d8a-feed81c36fec'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.614242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] The token cache is being invalidate because project 5a71a6fb013d43e79c863687345cda56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:28.614523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.615137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.616681 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4045/8116] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:28 2021] DELETE /identity/v3/projects/5a71a6fb013d43e79c863687345cda56 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:28.620784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f342f-6ad3-459a-a717-9956f3d2e02e service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:28.630293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f342f-6ad3-459a-a717-9956f3d2e02e service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:28.684757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbe822-befd-4ff6-a709-413a1912cfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:28.685615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbe822-befd-4ff6-a709-413a1912cfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:28.685899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbe822-befd-4ff6-a709-413a1912cfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:28.686175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbe822-befd-4ff6-a709-413a1912cfbb admin admin] PATH_INFO: `/v3/users/bd87494842814794846f1cb90285d99b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:28.687407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbe822-befd-4ff6-a709-413a1912cfbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd87494842814794846f1cb90285d99b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:28.689310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbe822-befd-4ff6-a709-413a1912cfbb admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:28.733506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ffcbe822-befd-4ff6-a709-413a1912cfbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd87494842814794846f1cb90285d99b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.740149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ffcbe822-befd-4ff6-a709-413a1912cfbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd87494842814794846f1cb90285d99b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.740827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ffcbe822-befd-4ff6-a709-413a1912cfbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd87494842814794846f1cb90285d99b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.747784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ffcbe822-befd-4ff6-a709-413a1912cfbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd87494842814794846f1cb90285d99b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.759954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ffcbe822-befd-4ff6-a709-413a1912cfbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd87494842814794846f1cb90285d99b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:28.765695 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4072/8117] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:28 2021] DELETE /identity/v3/users/bd87494842814794846f1cb90285d99b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:28.930601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:28.932442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:28.946969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38443e3-0054-4156-9d8a-feed81c36fec admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:29.004375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:29.005261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:29.005538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:29.005808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] PATH_INFO: `/v3/projects/a7e26109b6e94087b638eb7f81a508a1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:29.007643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e26109b6e94087b638eb7f81a508a1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:29.009579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:29.055626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e26109b6e94087b638eb7f81a508a1', 'request_id': 'req-27e91666-8dc7-406f-9afa-1bc87fdb214a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:29.061523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e26109b6e94087b638eb7f81a508a1', 'request_id': 'req-27e91666-8dc7-406f-9afa-1bc87fdb214a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:29.068519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e26109b6e94087b638eb7f81a508a1', 'request_id': 'req-27e91666-8dc7-406f-9afa-1bc87fdb214a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:29.079035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] The token cache is being invalidate because project a7e26109b6e94087b638eb7f81a508a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:29.079349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:29.079968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-27e91666-8dc7-406f-9afa-1bc87fdb214a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:29.081499 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4046/8118] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:28 2021] DELETE /identity/v3/projects/a7e26109b6e94087b638eb7f81a508a1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:29.087470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7fbd5-4e25-446b-9997-3eb3d28d0b8a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:29.087944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7fbd5-4e25-446b-9997-3eb3d28d0b8a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:29.088052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7fbd5-4e25-446b-9997-3eb3d28d0b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:29.106049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8ff7fbd5-4e25-446b-9997-3eb3d28d0b8a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:29.107280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8ff7fbd5-4e25-446b-9997-3eb3d28d0b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:29.169327 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4073/8119] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:29.177410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274ccc5-3550-4ea2-b71e-e4aeea1cfed4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:29.177883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274ccc5-3550-4ea2-b71e-e4aeea1cfed4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:29.178523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274ccc5-3550-4ea2-b71e-e4aeea1cfed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:29.197127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b274ccc5-3550-4ea2-b71e-e4aeea1cfed4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:29.198307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b274ccc5-3550-4ea2-b71e-e4aeea1cfed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:29.206352 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4047/8120] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:29.212280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7fbd5-4e25-446b-9997-3eb3d28d0b8a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:29.222203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7fbd5-4e25-446b-9997-3eb3d28d0b8a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:29.226999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f9ecc-f5c4-447f-838d-930fd5e004c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:29.227681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f9ecc-f5c4-447f-838d-930fd5e004c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:29.227959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f9ecc-f5c4-447f-838d-930fd5e004c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:29.228231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f9ecc-f5c4-447f-838d-930fd5e004c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:29.228960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f9ecc-f5c4-447f-838d-930fd5e004c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:29.229265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f9ecc-f5c4-447f-838d-930fd5e004c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:29.230865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f9ecc-f5c4-447f-838d-930fd5e004c5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:29.243212 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4074/8121] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:29.247497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274ccc5-3550-4ea2-b71e-e4aeea1cfed4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:29.257233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274ccc5-3550-4ea2-b71e-e4aeea1cfed4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:29.261883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158860d-0c1e-4ac9-9ce8-b26681f3846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:29.262519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158860d-0c1e-4ac9-9ce8-b26681f3846c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:29.262799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158860d-0c1e-4ac9-9ce8-b26681f3846c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:29.263072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158860d-0c1e-4ac9-9ce8-b26681f3846c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:29.263808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158860d-0c1e-4ac9-9ce8-b26681f3846c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:29.265755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158860d-0c1e-4ac9-9ce8-b26681f3846c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:29.290004 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4048/8122] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:29 2021] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:29.293894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f9ecc-f5c4-447f-838d-930fd5e004c5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:29.304199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f9ecc-f5c4-447f-838d-930fd5e004c5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:29.358437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b7766-edf4-45d7-9016-13b0ddb8d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:29.359115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b7766-edf4-45d7-9016-13b0ddb8d9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:29.359434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b7766-edf4-45d7-9016-13b0ddb8d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:29.359721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b7766-edf4-45d7-9016-13b0ddb8d9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:29.360413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b7766-edf4-45d7-9016-13b0ddb8d9a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:29.362323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b7766-edf4-45d7-9016-13b0ddb8d9a9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:29.382587 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4075/8123] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:29 2021] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:29.388493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158860d-0c1e-4ac9-9ce8-b26681f3846c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:29.398828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158860d-0c1e-4ac9-9ce8-b26681f3846c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:29.403482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f208e8-f448-4001-82bc-63707407f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:29.404133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f208e8-f448-4001-82bc-63707407f7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:29.404417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f208e8-f448-4001-82bc-63707407f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:29.404692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f208e8-f448-4001-82bc-63707407f7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:29.405418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f208e8-f448-4001-82bc-63707407f7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:29.407042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f208e8-f448-4001-82bc-63707407f7b7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:29.417712 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4049/8124] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:20:29.421664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b7766-edf4-45d7-9016-13b0ddb8d9a9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:29.433368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b7766-edf4-45d7-9016-13b0ddb8d9a9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:29.438118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75858-6c5e-4b06-9b44-226984238eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:29.438774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75858-6c5e-4b06-9b44-226984238eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:29.439062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75858-6c5e-4b06-9b44-226984238eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:29.439377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75858-6c5e-4b06-9b44-226984238eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:29.440116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75858-6c5e-4b06-9b44-226984238eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:29.441720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75858-6c5e-4b06-9b44-226984238eb9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:29.451817 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4076/8125] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:29.456361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f208e8-f448-4001-82bc-63707407f7b7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:29.466929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f208e8-f448-4001-82bc-63707407f7b7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:29.471728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45757e0-5f55-4884-bef4-0a3f795c0592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:29.472799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45757e0-5f55-4884-bef4-0a3f795c0592 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:29.473080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45757e0-5f55-4884-bef4-0a3f795c0592 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:29.473358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45757e0-5f55-4884-bef4-0a3f795c0592 admin admin] PATH_INFO: `/v3/projects/f3df5d783c964d2c963b1f31d5872a3f/users/a273c15d14cf4b80804ff3eef0e11194/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:29.488973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45757e0-5f55-4884-bef4-0a3f795c0592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3df5d783c964d2c963b1f31d5872a3f, user_id=a273c15d14cf4b80804ff3eef0e11194, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:29.492509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45757e0-5f55-4884-bef4-0a3f795c0592 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:29.505250 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4050/8126] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:29 2021] PUT /identity/v3/projects/f3df5d783c964d2c963b1f31d5872a3f/users/a273c15d14cf4b80804ff3eef0e11194/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:29.516437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f359bc6-5508-4584-a33c-69108e78d64b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:29.516661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f359bc6-5508-4584-a33c-69108e78d64b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:29.516935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f359bc6-5508-4584-a33c-69108e78d64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:29.542891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-3f359bc6-5508-4584-a33c-69108e78d64b None None] MFA Rules not processed for user `a273c15d14cf4b80804ff3eef0e11194`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:29.544108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3f359bc6-5508-4584-a33c-69108e78d64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:29.606289 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4077/8127] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:29 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:29.617940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45757e0-5f55-4884-bef4-0a3f795c0592 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:29.619658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b45757e0-5f55-4884-bef4-0a3f795c0592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:29.676613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45757e0-5f55-4884-bef4-0a3f795c0592 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:29.680992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b45abc-1c49-46b5-a94d-d365558d18cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:29.681630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45abc-1c49-46b5-a94d-d365558d18cc service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:29.681915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45abc-1c49-46b5-a94d-d365558d18cc service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:29.682191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45abc-1c49-46b5-a94d-d365558d18cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:29.690430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b45abc-1c49-46b5-a94d-d365558d18cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:29.691905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b45abc-1c49-46b5-a94d-d365558d18cc service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:29.700541 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4051/8128] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:29 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:30.200546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f359bc6-5508-4584-a33c-69108e78d64b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:30.264263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f359bc6-5508-4584-a33c-69108e78d64b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:30.269117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:30.269987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:30.270326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:30.270623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] PATH_INFO: `/v3/users/a273c15d14cf4b80804ff3eef0e11194` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:30.272533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a273c15d14cf4b80804ff3eef0e11194)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:30.274456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:30.319371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a273c15d14cf4b80804ff3eef0e11194'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:30.326521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a273c15d14cf4b80804ff3eef0e11194'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:30.327160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a273c15d14cf4b80804ff3eef0e11194'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:30.333866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a273c15d14cf4b80804ff3eef0e11194'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:30.346228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a273c15d14cf4b80804ff3eef0e11194'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:30.352031 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4078/8129] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:30 2021] DELETE /identity/v3/users/a273c15d14cf4b80804ff3eef0e11194 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:30.356696 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0742494-bc27-4664-bc12-73bf82107db4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:30.357151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0742494-bc27-4664-bc12-73bf82107db4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:30.357261 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0742494-bc27-4664-bc12-73bf82107db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:30.374200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e0742494-bc27-4664-bc12-73bf82107db4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:30.375430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e0742494-bc27-4664-bc12-73bf82107db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:30.433384 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4052/8130] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:30.444246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:30.445656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:30.505179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4a749-869c-4ed4-83cf-9bed81d09aaa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:30.509497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f53149-d5cd-4d10-a6a1-b3a59f777f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:30.510138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f53149-d5cd-4d10-a6a1-b3a59f777f5a service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:30.510423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f53149-d5cd-4d10-a6a1-b3a59f777f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:30.510696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f53149-d5cd-4d10-a6a1-b3a59f777f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:30.520181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f53149-d5cd-4d10-a6a1-b3a59f777f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:30.523318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f53149-d5cd-4d10-a6a1-b3a59f777f5a service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:30.535934 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4079/8131] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:30.794552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0742494-bc27-4664-bc12-73bf82107db4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:30.796595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e0742494-bc27-4664-bc12-73bf82107db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:30.810442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0742494-bc27-4664-bc12-73bf82107db4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:30.815707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:30.816982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:30.817264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:30.817770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] PATH_INFO: `/v3/projects/f3df5d783c964d2c963b1f31d5872a3f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:30.819495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3df5d783c964d2c963b1f31d5872a3f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:30.821430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:30.870059 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3df5d783c964d2c963b1f31d5872a3f', 'request_id': 'req-0106529d-9859-4395-995e-1e57060eff5b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:30.876106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3df5d783c964d2c963b1f31d5872a3f', 'request_id': 'req-0106529d-9859-4395-995e-1e57060eff5b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:30.884274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3df5d783c964d2c963b1f31d5872a3f', 'request_id': 'req-0106529d-9859-4395-995e-1e57060eff5b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:30.894570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] The token cache is being invalidate because project f3df5d783c964d2c963b1f31d5872a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:30.894857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:30.895511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0106529d-9859-4395-995e-1e57060eff5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:30.897053 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4053/8132] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:30 2021] DELETE /identity/v3/projects/f3df5d783c964d2c963b1f31d5872a3f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:30.903580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d800303-7c39-433e-bd5a-4d4f5422e642 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:30.903887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d800303-7c39-433e-bd5a-4d4f5422e642 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:30.904150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d800303-7c39-433e-bd5a-4d4f5422e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:30.922614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2d800303-7c39-433e-bd5a-4d4f5422e642 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:30.923820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2d800303-7c39-433e-bd5a-4d4f5422e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:30.983538 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4080/8133] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:30.992343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22fa8b-3af3-4954-9ce6-1f754609f089 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:30.992625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22fa8b-3af3-4954-9ce6-1f754609f089 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:30.992895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22fa8b-3af3-4954-9ce6-1f754609f089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:31.011021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ef22fa8b-3af3-4954-9ce6-1f754609f089 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:31.012249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ef22fa8b-3af3-4954-9ce6-1f754609f089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:31.020674 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4054/8134] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:31.024819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d800303-7c39-433e-bd5a-4d4f5422e642 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:31.034260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d800303-7c39-433e-bd5a-4d4f5422e642 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:31.039546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57324a1-e853-4a83-ae6c-fea79f1d9785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:31.040132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57324a1-e853-4a83-ae6c-fea79f1d9785 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:31.040411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57324a1-e853-4a83-ae6c-fea79f1d9785 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:31.040681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57324a1-e853-4a83-ae6c-fea79f1d9785 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:31.041401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57324a1-e853-4a83-ae6c-fea79f1d9785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:31.041704 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57324a1-e853-4a83-ae6c-fea79f1d9785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:31.043333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57324a1-e853-4a83-ae6c-fea79f1d9785 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:31.056113 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4081/8135] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:31.060128 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22fa8b-3af3-4954-9ce6-1f754609f089 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:31.069178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22fa8b-3af3-4954-9ce6-1f754609f089 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:31.074100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53ce9b-0eff-4c60-87cc-85a6ddf40a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:31.074737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53ce9b-0eff-4c60-87cc-85a6ddf40a4c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:31.075019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53ce9b-0eff-4c60-87cc-85a6ddf40a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:31.075326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53ce9b-0eff-4c60-87cc-85a6ddf40a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:31.076026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53ce9b-0eff-4c60-87cc-85a6ddf40a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:31.077913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53ce9b-0eff-4c60-87cc-85a6ddf40a4c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:31.103081 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4055/8136] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:31 2021] POST /identity/v3/projects => generated 389 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:31.107140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57324a1-e853-4a83-ae6c-fea79f1d9785 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:31.117627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57324a1-e853-4a83-ae6c-fea79f1d9785 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:31.171522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d0c1d-dcbf-46d3-8594-1ee025d95e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:31.172368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d0c1d-dcbf-46d3-8594-1ee025d95e63 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:31.172652 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d0c1d-dcbf-46d3-8594-1ee025d95e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:31.172924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d0c1d-dcbf-46d3-8594-1ee025d95e63 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:31.173659 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d0c1d-dcbf-46d3-8594-1ee025d95e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:31.175992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d0c1d-dcbf-46d3-8594-1ee025d95e63 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:31.198049 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4082/8137] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:31 2021] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:20:31.202265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53ce9b-0eff-4c60-87cc-85a6ddf40a4c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:31.212529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53ce9b-0eff-4c60-87cc-85a6ddf40a4c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:31.217131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe08ea-d7f6-47f6-959f-4186b62c7251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:31.217781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe08ea-d7f6-47f6-959f-4186b62c7251 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:31.218066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe08ea-d7f6-47f6-959f-4186b62c7251 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:31.218344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe08ea-d7f6-47f6-959f-4186b62c7251 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:31.219066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe08ea-d7f6-47f6-959f-4186b62c7251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:31.220712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe08ea-d7f6-47f6-959f-4186b62c7251 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:31.231354 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4056/8138] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:31 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:31.235202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d0c1d-dcbf-46d3-8594-1ee025d95e63 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:31.245698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d0c1d-dcbf-46d3-8594-1ee025d95e63 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:31.250264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899ed0e-8ed4-438e-acd7-378cd5c80c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:31.250905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899ed0e-8ed4-438e-acd7-378cd5c80c99 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:31.251313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899ed0e-8ed4-438e-acd7-378cd5c80c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:31.251616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899ed0e-8ed4-438e-acd7-378cd5c80c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:31.252438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899ed0e-8ed4-438e-acd7-378cd5c80c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:31.254022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899ed0e-8ed4-438e-acd7-378cd5c80c99 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:31.263729 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4083/8139] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:31 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:31.267685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe08ea-d7f6-47f6-959f-4186b62c7251 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:31.278562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe08ea-d7f6-47f6-959f-4186b62c7251 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:31.284637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3188b-30c5-42d5-929f-fbe1598d6867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:31.285496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3188b-30c5-42d5-929f-fbe1598d6867 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:31.285934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3188b-30c5-42d5-929f-fbe1598d6867 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:31.286215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3188b-30c5-42d5-929f-fbe1598d6867 admin admin] PATH_INFO: `/v3/projects/7b15d4a7d21640fbbfbf7889634e9522/users/18e51ea1af2c41999168a78abe647849/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:31.301418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3188b-30c5-42d5-929f-fbe1598d6867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b15d4a7d21640fbbfbf7889634e9522, user_id=18e51ea1af2c41999168a78abe647849, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:31.304052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3188b-30c5-42d5-929f-fbe1598d6867 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:31.316639 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4057/8140] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:31 2021] PUT /identity/v3/projects/7b15d4a7d21640fbbfbf7889634e9522/users/18e51ea1af2c41999168a78abe647849/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:31.327542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729cdd-1469-4a63-ac3c-364e638d31d6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:31.327834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729cdd-1469-4a63-ac3c-364e638d31d6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:31.328117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729cdd-1469-4a63-ac3c-364e638d31d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:31.356017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8f729cdd-1469-4a63-ac3c-364e638d31d6 None None] MFA Rules not processed for user `18e51ea1af2c41999168a78abe647849`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:31.357254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8f729cdd-1469-4a63-ac3c-364e638d31d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:31.421222 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4084/8141] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:31 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:31.432751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3188b-30c5-42d5-929f-fbe1598d6867 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:31.434458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-23d3188b-30c5-42d5-929f-fbe1598d6867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:31.497912 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3188b-30c5-42d5-929f-fbe1598d6867 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:31.501590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c23fdc-a5cc-414f-9bab-62046389e06e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:31.502227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23fdc-a5cc-414f-9bab-62046389e06e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:31.502510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23fdc-a5cc-414f-9bab-62046389e06e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:31.502785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c23fdc-a5cc-414f-9bab-62046389e06e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:31.511000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c23fdc-a5cc-414f-9bab-62046389e06e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:31.512485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c23fdc-a5cc-414f-9bab-62046389e06e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:31.521249 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4058/8142] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:31 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:35.796862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f729cdd-1469-4a63-ac3c-364e638d31d6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:35.858156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f729cdd-1469-4a63-ac3c-364e638d31d6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:35.863614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:35.864474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:35.864758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:35.865061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] PATH_INFO: `/v3/users/18e51ea1af2c41999168a78abe647849` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:35.866286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e51ea1af2c41999168a78abe647849)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:35.868243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:35.913673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e51ea1af2c41999168a78abe647849'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:35.920519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e51ea1af2c41999168a78abe647849'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:35.921156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e51ea1af2c41999168a78abe647849'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:35.928048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e51ea1af2c41999168a78abe647849'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:35.939411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e51ea1af2c41999168a78abe647849'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:35.945125 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4085/8143] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:35 2021] DELETE /identity/v3/users/18e51ea1af2c41999168a78abe647849 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:35.949775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e49309-a193-431d-950a-b20a7b5a68d2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:35.950262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e49309-a193-431d-950a-b20a7b5a68d2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:35.950359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e49309-a193-431d-950a-b20a7b5a68d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:35.968422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-84e49309-a193-431d-950a-b20a7b5a68d2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:35.969613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-84e49309-a193-431d-950a-b20a7b5a68d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:36.026978 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4059/8144] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:36.036882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:36.038869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:36.097045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfa1a8-ed2c-46d1-a9f4-afba73b77d0d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:36.101394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f3256-b701-486f-98ee-360a27fbd7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:36.102037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f3256-b701-486f-98ee-360a27fbd7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:36.102323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f3256-b701-486f-98ee-360a27fbd7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:36.102602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f3256-b701-486f-98ee-360a27fbd7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:36.111715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f3256-b701-486f-98ee-360a27fbd7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:36.113456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f3256-b701-486f-98ee-360a27fbd7d1 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:36.122825 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4086/8145] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:20:36.285066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e49309-a193-431d-950a-b20a7b5a68d2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:36.286583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-84e49309-a193-431d-950a-b20a7b5a68d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:36.305249 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e49309-a193-431d-950a-b20a7b5a68d2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:36.310658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:36.311553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:36.311834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:36.312115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] PATH_INFO: `/v3/projects/7b15d4a7d21640fbbfbf7889634e9522` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:36.313328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b15d4a7d21640fbbfbf7889634e9522)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:36.315324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:36.367118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b15d4a7d21640fbbfbf7889634e9522', 'request_id': 'req-aa6384e4-8d34-44df-9e15-6a497c3d3616'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:36.374115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b15d4a7d21640fbbfbf7889634e9522', 'request_id': 'req-aa6384e4-8d34-44df-9e15-6a497c3d3616'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:36.384735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b15d4a7d21640fbbfbf7889634e9522', 'request_id': 'req-aa6384e4-8d34-44df-9e15-6a497c3d3616'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:36.399032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] The token cache is being invalidate because project 7b15d4a7d21640fbbfbf7889634e9522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:36.399393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:36.400005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-aa6384e4-8d34-44df-9e15-6a497c3d3616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:36.401783 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4060/8146] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:36 2021] DELETE /identity/v3/projects/7b15d4a7d21640fbbfbf7889634e9522 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:36.407631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef266a-6f0e-4aa3-811e-bc672b00c947 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:36.407930 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef266a-6f0e-4aa3-811e-bc672b00c947 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:36.408208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef266a-6f0e-4aa3-811e-bc672b00c947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:36.429060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a1ef266a-6f0e-4aa3-811e-bc672b00c947 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:36.430968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a1ef266a-6f0e-4aa3-811e-bc672b00c947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:36.502576 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4087/8147] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:36.511054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491bd67-6dae-40bc-95fd-0c03e2461177 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:36.511381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491bd67-6dae-40bc-95fd-0c03e2461177 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:36.511667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491bd67-6dae-40bc-95fd-0c03e2461177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:36.531379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d491bd67-6dae-40bc-95fd-0c03e2461177 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:36.532601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d491bd67-6dae-40bc-95fd-0c03e2461177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:36.540659 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4061/8148] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:36.544853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef266a-6f0e-4aa3-811e-bc672b00c947 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:36.554859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef266a-6f0e-4aa3-811e-bc672b00c947 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:36.559462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d56d21-2322-4727-8154-d4da701b3935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:36.560113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d56d21-2322-4727-8154-d4da701b3935 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:36.560397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d56d21-2322-4727-8154-d4da701b3935 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:36.560675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d56d21-2322-4727-8154-d4da701b3935 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:36.561401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d56d21-2322-4727-8154-d4da701b3935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:36.561705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d56d21-2322-4727-8154-d4da701b3935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:36.563312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d56d21-2322-4727-8154-d4da701b3935 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:36.575580 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4088/8149] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:36.579877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491bd67-6dae-40bc-95fd-0c03e2461177 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:36.589405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491bd67-6dae-40bc-95fd-0c03e2461177 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:36.594216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1bbc9-7abb-4b3f-9bef-61e212c3c766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:36.594916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1bbc9-7abb-4b3f-9bef-61e212c3c766 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:36.595156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1bbc9-7abb-4b3f-9bef-61e212c3c766 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:36.595469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1bbc9-7abb-4b3f-9bef-61e212c3c766 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:36.596179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1bbc9-7abb-4b3f-9bef-61e212c3c766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:36.598081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1bbc9-7abb-4b3f-9bef-61e212c3c766 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:36.624428 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4062/8150] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:36 2021] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:36.627799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d56d21-2322-4727-8154-d4da701b3935 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:36.638259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d56d21-2322-4727-8154-d4da701b3935 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:36.692550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65772cef-00b5-4fe7-9c0a-e06d2108b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:36.693214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772cef-00b5-4fe7-9c0a-e06d2108b1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:36.694162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772cef-00b5-4fe7-9c0a-e06d2108b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:36.694464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772cef-00b5-4fe7-9c0a-e06d2108b1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:36.695178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65772cef-00b5-4fe7-9c0a-e06d2108b1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:36.697130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65772cef-00b5-4fe7-9c0a-e06d2108b1f9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:36.716145 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4089/8151] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:36 2021] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:36.720142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1bbc9-7abb-4b3f-9bef-61e212c3c766 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:36.730289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1bbc9-7abb-4b3f-9bef-61e212c3c766 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:36.734922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45064e-7996-431f-a444-2cb081a61472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:36.735679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45064e-7996-431f-a444-2cb081a61472 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:36.735963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45064e-7996-431f-a444-2cb081a61472 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:36.736241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45064e-7996-431f-a444-2cb081a61472 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:36.736968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45064e-7996-431f-a444-2cb081a61472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:36.738809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45064e-7996-431f-a444-2cb081a61472 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:36.749453 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4063/8152] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:36.753242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65772cef-00b5-4fe7-9c0a-e06d2108b1f9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:36.763857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65772cef-00b5-4fe7-9c0a-e06d2108b1f9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:36.768462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a435cae-93ff-47ba-ae62-f0d9f8322f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:36.769104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435cae-93ff-47ba-ae62-f0d9f8322f83 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:36.769390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435cae-93ff-47ba-ae62-f0d9f8322f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:36.769669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a435cae-93ff-47ba-ae62-f0d9f8322f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:36.770398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a435cae-93ff-47ba-ae62-f0d9f8322f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:36.772044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a435cae-93ff-47ba-ae62-f0d9f8322f83 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:36.781601 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4090/8153] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:36 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:36.785656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45064e-7996-431f-a444-2cb081a61472 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:36.795388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45064e-7996-431f-a444-2cb081a61472 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:36.800070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3381f7-e756-4451-af5b-bb361e4437d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:36.800928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3381f7-e756-4451-af5b-bb361e4437d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:36.801204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3381f7-e756-4451-af5b-bb361e4437d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:36.801473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3381f7-e756-4451-af5b-bb361e4437d6 admin admin] PATH_INFO: `/v3/projects/424217fe50de4a60ae88f538bdaecae2/users/d33c695fd3574130812db5474c42405a/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:36.816280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3381f7-e756-4451-af5b-bb361e4437d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=424217fe50de4a60ae88f538bdaecae2, user_id=d33c695fd3574130812db5474c42405a, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:36.819595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3381f7-e756-4451-af5b-bb361e4437d6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:36.832279 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4064/8154] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:36 2021] PUT /identity/v3/projects/424217fe50de4a60ae88f538bdaecae2/users/d33c695fd3574130812db5474c42405a/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:36.842655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1d83b-4942-46c1-baac-c4aaf377439d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:36.843112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1d83b-4942-46c1-baac-c4aaf377439d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:36.843355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1d83b-4942-46c1-baac-c4aaf377439d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:36.870848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c4a1d83b-4942-46c1-baac-c4aaf377439d None None] MFA Rules not processed for user `d33c695fd3574130812db5474c42405a`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:36.872039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c4a1d83b-4942-46c1-baac-c4aaf377439d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:36.934106 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4091/8155] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:36 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:36.944305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3381f7-e756-4451-af5b-bb361e4437d6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:36.945972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ab3381f7-e756-4451-af5b-bb361e4437d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:37.003840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3381f7-e756-4451-af5b-bb361e4437d6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:37.007651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59411a-b800-4c37-b024-917093a8e2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:37.008289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59411a-b800-4c37-b024-917093a8e2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:37.008572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59411a-b800-4c37-b024-917093a8e2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:37.009278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59411a-b800-4c37-b024-917093a8e2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:37.017578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59411a-b800-4c37-b024-917093a8e2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:37.019029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59411a-b800-4c37-b024-917093a8e2b1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:37.028372 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4065/8156] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:36 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:52.022718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1d83b-4942-46c1-baac-c4aaf377439d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:52.024263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c4a1d83b-4942-46c1-baac-c4aaf377439d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:52.038494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1d83b-4942-46c1-baac-c4aaf377439d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:52.041975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696be29-68c0-4f08-aec6-90ba9af0bb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:52.042618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696be29-68c0-4f08-aec6-90ba9af0bb28 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:52.042899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696be29-68c0-4f08-aec6-90ba9af0bb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:52.043172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696be29-68c0-4f08-aec6-90ba9af0bb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:52.044905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2696be29-68c0-4f08-aec6-90ba9af0bb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:52.118941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696be29-68c0-4f08-aec6-90ba9af0bb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:52.120497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696be29-68c0-4f08-aec6-90ba9af0bb28 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:52.144231 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4092/8157] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:52.990811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae1169-0e13-43fb-ba25-5ece8eca1804 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:52.991325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae1169-0e13-43fb-ba25-5ece8eca1804 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:52.991772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae1169-0e13-43fb-ba25-5ece8eca1804 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:52.994163 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4066/8158] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 21:20:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:20:52.999702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd794f-dd47-4fe7-891c-a9dc13c4bfd8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:52.999999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd794f-dd47-4fe7-891c-a9dc13c4bfd8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:53.000288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd794f-dd47-4fe7-891c-a9dc13c4bfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:53.043151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2cbd794f-dd47-4fe7-891c-a9dc13c4bfd8 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:53.044604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2cbd794f-dd47-4fe7-891c-a9dc13c4bfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:53.124407 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4093/8159] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:20:52 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:53.146239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae1169-0e13-43fb-ba25-5ece8eca1804 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:53.148178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3eae1169-0e13-43fb-ba25-5ece8eca1804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:53.168995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae1169-0e13-43fb-ba25-5ece8eca1804 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:53.175412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bdc5c-c55c-4d7c-9d8e-59ee19809127 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:53.176277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bdc5c-c55c-4d7c-9d8e-59ee19809127 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:53.176567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bdc5c-c55c-4d7c-9d8e-59ee19809127 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:53.176877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bdc5c-c55c-4d7c-9d8e-59ee19809127 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:53.186627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bdc5c-c55c-4d7c-9d8e-59ee19809127 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:53.188401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bdc5c-c55c-4d7c-9d8e-59ee19809127 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:53.201336 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4067/8160] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:53 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:20:55.670349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd794f-dd47-4fe7-891c-a9dc13c4bfd8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:55.685303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd794f-dd47-4fe7-891c-a9dc13c4bfd8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:55.696015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77d850-0414-4c81-a043-d4347a5808b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:55.697360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77d850-0414-4c81-a043-d4347a5808b4 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:55.697868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77d850-0414-4c81-a043-d4347a5808b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:55.698111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77d850-0414-4c81-a043-d4347a5808b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:55.700178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3c77d850-0414-4c81-a043-d4347a5808b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:55.719526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77d850-0414-4c81-a043-d4347a5808b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:55.721626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77d850-0414-4c81-a043-d4347a5808b4 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:55.745075 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4094/8161] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:58.828000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bdc5c-c55c-4d7c-9d8e-59ee19809127 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:58.889254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bdc5c-c55c-4d7c-9d8e-59ee19809127 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:58.894076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:58.894946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:58.895268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:58.895565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] PATH_INFO: `/v3/users/d33c695fd3574130812db5474c42405a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:58.896769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33c695fd3574130812db5474c42405a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:58.898749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:58.943689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33c695fd3574130812db5474c42405a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:58.944271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33c695fd3574130812db5474c42405a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:58.951161 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33c695fd3574130812db5474c42405a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:58.951842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33c695fd3574130812db5474c42405a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:58.958680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33c695fd3574130812db5474c42405a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:58.975776 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4068/8162] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:20:58 2021] DELETE /identity/v3/users/d33c695fd3574130812db5474c42405a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:58.980457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7139c8-d18b-4050-8951-8c18f3ccee78 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:58.980959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7139c8-d18b-4050-8951-8c18f3ccee78 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:58.981055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7139c8-d18b-4050-8951-8c18f3ccee78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:58.999749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5f7139c8-d18b-4050-8951-8c18f3ccee78 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:59.000951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f7139c8-d18b-4050-8951-8c18f3ccee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:59.063456 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4095/8163] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:59.077044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:59.078679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:59.153532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f34383-d8f6-4052-a42d-bf299cb8931f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:59.159491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a394fc6-600c-4a5a-8b51-e252aaefa80d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:59.160241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a394fc6-600c-4a5a-8b51-e252aaefa80d service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:59.160607 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a394fc6-600c-4a5a-8b51-e252aaefa80d service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:59.161531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a394fc6-600c-4a5a-8b51-e252aaefa80d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:59.171432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a394fc6-600c-4a5a-8b51-e252aaefa80d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:59.172925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a394fc6-600c-4a5a-8b51-e252aaefa80d service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:59.183392 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4069/8164] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:20:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:20:59.352132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7139c8-d18b-4050-8951-8c18f3ccee78 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:59.353694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f7139c8-d18b-4050-8951-8c18f3ccee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:59.367494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7139c8-d18b-4050-8951-8c18f3ccee78 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:59.372211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:59.373595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:59.373595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:59.373792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] PATH_INFO: `/v3/projects/424217fe50de4a60ae88f538bdaecae2` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:59.374851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=424217fe50de4a60ae88f538bdaecae2)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:59.376793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:59.426700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '424217fe50de4a60ae88f538bdaecae2', 'request_id': 'req-b5ad681c-490d-4dfc-9c53-12d14615d611'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:59.434568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '424217fe50de4a60ae88f538bdaecae2', 'request_id': 'req-b5ad681c-490d-4dfc-9c53-12d14615d611'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:59.441180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '424217fe50de4a60ae88f538bdaecae2', 'request_id': 'req-b5ad681c-490d-4dfc-9c53-12d14615d611'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:59.452083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] The token cache is being invalidate because project 424217fe50de4a60ae88f538bdaecae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:20:59.452377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:59.453034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b5ad681c-490d-4dfc-9c53-12d14615d611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:20:59.454584 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4096/8165] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:20:59 2021] DELETE /identity/v3/projects/424217fe50de4a60ae88f538bdaecae2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:20:59.461748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9114-9d5f-4e8c-ac9d-1764d901edd6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:59.462039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9114-9d5f-4e8c-ac9d-1764d901edd6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:59.462319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a9114-9d5f-4e8c-ac9d-1764d901edd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:59.479940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a75a9114-9d5f-4e8c-ac9d-1764d901edd6 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:59.481067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a75a9114-9d5f-4e8c-ac9d-1764d901edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:59.544493 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4070/8166] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:20:59.552033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0403-839f-4478-b791-eb169f29be1e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:59.552320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0403-839f-4478-b791-eb169f29be1e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:59.552596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0403-839f-4478-b791-eb169f29be1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:59.570913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-503f0403-839f-4478-b791-eb169f29be1e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:59.572128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-503f0403-839f-4478-b791-eb169f29be1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:59.579887 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4097/8167] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:20:59.584520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a9114-9d5f-4e8c-ac9d-1764d901edd6 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:59.594636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a9114-9d5f-4e8c-ac9d-1764d901edd6 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:59.599432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab44fad-f009-48f8-929c-23b82f9542f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:59.600093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab44fad-f009-48f8-929c-23b82f9542f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:59.600378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab44fad-f009-48f8-929c-23b82f9542f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:59.600657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab44fad-f009-48f8-929c-23b82f9542f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:59.601453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab44fad-f009-48f8-929c-23b82f9542f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:20:59.601733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab44fad-f009-48f8-929c-23b82f9542f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:59.603411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab44fad-f009-48f8-929c-23b82f9542f1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:59.618722 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4071/8168] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:20:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:20:59.619871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f0403-839f-4478-b791-eb169f29be1e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:59.636833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f0403-839f-4478-b791-eb169f29be1e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:59.641669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf66a04-6197-4bf4-99a3-5e54716a57f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:59.642569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf66a04-6197-4bf4-99a3-5e54716a57f9 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:59.642854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf66a04-6197-4bf4-99a3-5e54716a57f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:59.646340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf66a04-6197-4bf4-99a3-5e54716a57f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:59.646906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf66a04-6197-4bf4-99a3-5e54716a57f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:59.648864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf66a04-6197-4bf4-99a3-5e54716a57f9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:59.684768 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4098/8169] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:20:59 2021] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:59.689151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab44fad-f009-48f8-929c-23b82f9542f1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:59.700123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab44fad-f009-48f8-929c-23b82f9542f1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:59.757846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc851a3-426d-48f6-be6d-c58fc97bb5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:59.758515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc851a3-426d-48f6-be6d-c58fc97bb5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:59.758797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc851a3-426d-48f6-be6d-c58fc97bb5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:59.759070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc851a3-426d-48f6-be6d-c58fc97bb5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:59.759795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc851a3-426d-48f6-be6d-c58fc97bb5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:59.761740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc851a3-426d-48f6-be6d-c58fc97bb5d9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:59.785003 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4072/8170] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:20:59 2021] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:20:59.786360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf66a04-6197-4bf4-99a3-5e54716a57f9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:59.796558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf66a04-6197-4bf4-99a3-5e54716a57f9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:59.801140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e54354-74cb-4fb6-9d3f-01d51d5ab466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:59.802324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e54354-74cb-4fb6-9d3f-01d51d5ab466 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:59.802600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e54354-74cb-4fb6-9d3f-01d51d5ab466 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:59.802871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e54354-74cb-4fb6-9d3f-01d51d5ab466 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:59.803642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e54354-74cb-4fb6-9d3f-01d51d5ab466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:59.805213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e54354-74cb-4fb6-9d3f-01d51d5ab466 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:59.814809 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4099/8171] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:20:59.819470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc851a3-426d-48f6-be6d-c58fc97bb5d9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:59.829304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc851a3-426d-48f6-be6d-c58fc97bb5d9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:59.834047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc39c-3297-4ed5-9c24-5b70bc4dd3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:59.834694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc39c-3297-4ed5-9c24-5b70bc4dd3bd admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:59.834980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc39c-3297-4ed5-9c24-5b70bc4dd3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:59.835277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc39c-3297-4ed5-9c24-5b70bc4dd3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:59.836024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bc39c-3297-4ed5-9c24-5b70bc4dd3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:59.837624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bc39c-3297-4ed5-9c24-5b70bc4dd3bd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:59.847264 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4073/8172] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:20:59 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:20:59.851096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e54354-74cb-4fb6-9d3f-01d51d5ab466 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:20:59.860804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e54354-74cb-4fb6-9d3f-01d51d5ab466 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:20:59.866398 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a3714-5817-4211-a7e4-daa8228c42c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:20:59.867277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a3714-5817-4211-a7e4-daa8228c42c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:59.867581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a3714-5817-4211-a7e4-daa8228c42c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:59.867856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a3714-5817-4211-a7e4-daa8228c42c4 admin admin] PATH_INFO: `/v3/projects/e83185a2bc4f4141adea91a35fcf75ee/users/b1a6141732b84ce3a5c164c8cc61c56b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:59.882790 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a3714-5817-4211-a7e4-daa8228c42c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83185a2bc4f4141adea91a35fcf75ee, user_id=b1a6141732b84ce3a5c164c8cc61c56b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:20:59.885553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a3714-5817-4211-a7e4-daa8228c42c4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:20:59.898407 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4100/8173] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:20:59 2021] PUT /identity/v3/projects/e83185a2bc4f4141adea91a35fcf75ee/users/b1a6141732b84ce3a5c164c8cc61c56b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:20:59.908788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b703-92b0-4af3-b454-28db9b57fdea None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:20:59.909080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b703-92b0-4af3-b454-28db9b57fdea None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:20:59.909359 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b703-92b0-4af3-b454-28db9b57fdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:20:59.935376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5af0b703-92b0-4af3-b454-28db9b57fdea None None] MFA Rules not processed for user `b1a6141732b84ce3a5c164c8cc61c56b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:20:59.936561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5af0b703-92b0-4af3-b454-28db9b57fdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:20:59.997790 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4074/8174] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:20:59 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:21:00.008585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a3714-5817-4211-a7e4-daa8228c42c4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:00.010558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d92a3714-5817-4211-a7e4-daa8228c42c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:00.068336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a3714-5817-4211-a7e4-daa8228c42c4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:00.072024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9504d-773e-48cf-8d7c-ce8e014ee0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:00.072757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9504d-773e-48cf-8d7c-ce8e014ee0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:00.073039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9504d-773e-48cf-8d7c-ce8e014ee0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:00.073314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9504d-773e-48cf-8d7c-ce8e014ee0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:00.081786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9504d-773e-48cf-8d7c-ce8e014ee0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:00.083203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9504d-773e-48cf-8d7c-ce8e014ee0b9 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:00.092219 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4101/8175] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:21:00 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:21:17.527381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836792-64c2-4f7a-a54e-8f790741042c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:17.527955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836792-64c2-4f7a-a54e-8f790741042c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:17.527955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836792-64c2-4f7a-a54e-8f790741042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:17.557690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a2836792-64c2-4f7a-a54e-8f790741042c None None] MFA Rules not processed for user `6e49ff29764540ae95d8b9d0f9d4fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:17.558914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a2836792-64c2-4f7a-a54e-8f790741042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:17.645547 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4075/8176] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:17 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:21:26.798534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87241087-088a-4e67-88b3-20c903e28297 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:26.800670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87241087-088a-4e67-88b3-20c903e28297 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:26.801315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87241087-088a-4e67-88b3-20c903e28297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:26.829028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-87241087-088a-4e67-88b3-20c903e28297 None None] MFA Rules not processed for user `98c4fe50315d4fc0b0329e80802eee86`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:26.830735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-87241087-088a-4e67-88b3-20c903e28297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:26.943104 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4102/8177] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:26 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:21:49.001127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836792-64c2-4f7a-a54e-8f790741042c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:49.014521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836792-64c2-4f7a-a54e-8f790741042c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:49.018636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef361c-afb5-4afd-88ea-798d29fb698e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:49.019462 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef361c-afb5-4afd-88ea-798d29fb698e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:49.019743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef361c-afb5-4afd-88ea-798d29fb698e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:49.020015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef361c-afb5-4afd-88ea-798d29fb698e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:49.021767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-afef361c-afb5-4afd-88ea-798d29fb698e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:49.034742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef361c-afb5-4afd-88ea-798d29fb698e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:49.036309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef361c-afb5-4afd-88ea-798d29fb698e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:49.046941 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4076/8178] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:21:49 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:21:52.946417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87241087-088a-4e67-88b3-20c903e28297 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:53.008858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87241087-088a-4e67-88b3-20c903e28297 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:53.013436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:53.014291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.014599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.014874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] PATH_INFO: `/v3/users/b1a6141732b84ce3a5c164c8cc61c56b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.016113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a6141732b84ce3a5c164c8cc61c56b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:53.018526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:53.063971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a6141732b84ce3a5c164c8cc61c56b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:53.072484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a6141732b84ce3a5c164c8cc61c56b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:53.073556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a6141732b84ce3a5c164c8cc61c56b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:53.082152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a6141732b84ce3a5c164c8cc61c56b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:53.093772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a6141732b84ce3a5c164c8cc61c56b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:53.100390 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4103/8179] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:21:52 2021] DELETE /identity/v3/users/b1a6141732b84ce3a5c164c8cc61c56b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:21:53.104867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62d1f-c951-40d8-8dd2-2d4f1614ae68 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.105315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62d1f-c951-40d8-8dd2-2d4f1614ae68 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.105425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62d1f-c951-40d8-8dd2-2d4f1614ae68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.127305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-11d62d1f-c951-40d8-8dd2-2d4f1614ae68 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:53.132083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-11d62d1f-c951-40d8-8dd2-2d4f1614ae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:53.188294 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4077/8180] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:21:53.198335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:53.199759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:53.257367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0ac03-d06c-4be6-a3ad-b0a0d3b01b7e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:53.261040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefa8f2-b267-42a7-8be5-7e61e1f93f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:53.261679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefa8f2-b267-42a7-8be5-7e61e1f93f71 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.261994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefa8f2-b267-42a7-8be5-7e61e1f93f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.262273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefa8f2-b267-42a7-8be5-7e61e1f93f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.271731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefa8f2-b267-42a7-8be5-7e61e1f93f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:53.273160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefa8f2-b267-42a7-8be5-7e61e1f93f71 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:53.282354 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4104/8181] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:21:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:21:53.457388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d62d1f-c951-40d8-8dd2-2d4f1614ae68 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:53.459885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-11d62d1f-c951-40d8-8dd2-2d4f1614ae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:53.473635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d62d1f-c951-40d8-8dd2-2d4f1614ae68 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:53.478891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:53.479941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.480226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.480503 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] PATH_INFO: `/v3/projects/e83185a2bc4f4141adea91a35fcf75ee` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.481709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83185a2bc4f4141adea91a35fcf75ee)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:53.483823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:53.530805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83185a2bc4f4141adea91a35fcf75ee', 'request_id': 'req-92987fcd-c38b-4a93-a08e-fd6cbb884bee'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:53.536892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83185a2bc4f4141adea91a35fcf75ee', 'request_id': 'req-92987fcd-c38b-4a93-a08e-fd6cbb884bee'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:53.544383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83185a2bc4f4141adea91a35fcf75ee', 'request_id': 'req-92987fcd-c38b-4a93-a08e-fd6cbb884bee'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:53.554464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] The token cache is being invalidate because project e83185a2bc4f4141adea91a35fcf75ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:21:53.554751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:53.555420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-92987fcd-c38b-4a93-a08e-fd6cbb884bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:53.556966 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4078/8182] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:21:53 2021] DELETE /identity/v3/projects/e83185a2bc4f4141adea91a35fcf75ee => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:21:53.563241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0fb90-7bc6-4bef-8a09-9573f1e893ed None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.563568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0fb90-7bc6-4bef-8a09-9573f1e893ed None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.563849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0fb90-7bc6-4bef-8a09-9573f1e893ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.583318 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-33b0fb90-7bc6-4bef-8a09-9573f1e893ed None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:53.584497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-33b0fb90-7bc6-4bef-8a09-9573f1e893ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:53.641133 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4105/8183] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:21:53.649260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3cb3f-e8f6-4cea-966a-a727b594622b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.649551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3cb3f-e8f6-4cea-966a-a727b594622b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.649832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3cb3f-e8f6-4cea-966a-a727b594622b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.667791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-78f3cb3f-e8f6-4cea-966a-a727b594622b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:53.668984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-78f3cb3f-e8f6-4cea-966a-a727b594622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:53.676932 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4079/8184] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:21:53.681256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0fb90-7bc6-4bef-8a09-9573f1e893ed None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:53.691347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0fb90-7bc6-4bef-8a09-9573f1e893ed None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:53.695972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2cde8-fb68-4b75-8893-f1c1c8a8c5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:53.696608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2cde8-fb68-4b75-8893-f1c1c8a8c5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.696890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2cde8-fb68-4b75-8893-f1c1c8a8c5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.697162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2cde8-fb68-4b75-8893-f1c1c8a8c5d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.697882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2cde8-fb68-4b75-8893-f1c1c8a8c5d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:21:53.698184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2cde8-fb68-4b75-8893-f1c1c8a8c5d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:53.699792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2cde8-fb68-4b75-8893-f1c1c8a8c5d8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:53.711373 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4106/8185] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:21:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:21:53.715533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3cb3f-e8f6-4cea-966a-a727b594622b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:53.726738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3cb3f-e8f6-4cea-966a-a727b594622b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:53.731482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae80124-ffc8-47dd-9508-8754165b0c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:53.732127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae80124-ffc8-47dd-9508-8754165b0c7a admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.732409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae80124-ffc8-47dd-9508-8754165b0c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.732684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae80124-ffc8-47dd-9508-8754165b0c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.733382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae80124-ffc8-47dd-9508-8754165b0c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:53.735311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae80124-ffc8-47dd-9508-8754165b0c7a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:53.761652 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4080/8186] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:21:53 2021] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:21:53.765110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2cde8-fb68-4b75-8893-f1c1c8a8c5d8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:53.775155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2cde8-fb68-4b75-8893-f1c1c8a8c5d8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:53.830898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf4a41-d1f5-49fc-bc26-4b5b8b16096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:53.831601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4a41-d1f5-49fc-bc26-4b5b8b16096d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.831884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4a41-d1f5-49fc-bc26-4b5b8b16096d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.832158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4a41-d1f5-49fc-bc26-4b5b8b16096d admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.832881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf4a41-d1f5-49fc-bc26-4b5b8b16096d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:53.834772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf4a41-d1f5-49fc-bc26-4b5b8b16096d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:53.853634 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4107/8187] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:21:53 2021] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:21:53.857891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae80124-ffc8-47dd-9508-8754165b0c7a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:53.868737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae80124-ffc8-47dd-9508-8754165b0c7a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:53.873430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d67cc8-c043-4bbf-a431-3c57c4f79961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:53.874074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d67cc8-c043-4bbf-a431-3c57c4f79961 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.874355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d67cc8-c043-4bbf-a431-3c57c4f79961 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.874627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d67cc8-c043-4bbf-a431-3c57c4f79961 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.875384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d67cc8-c043-4bbf-a431-3c57c4f79961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:53.877575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d67cc8-c043-4bbf-a431-3c57c4f79961 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:53.887673 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4081/8188] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:21:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:21:53.891583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf4a41-d1f5-49fc-bc26-4b5b8b16096d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:53.901254 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf4a41-d1f5-49fc-bc26-4b5b8b16096d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:53.905918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daf5c4-832a-4f0b-b4ee-d3f8f644db60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:53.906558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daf5c4-832a-4f0b-b4ee-d3f8f644db60 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.906842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daf5c4-832a-4f0b-b4ee-d3f8f644db60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.907117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daf5c4-832a-4f0b-b4ee-d3f8f644db60 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.907879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daf5c4-832a-4f0b-b4ee-d3f8f644db60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:53.909515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daf5c4-832a-4f0b-b4ee-d3f8f644db60 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:53.919828 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4108/8189] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:21:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:21:53.923725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d67cc8-c043-4bbf-a431-3c57c4f79961 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:53.933930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d67cc8-c043-4bbf-a431-3c57c4f79961 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:53.938493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50d8b9-5a31-4bea-ad3e-4b88f312c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:53.939393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50d8b9-5a31-4bea-ad3e-4b88f312c4d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.940234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50d8b9-5a31-4bea-ad3e-4b88f312c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.940506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50d8b9-5a31-4bea-ad3e-4b88f312c4d1 admin admin] PATH_INFO: `/v3/projects/aff2e6d126ca4f94b98401d18d4c6e38/users/7592d997c34d45a895f0a6cf78e03078/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:53.954313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50d8b9-5a31-4bea-ad3e-4b88f312c4d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff2e6d126ca4f94b98401d18d4c6e38, user_id=7592d997c34d45a895f0a6cf78e03078, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:53.957049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50d8b9-5a31-4bea-ad3e-4b88f312c4d1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:53.969204 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4082/8190] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:21:53 2021] PUT /identity/v3/projects/aff2e6d126ca4f94b98401d18d4c6e38/users/7592d997c34d45a895f0a6cf78e03078/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:21:53.979807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93ea9c-68b0-439a-9004-522571cbf138 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:53.980301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93ea9c-68b0-439a-9004-522571cbf138 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:53.980434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93ea9c-68b0-439a-9004-522571cbf138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:54.007681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bd93ea9c-68b0-439a-9004-522571cbf138 None None] MFA Rules not processed for user `7592d997c34d45a895f0a6cf78e03078`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:54.008868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bd93ea9c-68b0-439a-9004-522571cbf138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:54.070735 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4109/8191] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:53 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:21:54.081489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50d8b9-5a31-4bea-ad3e-4b88f312c4d1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:54.083158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3a50d8b9-5a31-4bea-ad3e-4b88f312c4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:54.140848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50d8b9-5a31-4bea-ad3e-4b88f312c4d1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:54.144699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6358f8-8445-4df6-bee9-8023d57bbc06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:54.145276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6358f8-8445-4df6-bee9-8023d57bbc06 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:54.145560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6358f8-8445-4df6-bee9-8023d57bbc06 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:54.145987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6358f8-8445-4df6-bee9-8023d57bbc06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:54.154846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6358f8-8445-4df6-bee9-8023d57bbc06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:54.156362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6358f8-8445-4df6-bee9-8023d57bbc06 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:54.165816 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4083/8192] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:21:54 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:21:54.180503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93ea9c-68b0-439a-9004-522571cbf138 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:54.240521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93ea9c-68b0-439a-9004-522571cbf138 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:54.245128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:54.245984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:54.246267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:54.246545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] PATH_INFO: `/v3/users/7592d997c34d45a895f0a6cf78e03078` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:54.247780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7592d997c34d45a895f0a6cf78e03078)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:54.249677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:54.293521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7592d997c34d45a895f0a6cf78e03078'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:54.301540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7592d997c34d45a895f0a6cf78e03078'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:54.302204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7592d997c34d45a895f0a6cf78e03078'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:54.309078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7592d997c34d45a895f0a6cf78e03078'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:54.320411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7592d997c34d45a895f0a6cf78e03078'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:54.326339 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4110/8193] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:21:54 2021] DELETE /identity/v3/users/7592d997c34d45a895f0a6cf78e03078 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:21:54.330784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07053b-1335-4e38-bafd-ae1cb1ff0d95 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:54.331073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07053b-1335-4e38-bafd-ae1cb1ff0d95 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:54.331395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07053b-1335-4e38-bafd-ae1cb1ff0d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:54.348799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5f07053b-1335-4e38-bafd-ae1cb1ff0d95 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:54.350002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5f07053b-1335-4e38-bafd-ae1cb1ff0d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:54.407376 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4084/8194] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:21:54.418500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:54.419944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:54.483610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2a22e-4ca4-4da3-bad4-df3683753d56 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:54.487927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afae9f-5187-4314-ba12-078488f9690a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:54.488592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afae9f-5187-4314-ba12-078488f9690a service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:54.488872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afae9f-5187-4314-ba12-078488f9690a service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:54.489144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afae9f-5187-4314-ba12-078488f9690a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:54.499781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afae9f-5187-4314-ba12-078488f9690a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:54.501184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afae9f-5187-4314-ba12-078488f9690a service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:54.510557 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4111/8195] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:21:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:21:54.770970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07053b-1335-4e38-bafd-ae1cb1ff0d95 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:54.772526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5f07053b-1335-4e38-bafd-ae1cb1ff0d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:54.786821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07053b-1335-4e38-bafd-ae1cb1ff0d95 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:54.791538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:54.792497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:54.793127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:54.793756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] PATH_INFO: `/v3/projects/aff2e6d126ca4f94b98401d18d4c6e38` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:54.795027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff2e6d126ca4f94b98401d18d4c6e38)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:54.796878 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:54.842697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff2e6d126ca4f94b98401d18d4c6e38', 'request_id': 'req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:54.848904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff2e6d126ca4f94b98401d18d4c6e38', 'request_id': 'req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:54.855297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff2e6d126ca4f94b98401d18d4c6e38', 'request_id': 'req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:54.866136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] The token cache is being invalidate because project aff2e6d126ca4f94b98401d18d4c6e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:21:54.866420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:54.867032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8c6253d-b9cf-472c-931f-6fae7a2e5c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:54.868596 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4085/8196] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:21:54 2021] DELETE /identity/v3/projects/aff2e6d126ca4f94b98401d18d4c6e38 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:21:54.874629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddbcd7-231c-439d-9e3d-2a0e3a7b71f2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:54.874966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddbcd7-231c-439d-9e3d-2a0e3a7b71f2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:54.875283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddbcd7-231c-439d-9e3d-2a0e3a7b71f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:54.893952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-47ddbcd7-231c-439d-9e3d-2a0e3a7b71f2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:54.895152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-47ddbcd7-231c-439d-9e3d-2a0e3a7b71f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:54.951842 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4112/8197] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:21:54.959435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5bcd-bbb7-49f3-b926-76a3aecbc417 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:54.959732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5bcd-bbb7-49f3-b926-76a3aecbc417 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:54.960013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd5bcd-bbb7-49f3-b926-76a3aecbc417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:54.980043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-71cd5bcd-bbb7-49f3-b926-76a3aecbc417 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:54.981246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-71cd5bcd-bbb7-49f3-b926-76a3aecbc417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:54.989868 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4086/8198] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:21:54.994137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddbcd7-231c-439d-9e3d-2a0e3a7b71f2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:55.003726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddbcd7-231c-439d-9e3d-2a0e3a7b71f2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:55.008262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aceac01-5fd4-41dd-8388-b24fbb4c2759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:55.008900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceac01-5fd4-41dd-8388-b24fbb4c2759 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:55.009181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceac01-5fd4-41dd-8388-b24fbb4c2759 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:55.009455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceac01-5fd4-41dd-8388-b24fbb4c2759 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:55.010205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aceac01-5fd4-41dd-8388-b24fbb4c2759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:21:55.010506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aceac01-5fd4-41dd-8388-b24fbb4c2759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:55.012127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aceac01-5fd4-41dd-8388-b24fbb4c2759 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:55.023349 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4113/8199] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:21:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:21:55.027813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd5bcd-bbb7-49f3-b926-76a3aecbc417 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:55.037558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd5bcd-bbb7-49f3-b926-76a3aecbc417 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:55.042217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e3a45-b15b-422d-8f66-e7a6595f6e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:55.042872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e3a45-b15b-422d-8f66-e7a6595f6e6d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:55.043139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e3a45-b15b-422d-8f66-e7a6595f6e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:55.043443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e3a45-b15b-422d-8f66-e7a6595f6e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:55.044176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e3a45-b15b-422d-8f66-e7a6595f6e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:55.046069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e3a45-b15b-422d-8f66-e7a6595f6e6d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:55.071333 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4087/8200] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:21:55 2021] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:21:55.075614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aceac01-5fd4-41dd-8388-b24fbb4c2759 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:55.085401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aceac01-5fd4-41dd-8388-b24fbb4c2759 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:55.139355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708842ac-2816-4ace-be38-0e9f9d4142a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:55.140013 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708842ac-2816-4ace-be38-0e9f9d4142a0 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:55.140298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708842ac-2816-4ace-be38-0e9f9d4142a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:55.140577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708842ac-2816-4ace-be38-0e9f9d4142a0 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:55.141286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708842ac-2816-4ace-be38-0e9f9d4142a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:55.143284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708842ac-2816-4ace-be38-0e9f9d4142a0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:55.166026 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4114/8201] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:21:55 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:21:55.167234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e3a45-b15b-422d-8f66-e7a6595f6e6d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:55.178857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e3a45-b15b-422d-8f66-e7a6595f6e6d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:55.183635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03672e05-24ae-487f-ad04-6b7357298a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:55.184294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03672e05-24ae-487f-ad04-6b7357298a81 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:55.184630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03672e05-24ae-487f-ad04-6b7357298a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:55.184908 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03672e05-24ae-487f-ad04-6b7357298a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:55.185688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03672e05-24ae-487f-ad04-6b7357298a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:55.187331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03672e05-24ae-487f-ad04-6b7357298a81 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:55.198732 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4088/8202] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:21:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:21:55.202789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708842ac-2816-4ace-be38-0e9f9d4142a0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:55.212565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708842ac-2816-4ace-be38-0e9f9d4142a0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:55.217154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2de741-3ebe-45a0-b289-f71ee76346fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:55.217827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2de741-3ebe-45a0-b289-f71ee76346fd admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:55.218112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2de741-3ebe-45a0-b289-f71ee76346fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:55.218388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2de741-3ebe-45a0-b289-f71ee76346fd admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:55.219115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2de741-3ebe-45a0-b289-f71ee76346fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:55.221241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2de741-3ebe-45a0-b289-f71ee76346fd admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:55.230855 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4115/8203] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:21:55 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:21:55.234740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03672e05-24ae-487f-ad04-6b7357298a81 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:55.245134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03672e05-24ae-487f-ad04-6b7357298a81 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:55.249768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1384c6c-326c-4b58-a022-13fd9837b4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:55.250624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1384c6c-326c-4b58-a022-13fd9837b4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:55.250907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1384c6c-326c-4b58-a022-13fd9837b4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:55.251180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1384c6c-326c-4b58-a022-13fd9837b4f6 admin admin] PATH_INFO: `/v3/projects/3cd16623b99c4043a673bc1e50073896/users/760c0655a06c4f169f40ff7695bf451c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:55.265242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1384c6c-326c-4b58-a022-13fd9837b4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd16623b99c4043a673bc1e50073896, user_id=760c0655a06c4f169f40ff7695bf451c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:55.268424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1384c6c-326c-4b58-a022-13fd9837b4f6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:55.282097 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4089/8204] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:21:55 2021] PUT /identity/v3/projects/3cd16623b99c4043a673bc1e50073896/users/760c0655a06c4f169f40ff7695bf451c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:21:55.292445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6c8e6-7499-4c83-9065-11ed6c636e70 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:55.292738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6c8e6-7499-4c83-9065-11ed6c636e70 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:55.293044 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6c8e6-7499-4c83-9065-11ed6c636e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:55.318536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0bc6c8e6-7499-4c83-9065-11ed6c636e70 None None] MFA Rules not processed for user `760c0655a06c4f169f40ff7695bf451c`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:55.319776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0bc6c8e6-7499-4c83-9065-11ed6c636e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:55.383656 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4116/8205] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:55 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:21:55.394778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1384c6c-326c-4b58-a022-13fd9837b4f6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:55.396472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f1384c6c-326c-4b58-a022-13fd9837b4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:55.457546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1384c6c-326c-4b58-a022-13fd9837b4f6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:55.461487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e66f37-de77-4a89-ab6b-d88149631468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:55.462143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e66f37-de77-4a89-ab6b-d88149631468 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:55.462426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e66f37-de77-4a89-ab6b-d88149631468 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:55.462701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e66f37-de77-4a89-ab6b-d88149631468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:55.472006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e66f37-de77-4a89-ab6b-d88149631468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:55.473451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e66f37-de77-4a89-ab6b-d88149631468 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:55.482360 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4090/8206] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:21:55 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:21:59.133137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6c8e6-7499-4c83-9065-11ed6c636e70 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:59.196589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6c8e6-7499-4c83-9065-11ed6c636e70 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:59.201084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:59.201929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:59.202208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:59.202478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] PATH_INFO: `/v3/users/760c0655a06c4f169f40ff7695bf451c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:59.203686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=760c0655a06c4f169f40ff7695bf451c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:59.206098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:59.249197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760c0655a06c4f169f40ff7695bf451c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:59.256164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760c0655a06c4f169f40ff7695bf451c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:59.256774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760c0655a06c4f169f40ff7695bf451c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:59.263461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760c0655a06c4f169f40ff7695bf451c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:59.275167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760c0655a06c4f169f40ff7695bf451c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:59.281145 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4117/8207] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:21:59 2021] DELETE /identity/v3/users/760c0655a06c4f169f40ff7695bf451c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:21:59.286285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ba35-03b0-4ffc-8b75-6f0fcef200ce None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:59.286949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ba35-03b0-4ffc-8b75-6f0fcef200ce None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:59.286949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ba35-03b0-4ffc-8b75-6f0fcef200ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:59.303689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6463ba35-03b0-4ffc-8b75-6f0fcef200ce None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:59.304880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6463ba35-03b0-4ffc-8b75-6f0fcef200ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:59.366264 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4091/8208] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:21:59.376098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:59.378062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:59.435176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856f321-2c00-4bc1-8ec2-11b4619d5d9b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:59.440213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545fa02-43e9-4a58-ab8d-56813dc83782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:59.440934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545fa02-43e9-4a58-ab8d-56813dc83782 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:59.441250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545fa02-43e9-4a58-ab8d-56813dc83782 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:59.441639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545fa02-43e9-4a58-ab8d-56813dc83782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:59.453158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545fa02-43e9-4a58-ab8d-56813dc83782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:59.454590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545fa02-43e9-4a58-ab8d-56813dc83782 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:59.464843 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4118/8209] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:21:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:21:59.635990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463ba35-03b0-4ffc-8b75-6f0fcef200ce None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:59.637536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6463ba35-03b0-4ffc-8b75-6f0fcef200ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:59.650498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463ba35-03b0-4ffc-8b75-6f0fcef200ce None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:59.655093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:59.656103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:59.656393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:59.656841 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] PATH_INFO: `/v3/projects/3cd16623b99c4043a673bc1e50073896` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:59.658880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd16623b99c4043a673bc1e50073896)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:59.660519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:59.706770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd16623b99c4043a673bc1e50073896', 'request_id': 'req-b10d6614-f585-47bb-8f6b-92bf5f6c462a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:59.712848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd16623b99c4043a673bc1e50073896', 'request_id': 'req-b10d6614-f585-47bb-8f6b-92bf5f6c462a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:59.719967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd16623b99c4043a673bc1e50073896', 'request_id': 'req-b10d6614-f585-47bb-8f6b-92bf5f6c462a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:59.729854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] The token cache is being invalidate because project 3cd16623b99c4043a673bc1e50073896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:21:59.730137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:59.730755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b10d6614-f585-47bb-8f6b-92bf5f6c462a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:21:59.732350 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4092/8210] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:21:59 2021] DELETE /identity/v3/projects/3cd16623b99c4043a673bc1e50073896 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:21:59.740632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b8b69-cdac-471b-aa1e-72541c5b1ab7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:59.740923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b8b69-cdac-471b-aa1e-72541c5b1ab7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:59.741202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b8b69-cdac-471b-aa1e-72541c5b1ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:59.762334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-848b8b69-cdac-471b-aa1e-72541c5b1ab7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:59.763485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-848b8b69-cdac-471b-aa1e-72541c5b1ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:59.820651 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4119/8211] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:21:59.828354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ab69c-cc7e-4d60-9022-eb6c24a2d7f9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:59.828674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ab69c-cc7e-4d60-9022-eb6c24a2d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:59.828955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ab69c-cc7e-4d60-9022-eb6c24a2d7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:59.847175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-9a8ab69c-cc7e-4d60-9022-eb6c24a2d7f9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:21:59.848437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9a8ab69c-cc7e-4d60-9022-eb6c24a2d7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:21:59.856422 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4093/8212] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:21:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:21:59.860422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b8b69-cdac-471b-aa1e-72541c5b1ab7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:59.870625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b8b69-cdac-471b-aa1e-72541c5b1ab7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:59.875202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda351c-1b65-4d91-b5c5-8e2544b022c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:59.875873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda351c-1b65-4d91-b5c5-8e2544b022c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:59.876153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda351c-1b65-4d91-b5c5-8e2544b022c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:59.876426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda351c-1b65-4d91-b5c5-8e2544b022c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:59.877833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda351c-1b65-4d91-b5c5-8e2544b022c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:21:59.878138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda351c-1b65-4d91-b5c5-8e2544b022c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:59.879748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda351c-1b65-4d91-b5c5-8e2544b022c5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:59.890703 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4120/8213] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:21:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:21:59.894746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ab69c-cc7e-4d60-9022-eb6c24a2d7f9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:59.903942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ab69c-cc7e-4d60-9022-eb6c24a2d7f9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:21:59.908673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab192d44-64b5-421d-8ea8-8b4c0e215f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:21:59.909340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192d44-64b5-421d-8ea8-8b4c0e215f79 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:21:59.909625 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192d44-64b5-421d-8ea8-8b4c0e215f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:21:59.909902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192d44-64b5-421d-8ea8-8b4c0e215f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:21:59.910619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab192d44-64b5-421d-8ea8-8b4c0e215f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:21:59.912587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab192d44-64b5-421d-8ea8-8b4c0e215f79 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:21:59.937437 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4094/8214] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:21:59 2021] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:21:59.942203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda351c-1b65-4d91-b5c5-8e2544b022c5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:21:59.951955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda351c-1b65-4d91-b5c5-8e2544b022c5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:00.006326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd7b93-50b9-40ef-9362-fa1d8f72b40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:00.006977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd7b93-50b9-40ef-9362-fa1d8f72b40a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:00.007300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd7b93-50b9-40ef-9362-fa1d8f72b40a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:00.007577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd7b93-50b9-40ef-9362-fa1d8f72b40a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:00.008275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd7b93-50b9-40ef-9362-fa1d8f72b40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:00.010174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd7b93-50b9-40ef-9362-fa1d8f72b40a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:00.028858 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4121/8215] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:21:59 2021] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:00.032993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab192d44-64b5-421d-8ea8-8b4c0e215f79 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:00.043265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab192d44-64b5-421d-8ea8-8b4c0e215f79 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:00.048198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548d6ce-0256-4f48-bc07-cae36fbadbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:00.049360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548d6ce-0256-4f48-bc07-cae36fbadbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:00.049638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548d6ce-0256-4f48-bc07-cae36fbadbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:00.049910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548d6ce-0256-4f48-bc07-cae36fbadbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:00.050638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548d6ce-0256-4f48-bc07-cae36fbadbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:00.052263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548d6ce-0256-4f48-bc07-cae36fbadbc6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:00.062313 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4095/8216] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:00.066821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd7b93-50b9-40ef-9362-fa1d8f72b40a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:00.076523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd7b93-50b9-40ef-9362-fa1d8f72b40a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:00.081104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd521a8-bf2a-4b7b-aa6a-208cf5642c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:00.081740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd521a8-bf2a-4b7b-aa6a-208cf5642c66 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:00.082021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd521a8-bf2a-4b7b-aa6a-208cf5642c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:00.082295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd521a8-bf2a-4b7b-aa6a-208cf5642c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:00.083033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd521a8-bf2a-4b7b-aa6a-208cf5642c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:00.084901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd521a8-bf2a-4b7b-aa6a-208cf5642c66 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:00.094420 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4122/8217] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:00 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:00.098319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548d6ce-0256-4f48-bc07-cae36fbadbc6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:00.107930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548d6ce-0256-4f48-bc07-cae36fbadbc6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:00.113291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88555179-0b06-4425-b7c3-800ad717b1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:00.114155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88555179-0b06-4425-b7c3-800ad717b1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:00.114433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88555179-0b06-4425-b7c3-800ad717b1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:00.114708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88555179-0b06-4425-b7c3-800ad717b1c3 admin admin] PATH_INFO: `/v3/projects/e876099458b34eabb2f9863eef5ec986/users/496be9c514e0403bb326c8f8613f856b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:00.129290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88555179-0b06-4425-b7c3-800ad717b1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e876099458b34eabb2f9863eef5ec986, user_id=496be9c514e0403bb326c8f8613f856b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:00.132016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88555179-0b06-4425-b7c3-800ad717b1c3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:00.144764 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4096/8218] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:00 2021] PUT /identity/v3/projects/e876099458b34eabb2f9863eef5ec986/users/496be9c514e0403bb326c8f8613f856b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:00.154257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3733a0-b530-41d2-8d1a-c07bab76b31a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:00.154744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3733a0-b530-41d2-8d1a-c07bab76b31a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:00.154891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3733a0-b530-41d2-8d1a-c07bab76b31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:00.181497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6c3733a0-b530-41d2-8d1a-c07bab76b31a None None] MFA Rules not processed for user `496be9c514e0403bb326c8f8613f856b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:00.182728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6c3733a0-b530-41d2-8d1a-c07bab76b31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:00.244101 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4123/8219] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:00 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:00.260733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88555179-0b06-4425-b7c3-800ad717b1c3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:00.262409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-88555179-0b06-4425-b7c3-800ad717b1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:00.321046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88555179-0b06-4425-b7c3-800ad717b1c3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:00.324776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010212c-3af8-4f14-876c-4a227ed12c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:00.328091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010212c-3af8-4f14-876c-4a227ed12c38 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:00.328091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010212c-3af8-4f14-876c-4a227ed12c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:00.328091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010212c-3af8-4f14-876c-4a227ed12c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:00.334744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010212c-3af8-4f14-876c-4a227ed12c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:00.336209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010212c-3af8-4f14-876c-4a227ed12c38 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:00.344859 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4097/8220] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:00 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:00.359020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3733a0-b530-41d2-8d1a-c07bab76b31a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:00.419204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3733a0-b530-41d2-8d1a-c07bab76b31a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:00.424404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:00.425263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:00.425542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:00.425815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] PATH_INFO: `/v3/users/496be9c514e0403bb326c8f8613f856b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:00.427089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=496be9c514e0403bb326c8f8613f856b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:00.429026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:00.474052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496be9c514e0403bb326c8f8613f856b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:00.481193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496be9c514e0403bb326c8f8613f856b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:00.481856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496be9c514e0403bb326c8f8613f856b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:00.489313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496be9c514e0403bb326c8f8613f856b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:00.500574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496be9c514e0403bb326c8f8613f856b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:00.506446 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4124/8221] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:22:00 2021] DELETE /identity/v3/users/496be9c514e0403bb326c8f8613f856b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:00.510959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85afd5-0947-49d9-ba08-f7dd57385699 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:00.511283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85afd5-0947-49d9-ba08-f7dd57385699 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:00.511594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85afd5-0947-49d9-ba08-f7dd57385699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:00.529013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ef85afd5-0947-49d9-ba08-f7dd57385699 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:00.530194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ef85afd5-0947-49d9-ba08-f7dd57385699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:00.586457 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4098/8222] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:22:00.596960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:00.598379 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:00.656308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2be9d-2ad1-4caa-8f8f-102cd84495f4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:00.660649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86836392-7960-4670-b9a3-0f13737f3db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:00.661283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86836392-7960-4670-b9a3-0f13737f3db3 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:00.661565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86836392-7960-4670-b9a3-0f13737f3db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:00.661836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86836392-7960-4670-b9a3-0f13737f3db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:00.670624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86836392-7960-4670-b9a3-0f13737f3db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:00.672086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86836392-7960-4670-b9a3-0f13737f3db3 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:00.681393 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4125/8223] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:22:00.944883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85afd5-0947-49d9-ba08-f7dd57385699 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:00.946356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ef85afd5-0947-49d9-ba08-f7dd57385699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:00.960347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85afd5-0947-49d9-ba08-f7dd57385699 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:00.965023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:00.965875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:00.966154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:00.966426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] PATH_INFO: `/v3/projects/e876099458b34eabb2f9863eef5ec986` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:00.968129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e876099458b34eabb2f9863eef5ec986)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:00.969960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.018678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e876099458b34eabb2f9863eef5ec986', 'request_id': 'req-9e7957e3-1602-4359-a26b-78aa9c439be6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:01.024720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e876099458b34eabb2f9863eef5ec986', 'request_id': 'req-9e7957e3-1602-4359-a26b-78aa9c439be6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:01.031718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e876099458b34eabb2f9863eef5ec986', 'request_id': 'req-9e7957e3-1602-4359-a26b-78aa9c439be6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:01.041538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] The token cache is being invalidate because project e876099458b34eabb2f9863eef5ec986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:22:01.041819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:01.042436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-9e7957e3-1602-4359-a26b-78aa9c439be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:01.044019 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4099/8224] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:22:00 2021] DELETE /identity/v3/projects/e876099458b34eabb2f9863eef5ec986 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:01.049721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0b28c-c23c-4932-acfc-8261311a7dd4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.050004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0b28c-c23c-4932-acfc-8261311a7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.050280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0b28c-c23c-4932-acfc-8261311a7dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.068968 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-86a0b28c-c23c-4932-acfc-8261311a7dd4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:01.070171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-86a0b28c-c23c-4932-acfc-8261311a7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:01.128720 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4126/8225] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:22:01.136309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19849ecf-1af2-4a60-a1d7-719e2720d580 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.136596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19849ecf-1af2-4a60-a1d7-719e2720d580 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.136871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19849ecf-1af2-4a60-a1d7-719e2720d580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.155349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-19849ecf-1af2-4a60-a1d7-719e2720d580 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:01.156525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-19849ecf-1af2-4a60-a1d7-719e2720d580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:01.164350 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4100/8226] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:01.168414 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0b28c-c23c-4932-acfc-8261311a7dd4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.178115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0b28c-c23c-4932-acfc-8261311a7dd4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.182747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208df57-2d4d-46ba-bf67-18e0c167a4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.183507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208df57-2d4d-46ba-bf67-18e0c167a4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.183793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208df57-2d4d-46ba-bf67-18e0c167a4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.184071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208df57-2d4d-46ba-bf67-18e0c167a4a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.184832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208df57-2d4d-46ba-bf67-18e0c167a4a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:22:01.185142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208df57-2d4d-46ba-bf67-18e0c167a4a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.186731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208df57-2d4d-46ba-bf67-18e0c167a4a8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.198567 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4127/8227] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:22:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:22:01.202687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19849ecf-1af2-4a60-a1d7-719e2720d580 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.212552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19849ecf-1af2-4a60-a1d7-719e2720d580 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.217319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666f743-78c7-47b4-bd93-21c81f1f4ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.218611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666f743-78c7-47b4-bd93-21c81f1f4ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.218900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666f743-78c7-47b4-bd93-21c81f1f4ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.219176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666f743-78c7-47b4-bd93-21c81f1f4ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.219924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666f743-78c7-47b4-bd93-21c81f1f4ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.221823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666f743-78c7-47b4-bd93-21c81f1f4ba3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.249406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4101/8228] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:22:01 2021] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:22:01.254114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208df57-2d4d-46ba-bf67-18e0c167a4a8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.264084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208df57-2d4d-46ba-bf67-18e0c167a4a8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.319012 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36459d15-b62a-430b-ae0f-49137d0c81d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.319705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36459d15-b62a-430b-ae0f-49137d0c81d3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.319988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36459d15-b62a-430b-ae0f-49137d0c81d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.320259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36459d15-b62a-430b-ae0f-49137d0c81d3 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.320944 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36459d15-b62a-430b-ae0f-49137d0c81d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.322875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36459d15-b62a-430b-ae0f-49137d0c81d3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.345664 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4128/8229] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:22:01 2021] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:01.347597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666f743-78c7-47b4-bd93-21c81f1f4ba3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.358079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666f743-78c7-47b4-bd93-21c81f1f4ba3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.363614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a04c6a-01c2-48e8-881d-9cf844238683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.364269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a04c6a-01c2-48e8-881d-9cf844238683 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.364556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a04c6a-01c2-48e8-881d-9cf844238683 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.364836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a04c6a-01c2-48e8-881d-9cf844238683 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.365574 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a04c6a-01c2-48e8-881d-9cf844238683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.367169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a04c6a-01c2-48e8-881d-9cf844238683 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.382867 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4102/8230] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:22:01.384128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36459d15-b62a-430b-ae0f-49137d0c81d3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.394752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36459d15-b62a-430b-ae0f-49137d0c81d3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.399577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3f487-27c7-47cd-9000-294f7bb074e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.400260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3f487-27c7-47cd-9000-294f7bb074e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.400549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3f487-27c7-47cd-9000-294f7bb074e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.400829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3f487-27c7-47cd-9000-294f7bb074e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.401575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3f487-27c7-47cd-9000-294f7bb074e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.403190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3f487-27c7-47cd-9000-294f7bb074e0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.412891 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4129/8231] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:01.417092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a04c6a-01c2-48e8-881d-9cf844238683 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.427691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a04c6a-01c2-48e8-881d-9cf844238683 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.432529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02260641-96dc-4b53-92a1-0c54f542659d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.433408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02260641-96dc-4b53-92a1-0c54f542659d admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.433692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02260641-96dc-4b53-92a1-0c54f542659d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.433968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02260641-96dc-4b53-92a1-0c54f542659d admin admin] PATH_INFO: `/v3/projects/4fc508f1344e454eb198949b6ea9f8cd/users/ffb17ed4418548ab95f220de5ef452c8/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.449655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02260641-96dc-4b53-92a1-0c54f542659d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc508f1344e454eb198949b6ea9f8cd, user_id=ffb17ed4418548ab95f220de5ef452c8, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.452392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02260641-96dc-4b53-92a1-0c54f542659d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.466632 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4103/8232] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:01 2021] PUT /identity/v3/projects/4fc508f1344e454eb198949b6ea9f8cd/users/ffb17ed4418548ab95f220de5ef452c8/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:01.477674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c373a-94b0-488c-96c1-95fb775949fe None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.477963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c373a-94b0-488c-96c1-95fb775949fe None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.478242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c373a-94b0-488c-96c1-95fb775949fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.505311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9a0c373a-94b0-488c-96c1-95fb775949fe None None] MFA Rules not processed for user `ffb17ed4418548ab95f220de5ef452c8`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:01.506474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9a0c373a-94b0-488c-96c1-95fb775949fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:01.568881 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4130/8233] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:01 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:01.573543 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02260641-96dc-4b53-92a1-0c54f542659d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.635130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02260641-96dc-4b53-92a1-0c54f542659d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.639766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5175-4dc4-46da-bc5c-c6960d36e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.640424 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5175-4dc4-46da-bc5c-c6960d36e6df admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.640709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5175-4dc4-46da-bc5c-c6960d36e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.640987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5175-4dc4-46da-bc5c-c6960d36e6df admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.641691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a5175-4dc4-46da-bc5c-c6960d36e6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.643690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a5175-4dc4-46da-bc5c-c6960d36e6df admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.668135 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4104/8234] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:22:01 2021] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:22:01.672151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c373a-94b0-488c-96c1-95fb775949fe None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.683750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c373a-94b0-488c-96c1-95fb775949fe None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.737551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8ec1-6613-4437-a0ce-81192c32465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.738205 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8ec1-6613-4437-a0ce-81192c32465c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.738486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8ec1-6613-4437-a0ce-81192c32465c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.738759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8ec1-6613-4437-a0ce-81192c32465c admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.739474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b8ec1-6613-4437-a0ce-81192c32465c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.741359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b8ec1-6613-4437-a0ce-81192c32465c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.761628 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4131/8235] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:22:01 2021] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:01.764144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5175-4dc4-46da-bc5c-c6960d36e6df admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.775555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5175-4dc4-46da-bc5c-c6960d36e6df admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.780495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae3610-17cb-4296-adad-fed9a672e250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.781166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae3610-17cb-4296-adad-fed9a672e250 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.781454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae3610-17cb-4296-adad-fed9a672e250 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.781753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae3610-17cb-4296-adad-fed9a672e250 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.782494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae3610-17cb-4296-adad-fed9a672e250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.784854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae3610-17cb-4296-adad-fed9a672e250 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.795475 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4105/8236] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:01.800243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8ec1-6613-4437-a0ce-81192c32465c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.809952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8ec1-6613-4437-a0ce-81192c32465c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.814635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec1b95-d9de-486b-9b85-bd2d53870d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.815536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1b95-d9de-486b-9b85-bd2d53870d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.815820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1b95-d9de-486b-9b85-bd2d53870d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.816098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1b95-d9de-486b-9b85-bd2d53870d9b admin admin] PATH_INFO: `/v3/projects/629cd3166d8e478baf05156c7697fb30/users/8d356798d95c4e95967485eaf31d05a9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.830375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec1b95-d9de-486b-9b85-bd2d53870d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=629cd3166d8e478baf05156c7697fb30, user_id=8d356798d95c4e95967485eaf31d05a9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.833056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec1b95-d9de-486b-9b85-bd2d53870d9b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.846745 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4132/8237] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:01 2021] PUT /identity/v3/projects/629cd3166d8e478baf05156c7697fb30/users/8d356798d95c4e95967485eaf31d05a9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:01.850550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae3610-17cb-4296-adad-fed9a672e250 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.860529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae3610-17cb-4296-adad-fed9a672e250 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.915818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151f413-c2fc-445b-b606-0671c26e1261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.916405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151f413-c2fc-445b-b606-0671c26e1261 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.916688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151f413-c2fc-445b-b606-0671c26e1261 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.916964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151f413-c2fc-445b-b606-0671c26e1261 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.917690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151f413-c2fc-445b-b606-0671c26e1261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.919304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151f413-c2fc-445b-b606-0671c26e1261 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.929332 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4106/8238] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:01 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:01.933657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec1b95-d9de-486b-9b85-bd2d53870d9b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:01.944005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec1b95-d9de-486b-9b85-bd2d53870d9b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:01.948675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b28a6-a210-415e-a4e8-cb48086d5e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:01.949549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b28a6-a210-415e-a4e8-cb48086d5e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.949834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b28a6-a210-415e-a4e8-cb48086d5e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.950112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b28a6-a210-415e-a4e8-cb48086d5e5f admin admin] PATH_INFO: `/v3/projects/629cd3166d8e478baf05156c7697fb30/users/8d356798d95c4e95967485eaf31d05a9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:01.952149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b28a6-a210-415e-a4e8-cb48086d5e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=629cd3166d8e478baf05156c7697fb30, user_id=8d356798d95c4e95967485eaf31d05a9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:01.954793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b28a6-a210-415e-a4e8-cb48086d5e5f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:01.964860 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4133/8239] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:01 2021] PUT /identity/v3/projects/629cd3166d8e478baf05156c7697fb30/users/8d356798d95c4e95967485eaf31d05a9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:22:01.974857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5e7a9-44e4-4773-8e4b-28afee09a565 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:01.975150 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5e7a9-44e4-4773-8e4b-28afee09a565 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:01.975484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5e7a9-44e4-4773-8e4b-28afee09a565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:02.002617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f1b5e7a9-44e4-4773-8e4b-28afee09a565 None None] MFA Rules not processed for user `8d356798d95c4e95967485eaf31d05a9`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:02.003870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f1b5e7a9-44e4-4773-8e4b-28afee09a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:02.069794 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4107/8240] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:01 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:02.080791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b28a6-a210-415e-a4e8-cb48086d5e5f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:02.082497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-980b28a6-a210-415e-a4e8-cb48086d5e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:02.148588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b28a6-a210-415e-a4e8-cb48086d5e5f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:02.152280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb7ae1-a982-48ad-bd08-ac27a3a8563b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:02.152912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7ae1-a982-48ad-bd08-ac27a3a8563b service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:02.153191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7ae1-a982-48ad-bd08-ac27a3a8563b service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:02.153464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7ae1-a982-48ad-bd08-ac27a3a8563b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:02.162791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb7ae1-a982-48ad-bd08-ac27a3a8563b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:02.164514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb7ae1-a982-48ad-bd08-ac27a3a8563b service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:02.173765 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4134/8241] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:02 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:02.234116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5e7a9-44e4-4773-8e4b-28afee09a565 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:02.294981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5e7a9-44e4-4773-8e4b-28afee09a565 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:02.300414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:02.301274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:02.301562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:02.301838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] PATH_INFO: `/v3/users/ffb17ed4418548ab95f220de5ef452c8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:02.303080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb17ed4418548ab95f220de5ef452c8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:02.305057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:02.349562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb17ed4418548ab95f220de5ef452c8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:02.350214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb17ed4418548ab95f220de5ef452c8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:02.357347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb17ed4418548ab95f220de5ef452c8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:02.357981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb17ed4418548ab95f220de5ef452c8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:02.365711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb17ed4418548ab95f220de5ef452c8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:02.383336 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4108/8242] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:22:02 2021] DELETE /identity/v3/users/ffb17ed4418548ab95f220de5ef452c8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:02.387935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1dd8-351e-4df5-8d52-82f9fd5018fc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:02.388224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1dd8-351e-4df5-8d52-82f9fd5018fc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:02.388497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1dd8-351e-4df5-8d52-82f9fd5018fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:02.405912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5bdd1dd8-351e-4df5-8d52-82f9fd5018fc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:02.407093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5bdd1dd8-351e-4df5-8d52-82f9fd5018fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:02.464802 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4135/8243] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:02.475327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:02.476719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:02.533869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2562f-b39a-4753-9f14-2122d5d893a0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:02.537495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634a4f9-bf9b-4b8a-94e3-21d7a54c87a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:02.538132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634a4f9-bf9b-4b8a-94e3-21d7a54c87a3 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:02.538414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634a4f9-bf9b-4b8a-94e3-21d7a54c87a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:02.538688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634a4f9-bf9b-4b8a-94e3-21d7a54c87a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:02.547478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634a4f9-bf9b-4b8a-94e3-21d7a54c87a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:02.549522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634a4f9-bf9b-4b8a-94e3-21d7a54c87a3 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:02.558794 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4109/8244] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:02.827876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd1dd8-351e-4df5-8d52-82f9fd5018fc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:02.829381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5bdd1dd8-351e-4df5-8d52-82f9fd5018fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:02.842229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd1dd8-351e-4df5-8d52-82f9fd5018fc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:02.848361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:02.849343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:02.849685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:02.849970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] PATH_INFO: `/v3/projects/4fc508f1344e454eb198949b6ea9f8cd` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:02.851169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc508f1344e454eb198949b6ea9f8cd)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:02.853092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:02.898290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc508f1344e454eb198949b6ea9f8cd', 'request_id': 'req-f7128b19-c6f1-4e60-a644-168dc392d9ea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:02.905535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc508f1344e454eb198949b6ea9f8cd', 'request_id': 'req-f7128b19-c6f1-4e60-a644-168dc392d9ea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:02.912625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc508f1344e454eb198949b6ea9f8cd', 'request_id': 'req-f7128b19-c6f1-4e60-a644-168dc392d9ea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:02.922658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] The token cache is being invalidate because project 4fc508f1344e454eb198949b6ea9f8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:22:02.922954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:02.923654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:02.925239 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4136/8245] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:22:02 2021] DELETE /identity/v3/projects/4fc508f1344e454eb198949b6ea9f8cd => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:02.929323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634a4f9-bf9b-4b8a-94e3-21d7a54c87a3 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:02.938983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634a4f9-bf9b-4b8a-94e3-21d7a54c87a3 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:02.994617 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:02.995441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:02.995730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:02.996005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] PATH_INFO: `/v3/users/8d356798d95c4e95967485eaf31d05a9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:02.997446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d356798d95c4e95967485eaf31d05a9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:02.999505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:03.042642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d356798d95c4e95967485eaf31d05a9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:03.043301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d356798d95c4e95967485eaf31d05a9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:03.050047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d356798d95c4e95967485eaf31d05a9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:03.050651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d356798d95c4e95967485eaf31d05a9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:03.057584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d356798d95c4e95967485eaf31d05a9'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:03.074380 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4110/8246] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:22:02 2021] DELETE /identity/v3/users/8d356798d95c4e95967485eaf31d05a9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:03.302069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:03.303653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:03.336583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:03.338596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:03.371692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7128b19-c6f1-4e60-a644-168dc392d9ea admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:03.433657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f40f3-eb64-47f1-9078-674c0e91118b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:03.434394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f40f3-eb64-47f1-9078-674c0e91118b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:03.434743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f40f3-eb64-47f1-9078-674c0e91118b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:03.435164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f40f3-eb64-47f1-9078-674c0e91118b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:03.437296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a80f40f3-eb64-47f1-9078-674c0e91118b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:03.441015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c43cf-0005-4bcd-b0d4-2727a398b383 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:03.450419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:03.450559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f40f3-eb64-47f1-9078-674c0e91118b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:03.451327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:03.451885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:03.451995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f40f3-eb64-47f1-9078-674c0e91118b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:03.452082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] PATH_INFO: `/v3/projects/629cd3166d8e478baf05156c7697fb30` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:03.453811 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629cd3166d8e478baf05156c7697fb30)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:03.456949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:03.467570 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4137/8247] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:03.506659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629cd3166d8e478baf05156c7697fb30', 'request_id': 'req-e29eac4d-2a93-4a12-9a58-74ec0281a580'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:03.512899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629cd3166d8e478baf05156c7697fb30', 'request_id': 'req-e29eac4d-2a93-4a12-9a58-74ec0281a580'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:03.522015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629cd3166d8e478baf05156c7697fb30', 'request_id': 'req-e29eac4d-2a93-4a12-9a58-74ec0281a580'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:03.533241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] The token cache is being invalidate because project 629cd3166d8e478baf05156c7697fb30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:22:03.533557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:03.534191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e29eac4d-2a93-4a12-9a58-74ec0281a580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:03.535768 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4111/8248] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:22:03 2021] DELETE /identity/v3/projects/629cd3166d8e478baf05156c7697fb30 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:03.541486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ccae-a757-4573-a317-a871e4f3b3d2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:03.541809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ccae-a757-4573-a317-a871e4f3b3d2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:03.542088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ccae-a757-4573-a317-a871e4f3b3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:03.560710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2769ccae-a757-4573-a317-a871e4f3b3d2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:03.562018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2769ccae-a757-4573-a317-a871e4f3b3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:03.622734 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4138/8249] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:03.631108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c358c7-c7c2-41c9-9690-9c0f47cac8bd None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:03.631432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c358c7-c7c2-41c9-9690-9c0f47cac8bd None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:03.631711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c358c7-c7c2-41c9-9690-9c0f47cac8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:03.649801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-14c358c7-c7c2-41c9-9690-9c0f47cac8bd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:03.651002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-14c358c7-c7c2-41c9-9690-9c0f47cac8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:03.658921 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4112/8250] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:22:03.663480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769ccae-a757-4573-a317-a871e4f3b3d2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:03.673960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769ccae-a757-4573-a317-a871e4f3b3d2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:03.679521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84b50a-d8fc-4cb4-834f-e1786d6fc386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:03.680182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84b50a-d8fc-4cb4-834f-e1786d6fc386 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:03.680467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84b50a-d8fc-4cb4-834f-e1786d6fc386 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:03.680744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84b50a-d8fc-4cb4-834f-e1786d6fc386 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:03.681487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84b50a-d8fc-4cb4-834f-e1786d6fc386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:22:03.681793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84b50a-d8fc-4cb4-834f-e1786d6fc386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:03.683417 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84b50a-d8fc-4cb4-834f-e1786d6fc386 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:03.699317 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4139/8251] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:22:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:22:03.700177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c358c7-c7c2-41c9-9690-9c0f47cac8bd None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:03.709437 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c358c7-c7c2-41c9-9690-9c0f47cac8bd None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:03.714151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e478e2-abff-49e4-8d10-248842e6d269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:03.714794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e478e2-abff-49e4-8d10-248842e6d269 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:03.715074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e478e2-abff-49e4-8d10-248842e6d269 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:03.715391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e478e2-abff-49e4-8d10-248842e6d269 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:03.716097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e478e2-abff-49e4-8d10-248842e6d269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:03.717985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e478e2-abff-49e4-8d10-248842e6d269 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:03.749174 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4113/8252] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:22:03 2021] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:03.750405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84b50a-d8fc-4cb4-834f-e1786d6fc386 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:03.764237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84b50a-d8fc-4cb4-834f-e1786d6fc386 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:03.828745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f615d9a-314b-49b8-81fb-db6aa10b1001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:03.829416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615d9a-314b-49b8-81fb-db6aa10b1001 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:03.829816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615d9a-314b-49b8-81fb-db6aa10b1001 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:03.830097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615d9a-314b-49b8-81fb-db6aa10b1001 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:03.830803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f615d9a-314b-49b8-81fb-db6aa10b1001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:03.832766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f615d9a-314b-49b8-81fb-db6aa10b1001 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:03.852304 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4140/8253] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:22:03 2021] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:03.856420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e478e2-abff-49e4-8d10-248842e6d269 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:03.867570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e478e2-abff-49e4-8d10-248842e6d269 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:03.872248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ae21f-fbfb-4001-8ab5-849e36e018f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:03.872918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ae21f-fbfb-4001-8ab5-849e36e018f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:03.873201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ae21f-fbfb-4001-8ab5-849e36e018f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:03.873479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ae21f-fbfb-4001-8ab5-849e36e018f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:03.874316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ae21f-fbfb-4001-8ab5-849e36e018f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:03.875967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ae21f-fbfb-4001-8ab5-849e36e018f9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:03.887331 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4114/8254] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:22:03.891577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f615d9a-314b-49b8-81fb-db6aa10b1001 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:03.901528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f615d9a-314b-49b8-81fb-db6aa10b1001 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:03.906169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11a483-6c2f-4f00-83cf-06cdfd5ff513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:03.906829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11a483-6c2f-4f00-83cf-06cdfd5ff513 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:03.907120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11a483-6c2f-4f00-83cf-06cdfd5ff513 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:03.907439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11a483-6c2f-4f00-83cf-06cdfd5ff513 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:03.908689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11a483-6c2f-4f00-83cf-06cdfd5ff513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:03.910275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11a483-6c2f-4f00-83cf-06cdfd5ff513 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:03.920121 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4141/8255] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:03.924820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ae21f-fbfb-4001-8ab5-849e36e018f9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:03.934692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ae21f-fbfb-4001-8ab5-849e36e018f9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:03.939411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03b959-3ad5-4b76-85d8-54e053596980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:03.940283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03b959-3ad5-4b76-85d8-54e053596980 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:03.940599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03b959-3ad5-4b76-85d8-54e053596980 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:03.940879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03b959-3ad5-4b76-85d8-54e053596980 admin admin] PATH_INFO: `/v3/projects/a678c9fa11094a40859ce2b9c2785995/users/8d1bdfa8d45949a5b82045e1a09855aa/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:03.955317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03b959-3ad5-4b76-85d8-54e053596980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a678c9fa11094a40859ce2b9c2785995, user_id=8d1bdfa8d45949a5b82045e1a09855aa, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:03.958004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03b959-3ad5-4b76-85d8-54e053596980 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:03.971370 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4115/8256] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:03 2021] PUT /identity/v3/projects/a678c9fa11094a40859ce2b9c2785995/users/8d1bdfa8d45949a5b82045e1a09855aa/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:03.982314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2d27-f8aa-4af6-b534-772050b7d4c3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:03.982621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2d27-f8aa-4af6-b534-772050b7d4c3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:03.982900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2d27-f8aa-4af6-b534-772050b7d4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:04.011399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-767a2d27-f8aa-4af6-b534-772050b7d4c3 None None] MFA Rules not processed for user `8d1bdfa8d45949a5b82045e1a09855aa`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:04.012621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-767a2d27-f8aa-4af6-b534-772050b7d4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:04.077783 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4142/8257] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:03 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:04.084008 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03b959-3ad5-4b76-85d8-54e053596980 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:04.147869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03b959-3ad5-4b76-85d8-54e053596980 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:04.152531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61f1ca-39a3-42ad-b622-177e0eeecd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:04.153181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61f1ca-39a3-42ad-b622-177e0eeecd93 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:04.153465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61f1ca-39a3-42ad-b622-177e0eeecd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:04.153741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61f1ca-39a3-42ad-b622-177e0eeecd93 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:04.154446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61f1ca-39a3-42ad-b622-177e0eeecd93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:04.156390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61f1ca-39a3-42ad-b622-177e0eeecd93 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:04.181733 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4116/8258] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:22:04 2021] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:04.186115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2d27-f8aa-4af6-b534-772050b7d4c3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:04.196759 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2d27-f8aa-4af6-b534-772050b7d4c3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:04.251002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a1ea5-d979-4d21-ac36-f3b736559320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:04.251732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a1ea5-d979-4d21-ac36-f3b736559320 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:04.252016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a1ea5-d979-4d21-ac36-f3b736559320 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:04.252308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a1ea5-d979-4d21-ac36-f3b736559320 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:04.253002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a1ea5-d979-4d21-ac36-f3b736559320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:04.254893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a1ea5-d979-4d21-ac36-f3b736559320 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:04.274325 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4143/8259] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:22:04 2021] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:04.278382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61f1ca-39a3-42ad-b622-177e0eeecd93 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:04.289592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61f1ca-39a3-42ad-b622-177e0eeecd93 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:04.294342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2873c6-9b53-4b90-b0c5-1c859b36f8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:04.294999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2873c6-9b53-4b90-b0c5-1c859b36f8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:04.295307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2873c6-9b53-4b90-b0c5-1c859b36f8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:04.295591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2873c6-9b53-4b90-b0c5-1c859b36f8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:04.296322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2873c6-9b53-4b90-b0c5-1c859b36f8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:04.297917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2873c6-9b53-4b90-b0c5-1c859b36f8a3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:04.308369 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4117/8260] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:04.312509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a1ea5-d979-4d21-ac36-f3b736559320 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:04.323719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a1ea5-d979-4d21-ac36-f3b736559320 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:04.329244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d812c0-89a9-4934-a1ea-fa4e3bdaaf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:04.330629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d812c0-89a9-4934-a1ea-fa4e3bdaaf41 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:04.330910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d812c0-89a9-4934-a1ea-fa4e3bdaaf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:04.331182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d812c0-89a9-4934-a1ea-fa4e3bdaaf41 admin admin] PATH_INFO: `/v3/projects/12d7b065122645c39d72976edfde18e1/users/07655862f1784923a8b64cadd81d6917/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:04.346510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d812c0-89a9-4934-a1ea-fa4e3bdaaf41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d7b065122645c39d72976edfde18e1, user_id=07655862f1784923a8b64cadd81d6917, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:04.349185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d812c0-89a9-4934-a1ea-fa4e3bdaaf41 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:04.361949 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4144/8261] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:04 2021] PUT /identity/v3/projects/12d7b065122645c39d72976edfde18e1/users/07655862f1784923a8b64cadd81d6917/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:04.366117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2873c6-9b53-4b90-b0c5-1c859b36f8a3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:04.376325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2873c6-9b53-4b90-b0c5-1c859b36f8a3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:04.438697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa6132-c030-4f84-abb5-b0b24db44b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:04.439469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6132-c030-4f84-abb5-b0b24db44b0c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:04.439758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6132-c030-4f84-abb5-b0b24db44b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:04.440073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6132-c030-4f84-abb5-b0b24db44b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:04.441047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6132-c030-4f84-abb5-b0b24db44b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:04.442799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6132-c030-4f84-abb5-b0b24db44b0c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:04.453142 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4118/8262] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:04 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:04.457711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d812c0-89a9-4934-a1ea-fa4e3bdaaf41 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:04.469312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d812c0-89a9-4934-a1ea-fa4e3bdaaf41 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:04.474671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397732f-1701-48a8-8aa4-e5ce3fa99710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:04.475615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397732f-1701-48a8-8aa4-e5ce3fa99710 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:04.475901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397732f-1701-48a8-8aa4-e5ce3fa99710 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:04.476175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397732f-1701-48a8-8aa4-e5ce3fa99710 admin admin] PATH_INFO: `/v3/projects/12d7b065122645c39d72976edfde18e1/users/07655862f1784923a8b64cadd81d6917/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:04.478162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397732f-1701-48a8-8aa4-e5ce3fa99710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d7b065122645c39d72976edfde18e1, user_id=07655862f1784923a8b64cadd81d6917, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:04.480934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397732f-1701-48a8-8aa4-e5ce3fa99710 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:04.491987 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4145/8263] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:04 2021] PUT /identity/v3/projects/12d7b065122645c39d72976edfde18e1/users/07655862f1784923a8b64cadd81d6917/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:22:04.501562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57256644-79d0-4843-9e69-d83d2b06395e None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:04.501853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57256644-79d0-4843-9e69-d83d2b06395e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:04.502141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57256644-79d0-4843-9e69-d83d2b06395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:04.528086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-57256644-79d0-4843-9e69-d83d2b06395e None None] MFA Rules not processed for user `07655862f1784923a8b64cadd81d6917`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:04.529283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-57256644-79d0-4843-9e69-d83d2b06395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:04.596751 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4119/8264] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:04 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:04.606495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397732f-1701-48a8-8aa4-e5ce3fa99710 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:04.608252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5397732f-1701-48a8-8aa4-e5ce3fa99710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:04.665974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397732f-1701-48a8-8aa4-e5ce3fa99710 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:04.669624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f92b97-52d2-4ac5-b38a-79b95d59f70a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:04.670266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f92b97-52d2-4ac5-b38a-79b95d59f70a service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:04.670551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f92b97-52d2-4ac5-b38a-79b95d59f70a service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:04.670823 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f92b97-52d2-4ac5-b38a-79b95d59f70a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:04.679764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f92b97-52d2-4ac5-b38a-79b95d59f70a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:04.681188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f92b97-52d2-4ac5-b38a-79b95d59f70a service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:04.690889 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4146/8265] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:04 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:04.735741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57256644-79d0-4843-9e69-d83d2b06395e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:04.737403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-57256644-79d0-4843-9e69-d83d2b06395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:04.751872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57256644-79d0-4843-9e69-d83d2b06395e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:04.755579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eeab86-2964-461b-bab1-29bb835a500c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:04.756209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeab86-2964-461b-bab1-29bb835a500c service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:04.756493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeab86-2964-461b-bab1-29bb835a500c service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:04.756767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eeab86-2964-461b-bab1-29bb835a500c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:04.809719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eeab86-2964-461b-bab1-29bb835a500c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:04.811143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eeab86-2964-461b-bab1-29bb835a500c service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:04.820231 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4120/8266] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:04 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:07.962296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f92b97-52d2-4ac5-b38a-79b95d59f70a service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:08.022836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f92b97-52d2-4ac5-b38a-79b95d59f70a service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:08.027426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:08.028280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:08.028562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:08.028836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] PATH_INFO: `/v3/users/8d1bdfa8d45949a5b82045e1a09855aa` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:08.030029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1bdfa8d45949a5b82045e1a09855aa)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:08.031980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:08.075941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1bdfa8d45949a5b82045e1a09855aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.083559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1bdfa8d45949a5b82045e1a09855aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.084185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1bdfa8d45949a5b82045e1a09855aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.092535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1bdfa8d45949a5b82045e1a09855aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.108459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1bdfa8d45949a5b82045e1a09855aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.114686 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4147/8267] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:22:07 2021] DELETE /identity/v3/users/8d1bdfa8d45949a5b82045e1a09855aa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:08.119149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d2964-8886-444d-a7dc-314ebe2c4897 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:08.119637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d2964-8886-444d-a7dc-314ebe2c4897 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:08.119757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d2964-8886-444d-a7dc-314ebe2c4897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:08.136818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8a1d2964-8886-444d-a7dc-314ebe2c4897 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:08.138132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8a1d2964-8886-444d-a7dc-314ebe2c4897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:08.194939 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4121/8268] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:08.204960 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:08.206892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:08.265161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf99d9-4661-445c-851e-d79a11c0c26e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:08.269439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f96bb-c2ee-43c4-8998-95e0c2d36689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:08.270083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f96bb-c2ee-43c4-8998-95e0c2d36689 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:08.270425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f96bb-c2ee-43c4-8998-95e0c2d36689 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:08.270707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f96bb-c2ee-43c4-8998-95e0c2d36689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:08.279921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f96bb-c2ee-43c4-8998-95e0c2d36689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:08.281352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f96bb-c2ee-43c4-8998-95e0c2d36689 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:08.291532 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4148/8269] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:08.553151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d2964-8886-444d-a7dc-314ebe2c4897 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:08.554732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8a1d2964-8886-444d-a7dc-314ebe2c4897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:08.567483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d2964-8886-444d-a7dc-314ebe2c4897 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:08.572090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:08.572953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:08.573235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:08.573535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] PATH_INFO: `/v3/projects/a678c9fa11094a40859ce2b9c2785995` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:08.575659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a678c9fa11094a40859ce2b9c2785995)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:08.577493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:08.626343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a678c9fa11094a40859ce2b9c2785995', 'request_id': 'req-3fe71547-8f4a-4526-95ac-7778b2fba4ba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.633018 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a678c9fa11094a40859ce2b9c2785995', 'request_id': 'req-3fe71547-8f4a-4526-95ac-7778b2fba4ba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.640197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a678c9fa11094a40859ce2b9c2785995', 'request_id': 'req-3fe71547-8f4a-4526-95ac-7778b2fba4ba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.650704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] The token cache is being invalidate because project a678c9fa11094a40859ce2b9c2785995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:22:08.650991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.651638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.653174 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4122/8270] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:22:08 2021] DELETE /identity/v3/projects/a678c9fa11094a40859ce2b9c2785995 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:08.657189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f96bb-c2ee-43c4-8998-95e0c2d36689 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:08.666741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f96bb-c2ee-43c4-8998-95e0c2d36689 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:08.721556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08136d9f-6811-4afe-9ef5-05e947bcd1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:08.722425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08136d9f-6811-4afe-9ef5-05e947bcd1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:08.722711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08136d9f-6811-4afe-9ef5-05e947bcd1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:08.722988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08136d9f-6811-4afe-9ef5-05e947bcd1cf admin admin] PATH_INFO: `/v3/users/07655862f1784923a8b64cadd81d6917` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:08.724245 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08136d9f-6811-4afe-9ef5-05e947bcd1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=07655862f1784923a8b64cadd81d6917)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:08.726169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08136d9f-6811-4afe-9ef5-05e947bcd1cf admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:08.772910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08136d9f-6811-4afe-9ef5-05e947bcd1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07655862f1784923a8b64cadd81d6917'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.780455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08136d9f-6811-4afe-9ef5-05e947bcd1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07655862f1784923a8b64cadd81d6917'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.781422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08136d9f-6811-4afe-9ef5-05e947bcd1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07655862f1784923a8b64cadd81d6917'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.788696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08136d9f-6811-4afe-9ef5-05e947bcd1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07655862f1784923a8b64cadd81d6917'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.802237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-08136d9f-6811-4afe-9ef5-05e947bcd1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07655862f1784923a8b64cadd81d6917'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:08.809189 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4149/8271] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:22:08 2021] DELETE /identity/v3/users/07655862f1784923a8b64cadd81d6917 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:09.066713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:09.068285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:09.081230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe71547-8f4a-4526-95ac-7778b2fba4ba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:09.139705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:09.140490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.140783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.141061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] PATH_INFO: `/v3/projects/12d7b065122645c39d72976edfde18e1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.142257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d7b065122645c39d72976edfde18e1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:09.144226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:09.191863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d7b065122645c39d72976edfde18e1', 'request_id': 'req-a28a4c54-0169-4718-bfc6-8ec643505ac1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:09.197876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d7b065122645c39d72976edfde18e1', 'request_id': 'req-a28a4c54-0169-4718-bfc6-8ec643505ac1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:09.204563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d7b065122645c39d72976edfde18e1', 'request_id': 'req-a28a4c54-0169-4718-bfc6-8ec643505ac1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:09.214452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] The token cache is being invalidate because project 12d7b065122645c39d72976edfde18e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:22:09.214736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:09.215546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-a28a4c54-0169-4718-bfc6-8ec643505ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:09.217071 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4123/8272] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:22:09 2021] DELETE /identity/v3/projects/12d7b065122645c39d72976edfde18e1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:09.223285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd2b9c-075a-4774-81a8-fa0e677214ca None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.223798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd2b9c-075a-4774-81a8-fa0e677214ca None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.223893 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd2b9c-075a-4774-81a8-fa0e677214ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.242582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-57bd2b9c-075a-4774-81a8-fa0e677214ca None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:09.243791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-57bd2b9c-075a-4774-81a8-fa0e677214ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:09.299039 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4150/8273] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:09.308376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a3b12-a61b-4964-aebf-37179efce20a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.308669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a3b12-a61b-4964-aebf-37179efce20a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.308949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a3b12-a61b-4964-aebf-37179efce20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.327147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8b7a3b12-a61b-4964-aebf-37179efce20a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:09.328389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8b7a3b12-a61b-4964-aebf-37179efce20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:09.336243 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4124/8274] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:09.340244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd2b9c-075a-4774-81a8-fa0e677214ca None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:09.350488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd2b9c-075a-4774-81a8-fa0e677214ca None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:09.355007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d4446-0ddc-4eb8-baeb-28d1378e256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:09.355684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d4446-0ddc-4eb8-baeb-28d1378e256e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.355967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d4446-0ddc-4eb8-baeb-28d1378e256e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.356239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d4446-0ddc-4eb8-baeb-28d1378e256e admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.356964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d4446-0ddc-4eb8-baeb-28d1378e256e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:22:09.357264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d4446-0ddc-4eb8-baeb-28d1378e256e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:09.358835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d4446-0ddc-4eb8-baeb-28d1378e256e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:09.370863 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4151/8275] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:22:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:22:09.375074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a3b12-a61b-4964-aebf-37179efce20a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:09.384281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a3b12-a61b-4964-aebf-37179efce20a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:09.388851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06f12a-188c-496b-9347-3b0817c9f6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:09.389485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06f12a-188c-496b-9347-3b0817c9f6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.389767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06f12a-188c-496b-9347-3b0817c9f6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.390041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06f12a-188c-496b-9347-3b0817c9f6d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.390770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06f12a-188c-496b-9347-3b0817c9f6d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:09.392719 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06f12a-188c-496b-9347-3b0817c9f6d6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:09.420243 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4125/8276] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:22:09 2021] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:22:09.424938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d4446-0ddc-4eb8-baeb-28d1378e256e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:09.434751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d4446-0ddc-4eb8-baeb-28d1378e256e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:09.490267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38771e-ed5f-41b0-bf35-5a4d4a7d48f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:09.491011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38771e-ed5f-41b0-bf35-5a4d4a7d48f4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.491332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38771e-ed5f-41b0-bf35-5a4d4a7d48f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.491611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38771e-ed5f-41b0-bf35-5a4d4a7d48f4 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.492334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38771e-ed5f-41b0-bf35-5a4d4a7d48f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:09.494264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38771e-ed5f-41b0-bf35-5a4d4a7d48f4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:09.513991 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4152/8277] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:22:09 2021] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:22:09.518137 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06f12a-188c-496b-9347-3b0817c9f6d6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:09.529449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06f12a-188c-496b-9347-3b0817c9f6d6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:09.534085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9574d-f8c4-459a-be3d-754c1d3e9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:09.535303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9574d-f8c4-459a-be3d-754c1d3e9fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.535612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9574d-f8c4-459a-be3d-754c1d3e9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.535906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9574d-f8c4-459a-be3d-754c1d3e9fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.536675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9574d-f8c4-459a-be3d-754c1d3e9fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:09.538237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9574d-f8c4-459a-be3d-754c1d3e9fb8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:09.548980 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4126/8278] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:09 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:09.552848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38771e-ed5f-41b0-bf35-5a4d4a7d48f4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:09.562737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38771e-ed5f-41b0-bf35-5a4d4a7d48f4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:09.570492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868aa349-9539-4747-bee6-63d487b13a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:09.571159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aa349-9539-4747-bee6-63d487b13a99 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.571466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aa349-9539-4747-bee6-63d487b13a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.571739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868aa349-9539-4747-bee6-63d487b13a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.572465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868aa349-9539-4747-bee6-63d487b13a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:09.574041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868aa349-9539-4747-bee6-63d487b13a99 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:09.587548 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4153/8279] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:22:09.590064 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9574d-f8c4-459a-be3d-754c1d3e9fb8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:09.601109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9574d-f8c4-459a-be3d-754c1d3e9fb8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:09.607337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd23b45-f5c6-4e33-a74a-ad9df89774e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:09.608229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd23b45-f5c6-4e33-a74a-ad9df89774e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.608518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd23b45-f5c6-4e33-a74a-ad9df89774e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.608797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd23b45-f5c6-4e33-a74a-ad9df89774e5 admin admin] PATH_INFO: `/v3/projects/570d7cfeaedb482dabbcfc5f93d933a2/users/fb3d11de786246cd9850d272f063cb8c/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.626499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd23b45-f5c6-4e33-a74a-ad9df89774e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570d7cfeaedb482dabbcfc5f93d933a2, user_id=fb3d11de786246cd9850d272f063cb8c, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:09.630268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd23b45-f5c6-4e33-a74a-ad9df89774e5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:09.646944 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4127/8280] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:09 2021] PUT /identity/v3/projects/570d7cfeaedb482dabbcfc5f93d933a2/users/fb3d11de786246cd9850d272f063cb8c/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:09.656730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa34074-11a1-45c2-9777-227debf96a2b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.657026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa34074-11a1-45c2-9777-227debf96a2b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.657407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa34074-11a1-45c2-9777-227debf96a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.692396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-baa34074-11a1-45c2-9777-227debf96a2b None None] MFA Rules not processed for user `fb3d11de786246cd9850d272f063cb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:09.694030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-baa34074-11a1-45c2-9777-227debf96a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:09.760474 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4154/8281] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:09 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:09.764996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd23b45-f5c6-4e33-a74a-ad9df89774e5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:09.827865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd23b45-f5c6-4e33-a74a-ad9df89774e5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:09.833154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0bb16-8cf4-4760-bab1-1485b0f59cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:09.833808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0bb16-8cf4-4760-bab1-1485b0f59cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.834096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0bb16-8cf4-4760-bab1-1485b0f59cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.834383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0bb16-8cf4-4760-bab1-1485b0f59cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.835077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0bb16-8cf4-4760-bab1-1485b0f59cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:09.837024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0bb16-8cf4-4760-bab1-1485b0f59cf9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:09.861793 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4128/8282] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:22:09 2021] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:09.865797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa34074-11a1-45c2-9777-227debf96a2b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:09.876172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa34074-11a1-45c2-9777-227debf96a2b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:09.929378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44479746-ab36-4284-a5fe-9e8280513930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:09.930029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44479746-ab36-4284-a5fe-9e8280513930 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.930308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44479746-ab36-4284-a5fe-9e8280513930 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.930580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44479746-ab36-4284-a5fe-9e8280513930 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.931306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44479746-ab36-4284-a5fe-9e8280513930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:09.933187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44479746-ab36-4284-a5fe-9e8280513930 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:09.952772 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4155/8283] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:22:09 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:09.957374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0bb16-8cf4-4760-bab1-1485b0f59cf9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:09.967511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0bb16-8cf4-4760-bab1-1485b0f59cf9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:09.972689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028b0ff-b458-4299-8a40-6686cb3e781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:09.973335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b0ff-b458-4299-8a40-6686cb3e781e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:09.973618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b0ff-b458-4299-8a40-6686cb3e781e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:09.973890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b0ff-b458-4299-8a40-6686cb3e781e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:09.974612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028b0ff-b458-4299-8a40-6686cb3e781e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:09.976259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028b0ff-b458-4299-8a40-6686cb3e781e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:09.986784 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4129/8284] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:09.991672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44479746-ab36-4284-a5fe-9e8280513930 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:10.001672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44479746-ab36-4284-a5fe-9e8280513930 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:10.006439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530665a4-cf5e-443a-bdff-b11463383962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:10.007342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530665a4-cf5e-443a-bdff-b11463383962 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:10.007635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530665a4-cf5e-443a-bdff-b11463383962 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:10.007915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530665a4-cf5e-443a-bdff-b11463383962 admin admin] PATH_INFO: `/v3/projects/7b2246a489e9415bb20559e3c38140c7/users/28a7bb53e5434b6ab02f9cbea0cb220d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:10.022206 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530665a4-cf5e-443a-bdff-b11463383962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2246a489e9415bb20559e3c38140c7, user_id=28a7bb53e5434b6ab02f9cbea0cb220d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:10.024829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530665a4-cf5e-443a-bdff-b11463383962 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:10.038066 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4156/8285] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:09 2021] PUT /identity/v3/projects/7b2246a489e9415bb20559e3c38140c7/users/28a7bb53e5434b6ab02f9cbea0cb220d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:10.041983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028b0ff-b458-4299-8a40-6686cb3e781e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:10.052742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028b0ff-b458-4299-8a40-6686cb3e781e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:10.107619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bff5f-db41-46df-bf64-f7fb002d8c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:10.108269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bff5f-db41-46df-bf64-f7fb002d8c0c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:10.108556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bff5f-db41-46df-bf64-f7fb002d8c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:10.108835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bff5f-db41-46df-bf64-f7fb002d8c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:10.109569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067bff5f-db41-46df-bf64-f7fb002d8c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:10.111190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067bff5f-db41-46df-bf64-f7fb002d8c0c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:10.122064 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4130/8286] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:10 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:10.126215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530665a4-cf5e-443a-bdff-b11463383962 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:10.136547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530665a4-cf5e-443a-bdff-b11463383962 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:10.141416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206347c-639c-4f9d-9a38-0505bd9b4198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:10.142292 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206347c-639c-4f9d-9a38-0505bd9b4198 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:10.142578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206347c-639c-4f9d-9a38-0505bd9b4198 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:10.142864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206347c-639c-4f9d-9a38-0505bd9b4198 admin admin] PATH_INFO: `/v3/projects/7b2246a489e9415bb20559e3c38140c7/users/28a7bb53e5434b6ab02f9cbea0cb220d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:10.144921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206347c-639c-4f9d-9a38-0505bd9b4198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2246a489e9415bb20559e3c38140c7, user_id=28a7bb53e5434b6ab02f9cbea0cb220d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:10.147603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206347c-639c-4f9d-9a38-0505bd9b4198 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:10.157676 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4157/8287] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:10 2021] PUT /identity/v3/projects/7b2246a489e9415bb20559e3c38140c7/users/28a7bb53e5434b6ab02f9cbea0cb220d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:10.167769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad3d7d-fae0-43c0-a789-34f624525e04 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:10.168233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad3d7d-fae0-43c0-a789-34f624525e04 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:10.168355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad3d7d-fae0-43c0-a789-34f624525e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:10.194324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2dad3d7d-fae0-43c0-a789-34f624525e04 None None] MFA Rules not processed for user `28a7bb53e5434b6ab02f9cbea0cb220d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:10.195556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2dad3d7d-fae0-43c0-a789-34f624525e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:10.262589 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4131/8288] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:10 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:10.273266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206347c-639c-4f9d-9a38-0505bd9b4198 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:10.274906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3206347c-639c-4f9d-9a38-0505bd9b4198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:10.335824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206347c-639c-4f9d-9a38-0505bd9b4198 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:10.339593 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57792f9d-73f9-4394-bf7e-6c0b94b52611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:10.340231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57792f9d-73f9-4394-bf7e-6c0b94b52611 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:10.340536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57792f9d-73f9-4394-bf7e-6c0b94b52611 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:10.340817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57792f9d-73f9-4394-bf7e-6c0b94b52611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:10.350608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57792f9d-73f9-4394-bf7e-6c0b94b52611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:10.352103 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57792f9d-73f9-4394-bf7e-6c0b94b52611 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:10.361623 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4158/8289] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:10 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:10.439482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad3d7d-fae0-43c0-a789-34f624525e04 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:10.451928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad3d7d-fae0-43c0-a789-34f624525e04 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:10.455641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8d939-70ff-4c10-837b-bd10a19fc707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:10.456285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d939-70ff-4c10-837b-bd10a19fc707 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:10.457062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d939-70ff-4c10-837b-bd10a19fc707 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:10.457340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d939-70ff-4c10-837b-bd10a19fc707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:10.516524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8d939-70ff-4c10-837b-bd10a19fc707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:10.518256 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8d939-70ff-4c10-837b-bd10a19fc707 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:10.529313 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4132/8290] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:10 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:15.073897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57792f9d-73f9-4394-bf7e-6c0b94b52611 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:15.133709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57792f9d-73f9-4394-bf7e-6c0b94b52611 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:15.138390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:15.139272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:15.139560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:15.139836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] PATH_INFO: `/v3/users/fb3d11de786246cd9850d272f063cb8c` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:15.141025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3d11de786246cd9850d272f063cb8c)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:15.142914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:15.186457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3d11de786246cd9850d272f063cb8c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.193543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3d11de786246cd9850d272f063cb8c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.194164 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3d11de786246cd9850d272f063cb8c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.201268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3d11de786246cd9850d272f063cb8c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.212557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3d11de786246cd9850d272f063cb8c'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.218228 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4159/8291] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:22:15 2021] DELETE /identity/v3/users/fb3d11de786246cd9850d272f063cb8c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:15.223269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fcd30-d3f5-4fc3-8d42-ab9ba989a936 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:15.223778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fcd30-d3f5-4fc3-8d42-ab9ba989a936 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:15.223882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fcd30-d3f5-4fc3-8d42-ab9ba989a936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:15.241838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c23fcd30-d3f5-4fc3-8d42-ab9ba989a936 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:15.243035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c23fcd30-d3f5-4fc3-8d42-ab9ba989a936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:15.301955 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4133/8292] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:22:15.312410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:15.313802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:15.372754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6621fe-cb6f-40d6-b840-7ef7f924850d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:15.376444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dbbac-c42b-46d1-be88-be3bd2cce9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:15.377112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dbbac-c42b-46d1-be88-be3bd2cce9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:15.377399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dbbac-c42b-46d1-be88-be3bd2cce9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:15.377678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dbbac-c42b-46d1-be88-be3bd2cce9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:15.387207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dbbac-c42b-46d1-be88-be3bd2cce9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:15.389076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dbbac-c42b-46d1-be88-be3bd2cce9d3 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:15.403876 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4160/8293] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:15.667591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fcd30-d3f5-4fc3-8d42-ab9ba989a936 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:15.668997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c23fcd30-d3f5-4fc3-8d42-ab9ba989a936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:15.682075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fcd30-d3f5-4fc3-8d42-ab9ba989a936 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:15.686567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:15.687446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:15.687733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:15.688010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] PATH_INFO: `/v3/projects/570d7cfeaedb482dabbcfc5f93d933a2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:15.689189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=570d7cfeaedb482dabbcfc5f93d933a2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:15.692114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:15.738164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570d7cfeaedb482dabbcfc5f93d933a2', 'request_id': 'req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.744432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570d7cfeaedb482dabbcfc5f93d933a2', 'request_id': 'req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.751840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570d7cfeaedb482dabbcfc5f93d933a2', 'request_id': 'req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.761765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] The token cache is being invalidate because project 570d7cfeaedb482dabbcfc5f93d933a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:22:15.762047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.762667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.764211 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4134/8294] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:22:15 2021] DELETE /identity/v3/projects/570d7cfeaedb482dabbcfc5f93d933a2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:15.768161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dbbac-c42b-46d1-be88-be3bd2cce9d3 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:15.778019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dbbac-c42b-46d1-be88-be3bd2cce9d3 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:15.840383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271f0a8-c782-4e27-9bb1-d14224544c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:15.841167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271f0a8-c782-4e27-9bb1-d14224544c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:15.841469 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271f0a8-c782-4e27-9bb1-d14224544c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:15.841740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271f0a8-c782-4e27-9bb1-d14224544c2f admin admin] PATH_INFO: `/v3/users/28a7bb53e5434b6ab02f9cbea0cb220d` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:15.842969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271f0a8-c782-4e27-9bb1-d14224544c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a7bb53e5434b6ab02f9cbea0cb220d)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:15.844933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271f0a8-c782-4e27-9bb1-d14224544c2f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:15.888405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6271f0a8-c782-4e27-9bb1-d14224544c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a7bb53e5434b6ab02f9cbea0cb220d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.895986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6271f0a8-c782-4e27-9bb1-d14224544c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a7bb53e5434b6ab02f9cbea0cb220d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.896695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6271f0a8-c782-4e27-9bb1-d14224544c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a7bb53e5434b6ab02f9cbea0cb220d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.903401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6271f0a8-c782-4e27-9bb1-d14224544c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a7bb53e5434b6ab02f9cbea0cb220d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.914488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-6271f0a8-c782-4e27-9bb1-d14224544c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a7bb53e5434b6ab02f9cbea0cb220d'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:15.920224 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4161/8295] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:22:15 2021] DELETE /identity/v3/users/28a7bb53e5434b6ab02f9cbea0cb220d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:16.184758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:16.186541 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:16.202190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd2415-3650-40a9-b9c4-ea8e48fa0b4e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:16.258358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:16.259238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:16.259577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:16.259850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] PATH_INFO: `/v3/projects/7b2246a489e9415bb20559e3c38140c7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:16.261024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2246a489e9415bb20559e3c38140c7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:16.262933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:16.307180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2246a489e9415bb20559e3c38140c7', 'request_id': 'req-706c34ee-016e-4df1-880b-2160123fb470'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:16.313117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2246a489e9415bb20559e3c38140c7', 'request_id': 'req-706c34ee-016e-4df1-880b-2160123fb470'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:16.319825 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2246a489e9415bb20559e3c38140c7', 'request_id': 'req-706c34ee-016e-4df1-880b-2160123fb470'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:16.329687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] The token cache is being invalidate because project 7b2246a489e9415bb20559e3c38140c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:22:16.329977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:16.330604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-706c34ee-016e-4df1-880b-2160123fb470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:16.332852 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4135/8296] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:22:16 2021] DELETE /identity/v3/projects/7b2246a489e9415bb20559e3c38140c7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:16.338761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3eb24-0100-4701-ab91-9969ad26acfb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:16.339275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3eb24-0100-4701-ab91-9969ad26acfb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:16.339381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3eb24-0100-4701-ab91-9969ad26acfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:16.358152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5ed3eb24-0100-4701-ab91-9969ad26acfb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:16.359306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5ed3eb24-0100-4701-ab91-9969ad26acfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:16.419781 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4162/8297] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:16.427644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46385a-711a-4191-b05f-e957c3cea15b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:16.428001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46385a-711a-4191-b05f-e957c3cea15b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:16.428345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46385a-711a-4191-b05f-e957c3cea15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:16.446900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cf46385a-711a-4191-b05f-e957c3cea15b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:16.448193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cf46385a-711a-4191-b05f-e957c3cea15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:16.456034 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4136/8298] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:16.460752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3eb24-0100-4701-ab91-9969ad26acfb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:16.470226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3eb24-0100-4701-ab91-9969ad26acfb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:16.475413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04c7ba-cb51-4619-b2e5-e62573d2c808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:16.476082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04c7ba-cb51-4619-b2e5-e62573d2c808 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:16.476361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04c7ba-cb51-4619-b2e5-e62573d2c808 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:16.476632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04c7ba-cb51-4619-b2e5-e62573d2c808 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:16.477355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04c7ba-cb51-4619-b2e5-e62573d2c808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:22:16.477653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04c7ba-cb51-4619-b2e5-e62573d2c808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:16.479243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04c7ba-cb51-4619-b2e5-e62573d2c808 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:16.490674 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4163/8299] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:22:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:22:16.494828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46385a-711a-4191-b05f-e957c3cea15b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:16.504109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46385a-711a-4191-b05f-e957c3cea15b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:16.508816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda74e1c-f665-4d34-b6a6-e4ccf63830f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:16.509458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda74e1c-f665-4d34-b6a6-e4ccf63830f7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:16.509747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda74e1c-f665-4d34-b6a6-e4ccf63830f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:16.510027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda74e1c-f665-4d34-b6a6-e4ccf63830f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:16.510724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda74e1c-f665-4d34-b6a6-e4ccf63830f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:16.512731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda74e1c-f665-4d34-b6a6-e4ccf63830f7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:16.538615 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4137/8300] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:22:16 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:16.542707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04c7ba-cb51-4619-b2e5-e62573d2c808 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:16.552755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04c7ba-cb51-4619-b2e5-e62573d2c808 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:16.607111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655f72-1040-44f0-b25e-6ca235af1e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:16.608030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655f72-1040-44f0-b25e-6ca235af1e4b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:16.608360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655f72-1040-44f0-b25e-6ca235af1e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:16.608579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655f72-1040-44f0-b25e-6ca235af1e4b admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:16.609274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655f72-1040-44f0-b25e-6ca235af1e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:16.611174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e655f72-1040-44f0-b25e-6ca235af1e4b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:16.631063 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4164/8301] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:22:16 2021] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:16.635195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda74e1c-f665-4d34-b6a6-e4ccf63830f7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:16.646418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda74e1c-f665-4d34-b6a6-e4ccf63830f7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:16.651101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5bb93-3a93-4789-b0a5-9004747d26d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:16.651791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5bb93-3a93-4789-b0a5-9004747d26d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:16.652074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5bb93-3a93-4789-b0a5-9004747d26d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:16.652375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5bb93-3a93-4789-b0a5-9004747d26d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:16.653108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5bb93-3a93-4789-b0a5-9004747d26d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:16.654704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5bb93-3a93-4789-b0a5-9004747d26d9 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:16.664918 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4138/8302] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:16.668953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655f72-1040-44f0-b25e-6ca235af1e4b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:16.678923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655f72-1040-44f0-b25e-6ca235af1e4b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:16.683596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bcd88-05ba-4d7f-9fc6-a66f78b3f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:16.684240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bcd88-05ba-4d7f-9fc6-a66f78b3f418 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:16.684529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bcd88-05ba-4d7f-9fc6-a66f78b3f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:16.684808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bcd88-05ba-4d7f-9fc6-a66f78b3f418 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:16.685540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bcd88-05ba-4d7f-9fc6-a66f78b3f418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:16.687125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bcd88-05ba-4d7f-9fc6-a66f78b3f418 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:16.697413 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4165/8303] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:16.701435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5bb93-3a93-4789-b0a5-9004747d26d9 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:16.712155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5bb93-3a93-4789-b0a5-9004747d26d9 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:16.716804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69ad1c-e6dd-4c5f-8e4a-0c8486911bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:16.717675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69ad1c-e6dd-4c5f-8e4a-0c8486911bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:16.717960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69ad1c-e6dd-4c5f-8e4a-0c8486911bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:16.718252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69ad1c-e6dd-4c5f-8e4a-0c8486911bcf admin admin] PATH_INFO: `/v3/projects/686a8233f0e94b2bac7e4eb02ac5a4f1/users/4c026d87d35444e8a8a722c1d3cde5cb/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:16.732512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69ad1c-e6dd-4c5f-8e4a-0c8486911bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=686a8233f0e94b2bac7e4eb02ac5a4f1, user_id=4c026d87d35444e8a8a722c1d3cde5cb, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:16.735170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a69ad1c-e6dd-4c5f-8e4a-0c8486911bcf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:16.748385 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4139/8304] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:16 2021] PUT /identity/v3/projects/686a8233f0e94b2bac7e4eb02ac5a4f1/users/4c026d87d35444e8a8a722c1d3cde5cb/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:16.753918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf3e2-9563-4292-bc7c-193f52183af5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:16.754237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf3e2-9563-4292-bc7c-193f52183af5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:16.754510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf3e2-9563-4292-bc7c-193f52183af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:16.772771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6edcf3e2-9563-4292-bc7c-193f52183af5 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:16.774001 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6edcf3e2-9563-4292-bc7c-193f52183af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:16.834867 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4166/8305] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:16.842251 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69ad1c-e6dd-4c5f-8e4a-0c8486911bcf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:16.843984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9a69ad1c-e6dd-4c5f-8e4a-0c8486911bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:16.902683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69ad1c-e6dd-4c5f-8e4a-0c8486911bcf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:16.906280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d08ef-437c-4c7f-9c0f-259727eb3ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:16.906954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d08ef-437c-4c7f-9c0f-259727eb3ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:16.907240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d08ef-437c-4c7f-9c0f-259727eb3ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:16.907554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d08ef-437c-4c7f-9c0f-259727eb3ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:16.916591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d08ef-437c-4c7f-9c0f-259727eb3ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:16.918036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d08ef-437c-4c7f-9c0f-259727eb3ce6 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:16.927510 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4140/8306] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:17.548088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988cb22-ca87-47a5-a415-d24354e73b39 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:17.549119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988cb22-ca87-47a5-a415-d24354e73b39 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:17.549564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988cb22-ca87-47a5-a415-d24354e73b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:17.577095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f988cb22-ca87-47a5-a415-d24354e73b39 None None] MFA Rules not processed for user `4c026d87d35444e8a8a722c1d3cde5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:17.578322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f988cb22-ca87-47a5-a415-d24354e73b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:17.643853 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4167/8307] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:17 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:17.648213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d08ef-437c-4c7f-9c0f-259727eb3ce6 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:17.658097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d08ef-437c-4c7f-9c0f-259727eb3ce6 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:17.663349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697b0b1-f188-436a-9c90-6d621f9f5199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:17.664005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697b0b1-f188-436a-9c90-6d621f9f5199 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:17.664291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697b0b1-f188-436a-9c90-6d621f9f5199 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:17.665029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697b0b1-f188-436a-9c90-6d621f9f5199 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:17.665867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697b0b1-f188-436a-9c90-6d621f9f5199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:17.667818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697b0b1-f188-436a-9c90-6d621f9f5199 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:17.693162 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4141/8308] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:22:17 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:17.697162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988cb22-ca87-47a5-a415-d24354e73b39 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:17.709493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988cb22-ca87-47a5-a415-d24354e73b39 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:17.764269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91a24e-8914-4329-a5d4-7e08a11fb879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:17.764940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91a24e-8914-4329-a5d4-7e08a11fb879 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:17.765228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91a24e-8914-4329-a5d4-7e08a11fb879 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:17.765496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91a24e-8914-4329-a5d4-7e08a11fb879 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:17.766317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91a24e-8914-4329-a5d4-7e08a11fb879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:17.768341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91a24e-8914-4329-a5d4-7e08a11fb879 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:17.789891 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4168/8309] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:22:17 2021] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:17.793812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697b0b1-f188-436a-9c90-6d621f9f5199 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:17.806588 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697b0b1-f188-436a-9c90-6d621f9f5199 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:17.811344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e54ba2-defc-42aa-945b-d2d56c136f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:17.812002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e54ba2-defc-42aa-945b-d2d56c136f46 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:17.812292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e54ba2-defc-42aa-945b-d2d56c136f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:17.812566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e54ba2-defc-42aa-945b-d2d56c136f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:17.813298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e54ba2-defc-42aa-945b-d2d56c136f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:17.814897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e54ba2-defc-42aa-945b-d2d56c136f46 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:17.825433 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4142/8310] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:17 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:17.829677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91a24e-8914-4329-a5d4-7e08a11fb879 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:17.840309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91a24e-8914-4329-a5d4-7e08a11fb879 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:17.845686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a993cf8-d359-49ba-b976-c78117f8a16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:17.846568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a993cf8-d359-49ba-b976-c78117f8a16b admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:17.847617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a993cf8-d359-49ba-b976-c78117f8a16b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:17.847909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a993cf8-d359-49ba-b976-c78117f8a16b admin admin] PATH_INFO: `/v3/projects/3fbf11da66a54891a89db48df774b6ef/users/714e0311bf194833a14e625db4d4c734/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:17.864420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a993cf8-d359-49ba-b976-c78117f8a16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbf11da66a54891a89db48df774b6ef, user_id=714e0311bf194833a14e625db4d4c734, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:17.867057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a993cf8-d359-49ba-b976-c78117f8a16b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:17.879643 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4169/8311] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:17 2021] PUT /identity/v3/projects/3fbf11da66a54891a89db48df774b6ef/users/714e0311bf194833a14e625db4d4c734/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:22:17.883533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e54ba2-defc-42aa-945b-d2d56c136f46 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:17.897772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e54ba2-defc-42aa-945b-d2d56c136f46 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:17.952949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589544a-3edc-4ca0-8d85-ef56959d5a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:17.953613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589544a-3edc-4ca0-8d85-ef56959d5a2e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:17.953897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589544a-3edc-4ca0-8d85-ef56959d5a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:17.954174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589544a-3edc-4ca0-8d85-ef56959d5a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:17.954897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589544a-3edc-4ca0-8d85-ef56959d5a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:17.957038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589544a-3edc-4ca0-8d85-ef56959d5a2e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:17.966460 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4143/8312] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:17 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:17.970780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a993cf8-d359-49ba-b976-c78117f8a16b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:17.981720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a993cf8-d359-49ba-b976-c78117f8a16b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:17.986755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dae6b-aac5-480e-936a-0254fd84e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:17.987664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dae6b-aac5-480e-936a-0254fd84e30d admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:17.987950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dae6b-aac5-480e-936a-0254fd84e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:17.988223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dae6b-aac5-480e-936a-0254fd84e30d admin admin] PATH_INFO: `/v3/projects/3fbf11da66a54891a89db48df774b6ef/users/714e0311bf194833a14e625db4d4c734/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:17.990249 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dae6b-aac5-480e-936a-0254fd84e30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbf11da66a54891a89db48df774b6ef, user_id=714e0311bf194833a14e625db4d4c734, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:17.992922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dae6b-aac5-480e-936a-0254fd84e30d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:18.003131 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4170/8313] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:17 2021] PUT /identity/v3/projects/3fbf11da66a54891a89db48df774b6ef/users/714e0311bf194833a14e625db4d4c734/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:18.600102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e69845-443b-45fa-a11a-65a14971887a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:18.600397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e69845-443b-45fa-a11a-65a14971887a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:18.600677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e69845-443b-45fa-a11a-65a14971887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:18.628252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f4e69845-443b-45fa-a11a-65a14971887a None None] MFA Rules not processed for user `714e0311bf194833a14e625db4d4c734`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:18.630049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f4e69845-443b-45fa-a11a-65a14971887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:18.703957 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4144/8314] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:18 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:22:18.715104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7607ee0-0eaf-4679-9a52-53a1221d13f5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:18.715696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7607ee0-0eaf-4679-9a52-53a1221d13f5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:18.715810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7607ee0-0eaf-4679-9a52-53a1221d13f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:18.735132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d7607ee0-0eaf-4679-9a52-53a1221d13f5 None None] MFA Rules not processed for user `4c026d87d35444e8a8a722c1d3cde5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:18.736729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d7607ee0-0eaf-4679-9a52-53a1221d13f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:18.793746 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4171/8315] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:18 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:22:18.805793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e69845-443b-45fa-a11a-65a14971887a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:18.807284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f4e69845-443b-45fa-a11a-65a14971887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:18.888940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e69845-443b-45fa-a11a-65a14971887a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:18.895443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7316a-354b-4603-95fd-a1d2fd3f9140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:18.896275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7316a-354b-4603-95fd-a1d2fd3f9140 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:18.896407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7316a-354b-4603-95fd-a1d2fd3f9140 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:18.896671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7316a-354b-4603-95fd-a1d2fd3f9140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:18.905080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7316a-354b-4603-95fd-a1d2fd3f9140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:18.906691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7316a-354b-4603-95fd-a1d2fd3f9140 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:18.916439 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4145/8316] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:18 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:19.460970 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7607ee0-0eaf-4679-9a52-53a1221d13f5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:19.462508 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d7607ee0-0eaf-4679-9a52-53a1221d13f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:19.533586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7607ee0-0eaf-4679-9a52-53a1221d13f5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:19.539116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74278-3ddc-44f5-860b-713450d16e3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:19.539792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74278-3ddc-44f5-860b-713450d16e3b service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:19.540078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74278-3ddc-44f5-860b-713450d16e3b service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:19.540355 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74278-3ddc-44f5-860b-713450d16e3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:19.542116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-50b74278-3ddc-44f5-860b-713450d16e3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:19.557385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b74278-3ddc-44f5-860b-713450d16e3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:19.558973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b74278-3ddc-44f5-860b-713450d16e3b service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:19.571705 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4172/8317] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:19 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:29.622741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7316a-354b-4603-95fd-a1d2fd3f9140 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:29.624216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b1f7316a-354b-4603-95fd-a1d2fd3f9140 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:29.644801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7316a-354b-4603-95fd-a1d2fd3f9140 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:29.650769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe537b0-e157-4b74-b9f1-68f20ff4f5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:29.651447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe537b0-e157-4b74-b9f1-68f20ff4f5a4 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:29.651727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe537b0-e157-4b74-b9f1-68f20ff4f5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:29.652002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe537b0-e157-4b74-b9f1-68f20ff4f5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:29.653755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bbe537b0-e157-4b74-b9f1-68f20ff4f5a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:29.668993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe537b0-e157-4b74-b9f1-68f20ff4f5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:29.670582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe537b0-e157-4b74-b9f1-68f20ff4f5a4 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:29.685711 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4146/8318] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:33.862940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74278-3ddc-44f5-860b-713450d16e3b service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:33.864853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-50b74278-3ddc-44f5-860b-713450d16e3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:33.921972 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74278-3ddc-44f5-860b-713450d16e3b service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:33.926175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fd198-d8f6-4bc7-9574-9442d89e8ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:33.926799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fd198-d8f6-4bc7-9574-9442d89e8ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:33.927084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fd198-d8f6-4bc7-9574-9442d89e8ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:33.927387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fd198-d8f6-4bc7-9574-9442d89e8ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:33.936746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fd198-d8f6-4bc7-9574-9442d89e8ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:33.938196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fd198-d8f6-4bc7-9574-9442d89e8ea4 service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:33.947885 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4173/8319] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:33 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:36.394868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe537b0-e157-4b74-b9f1-68f20ff4f5a4 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:36.410067 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe537b0-e157-4b74-b9f1-68f20ff4f5a4 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:36.416060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bc5b3-2a77-448e-8748-2664994f7d92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:36.416704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bc5b3-2a77-448e-8748-2664994f7d92 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:36.416990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bc5b3-2a77-448e-8748-2664994f7d92 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:36.417265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bc5b3-2a77-448e-8748-2664994f7d92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:36.419039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-574bc5b3-2a77-448e-8748-2664994f7d92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:36.435612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bc5b3-2a77-448e-8748-2664994f7d92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:36.437281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bc5b3-2a77-448e-8748-2664994f7d92 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:36.451591 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4147/8320] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:52.045458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fd198-d8f6-4bc7-9574-9442d89e8ea4 service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:52.108071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fd198-d8f6-4bc7-9574-9442d89e8ea4 service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:52.113601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:52.114459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:52.114743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:52.115022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] PATH_INFO: `/v3/users/4c026d87d35444e8a8a722c1d3cde5cb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:52.116255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c026d87d35444e8a8a722c1d3cde5cb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:52.118199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:52.161449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c026d87d35444e8a8a722c1d3cde5cb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.168102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c026d87d35444e8a8a722c1d3cde5cb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.168693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c026d87d35444e8a8a722c1d3cde5cb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.176024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c026d87d35444e8a8a722c1d3cde5cb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.187171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c026d87d35444e8a8a722c1d3cde5cb'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.193009 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4174/8321] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:22:52 2021] DELETE /identity/v3/users/4c026d87d35444e8a8a722c1d3cde5cb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:52.364868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bc5b3-2a77-448e-8748-2664994f7d92 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:52.377755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bc5b3-2a77-448e-8748-2664994f7d92 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:52.436218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:52.436991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:52.437276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:52.437594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] PATH_INFO: `/v3/projects/686a8233f0e94b2bac7e4eb02ac5a4f1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:52.439062 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=686a8233f0e94b2bac7e4eb02ac5a4f1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:52.441556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:52.488350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'request_id': 'req-98dc3835-f27e-4f08-87c5-098f3e8888e7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.494283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'request_id': 'req-98dc3835-f27e-4f08-87c5-098f3e8888e7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.501626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '686a8233f0e94b2bac7e4eb02ac5a4f1', 'request_id': 'req-98dc3835-f27e-4f08-87c5-098f3e8888e7'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.512921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] The token cache is being invalidate because project 686a8233f0e94b2bac7e4eb02ac5a4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:22:52.513209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.513857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.515446 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4148/8322] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:22:52 2021] DELETE /identity/v3/projects/686a8233f0e94b2bac7e4eb02ac5a4f1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:52.520200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:52.521757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:52.535543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82483133-3207-431c-b2cf-8c112b7a43d2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:52.594474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafbe66-d17a-4412-bb3d-b07ed1bd0add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:52.595372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafbe66-d17a-4412-bb3d-b07ed1bd0add admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:52.595656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafbe66-d17a-4412-bb3d-b07ed1bd0add admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:52.595927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafbe66-d17a-4412-bb3d-b07ed1bd0add admin admin] PATH_INFO: `/v3/users/714e0311bf194833a14e625db4d4c734` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:52.597255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafbe66-d17a-4412-bb3d-b07ed1bd0add admin admin] RBAC: Authorizing `identity:delete_user(user_id=714e0311bf194833a14e625db4d4c734)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:52.600017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafbe66-d17a-4412-bb3d-b07ed1bd0add admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:52.649352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fafbe66-d17a-4412-bb3d-b07ed1bd0add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714e0311bf194833a14e625db4d4c734'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.656553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fafbe66-d17a-4412-bb3d-b07ed1bd0add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714e0311bf194833a14e625db4d4c734'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.657259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fafbe66-d17a-4412-bb3d-b07ed1bd0add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714e0311bf194833a14e625db4d4c734'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.664252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fafbe66-d17a-4412-bb3d-b07ed1bd0add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714e0311bf194833a14e625db4d4c734'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.675610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-8fafbe66-d17a-4412-bb3d-b07ed1bd0add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714e0311bf194833a14e625db4d4c734'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.681527 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4175/8323] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:22:52 2021] DELETE /identity/v3/users/714e0311bf194833a14e625db4d4c734 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:52.854877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:52.856391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:52.872483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc3835-f27e-4f08-87c5-098f3e8888e7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:52.934411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:52.935304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:52.935608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:52.935867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] PATH_INFO: `/v3/projects/3fbf11da66a54891a89db48df774b6ef` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:52.937072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fbf11da66a54891a89db48df774b6ef)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:52.938986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:52.991382 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fbf11da66a54891a89db48df774b6ef', 'request_id': 'req-b87d348c-da1f-452a-8be9-6eac0d48d4ef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:52.998441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fbf11da66a54891a89db48df774b6ef', 'request_id': 'req-b87d348c-da1f-452a-8be9-6eac0d48d4ef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:53.007024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fbf11da66a54891a89db48df774b6ef', 'request_id': 'req-b87d348c-da1f-452a-8be9-6eac0d48d4ef'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:53.019373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] The token cache is being invalidate because project 3fbf11da66a54891a89db48df774b6ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:22:53.019692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:53.020343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b87d348c-da1f-452a-8be9-6eac0d48d4ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:53.021892 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4149/8324] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:22:52 2021] DELETE /identity/v3/projects/3fbf11da66a54891a89db48df774b6ef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:53.027819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6823a4-07a6-47af-a271-060faa2122bc None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.028135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6823a4-07a6-47af-a271-060faa2122bc None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.028433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6823a4-07a6-47af-a271-060faa2122bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.046978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1a6823a4-07a6-47af-a271-060faa2122bc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:53.048228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1a6823a4-07a6-47af-a271-060faa2122bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:53.109596 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4176/8325] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:53.118225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e2dc-6cc5-4c0c-ada7-fad8d1dbb18b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.118516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e2dc-6cc5-4c0c-ada7-fad8d1dbb18b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.118794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e2dc-6cc5-4c0c-ada7-fad8d1dbb18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.139731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8427e2dc-6cc5-4c0c-ada7-fad8d1dbb18b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:53.141044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8427e2dc-6cc5-4c0c-ada7-fad8d1dbb18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:53.149611 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4150/8326] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:22:53.155143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6823a4-07a6-47af-a271-060faa2122bc None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:53.165774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6823a4-07a6-47af-a271-060faa2122bc None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:53.170410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d344ae-a03b-4cc2-8ebd-4251794a0ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:53.171061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d344ae-a03b-4cc2-8ebd-4251794a0ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.171392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d344ae-a03b-4cc2-8ebd-4251794a0ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.171675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d344ae-a03b-4cc2-8ebd-4251794a0ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.172440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d344ae-a03b-4cc2-8ebd-4251794a0ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:22:53.172749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d344ae-a03b-4cc2-8ebd-4251794a0ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:53.174868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d344ae-a03b-4cc2-8ebd-4251794a0ca4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:53.186373 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4177/8327] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:22:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:22:53.191273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427e2dc-6cc5-4c0c-ada7-fad8d1dbb18b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:53.200629 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427e2dc-6cc5-4c0c-ada7-fad8d1dbb18b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:53.206721 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242941bc-fbfd-42ca-8716-155f8228896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:53.207587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242941bc-fbfd-42ca-8716-155f8228896b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.207876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242941bc-fbfd-42ca-8716-155f8228896b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.208155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242941bc-fbfd-42ca-8716-155f8228896b admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.208865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242941bc-fbfd-42ca-8716-155f8228896b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:53.210779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242941bc-fbfd-42ca-8716-155f8228896b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:53.241377 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4151/8328] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:22:53 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:22:53.242389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d344ae-a03b-4cc2-8ebd-4251794a0ca4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:53.252171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d344ae-a03b-4cc2-8ebd-4251794a0ca4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:53.307332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b589c-1cf6-474a-9a38-61097dafc7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:53.308002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b589c-1cf6-474a-9a38-61097dafc7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.308289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b589c-1cf6-474a-9a38-61097dafc7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.308598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b589c-1cf6-474a-9a38-61097dafc7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.309302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b589c-1cf6-474a-9a38-61097dafc7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:53.311221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b589c-1cf6-474a-9a38-61097dafc7f8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:53.330610 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4178/8329] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:22:53 2021] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:22:53.334830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242941bc-fbfd-42ca-8716-155f8228896b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:53.345324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242941bc-fbfd-42ca-8716-155f8228896b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:53.350740 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93dcad-9546-4343-9b2b-d03cc29824f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:53.351427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93dcad-9546-4343-9b2b-d03cc29824f0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.351715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93dcad-9546-4343-9b2b-d03cc29824f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.351992 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93dcad-9546-4343-9b2b-d03cc29824f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.352722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93dcad-9546-4343-9b2b-d03cc29824f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:53.354329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93dcad-9546-4343-9b2b-d03cc29824f0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:53.365462 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4152/8330] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:53.369390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b589c-1cf6-474a-9a38-61097dafc7f8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:53.379378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b589c-1cf6-474a-9a38-61097dafc7f8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:53.384315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b71f9e-f1a0-43c4-89f1-97fa03279437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:53.385094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71f9e-f1a0-43c4-89f1-97fa03279437 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.385384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71f9e-f1a0-43c4-89f1-97fa03279437 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.385658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71f9e-f1a0-43c4-89f1-97fa03279437 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.386393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b71f9e-f1a0-43c4-89f1-97fa03279437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:53.388078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b71f9e-f1a0-43c4-89f1-97fa03279437 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:53.398750 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4179/8331] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:53.402984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93dcad-9546-4343-9b2b-d03cc29824f0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:53.413538 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93dcad-9546-4343-9b2b-d03cc29824f0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:53.418141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc1826-d024-46c5-a1a0-caa04275667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:53.419003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1826-d024-46c5-a1a0-caa04275667a admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.419309 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1826-d024-46c5-a1a0-caa04275667a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.419584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1826-d024-46c5-a1a0-caa04275667a admin admin] PATH_INFO: `/v3/projects/1633b0ee23ba426bb3b4ef52c1707bd9/users/fbf3d0ce97bd4e599f2ba4e13dc363a1/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.434337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc1826-d024-46c5-a1a0-caa04275667a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1633b0ee23ba426bb3b4ef52c1707bd9, user_id=fbf3d0ce97bd4e599f2ba4e13dc363a1, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:53.437041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc1826-d024-46c5-a1a0-caa04275667a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:53.451089 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4153/8332] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:53 2021] PUT /identity/v3/projects/1633b0ee23ba426bb3b4ef52c1707bd9/users/fbf3d0ce97bd4e599f2ba4e13dc363a1/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:53.461511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c1853-464b-4241-a3bb-c56adb245ed5 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.461802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c1853-464b-4241-a3bb-c56adb245ed5 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.462083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c1853-464b-4241-a3bb-c56adb245ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.489084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ed8c1853-464b-4241-a3bb-c56adb245ed5 None None] MFA Rules not processed for user `fbf3d0ce97bd4e599f2ba4e13dc363a1`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:53.490285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ed8c1853-464b-4241-a3bb-c56adb245ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:53.552984 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4180/8333] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:53 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:53.563293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc1826-d024-46c5-a1a0-caa04275667a admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:53.565069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b0cc1826-d024-46c5-a1a0-caa04275667a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:53.623006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc1826-d024-46c5-a1a0-caa04275667a admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:53.626749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801626c-b18d-4047-b077-4e21e823941d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:53.627421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801626c-b18d-4047-b077-4e21e823941d service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.627731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801626c-b18d-4047-b077-4e21e823941d service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.628010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801626c-b18d-4047-b077-4e21e823941d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.636425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801626c-b18d-4047-b077-4e21e823941d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:53.637864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801626c-b18d-4047-b077-4e21e823941d service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:53.646639 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4154/8334] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:53 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:53.665251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c1853-464b-4241-a3bb-c56adb245ed5 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:53.725655 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c1853-464b-4241-a3bb-c56adb245ed5 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:53.730331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:53.731182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.731497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.731775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] PATH_INFO: `/v3/users/fbf3d0ce97bd4e599f2ba4e13dc363a1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.732983 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf3d0ce97bd4e599f2ba4e13dc363a1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:53.734886 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:53.777612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf3d0ce97bd4e599f2ba4e13dc363a1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:53.785075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf3d0ce97bd4e599f2ba4e13dc363a1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:53.785646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf3d0ce97bd4e599f2ba4e13dc363a1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:53.792492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf3d0ce97bd4e599f2ba4e13dc363a1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:53.803750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf3d0ce97bd4e599f2ba4e13dc363a1'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:53.809365 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4181/8335] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:22:53 2021] DELETE /identity/v3/users/fbf3d0ce97bd4e599f2ba4e13dc363a1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:53.813948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113ffb2-c894-4b8c-85eb-0a8ec432a97f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.814236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113ffb2-c894-4b8c-85eb-0a8ec432a97f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.814511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113ffb2-c894-4b8c-85eb-0a8ec432a97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.832763 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8113ffb2-c894-4b8c-85eb-0a8ec432a97f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:53.834030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8113ffb2-c894-4b8c-85eb-0a8ec432a97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:53.901435 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4155/8336] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:22:53.912052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:53.913471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:53.970673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf3950-4bfa-4f48-83f7-000ca5510ab6 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:53.974999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efc0c1-8d52-44a2-b7a0-d474386827ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:53.975667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efc0c1-8d52-44a2-b7a0-d474386827ef service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:53.975954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efc0c1-8d52-44a2-b7a0-d474386827ef service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:53.976255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efc0c1-8d52-44a2-b7a0-d474386827ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:53.985344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efc0c1-8d52-44a2-b7a0-d474386827ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:53.987069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90efc0c1-8d52-44a2-b7a0-d474386827ef service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:53.996457 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4182/8337] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:54.297149 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113ffb2-c894-4b8c-85eb-0a8ec432a97f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:54.298699 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8113ffb2-c894-4b8c-85eb-0a8ec432a97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:54.310867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113ffb2-c894-4b8c-85eb-0a8ec432a97f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:54.316525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:54.317423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:54.317701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:54.317975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] PATH_INFO: `/v3/projects/1633b0ee23ba426bb3b4ef52c1707bd9` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:54.319274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1633b0ee23ba426bb3b4ef52c1707bd9)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:54.321248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:54.370707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1633b0ee23ba426bb3b4ef52c1707bd9', 'request_id': 'req-268ce563-3fed-4bee-a23e-6df3f1a38fcc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:54.376781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1633b0ee23ba426bb3b4ef52c1707bd9', 'request_id': 'req-268ce563-3fed-4bee-a23e-6df3f1a38fcc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:54.384667 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1633b0ee23ba426bb3b4ef52c1707bd9', 'request_id': 'req-268ce563-3fed-4bee-a23e-6df3f1a38fcc'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:54.395606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] The token cache is being invalidate because project 1633b0ee23ba426bb3b4ef52c1707bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:22:54.395897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:54.396583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-268ce563-3fed-4bee-a23e-6df3f1a38fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:22:54.398162 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4156/8338] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:22:54 2021] DELETE /identity/v3/projects/1633b0ee23ba426bb3b4ef52c1707bd9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:54.403827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5f090-0214-4755-af79-561848609d07 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:54.404315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5f090-0214-4755-af79-561848609d07 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:54.404424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5f090-0214-4755-af79-561848609d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:54.423973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-abe5f090-0214-4755-af79-561848609d07 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:54.425829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-abe5f090-0214-4755-af79-561848609d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:54.485001 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4183/8339] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:54.492990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558865f9-9b4d-4478-b552-d837d75e3c95 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:54.493280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558865f9-9b4d-4478-b552-d837d75e3c95 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:54.493557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558865f9-9b4d-4478-b552-d837d75e3c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:54.511526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-558865f9-9b4d-4478-b552-d837d75e3c95 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:54.512765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-558865f9-9b4d-4478-b552-d837d75e3c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:54.521549 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4157/8340] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:54.525747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5f090-0214-4755-af79-561848609d07 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:54.536154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5f090-0214-4755-af79-561848609d07 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:54.540751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e10b0-b90a-42d0-8324-de7e3e189b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:54.541393 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e10b0-b90a-42d0-8324-de7e3e189b88 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:54.541672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e10b0-b90a-42d0-8324-de7e3e189b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:54.541943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e10b0-b90a-42d0-8324-de7e3e189b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:54.542666 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e10b0-b90a-42d0-8324-de7e3e189b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:22:54.542964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e10b0-b90a-42d0-8324-de7e3e189b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:54.544578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e10b0-b90a-42d0-8324-de7e3e189b88 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:54.556214 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4184/8341] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:22:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:22:54.560341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558865f9-9b4d-4478-b552-d837d75e3c95 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:54.569530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558865f9-9b4d-4478-b552-d837d75e3c95 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:54.574115 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed5f89-a061-40ef-a312-3e72183c2ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:54.574746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed5f89-a061-40ef-a312-3e72183c2ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:54.575026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed5f89-a061-40ef-a312-3e72183c2ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:54.575336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed5f89-a061-40ef-a312-3e72183c2ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:54.576024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed5f89-a061-40ef-a312-3e72183c2ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:54.577911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed5f89-a061-40ef-a312-3e72183c2ef7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:54.603505 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4158/8342] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:22:54 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:22:54.607413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e10b0-b90a-42d0-8324-de7e3e189b88 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:54.617929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e10b0-b90a-42d0-8324-de7e3e189b88 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:54.671727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc016d-6da5-44d8-8e41-2277e45f09f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:54.672408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc016d-6da5-44d8-8e41-2277e45f09f4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:54.672687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc016d-6da5-44d8-8e41-2277e45f09f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:54.672958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc016d-6da5-44d8-8e41-2277e45f09f4 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:54.673653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc016d-6da5-44d8-8e41-2277e45f09f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:54.675623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc016d-6da5-44d8-8e41-2277e45f09f4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:54.694226 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4185/8343] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:22:54 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:22:54.698364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed5f89-a061-40ef-a312-3e72183c2ef7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:54.709274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed5f89-a061-40ef-a312-3e72183c2ef7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:54.713867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5becc9-6abb-48f3-ba03-458cef66ee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:54.714546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5becc9-6abb-48f3-ba03-458cef66ee9e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:54.714833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5becc9-6abb-48f3-ba03-458cef66ee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:54.715111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5becc9-6abb-48f3-ba03-458cef66ee9e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:54.715880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5becc9-6abb-48f3-ba03-458cef66ee9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:54.717476 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5becc9-6abb-48f3-ba03-458cef66ee9e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:54.729685 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4159/8344] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:54.733730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc016d-6da5-44d8-8e41-2277e45f09f4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:54.744166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc016d-6da5-44d8-8e41-2277e45f09f4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:54.748777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44710fa2-62f3-42a3-ab37-4371b4ae2b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:54.749423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710fa2-62f3-42a3-ab37-4371b4ae2b40 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:54.749712 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710fa2-62f3-42a3-ab37-4371b4ae2b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:54.749990 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710fa2-62f3-42a3-ab37-4371b4ae2b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:54.750715 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44710fa2-62f3-42a3-ab37-4371b4ae2b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:54.752339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44710fa2-62f3-42a3-ab37-4371b4ae2b40 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:54.762111 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4186/8345] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:22:54 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:22:54.766103 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5becc9-6abb-48f3-ba03-458cef66ee9e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:54.776540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5becc9-6abb-48f3-ba03-458cef66ee9e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:54.781093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656cf2-f4e4-4088-904f-3892b3447804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:54.781948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656cf2-f4e4-4088-904f-3892b3447804 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:54.782227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656cf2-f4e4-4088-904f-3892b3447804 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:54.782494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656cf2-f4e4-4088-904f-3892b3447804 admin admin] PATH_INFO: `/v3/projects/e83b027153ea42e1b193393f015947f1/users/5aa295a582b041a1a535958cbeb50e8f/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:54.797401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0656cf2-f4e4-4088-904f-3892b3447804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83b027153ea42e1b193393f015947f1, user_id=5aa295a582b041a1a535958cbeb50e8f, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:54.800185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0656cf2-f4e4-4088-904f-3892b3447804 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:54.812534 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4160/8346] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:22:54 2021] PUT /identity/v3/projects/e83b027153ea42e1b193393f015947f1/users/5aa295a582b041a1a535958cbeb50e8f/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:22:54.824363 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0a3f-1c3c-4b29-b196-e537df633367 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:54.824654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0a3f-1c3c-4b29-b196-e537df633367 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:54.824932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0a3f-1c3c-4b29-b196-e537df633367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:54.851849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-723e0a3f-1c3c-4b29-b196-e537df633367 None None] MFA Rules not processed for user `5aa295a582b041a1a535958cbeb50e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:54.853054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-723e0a3f-1c3c-4b29-b196-e537df633367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:54.915186 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4187/8347] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:54 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:22:54.925507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656cf2-f4e4-4088-904f-3892b3447804 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:22:54.927208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c0656cf2-f4e4-4088-904f-3892b3447804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:54.984946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656cf2-f4e4-4088-904f-3892b3447804 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:22:54.989612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c51007-60f8-4771-b258-ae5abbddee67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:22:54.990250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c51007-60f8-4771-b258-ae5abbddee67 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:54.990535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c51007-60f8-4771-b258-ae5abbddee67 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:54.990808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c51007-60f8-4771-b258-ae5abbddee67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:54.999186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c51007-60f8-4771-b258-ae5abbddee67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:22:55.000731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c51007-60f8-4771-b258-ae5abbddee67 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:22:55.009718 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4161/8348] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:22:54 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:22:56.412409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104158-5930-4cc1-af99-8f66969440ff None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:22:56.412975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104158-5930-4cc1-af99-8f66969440ff None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:22:56.412975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104158-5930-4cc1-af99-8f66969440ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:22:56.438201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e9104158-5930-4cc1-af99-8f66969440ff None None] MFA Rules not processed for user `5aa295a582b041a1a535958cbeb50e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:22:56.440419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e9104158-5930-4cc1-af99-8f66969440ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:22:56.448066 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4188/8349] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:22:56 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:37.766282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c51007-60f8-4771-b258-ae5abbddee67 service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:37.767928 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-53c51007-60f8-4771-b258-ae5abbddee67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:37.839548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c51007-60f8-4771-b258-ae5abbddee67 service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:37.844663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9773a-0db6-410e-8d9c-d46251c9ca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:37.845563 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9773a-0db6-410e-8d9c-d46251c9ca33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:37.845845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9773a-0db6-410e-8d9c-d46251c9ca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:37.846116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9773a-0db6-410e-8d9c-d46251c9ca33 admin admin] PATH_INFO: `/v3/users/6e49ff29764540ae95d8b9d0f9d4fbfa` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:37.847528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9773a-0db6-410e-8d9c-d46251c9ca33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e49ff29764540ae95d8b9d0f9d4fbfa)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:37.849466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9773a-0db6-410e-8d9c-d46251c9ca33 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:37.909761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b9d9773a-0db6-410e-8d9c-d46251c9ca33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e49ff29764540ae95d8b9d0f9d4fbfa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:37.910506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b9d9773a-0db6-410e-8d9c-d46251c9ca33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e49ff29764540ae95d8b9d0f9d4fbfa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:37.918954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b9d9773a-0db6-410e-8d9c-d46251c9ca33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e49ff29764540ae95d8b9d0f9d4fbfa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:37.919685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b9d9773a-0db6-410e-8d9c-d46251c9ca33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e49ff29764540ae95d8b9d0f9d4fbfa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:37.927518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b9d9773a-0db6-410e-8d9c-d46251c9ca33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e49ff29764540ae95d8b9d0f9d4fbfa'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:37.946592 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4162/8350] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:23:37 2021] DELETE /identity/v3/users/6e49ff29764540ae95d8b9d0f9d4fbfa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:23:38.158932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9104158-5930-4cc1-af99-8f66969440ff None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:38.181592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9104158-5930-4cc1-af99-8f66969440ff None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:38.284620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:38.294977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:38.294977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:38.294977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] PATH_INFO: `/v3/projects/05afa0d2a44144078e3fa7d820a95510` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:38.294977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05afa0d2a44144078e3fa7d820a95510)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:38.294977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:38.371735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05afa0d2a44144078e3fa7d820a95510', 'request_id': 'req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:38.381548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05afa0d2a44144078e3fa7d820a95510', 'request_id': 'req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:38.391509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05afa0d2a44144078e3fa7d820a95510', 'request_id': 'req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:38.404753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] The token cache is being invalidate because project 05afa0d2a44144078e3fa7d820a95510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:23:38.405135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:38.405857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5ca2ca8b-1514-46b9-bc2f-46996a8580c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:38.411302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4189/8351] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:23:38 2021] DELETE /identity/v3/projects/05afa0d2a44144078e3fa7d820a95510 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:23:38.415141 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d9394-d4b6-4297-8314-494cdddc5b0c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:38.415537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d9394-d4b6-4297-8314-494cdddc5b0c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:38.415819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d9394-d4b6-4297-8314-494cdddc5b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:38.449221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-479d9394-d4b6-4297-8314-494cdddc5b0c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:38.451472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-479d9394-d4b6-4297-8314-494cdddc5b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:38.543668 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4163/8352] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:23:38.553728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce581e62-83ac-4bdf-9fc0-5e12ac742b02 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:38.554255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce581e62-83ac-4bdf-9fc0-5e12ac742b02 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:38.554764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce581e62-83ac-4bdf-9fc0-5e12ac742b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:38.580590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ce581e62-83ac-4bdf-9fc0-5e12ac742b02 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:38.587352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ce581e62-83ac-4bdf-9fc0-5e12ac742b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:38.601470 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4190/8353] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:38.611491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d9394-d4b6-4297-8314-494cdddc5b0c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:38.626389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d9394-d4b6-4297-8314-494cdddc5b0c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:38.636989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4be9e-4c41-4746-a7d9-6f3dc715f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:38.637966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4be9e-4c41-4746-a7d9-6f3dc715f3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:38.638400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4be9e-4c41-4746-a7d9-6f3dc715f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:38.638806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4be9e-4c41-4746-a7d9-6f3dc715f3a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:38.639922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4be9e-4c41-4746-a7d9-6f3dc715f3a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:23:38.640337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4be9e-4c41-4746-a7d9-6f3dc715f3a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:38.643311 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4be9e-4c41-4746-a7d9-6f3dc715f3a5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:38.663235 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4164/8354] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:23:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:23:38.667472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce581e62-83ac-4bdf-9fc0-5e12ac742b02 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:38.680614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce581e62-83ac-4bdf-9fc0-5e12ac742b02 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:38.688619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf3cf1-bd7e-4099-b08e-d635ee64b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:38.689436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf3cf1-bd7e-4099-b08e-d635ee64b1aa admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:38.689718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf3cf1-bd7e-4099-b08e-d635ee64b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:38.689993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf3cf1-bd7e-4099-b08e-d635ee64b1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:38.690711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf3cf1-bd7e-4099-b08e-d635ee64b1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:38.693329 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf3cf1-bd7e-4099-b08e-d635ee64b1aa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:38.734512 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4191/8355] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:23:38 2021] POST /identity/v3/projects => generated 389 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:23:38.739423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4be9e-4c41-4746-a7d9-6f3dc715f3a5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:38.754988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4be9e-4c41-4746-a7d9-6f3dc715f3a5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:38.863706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c4556-4b73-46af-af39-b655eb28cbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:38.864675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c4556-4b73-46af-af39-b655eb28cbca admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:38.864930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c4556-4b73-46af-af39-b655eb28cbca admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:38.865557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c4556-4b73-46af-af39-b655eb28cbca admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:38.869685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c4556-4b73-46af-af39-b655eb28cbca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:38.870442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c4556-4b73-46af-af39-b655eb28cbca admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:38.900217 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4165/8356] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:23:38 2021] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:23:38.905105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf3cf1-bd7e-4099-b08e-d635ee64b1aa admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:38.920459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf3cf1-bd7e-4099-b08e-d635ee64b1aa admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:38.929105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ad06d-38bd-4e21-998a-63dc3b7b4f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:38.930361 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ad06d-38bd-4e21-998a-63dc3b7b4f6d admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:38.930987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ad06d-38bd-4e21-998a-63dc3b7b4f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:38.931530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ad06d-38bd-4e21-998a-63dc3b7b4f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:38.932529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ad06d-38bd-4e21-998a-63dc3b7b4f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:38.934487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ad06d-38bd-4e21-998a-63dc3b7b4f6d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:38.951299 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4192/8357] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:23:38 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:23:38.955622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c4556-4b73-46af-af39-b655eb28cbca admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:38.968736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c4556-4b73-46af-af39-b655eb28cbca admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:38.975817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf026d45-94ea-4a0d-8d56-019e5d7d9cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:38.976627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026d45-94ea-4a0d-8d56-019e5d7d9cac admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:38.976842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026d45-94ea-4a0d-8d56-019e5d7d9cac admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:38.977163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026d45-94ea-4a0d-8d56-019e5d7d9cac admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:38.978090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf026d45-94ea-4a0d-8d56-019e5d7d9cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:38.980449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf026d45-94ea-4a0d-8d56-019e5d7d9cac admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:39.004159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ad06d-38bd-4e21-998a-63dc3b7b4f6d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:39.005454 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4166/8358] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:23:38 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:23:39.015856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ad06d-38bd-4e21-998a-63dc3b7b4f6d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:39.031669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca162e1-dd2e-4a32-9e6a-5a3075ede6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:39.032639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca162e1-dd2e-4a32-9e6a-5a3075ede6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:39.033061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca162e1-dd2e-4a32-9e6a-5a3075ede6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:39.033237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca162e1-dd2e-4a32-9e6a-5a3075ede6dc admin admin] PATH_INFO: `/v3/projects/bf0472ce0ce9426facb631be6459a422/users/1d735726954247d4831492fa0ff93f65/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:39.053327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca162e1-dd2e-4a32-9e6a-5a3075ede6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0472ce0ce9426facb631be6459a422, user_id=1d735726954247d4831492fa0ff93f65, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:39.056732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca162e1-dd2e-4a32-9e6a-5a3075ede6dc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:39.083309 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4193/8359] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:23:39 2021] PUT /identity/v3/projects/bf0472ce0ce9426facb631be6459a422/users/1d735726954247d4831492fa0ff93f65/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:23:39.094029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfb3fc-da6f-4a5c-8aa0-c6979ab2c8a3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:39.094320 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfb3fc-da6f-4a5c-8aa0-c6979ab2c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:39.094599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfb3fc-da6f-4a5c-8aa0-c6979ab2c8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:39.150868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-15cfb3fc-da6f-4a5c-8aa0-c6979ab2c8a3 None None] MFA Rules not processed for user `1d735726954247d4831492fa0ff93f65`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:39.155163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-15cfb3fc-da6f-4a5c-8aa0-c6979ab2c8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:39.256687 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4167/8360] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:39 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:39.267800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca162e1-dd2e-4a32-9e6a-5a3075ede6dc admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:39.269571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cca162e1-dd2e-4a32-9e6a-5a3075ede6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:39.347884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca162e1-dd2e-4a32-9e6a-5a3075ede6dc admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:39.353749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ebde1-2589-4a1f-8184-d45dff34fd6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:39.354435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ebde1-2589-4a1f-8184-d45dff34fd6a service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:39.354730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ebde1-2589-4a1f-8184-d45dff34fd6a service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:39.356696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ebde1-2589-4a1f-8184-d45dff34fd6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:39.383731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ebde1-2589-4a1f-8184-d45dff34fd6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:39.385202 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ebde1-2589-4a1f-8184-d45dff34fd6a service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:39.398290 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4194/8361] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:23:39 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:23:46.661092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfb3fc-da6f-4a5c-8aa0-c6979ab2c8a3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:46.662609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-15cfb3fc-da6f-4a5c-8aa0-c6979ab2c8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:46.737853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfb3fc-da6f-4a5c-8aa0-c6979ab2c8a3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:46.742403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:46.743289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:46.743576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:46.743850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] PATH_INFO: `/v3/users/5aa295a582b041a1a535958cbeb50e8f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:46.745050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa295a582b041a1a535958cbeb50e8f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:46.746980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:46.794983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa295a582b041a1a535958cbeb50e8f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:46.795689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa295a582b041a1a535958cbeb50e8f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:46.804446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa295a582b041a1a535958cbeb50e8f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:46.805057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa295a582b041a1a535958cbeb50e8f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:46.812017 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa295a582b041a1a535958cbeb50e8f'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:46.831632 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4168/8362] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:23:46 2021] DELETE /identity/v3/users/5aa295a582b041a1a535958cbeb50e8f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:23:46.835939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36af65-d491-480a-8bb6-8a9472fe36f9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:46.836449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36af65-d491-480a-8bb6-8a9472fe36f9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:46.836549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36af65-d491-480a-8bb6-8a9472fe36f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:46.857420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5f36af65-d491-480a-8bb6-8a9472fe36f9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:46.858624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f36af65-d491-480a-8bb6-8a9472fe36f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:46.917099 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4195/8363] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:46.927793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:46.929415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:46.990322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58593eb-51de-4fa6-901d-f176f4aef5e8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:46.993888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29249a55-8308-4834-b09e-330750c7f59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:46.994533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249a55-8308-4834-b09e-330750c7f59c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:46.994815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249a55-8308-4834-b09e-330750c7f59c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:46.995086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29249a55-8308-4834-b09e-330750c7f59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.004566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29249a55-8308-4834-b09e-330750c7f59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:47.006045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29249a55-8308-4834-b09e-330750c7f59c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:47.016005 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4169/8364] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:23:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:23:47.191590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36af65-d491-480a-8bb6-8a9472fe36f9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:47.196284 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f36af65-d491-480a-8bb6-8a9472fe36f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:47.219359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36af65-d491-480a-8bb6-8a9472fe36f9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:47.224457 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:47.225242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:47.225524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:47.225786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] PATH_INFO: `/v3/projects/e83b027153ea42e1b193393f015947f1` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.226974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83b027153ea42e1b193393f015947f1)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:47.228965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:47.283665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83b027153ea42e1b193393f015947f1', 'request_id': 'req-20da0282-60b2-4296-ae09-7d5204e14e04'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:47.291530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83b027153ea42e1b193393f015947f1', 'request_id': 'req-20da0282-60b2-4296-ae09-7d5204e14e04'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:47.298494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83b027153ea42e1b193393f015947f1', 'request_id': 'req-20da0282-60b2-4296-ae09-7d5204e14e04'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:47.309587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] The token cache is being invalidate because project e83b027153ea42e1b193393f015947f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:23:47.309940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:47.310736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-20da0282-60b2-4296-ae09-7d5204e14e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:47.312379 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4196/8365] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:23:47 2021] DELETE /identity/v3/projects/e83b027153ea42e1b193393f015947f1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:23:47.318306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee236e5e-97d3-49e5-8889-e19f69fda62f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:47.318593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee236e5e-97d3-49e5-8889-e19f69fda62f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:47.318871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee236e5e-97d3-49e5-8889-e19f69fda62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.338366 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ee236e5e-97d3-49e5-8889-e19f69fda62f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:47.339880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ee236e5e-97d3-49e5-8889-e19f69fda62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:47.403443 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4170/8366] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:47.412494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21f484-dfcc-4818-89f2-e2deffed1e4a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:47.412781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21f484-dfcc-4818-89f2-e2deffed1e4a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:47.413056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21f484-dfcc-4818-89f2-e2deffed1e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.431825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8f21f484-dfcc-4818-89f2-e2deffed1e4a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:47.433021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8f21f484-dfcc-4818-89f2-e2deffed1e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:47.441049 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4197/8367] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:47.445407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee236e5e-97d3-49e5-8889-e19f69fda62f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:47.456219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee236e5e-97d3-49e5-8889-e19f69fda62f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:47.460761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2d7df-f343-4c63-a217-b4928bb26cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:47.461443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2d7df-f343-4c63-a217-b4928bb26cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:47.461726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2d7df-f343-4c63-a217-b4928bb26cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:47.462026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2d7df-f343-4c63-a217-b4928bb26cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.462753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2d7df-f343-4c63-a217-b4928bb26cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:23:47.463058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2d7df-f343-4c63-a217-b4928bb26cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:47.464729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2d7df-f343-4c63-a217-b4928bb26cf7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:47.476441 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4171/8368] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:23:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:23:47.480866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21f484-dfcc-4818-89f2-e2deffed1e4a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:47.490765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21f484-dfcc-4818-89f2-e2deffed1e4a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:47.495450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5caf6-d04d-4cee-a947-eaf51fdd6957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:47.496093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5caf6-d04d-4cee-a947-eaf51fdd6957 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:47.496377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5caf6-d04d-4cee-a947-eaf51fdd6957 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:47.496656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5caf6-d04d-4cee-a947-eaf51fdd6957 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.497354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5caf6-d04d-4cee-a947-eaf51fdd6957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:47.499242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5caf6-d04d-4cee-a947-eaf51fdd6957 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:47.523624 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4198/8369] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:23:47 2021] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:23:47.528148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2d7df-f343-4c63-a217-b4928bb26cf7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:47.539465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2d7df-f343-4c63-a217-b4928bb26cf7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:47.592522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bd22f-75d4-46fd-9b63-0e49b07b2aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:47.593174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bd22f-75d4-46fd-9b63-0e49b07b2aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:47.593453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bd22f-75d4-46fd-9b63-0e49b07b2aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:47.593727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bd22f-75d4-46fd-9b63-0e49b07b2aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.594415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bd22f-75d4-46fd-9b63-0e49b07b2aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:47.596891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bd22f-75d4-46fd-9b63-0e49b07b2aa1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:47.616635 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4172/8370] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:23:47 2021] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:23:47.620729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5caf6-d04d-4cee-a947-eaf51fdd6957 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:47.630916 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5caf6-d04d-4cee-a947-eaf51fdd6957 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:47.635551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a94cd-ba74-4e0e-b8df-afd50e17c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:47.636354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a94cd-ba74-4e0e-b8df-afd50e17c555 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:47.636681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a94cd-ba74-4e0e-b8df-afd50e17c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:47.636967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a94cd-ba74-4e0e-b8df-afd50e17c555 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.637693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a94cd-ba74-4e0e-b8df-afd50e17c555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:47.639289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a94cd-ba74-4e0e-b8df-afd50e17c555 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:47.649927 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4199/8371] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:23:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:23:47.653665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bd22f-75d4-46fd-9b63-0e49b07b2aa1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:47.664425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bd22f-75d4-46fd-9b63-0e49b07b2aa1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:47.669455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d58d9-ba02-4a81-8cfd-50dd9d578175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:47.670111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d58d9-ba02-4a81-8cfd-50dd9d578175 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:47.670397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d58d9-ba02-4a81-8cfd-50dd9d578175 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:47.670700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d58d9-ba02-4a81-8cfd-50dd9d578175 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.671468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d58d9-ba02-4a81-8cfd-50dd9d578175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:47.673079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d58d9-ba02-4a81-8cfd-50dd9d578175 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:47.682995 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4173/8372] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:23:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:23:47.686958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a94cd-ba74-4e0e-b8df-afd50e17c555 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:47.696710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a94cd-ba74-4e0e-b8df-afd50e17c555 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:47.701285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52016ecf-1885-4094-a25e-b89eca9bcf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:47.702141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016ecf-1885-4094-a25e-b89eca9bcf50 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:47.702443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016ecf-1885-4094-a25e-b89eca9bcf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:47.702819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016ecf-1885-4094-a25e-b89eca9bcf50 admin admin] PATH_INFO: `/v3/projects/9754c7acc6c542a28aca81967d0e24a1/users/d92679a35eb64fab8ae9c72180190285/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.718275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52016ecf-1885-4094-a25e-b89eca9bcf50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9754c7acc6c542a28aca81967d0e24a1, user_id=d92679a35eb64fab8ae9c72180190285, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:47.721495 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52016ecf-1885-4094-a25e-b89eca9bcf50 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:47.733957 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4200/8373] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:23:47 2021] PUT /identity/v3/projects/9754c7acc6c542a28aca81967d0e24a1/users/d92679a35eb64fab8ae9c72180190285/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:23:47.743452 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f17e6-df0a-4067-9adb-7f4a5c961472 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:47.743808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f17e6-df0a-4067-9adb-7f4a5c961472 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:47.744117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f17e6-df0a-4067-9adb-7f4a5c961472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.767049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-526f17e6-df0a-4067-9adb-7f4a5c961472 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:47.768395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-526f17e6-df0a-4067-9adb-7f4a5c961472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:47.830297 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4174/8374] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:47.840739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52016ecf-1885-4094-a25e-b89eca9bcf50 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:47.842640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-52016ecf-1885-4094-a25e-b89eca9bcf50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:47.902590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52016ecf-1885-4094-a25e-b89eca9bcf50 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:47.906281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf495a7-4a04-488a-8cd5-12cd18b81248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:47.906928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf495a7-4a04-488a-8cd5-12cd18b81248 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:47.907862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf495a7-4a04-488a-8cd5-12cd18b81248 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:47.908098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf495a7-4a04-488a-8cd5-12cd18b81248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:47.917321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf495a7-4a04-488a-8cd5-12cd18b81248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:47.918746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf495a7-4a04-488a-8cd5-12cd18b81248 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:47.928176 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4201/8375] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:23:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:23:51.831904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f17e6-df0a-4067-9adb-7f4a5c961472 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:51.833942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-526f17e6-df0a-4067-9adb-7f4a5c961472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:51.854936 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f17e6-df0a-4067-9adb-7f4a5c961472 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:51.861136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:51.863642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:51.864119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:51.864578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] PATH_INFO: `/v3/users/1d735726954247d4831492fa0ff93f65` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:51.867419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d735726954247d4831492fa0ff93f65)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:51.870255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:51.937171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d735726954247d4831492fa0ff93f65'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:51.938181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d735726954247d4831492fa0ff93f65'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:51.948066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d735726954247d4831492fa0ff93f65'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:51.948742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d735726954247d4831492fa0ff93f65'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:51.960646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d735726954247d4831492fa0ff93f65'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:51.984260 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4175/8376] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:23:51 2021] DELETE /identity/v3/users/1d735726954247d4831492fa0ff93f65 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:23:51.989935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c09ad-a0a6-4e39-9e82-b76920f9175f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:51.990476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c09ad-a0a6-4e39-9e82-b76920f9175f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:51.990725 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c09ad-a0a6-4e39-9e82-b76920f9175f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:52.015585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a33c09ad-a0a6-4e39-9e82-b76920f9175f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:52.016896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a33c09ad-a0a6-4e39-9e82-b76920f9175f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:52.119278 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4202/8377] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:52.131304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:52.133001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:52.207510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967a9f7-fa7a-49f2-8a3e-586611c622e6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:52.212111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105d10d-d96e-485d-a2f4-255f48eeedae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:52.213093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d10d-d96e-485d-a2f4-255f48eeedae service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:52.213813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d10d-d96e-485d-a2f4-255f48eeedae service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:52.214322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d10d-d96e-485d-a2f4-255f48eeedae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:52.228949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105d10d-d96e-485d-a2f4-255f48eeedae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:52.230697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105d10d-d96e-485d-a2f4-255f48eeedae service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:52.244732 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4176/8378] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:23:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:23:52.337223 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caabde-9d98-472b-8b15-833b574e9de9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:52.337516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caabde-9d98-472b-8b15-833b574e9de9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:52.338532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caabde-9d98-472b-8b15-833b574e9de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:52.344155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105d10d-d96e-485d-a2f4-255f48eeedae service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:52.345872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0105d10d-d96e-485d-a2f4-255f48eeedae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:52.385879 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b8caabde-9d98-472b-8b15-833b574e9de9 None None] MFA Rules not processed for user `d92679a35eb64fab8ae9c72180190285`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:52.388203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b8caabde-9d98-472b-8b15-833b574e9de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:52.477746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105d10d-d96e-485d-a2f4-255f48eeedae service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:52.487573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8003ac2-e5ba-46f2-8043-934eff95e479 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:52.489244 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8003ac2-e5ba-46f2-8043-934eff95e479 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:52.490362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8003ac2-e5ba-46f2-8043-934eff95e479 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:52.491043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8003ac2-e5ba-46f2-8043-934eff95e479 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:52.496090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d8003ac2-e5ba-46f2-8043-934eff95e479 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:52.530575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8003ac2-e5ba-46f2-8043-934eff95e479 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:52.539276 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4203/8379] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:52 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:52.540737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8003ac2-e5ba-46f2-8043-934eff95e479 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:52.541074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caabde-9d98-472b-8b15-833b574e9de9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:52.543639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b8caabde-9d98-472b-8b15-833b574e9de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:52.571752 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4177/8380] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:23:52 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:23:52.577084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caabde-9d98-472b-8b15-833b574e9de9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:52.584807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df7d05-1c2e-46ed-b0f3-d7398b5c286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:52.585587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7d05-1c2e-46ed-b0f3-d7398b5c286a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:52.585971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7d05-1c2e-46ed-b0f3-d7398b5c286a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:52.586404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df7d05-1c2e-46ed-b0f3-d7398b5c286a admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:52.587226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df7d05-1c2e-46ed-b0f3-d7398b5c286a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:52.599434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df7d05-1c2e-46ed-b0f3-d7398b5c286a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:52.647903 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4204/8381] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:23:52 2021] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:23:52.649926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8003ac2-e5ba-46f2-8043-934eff95e479 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:52.664400 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8003ac2-e5ba-46f2-8043-934eff95e479 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:52.736978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df7d05-1c2e-46ed-b0f3-d7398b5c286a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:52.739005 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a8df7d05-1c2e-46ed-b0f3-d7398b5c286a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:52.767770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be4151-a41d-4986-a3cf-8f5fed9d42a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:52.768236 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be4151-a41d-4986-a3cf-8f5fed9d42a5 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:52.768556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be4151-a41d-4986-a3cf-8f5fed9d42a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:52.768769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be4151-a41d-4986-a3cf-8f5fed9d42a5 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:52.769577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be4151-a41d-4986-a3cf-8f5fed9d42a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:52.771575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be4151-a41d-4986-a3cf-8f5fed9d42a5 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:52.795883 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4178/8382] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:23:52 2021] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:23:52.799761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be4151-a41d-4986-a3cf-8f5fed9d42a5 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:52.815611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be4151-a41d-4986-a3cf-8f5fed9d42a5 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:52.823370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291ae77-2652-48ea-8400-6ddba2d5ebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:52.824144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ae77-2652-48ea-8400-6ddba2d5ebc4 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:52.824426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ae77-2652-48ea-8400-6ddba2d5ebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:52.824738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ae77-2652-48ea-8400-6ddba2d5ebc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:52.826108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291ae77-2652-48ea-8400-6ddba2d5ebc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:52.827959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291ae77-2652-48ea-8400-6ddba2d5ebc4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:52.843900 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4179/8383] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:23:52 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:23:52.844588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df7d05-1c2e-46ed-b0f3-d7398b5c286a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:52.845567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291ae77-2652-48ea-8400-6ddba2d5ebc4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:52.847888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:52.848808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:52.849024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:52.849301 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] PATH_INFO: `/v3/projects/bf0472ce0ce9426facb631be6459a422` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:52.850713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0472ce0ce9426facb631be6459a422)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:52.852765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:52.855979 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291ae77-2652-48ea-8400-6ddba2d5ebc4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:52.861155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe79d44-fa95-40c3-8822-375e664a3429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:52.862078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe79d44-fa95-40c3-8822-375e664a3429 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:52.862315 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe79d44-fa95-40c3-8822-375e664a3429 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:52.862590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe79d44-fa95-40c3-8822-375e664a3429 admin admin] PATH_INFO: `/v3/projects/674e404c419c4edc83c8ad40b43ba4a6/users/f2a54d2ad613446fb8a9bc437a60b79b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:52.879113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe79d44-fa95-40c3-8822-375e664a3429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674e404c419c4edc83c8ad40b43ba4a6, user_id=f2a54d2ad613446fb8a9bc437a60b79b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:52.882021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe79d44-fa95-40c3-8822-375e664a3429 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:52.898129 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4180/8384] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:23:52 2021] PUT /identity/v3/projects/674e404c419c4edc83c8ad40b43ba4a6/users/f2a54d2ad613446fb8a9bc437a60b79b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:23:52.901804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe79d44-fa95-40c3-8822-375e664a3429 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:52.904844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0472ce0ce9426facb631be6459a422', 'request_id': 'req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:52.914060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0472ce0ce9426facb631be6459a422', 'request_id': 'req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:52.920603 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0472ce0ce9426facb631be6459a422', 'request_id': 'req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:52.932289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] The token cache is being invalidate because project bf0472ce0ce9426facb631be6459a422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:23:52.932839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:52.933808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-3423fd30-0ebc-4ba7-b5d7-a9922c46be8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:52.935842 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4205/8385] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:23:52 2021] DELETE /identity/v3/projects/bf0472ce0ce9426facb631be6459a422 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:23:52.941801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9e534-d23e-47a9-a68c-876c3f712c2a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:52.942088 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9e534-d23e-47a9-a68c-876c3f712c2a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:52.942368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9e534-d23e-47a9-a68c-876c3f712c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:52.970040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ccc9e534-d23e-47a9-a68c-876c3f712c2a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:52.971317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ccc9e534-d23e-47a9-a68c-876c3f712c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:52.989409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe79d44-fa95-40c3-8822-375e664a3429 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:53.049886 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4206/8386] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:53.057685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e2c5-0cc3-42b8-82d8-acb444cb5b9e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:53.057976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e2c5-0cc3-42b8-82d8-acb444cb5b9e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:53.058250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6e2c5-0cc3-42b8-82d8-acb444cb5b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:53.069019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d23389-e9c8-4ea6-978f-2614dbfdc655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:53.069709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d23389-e9c8-4ea6-978f-2614dbfdc655 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:53.069996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d23389-e9c8-4ea6-978f-2614dbfdc655 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:53.070273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d23389-e9c8-4ea6-978f-2614dbfdc655 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:53.071022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d23389-e9c8-4ea6-978f-2614dbfdc655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:53.073509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d23389-e9c8-4ea6-978f-2614dbfdc655 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:53.082665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-34f6e2c5-0cc3-42b8-82d8-acb444cb5b9e None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:53.084424 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-34f6e2c5-0cc3-42b8-82d8-acb444cb5b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:53.090687 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4181/8387] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:23:52 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:23:53.092706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d23389-e9c8-4ea6-978f-2614dbfdc655 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:53.095127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d8d23389-e9c8-4ea6-978f-2614dbfdc655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:53.096012 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4207/8388] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:23:53.104517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6e2c5-0cc3-42b8-82d8-acb444cb5b9e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:53.109530 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d23389-e9c8-4ea6-978f-2614dbfdc655 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:53.113874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6e2c5-0cc3-42b8-82d8-acb444cb5b9e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:53.114864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a400e3-8c3a-4899-9e89-de0df7da026c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:53.115764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a400e3-8c3a-4899-9e89-de0df7da026c admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:53.116053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a400e3-8c3a-4899-9e89-de0df7da026c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:53.116329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a400e3-8c3a-4899-9e89-de0df7da026c admin admin] PATH_INFO: `/v3/projects/674e404c419c4edc83c8ad40b43ba4a6/users/f2a54d2ad613446fb8a9bc437a60b79b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:53.118367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a400e3-8c3a-4899-9e89-de0df7da026c admin admin] RBAC: Authorizing `identity:create_grant(project_id=674e404c419c4edc83c8ad40b43ba4a6, user_id=f2a54d2ad613446fb8a9bc437a60b79b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:53.118854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b322fa-560d-4afc-be22-eec0b7486540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:53.119708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b322fa-560d-4afc-be22-eec0b7486540 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:53.120148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b322fa-560d-4afc-be22-eec0b7486540 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:53.120422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b322fa-560d-4afc-be22-eec0b7486540 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:53.121159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b322fa-560d-4afc-be22-eec0b7486540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:23:53.121267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a400e3-8c3a-4899-9e89-de0df7da026c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:53.121460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b322fa-560d-4afc-be22-eec0b7486540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:53.123047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b322fa-560d-4afc-be22-eec0b7486540 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:53.133218 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4182/8389] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:23:53 2021] PUT /identity/v3/projects/674e404c419c4edc83c8ad40b43ba4a6/users/f2a54d2ad613446fb8a9bc437a60b79b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:23:53.143375 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4208/8390] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:23:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:23:53.147819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a400e3-8c3a-4899-9e89-de0df7da026c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:53.219024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a400e3-8c3a-4899-9e89-de0df7da026c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:53.224845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0c6d5-1200-4a16-aa06-ec9cb5562b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:53.225513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0c6d5-1200-4a16-aa06-ec9cb5562b32 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:53.225795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0c6d5-1200-4a16-aa06-ec9cb5562b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:53.226068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0c6d5-1200-4a16-aa06-ec9cb5562b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:53.226780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0c6d5-1200-4a16-aa06-ec9cb5562b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:53.228941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0c6d5-1200-4a16-aa06-ec9cb5562b32 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:53.261080 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4183/8391] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:23:53 2021] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:23:53.265837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b322fa-560d-4afc-be22-eec0b7486540 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:53.280425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b322fa-560d-4afc-be22-eec0b7486540 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:53.369971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d9f14-aa0f-4f55-a17d-fe221bafad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:53.370781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9f14-aa0f-4f55-a17d-fe221bafad4c admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:53.371138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9f14-aa0f-4f55-a17d-fe221bafad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:53.371534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9f14-aa0f-4f55-a17d-fe221bafad4c admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:53.372323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d9f14-aa0f-4f55-a17d-fe221bafad4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:53.374289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d9f14-aa0f-4f55-a17d-fe221bafad4c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:53.404456 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4209/8392] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:23:53 2021] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:23:53.408757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0c6d5-1200-4a16-aa06-ec9cb5562b32 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:53.427749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0c6d5-1200-4a16-aa06-ec9cb5562b32 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:53.448157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f088e2f-e900-4e8d-a187-53913e948bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:53.448157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f088e2f-e900-4e8d-a187-53913e948bad admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:53.448157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f088e2f-e900-4e8d-a187-53913e948bad admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:53.448157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f088e2f-e900-4e8d-a187-53913e948bad admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:53.448733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f088e2f-e900-4e8d-a187-53913e948bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:53.448733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f088e2f-e900-4e8d-a187-53913e948bad admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:53.463312 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4184/8393] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:23:53 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:23:53.465639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d9f14-aa0f-4f55-a17d-fe221bafad4c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:53.477009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d9f14-aa0f-4f55-a17d-fe221bafad4c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:53.483538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c299b87-0c09-4c9d-b5af-3134619a02fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:53.487002 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c299b87-0c09-4c9d-b5af-3134619a02fc admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:53.488183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c299b87-0c09-4c9d-b5af-3134619a02fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:53.491524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c299b87-0c09-4c9d-b5af-3134619a02fc admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:53.492626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c299b87-0c09-4c9d-b5af-3134619a02fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:53.497235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c299b87-0c09-4c9d-b5af-3134619a02fc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:53.531858 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4210/8394] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:23:53 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:23:53.532765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f088e2f-e900-4e8d-a187-53913e948bad admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:53.544303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f088e2f-e900-4e8d-a187-53913e948bad admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:53.555407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79636e2d-4454-4873-9a6a-82505f335cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:53.556318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79636e2d-4454-4873-9a6a-82505f335cba admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:53.556603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79636e2d-4454-4873-9a6a-82505f335cba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:53.556882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79636e2d-4454-4873-9a6a-82505f335cba admin admin] PATH_INFO: `/v3/projects/d50c27f6a8ff4c60b0c83b539eae25f4/users/c452ab8d57c949b584bca2ead06fff01/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:53.587694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79636e2d-4454-4873-9a6a-82505f335cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50c27f6a8ff4c60b0c83b539eae25f4, user_id=c452ab8d57c949b584bca2ead06fff01, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:53.590615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79636e2d-4454-4873-9a6a-82505f335cba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:53.613552 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4185/8395] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:23:53 2021] PUT /identity/v3/projects/d50c27f6a8ff4c60b0c83b539eae25f4/users/c452ab8d57c949b584bca2ead06fff01/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:23:53.624800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66c7f9-e89c-4270-9ecb-9b161700d446 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:53.625090 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66c7f9-e89c-4270-9ecb-9b161700d446 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:53.625385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66c7f9-e89c-4270-9ecb-9b161700d446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:53.657430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fa66c7f9-e89c-4270-9ecb-9b161700d446 None None] MFA Rules not processed for user `c452ab8d57c949b584bca2ead06fff01`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:53.659510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fa66c7f9-e89c-4270-9ecb-9b161700d446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:53.734697 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4211/8396] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:53 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:53.746496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79636e2d-4454-4873-9a6a-82505f335cba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:53.748705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-79636e2d-4454-4873-9a6a-82505f335cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:53.817958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79636e2d-4454-4873-9a6a-82505f335cba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:53.822044 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0efe50-a101-48b7-a82d-d67ca60cd114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:53.822701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0efe50-a101-48b7-a82d-d67ca60cd114 service cinder] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:53.823061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0efe50-a101-48b7-a82d-d67ca60cd114 service cinder] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:53.823299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0efe50-a101-48b7-a82d-d67ca60cd114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:53.833771 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0efe50-a101-48b7-a82d-d67ca60cd114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:53.835347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0efe50-a101-48b7-a82d-d67ca60cd114 service cinder] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:53.849283 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4186/8397] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:23:53 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:23:58.639490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b41684-f75d-4e6b-a729-deb90f732381 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:58.640421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b41684-f75d-4e6b-a729-deb90f732381 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:58.640702 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b41684-f75d-4e6b-a729-deb90f732381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:58.681464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d0b41684-f75d-4e6b-a729-deb90f732381 None None] MFA Rules not processed for user `f2a54d2ad613446fb8a9bc437a60b79b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:58.682698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d0b41684-f75d-4e6b-a729-deb90f732381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:58.762829 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4212/8398] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:58 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:23:58.777453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0efe50-a101-48b7-a82d-d67ca60cd114 service cinder] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:58.778926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9d0efe50-a101-48b7-a82d-d67ca60cd114 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:58.873241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0efe50-a101-48b7-a82d-d67ca60cd114 service cinder] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:58.879488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae19e4c-08ab-4a5e-a39a-36898056381f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:58.880145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae19e4c-08ab-4a5e-a39a-36898056381f service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:58.880429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae19e4c-08ab-4a5e-a39a-36898056381f service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:58.880707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae19e4c-08ab-4a5e-a39a-36898056381f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:58.889474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae19e4c-08ab-4a5e-a39a-36898056381f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:58.891733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae19e4c-08ab-4a5e-a39a-36898056381f service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:58.901453 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4187/8399] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:23:58 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:23:59.169059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b41684-f75d-4e6b-a729-deb90f732381 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:59.171289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d0b41684-f75d-4e6b-a729-deb90f732381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:59.254871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b41684-f75d-4e6b-a729-deb90f732381 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:59.262699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3c1d9-2451-494f-a2f2-ab8ef198a67b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:59.263229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c1d9-2451-494f-a2f2-ab8ef198a67b service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:59.263551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c1d9-2451-494f-a2f2-ab8ef198a67b service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:59.263830 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c1d9-2451-494f-a2f2-ab8ef198a67b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:59.266626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-29b3c1d9-2451-494f-a2f2-ab8ef198a67b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:59.293257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3c1d9-2451-494f-a2f2-ab8ef198a67b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:59.295646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3c1d9-2451-494f-a2f2-ab8ef198a67b service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:59.310669 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4213/8400] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:23:59 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:23:59.315701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae19e4c-08ab-4a5e-a39a-36898056381f service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:59.398987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae19e4c-08ab-4a5e-a39a-36898056381f service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:59.404322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:59.405334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:59.405697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:59.406189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] PATH_INFO: `/v3/users/c452ab8d57c949b584bca2ead06fff01` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:59.408392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c452ab8d57c949b584bca2ead06fff01)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:59.410441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:59.479412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c452ab8d57c949b584bca2ead06fff01'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:59.480088 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c452ab8d57c949b584bca2ead06fff01'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:59.489601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c452ab8d57c949b584bca2ead06fff01'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:59.491090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c452ab8d57c949b584bca2ead06fff01'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:59.501689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c452ab8d57c949b584bca2ead06fff01'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:23:59.520893 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4188/8401] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:23:59 2021] DELETE /identity/v3/users/c452ab8d57c949b584bca2ead06fff01 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:23:59.525842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25787273-e0dc-4bef-9111-39dd800b82fa None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:59.525842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25787273-e0dc-4bef-9111-39dd800b82fa None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:59.525842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25787273-e0dc-4bef-9111-39dd800b82fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:59.558037 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-25787273-e0dc-4bef-9111-39dd800b82fa None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:23:59.559669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-25787273-e0dc-4bef-9111-39dd800b82fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:59.624872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:59.627010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:59.629851 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4214/8402] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:23:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:23:59.665665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25787273-e0dc-4bef-9111-39dd800b82fa None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:23:59.668771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-25787273-e0dc-4bef-9111-39dd800b82fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:59.726023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f994d-0149-4114-9377-d7e0aec7ef25 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:59.731668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537999e-0cbd-48cd-a59f-c430363ec0bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:59.732380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537999e-0cbd-48cd-a59f-c430363ec0bd service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:59.732668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537999e-0cbd-48cd-a59f-c430363ec0bd service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:59.732945 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537999e-0cbd-48cd-a59f-c430363ec0bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:59.735646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0537999e-0cbd-48cd-a59f-c430363ec0bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:23:59.743052 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25787273-e0dc-4bef-9111-39dd800b82fa None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:23:59.747099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a7747-9417-44af-9faa-b0295cc3fb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:23:59.747793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7747-9417-44af-9faa-b0295cc3fb8c service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:23:59.748076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7747-9417-44af-9faa-b0295cc3fb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:23:59.748353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7747-9417-44af-9faa-b0295cc3fb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:23:59.751548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537999e-0cbd-48cd-a59f-c430363ec0bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:59.753346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537999e-0cbd-48cd-a59f-c430363ec0bd service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:59.758768 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a7747-9417-44af-9faa-b0295cc3fb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:23:59.760253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a7747-9417-44af-9faa-b0295cc3fb8c service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:23:59.768049 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4189/8403] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:23:59 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:23:59.770636 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4215/8404] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:23:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:24:00.083032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537999e-0cbd-48cd-a59f-c430363ec0bd service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:00.084946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0537999e-0cbd-48cd-a59f-c430363ec0bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:00.109042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537999e-0cbd-48cd-a59f-c430363ec0bd service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:00.115297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:00.116425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:00.116708 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:00.117005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] PATH_INFO: `/v3/projects/d50c27f6a8ff4c60b0c83b539eae25f4` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:00.118556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50c27f6a8ff4c60b0c83b539eae25f4)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:00.121731 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:00.187479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50c27f6a8ff4c60b0c83b539eae25f4', 'request_id': 'req-79e512f7-41ae-4f0a-987b-90a346b07d11'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:00.194110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50c27f6a8ff4c60b0c83b539eae25f4', 'request_id': 'req-79e512f7-41ae-4f0a-987b-90a346b07d11'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:00.204499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50c27f6a8ff4c60b0c83b539eae25f4', 'request_id': 'req-79e512f7-41ae-4f0a-987b-90a346b07d11'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:00.216533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] The token cache is being invalidate because project d50c27f6a8ff4c60b0c83b539eae25f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:24:00.216834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:00.217516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-79e512f7-41ae-4f0a-987b-90a346b07d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:00.220041 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4190/8405] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:24:00 2021] DELETE /identity/v3/projects/d50c27f6a8ff4c60b0c83b539eae25f4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:24:00.226762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df20358-d19d-430b-87f3-3763f8576607 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:00.227198 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df20358-d19d-430b-87f3-3763f8576607 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:00.227519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df20358-d19d-430b-87f3-3763f8576607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:00.247846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5df20358-d19d-430b-87f3-3763f8576607 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:00.249065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5df20358-d19d-430b-87f3-3763f8576607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:00.327270 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4216/8406] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:00.330097 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834003a-d24d-4c25-85fd-20c892404a22 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:00.330381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834003a-d24d-4c25-85fd-20c892404a22 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:00.330659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834003a-d24d-4c25-85fd-20c892404a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:00.352373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f834003a-d24d-4c25-85fd-20c892404a22 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:00.353697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f834003a-d24d-4c25-85fd-20c892404a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:00.363216 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4191/8407] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:00.367657 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df20358-d19d-430b-87f3-3763f8576607 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:00.379442 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df20358-d19d-430b-87f3-3763f8576607 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:00.384494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5858-dc12-489c-9023-a23b71c443f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:00.385170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5858-dc12-489c-9023-a23b71c443f3 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:00.385454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5858-dc12-489c-9023-a23b71c443f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:00.385732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb5858-dc12-489c-9023-a23b71c443f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:00.386480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb5858-dc12-489c-9023-a23b71c443f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:24:00.386788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb5858-dc12-489c-9023-a23b71c443f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:00.388432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb5858-dc12-489c-9023-a23b71c443f3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:00.401298 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4217/8408] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:24:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:24:00.405875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834003a-d24d-4c25-85fd-20c892404a22 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:00.415480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834003a-d24d-4c25-85fd-20c892404a22 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:00.421012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3013a-45be-4dbb-9985-52914c993554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:00.421693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3013a-45be-4dbb-9985-52914c993554 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:00.422496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3013a-45be-4dbb-9985-52914c993554 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:00.422778 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3013a-45be-4dbb-9985-52914c993554 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:00.432529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3013a-45be-4dbb-9985-52914c993554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:00.435278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3013a-45be-4dbb-9985-52914c993554 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:00.473133 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4192/8409] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:24:00 2021] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:24:00.474266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5858-dc12-489c-9023-a23b71c443f3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:00.485648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb5858-dc12-489c-9023-a23b71c443f3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:00.546784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3098-cfd0-4e76-aa14-3d0800c35ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:00.547623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3098-cfd0-4e76-aa14-3d0800c35ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:00.547993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3098-cfd0-4e76-aa14-3d0800c35ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:00.548333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e3098-cfd0-4e76-aa14-3d0800c35ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:00.549109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3098-cfd0-4e76-aa14-3d0800c35ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:00.551082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e3098-cfd0-4e76-aa14-3d0800c35ca4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:00.574263 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4218/8410] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:24:00 2021] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:24:00.575458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3013a-45be-4dbb-9985-52914c993554 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:00.586305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3013a-45be-4dbb-9985-52914c993554 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:00.590989 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740f498-984c-492a-bae1-3a9901f849db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:00.591679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740f498-984c-492a-bae1-3a9901f849db admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:00.591965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740f498-984c-492a-bae1-3a9901f849db admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:00.592237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740f498-984c-492a-bae1-3a9901f849db admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:00.592967 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740f498-984c-492a-bae1-3a9901f849db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:00.595241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740f498-984c-492a-bae1-3a9901f849db admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:00.608738 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4193/8411] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:00.610670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3098-cfd0-4e76-aa14-3d0800c35ca4 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:00.620677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e3098-cfd0-4e76-aa14-3d0800c35ca4 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:00.625546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed57f5-6e32-4d66-b24e-be524d9650e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:00.626314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed57f5-6e32-4d66-b24e-be524d9650e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:00.626431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed57f5-6e32-4d66-b24e-be524d9650e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:00.626642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed57f5-6e32-4d66-b24e-be524d9650e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:00.627420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed57f5-6e32-4d66-b24e-be524d9650e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:00.629159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed57f5-6e32-4d66-b24e-be524d9650e8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:00.639945 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4219/8412] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:00.644858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740f498-984c-492a-bae1-3a9901f849db admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:00.655219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740f498-984c-492a-bae1-3a9901f849db admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:00.661342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adcded-e628-4702-8cdd-8c1229ee37a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:00.662391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adcded-e628-4702-8cdd-8c1229ee37a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:00.662676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adcded-e628-4702-8cdd-8c1229ee37a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:00.662953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adcded-e628-4702-8cdd-8c1229ee37a3 admin admin] PATH_INFO: `/v3/projects/c0ac40a766ea478bab3fe658ba56b08f/users/a2b5ce3f808e49e3a6e346d26813ae5b/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:00.679234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adcded-e628-4702-8cdd-8c1229ee37a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ac40a766ea478bab3fe658ba56b08f, user_id=a2b5ce3f808e49e3a6e346d26813ae5b, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:00.681986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adcded-e628-4702-8cdd-8c1229ee37a3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:00.696338 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4194/8413] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:24:00 2021] PUT /identity/v3/projects/c0ac40a766ea478bab3fe658ba56b08f/users/a2b5ce3f808e49e3a6e346d26813ae5b/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:00.708008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c251f9a-cc4c-440a-8a93-29cff2811864 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:00.708491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c251f9a-cc4c-440a-8a93-29cff2811864 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:00.708590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c251f9a-cc4c-440a-8a93-29cff2811864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:00.735487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8c251f9a-cc4c-440a-8a93-29cff2811864 None None] MFA Rules not processed for user `a2b5ce3f808e49e3a6e346d26813ae5b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:00.736705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8c251f9a-cc4c-440a-8a93-29cff2811864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:00.799576 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4220/8414] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:00 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:00.804048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adcded-e628-4702-8cdd-8c1229ee37a3 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:00.877481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adcded-e628-4702-8cdd-8c1229ee37a3 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:00.882396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288d1a3-b34e-465b-b802-efa6079beba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:00.883084 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d1a3-b34e-465b-b802-efa6079beba7 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:00.883403 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d1a3-b34e-465b-b802-efa6079beba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:00.883678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288d1a3-b34e-465b-b802-efa6079beba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:00.885183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288d1a3-b34e-465b-b802-efa6079beba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:00.886614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288d1a3-b34e-465b-b802-efa6079beba7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:00.922477 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4195/8415] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:24:00 2021] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:24:00.926426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c251f9a-cc4c-440a-8a93-29cff2811864 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:00.939176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c251f9a-cc4c-440a-8a93-29cff2811864 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:01.020576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01954719-e5a4-482f-a04f-b4c5a7bc96d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:01.021385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01954719-e5a4-482f-a04f-b4c5a7bc96d3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:01.023004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01954719-e5a4-482f-a04f-b4c5a7bc96d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:01.023468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01954719-e5a4-482f-a04f-b4c5a7bc96d3 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:01.024278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01954719-e5a4-482f-a04f-b4c5a7bc96d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:01.026439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01954719-e5a4-482f-a04f-b4c5a7bc96d3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:01.058240 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4221/8416] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:24:00 2021] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:24:01.062102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288d1a3-b34e-465b-b802-efa6079beba7 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:01.074618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288d1a3-b34e-465b-b802-efa6079beba7 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:01.083362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d424509-897b-4c4a-94fd-28a2e98257dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:01.087461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d424509-897b-4c4a-94fd-28a2e98257dc admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:01.087793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d424509-897b-4c4a-94fd-28a2e98257dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:01.088079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d424509-897b-4c4a-94fd-28a2e98257dc admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:01.088855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d424509-897b-4c4a-94fd-28a2e98257dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:01.090502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d424509-897b-4c4a-94fd-28a2e98257dc admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:01.104257 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4196/8417] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:01 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:24:01.108172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01954719-e5a4-482f-a04f-b4c5a7bc96d3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:01.120521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01954719-e5a4-482f-a04f-b4c5a7bc96d3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:01.126290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d4321-47f9-4030-84d8-1e56c420f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:01.127220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d4321-47f9-4030-84d8-1e56c420f258 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:01.127541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d4321-47f9-4030-84d8-1e56c420f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:01.127874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d4321-47f9-4030-84d8-1e56c420f258 admin admin] PATH_INFO: `/v3/projects/0705b1c522974ef5872986bed72cc194/users/d1201dc74dc341de854020747f026ed8/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:01.152640 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d4321-47f9-4030-84d8-1e56c420f258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0705b1c522974ef5872986bed72cc194, user_id=d1201dc74dc341de854020747f026ed8, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:01.157450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d4321-47f9-4030-84d8-1e56c420f258 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:01.187088 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4222/8418] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:24:01 2021] PUT /identity/v3/projects/0705b1c522974ef5872986bed72cc194/users/d1201dc74dc341de854020747f026ed8/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:01.191337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d424509-897b-4c4a-94fd-28a2e98257dc admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:01.202942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d424509-897b-4c4a-94fd-28a2e98257dc admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:01.273899 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d3822-8085-4fdd-8b20-79ad02ef470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:01.274798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d3822-8085-4fdd-8b20-79ad02ef470e admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:01.275014 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d3822-8085-4fdd-8b20-79ad02ef470e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:01.275423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d3822-8085-4fdd-8b20-79ad02ef470e admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:01.276175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d3822-8085-4fdd-8b20-79ad02ef470e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:01.279040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d3822-8085-4fdd-8b20-79ad02ef470e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:01.304686 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4197/8419] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:01 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:01.304987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d4321-47f9-4030-84d8-1e56c420f258 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:01.320334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d4321-47f9-4030-84d8-1e56c420f258 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:01.325467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30572be-4b41-4939-a871-c804deae3894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:01.326375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30572be-4b41-4939-a871-c804deae3894 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:01.326745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30572be-4b41-4939-a871-c804deae3894 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:01.327094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30572be-4b41-4939-a871-c804deae3894 admin admin] PATH_INFO: `/v3/projects/0705b1c522974ef5872986bed72cc194/users/d1201dc74dc341de854020747f026ed8/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:01.329303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30572be-4b41-4939-a871-c804deae3894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0705b1c522974ef5872986bed72cc194, user_id=d1201dc74dc341de854020747f026ed8, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:01.332255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30572be-4b41-4939-a871-c804deae3894 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:01.364569 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4223/8420] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:24:01 2021] PUT /identity/v3/projects/0705b1c522974ef5872986bed72cc194/users/d1201dc74dc341de854020747f026ed8/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:01.365527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22fcb0-df79-4bff-9d31-906af6c8c7a4 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:01.365977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22fcb0-df79-4bff-9d31-906af6c8c7a4 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:01.366254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22fcb0-df79-4bff-9d31-906af6c8c7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:01.400348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3b22fcb0-df79-4bff-9d31-906af6c8c7a4 None None] MFA Rules not processed for user `d1201dc74dc341de854020747f026ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:01.401632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3b22fcb0-df79-4bff-9d31-906af6c8c7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:01.507747 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4198/8421] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:01 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:01.522677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30572be-4b41-4939-a871-c804deae3894 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:01.525084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e30572be-4b41-4939-a871-c804deae3894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:01.599214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30572be-4b41-4939-a871-c804deae3894 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:01.603244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f79174-acc4-436f-8313-f17f25c01045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:01.604048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f79174-acc4-436f-8313-f17f25c01045 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:01.604248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f79174-acc4-436f-8313-f17f25c01045 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:01.605253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f79174-acc4-436f-8313-f17f25c01045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:01.670514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f79174-acc4-436f-8313-f17f25c01045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:01.672067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f79174-acc4-436f-8313-f17f25c01045 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:01.683466 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4224/8422] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:24:01 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:24:04.611597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22fcb0-df79-4bff-9d31-906af6c8c7a4 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:04.613054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3b22fcb0-df79-4bff-9d31-906af6c8c7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:04.628512 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22fcb0-df79-4bff-9d31-906af6c8c7a4 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:04.632502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620785a-65e2-4b9b-8d11-e93f2ddfc733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:04.633191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620785a-65e2-4b9b-8d11-e93f2ddfc733 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:04.633470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620785a-65e2-4b9b-8d11-e93f2ddfc733 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:04.633762 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620785a-65e2-4b9b-8d11-e93f2ddfc733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:04.645597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620785a-65e2-4b9b-8d11-e93f2ddfc733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:04.647140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620785a-65e2-4b9b-8d11-e93f2ddfc733 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:04.658294 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4199/8423] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:24:04 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:24:09.079557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f79174-acc4-436f-8313-f17f25c01045 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:09.081152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a2f79174-acc4-436f-8313-f17f25c01045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:09.237555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f79174-acc4-436f-8313-f17f25c01045 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:09.243084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120af84-5008-4220-9f68-ac17db675942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:09.244043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120af84-5008-4220-9f68-ac17db675942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:09.244530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120af84-5008-4220-9f68-ac17db675942 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:09.244812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120af84-5008-4220-9f68-ac17db675942 admin admin] PATH_INFO: `/v3/users/d92679a35eb64fab8ae9c72180190285` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:09.246109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120af84-5008-4220-9f68-ac17db675942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d92679a35eb64fab8ae9c72180190285)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:09.248612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120af84-5008-4220-9f68-ac17db675942 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:09.331948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b120af84-5008-4220-9f68-ac17db675942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd92679a35eb64fab8ae9c72180190285'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:09.359176 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b120af84-5008-4220-9f68-ac17db675942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd92679a35eb64fab8ae9c72180190285'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:09.359855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b120af84-5008-4220-9f68-ac17db675942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd92679a35eb64fab8ae9c72180190285'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:09.385710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b120af84-5008-4220-9f68-ac17db675942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd92679a35eb64fab8ae9c72180190285'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:09.401421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-b120af84-5008-4220-9f68-ac17db675942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd92679a35eb64fab8ae9c72180190285'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:09.425401 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4225/8424] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:24:09 2021] DELETE /identity/v3/users/d92679a35eb64fab8ae9c72180190285 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:10.293110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620785a-65e2-4b9b-8d11-e93f2ddfc733 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:10.309376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620785a-65e2-4b9b-8d11-e93f2ddfc733 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:10.412473 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a7367-2956-4b72-bd27-2baf19c79d4f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:10.413444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a7367-2956-4b72-bd27-2baf19c79d4f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:10.413882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a7367-2956-4b72-bd27-2baf19c79d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:10.465783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-154a7367-2956-4b72-bd27-2baf19c79d4f None None] MFA Rules not processed for user `a2b5ce3f808e49e3a6e346d26813ae5b`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:10.467629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-154a7367-2956-4b72-bd27-2baf19c79d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:10.471720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:10.472768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:10.473118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:10.473327 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] PATH_INFO: `/v3/projects/9754c7acc6c542a28aca81967d0e24a1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:10.476063 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9754c7acc6c542a28aca81967d0e24a1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:10.481421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:10.557235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9754c7acc6c542a28aca81967d0e24a1', 'request_id': 'req-b3abd19f-591d-459b-891c-916a9bbc6f37'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:10.564560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9754c7acc6c542a28aca81967d0e24a1', 'request_id': 'req-b3abd19f-591d-459b-891c-916a9bbc6f37'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:10.565737 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4226/8425] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:10 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:24:10.581589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9754c7acc6c542a28aca81967d0e24a1', 'request_id': 'req-b3abd19f-591d-459b-891c-916a9bbc6f37'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:10.599525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] The token cache is being invalidate because project 9754c7acc6c542a28aca81967d0e24a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:24:10.599848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:10.600516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:10.605291 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4200/8426] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:24:10 2021] DELETE /identity/v3/projects/9754c7acc6c542a28aca81967d0e24a1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:10.606371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a7367-2956-4b72-bd27-2baf19c79d4f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:10.607767 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-154a7367-2956-4b72-bd27-2baf19c79d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:10.624516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a7367-2956-4b72-bd27-2baf19c79d4f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:10.774795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:10.776388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:10.777048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:10.777547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] PATH_INFO: `/v3/users/f2a54d2ad613446fb8a9bc437a60b79b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:10.779996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a54d2ad613446fb8a9bc437a60b79b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:10.782588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:10.848939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a54d2ad613446fb8a9bc437a60b79b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:10.859159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a54d2ad613446fb8a9bc437a60b79b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:10.860636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a54d2ad613446fb8a9bc437a60b79b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:10.868487 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a54d2ad613446fb8a9bc437a60b79b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:10.883920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a54d2ad613446fb8a9bc437a60b79b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:10.893855 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4227/8427] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:24:10 2021] DELETE /identity/v3/users/f2a54d2ad613446fb8a9bc437a60b79b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:11.114720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:11.116218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:11.149374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abd19f-591d-459b-891c-916a9bbc6f37 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:11.235949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:11.236880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:11.237230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:11.237573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] PATH_INFO: `/v3/projects/674e404c419c4edc83c8ad40b43ba4a6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:11.238836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674e404c419c4edc83c8ad40b43ba4a6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:11.240850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:11.305264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674e404c419c4edc83c8ad40b43ba4a6', 'request_id': 'req-cda56690-0228-471f-95a6-febc23281e64'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:11.322922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674e404c419c4edc83c8ad40b43ba4a6', 'request_id': 'req-cda56690-0228-471f-95a6-febc23281e64'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:11.336194 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674e404c419c4edc83c8ad40b43ba4a6', 'request_id': 'req-cda56690-0228-471f-95a6-febc23281e64'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:11.354057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] The token cache is being invalidate because project 674e404c419c4edc83c8ad40b43ba4a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:24:11.354361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:11.355245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-cda56690-0228-471f-95a6-febc23281e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:11.358105 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4201/8428] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:24:11 2021] DELETE /identity/v3/projects/674e404c419c4edc83c8ad40b43ba4a6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:19.772527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:19.775432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:19.789382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f8ee2-25ad-41b0-b9fb-ce80379ff8f7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:19.848925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:19.849827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:19.850113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:19.850394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] PATH_INFO: `/v3/users/98c4fe50315d4fc0b0329e80802eee86` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:19.851650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c4fe50315d4fc0b0329e80802eee86)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:19.853564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:19.901267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c4fe50315d4fc0b0329e80802eee86'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:19.909095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c4fe50315d4fc0b0329e80802eee86'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:19.909731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c4fe50315d4fc0b0329e80802eee86'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:19.916462 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c4fe50315d4fc0b0329e80802eee86'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:19.928406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c4fe50315d4fc0b0329e80802eee86'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:19.934142 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4228/8429] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:24:19 2021] DELETE /identity/v3/users/98c4fe50315d4fc0b0329e80802eee86 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:19.938950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5315-4c6b-4bf6-afa8-4dd78c0a90e8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:19.939499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5315-4c6b-4bf6-afa8-4dd78c0a90e8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:19.939733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5315-4c6b-4bf6-afa8-4dd78c0a90e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:19.960510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c5fa5315-4c6b-4bf6-afa8-4dd78c0a90e8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:19.961914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c5fa5315-4c6b-4bf6-afa8-4dd78c0a90e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:20.024975 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4202/8430] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:20.035382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:20.036776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:20.097674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20f297-50af-4870-ba64-37b0a34d36d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:20.101322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23920912-35be-4a29-a30a-a332e26cd072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:20.101986 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23920912-35be-4a29-a30a-a332e26cd072 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:20.102269 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23920912-35be-4a29-a30a-a332e26cd072 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:20.102544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23920912-35be-4a29-a30a-a332e26cd072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:20.112770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23920912-35be-4a29-a30a-a332e26cd072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:20.114190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23920912-35be-4a29-a30a-a332e26cd072 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:20.123460 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4229/8431] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:24:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:24:20.298996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa5315-4c6b-4bf6-afa8-4dd78c0a90e8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:20.300624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c5fa5315-4c6b-4bf6-afa8-4dd78c0a90e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:20.316694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa5315-4c6b-4bf6-afa8-4dd78c0a90e8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:20.324594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:20.325444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:20.326100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:20.326418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] PATH_INFO: `/v3/projects/587ce621728b4cb1b01fd53d69d45d4d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:20.338482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] RBAC: Authorizing `identity:delete_project(project_id=587ce621728b4cb1b01fd53d69d45d4d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:20.340596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:20.387693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587ce621728b4cb1b01fd53d69d45d4d', 'request_id': 'req-789e0915-94f0-40d4-b76e-4704ec0aeeba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.395069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587ce621728b4cb1b01fd53d69d45d4d', 'request_id': 'req-789e0915-94f0-40d4-b76e-4704ec0aeeba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.403344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587ce621728b4cb1b01fd53d69d45d4d', 'request_id': 'req-789e0915-94f0-40d4-b76e-4704ec0aeeba'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.414732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] The token cache is being invalidate because project 587ce621728b4cb1b01fd53d69d45d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:24:20.415026 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.415946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.417503 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4203/8432] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:24:20 2021] DELETE /identity/v3/projects/587ce621728b4cb1b01fd53d69d45d4d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:20.421630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23920912-35be-4a29-a30a-a332e26cd072 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:20.432523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23920912-35be-4a29-a30a-a332e26cd072 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:20.492054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcae60-c5ad-465a-a8e9-2cec64569331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:20.492929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcae60-c5ad-465a-a8e9-2cec64569331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:20.493219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcae60-c5ad-465a-a8e9-2cec64569331 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:20.493489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcae60-c5ad-465a-a8e9-2cec64569331 admin admin] PATH_INFO: `/v3/users/d7f39669871844cf88f46f072f46fe15` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:20.494714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcae60-c5ad-465a-a8e9-2cec64569331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f39669871844cf88f46f072f46fe15)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:20.496878 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcae60-c5ad-465a-a8e9-2cec64569331 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:20.541897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-befcae60-c5ad-465a-a8e9-2cec64569331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f39669871844cf88f46f072f46fe15'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.549241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-befcae60-c5ad-465a-a8e9-2cec64569331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f39669871844cf88f46f072f46fe15'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.549933 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-befcae60-c5ad-465a-a8e9-2cec64569331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f39669871844cf88f46f072f46fe15'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.557253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-befcae60-c5ad-465a-a8e9-2cec64569331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f39669871844cf88f46f072f46fe15'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.569348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-befcae60-c5ad-465a-a8e9-2cec64569331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f39669871844cf88f46f072f46fe15'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.576373 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4230/8433] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:24:20 2021] DELETE /identity/v3/users/d7f39669871844cf88f46f072f46fe15 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:24:20.752358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:20.754202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:20.771502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0915-94f0-40d4-b76e-4704ec0aeeba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:20.837197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:20.838016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:20.838300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:20.838600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] PATH_INFO: `/v3/projects/414235e15cdd46bfad72cceefb31d6f3` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:20.849273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=414235e15cdd46bfad72cceefb31d6f3)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:20.851197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:20.899454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414235e15cdd46bfad72cceefb31d6f3', 'request_id': 'req-e8baebc3-b3a7-49f8-9eb8-7232493796f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.906306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414235e15cdd46bfad72cceefb31d6f3', 'request_id': 'req-e8baebc3-b3a7-49f8-9eb8-7232493796f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.914162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414235e15cdd46bfad72cceefb31d6f3', 'request_id': 'req-e8baebc3-b3a7-49f8-9eb8-7232493796f3'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.924398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] The token cache is being invalidate because project 414235e15cdd46bfad72cceefb31d6f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:24:20.924683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.925321 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-e8baebc3-b3a7-49f8-9eb8-7232493796f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:20.926866 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4204/8434] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:24:20 2021] DELETE /identity/v3/projects/414235e15cdd46bfad72cceefb31d6f3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:24:20.934372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcc673-04d5-4cd7-a30f-5034859e1f77 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:20.934902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcc673-04d5-4cd7-a30f-5034859e1f77 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:20.935480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcc673-04d5-4cd7-a30f-5034859e1f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:20.954765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-63fcc673-04d5-4cd7-a30f-5034859e1f77 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:20.956026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-63fcc673-04d5-4cd7-a30f-5034859e1f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:21.014262 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4231/8435] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:24:21.023093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af9611-dba9-4ebe-8a38-1d9b4e44663f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.023598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af9611-dba9-4ebe-8a38-1d9b4e44663f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.023697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af9611-dba9-4ebe-8a38-1d9b4e44663f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.041652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-70af9611-dba9-4ebe-8a38-1d9b4e44663f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:21.042860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-70af9611-dba9-4ebe-8a38-1d9b4e44663f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:21.050686 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4205/8436] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:21.054947 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcc673-04d5-4cd7-a30f-5034859e1f77 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:21.064461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcc673-04d5-4cd7-a30f-5034859e1f77 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:21.069105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4f0f7-ba07-406b-9d89-4e9ddea5d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:21.069754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f0f7-ba07-406b-9d89-4e9ddea5d6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.070039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f0f7-ba07-406b-9d89-4e9ddea5d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.070316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f0f7-ba07-406b-9d89-4e9ddea5d6c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.071055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4f0f7-ba07-406b-9d89-4e9ddea5d6c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:24:21.071408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4f0f7-ba07-406b-9d89-4e9ddea5d6c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:21.072993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4f0f7-ba07-406b-9d89-4e9ddea5d6c2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:21.084846 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4232/8437] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:24:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:24:21.089190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af9611-dba9-4ebe-8a38-1d9b4e44663f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:21.099381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af9611-dba9-4ebe-8a38-1d9b4e44663f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:21.104224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2573-f3cc-4deb-b122-3c9fa36ea9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:21.104876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2573-f3cc-4deb-b122-3c9fa36ea9dd admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.105163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2573-f3cc-4deb-b122-3c9fa36ea9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.105472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2573-f3cc-4deb-b122-3c9fa36ea9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.106185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2573-f3cc-4deb-b122-3c9fa36ea9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:21.108147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2573-f3cc-4deb-b122-3c9fa36ea9dd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:21.136237 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4206/8438] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:24:21 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:24:21.140553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4f0f7-ba07-406b-9d89-4e9ddea5d6c2 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:21.151670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4f0f7-ba07-406b-9d89-4e9ddea5d6c2 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:21.209161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad93ff-8dc1-471b-941d-486cc98b91d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:21.209819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad93ff-8dc1-471b-941d-486cc98b91d1 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.210097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad93ff-8dc1-471b-941d-486cc98b91d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.210367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad93ff-8dc1-471b-941d-486cc98b91d1 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.211099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad93ff-8dc1-471b-941d-486cc98b91d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:21.213031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad93ff-8dc1-471b-941d-486cc98b91d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:21.232729 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4233/8439] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:24:21 2021] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:24:21.237130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2573-f3cc-4deb-b122-3c9fa36ea9dd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:21.247169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2573-f3cc-4deb-b122-3c9fa36ea9dd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:21.251889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390f17e-1557-4ce6-aa47-721645ac67b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:21.252535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390f17e-1557-4ce6-aa47-721645ac67b2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.252817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390f17e-1557-4ce6-aa47-721645ac67b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.253091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390f17e-1557-4ce6-aa47-721645ac67b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.253896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390f17e-1557-4ce6-aa47-721645ac67b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:21.255602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390f17e-1557-4ce6-aa47-721645ac67b2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:21.266122 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4207/8440] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:21.269874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad93ff-8dc1-471b-941d-486cc98b91d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:21.279784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad93ff-8dc1-471b-941d-486cc98b91d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:21.285174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c16aa9-6d4b-46e0-8acd-7cf9a44e610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:21.285818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16aa9-6d4b-46e0-8acd-7cf9a44e610b admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.286104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16aa9-6d4b-46e0-8acd-7cf9a44e610b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.286397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16aa9-6d4b-46e0-8acd-7cf9a44e610b admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.287106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c16aa9-6d4b-46e0-8acd-7cf9a44e610b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:21.288742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c16aa9-6d4b-46e0-8acd-7cf9a44e610b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:21.298617 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4234/8441] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:24:21.302525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390f17e-1557-4ce6-aa47-721645ac67b2 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:21.312376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390f17e-1557-4ce6-aa47-721645ac67b2 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:21.317098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454406e8-983d-4649-a475-d6b55f0e60ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:21.317961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454406e8-983d-4649-a475-d6b55f0e60ba admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.318239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454406e8-983d-4649-a475-d6b55f0e60ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.318509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454406e8-983d-4649-a475-d6b55f0e60ba admin admin] PATH_INFO: `/v3/projects/207bec47ae3d4596bea08391a7516e01/users/03913eda5b9f42b2a0e6c6d8558359e2/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.333165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454406e8-983d-4649-a475-d6b55f0e60ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=207bec47ae3d4596bea08391a7516e01, user_id=03913eda5b9f42b2a0e6c6d8558359e2, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:21.335847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454406e8-983d-4649-a475-d6b55f0e60ba admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:21.348886 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4208/8442] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:24:21 2021] PUT /identity/v3/projects/207bec47ae3d4596bea08391a7516e01/users/03913eda5b9f42b2a0e6c6d8558359e2/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:21.359260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4949a-1d66-462c-a138-827dcab3b66f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.359587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4949a-1d66-462c-a138-827dcab3b66f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.360132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4949a-1d66-462c-a138-827dcab3b66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.387510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-75f4949a-1d66-462c-a138-827dcab3b66f None None] MFA Rules not processed for user `03913eda5b9f42b2a0e6c6d8558359e2`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:21.388710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-75f4949a-1d66-462c-a138-827dcab3b66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:21.449593 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4235/8443] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:21 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:21.455521 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454406e8-983d-4649-a475-d6b55f0e60ba admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:21.517318 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454406e8-983d-4649-a475-d6b55f0e60ba admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:21.522684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760b68b-1044-4370-9297-97b57eed766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:21.523375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760b68b-1044-4370-9297-97b57eed766e admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.523660 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760b68b-1044-4370-9297-97b57eed766e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.523931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760b68b-1044-4370-9297-97b57eed766e admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.524632 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760b68b-1044-4370-9297-97b57eed766e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:21.526542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760b68b-1044-4370-9297-97b57eed766e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:21.552457 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4209/8444] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:24:21 2021] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:24:21.556771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4949a-1d66-462c-a138-827dcab3b66f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:21.568650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4949a-1d66-462c-a138-827dcab3b66f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:21.632683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de845950-f81d-41d8-bcbc-6365ee9711d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:21.632683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de845950-f81d-41d8-bcbc-6365ee9711d1 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.632683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de845950-f81d-41d8-bcbc-6365ee9711d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.632683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de845950-f81d-41d8-bcbc-6365ee9711d1 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.633087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de845950-f81d-41d8-bcbc-6365ee9711d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:21.633872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de845950-f81d-41d8-bcbc-6365ee9711d1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:21.653308 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4236/8445] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:24:21 2021] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:24:21.657548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760b68b-1044-4370-9297-97b57eed766e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:21.668608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760b68b-1044-4370-9297-97b57eed766e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:21.673292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334e427-532b-4738-9f70-0afce73a677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:21.673942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e427-532b-4738-9f70-0afce73a677a admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.674228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e427-532b-4738-9f70-0afce73a677a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.674504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334e427-532b-4738-9f70-0afce73a677a admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.675234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334e427-532b-4738-9f70-0afce73a677a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:21.676870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334e427-532b-4738-9f70-0afce73a677a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:21.687197 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4210/8446] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:21.691723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de845950-f81d-41d8-bcbc-6365ee9711d1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:21.701360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de845950-f81d-41d8-bcbc-6365ee9711d1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:21.706592 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df118f-3f13-4bab-bffc-641979fdf7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:21.707482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df118f-3f13-4bab-bffc-641979fdf7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.707765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df118f-3f13-4bab-bffc-641979fdf7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.708041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df118f-3f13-4bab-bffc-641979fdf7d8 admin admin] PATH_INFO: `/v3/projects/373c7eabe2424dff9c816da53915c41b/users/72e99dd8356941baabed364d6b173266/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.722390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df118f-3f13-4bab-bffc-641979fdf7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373c7eabe2424dff9c816da53915c41b, user_id=72e99dd8356941baabed364d6b173266, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:21.725047 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df118f-3f13-4bab-bffc-641979fdf7d8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:21.738837 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4237/8447] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:24:21 2021] PUT /identity/v3/projects/373c7eabe2424dff9c816da53915c41b/users/72e99dd8356941baabed364d6b173266/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:21.749769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243b116-551f-48e3-a433-30c9d17d6b48 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.750079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243b116-551f-48e3-a433-30c9d17d6b48 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.750340 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243b116-551f-48e3-a433-30c9d17d6b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.777332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8243b116-551f-48e3-a433-30c9d17d6b48 None None] MFA Rules not processed for user `72e99dd8356941baabed364d6b173266`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:21.778478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8243b116-551f-48e3-a433-30c9d17d6b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:21.839611 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4211/8448] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:21 2021] POST /identity/v3/auth/tokens => generated 3261 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:21.868230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df118f-3f13-4bab-bffc-641979fdf7d8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:21.869941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d7df118f-3f13-4bab-bffc-641979fdf7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:21.960835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df118f-3f13-4bab-bffc-641979fdf7d8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:21.966105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278885a7-0024-4c74-82b2-9d48b169e055 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:21.966746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278885a7-0024-4c74-82b2-9d48b169e055 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:21.967032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278885a7-0024-4c74-82b2-9d48b169e055 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:21.967339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278885a7-0024-4c74-82b2-9d48b169e055 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:21.975020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278885a7-0024-4c74-82b2-9d48b169e055 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:21.976626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278885a7-0024-4c74-82b2-9d48b169e055 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:21.985922 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4238/8449] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:24:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:24:22.565151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243b116-551f-48e3-a433-30c9d17d6b48 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:22.630135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243b116-551f-48e3-a433-30c9d17d6b48 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:22.634615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:22.635496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:22.635779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:22.636050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] PATH_INFO: `/v3/users/03913eda5b9f42b2a0e6c6d8558359e2` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:22.637239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03913eda5b9f42b2a0e6c6d8558359e2)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:22.639171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:22.686869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03913eda5b9f42b2a0e6c6d8558359e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:22.687692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03913eda5b9f42b2a0e6c6d8558359e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:22.695130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03913eda5b9f42b2a0e6c6d8558359e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:22.695790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03913eda5b9f42b2a0e6c6d8558359e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:22.702751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03913eda5b9f42b2a0e6c6d8558359e2'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:22.720542 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4212/8450] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:24:22 2021] DELETE /identity/v3/users/03913eda5b9f42b2a0e6c6d8558359e2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:22.725222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594957fb-407b-44d6-af86-47aa1ecd2ba2 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:22.725520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594957fb-407b-44d6-af86-47aa1ecd2ba2 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:22.725799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594957fb-407b-44d6-af86-47aa1ecd2ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:22.743630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-594957fb-407b-44d6-af86-47aa1ecd2ba2 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:22.744819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-594957fb-407b-44d6-af86-47aa1ecd2ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:22.805441 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4239/8451] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:22.815372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:22.816850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:22.876978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378e390-ebef-461e-94c6-27037d25a4e0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:22.880622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e9822-b591-404d-bbef-4ebd3b19476c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:22.881267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e9822-b591-404d-bbef-4ebd3b19476c service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:22.881555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e9822-b591-404d-bbef-4ebd3b19476c service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:22.881824 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e9822-b591-404d-bbef-4ebd3b19476c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:22.891111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e9822-b591-404d-bbef-4ebd3b19476c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:22.893245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e9822-b591-404d-bbef-4ebd3b19476c service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:22.902729 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4213/8452] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:24:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:24:23.548057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594957fb-407b-44d6-af86-47aa1ecd2ba2 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:23.549566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-594957fb-407b-44d6-af86-47aa1ecd2ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:23.561716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594957fb-407b-44d6-af86-47aa1ecd2ba2 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:23.566958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:23.567864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:23.568271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:23.568557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] PATH_INFO: `/v3/projects/207bec47ae3d4596bea08391a7516e01` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:23.570588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207bec47ae3d4596bea08391a7516e01)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:23.572529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:23.628981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207bec47ae3d4596bea08391a7516e01', 'request_id': 'req-900c3bb7-f72d-4a76-9052-f2c569d49c55'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:23.637298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207bec47ae3d4596bea08391a7516e01', 'request_id': 'req-900c3bb7-f72d-4a76-9052-f2c569d49c55'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:23.644048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207bec47ae3d4596bea08391a7516e01', 'request_id': 'req-900c3bb7-f72d-4a76-9052-f2c569d49c55'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:23.655285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] The token cache is being invalidate because project 207bec47ae3d4596bea08391a7516e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:24:23.655573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:23.656354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:23.658709 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4240/8453] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:24:23 2021] DELETE /identity/v3/projects/207bec47ae3d4596bea08391a7516e01 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:23.662672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e9822-b591-404d-bbef-4ebd3b19476c service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:23.673689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e9822-b591-404d-bbef-4ebd3b19476c service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:23.729697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c09768-f0e0-4cde-af96-b05793ef4595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:23.730565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c09768-f0e0-4cde-af96-b05793ef4595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:23.730847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c09768-f0e0-4cde-af96-b05793ef4595 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:23.731122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c09768-f0e0-4cde-af96-b05793ef4595 admin admin] PATH_INFO: `/v3/users/72e99dd8356941baabed364d6b173266` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:23.732389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c09768-f0e0-4cde-af96-b05793ef4595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e99dd8356941baabed364d6b173266)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:23.734361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c09768-f0e0-4cde-af96-b05793ef4595 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:23.779722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-93c09768-f0e0-4cde-af96-b05793ef4595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e99dd8356941baabed364d6b173266'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:23.780418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-93c09768-f0e0-4cde-af96-b05793ef4595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e99dd8356941baabed364d6b173266'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:23.788250 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-93c09768-f0e0-4cde-af96-b05793ef4595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e99dd8356941baabed364d6b173266'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:23.789093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-93c09768-f0e0-4cde-af96-b05793ef4595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e99dd8356941baabed364d6b173266'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:23.796746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-93c09768-f0e0-4cde-af96-b05793ef4595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e99dd8356941baabed364d6b173266'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:23.814931 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4214/8454] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:24:23 2021] DELETE /identity/v3/users/72e99dd8356941baabed364d6b173266 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:24.268695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:24.270277 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:24.284806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c3bb7-f72d-4a76-9052-f2c569d49c55 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:24.350272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:24.351058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:24.351427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:24.351709 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] PATH_INFO: `/v3/projects/373c7eabe2424dff9c816da53915c41b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:24.353071 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=373c7eabe2424dff9c816da53915c41b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:24.355007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:24.401789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373c7eabe2424dff9c816da53915c41b', 'request_id': 'req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:24.410009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373c7eabe2424dff9c816da53915c41b', 'request_id': 'req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:24.416684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373c7eabe2424dff9c816da53915c41b', 'request_id': 'req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:24.426800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] The token cache is being invalidate because project 373c7eabe2424dff9c816da53915c41b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:24:24.427087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:24.427762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f4e581a6-51e9-4306-b6f7-3c3deddc75aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:24.429518 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4241/8455] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:24:24 2021] DELETE /identity/v3/projects/373c7eabe2424dff9c816da53915c41b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:24.435134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa9ec-f9d3-42ee-855c-31b820ca0b6b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:24.435591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa9ec-f9d3-42ee-855c-31b820ca0b6b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:24.435939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa9ec-f9d3-42ee-855c-31b820ca0b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:24.462768 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-da3fa9ec-f9d3-42ee-855c-31b820ca0b6b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:24.464367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-da3fa9ec-f9d3-42ee-855c-31b820ca0b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:24.530090 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4215/8456] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:24.537798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f3f6-e6e5-4328-8708-311da79a6a0b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:24.538094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f3f6-e6e5-4328-8708-311da79a6a0b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:24.538374 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f3f6-e6e5-4328-8708-311da79a6a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:24.557110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ab61f3f6-e6e5-4328-8708-311da79a6a0b None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:24.558614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ab61f3f6-e6e5-4328-8708-311da79a6a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:24.571955 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4242/8457] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:24.573624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa9ec-f9d3-42ee-855c-31b820ca0b6b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:24.583994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa9ec-f9d3-42ee-855c-31b820ca0b6b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:24.588679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dae9c-6efa-4591-9bef-2127561089ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:24.589329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dae9c-6efa-4591-9bef-2127561089ed admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:24.589615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dae9c-6efa-4591-9bef-2127561089ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:24.589893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dae9c-6efa-4591-9bef-2127561089ed admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:24.590627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599dae9c-6efa-4591-9bef-2127561089ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:24:24.590934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599dae9c-6efa-4591-9bef-2127561089ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:24.592637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599dae9c-6efa-4591-9bef-2127561089ed admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:24.607756 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4216/8458] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:24:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:24:24.612221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f3f6-e6e5-4328-8708-311da79a6a0b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:24.622455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f3f6-e6e5-4328-8708-311da79a6a0b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:24.627964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9915e9-c4a5-4fc4-bb5d-1182fcfd1cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:24.628689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9915e9-c4a5-4fc4-bb5d-1182fcfd1cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:24.629068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9915e9-c4a5-4fc4-bb5d-1182fcfd1cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:24.629413 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9915e9-c4a5-4fc4-bb5d-1182fcfd1cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:24.630190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9915e9-c4a5-4fc4-bb5d-1182fcfd1cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:24.632188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9915e9-c4a5-4fc4-bb5d-1182fcfd1cf1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:24.661709 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4243/8459] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:24:24 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:24:24.663749 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dae9c-6efa-4591-9bef-2127561089ed admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:24.674197 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dae9c-6efa-4591-9bef-2127561089ed admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:24.730396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4f577-a9c4-4e27-b052-6953f466e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:24.731068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4f577-a9c4-4e27-b052-6953f466e805 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:24.731393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4f577-a9c4-4e27-b052-6953f466e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:24.731675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4f577-a9c4-4e27-b052-6953f466e805 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:24.732378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4f577-a9c4-4e27-b052-6953f466e805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:24.734351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4f577-a9c4-4e27-b052-6953f466e805 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:24.758150 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4217/8460] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:24:24 2021] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:24:24.759548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9915e9-c4a5-4fc4-bb5d-1182fcfd1cf1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:24.771695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9915e9-c4a5-4fc4-bb5d-1182fcfd1cf1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:24.776772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1ac45-e4a3-47b1-93a3-5ce55f1d563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:24.777463 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1ac45-e4a3-47b1-93a3-5ce55f1d563a admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:24.777734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1ac45-e4a3-47b1-93a3-5ce55f1d563a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:24.778120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1ac45-e4a3-47b1-93a3-5ce55f1d563a admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:24.778866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1ac45-e4a3-47b1-93a3-5ce55f1d563a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:24.780493 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1ac45-e4a3-47b1-93a3-5ce55f1d563a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:24.797747 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4244/8461] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:24 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:24.801848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4f577-a9c4-4e27-b052-6953f466e805 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:24.811872 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4f577-a9c4-4e27-b052-6953f466e805 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:24.818470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea819c-35b8-4943-a7b9-d93d16a9711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:24.819140 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea819c-35b8-4943-a7b9-d93d16a9711f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:24.819455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea819c-35b8-4943-a7b9-d93d16a9711f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:24.819738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea819c-35b8-4943-a7b9-d93d16a9711f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:24.820472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea819c-35b8-4943-a7b9-d93d16a9711f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:24.822079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea819c-35b8-4943-a7b9-d93d16a9711f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:24.835855 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4218/8462] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:24.837203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1ac45-e4a3-47b1-93a3-5ce55f1d563a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:24.847882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1ac45-e4a3-47b1-93a3-5ce55f1d563a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:24.852545 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904d16-18dd-463a-8bd8-e454664c3345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:24.853423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904d16-18dd-463a-8bd8-e454664c3345 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:24.853698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904d16-18dd-463a-8bd8-e454664c3345 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:24.853974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3904d16-18dd-463a-8bd8-e454664c3345 admin admin] PATH_INFO: `/v3/projects/c7fd68c2720747e98f51f396d9f4dd78/users/afd2e66b6a504b77a139c37ea777d41a/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:24.868980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3904d16-18dd-463a-8bd8-e454664c3345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fd68c2720747e98f51f396d9f4dd78, user_id=afd2e66b6a504b77a139c37ea777d41a, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:24.871935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3904d16-18dd-463a-8bd8-e454664c3345 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:24.885308 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4245/8463] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:24:24 2021] PUT /identity/v3/projects/c7fd68c2720747e98f51f396d9f4dd78/users/afd2e66b6a504b77a139c37ea777d41a/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:24.890332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79173b7a-404b-48bf-90ab-176730b1ea80 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:24.890631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79173b7a-404b-48bf-90ab-176730b1ea80 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:24.890916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79173b7a-404b-48bf-90ab-176730b1ea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:24.910247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-79173b7a-404b-48bf-90ab-176730b1ea80 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:24.911496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-79173b7a-404b-48bf-90ab-176730b1ea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:24.977610 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4219/8464] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:24.986714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904d16-18dd-463a-8bd8-e454664c3345 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:24.988564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c3904d16-18dd-463a-8bd8-e454664c3345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:25.046760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3904d16-18dd-463a-8bd8-e454664c3345 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:25.051279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc449e0-c38d-46ee-a018-132f6f1dd7d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:25.051950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc449e0-c38d-46ee-a018-132f6f1dd7d4 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:25.052236 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc449e0-c38d-46ee-a018-132f6f1dd7d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:25.052509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc449e0-c38d-46ee-a018-132f6f1dd7d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:25.064139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc449e0-c38d-46ee-a018-132f6f1dd7d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:25.065811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc449e0-c38d-46ee-a018-132f6f1dd7d4 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:25.078125 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4246/8465] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:24:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:24:25.824516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddef46-93e3-42d1-a920-ae4724151bdb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:25.825049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddef46-93e3-42d1-a920-ae4724151bdb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:25.825903 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddef46-93e3-42d1-a920-ae4724151bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:25.855540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-daddef46-93e3-42d1-a920-ae4724151bdb None None] MFA Rules not processed for user `afd2e66b6a504b77a139c37ea777d41a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:25.857159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-daddef46-93e3-42d1-a920-ae4724151bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:25.939768 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4220/8466] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:25 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:25.944388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc449e0-c38d-46ee-a018-132f6f1dd7d4 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:25.958232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc449e0-c38d-46ee-a018-132f6f1dd7d4 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:25.963636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb0556-574d-41e1-9a8a-86e948436271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:25.964518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb0556-574d-41e1-9a8a-86e948436271 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:25.964900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb0556-574d-41e1-9a8a-86e948436271 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:25.965281 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb0556-574d-41e1-9a8a-86e948436271 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:25.966290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb0556-574d-41e1-9a8a-86e948436271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:25.968542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb0556-574d-41e1-9a8a-86e948436271 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:25.998820 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4247/8467] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:24:25 2021] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:24:26.003331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddef46-93e3-42d1-a920-ae4724151bdb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:26.014973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddef46-93e3-42d1-a920-ae4724151bdb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:26.082722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86028483-f298-41c3-9101-cfdafb693087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:26.083601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028483-f298-41c3-9101-cfdafb693087 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:26.083977 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028483-f298-41c3-9101-cfdafb693087 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:26.084352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86028483-f298-41c3-9101-cfdafb693087 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:26.085185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86028483-f298-41c3-9101-cfdafb693087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:26.088450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86028483-f298-41c3-9101-cfdafb693087 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:26.113735 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4221/8468] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:24:26 2021] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:24:26.117530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb0556-574d-41e1-9a8a-86e948436271 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:26.128717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb0556-574d-41e1-9a8a-86e948436271 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:26.133757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae550d7-01b2-4854-a53b-287855238f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:26.134436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae550d7-01b2-4854-a53b-287855238f3e admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:26.134726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae550d7-01b2-4854-a53b-287855238f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:26.135008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae550d7-01b2-4854-a53b-287855238f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:26.135940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae550d7-01b2-4854-a53b-287855238f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:26.137890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae550d7-01b2-4854-a53b-287855238f3e admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:26.150380 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4248/8469] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:26 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:26.156075 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86028483-f298-41c3-9101-cfdafb693087 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:26.167501 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86028483-f298-41c3-9101-cfdafb693087 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:26.172962 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc8c80-0479-4ccb-8af3-43b8ab8b4011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:26.173917 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8c80-0479-4ccb-8af3-43b8ab8b4011 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:26.174267 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8c80-0479-4ccb-8af3-43b8ab8b4011 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:26.174613 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8c80-0479-4ccb-8af3-43b8ab8b4011 admin admin] PATH_INFO: `/v3/projects/d11027607fff4fb6b2e4a0107feca716/users/353da499d0c241a08eb9c91c54f78680/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:26.189641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc8c80-0479-4ccb-8af3-43b8ab8b4011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11027607fff4fb6b2e4a0107feca716, user_id=353da499d0c241a08eb9c91c54f78680, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:26.192484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc8c80-0479-4ccb-8af3-43b8ab8b4011 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:26.205291 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4222/8470] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:24:26 2021] PUT /identity/v3/projects/d11027607fff4fb6b2e4a0107feca716/users/353da499d0c241a08eb9c91c54f78680/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:26.209459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae550d7-01b2-4854-a53b-287855238f3e admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:26.220467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae550d7-01b2-4854-a53b-287855238f3e admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:26.287650 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0e412-2bd0-46ae-999e-10c5294cbee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:26.288515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e412-2bd0-46ae-999e-10c5294cbee2 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:26.288985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e412-2bd0-46ae-999e-10c5294cbee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:26.289426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0e412-2bd0-46ae-999e-10c5294cbee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:26.290326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0e412-2bd0-46ae-999e-10c5294cbee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:26.292140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0e412-2bd0-46ae-999e-10c5294cbee2 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:26.302058 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4249/8471] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:26 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:26.309199 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc8c80-0479-4ccb-8af3-43b8ab8b4011 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:26.320043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc8c80-0479-4ccb-8af3-43b8ab8b4011 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:26.325488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd549ce-4515-4935-92ca-2d569a93bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:26.326379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd549ce-4515-4935-92ca-2d569a93bab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:26.326664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd549ce-4515-4935-92ca-2d569a93bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:26.326941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd549ce-4515-4935-92ca-2d569a93bab7 admin admin] PATH_INFO: `/v3/projects/d11027607fff4fb6b2e4a0107feca716/users/353da499d0c241a08eb9c91c54f78680/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:26.329546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd549ce-4515-4935-92ca-2d569a93bab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11027607fff4fb6b2e4a0107feca716, user_id=353da499d0c241a08eb9c91c54f78680, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:26.332454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd549ce-4515-4935-92ca-2d569a93bab7 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:26.343229 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4223/8472] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:24:26 2021] PUT /identity/v3/projects/d11027607fff4fb6b2e4a0107feca716/users/353da499d0c241a08eb9c91c54f78680/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:27.261111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53fc57-5457-49fa-b5c7-97327ffd1a5d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:27.261636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53fc57-5457-49fa-b5c7-97327ffd1a5d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:27.261812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53fc57-5457-49fa-b5c7-97327ffd1a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:27.292028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6c53fc57-5457-49fa-b5c7-97327ffd1a5d None None] MFA Rules not processed for user `353da499d0c241a08eb9c91c54f78680`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:27.293575 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6c53fc57-5457-49fa-b5c7-97327ffd1a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:27.365189 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4250/8473] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:27 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:27.376021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3176-94f2-402a-bbca-358ba08c7a93 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:27.376522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3176-94f2-402a-bbca-358ba08c7a93 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:27.376642 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e3176-94f2-402a-bbca-358ba08c7a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:27.394313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5d1e3176-94f2-402a-bbca-358ba08c7a93 None None] MFA Rules not processed for user `afd2e66b6a504b77a139c37ea777d41a`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:27.395496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5d1e3176-94f2-402a-bbca-358ba08c7a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:27.451492 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4224/8474] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:27 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:27.464365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53fc57-5457-49fa-b5c7-97327ffd1a5d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:27.465739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6c53fc57-5457-49fa-b5c7-97327ffd1a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:27.540720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53fc57-5457-49fa-b5c7-97327ffd1a5d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:27.546283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433604bc-3f43-4cca-8683-d502e74a18c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:27.546924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433604bc-3f43-4cca-8683-d502e74a18c4 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:27.547875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433604bc-3f43-4cca-8683-d502e74a18c4 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:27.548161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433604bc-3f43-4cca-8683-d502e74a18c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:27.555791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433604bc-3f43-4cca-8683-d502e74a18c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:27.557365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433604bc-3f43-4cca-8683-d502e74a18c4 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:27.566051 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4251/8475] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:24:27 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:24:51.794037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e3176-94f2-402a-bbca-358ba08c7a93 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:51.856800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e3176-94f2-402a-bbca-358ba08c7a93 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:51.861986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:51.862844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:51.863129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:51.863436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] PATH_INFO: `/v3/users/afd2e66b6a504b77a139c37ea777d41a` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:51.864628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd2e66b6a504b77a139c37ea777d41a)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:51.866551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:51.910821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd2e66b6a504b77a139c37ea777d41a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:51.911505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd2e66b6a504b77a139c37ea777d41a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:51.918595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd2e66b6a504b77a139c37ea777d41a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:51.919354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd2e66b6a504b77a139c37ea777d41a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:51.926643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd2e66b6a504b77a139c37ea777d41a'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:51.943844 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4225/8476] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:24:51 2021] DELETE /identity/v3/users/afd2e66b6a504b77a139c37ea777d41a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:52.113648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433604bc-3f43-4cca-8683-d502e74a18c4 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:52.125093 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433604bc-3f43-4cca-8683-d502e74a18c4 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:52.179966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:52.180816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:52.181096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:52.181370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] PATH_INFO: `/v3/projects/c7fd68c2720747e98f51f396d9f4dd78` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:52.182555 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fd68c2720747e98f51f396d9f4dd78)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:52.184494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:52.227857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fd68c2720747e98f51f396d9f4dd78', 'request_id': 'req-7767c265-7f41-4420-825c-c5688ab299c0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.235605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fd68c2720747e98f51f396d9f4dd78', 'request_id': 'req-7767c265-7f41-4420-825c-c5688ab299c0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.241631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fd68c2720747e98f51f396d9f4dd78', 'request_id': 'req-7767c265-7f41-4420-825c-c5688ab299c0'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.251354 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] The token cache is being invalidate because project c7fd68c2720747e98f51f396d9f4dd78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:24:52.251642 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.252264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.253799 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4252/8477] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:24:52 2021] DELETE /identity/v3/projects/c7fd68c2720747e98f51f396d9f4dd78 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:24:52.257785 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:52.259186 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:52.271941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbdd27-4095-418c-ba79-bda576f38ecd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:52.326669 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8339620-4736-4f7d-b6d1-ab85edecb483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:52.327565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339620-4736-4f7d-b6d1-ab85edecb483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:52.327846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339620-4736-4f7d-b6d1-ab85edecb483 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:52.328117 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339620-4736-4f7d-b6d1-ab85edecb483 admin admin] PATH_INFO: `/v3/users/353da499d0c241a08eb9c91c54f78680` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:52.329350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8339620-4736-4f7d-b6d1-ab85edecb483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=353da499d0c241a08eb9c91c54f78680)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:52.331269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8339620-4736-4f7d-b6d1-ab85edecb483 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:52.377622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8339620-4736-4f7d-b6d1-ab85edecb483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353da499d0c241a08eb9c91c54f78680'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.378220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8339620-4736-4f7d-b6d1-ab85edecb483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353da499d0c241a08eb9c91c54f78680'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.385942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8339620-4736-4f7d-b6d1-ab85edecb483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353da499d0c241a08eb9c91c54f78680'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.386643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8339620-4736-4f7d-b6d1-ab85edecb483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353da499d0c241a08eb9c91c54f78680'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.393758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c8339620-4736-4f7d-b6d1-ab85edecb483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353da499d0c241a08eb9c91c54f78680'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.410620 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4226/8478] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:24:52 2021] DELETE /identity/v3/users/353da499d0c241a08eb9c91c54f78680 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:52.580485 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:52.582125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:52.596272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767c265-7f41-4420-825c-c5688ab299c0 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:52.654519 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:52.655333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:52.655623 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:52.655901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] PATH_INFO: `/v3/projects/d11027607fff4fb6b2e4a0107feca716` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:52.657668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11027607fff4fb6b2e4a0107feca716)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:52.659606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:52.709181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11027607fff4fb6b2e4a0107feca716', 'request_id': 'req-918f05ed-c164-429c-a946-0197153f2dea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.716953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11027607fff4fb6b2e4a0107feca716', 'request_id': 'req-918f05ed-c164-429c-a946-0197153f2dea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.724085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11027607fff4fb6b2e4a0107feca716', 'request_id': 'req-918f05ed-c164-429c-a946-0197153f2dea'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.735062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] The token cache is being invalidate because project d11027607fff4fb6b2e4a0107feca716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:24:52.736010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.736856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-918f05ed-c164-429c-a946-0197153f2dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:24:52.738418 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4253/8479] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:24:52 2021] DELETE /identity/v3/projects/d11027607fff4fb6b2e4a0107feca716 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:24:52.744222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ceaf7-2444-4405-87be-091311384945 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:52.744592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ceaf7-2444-4405-87be-091311384945 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:52.744869 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ceaf7-2444-4405-87be-091311384945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:52.765663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ee1ceaf7-2444-4405-87be-091311384945 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:52.767413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ee1ceaf7-2444-4405-87be-091311384945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:52.827644 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4227/8480] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:24:52.837606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf170065-96ff-43c2-b333-8dd00b8900cf None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:52.837909 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf170065-96ff-43c2-b333-8dd00b8900cf None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:52.838186 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf170065-96ff-43c2-b333-8dd00b8900cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:52.860083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cf170065-96ff-43c2-b333-8dd00b8900cf None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:52.861311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cf170065-96ff-43c2-b333-8dd00b8900cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:52.869560 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4254/8481] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:52.873850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ceaf7-2444-4405-87be-091311384945 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:52.884121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ceaf7-2444-4405-87be-091311384945 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:52.888877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48967e6f-cd25-430e-95de-5b603eabd730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:52.889533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48967e6f-cd25-430e-95de-5b603eabd730 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:52.889817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48967e6f-cd25-430e-95de-5b603eabd730 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:52.890089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48967e6f-cd25-430e-95de-5b603eabd730 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:52.891491 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48967e6f-cd25-430e-95de-5b603eabd730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:24:52.891802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48967e6f-cd25-430e-95de-5b603eabd730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:52.893427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48967e6f-cd25-430e-95de-5b603eabd730 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:52.904909 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4228/8482] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:24:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:24:52.909135 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf170065-96ff-43c2-b333-8dd00b8900cf None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:52.918250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf170065-96ff-43c2-b333-8dd00b8900cf None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:52.922953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e39156-9e33-4b8f-a611-ed8ff10f4b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:52.923637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e39156-9e33-4b8f-a611-ed8ff10f4b9d admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:52.923923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e39156-9e33-4b8f-a611-ed8ff10f4b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:52.924201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e39156-9e33-4b8f-a611-ed8ff10f4b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:52.924901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e39156-9e33-4b8f-a611-ed8ff10f4b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:52.926793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e39156-9e33-4b8f-a611-ed8ff10f4b9d admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:52.951793 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4255/8483] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:24:52 2021] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:24:52.956390 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48967e6f-cd25-430e-95de-5b603eabd730 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:52.966556 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48967e6f-cd25-430e-95de-5b603eabd730 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:53.023191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a838e8e-9bcd-4aeb-b542-421729305e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:53.023890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a838e8e-9bcd-4aeb-b542-421729305e87 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:53.024175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a838e8e-9bcd-4aeb-b542-421729305e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:53.024450 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a838e8e-9bcd-4aeb-b542-421729305e87 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:53.025145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a838e8e-9bcd-4aeb-b542-421729305e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:53.027073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a838e8e-9bcd-4aeb-b542-421729305e87 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:53.046321 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4229/8484] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:24:52 2021] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:24:53.050449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e39156-9e33-4b8f-a611-ed8ff10f4b9d admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:53.060677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e39156-9e33-4b8f-a611-ed8ff10f4b9d admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:53.065847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba0993-0996-42c4-a4bf-fb80083f4f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:53.066497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba0993-0996-42c4-a4bf-fb80083f4f4f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:53.066847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba0993-0996-42c4-a4bf-fb80083f4f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:53.067129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba0993-0996-42c4-a4bf-fb80083f4f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:53.067905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba0993-0996-42c4-a4bf-fb80083f4f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:53.069505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba0993-0996-42c4-a4bf-fb80083f4f4f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:53.080923 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4256/8485] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:53.085007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a838e8e-9bcd-4aeb-b542-421729305e87 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:53.094961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a838e8e-9bcd-4aeb-b542-421729305e87 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:53.099647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e56811-85e5-4b09-84d0-12c95b29a22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:53.100300 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e56811-85e5-4b09-84d0-12c95b29a22d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:53.100595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e56811-85e5-4b09-84d0-12c95b29a22d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:53.100857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e56811-85e5-4b09-84d0-12c95b29a22d admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:53.101582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e56811-85e5-4b09-84d0-12c95b29a22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:53.103184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e56811-85e5-4b09-84d0-12c95b29a22d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:53.113190 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4230/8486] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:53.117253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba0993-0996-42c4-a4bf-fb80083f4f4f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:53.128831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba0993-0996-42c4-a4bf-fb80083f4f4f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:53.133572 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8415b-6888-4c16-b38d-eebdbdfce7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:53.134446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8415b-6888-4c16-b38d-eebdbdfce7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:53.134727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8415b-6888-4c16-b38d-eebdbdfce7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:53.134999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8415b-6888-4c16-b38d-eebdbdfce7f5 admin admin] PATH_INFO: `/v3/projects/75d471b7fbc14bbcbf3dbb7f1acbddcb/users/22d0ea2ed19044fa8d47565b0eb443d6/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:53.149868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8415b-6888-4c16-b38d-eebdbdfce7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d471b7fbc14bbcbf3dbb7f1acbddcb, user_id=22d0ea2ed19044fa8d47565b0eb443d6, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:53.152582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8415b-6888-4c16-b38d-eebdbdfce7f5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:53.165660 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4257/8487] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:24:53 2021] PUT /identity/v3/projects/75d471b7fbc14bbcbf3dbb7f1acbddcb/users/22d0ea2ed19044fa8d47565b0eb443d6/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:24:53.170866 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588afab-513b-438a-8698-c7f3d3f785d0 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:53.171214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588afab-513b-438a-8698-c7f3d3f785d0 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:53.171525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588afab-513b-438a-8698-c7f3d3f785d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:53.189427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d588afab-513b-438a-8698-c7f3d3f785d0 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:53.190615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d588afab-513b-438a-8698-c7f3d3f785d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:53.247490 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4231/8488] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:53.258543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8415b-6888-4c16-b38d-eebdbdfce7f5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:53.260309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e9a8415b-6888-4c16-b38d-eebdbdfce7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:53.319616 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8415b-6888-4c16-b38d-eebdbdfce7f5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:53.323341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9550b-0bd1-4f95-99ce-0c1a57fe2b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:53.323985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9550b-0bd1-4f95-99ce-0c1a57fe2b8b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:53.324270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9550b-0bd1-4f95-99ce-0c1a57fe2b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:53.324550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9550b-0bd1-4f95-99ce-0c1a57fe2b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:53.333579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9550b-0bd1-4f95-99ce-0c1a57fe2b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:53.335019 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9550b-0bd1-4f95-99ce-0c1a57fe2b8b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:53.344551 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4258/8489] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:24:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:24:57.255904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465c5ac-204a-41b5-b5f7-08ecea5433c5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:57.256397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465c5ac-204a-41b5-b5f7-08ecea5433c5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:57.256513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465c5ac-204a-41b5-b5f7-08ecea5433c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:57.289709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0465c5ac-204a-41b5-b5f7-08ecea5433c5 None None] MFA Rules not processed for user `22d0ea2ed19044fa8d47565b0eb443d6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:24:57.290941 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0465c5ac-204a-41b5-b5f7-08ecea5433c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:24:57.374621 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4232/8490] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:24:57 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:24:57.378748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9550b-0bd1-4f95-99ce-0c1a57fe2b8b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:57.388828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9550b-0bd1-4f95-99ce-0c1a57fe2b8b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:57.395723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d19a8f-e3fb-47a6-8c0b-00c4dae57597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:57.396504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19a8f-e3fb-47a6-8c0b-00c4dae57597 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:57.396967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19a8f-e3fb-47a6-8c0b-00c4dae57597 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:57.397432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d19a8f-e3fb-47a6-8c0b-00c4dae57597 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:57.398316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d19a8f-e3fb-47a6-8c0b-00c4dae57597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:57.400458 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d19a8f-e3fb-47a6-8c0b-00c4dae57597 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:57.431792 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4259/8491] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:24:57 2021] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:24:57.435554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465c5ac-204a-41b5-b5f7-08ecea5433c5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:57.449253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465c5ac-204a-41b5-b5f7-08ecea5433c5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:57.515736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2fa9f-f512-4ca0-b9da-e79d61612222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:57.516996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2fa9f-f512-4ca0-b9da-e79d61612222 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:57.517280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2fa9f-f512-4ca0-b9da-e79d61612222 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:57.517555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2fa9f-f512-4ca0-b9da-e79d61612222 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:57.518269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2fa9f-f512-4ca0-b9da-e79d61612222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:57.520344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2fa9f-f512-4ca0-b9da-e79d61612222 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:57.542199 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4233/8492] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:24:57 2021] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:24:57.546378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d19a8f-e3fb-47a6-8c0b-00c4dae57597 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:57.557959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d19a8f-e3fb-47a6-8c0b-00c4dae57597 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:57.564794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e7189-3053-48fd-8ef2-a8b29eb02ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:57.565577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e7189-3053-48fd-8ef2-a8b29eb02ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:57.565881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e7189-3053-48fd-8ef2-a8b29eb02ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:57.566225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e7189-3053-48fd-8ef2-a8b29eb02ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:57.567096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e7189-3053-48fd-8ef2-a8b29eb02ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:57.568938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e7189-3053-48fd-8ef2-a8b29eb02ff1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:57.581240 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4260/8493] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:57 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:57.585468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2fa9f-f512-4ca0-b9da-e79d61612222 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:57.595725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2fa9f-f512-4ca0-b9da-e79d61612222 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:57.601206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de86269-f4df-48e2-ae10-2060d0ce2513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:57.602101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de86269-f4df-48e2-ae10-2060d0ce2513 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:57.602381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de86269-f4df-48e2-ae10-2060d0ce2513 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:57.602733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de86269-f4df-48e2-ae10-2060d0ce2513 admin admin] PATH_INFO: `/v3/projects/75285b09603b45a3b97073daffc753f6/users/84059cdb35fe41a4be2e2bf6f64d3812/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:57.619974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de86269-f4df-48e2-ae10-2060d0ce2513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75285b09603b45a3b97073daffc753f6, user_id=84059cdb35fe41a4be2e2bf6f64d3812, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:57.622997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de86269-f4df-48e2-ae10-2060d0ce2513 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:57.639370 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4234/8494] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:24:57 2021] PUT /identity/v3/projects/75285b09603b45a3b97073daffc753f6/users/84059cdb35fe41a4be2e2bf6f64d3812/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:24:57.643927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e7189-3053-48fd-8ef2-a8b29eb02ff1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:57.654172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e7189-3053-48fd-8ef2-a8b29eb02ff1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:57.716875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed53e06-9f2c-42ca-aada-835b4def427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:57.717550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed53e06-9f2c-42ca-aada-835b4def427c admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:57.717832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed53e06-9f2c-42ca-aada-835b4def427c admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:57.718107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed53e06-9f2c-42ca-aada-835b4def427c admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:57.718851 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed53e06-9f2c-42ca-aada-835b4def427c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:57.720536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed53e06-9f2c-42ca-aada-835b4def427c admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:57.730707 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4261/8495] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:24:57 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:24:57.735571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de86269-f4df-48e2-ae10-2060d0ce2513 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:24:57.746292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de86269-f4df-48e2-ae10-2060d0ce2513 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:24:57.751839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa22658-c42c-4a6e-8d93-d39b839c71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:24:57.752833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22658-c42c-4a6e-8d93-d39b839c71cd admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:24:57.753193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22658-c42c-4a6e-8d93-d39b839c71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:24:57.753572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa22658-c42c-4a6e-8d93-d39b839c71cd admin admin] PATH_INFO: `/v3/projects/75285b09603b45a3b97073daffc753f6/users/84059cdb35fe41a4be2e2bf6f64d3812/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:24:57.755761 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa22658-c42c-4a6e-8d93-d39b839c71cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=75285b09603b45a3b97073daffc753f6, user_id=84059cdb35fe41a4be2e2bf6f64d3812, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:24:57.758711 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa22658-c42c-4a6e-8d93-d39b839c71cd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:24:57.769744 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4235/8496] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:24:57 2021] PUT /identity/v3/projects/75285b09603b45a3b97073daffc753f6/users/84059cdb35fe41a4be2e2bf6f64d3812/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:25:00.564928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed53e06-9f2c-42ca-aada-835b4def427c admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:25:00.566857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5ed53e06-9f2c-42ca-aada-835b4def427c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:00.745022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed53e06-9f2c-42ca-aada-835b4def427c admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:25:00.888239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47220c0-b77d-46af-be48-63fde8d14406 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:25:00.888239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47220c0-b77d-46af-be48-63fde8d14406 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:00.888239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47220c0-b77d-46af-be48-63fde8d14406 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:00.888239 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47220c0-b77d-46af-be48-63fde8d14406 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:00.902942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e47220c0-b77d-46af-be48-63fde8d14406 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:00.948362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47220c0-b77d-46af-be48-63fde8d14406 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:25:00.952500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47220c0-b77d-46af-be48-63fde8d14406 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:25:00.972034 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4262/8497] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:25:00 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:25:03.014584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2c8ce-97be-4def-8789-6089da9b362f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:03.015166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2c8ce-97be-4def-8789-6089da9b362f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:03.015166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2c8ce-97be-4def-8789-6089da9b362f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:03.051797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ccc2c8ce-97be-4def-8789-6089da9b362f None None] MFA Rules not processed for user `84059cdb35fe41a4be2e2bf6f64d3812`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:25:03.053040 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ccc2c8ce-97be-4def-8789-6089da9b362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:03.132723 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4236/8498] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:25:03 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:25:03.147089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47220c0-b77d-46af-be48-63fde8d14406 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:25:03.148521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e47220c0-b77d-46af-be48-63fde8d14406 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:03.244404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47220c0-b77d-46af-be48-63fde8d14406 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:25:03.256859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb042f15-0464-4257-9db7-4c5864f7bd78 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:25:03.257922 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042f15-0464-4257-9db7-4c5864f7bd78 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:03.258490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042f15-0464-4257-9db7-4c5864f7bd78 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:03.258963 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042f15-0464-4257-9db7-4c5864f7bd78 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:03.339084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb042f15-0464-4257-9db7-4c5864f7bd78 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:25:03.340644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb042f15-0464-4257-9db7-4c5864f7bd78 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:25:03.354511 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4263/8499] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:25:03 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:25:05.615138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8834b-bbe0-43f9-9fe5-ac9ca0ad6327 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:05.616143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8834b-bbe0-43f9-9fe5-ac9ca0ad6327 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:05.616671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8834b-bbe0-43f9-9fe5-ac9ca0ad6327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:05.636993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0ad8834b-bbe0-43f9-9fe5-ac9ca0ad6327 None None] MFA Rules not processed for user `a2b5ce3f808e49e3a6e346d26813ae5b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:25:05.638526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0ad8834b-bbe0-43f9-9fe5-ac9ca0ad6327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:05.701702 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4237/8500] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:25:05 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:25:06.079494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb042f15-0464-4257-9db7-4c5864f7bd78 service glance] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:25:06.178189 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb042f15-0464-4257-9db7-4c5864f7bd78 service glance] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:25:06.183644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b240747-0541-4324-955b-f6a6e555161e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:25:06.184820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b240747-0541-4324-955b-f6a6e555161e service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:06.186232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b240747-0541-4324-955b-f6a6e555161e service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:06.186803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b240747-0541-4324-955b-f6a6e555161e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:06.189730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3b240747-0541-4324-955b-f6a6e555161e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:06.203918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b240747-0541-4324-955b-f6a6e555161e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:25:06.206015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b240747-0541-4324-955b-f6a6e555161e service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:25:06.221692 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4264/8501] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:25:06 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:25:07.626043 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847a511-b971-4de8-983b-cfb04b08e975 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:07.627863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847a511-b971-4de8-983b-cfb04b08e975 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:07.628201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847a511-b971-4de8-983b-cfb04b08e975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:07.661836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7847a511-b971-4de8-983b-cfb04b08e975 None None] MFA Rules not processed for user `22d0ea2ed19044fa8d47565b0eb443d6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:25:07.663404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7847a511-b971-4de8-983b-cfb04b08e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:07.676299 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4238/8502] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:25:07 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:25:32.792279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c31e-23a1-4950-a22d-bb34ceece9ce None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:32.792881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c31e-23a1-4950-a22d-bb34ceece9ce None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:32.792881 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c31e-23a1-4950-a22d-bb34ceece9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:32.812224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b151c31e-23a1-4950-a22d-bb34ceece9ce None None] MFA Rules not processed for user `22d0ea2ed19044fa8d47565b0eb443d6`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:25:32.813426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b151c31e-23a1-4950-a22d-bb34ceece9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:32.820979 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4265/8503] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:25:32 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:25:46.145809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4fd3a-b222-4ec6-a8c3-57a3802b7ff9 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:46.146298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4fd3a-b222-4ec6-a8c3-57a3802b7ff9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:46.146395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4fd3a-b222-4ec6-a8c3-57a3802b7ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:46.194240 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ebf4fd3a-b222-4ec6-a8c3-57a3802b7ff9 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:25:46.195513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ebf4fd3a-b222-4ec6-a8c3-57a3802b7ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:46.258563 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4239/8504] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:25:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:25:46.308331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151c31e-23a1-4950-a22d-bb34ceece9ce None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:25:46.309750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b151c31e-23a1-4950-a22d-bb34ceece9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:46.380966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151c31e-23a1-4950-a22d-bb34ceece9ce None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:25:46.385911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06fde4-e374-43ab-a8c3-8a5cbc90db69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:25:46.386551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06fde4-e374-43ab-a8c3-8a5cbc90db69 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:46.386832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06fde4-e374-43ab-a8c3-8a5cbc90db69 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:46.387106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06fde4-e374-43ab-a8c3-8a5cbc90db69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:46.395117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06fde4-e374-43ab-a8c3-8a5cbc90db69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:25:46.396720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06fde4-e374-43ab-a8c3-8a5cbc90db69 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:25:46.404743 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4266/8505] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:25:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:25:47.661644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4165cd-dc40-4dee-afff-b516bbb0ece2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:47.662131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4165cd-dc40-4dee-afff-b516bbb0ece2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:47.662227 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4165cd-dc40-4dee-afff-b516bbb0ece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:47.680021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fe4165cd-dc40-4dee-afff-b516bbb0ece2 None None] MFA Rules not processed for user `22d0ea2ed19044fa8d47565b0eb443d6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:25:47.681253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fe4165cd-dc40-4dee-afff-b516bbb0ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:47.689013 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4240/8506] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:25:47 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:25:51.783585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06fde4-e374-43ab-a8c3-8a5cbc90db69 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:25:51.795839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06fde4-e374-43ab-a8c3-8a5cbc90db69 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:25:51.800200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692a0d1-4437-4da0-9828-7c199b762ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:25:51.800935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692a0d1-4437-4da0-9828-7c199b762ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:51.801286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692a0d1-4437-4da0-9828-7c199b762ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:51.801661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692a0d1-4437-4da0-9828-7c199b762ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:51.803511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1692a0d1-4437-4da0-9828-7c199b762ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:51.876291 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692a0d1-4437-4da0-9828-7c199b762ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:25:51.877735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692a0d1-4437-4da0-9828-7c199b762ca8 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:25:51.892068 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4267/8507] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:25:51 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:25:55.483753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4165cd-dc40-4dee-afff-b516bbb0ece2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:25:55.486447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fe4165cd-dc40-4dee-afff-b516bbb0ece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:55.522454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4165cd-dc40-4dee-afff-b516bbb0ece2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:25:55.528361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e204820-3356-4126-b5f7-86a3ed400f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:25:55.530474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e204820-3356-4126-b5f7-86a3ed400f14 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:55.531101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e204820-3356-4126-b5f7-86a3ed400f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:55.531980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e204820-3356-4126-b5f7-86a3ed400f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:55.534336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5e204820-3356-4126-b5f7-86a3ed400f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:55.552519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e204820-3356-4126-b5f7-86a3ed400f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:25:55.554299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e204820-3356-4126-b5f7-86a3ed400f14 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:25:55.569558 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4241/8508] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:25:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:25:59.831973 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692a0d1-4437-4da0-9828-7c199b762ca8 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:25:59.834855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1692a0d1-4437-4da0-9828-7c199b762ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:59.854382 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692a0d1-4437-4da0-9828-7c199b762ca8 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:25:59.862200 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf73d-f9f7-421b-9f38-0a34b7465191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:25:59.863678 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf73d-f9f7-421b-9f38-0a34b7465191 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:25:59.863976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf73d-f9f7-421b-9f38-0a34b7465191 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:25:59.864258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf73d-f9f7-421b-9f38-0a34b7465191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:25:59.866260 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8b5cf73d-f9f7-421b-9f38-0a34b7465191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:25:59.884617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cf73d-f9f7-421b-9f38-0a34b7465191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:25:59.886667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cf73d-f9f7-421b-9f38-0a34b7465191 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:25:59.904604 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4268/8509] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:25:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:26:14.271963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a38f4-ed47-42a3-8336-d44e139c0698 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:26:14.272548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a38f4-ed47-42a3-8336-d44e139c0698 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:26:14.273367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a38f4-ed47-42a3-8336-d44e139c0698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:26:14.295467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7f3a38f4-ed47-42a3-8336-d44e139c0698 None None] MFA Rules not processed for user `a2b5ce3f808e49e3a6e346d26813ae5b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:26:14.297058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7f3a38f4-ed47-42a3-8336-d44e139c0698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:26:14.306488 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4242/8510] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:26:14 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:26:14.737415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf73d-f9f7-421b-9f38-0a34b7465191 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:26:14.781015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf73d-f9f7-421b-9f38-0a34b7465191 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:26:14.793302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a3dd2-2a48-43f5-8490-6ec2a49e7f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:26:14.794321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a3dd2-2a48-43f5-8490-6ec2a49e7f04 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:26:14.794822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a3dd2-2a48-43f5-8490-6ec2a49e7f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:26:14.795639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a3dd2-2a48-43f5-8490-6ec2a49e7f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:26:14.798367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-532a3dd2-2a48-43f5-8490-6ec2a49e7f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:26:14.813362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a3dd2-2a48-43f5-8490-6ec2a49e7f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:26:14.814818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a3dd2-2a48-43f5-8490-6ec2a49e7f04 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:26:14.825840 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4269/8511] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:26:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:26:42.041600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635148d-f58b-48ff-8ace-eb266bdefdcc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:26:42.042095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635148d-f58b-48ff-8ace-eb266bdefdcc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:26:42.042095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635148d-f58b-48ff-8ace-eb266bdefdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:26:42.068551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c635148d-f58b-48ff-8ace-eb266bdefdcc None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:26:42.069737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c635148d-f58b-48ff-8ace-eb266bdefdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:26:42.096364 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4243/8512] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:26:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:26:42.109797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a3dd2-2a48-43f5-8490-6ec2a49e7f04 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:26:42.152727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a3dd2-2a48-43f5-8490-6ec2a49e7f04 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:26:42.157674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f0417-a0cc-4adf-b048-43ffad836b7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:26:42.158410 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0417-a0cc-4adf-b048-43ffad836b7d service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:26:42.158621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0417-a0cc-4adf-b048-43ffad836b7d service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:26:42.158895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f0417-a0cc-4adf-b048-43ffad836b7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:26:42.167168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f0417-a0cc-4adf-b048-43ffad836b7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:26:42.168761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f0417-a0cc-4adf-b048-43ffad836b7d service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:26:42.176471 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4270/8513] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:26:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:26:44.998569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80312b6-62d7-458e-bc3e-1c0548236107 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:26:44.999066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80312b6-62d7-458e-bc3e-1c0548236107 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:26:44.999179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80312b6-62d7-458e-bc3e-1c0548236107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:26:45.017046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c80312b6-62d7-458e-bc3e-1c0548236107 None None] MFA Rules not processed for user `22d0ea2ed19044fa8d47565b0eb443d6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:26:45.018230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c80312b6-62d7-458e-bc3e-1c0548236107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:26:45.027068 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4244/8514] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:26:44 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:26:48.449631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f0417-a0cc-4adf-b048-43ffad836b7d service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:26:48.472452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f0417-a0cc-4adf-b048-43ffad836b7d service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:26:48.477397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a44e-6d4b-4511-b40c-3f1cfd2038b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:26:48.478057 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a44e-6d4b-4511-b40c-3f1cfd2038b7 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:26:48.478336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a44e-6d4b-4511-b40c-3f1cfd2038b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:26:48.478817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4a44e-6d4b-4511-b40c-3f1cfd2038b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:26:48.480871 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-02e4a44e-6d4b-4511-b40c-3f1cfd2038b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:26:48.508157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4a44e-6d4b-4511-b40c-3f1cfd2038b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:26:48.509620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4a44e-6d4b-4511-b40c-3f1cfd2038b7 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:26:48.521027 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4271/8515] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:26:48 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:26:55.671539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80312b6-62d7-458e-bc3e-1c0548236107 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:26:55.684215 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80312b6-62d7-458e-bc3e-1c0548236107 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:26:55.687780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ab27f-4b1c-4de2-93a9-7d9cb213c1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:26:55.688443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ab27f-4b1c-4de2-93a9-7d9cb213c1bc service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:26:55.688722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ab27f-4b1c-4de2-93a9-7d9cb213c1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:26:55.688994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ab27f-4b1c-4de2-93a9-7d9cb213c1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:26:55.698467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ab27f-4b1c-4de2-93a9-7d9cb213c1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:26:55.699950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ab27f-4b1c-4de2-93a9-7d9cb213c1bc service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:26:55.709140 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4245/8516] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:26:55 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:27:07.280601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a44e-6d4b-4511-b40c-3f1cfd2038b7 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:07.292641 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4a44e-6d4b-4511-b40c-3f1cfd2038b7 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:07.296475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ce931-62b8-4646-b921-171d2e56bc20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:07.297167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce931-62b8-4646-b921-171d2e56bc20 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:07.297447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce931-62b8-4646-b921-171d2e56bc20 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:07.297721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce931-62b8-4646-b921-171d2e56bc20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:07.299618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-904ce931-62b8-4646-b921-171d2e56bc20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:07.312208 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ce931-62b8-4646-b921-171d2e56bc20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:07.313665 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ce931-62b8-4646-b921-171d2e56bc20 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:07.324007 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4272/8517] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:27:07 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:27:39.318166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ab27f-4b1c-4de2-93a9-7d9cb213c1bc service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:39.319823 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0a6ab27f-4b1c-4de2-93a9-7d9cb213c1bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:39.426282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ab27f-4b1c-4de2-93a9-7d9cb213c1bc service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:39.431127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:39.432039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:39.432324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:39.432602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] PATH_INFO: `/v3/users/a2b5ce3f808e49e3a6e346d26813ae5b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:39.433836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b5ce3f808e49e3a6e346d26813ae5b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:39.435978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:39.487268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b5ce3f808e49e3a6e346d26813ae5b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:39.487968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b5ce3f808e49e3a6e346d26813ae5b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:39.495734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b5ce3f808e49e3a6e346d26813ae5b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:39.496364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b5ce3f808e49e3a6e346d26813ae5b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:39.503883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b5ce3f808e49e3a6e346d26813ae5b'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:39.523937 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4246/8518] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:27:39 2021] DELETE /identity/v3/users/a2b5ce3f808e49e3a6e346d26813ae5b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:27:39.529045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f431049-a1e0-4940-a34a-13edc087100c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:39.529577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f431049-a1e0-4940-a34a-13edc087100c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:39.529707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f431049-a1e0-4940-a34a-13edc087100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:39.556600 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6f431049-a1e0-4940-a34a-13edc087100c None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:27:39.557810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6f431049-a1e0-4940-a34a-13edc087100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:39.615424 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4273/8519] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:27:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:27:39.625611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:39.627035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:39.686181 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dabef-3788-4bb3-b7b0-8f97a268d43e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:39.689831 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538a266-9ae9-4c38-a708-ac1261b76e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:39.690471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538a266-9ae9-4c38-a708-ac1261b76e4d service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:39.690751 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538a266-9ae9-4c38-a708-ac1261b76e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:39.691029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538a266-9ae9-4c38-a708-ac1261b76e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:39.700729 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538a266-9ae9-4c38-a708-ac1261b76e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:39.702176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538a266-9ae9-4c38-a708-ac1261b76e4d service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:39.711548 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4247/8520] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:27:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:27:39.879412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f431049-a1e0-4940-a34a-13edc087100c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:39.880890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6f431049-a1e0-4940-a34a-13edc087100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:39.893722 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f431049-a1e0-4940-a34a-13edc087100c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:39.898420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:39.899356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:39.900268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:39.900547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] PATH_INFO: `/v3/projects/c0ac40a766ea478bab3fe658ba56b08f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:39.901747 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ac40a766ea478bab3fe658ba56b08f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:39.903756 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:39.949367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ac40a766ea478bab3fe658ba56b08f', 'request_id': 'req-4c1db6b4-63be-4701-a0ad-bb81c661b935'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:39.955793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ac40a766ea478bab3fe658ba56b08f', 'request_id': 'req-4c1db6b4-63be-4701-a0ad-bb81c661b935'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:39.961846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ac40a766ea478bab3fe658ba56b08f', 'request_id': 'req-4c1db6b4-63be-4701-a0ad-bb81c661b935'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:39.972286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] The token cache is being invalidate because project c0ac40a766ea478bab3fe658ba56b08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:27:39.972573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:39.973276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:39.974889 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4274/8521] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:27:39 2021] DELETE /identity/v3/projects/c0ac40a766ea478bab3fe658ba56b08f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:27:39.978961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538a266-9ae9-4c38-a708-ac1261b76e4d service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:39.988781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538a266-9ae9-4c38-a708-ac1261b76e4d service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:40.043827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a58c2-713c-42a8-814c-2b438e46a292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:40.044686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a58c2-713c-42a8-814c-2b438e46a292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:40.044973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a58c2-713c-42a8-814c-2b438e46a292 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:40.045247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a58c2-713c-42a8-814c-2b438e46a292 admin admin] PATH_INFO: `/v3/users/d1201dc74dc341de854020747f026ed8` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:40.046432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a58c2-713c-42a8-814c-2b438e46a292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1201dc74dc341de854020747f026ed8)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:40.048416 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a58c2-713c-42a8-814c-2b438e46a292 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:40.093470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-338a58c2-713c-42a8-814c-2b438e46a292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1201dc74dc341de854020747f026ed8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:40.094066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-338a58c2-713c-42a8-814c-2b438e46a292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1201dc74dc341de854020747f026ed8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:40.100814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-338a58c2-713c-42a8-814c-2b438e46a292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1201dc74dc341de854020747f026ed8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:40.101509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-338a58c2-713c-42a8-814c-2b438e46a292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1201dc74dc341de854020747f026ed8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:40.108336 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-338a58c2-713c-42a8-814c-2b438e46a292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1201dc74dc341de854020747f026ed8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:40.125624 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4248/8522] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:27:39 2021] DELETE /identity/v3/users/d1201dc74dc341de854020747f026ed8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:27:40.390505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:40.392256 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:40.409942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1db6b4-63be-4701-a0ad-bb81c661b935 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:40.470805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:40.471924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:40.472218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:40.472522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] PATH_INFO: `/v3/projects/0705b1c522974ef5872986bed72cc194` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:40.473741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0705b1c522974ef5872986bed72cc194)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:40.475686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:40.520569 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0705b1c522974ef5872986bed72cc194', 'request_id': 'req-0d91e243-d652-41b9-af52-fbdb154b5a0a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:40.527938 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0705b1c522974ef5872986bed72cc194', 'request_id': 'req-0d91e243-d652-41b9-af52-fbdb154b5a0a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:40.534238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0705b1c522974ef5872986bed72cc194', 'request_id': 'req-0d91e243-d652-41b9-af52-fbdb154b5a0a'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:40.544179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] The token cache is being invalidate because project 0705b1c522974ef5872986bed72cc194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:27:40.544468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:40.545111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0d91e243-d652-41b9-af52-fbdb154b5a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:27:40.546642 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4275/8523] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:27:40 2021] DELETE /identity/v3/projects/0705b1c522974ef5872986bed72cc194 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:27:40.554880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b4b49-13db-4894-ad1e-ea4dabaaf7ff None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:40.555388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b4b49-13db-4894-ad1e-ea4dabaaf7ff None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:40.555589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b4b49-13db-4894-ad1e-ea4dabaaf7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:40.602590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3d1b4b49-13db-4894-ad1e-ea4dabaaf7ff None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:27:40.603812 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3d1b4b49-13db-4894-ad1e-ea4dabaaf7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:40.660275 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4249/8524] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:27:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:27:40.669024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffb665-730e-422f-be6d-c5ebc7258984 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:40.669322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffb665-730e-422f-be6d-c5ebc7258984 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:40.669601 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffb665-730e-422f-be6d-c5ebc7258984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:40.688066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-08ffb665-730e-422f-be6d-c5ebc7258984 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:27:40.689259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-08ffb665-730e-422f-be6d-c5ebc7258984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:40.697635 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4276/8525] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:27:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:27:40.701946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b4b49-13db-4894-ad1e-ea4dabaaf7ff None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:40.711757 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b4b49-13db-4894-ad1e-ea4dabaaf7ff None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:40.716842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06adbc-61d2-4ea8-9131-2099aef34b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:40.717484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06adbc-61d2-4ea8-9131-2099aef34b54 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:40.717765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06adbc-61d2-4ea8-9131-2099aef34b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:40.718038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06adbc-61d2-4ea8-9131-2099aef34b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:40.718794 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06adbc-61d2-4ea8-9131-2099aef34b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:27:40.719098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06adbc-61d2-4ea8-9131-2099aef34b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:40.720732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06adbc-61d2-4ea8-9131-2099aef34b54 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:40.732755 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4250/8526] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:27:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:27:40.737116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffb665-730e-422f-be6d-c5ebc7258984 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:40.747145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffb665-730e-422f-be6d-c5ebc7258984 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:40.752542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1cac8-2b08-47ab-9608-b409cc2fbe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:40.753191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1cac8-2b08-47ab-9608-b409cc2fbe97 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:40.753477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1cac8-2b08-47ab-9608-b409cc2fbe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:40.753757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1cac8-2b08-47ab-9608-b409cc2fbe97 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:40.754466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1cac8-2b08-47ab-9608-b409cc2fbe97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:40.756401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1cac8-2b08-47ab-9608-b409cc2fbe97 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:40.782554 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4277/8527] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:27:40 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:27:40.786770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06adbc-61d2-4ea8-9131-2099aef34b54 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:40.796760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06adbc-61d2-4ea8-9131-2099aef34b54 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:40.851401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eb3e2-7a36-48f2-9886-a0bb6938df1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:40.852096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb3e2-7a36-48f2-9886-a0bb6938df1b admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:40.852396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb3e2-7a36-48f2-9886-a0bb6938df1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:40.852694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eb3e2-7a36-48f2-9886-a0bb6938df1b admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:40.855458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901eb3e2-7a36-48f2-9886-a0bb6938df1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:40.860471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901eb3e2-7a36-48f2-9886-a0bb6938df1b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:40.885676 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4251/8528] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:27:40 2021] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:27:40.889498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1cac8-2b08-47ab-9608-b409cc2fbe97 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:40.900380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1cac8-2b08-47ab-9608-b409cc2fbe97 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:40.905030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042556a-64e7-47ec-81a3-3fdbdda24aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:40.905683 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042556a-64e7-47ec-81a3-3fdbdda24aec admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:40.905974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042556a-64e7-47ec-81a3-3fdbdda24aec admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:40.906255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042556a-64e7-47ec-81a3-3fdbdda24aec admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:40.906992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042556a-64e7-47ec-81a3-3fdbdda24aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:40.908629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042556a-64e7-47ec-81a3-3fdbdda24aec admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:40.919410 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4278/8529] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:27:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:27:40.923231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eb3e2-7a36-48f2-9886-a0bb6938df1b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:40.933892 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eb3e2-7a36-48f2-9886-a0bb6938df1b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:40.938497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f17da-29b7-4339-8ddf-d16e93c2f4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:40.939229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f17da-29b7-4339-8ddf-d16e93c2f4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:40.939557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f17da-29b7-4339-8ddf-d16e93c2f4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:40.939843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f17da-29b7-4339-8ddf-d16e93c2f4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:40.940580 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f17da-29b7-4339-8ddf-d16e93c2f4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:40.942184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f17da-29b7-4339-8ddf-d16e93c2f4a2 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:40.953065 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4252/8530] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:27:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:27:40.957183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042556a-64e7-47ec-81a3-3fdbdda24aec admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:40.967661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042556a-64e7-47ec-81a3-3fdbdda24aec admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:40.972681 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bce6d-d681-41b7-8a50-63a0e19060c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:40.973560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bce6d-d681-41b7-8a50-63a0e19060c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:40.973848 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bce6d-d681-41b7-8a50-63a0e19060c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:40.974128 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bce6d-d681-41b7-8a50-63a0e19060c8 admin admin] PATH_INFO: `/v3/projects/34545818a5a9484a943ab6e09bdd800a/users/011c76eca940449f865a90106ed59c41/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:40.990847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bce6d-d681-41b7-8a50-63a0e19060c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34545818a5a9484a943ab6e09bdd800a, user_id=011c76eca940449f865a90106ed59c41, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:40.994517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bce6d-d681-41b7-8a50-63a0e19060c8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:41.007109 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4279/8531] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:27:40 2021] PUT /identity/v3/projects/34545818a5a9484a943ab6e09bdd800a/users/011c76eca940449f865a90106ed59c41/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:27:41.012679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb28742-8be2-406f-8cd0-aabaeae05a24 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:41.013020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb28742-8be2-406f-8cd0-aabaeae05a24 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:41.013305 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb28742-8be2-406f-8cd0-aabaeae05a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:41.030774 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-feb28742-8be2-406f-8cd0-aabaeae05a24 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:27:41.032005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-feb28742-8be2-406f-8cd0-aabaeae05a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:41.089057 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4253/8532] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:27:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:27:41.098763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bce6d-d681-41b7-8a50-63a0e19060c8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:41.100535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-722bce6d-d681-41b7-8a50-63a0e19060c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:41.158020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bce6d-d681-41b7-8a50-63a0e19060c8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:41.161708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef3e94-a194-4428-98fd-3ba83cf4e6ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:41.162375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef3e94-a194-4428-98fd-3ba83cf4e6ab service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:41.162664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef3e94-a194-4428-98fd-3ba83cf4e6ab service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:41.162951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef3e94-a194-4428-98fd-3ba83cf4e6ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:41.172542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef3e94-a194-4428-98fd-3ba83cf4e6ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:41.173903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef3e94-a194-4428-98fd-3ba83cf4e6ab service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:41.183794 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4280/8533] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:27:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:27:45.670687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77677da-9a9b-46be-832e-020b0e5be64f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:45.671381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77677da-9a9b-46be-832e-020b0e5be64f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:45.671381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77677da-9a9b-46be-832e-020b0e5be64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:45.701897 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b77677da-9a9b-46be-832e-020b0e5be64f None None] MFA Rules not processed for user `011c76eca940449f865a90106ed59c41`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:27:45.705007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b77677da-9a9b-46be-832e-020b0e5be64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:45.791894 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4254/8534] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:27:45 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:27:45.797234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef3e94-a194-4428-98fd-3ba83cf4e6ab service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:45.808778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef3e94-a194-4428-98fd-3ba83cf4e6ab service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:45.814637 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89254a9-bf6a-4765-bf50-beecc308b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:45.815587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89254a9-bf6a-4765-bf50-beecc308b383 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:45.816663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89254a9-bf6a-4765-bf50-beecc308b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:45.816663 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89254a9-bf6a-4765-bf50-beecc308b383 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:45.817228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89254a9-bf6a-4765-bf50-beecc308b383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:45.819525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89254a9-bf6a-4765-bf50-beecc308b383 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:45.860287 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4281/8535] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:27:45 2021] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:27:45.865175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77677da-9a9b-46be-832e-020b0e5be64f None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:45.882882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77677da-9a9b-46be-832e-020b0e5be64f None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:45.948844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e93b4b-fa01-4b54-bece-4ece32fff123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:45.949656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e93b4b-fa01-4b54-bece-4ece32fff123 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:45.949976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e93b4b-fa01-4b54-bece-4ece32fff123 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:45.950258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e93b4b-fa01-4b54-bece-4ece32fff123 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:45.950973 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e93b4b-fa01-4b54-bece-4ece32fff123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:45.953022 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e93b4b-fa01-4b54-bece-4ece32fff123 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:45.974012 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4255/8536] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:27:45 2021] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:27:45.978384 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89254a9-bf6a-4765-bf50-beecc308b383 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:45.989397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89254a9-bf6a-4765-bf50-beecc308b383 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:45.995286 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67037258-fb9c-4028-823a-916151adf88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:45.995969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67037258-fb9c-4028-823a-916151adf88f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:45.996253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67037258-fb9c-4028-823a-916151adf88f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:45.996526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67037258-fb9c-4028-823a-916151adf88f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:45.997400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67037258-fb9c-4028-823a-916151adf88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:45.999391 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67037258-fb9c-4028-823a-916151adf88f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:46.011737 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4282/8537] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:27:45 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:27:46.016402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e93b4b-fa01-4b54-bece-4ece32fff123 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:46.028263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e93b4b-fa01-4b54-bece-4ece32fff123 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:46.033570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964979f-beb4-4649-9de1-12197d1fd778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:46.034622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964979f-beb4-4649-9de1-12197d1fd778 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:46.034915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964979f-beb4-4649-9de1-12197d1fd778 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:46.035307 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964979f-beb4-4649-9de1-12197d1fd778 admin admin] PATH_INFO: `/v3/projects/a1a29ead62784dc8bc7fce501eb74049/users/ece4ba7dba68499988a30f2c35580cdb/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:46.054085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964979f-beb4-4649-9de1-12197d1fd778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a29ead62784dc8bc7fce501eb74049, user_id=ece4ba7dba68499988a30f2c35580cdb, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:46.056986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964979f-beb4-4649-9de1-12197d1fd778 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:46.071001 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4256/8538] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:27:46 2021] PUT /identity/v3/projects/a1a29ead62784dc8bc7fce501eb74049/users/ece4ba7dba68499988a30f2c35580cdb/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:27:46.075148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67037258-fb9c-4028-823a-916151adf88f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:46.085477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67037258-fb9c-4028-823a-916151adf88f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:46.150482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6054-b36f-4648-a756-b475b7c54ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:46.151855 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6054-b36f-4648-a756-b475b7c54ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:46.152259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6054-b36f-4648-a756-b475b7c54ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:46.152549 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6054-b36f-4648-a756-b475b7c54ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:46.153399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f6054-b36f-4648-a756-b475b7c54ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:46.155479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f6054-b36f-4648-a756-b475b7c54ef1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:46.168008 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4283/8539] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:27:46 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:27:46.172663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964979f-beb4-4649-9de1-12197d1fd778 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:46.183766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964979f-beb4-4649-9de1-12197d1fd778 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:46.188465 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b1108-5129-4785-86df-3acda35d8146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:46.189420 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b1108-5129-4785-86df-3acda35d8146 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:46.189682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b1108-5129-4785-86df-3acda35d8146 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:46.189972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b1108-5129-4785-86df-3acda35d8146 admin admin] PATH_INFO: `/v3/projects/a1a29ead62784dc8bc7fce501eb74049/users/ece4ba7dba68499988a30f2c35580cdb/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:46.192054 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b1108-5129-4785-86df-3acda35d8146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a29ead62784dc8bc7fce501eb74049, user_id=ece4ba7dba68499988a30f2c35580cdb, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:46.194703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b1108-5129-4785-86df-3acda35d8146 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:46.207112 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4257/8540] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:27:46 2021] PUT /identity/v3/projects/a1a29ead62784dc8bc7fce501eb74049/users/ece4ba7dba68499988a30f2c35580cdb/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:27:51.797416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1fd3-72bb-44e2-b116-71544e1d8b84 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:51.798028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1fd3-72bb-44e2-b116-71544e1d8b84 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:51.798028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e1fd3-72bb-44e2-b116-71544e1d8b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:51.829331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-392e1fd3-72bb-44e2-b116-71544e1d8b84 None None] MFA Rules not processed for user `ece4ba7dba68499988a30f2c35580cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:27:51.830667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-392e1fd3-72bb-44e2-b116-71544e1d8b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:51.906470 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4284/8541] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:27:51 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:27:51.919571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b1108-5129-4785-86df-3acda35d8146 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:27:51.921494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-be0b1108-5129-4785-86df-3acda35d8146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:27:51.985325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b1108-5129-4785-86df-3acda35d8146 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:27:51.989027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ad442-23f3-43a1-8035-0e9a1ea21a21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:27:51.989643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ad442-23f3-43a1-8035-0e9a1ea21a21 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:27:51.989927 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ad442-23f3-43a1-8035-0e9a1ea21a21 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:27:51.990207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ad442-23f3-43a1-8035-0e9a1ea21a21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:27:52.063666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ad442-23f3-43a1-8035-0e9a1ea21a21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:27:52.065784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ad442-23f3-43a1-8035-0e9a1ea21a21 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:27:52.076572 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4258/8542] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:27:51 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:28:09.035477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a593-888a-4822-a7a6-e08886f41da7 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:28:09.036029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a593-888a-4822-a7a6-e08886f41da7 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:28:09.036132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9a593-888a-4822-a7a6-e08886f41da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:28:09.054268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e6e9a593-888a-4822-a7a6-e08886f41da7 None None] MFA Rules not processed for user `011c76eca940449f865a90106ed59c41`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:28:09.055518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e6e9a593-888a-4822-a7a6-e08886f41da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:28:09.063029 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4285/8543] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:28:09 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:28:09.792893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ad442-23f3-43a1-8035-0e9a1ea21a21 service glance] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:28:09.794900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-806ad442-23f3-43a1-8035-0e9a1ea21a21 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:28:09.865787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ad442-23f3-43a1-8035-0e9a1ea21a21 service glance] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:28:09.871037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491af89-970a-4c67-9d44-571049fb746e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:28:09.872294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491af89-970a-4c67-9d44-571049fb746e service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:28:09.872592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491af89-970a-4c67-9d44-571049fb746e service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:28:09.872864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491af89-970a-4c67-9d44-571049fb746e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:28:09.874663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d491af89-970a-4c67-9d44-571049fb746e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:28:09.889993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491af89-970a-4c67-9d44-571049fb746e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:28:09.891636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491af89-970a-4c67-9d44-571049fb746e service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:28:09.904629 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4259/8544] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:28:09 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:28:12.154967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9a593-888a-4822-a7a6-e08886f41da7 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:28:12.157920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e6e9a593-888a-4822-a7a6-e08886f41da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:28:12.289060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9a593-888a-4822-a7a6-e08886f41da7 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:28:12.294934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c854c-c993-4cc5-b774-947ad982bce6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:28:12.295873 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c854c-c993-4cc5-b774-947ad982bce6 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:28:12.296156 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c854c-c993-4cc5-b774-947ad982bce6 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:28:12.297115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c854c-c993-4cc5-b774-947ad982bce6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:28:12.299169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-511c854c-c993-4cc5-b774-947ad982bce6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:28:12.317682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c854c-c993-4cc5-b774-947ad982bce6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:28:12.319941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c854c-c993-4cc5-b774-947ad982bce6 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:28:12.336598 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4286/8545] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:28:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:28:19.239868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491af89-970a-4c67-9d44-571049fb746e service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:28:19.241438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d491af89-970a-4c67-9d44-571049fb746e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:28:19.260156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491af89-970a-4c67-9d44-571049fb746e service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:28:19.265997 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ef262-bb00-43d9-8329-bea242078ece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:28:19.266760 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef262-bb00-43d9-8329-bea242078ece service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:28:19.267053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef262-bb00-43d9-8329-bea242078ece service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:28:19.267361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ef262-bb00-43d9-8329-bea242078ece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:28:19.269154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f65ef262-bb00-43d9-8329-bea242078ece service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:28:19.284378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ef262-bb00-43d9-8329-bea242078ece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:28:19.285976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ef262-bb00-43d9-8329-bea242078ece service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:28:19.300986 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4260/8546] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:28:19 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:28:21.648288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c854c-c993-4cc5-b774-947ad982bce6 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:28:21.649694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-511c854c-c993-4cc5-b774-947ad982bce6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:28:21.706558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c854c-c993-4cc5-b774-947ad982bce6 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:28:21.710144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa1417-5cc0-48e7-98e1-819fbb9769a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:28:21.710770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa1417-5cc0-48e7-98e1-819fbb9769a8 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:28:21.711050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa1417-5cc0-48e7-98e1-819fbb9769a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:28:21.711356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa1417-5cc0-48e7-98e1-819fbb9769a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:28:21.720723 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa1417-5cc0-48e7-98e1-819fbb9769a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:28:21.722133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa1417-5cc0-48e7-98e1-819fbb9769a8 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:28:21.731398 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4287/8547] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:28:21 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:28:57.294843 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ef262-bb00-43d9-8329-bea242078ece service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:28:57.310163 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ef262-bb00-43d9-8329-bea242078ece service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:28:57.316429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83accc-e5df-4435-a1f5-0fcd265e5b3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:28:57.317111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83accc-e5df-4435-a1f5-0fcd265e5b3d service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:28:57.317428 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83accc-e5df-4435-a1f5-0fcd265e5b3d service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:28:57.317725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83accc-e5df-4435-a1f5-0fcd265e5b3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:28:57.319582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-aa83accc-e5df-4435-a1f5-0fcd265e5b3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:28:57.348156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83accc-e5df-4435-a1f5-0fcd265e5b3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:28:57.349846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83accc-e5df-4435-a1f5-0fcd265e5b3d service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:28:57.363934 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4261/8548] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:28:57 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:29:16.497332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8ca6c-6991-49cd-8772-ed0f2b34fe6b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:29:16.497889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8ca6c-6991-49cd-8772-ed0f2b34fe6b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:29:16.497889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8ca6c-6991-49cd-8772-ed0f2b34fe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:29:16.515803 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f8e8ca6c-6991-49cd-8772-ed0f2b34fe6b None None] MFA Rules not processed for user `22d0ea2ed19044fa8d47565b0eb443d6`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:29:16.517065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f8e8ca6c-6991-49cd-8772-ed0f2b34fe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:29:16.579463 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4288/8549] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:29:16 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:29:21.436395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83accc-e5df-4435-a1f5-0fcd265e5b3d service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:29:21.510253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83accc-e5df-4435-a1f5-0fcd265e5b3d service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:29:21.515111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:29:21.516562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:29:21.516849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:29:21.517122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] PATH_INFO: `/v3/users/011c76eca940449f865a90106ed59c41` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:29:21.518347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011c76eca940449f865a90106ed59c41)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:29:21.520342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:29:21.567966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011c76eca940449f865a90106ed59c41'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:21.568635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011c76eca940449f865a90106ed59c41'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:21.577127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011c76eca940449f865a90106ed59c41'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:21.578397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011c76eca940449f865a90106ed59c41'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:21.587167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011c76eca940449f865a90106ed59c41'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:21.605939 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4262/8550] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:29:21 2021] DELETE /identity/v3/users/011c76eca940449f865a90106ed59c41 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:29:21.780266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8ca6c-6991-49cd-8772-ed0f2b34fe6b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:29:21.793624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8ca6c-6991-49cd-8772-ed0f2b34fe6b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:29:21.851307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:29:21.852161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:29:21.852444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:29:21.852720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] PATH_INFO: `/v3/projects/34545818a5a9484a943ab6e09bdd800a` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:29:21.853902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34545818a5a9484a943ab6e09bdd800a)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:29:21.855829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:29:21.901051 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34545818a5a9484a943ab6e09bdd800a', 'request_id': 'req-9c0c7813-bb10-4b34-a590-8a058ebd8b58'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:21.908180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34545818a5a9484a943ab6e09bdd800a', 'request_id': 'req-9c0c7813-bb10-4b34-a590-8a058ebd8b58'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:21.914203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34545818a5a9484a943ab6e09bdd800a', 'request_id': 'req-9c0c7813-bb10-4b34-a590-8a058ebd8b58'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:21.924409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] The token cache is being invalidate because project 34545818a5a9484a943ab6e09bdd800a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:29:21.924694 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:21.925342 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:21.926884 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4289/8551] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:29:21 2021] DELETE /identity/v3/projects/34545818a5a9484a943ab6e09bdd800a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:29:21.930900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:29:21.932362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:29:21.946072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8039294-0e7c-43c7-9340-f025068700d6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:29:22.003324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:29:22.004193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:29:22.004475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:29:22.004755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] PATH_INFO: `/v3/users/ece4ba7dba68499988a30f2c35580cdb` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:29:22.005963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece4ba7dba68499988a30f2c35580cdb)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:29:22.007985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:29:22.054718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece4ba7dba68499988a30f2c35580cdb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:22.055583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece4ba7dba68499988a30f2c35580cdb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:22.063035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece4ba7dba68499988a30f2c35580cdb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:22.063706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece4ba7dba68499988a30f2c35580cdb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:22.071772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece4ba7dba68499988a30f2c35580cdb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:22.089016 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4263/8552] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:29:21 2021] DELETE /identity/v3/users/ece4ba7dba68499988a30f2c35580cdb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:29:22.253739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:29:22.255187 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:29:22.268553 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c7813-bb10-4b34-a590-8a058ebd8b58 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:29:22.324022 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:29:22.324877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:29:22.325157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:29:22.325431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] PATH_INFO: `/v3/projects/a1a29ead62784dc8bc7fce501eb74049` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:29:22.326609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a29ead62784dc8bc7fce501eb74049)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:29:22.329194 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:29:22.374777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a29ead62784dc8bc7fce501eb74049', 'request_id': 'req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:22.381622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a29ead62784dc8bc7fce501eb74049', 'request_id': 'req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:22.387809 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a29ead62784dc8bc7fce501eb74049', 'request_id': 'req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:22.398304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] The token cache is being invalidate because project a1a29ead62784dc8bc7fce501eb74049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:29:22.398590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:22.399230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:29:22.400797 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4290/8553] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:29:22 2021] DELETE /identity/v3/projects/a1a29ead62784dc8bc7fce501eb74049 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:30:07.574446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:30:07.575873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:30:07.645748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bab52-72af-4be5-960e-347dcd7814d6 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:30:07.702871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dbbe4-c3ce-4e5b-957f-bc209c687b2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:30:07.703549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dbbe4-c3ce-4e5b-957f-bc209c687b2d service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:30:07.703837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dbbe4-c3ce-4e5b-957f-bc209c687b2d service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:30:07.704701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dbbe4-c3ce-4e5b-957f-bc209c687b2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:30:07.706478 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9b5dbbe4-c3ce-4e5b-957f-bc209c687b2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:30:07.719842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5dbbe4-c3ce-4e5b-957f-bc209c687b2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:30:07.721423 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5dbbe4-c3ce-4e5b-957f-bc209c687b2d service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:30:07.733545 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4264/8554] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:30:07 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:31:11.459638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:31:11.461026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:31:11.534418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38b4ad-71b5-4ae0-9cd2-255b7b0625a9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:31:11.538100 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69246938-f2ac-40ff-a4b9-3e909d2fbfdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:31:11.538739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69246938-f2ac-40ff-a4b9-3e909d2fbfdf service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:31:11.539018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69246938-f2ac-40ff-a4b9-3e909d2fbfdf service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:31:11.539317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69246938-f2ac-40ff-a4b9-3e909d2fbfdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:31:11.541072 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-69246938-f2ac-40ff-a4b9-3e909d2fbfdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:31:11.600092 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69246938-f2ac-40ff-a4b9-3e909d2fbfdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:31:11.601538 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69246938-f2ac-40ff-a4b9-3e909d2fbfdf service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:31:11.610335 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4291/8555] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:31:11 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:31:14.219100 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527ad1-3065-4f4f-8cea-d36f5c583cca None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:31:14.219673 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527ad1-3065-4f4f-8cea-d36f5c583cca None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:31:14.219792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527ad1-3065-4f4f-8cea-d36f5c583cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:31:14.239942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c6527ad1-3065-4f4f-8cea-d36f5c583cca None None] MFA Rules not processed for user `22d0ea2ed19044fa8d47565b0eb443d6`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:31:14.241134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c6527ad1-3065-4f4f-8cea-d36f5c583cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:31:14.248306 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4265/8556] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:31:14 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:31:14.283185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69246938-f2ac-40ff-a4b9-3e909d2fbfdf service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:31:14.295142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69246938-f2ac-40ff-a4b9-3e909d2fbfdf service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:31:14.298793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac79f4-cff0-4cf4-8e47-761362cf123d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198c9372013440ec942a0192a73a231d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:31:14.299480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac79f4-cff0-4cf4-8e47-761362cf123d service cinder] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:31:14.299789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac79f4-cff0-4cf4-8e47-761362cf123d service cinder] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:31:14.300086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac79f4-cff0-4cf4-8e47-761362cf123d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:31:14.302089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3bac79f4-cff0-4cf4-8e47-761362cf123d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:31:14.372460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac79f4-cff0-4cf4-8e47-761362cf123d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:31:14.374155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac79f4-cff0-4cf4-8e47-761362cf123d service cinder] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:31:14.397034 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4292/8557] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:31:14 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:31:14.857860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6527ad1-3065-4f4f-8cea-d36f5c583cca None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:31:14.859270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c6527ad1-3065-4f4f-8cea-d36f5c583cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:31:14.927203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6527ad1-3065-4f4f-8cea-d36f5c583cca None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:31:14.931397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa205e-4ae8-41a5-80dd-f2251512cb15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:31:14.932034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa205e-4ae8-41a5-80dd-f2251512cb15 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:31:14.932329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa205e-4ae8-41a5-80dd-f2251512cb15 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:31:14.932592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa205e-4ae8-41a5-80dd-f2251512cb15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:31:14.934347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f2aa205e-4ae8-41a5-80dd-f2251512cb15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:31:14.946102 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa205e-4ae8-41a5-80dd-f2251512cb15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:31:14.947566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa205e-4ae8-41a5-80dd-f2251512cb15 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:31:14.957787 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4266/8558] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:31:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:31:15.408778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac79f4-cff0-4cf4-8e47-761362cf123d service cinder] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:31:15.410253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3bac79f4-cff0-4cf4-8e47-761362cf123d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:31:15.425392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac79f4-cff0-4cf4-8e47-761362cf123d service cinder] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:31:15.429133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb163d-e691-42c9-a1be-833b24c767c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:31:15.429705 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb163d-e691-42c9-a1be-833b24c767c7 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:31:15.429988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb163d-e691-42c9-a1be-833b24c767c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:31:15.430261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb163d-e691-42c9-a1be-833b24c767c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:31:15.432162 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f6bb163d-e691-42c9-a1be-833b24c767c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:31:15.450140 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb163d-e691-42c9-a1be-833b24c767c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:31:15.451644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb163d-e691-42c9-a1be-833b24c767c7 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:31:15.466414 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4293/8559] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:31:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:31:54.004119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa205e-4ae8-41a5-80dd-f2251512cb15 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:31:54.016494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa205e-4ae8-41a5-80dd-f2251512cb15 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:31:54.020820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488f10c-fd07-48ec-919f-cb1b83403dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:31:54.021477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488f10c-fd07-48ec-919f-cb1b83403dda service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:31:54.021758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488f10c-fd07-48ec-919f-cb1b83403dda service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:31:54.022027 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488f10c-fd07-48ec-919f-cb1b83403dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:31:54.023788 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3488f10c-fd07-48ec-919f-cb1b83403dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:31:54.036844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488f10c-fd07-48ec-919f-cb1b83403dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:31:54.038325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488f10c-fd07-48ec-919f-cb1b83403dda service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:31:54.049445 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4267/8560] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:31:54 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:32:10.280738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb163d-e691-42c9-a1be-833b24c767c7 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:32:10.291826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb163d-e691-42c9-a1be-833b24c767c7 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:32:10.295482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcbd88-cae9-493c-b101-658b8ed982a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:32:10.296116 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcbd88-cae9-493c-b101-658b8ed982a7 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:32:10.296406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcbd88-cae9-493c-b101-658b8ed982a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:32:10.296749 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcbd88-cae9-493c-b101-658b8ed982a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:32:10.298563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-81fcbd88-cae9-493c-b101-658b8ed982a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:32:10.310268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcbd88-cae9-493c-b101-658b8ed982a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:32:10.311780 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcbd88-cae9-493c-b101-658b8ed982a7 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:32:10.322415 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4294/8561] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:32:10 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:33:20.776703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488f10c-fd07-48ec-919f-cb1b83403dda service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:33:20.778246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3488f10c-fd07-48ec-919f-cb1b83403dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:33:20.797025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488f10c-fd07-48ec-919f-cb1b83403dda service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:33:20.805298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4d42-cb7a-4e19-83c6-24d469058fcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:33:20.805955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4d42-cb7a-4e19-83c6-24d469058fcb service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:33:20.806237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4d42-cb7a-4e19-83c6-24d469058fcb service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:33:20.806511 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4d42-cb7a-4e19-83c6-24d469058fcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:33:20.808384 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-baee4d42-cb7a-4e19-83c6-24d469058fcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:33:20.823738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee4d42-cb7a-4e19-83c6-24d469058fcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:33:20.825322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee4d42-cb7a-4e19-83c6-24d469058fcb service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:33:20.840010 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4268/8562] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:33:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:33:58.342684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcbd88-cae9-493c-b101-658b8ed982a7 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:33:58.344113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-81fcbd88-cae9-493c-b101-658b8ed982a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:33:58.371638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcbd88-cae9-493c-b101-658b8ed982a7 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:33:58.376975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9e3a2-604d-4a72-8e2a-3c5010cdf2a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:33:58.377608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9e3a2-604d-4a72-8e2a-3c5010cdf2a9 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:33:58.377887 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9e3a2-604d-4a72-8e2a-3c5010cdf2a9 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:33:58.378159 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9e3a2-604d-4a72-8e2a-3c5010cdf2a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:33:58.379884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-eff9e3a2-604d-4a72-8e2a-3c5010cdf2a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:33:58.393423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9e3a2-604d-4a72-8e2a-3c5010cdf2a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:33:58.394924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9e3a2-604d-4a72-8e2a-3c5010cdf2a9 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:33:58.407051 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4295/8563] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:33:58 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:34:04.740970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907259-8388-41b8-9743-4df37fdae4bc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:04.741482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907259-8388-41b8-9743-4df37fdae4bc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:04.741593 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907259-8388-41b8-9743-4df37fdae4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:04.790015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-84907259-8388-41b8-9743-4df37fdae4bc None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:04.791213 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-84907259-8388-41b8-9743-4df37fdae4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:04.797777 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4269/8564] 10.222.0.21 () {58 vars in 1061 bytes} [Sat Nov 27 21:34:04 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:34:04.804445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9e3a2-604d-4a72-8e2a-3c5010cdf2a9 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:04.814040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9e3a2-604d-4a72-8e2a-3c5010cdf2a9 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:04.817661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350a0f0-d2c1-41cb-96ec-746ad1502cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:04.818296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350a0f0-d2c1-41cb-96ec-746ad1502cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:04.818582 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350a0f0-d2c1-41cb-96ec-746ad1502cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:04.818861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350a0f0-d2c1-41cb-96ec-746ad1502cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:04.821248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7350a0f0-d2c1-41cb-96ec-746ad1502cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:04.882015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350a0f0-d2c1-41cb-96ec-746ad1502cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:04.883484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350a0f0-d2c1-41cb-96ec-746ad1502cc5 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:04.902106 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4296/8565] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:34:11.310597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84907259-8388-41b8-9743-4df37fdae4bc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:11.312208 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-84907259-8388-41b8-9743-4df37fdae4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:11.327374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84907259-8388-41b8-9743-4df37fdae4bc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:11.332002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:11.332873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:11.333157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:11.333435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] PATH_INFO: `/v3/users/22d0ea2ed19044fa8d47565b0eb443d6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:11.334661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d0ea2ed19044fa8d47565b0eb443d6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:11.337238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:11.385848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d0ea2ed19044fa8d47565b0eb443d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.386523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d0ea2ed19044fa8d47565b0eb443d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.392863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d0ea2ed19044fa8d47565b0eb443d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.393587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d0ea2ed19044fa8d47565b0eb443d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.401155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d0ea2ed19044fa8d47565b0eb443d6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.418502 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4270/8566] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:34:11 2021] DELETE /identity/v3/users/22d0ea2ed19044fa8d47565b0eb443d6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:34:11.595032 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350a0f0-d2c1-41cb-96ec-746ad1502cc5 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:11.606516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350a0f0-d2c1-41cb-96ec-746ad1502cc5 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:11.661263 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:11.662110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:11.662392 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:11.662667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] PATH_INFO: `/v3/projects/75d471b7fbc14bbcbf3dbb7f1acbddcb` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:11.663928 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d471b7fbc14bbcbf3dbb7f1acbddcb)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:11.665813 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:11.710232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'request_id': 'req-0682efdc-67e2-460a-b907-a60251e5ee49'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.716995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'request_id': 'req-0682efdc-67e2-460a-b907-a60251e5ee49'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.722934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d471b7fbc14bbcbf3dbb7f1acbddcb', 'request_id': 'req-0682efdc-67e2-460a-b907-a60251e5ee49'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.732932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] The token cache is being invalidate because project 75d471b7fbc14bbcbf3dbb7f1acbddcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:34:11.733219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.733846 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.735442 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4297/8567] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:34:11 2021] DELETE /identity/v3/projects/75d471b7fbc14bbcbf3dbb7f1acbddcb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:34:11.739505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:11.740900 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:11.754637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1e5b-458c-487b-8a43-7533a0365782 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:11.810253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a71d24-1684-4f74-ad52-766bbf1c927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:11.811035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71d24-1684-4f74-ad52-766bbf1c927c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:11.811351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71d24-1684-4f74-ad52-766bbf1c927c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:11.811631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71d24-1684-4f74-ad52-766bbf1c927c admin admin] PATH_INFO: `/v3/users/84059cdb35fe41a4be2e2bf6f64d3812` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:11.812840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a71d24-1684-4f74-ad52-766bbf1c927c admin admin] RBAC: Authorizing `identity:delete_user(user_id=84059cdb35fe41a4be2e2bf6f64d3812)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:11.814764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a71d24-1684-4f74-ad52-766bbf1c927c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:11.860877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-64a71d24-1684-4f74-ad52-766bbf1c927c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84059cdb35fe41a4be2e2bf6f64d3812'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.861524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-64a71d24-1684-4f74-ad52-766bbf1c927c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84059cdb35fe41a4be2e2bf6f64d3812'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.868528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-64a71d24-1684-4f74-ad52-766bbf1c927c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84059cdb35fe41a4be2e2bf6f64d3812'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.869176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-64a71d24-1684-4f74-ad52-766bbf1c927c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84059cdb35fe41a4be2e2bf6f64d3812'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.876332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-64a71d24-1684-4f74-ad52-766bbf1c927c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84059cdb35fe41a4be2e2bf6f64d3812'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:11.893519 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4271/8568] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:34:11 2021] DELETE /identity/v3/users/84059cdb35fe41a4be2e2bf6f64d3812 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:34:12.063981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:12.065411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:12.079083 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682efdc-67e2-460a-b907-a60251e5ee49 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:12.135216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:12.136105 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:12.136389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:12.136661 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] PATH_INFO: `/v3/projects/75285b09603b45a3b97073daffc753f6` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:12.137858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75285b09603b45a3b97073daffc753f6)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:12.139833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:12.186193 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75285b09603b45a3b97073daffc753f6', 'request_id': 'req-459e2e56-59a3-4f14-863d-48a8943d2b22'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:12.193036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75285b09603b45a3b97073daffc753f6', 'request_id': 'req-459e2e56-59a3-4f14-863d-48a8943d2b22'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:12.199695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75285b09603b45a3b97073daffc753f6', 'request_id': 'req-459e2e56-59a3-4f14-863d-48a8943d2b22'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:12.209696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] The token cache is being invalidate because project 75285b09603b45a3b97073daffc753f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:34:12.209980 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:12.210613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-459e2e56-59a3-4f14-863d-48a8943d2b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:12.212195 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4298/8569] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:34:12 2021] DELETE /identity/v3/projects/75285b09603b45a3b97073daffc753f6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:34:21.693152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6300a6d-de15-44f4-bfea-933f6eb009bb None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:21.693698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6300a6d-de15-44f4-bfea-933f6eb009bb None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:21.693698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6300a6d-de15-44f4-bfea-933f6eb009bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:21.712286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f6300a6d-de15-44f4-bfea-933f6eb009bb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:21.713411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f6300a6d-de15-44f4-bfea-933f6eb009bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:21.770191 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4272/8570] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:34:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:21.779529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a956ce3-d82c-44be-94f5-c8c062e99f3d None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:21.779999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a956ce3-d82c-44be-94f5-c8c062e99f3d None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:21.780097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a956ce3-d82c-44be-94f5-c8c062e99f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:21.797882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7a956ce3-d82c-44be-94f5-c8c062e99f3d None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:21.799080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7a956ce3-d82c-44be-94f5-c8c062e99f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:21.806976 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4299/8571] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:34:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:21.811644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6300a6d-de15-44f4-bfea-933f6eb009bb None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:21.821834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6300a6d-de15-44f4-bfea-933f6eb009bb None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:21.826425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fb55e-8a7a-46bd-96be-47607daa32c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:21.827065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fb55e-8a7a-46bd-96be-47607daa32c0 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:21.827381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fb55e-8a7a-46bd-96be-47607daa32c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:21.828398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fb55e-8a7a-46bd-96be-47607daa32c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:21.829893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fb55e-8a7a-46bd-96be-47607daa32c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:34:21.830483 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fb55e-8a7a-46bd-96be-47607daa32c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:21.838683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fb55e-8a7a-46bd-96be-47607daa32c0 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:21.850503 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4273/8572] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:34:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:34:21.872826 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a956ce3-d82c-44be-94f5-c8c062e99f3d None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:21.882949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a956ce3-d82c-44be-94f5-c8c062e99f3d None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:21.887668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d378f-8d58-4410-8593-a919b8abb813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:21.888308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d378f-8d58-4410-8593-a919b8abb813 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:21.888589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d378f-8d58-4410-8593-a919b8abb813 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:21.888860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d378f-8d58-4410-8593-a919b8abb813 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:21.889556 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d378f-8d58-4410-8593-a919b8abb813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:21.891450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d378f-8d58-4410-8593-a919b8abb813 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:21.930553 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4300/8573] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:34:21 2021] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:34:21.931701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fb55e-8a7a-46bd-96be-47607daa32c0 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:21.941532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fb55e-8a7a-46bd-96be-47607daa32c0 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:21.996520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b33bb-82b4-4e85-8092-d77068cae23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:21.997090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b33bb-82b4-4e85-8092-d77068cae23c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:21.997376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b33bb-82b4-4e85-8092-d77068cae23c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:21.997651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b33bb-82b4-4e85-8092-d77068cae23c admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:21.998367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b33bb-82b4-4e85-8092-d77068cae23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:22.000331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b33bb-82b4-4e85-8092-d77068cae23c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:22.023868 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4274/8574] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:34:21 2021] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:34:22.024992 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d378f-8d58-4410-8593-a919b8abb813 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:22.034976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d378f-8d58-4410-8593-a919b8abb813 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:22.039834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cd5a-a3a8-4ece-a278-b79bb63caff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:22.040522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cd5a-a3a8-4ece-a278-b79bb63caff1 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.040802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cd5a-a3a8-4ece-a278-b79bb63caff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.041073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cd5a-a3a8-4ece-a278-b79bb63caff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.041796 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55cd5a-a3a8-4ece-a278-b79bb63caff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:22.043405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55cd5a-a3a8-4ece-a278-b79bb63caff1 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:22.053253 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4301/8575] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:34:22 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:34:22.057868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b33bb-82b4-4e85-8092-d77068cae23c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:22.067586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b33bb-82b4-4e85-8092-d77068cae23c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:22.072765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a294834-5474-4923-a7b2-8dddd07fbebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:22.073408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294834-5474-4923-a7b2-8dddd07fbebe admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.073690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294834-5474-4923-a7b2-8dddd07fbebe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.073963 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a294834-5474-4923-a7b2-8dddd07fbebe admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.074685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a294834-5474-4923-a7b2-8dddd07fbebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:22.076568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a294834-5474-4923-a7b2-8dddd07fbebe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:22.086689 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4275/8576] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:34:22 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:34:22.090677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cd5a-a3a8-4ece-a278-b79bb63caff1 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:22.100326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cd5a-a3a8-4ece-a278-b79bb63caff1 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:22.105316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d97af-4100-48bf-8ef4-28c0ce9f7572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:22.106234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d97af-4100-48bf-8ef4-28c0ce9f7572 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.106512 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d97af-4100-48bf-8ef4-28c0ce9f7572 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.106781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d97af-4100-48bf-8ef4-28c0ce9f7572 admin admin] PATH_INFO: `/v3/projects/7ae3208eb9084263841957ed1fabbfe6/users/2f82c3c3f75d4c0189c3b3dcd56b16cd/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.121420 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d97af-4100-48bf-8ef4-28c0ce9f7572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae3208eb9084263841957ed1fabbfe6, user_id=2f82c3c3f75d4c0189c3b3dcd56b16cd, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:22.124110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d97af-4100-48bf-8ef4-28c0ce9f7572 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:22.137482 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4302/8577] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:34:22 2021] PUT /identity/v3/projects/7ae3208eb9084263841957ed1fabbfe6/users/2f82c3c3f75d4c0189c3b3dcd56b16cd/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:34:22.150479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95927-5b19-44df-8fc8-ec35de3b4383 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.150791 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95927-5b19-44df-8fc8-ec35de3b4383 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.151065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95927-5b19-44df-8fc8-ec35de3b4383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.176498 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-06a95927-5b19-44df-8fc8-ec35de3b4383 None None] MFA Rules not processed for user `2f82c3c3f75d4c0189c3b3dcd56b16cd`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:22.177712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-06a95927-5b19-44df-8fc8-ec35de3b4383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:22.239873 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4276/8578] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:34:22 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:22.245190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d97af-4100-48bf-8ef4-28c0ce9f7572 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:22.306369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d97af-4100-48bf-8ef4-28c0ce9f7572 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:22.311070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc17d08-b8ea-409d-ab21-7abf5501fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:22.311757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc17d08-b8ea-409d-ab21-7abf5501fb79 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.312045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc17d08-b8ea-409d-ab21-7abf5501fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.312324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc17d08-b8ea-409d-ab21-7abf5501fb79 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.313017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc17d08-b8ea-409d-ab21-7abf5501fb79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:22.314894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc17d08-b8ea-409d-ab21-7abf5501fb79 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:22.339465 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4303/8579] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:34:22 2021] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:34:22.343643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a95927-5b19-44df-8fc8-ec35de3b4383 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:22.354589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a95927-5b19-44df-8fc8-ec35de3b4383 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:22.409338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f52632-129c-4b9b-ae39-a450d6993a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:22.410009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f52632-129c-4b9b-ae39-a450d6993a45 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.410293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f52632-129c-4b9b-ae39-a450d6993a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.410572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f52632-129c-4b9b-ae39-a450d6993a45 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.411374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f52632-129c-4b9b-ae39-a450d6993a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:22.413306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f52632-129c-4b9b-ae39-a450d6993a45 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:22.438622 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4277/8580] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:34:22 2021] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:34:22.439862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc17d08-b8ea-409d-ab21-7abf5501fb79 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:22.450225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc17d08-b8ea-409d-ab21-7abf5501fb79 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:22.454842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae2178-26cf-47f3-8dd5-160c8c7402df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:22.455554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae2178-26cf-47f3-8dd5-160c8c7402df admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.455836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae2178-26cf-47f3-8dd5-160c8c7402df admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.456112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae2178-26cf-47f3-8dd5-160c8c7402df admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.456837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae2178-26cf-47f3-8dd5-160c8c7402df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:22.458418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae2178-26cf-47f3-8dd5-160c8c7402df admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:22.468667 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4304/8581] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:34:22 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:34:22.472728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f52632-129c-4b9b-ae39-a450d6993a45 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:22.483514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f52632-129c-4b9b-ae39-a450d6993a45 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:22.488212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c4648-2597-457b-a6f9-a0d4266876ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:22.489082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4648-2597-457b-a6f9-a0d4266876ed admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.489417 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4648-2597-457b-a6f9-a0d4266876ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.489752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c4648-2597-457b-a6f9-a0d4266876ed admin admin] PATH_INFO: `/v3/projects/5b6c9423d7454ff9b193a0254711d916/users/9a217cb37c5c4080bbbe98d4d866e430/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.506485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c4648-2597-457b-a6f9-a0d4266876ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6c9423d7454ff9b193a0254711d916, user_id=9a217cb37c5c4080bbbe98d4d866e430, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:22.509178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c4648-2597-457b-a6f9-a0d4266876ed admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:22.521082 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4278/8582] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:34:22 2021] PUT /identity/v3/projects/5b6c9423d7454ff9b193a0254711d916/users/9a217cb37c5c4080bbbe98d4d866e430/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:34:22.525079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae2178-26cf-47f3-8dd5-160c8c7402df admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:22.535097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae2178-26cf-47f3-8dd5-160c8c7402df admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:22.588864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b10b1-d415-440b-8157-1718daf80e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:22.589454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b10b1-d415-440b-8157-1718daf80e23 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.589741 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b10b1-d415-440b-8157-1718daf80e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.590018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b10b1-d415-440b-8157-1718daf80e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.590745 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b10b1-d415-440b-8157-1718daf80e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:22.592504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b10b1-d415-440b-8157-1718daf80e23 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:22.602336 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4305/8583] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:34:22 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:34:22.606380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c4648-2597-457b-a6f9-a0d4266876ed admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:22.616469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c4648-2597-457b-a6f9-a0d4266876ed admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:22.621717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e3b02-6985-4b00-9cea-3b97089c4e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:22.622587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e3b02-6985-4b00-9cea-3b97089c4e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.622894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e3b02-6985-4b00-9cea-3b97089c4e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.623172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e3b02-6985-4b00-9cea-3b97089c4e3f admin admin] PATH_INFO: `/v3/projects/5b6c9423d7454ff9b193a0254711d916/users/9a217cb37c5c4080bbbe98d4d866e430/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.625260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e3b02-6985-4b00-9cea-3b97089c4e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6c9423d7454ff9b193a0254711d916, user_id=9a217cb37c5c4080bbbe98d4d866e430, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:22.628211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e3b02-6985-4b00-9cea-3b97089c4e3f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:22.638519 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4279/8584] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:34:22 2021] PUT /identity/v3/projects/5b6c9423d7454ff9b193a0254711d916/users/9a217cb37c5c4080bbbe98d4d866e430/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:34:22.648532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e639e2-210a-4f70-ad3a-3f4dcb265f54 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.648818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e639e2-210a-4f70-ad3a-3f4dcb265f54 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.649123 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e639e2-210a-4f70-ad3a-3f4dcb265f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.675235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-43e639e2-210a-4f70-ad3a-3f4dcb265f54 None None] MFA Rules not processed for user `9a217cb37c5c4080bbbe98d4d866e430`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:22.676496 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-43e639e2-210a-4f70-ad3a-3f4dcb265f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:22.743069 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4306/8585] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:34:22 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:34:22.793272 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ec839-05eb-4f77-bbe7-bc6ab537243b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.793870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ec839-05eb-4f77-bbe7-bc6ab537243b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.793870 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ec839-05eb-4f77-bbe7-bc6ab537243b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.812710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d48ec839-05eb-4f77-bbe7-bc6ab537243b None None] MFA Rules not processed for user `2f82c3c3f75d4c0189c3b3dcd56b16cd`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:22.813898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d48ec839-05eb-4f77-bbe7-bc6ab537243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:22.868205 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4280/8586] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:34:22 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:22.880412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e639e2-210a-4f70-ad3a-3f4dcb265f54 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:22.881870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-43e639e2-210a-4f70-ad3a-3f4dcb265f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:22.954243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e639e2-210a-4f70-ad3a-3f4dcb265f54 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:22.959779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4313c-d21c-403d-a91a-8339ffb71b50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:22.960419 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4313c-d21c-403d-a91a-8339ffb71b50 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:22.961253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4313c-d21c-403d-a91a-8339ffb71b50 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:22.961531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4313c-d21c-403d-a91a-8339ffb71b50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:22.969066 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4313c-d21c-403d-a91a-8339ffb71b50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:22.970636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4313c-d21c-403d-a91a-8339ffb71b50 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:22.979993 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4307/8587] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:22 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:34:23.431218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ec839-05eb-4f77-bbe7-bc6ab537243b None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:23.432611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d48ec839-05eb-4f77-bbe7-bc6ab537243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:23.505631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ec839-05eb-4f77-bbe7-bc6ab537243b None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:23.511560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6f595-126c-4f48-aa8d-83e99ea1637a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:23.512203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6f595-126c-4f48-aa8d-83e99ea1637a service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:23.512490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6f595-126c-4f48-aa8d-83e99ea1637a service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:23.512770 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6f595-126c-4f48-aa8d-83e99ea1637a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:23.514536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-efa6f595-126c-4f48-aa8d-83e99ea1637a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:23.529682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6f595-126c-4f48-aa8d-83e99ea1637a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:23.531630 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6f595-126c-4f48-aa8d-83e99ea1637a service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:23.544932 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4281/8588] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:23 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:34:31.033359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4313c-d21c-403d-a91a-8339ffb71b50 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:31.035278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-11f4313c-d21c-403d-a91a-8339ffb71b50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:31.060356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4313c-d21c-403d-a91a-8339ffb71b50 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:31.066939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f165777-382f-4ffc-8b53-cf7e132f8079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:31.067619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f165777-382f-4ffc-8b53-cf7e132f8079 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:31.067906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f165777-382f-4ffc-8b53-cf7e132f8079 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:31.068185 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f165777-382f-4ffc-8b53-cf7e132f8079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:31.070586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-3f165777-382f-4ffc-8b53-cf7e132f8079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:31.085671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f165777-382f-4ffc-8b53-cf7e132f8079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:31.087321 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f165777-382f-4ffc-8b53-cf7e132f8079 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:31.103246 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4308/8589] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:31 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:34:32.962408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6f595-126c-4f48-aa8d-83e99ea1637a service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:32.977679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6f595-126c-4f48-aa8d-83e99ea1637a service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:32.983136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a5b11-d11e-41bf-b667-e4bdd2601414 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:32.983828 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5b11-d11e-41bf-b667-e4bdd2601414 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:32.984113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5b11-d11e-41bf-b667-e4bdd2601414 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:32.984388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a5b11-d11e-41bf-b667-e4bdd2601414 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:32.993302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a5b11-d11e-41bf-b667-e4bdd2601414 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:32.994881 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a5b11-d11e-41bf-b667-e4bdd2601414 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:33.004484 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4282/8590] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:32 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:34:33.018573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acb47d-c246-4045-8641-591c756ecea0 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:33.018998 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acb47d-c246-4045-8641-591c756ecea0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:33.019114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acb47d-c246-4045-8641-591c756ecea0 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:33.020894 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4309/8591] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 21:34:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:34:33.025526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a5b11-d11e-41bf-b667-e4bdd2601414 service nova] Authenticating service token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 21:34:33.039455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a5b11-d11e-41bf-b667-e4bdd2601414 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:33.047739 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a5b11-d11e-41bf-b667-e4bdd2601414 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:33.052342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21883f89-e5d6-428d-b89e-b2e046dd1fc7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a217cb37c5c4080bbbe98d4d866e430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6c9423d7454ff9b193a0254711d916', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:33.053173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21883f89-e5d6-428d-b89e-b2e046dd1fc7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:33.053458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21883f89-e5d6-428d-b89e-b2e046dd1fc7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:33.053736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21883f89-e5d6-428d-b89e-b2e046dd1fc7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] PATH_INFO: `/v3/projects/5b6c9423d7454ff9b193a0254711d916` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:33.055737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21883f89-e5d6-428d-b89e-b2e046dd1fc7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b6c9423d7454ff9b193a0254711d916)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:33.057513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21883f89-e5d6-428d-b89e-b2e046dd1fc7 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:33.059185 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4283/8592] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 21:34:33 2021] GET /identity/v3/projects/5b6c9423d7454ff9b193a0254711d916 => generated 391 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:34:33.202653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acb47d-c246-4045-8641-591c756ecea0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:33.204540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d3acb47d-c246-4045-8641-591c756ecea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:33.261356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acb47d-c246-4045-8641-591c756ecea0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:33.264861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19d77b-dcc7-4b41-a800-c4f2ec292c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:33.265504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19d77b-dcc7-4b41-a800-c4f2ec292c6e service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:33.265785 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19d77b-dcc7-4b41-a800-c4f2ec292c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:33.266085 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19d77b-dcc7-4b41-a800-c4f2ec292c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:33.267844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4b19d77b-dcc7-4b41-a800-c4f2ec292c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:33.279866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19d77b-dcc7-4b41-a800-c4f2ec292c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:33.281275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19d77b-dcc7-4b41-a800-c4f2ec292c6e service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:33.292157 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4310/8593] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:33 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:34:33.429401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ff507-3334-41eb-80e1-67bd2a4a3985 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:33.429684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ff507-3334-41eb-80e1-67bd2a4a3985 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:33.429959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ff507-3334-41eb-80e1-67bd2a4a3985 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:33.431778 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4284/8594] 10.222.0.21 () {54 vars in 912 bytes} [Sat Nov 27 21:34:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:34:33.436958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19d77b-dcc7-4b41-a800-c4f2ec292c6e service neutron] Authenticating service token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 27 21:34:33.452961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19d77b-dcc7-4b41-a800-c4f2ec292c6e service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:33.462885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19d77b-dcc7-4b41-a800-c4f2ec292c6e service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:33.467532 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad1e17-473f-4153-94cd-6ee0133d8e64 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a217cb37c5c4080bbbe98d4d866e430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b6c9423d7454ff9b193a0254711d916', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:33.468385 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad1e17-473f-4153-94cd-6ee0133d8e64 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:33.468672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad1e17-473f-4153-94cd-6ee0133d8e64 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:33.468954 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad1e17-473f-4153-94cd-6ee0133d8e64 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] PATH_INFO: `/v3/projects/5b6c9423d7454ff9b193a0254711d916` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:33.470153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad1e17-473f-4153-94cd-6ee0133d8e64 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b6c9423d7454ff9b193a0254711d916)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:33.471976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad1e17-473f-4153-94cd-6ee0133d8e64 tempest-ServersAdminNegativeTestJSON-299556135 tempest-ServersAdminNegativeTestJSON-299556135-project-admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:33.473646 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4311/8595] 10.222.0.21 () {58 vars in 1443 bytes} [Sat Nov 27 21:34:33 2021] GET /identity/v3/projects/5b6c9423d7454ff9b193a0254711d916 => generated 391 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:34:36.222906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ff507-3334-41eb-80e1-67bd2a4a3985 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:36.285575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ff507-3334-41eb-80e1-67bd2a4a3985 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:36.290080 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e891363-96f8-4eff-80a1-3d0ca370298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:36.290939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891363-96f8-4eff-80a1-3d0ca370298a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:36.291222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891363-96f8-4eff-80a1-3d0ca370298a admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:36.291526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e891363-96f8-4eff-80a1-3d0ca370298a admin admin] PATH_INFO: `/v3/users/2f82c3c3f75d4c0189c3b3dcd56b16cd` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:36.292742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891363-96f8-4eff-80a1-3d0ca370298a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f82c3c3f75d4c0189c3b3dcd56b16cd)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:36.294663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e891363-96f8-4eff-80a1-3d0ca370298a admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:36.337726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e891363-96f8-4eff-80a1-3d0ca370298a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f82c3c3f75d4c0189c3b3dcd56b16cd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.338312 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e891363-96f8-4eff-80a1-3d0ca370298a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f82c3c3f75d4c0189c3b3dcd56b16cd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.344458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e891363-96f8-4eff-80a1-3d0ca370298a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f82c3c3f75d4c0189c3b3dcd56b16cd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.345099 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e891363-96f8-4eff-80a1-3d0ca370298a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f82c3c3f75d4c0189c3b3dcd56b16cd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.351700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5e891363-96f8-4eff-80a1-3d0ca370298a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f82c3c3f75d4c0189c3b3dcd56b16cd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.370492 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4285/8596] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:34:36 2021] DELETE /identity/v3/users/2f82c3c3f75d4c0189c3b3dcd56b16cd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:34:36.375077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725d6f-a7f9-45cc-9a9b-a277bdc987f8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:36.375588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725d6f-a7f9-45cc-9a9b-a277bdc987f8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:36.375707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725d6f-a7f9-45cc-9a9b-a277bdc987f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:36.393844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-23725d6f-a7f9-45cc-9a9b-a277bdc987f8 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:36.395078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-23725d6f-a7f9-45cc-9a9b-a277bdc987f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:36.459136 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4312/8597] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:34:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:36.468596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9f5c6-ea0b-4694-9740-07d20d69dc21 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:36.468885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9f5c6-ea0b-4694-9740-07d20d69dc21 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:36.469157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9f5c6-ea0b-4694-9740-07d20d69dc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:36.486847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2ee9f5c6-ea0b-4694-9740-07d20d69dc21 None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:36.488106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2ee9f5c6-ea0b-4694-9740-07d20d69dc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:36.540587 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4286/8598] 10.222.0.21 () {58 vars in 1061 bytes} [Sat Nov 27 21:34:36 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:36.546606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23725d6f-a7f9-45cc-9a9b-a277bdc987f8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:36.556525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23725d6f-a7f9-45cc-9a9b-a277bdc987f8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:36.560152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc257b-3f6f-45bd-aa0e-58cc11a8f33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:36.560782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc257b-3f6f-45bd-aa0e-58cc11a8f33b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:36.561059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc257b-3f6f-45bd-aa0e-58cc11a8f33b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:36.561334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc257b-3f6f-45bd-aa0e-58cc11a8f33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:36.570238 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc257b-3f6f-45bd-aa0e-58cc11a8f33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:36.571821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc257b-3f6f-45bd-aa0e-58cc11a8f33b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:36.581321 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4313/8599] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:34:36.746561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9f5c6-ea0b-4694-9740-07d20d69dc21 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:36.748091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2ee9f5c6-ea0b-4694-9740-07d20d69dc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:36.764847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9f5c6-ea0b-4694-9740-07d20d69dc21 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:36.769468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:36.770349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:36.770743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:36.770895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] PATH_INFO: `/v3/projects/7ae3208eb9084263841957ed1fabbfe6` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:36.772255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae3208eb9084263841957ed1fabbfe6)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:36.774094 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:36.819733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae3208eb9084263841957ed1fabbfe6', 'request_id': 'req-ed1e3206-290b-42e9-8477-e2cb233a3266'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.825769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae3208eb9084263841957ed1fabbfe6', 'request_id': 'req-ed1e3206-290b-42e9-8477-e2cb233a3266'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.834164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae3208eb9084263841957ed1fabbfe6', 'request_id': 'req-ed1e3206-290b-42e9-8477-e2cb233a3266'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.844319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] The token cache is being invalidate because project 7ae3208eb9084263841957ed1fabbfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:34:36.844604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.845230 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.846833 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4287/8600] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:34:36 2021] DELETE /identity/v3/projects/7ae3208eb9084263841957ed1fabbfe6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:34:36.850814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc257b-3f6f-45bd-aa0e-58cc11a8f33b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:36.860897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc257b-3f6f-45bd-aa0e-58cc11a8f33b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:36.915839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9caa2-57df-4f15-9e5e-4901c0a66046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:36.916620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9caa2-57df-4f15-9e5e-4901c0a66046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:36.916898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9caa2-57df-4f15-9e5e-4901c0a66046 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:36.917168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9caa2-57df-4f15-9e5e-4901c0a66046 admin admin] PATH_INFO: `/v3/users/9a217cb37c5c4080bbbe98d4d866e430` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:36.918346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9caa2-57df-4f15-9e5e-4901c0a66046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a217cb37c5c4080bbbe98d4d866e430)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:36.920290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9caa2-57df-4f15-9e5e-4901c0a66046 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:36.963341 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2cb9caa2-57df-4f15-9e5e-4901c0a66046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a217cb37c5c4080bbbe98d4d866e430'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.970262 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2cb9caa2-57df-4f15-9e5e-4901c0a66046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a217cb37c5c4080bbbe98d4d866e430'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.970919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2cb9caa2-57df-4f15-9e5e-4901c0a66046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a217cb37c5c4080bbbe98d4d866e430'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.978259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2cb9caa2-57df-4f15-9e5e-4901c0a66046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a217cb37c5c4080bbbe98d4d866e430'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.989581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-2cb9caa2-57df-4f15-9e5e-4901c0a66046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a217cb37c5c4080bbbe98d4d866e430'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:36.995541 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4314/8601] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:34:36 2021] DELETE /identity/v3/users/9a217cb37c5c4080bbbe98d4d866e430 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:34:37.262139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:37.263730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:37.278238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e3206-290b-42e9-8477-e2cb233a3266 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:37.334799 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:37.335692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:37.335975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:37.336247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] PATH_INFO: `/v3/projects/5b6c9423d7454ff9b193a0254711d916` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:37.338147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6c9423d7454ff9b193a0254711d916)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:37.340095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:37.384365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6c9423d7454ff9b193a0254711d916', 'request_id': 'req-42e6b959-933b-46c2-ba89-23f01f54e8b6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:37.390377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6c9423d7454ff9b193a0254711d916', 'request_id': 'req-42e6b959-933b-46c2-ba89-23f01f54e8b6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:37.397555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6c9423d7454ff9b193a0254711d916', 'request_id': 'req-42e6b959-933b-46c2-ba89-23f01f54e8b6'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:37.408182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] The token cache is being invalidate because project 5b6c9423d7454ff9b193a0254711d916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:34:37.408466 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:37.409092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-42e6b959-933b-46c2-ba89-23f01f54e8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:34:37.410604 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4288/8602] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:34:37 2021] DELETE /identity/v3/projects/5b6c9423d7454ff9b193a0254711d916 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:34:37.417267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59c553-0784-46e1-8e1c-a91f7f616c69 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:37.417733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59c553-0784-46e1-8e1c-a91f7f616c69 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:37.417864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59c553-0784-46e1-8e1c-a91f7f616c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:37.435917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cf59c553-0784-46e1-8e1c-a91f7f616c69 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:37.437094 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cf59c553-0784-46e1-8e1c-a91f7f616c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:37.493713 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4315/8603] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:34:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:37.502401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7438-b60c-4c78-9750-d3f37cc20935 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:37.502717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7438-b60c-4c78-9750-d3f37cc20935 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:37.503002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7438-b60c-4c78-9750-d3f37cc20935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:37.522031 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-14ba7438-b60c-4c78-9750-d3f37cc20935 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:37.523233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-14ba7438-b60c-4c78-9750-d3f37cc20935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:37.531749 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4289/8604] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:34:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:34:37.535875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59c553-0784-46e1-8e1c-a91f7f616c69 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:37.545483 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59c553-0784-46e1-8e1c-a91f7f616c69 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:37.550129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd601fd-f906-4e86-a677-9deae08ff215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:37.550777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd601fd-f906-4e86-a677-9deae08ff215 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:37.551067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd601fd-f906-4e86-a677-9deae08ff215 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:37.551388 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd601fd-f906-4e86-a677-9deae08ff215 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:37.552126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd601fd-f906-4e86-a677-9deae08ff215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:34:37.552433 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd601fd-f906-4e86-a677-9deae08ff215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:37.554029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd601fd-f906-4e86-a677-9deae08ff215 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:37.565369 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4316/8605] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:34:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:34:37.569798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba7438-b60c-4c78-9750-d3f37cc20935 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:37.579464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba7438-b60c-4c78-9750-d3f37cc20935 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:37.584120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9e43d-1489-4501-b31c-15ce656a7f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:37.584756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9e43d-1489-4501-b31c-15ce656a7f0d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:37.585038 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9e43d-1489-4501-b31c-15ce656a7f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:37.585317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9e43d-1489-4501-b31c-15ce656a7f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:37.586045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9e43d-1489-4501-b31c-15ce656a7f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:37.588938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9e43d-1489-4501-b31c-15ce656a7f0d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:37.612926 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4290/8606] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:34:37 2021] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:34:37.616987 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd601fd-f906-4e86-a677-9deae08ff215 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:37.627121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd601fd-f906-4e86-a677-9deae08ff215 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:37.681018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f04a4c-360d-431a-8729-86f73178a0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:37.681679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f04a4c-360d-431a-8729-86f73178a0ba admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:37.681965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f04a4c-360d-431a-8729-86f73178a0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:37.682244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f04a4c-360d-431a-8729-86f73178a0ba admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:37.682942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f04a4c-360d-431a-8729-86f73178a0ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:37.684891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f04a4c-360d-431a-8729-86f73178a0ba admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:37.704752 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4317/8607] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:34:37 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:34:37.708638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9e43d-1489-4501-b31c-15ce656a7f0d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:37.718698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9e43d-1489-4501-b31c-15ce656a7f0d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:37.723679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3713a4-6e6c-484d-ae83-0ae056be871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:37.724334 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3713a4-6e6c-484d-ae83-0ae056be871b admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:37.724618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3713a4-6e6c-484d-ae83-0ae056be871b admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:37.724891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3713a4-6e6c-484d-ae83-0ae056be871b admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:37.725619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3713a4-6e6c-484d-ae83-0ae056be871b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:37.727364 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3713a4-6e6c-484d-ae83-0ae056be871b admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:37.737809 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4291/8608] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:34:37 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:34:37.741340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f04a4c-360d-431a-8729-86f73178a0ba admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:37.751885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f04a4c-360d-431a-8729-86f73178a0ba admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:37.756401 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed34799-c748-43a9-b017-9d114e661458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:37.757040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34799-c748-43a9-b017-9d114e661458 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:37.757319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34799-c748-43a9-b017-9d114e661458 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:37.757591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed34799-c748-43a9-b017-9d114e661458 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:37.758927 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed34799-c748-43a9-b017-9d114e661458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:37.760536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed34799-c748-43a9-b017-9d114e661458 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:37.769993 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4318/8609] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:34:37 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:34:37.773851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3713a4-6e6c-484d-ae83-0ae056be871b admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:37.783644 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3713a4-6e6c-484d-ae83-0ae056be871b admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:37.788246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc8439-b0e0-4264-989d-cda463374831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:37.789104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8439-b0e0-4264-989d-cda463374831 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:37.789388 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8439-b0e0-4264-989d-cda463374831 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:37.789663 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc8439-b0e0-4264-989d-cda463374831 admin admin] PATH_INFO: `/v3/projects/11fc5844e4a54a18a4a14eeb83b07c31/users/7980fb228ebd41d99746e8f1b78e32f2/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:37.803802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc8439-b0e0-4264-989d-cda463374831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11fc5844e4a54a18a4a14eeb83b07c31, user_id=7980fb228ebd41d99746e8f1b78e32f2, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:37.807060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc8439-b0e0-4264-989d-cda463374831 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:37.819884 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4292/8610] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:34:37 2021] PUT /identity/v3/projects/11fc5844e4a54a18a4a14eeb83b07c31/users/7980fb228ebd41d99746e8f1b78e32f2/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:34:37.825498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b28b6-3a5a-4a4b-bc50-19d19dfa3ddb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:37.825791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b28b6-3a5a-4a4b-bc50-19d19dfa3ddb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:37.826069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b28b6-3a5a-4a4b-bc50-19d19dfa3ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:37.843268 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-899b28b6-3a5a-4a4b-bc50-19d19dfa3ddb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:37.844461 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-899b28b6-3a5a-4a4b-bc50-19d19dfa3ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:37.900593 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4319/8611] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:34:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:37.910683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc8439-b0e0-4264-989d-cda463374831 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:37.912372 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-94bc8439-b0e0-4264-989d-cda463374831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:37.969714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc8439-b0e0-4264-989d-cda463374831 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:37.973439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ebda0-3351-404f-a042-e22d3fce2b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:37.974081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ebda0-3351-404f-a042-e22d3fce2b73 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:37.974365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ebda0-3351-404f-a042-e22d3fce2b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:37.974641 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ebda0-3351-404f-a042-e22d3fce2b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:37.983504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ebda0-3351-404f-a042-e22d3fce2b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:37.984944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ebda0-3351-404f-a042-e22d3fce2b73 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:37.994685 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4293/8612] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:34:38.590080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5efd-3aa2-402b-9521-832d73720d17 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:38.590607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5efd-3aa2-402b-9521-832d73720d17 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:38.590711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5efd-3aa2-402b-9521-832d73720d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:38.618295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4b5d5efd-3aa2-402b-9521-832d73720d17 None None] MFA Rules not processed for user `7980fb228ebd41d99746e8f1b78e32f2`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:38.619664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4b5d5efd-3aa2-402b-9521-832d73720d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:38.689302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4320/8613] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:34:38 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:38.701268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd62185-dba8-4072-9199-19dc400422f6 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:38.701783 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd62185-dba8-4072-9199-19dc400422f6 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:38.701907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd62185-dba8-4072-9199-19dc400422f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:38.719426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ccd62185-dba8-4072-9199-19dc400422f6 None None] MFA Rules not processed for user `7980fb228ebd41d99746e8f1b78e32f2`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:38.720622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ccd62185-dba8-4072-9199-19dc400422f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:38.728099 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4294/8614] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:34:38 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:38.740453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d5efd-3aa2-402b-9521-832d73720d17 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:38.741805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4b5d5efd-3aa2-402b-9521-832d73720d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:38.817969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d5efd-3aa2-402b-9521-832d73720d17 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:38.824383 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b0095-9a6c-4160-b33f-c3e37ca4cee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:38.825036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b0095-9a6c-4160-b33f-c3e37ca4cee5 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:38.825325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b0095-9a6c-4160-b33f-c3e37ca4cee5 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:38.825606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b0095-9a6c-4160-b33f-c3e37ca4cee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:38.833604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b0095-9a6c-4160-b33f-c3e37ca4cee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:38.835444 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b0095-9a6c-4160-b33f-c3e37ca4cee5 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:38.844445 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4321/8615] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:38 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:34:39.368494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77bd6-8d9d-4d27-b8f6-a71df087de48 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:39.368858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77bd6-8d9d-4d27-b8f6-a71df087de48 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:39.369235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd77bd6-8d9d-4d27-b8f6-a71df087de48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:39.406643 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-7bd77bd6-8d9d-4d27-b8f6-a71df087de48 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:39.407890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7bd77bd6-8d9d-4d27-b8f6-a71df087de48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:39.470224 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4295/8616] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:34:39 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:39.482885 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b0095-9a6c-4160-b33f-c3e37ca4cee5 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:39.484303 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ce4b0095-9a6c-4160-b33f-c3e37ca4cee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:39.501224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b0095-9a6c-4160-b33f-c3e37ca4cee5 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:39.506036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3968e4-04d5-4722-a875-7cd55b9cfd3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:39.506687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3968e4-04d5-4722-a875-7cd55b9cfd3d service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:39.506975 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3968e4-04d5-4722-a875-7cd55b9cfd3d service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:39.507295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3968e4-04d5-4722-a875-7cd55b9cfd3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:39.515406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3968e4-04d5-4722-a875-7cd55b9cfd3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:39.516952 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3968e4-04d5-4722-a875-7cd55b9cfd3d service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:39.527150 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4322/8617] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:34:50.138079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd77bd6-8d9d-4d27-b8f6-a71df087de48 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:50.139518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7bd77bd6-8d9d-4d27-b8f6-a71df087de48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:50.151371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd77bd6-8d9d-4d27-b8f6-a71df087de48 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:50.154930 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a50e56-5486-45bc-8ad9-094a74f40e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:50.155612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a50e56-5486-45bc-8ad9-094a74f40e6e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:50.155894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a50e56-5486-45bc-8ad9-094a74f40e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:50.156269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a50e56-5486-45bc-8ad9-094a74f40e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:50.158019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f7a50e56-5486-45bc-8ad9-094a74f40e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:50.170281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a50e56-5486-45bc-8ad9-094a74f40e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:50.171815 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a50e56-5486-45bc-8ad9-094a74f40e6e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:50.182536 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4296/8618] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:50 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:34:50.273686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef4e4-2e26-4aa9-ad18-239066722802 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:50.274261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef4e4-2e26-4aa9-ad18-239066722802 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:50.274261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aef4e4-2e26-4aa9-ad18-239066722802 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:50.276614 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4323/8619] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 21:34:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:34:50.281728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95956f72-e074-43ca-84e8-b5df6bb7b533 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:50.282036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95956f72-e074-43ca-84e8-b5df6bb7b533 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:50.282337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95956f72-e074-43ca-84e8-b5df6bb7b533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:50.300264 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-95956f72-e074-43ca-84e8-b5df6bb7b533 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:50.301438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-95956f72-e074-43ca-84e8-b5df6bb7b533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:50.310273 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4297/8620] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:34:50 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:34:50.331743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef4e4-2e26-4aa9-ad18-239066722802 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:50.333418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-83aef4e4-2e26-4aa9-ad18-239066722802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:50.352701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aef4e4-2e26-4aa9-ad18-239066722802 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:50.357737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab854b3-133a-4e03-bc72-24222a204a67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:50.358402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab854b3-133a-4e03-bc72-24222a204a67 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:50.358687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab854b3-133a-4e03-bc72-24222a204a67 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:50.358967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab854b3-133a-4e03-bc72-24222a204a67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:50.367112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab854b3-133a-4e03-bc72-24222a204a67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:50.368754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab854b3-133a-4e03-bc72-24222a204a67 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:50.378458 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4324/8621] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:34:50.538013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4b8b-c979-4124-84ac-2762d129e00a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:50.538306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4b8b-c979-4124-84ac-2762d129e00a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:50.538587 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4b8b-c979-4124-84ac-2762d129e00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:50.556830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3f2b4b8b-c979-4124-84ac-2762d129e00a None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:34:50.558003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3f2b4b8b-c979-4124-84ac-2762d129e00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:34:50.566659 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4298/8622] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:34:50 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:34:50.579226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab854b3-133a-4e03-bc72-24222a204a67 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:34:50.592169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab854b3-133a-4e03-bc72-24222a204a67 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:34:50.597219 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003c1ab-1914-4d6f-a6a3-51af53911199 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:34:50.597874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c1ab-1914-4d6f-a6a3-51af53911199 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:34:50.598158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c1ab-1914-4d6f-a6a3-51af53911199 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:34:50.598437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c1ab-1914-4d6f-a6a3-51af53911199 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:34:50.606732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003c1ab-1914-4d6f-a6a3-51af53911199 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:34:50.608333 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003c1ab-1914-4d6f-a6a3-51af53911199 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:34:50.618811 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4325/8623] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:34:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:35:13.568622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b4b8b-c979-4124-84ac-2762d129e00a None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:13.582352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b4b8b-c979-4124-84ac-2762d129e00a None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:13.588050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a9ddf-2e2d-42c5-93bd-9bdcb6a86cb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:13.588688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a9ddf-2e2d-42c5-93bd-9bdcb6a86cb4 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:13.588974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a9ddf-2e2d-42c5-93bd-9bdcb6a86cb4 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:13.589252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a9ddf-2e2d-42c5-93bd-9bdcb6a86cb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:13.591006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-178a9ddf-2e2d-42c5-93bd-9bdcb6a86cb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:35:13.604694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a9ddf-2e2d-42c5-93bd-9bdcb6a86cb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:13.606283 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a9ddf-2e2d-42c5-93bd-9bdcb6a86cb4 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:13.619053 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4299/8624] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:35:13 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:35:26.806564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003c1ab-1914-4d6f-a6a3-51af53911199 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:26.816843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003c1ab-1914-4d6f-a6a3-51af53911199 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:26.821454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4deab2-b79e-4ef6-9a1d-6161853e9018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:26.822305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4deab2-b79e-4ef6-9a1d-6161853e9018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:26.822587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4deab2-b79e-4ef6-9a1d-6161853e9018 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:26.822865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4deab2-b79e-4ef6-9a1d-6161853e9018 admin admin] PATH_INFO: `/v3/users/7980fb228ebd41d99746e8f1b78e32f2` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:26.824115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4deab2-b79e-4ef6-9a1d-6161853e9018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7980fb228ebd41d99746e8f1b78e32f2)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:26.826031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4deab2-b79e-4ef6-9a1d-6161853e9018 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:26.871045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9d4deab2-b79e-4ef6-9a1d-6161853e9018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7980fb228ebd41d99746e8f1b78e32f2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:35:26.878324 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9d4deab2-b79e-4ef6-9a1d-6161853e9018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7980fb228ebd41d99746e8f1b78e32f2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:35:26.879191 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9d4deab2-b79e-4ef6-9a1d-6161853e9018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7980fb228ebd41d99746e8f1b78e32f2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:35:26.887017 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9d4deab2-b79e-4ef6-9a1d-6161853e9018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7980fb228ebd41d99746e8f1b78e32f2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:35:26.898309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-9d4deab2-b79e-4ef6-9a1d-6161853e9018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7980fb228ebd41d99746e8f1b78e32f2'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:35:26.904130 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4326/8625] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:35:26 2021] DELETE /identity/v3/users/7980fb228ebd41d99746e8f1b78e32f2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:35:27.072742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a9ddf-2e2d-42c5-93bd-9bdcb6a86cb4 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:27.094647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a9ddf-2e2d-42c5-93bd-9bdcb6a86cb4 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:27.151237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:27.152112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:27.152393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:27.152664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] PATH_INFO: `/v3/projects/11fc5844e4a54a18a4a14eeb83b07c31` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:27.153861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11fc5844e4a54a18a4a14eeb83b07c31)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:27.155853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:27.200143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11fc5844e4a54a18a4a14eeb83b07c31', 'request_id': 'req-81e2a2ce-8d67-4906-b92f-839566ceb3a1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:35:27.205956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11fc5844e4a54a18a4a14eeb83b07c31', 'request_id': 'req-81e2a2ce-8d67-4906-b92f-839566ceb3a1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:35:27.213566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11fc5844e4a54a18a4a14eeb83b07c31', 'request_id': 'req-81e2a2ce-8d67-4906-b92f-839566ceb3a1'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:35:27.223705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] The token cache is being invalidate because project 11fc5844e4a54a18a4a14eeb83b07c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:35:27.223987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:35:27.224611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-81e2a2ce-8d67-4906-b92f-839566ceb3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:35:27.226142 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4300/8626] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:35:27 2021] DELETE /identity/v3/projects/11fc5844e4a54a18a4a14eeb83b07c31 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:35:27.232644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3211b7-44f1-438c-b36c-a75f6d9a88ea None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:27.232937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3211b7-44f1-438c-b36c-a75f6d9a88ea None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:27.233215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3211b7-44f1-438c-b36c-a75f6d9a88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:27.252626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-df3211b7-44f1-438c-b36c-a75f6d9a88ea None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:35:27.253835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-df3211b7-44f1-438c-b36c-a75f6d9a88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:35:27.310515 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4327/8627] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:35:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:35:27.319179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a72b1-ac6d-40c6-ba22-304f488483da None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:27.319658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a72b1-ac6d-40c6-ba22-304f488483da None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:27.320277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a72b1-ac6d-40c6-ba22-304f488483da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:27.340677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-899a72b1-ac6d-40c6-ba22-304f488483da None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:35:27.342007 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-899a72b1-ac6d-40c6-ba22-304f488483da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:35:27.350100 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4301/8628] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:35:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:35:27.354802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3211b7-44f1-438c-b36c-a75f6d9a88ea None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:27.364515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3211b7-44f1-438c-b36c-a75f6d9a88ea None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:27.369375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c95f9-660d-42a1-ad80-35179d4039ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:27.370062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c95f9-660d-42a1-ad80-35179d4039ef admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:27.370348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c95f9-660d-42a1-ad80-35179d4039ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:27.370624 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c95f9-660d-42a1-ad80-35179d4039ef admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:27.371445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c95f9-660d-42a1-ad80-35179d4039ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:35:27.371774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c95f9-660d-42a1-ad80-35179d4039ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:27.373390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c95f9-660d-42a1-ad80-35179d4039ef admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:27.384936 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4328/8629] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:35:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:35:27.388957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a72b1-ac6d-40c6-ba22-304f488483da None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:27.397938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a72b1-ac6d-40c6-ba22-304f488483da None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:27.403570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424e06-b61d-4014-8e1c-415ab6885a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:27.404217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424e06-b61d-4014-8e1c-415ab6885a26 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:27.404505 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424e06-b61d-4014-8e1c-415ab6885a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:27.404784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424e06-b61d-4014-8e1c-415ab6885a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:27.405493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf424e06-b61d-4014-8e1c-415ab6885a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:27.407464 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf424e06-b61d-4014-8e1c-415ab6885a26 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:27.436566 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4302/8630] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:35:27 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:35:27.437751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c95f9-660d-42a1-ad80-35179d4039ef admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:27.448125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c95f9-660d-42a1-ad80-35179d4039ef admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:27.504717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434897d3-0c94-4b76-8481-643842433e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:27.505389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434897d3-0c94-4b76-8481-643842433e02 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:27.505672 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434897d3-0c94-4b76-8481-643842433e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:27.505946 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434897d3-0c94-4b76-8481-643842433e02 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:27.506648 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434897d3-0c94-4b76-8481-643842433e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:27.509077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434897d3-0c94-4b76-8481-643842433e02 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:27.528034 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4329/8631] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:35:27 2021] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:35:27.532183 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424e06-b61d-4014-8e1c-415ab6885a26 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:27.542396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424e06-b61d-4014-8e1c-415ab6885a26 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:27.547019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bd4fd-65d5-40db-9cb7-d9e0dc3d984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:27.547700 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bd4fd-65d5-40db-9cb7-d9e0dc3d984c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:27.547981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bd4fd-65d5-40db-9cb7-d9e0dc3d984c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:27.548255 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bd4fd-65d5-40db-9cb7-d9e0dc3d984c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:27.548978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bd4fd-65d5-40db-9cb7-d9e0dc3d984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:27.550571 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bd4fd-65d5-40db-9cb7-d9e0dc3d984c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:27.560854 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4303/8632] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:35:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:35:27.564684 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434897d3-0c94-4b76-8481-643842433e02 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:27.574797 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434897d3-0c94-4b76-8481-643842433e02 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:27.579319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7db28-0fdc-4e49-8697-7e58245d6568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:27.580046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7db28-0fdc-4e49-8697-7e58245d6568 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:27.580337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7db28-0fdc-4e49-8697-7e58245d6568 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:27.580613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7db28-0fdc-4e49-8697-7e58245d6568 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:27.581331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7db28-0fdc-4e49-8697-7e58245d6568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:27.582891 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7db28-0fdc-4e49-8697-7e58245d6568 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:27.593019 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4330/8633] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:35:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:35:27.597053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bd4fd-65d5-40db-9cb7-d9e0dc3d984c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:27.606790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bd4fd-65d5-40db-9cb7-d9e0dc3d984c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:27.611353 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167a57c-dc06-47b7-91a7-95bec83c7c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:27.612229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a57c-dc06-47b7-91a7-95bec83c7c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:27.612517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a57c-dc06-47b7-91a7-95bec83c7c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:27.612793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167a57c-dc06-47b7-91a7-95bec83c7c49 admin admin] PATH_INFO: `/v3/projects/d123122da41042cf88d46e8761467e75/users/846ce1b3957d4992b8d0a1a265ec0997/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:27.627542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167a57c-dc06-47b7-91a7-95bec83c7c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d123122da41042cf88d46e8761467e75, user_id=846ce1b3957d4992b8d0a1a265ec0997, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:27.630175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167a57c-dc06-47b7-91a7-95bec83c7c49 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:27.645406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4304/8634] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:35:27 2021] PUT /identity/v3/projects/d123122da41042cf88d46e8761467e75/users/846ce1b3957d4992b8d0a1a265ec0997/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:35:27.651320 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8e53e-5033-425e-9132-6c1399fd08e9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:27.651617 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8e53e-5033-425e-9132-6c1399fd08e9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:27.651898 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8e53e-5033-425e-9132-6c1399fd08e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:27.669437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-38c8e53e-5033-425e-9132-6c1399fd08e9 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:35:27.670651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-38c8e53e-5033-425e-9132-6c1399fd08e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:35:27.729448 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4331/8635] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:35:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:35:27.739529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167a57c-dc06-47b7-91a7-95bec83c7c49 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:27.741201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5167a57c-dc06-47b7-91a7-95bec83c7c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:35:27.796525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167a57c-dc06-47b7-91a7-95bec83c7c49 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:27.800229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1ba0a-4796-4940-96fc-a37ccc285f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:27.800861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1ba0a-4796-4940-96fc-a37ccc285f26 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:27.801143 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1ba0a-4796-4940-96fc-a37ccc285f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:27.801418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1ba0a-4796-4940-96fc-a37ccc285f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:27.810349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1ba0a-4796-4940-96fc-a37ccc285f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:27.811810 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1ba0a-4796-4940-96fc-a37ccc285f26 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:27.821533 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4305/8636] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:35:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:35:28.422258 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6d9f-11a1-4f78-ac70-0c2a0b2e2607 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:28.422784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6d9f-11a1-4f78-ac70-0c2a0b2e2607 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:28.422894 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6d9f-11a1-4f78-ac70-0c2a0b2e2607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:28.450831 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a13f6d9f-11a1-4f78-ac70-0c2a0b2e2607 None None] MFA Rules not processed for user `846ce1b3957d4992b8d0a1a265ec0997`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:35:28.451676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a13f6d9f-11a1-4f78-ac70-0c2a0b2e2607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:35:28.518504 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4332/8637] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:35:28 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:35:28.529241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5fc2-ccda-4138-8329-48947a522aa3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:28.529974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5fc2-ccda-4138-8329-48947a522aa3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:28.529974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5fc2-ccda-4138-8329-48947a522aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:28.548147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d94a5fc2-ccda-4138-8329-48947a522aa3 None None] MFA Rules not processed for user `846ce1b3957d4992b8d0a1a265ec0997`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:35:28.549365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d94a5fc2-ccda-4138-8329-48947a522aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:35:28.559288 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4306/8638] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:35:28 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:35:28.572255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6d9f-11a1-4f78-ac70-0c2a0b2e2607 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:28.574229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a13f6d9f-11a1-4f78-ac70-0c2a0b2e2607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:35:28.650069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6d9f-11a1-4f78-ac70-0c2a0b2e2607 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:28.655584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319816d1-c13d-4fea-867e-4cdac4cafdde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:28.656227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319816d1-c13d-4fea-867e-4cdac4cafdde service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:28.656511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319816d1-c13d-4fea-867e-4cdac4cafdde service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:28.656786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319816d1-c13d-4fea-867e-4cdac4cafdde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:28.664690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319816d1-c13d-4fea-867e-4cdac4cafdde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:28.666808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319816d1-c13d-4fea-867e-4cdac4cafdde service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:28.675370 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4333/8639] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:35:28 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:35:39.467970 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d153a-d95b-460b-9c62-6a0c01128f54 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:39.468546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d153a-d95b-460b-9c62-6a0c01128f54 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:39.468546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d153a-d95b-460b-9c62-6a0c01128f54 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:39.470320 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4307/8640] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 21:35:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:35:39.475791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95054d-fc1b-4c1b-9be8-7d730c580714 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:39.476232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95054d-fc1b-4c1b-9be8-7d730c580714 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:39.476402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95054d-fc1b-4c1b-9be8-7d730c580714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:39.499418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9d95054d-fc1b-4c1b-9be8-7d730c580714 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:35:39.500801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9d95054d-fc1b-4c1b-9be8-7d730c580714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:35:39.563422 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4334/8641] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:35:39 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:35:39.584402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d153a-d95b-460b-9c62-6a0c01128f54 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:35:39.586082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7d6d153a-d95b-460b-9c62-6a0c01128f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:35:39.605378 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d153a-d95b-460b-9c62-6a0c01128f54 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:35:39.610439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fbf4d-0f93-452e-8a15-21f064560231 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:35:39.611096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fbf4d-0f93-452e-8a15-21f064560231 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:35:39.611418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fbf4d-0f93-452e-8a15-21f064560231 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:35:39.611702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fbf4d-0f93-452e-8a15-21f064560231 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:35:39.619893 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fbf4d-0f93-452e-8a15-21f064560231 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:35:39.621461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fbf4d-0f93-452e-8a15-21f064560231 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:35:39.631206 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4308/8642] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:35:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:36:14.454328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe3dee-e7da-4ced-a00c-65dfd284c50f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:36:14.454902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe3dee-e7da-4ced-a00c-65dfd284c50f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:36:14.454902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe3dee-e7da-4ced-a00c-65dfd284c50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:36:14.472270 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-60fe3dee-e7da-4ced-a00c-65dfd284c50f None None] MFA Rules not processed for user `846ce1b3957d4992b8d0a1a265ec0997`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:36:14.473466 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-60fe3dee-e7da-4ced-a00c-65dfd284c50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:36:14.480316 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4335/8643] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:36:14 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:36:14.515786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fbf4d-0f93-452e-8a15-21f064560231 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:36:14.518129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3b0fbf4d-0f93-452e-8a15-21f064560231 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:36:14.597694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fbf4d-0f93-452e-8a15-21f064560231 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:36:14.601383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe5e68-3f99-497a-8a81-8ce785e89560 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:36:14.602019 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5e68-3f99-497a-8a81-8ce785e89560 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:36:14.602302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5e68-3f99-497a-8a81-8ce785e89560 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:36:14.602608 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5e68-3f99-497a-8a81-8ce785e89560 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:36:14.604418 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6cfe5e68-3f99-497a-8a81-8ce785e89560 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:36:14.620459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe5e68-3f99-497a-8a81-8ce785e89560 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:36:14.621827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe5e68-3f99-497a-8a81-8ce785e89560 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:36:14.635807 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4309/8644] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:36:14 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:36:14.855133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe3dee-e7da-4ced-a00c-65dfd284c50f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:36:14.864474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe3dee-e7da-4ced-a00c-65dfd284c50f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:36:14.868065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa18b-9e7a-465f-a679-2ac983a188e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:36:14.869255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa18b-9e7a-465f-a679-2ac983a188e3 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:36:14.869540 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa18b-9e7a-465f-a679-2ac983a188e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:36:14.869816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa18b-9e7a-465f-a679-2ac983a188e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:36:14.871677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-44caa18b-9e7a-465f-a679-2ac983a188e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:36:14.883518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caa18b-9e7a-465f-a679-2ac983a188e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:36:14.884961 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caa18b-9e7a-465f-a679-2ac983a188e3 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:36:14.895083 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4336/8645] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:36:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:36:16.306907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe5e68-3f99-497a-8a81-8ce785e89560 service glance] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:36:16.309444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6cfe5e68-3f99-497a-8a81-8ce785e89560 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:36:16.322753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe5e68-3f99-497a-8a81-8ce785e89560 service glance] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:36:16.326915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4fcb5-fcb4-4649-8743-fced01bb228a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:36:16.327905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4fcb5-fcb4-4649-8743-fced01bb228a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:36:16.330036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4fcb5-fcb4-4649-8743-fced01bb228a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:36:16.330852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4fcb5-fcb4-4649-8743-fced01bb228a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:36:16.333728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-73b4fcb5-fcb4-4649-8743-fced01bb228a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:36:16.355013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4fcb5-fcb4-4649-8743-fced01bb228a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:36:16.356560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4fcb5-fcb4-4649-8743-fced01bb228a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:36:16.371231 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4310/8646] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:36:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:36:17.485754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa18b-9e7a-465f-a679-2ac983a188e3 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:36:17.487285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-44caa18b-9e7a-465f-a679-2ac983a188e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:36:17.520720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa18b-9e7a-465f-a679-2ac983a188e3 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:36:17.526627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3c6c6-1db8-4eb6-b1ad-1da2d037c37c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:36:17.527317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3c6c6-1db8-4eb6-b1ad-1da2d037c37c service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:36:17.527613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3c6c6-1db8-4eb6-b1ad-1da2d037c37c service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:36:17.527897 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3c6c6-1db8-4eb6-b1ad-1da2d037c37c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:36:17.529669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9aa3c6c6-1db8-4eb6-b1ad-1da2d037c37c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:36:17.545207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3c6c6-1db8-4eb6-b1ad-1da2d037c37c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:36:17.546825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3c6c6-1db8-4eb6-b1ad-1da2d037c37c service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:36:17.560862 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4337/8647] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:36:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:36:26.296077 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb18ce-eee3-430b-9199-1837a86728c7 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:36:26.296656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb18ce-eee3-430b-9199-1837a86728c7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:36:26.296656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb18ce-eee3-430b-9199-1837a86728c7 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:36:26.298448 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4311/8648] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 21:36:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:36:26.303991 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73641-1d50-4552-abf4-3f78f1ef84f3 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:36:26.304482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73641-1d50-4552-abf4-3f78f1ef84f3 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:36:26.304605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73641-1d50-4552-abf4-3f78f1ef84f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:36:26.322904 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-2db73641-1d50-4552-abf4-3f78f1ef84f3 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:36:26.324404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-2db73641-1d50-4552-abf4-3f78f1ef84f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:36:26.337299 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4338/8649] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:36:26 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:36:26.359313 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb18ce-eee3-430b-9199-1837a86728c7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:36:26.361024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3bfb18ce-eee3-430b-9199-1837a86728c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:36:26.380507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb18ce-eee3-430b-9199-1837a86728c7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:36:26.386121 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0f6bf-c0db-4e34-8abe-801dc8c204a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:36:26.386752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0f6bf-c0db-4e34-8abe-801dc8c204a2 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:36:26.387039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0f6bf-c0db-4e34-8abe-801dc8c204a2 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:36:26.387348 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0f6bf-c0db-4e34-8abe-801dc8c204a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:36:26.395717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0f6bf-c0db-4e34-8abe-801dc8c204a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:36:26.397322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0f6bf-c0db-4e34-8abe-801dc8c204a2 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:36:26.406873 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4312/8650] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:36:26 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:36:54.955740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db73641-1d50-4552-abf4-3f78f1ef84f3 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:36:54.974899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db73641-1d50-4552-abf4-3f78f1ef84f3 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:36:54.978567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfe96c-f108-41eb-a251-77c0fe1ab35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:36:54.979201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfe96c-f108-41eb-a251-77c0fe1ab35a service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:36:54.979527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfe96c-f108-41eb-a251-77c0fe1ab35a service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:36:54.979911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfe96c-f108-41eb-a251-77c0fe1ab35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:36:54.981668 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-aecfe96c-f108-41eb-a251-77c0fe1ab35a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:36:55.024299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfe96c-f108-41eb-a251-77c0fe1ab35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:36:55.026332 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfe96c-f108-41eb-a251-77c0fe1ab35a service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:36:55.036533 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4339/8651] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:36:54 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:37:04.211239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0f6bf-c0db-4e34-8abe-801dc8c204a2 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:37:04.246134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0f6bf-c0db-4e34-8abe-801dc8c204a2 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:37:04.250792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7214ba1-ffaf-4e32-98d5-37e4f7e00466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:37:04.251675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7214ba1-ffaf-4e32-98d5-37e4f7e00466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:04.251960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7214ba1-ffaf-4e32-98d5-37e4f7e00466 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:04.252237 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7214ba1-ffaf-4e32-98d5-37e4f7e00466 admin admin] PATH_INFO: `/v3/users/846ce1b3957d4992b8d0a1a265ec0997` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:04.253714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7214ba1-ffaf-4e32-98d5-37e4f7e00466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846ce1b3957d4992b8d0a1a265ec0997)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:37:04.255685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7214ba1-ffaf-4e32-98d5-37e4f7e00466 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:37:04.300375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d7214ba1-ffaf-4e32-98d5-37e4f7e00466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846ce1b3957d4992b8d0a1a265ec0997'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:37:04.301025 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d7214ba1-ffaf-4e32-98d5-37e4f7e00466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846ce1b3957d4992b8d0a1a265ec0997'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:37:04.308454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d7214ba1-ffaf-4e32-98d5-37e4f7e00466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846ce1b3957d4992b8d0a1a265ec0997'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:37:04.309448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d7214ba1-ffaf-4e32-98d5-37e4f7e00466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846ce1b3957d4992b8d0a1a265ec0997'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:37:04.316956 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d7214ba1-ffaf-4e32-98d5-37e4f7e00466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846ce1b3957d4992b8d0a1a265ec0997'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:37:04.334329 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4313/8652] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:37:04 2021] DELETE /identity/v3/users/846ce1b3957d4992b8d0a1a265ec0997 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:37:04.502345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfe96c-f108-41eb-a251-77c0fe1ab35a service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:37:04.517941 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfe96c-f108-41eb-a251-77c0fe1ab35a service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:37:04.575158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:37:04.576165 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:04.576443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:04.576714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] PATH_INFO: `/v3/projects/d123122da41042cf88d46e8761467e75` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:04.577902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d123122da41042cf88d46e8761467e75)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:37:04.579854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:37:04.624587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd123122da41042cf88d46e8761467e75', 'request_id': 'req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:37:04.631426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd123122da41042cf88d46e8761467e75', 'request_id': 'req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:37:04.637474 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd123122da41042cf88d46e8761467e75', 'request_id': 'req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:37:04.647272 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] The token cache is being invalidate because project d123122da41042cf88d46e8761467e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:37:04.647563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:37:04.648181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c8e5a36e-f4d8-4bbd-aff2-47bcfab1fecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:37:04.649705 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4340/8653] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:37:04 2021] DELETE /identity/v3/projects/d123122da41042cf88d46e8761467e75 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:37:04.655691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e106-5cb8-4100-8976-83c972cd3bda None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:04.655986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e106-5cb8-4100-8976-83c972cd3bda None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:04.656266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9e106-5cb8-4100-8976-83c972cd3bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:04.674120 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-38d9e106-5cb8-4100-8976-83c972cd3bda None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:37:04.675351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-38d9e106-5cb8-4100-8976-83c972cd3bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:37:04.733440 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4314/8654] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:37:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:37:04.741380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46068d-1aa9-4488-8513-7df79813430a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:04.741720 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46068d-1aa9-4488-8513-7df79813430a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:04.741977 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46068d-1aa9-4488-8513-7df79813430a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:04.760735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4b46068d-1aa9-4488-8513-7df79813430a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:37:04.761914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4b46068d-1aa9-4488-8513-7df79813430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:37:04.769731 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4341/8655] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:37:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:37:04.773781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9e106-5cb8-4100-8976-83c972cd3bda None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:37:04.783344 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9e106-5cb8-4100-8976-83c972cd3bda None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:37:04.787915 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6ccfc-d624-439b-b12b-58195774878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:37:04.788559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ccfc-d624-439b-b12b-58195774878d admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:04.788842 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ccfc-d624-439b-b12b-58195774878d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:04.789118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6ccfc-d624-439b-b12b-58195774878d admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:04.789849 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6ccfc-d624-439b-b12b-58195774878d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:37:04.790270 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6ccfc-d624-439b-b12b-58195774878d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:37:04.792527 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6ccfc-d624-439b-b12b-58195774878d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:37:04.803887 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4315/8656] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:37:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:37:04.808773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46068d-1aa9-4488-8513-7df79813430a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:37:04.817786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46068d-1aa9-4488-8513-7df79813430a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:37:04.822370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8432d-2924-4a1d-b3de-34bc3f7b5093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:37:04.822999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8432d-2924-4a1d-b3de-34bc3f7b5093 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:04.823306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8432d-2924-4a1d-b3de-34bc3f7b5093 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:04.823587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8432d-2924-4a1d-b3de-34bc3f7b5093 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:04.824276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8432d-2924-4a1d-b3de-34bc3f7b5093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:37:04.826149 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8432d-2924-4a1d-b3de-34bc3f7b5093 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:37:04.850432 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4342/8657] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:37:04 2021] POST /identity/v3/projects => generated 377 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:37:04.855138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6ccfc-d624-439b-b12b-58195774878d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:37:04.865132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6ccfc-d624-439b-b12b-58195774878d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:37:04.921463 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0fd17-dbb2-45d1-a7e3-19c4d6fa381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:37:04.922126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0fd17-dbb2-45d1-a7e3-19c4d6fa381f admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:04.922408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0fd17-dbb2-45d1-a7e3-19c4d6fa381f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:04.922682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0fd17-dbb2-45d1-a7e3-19c4d6fa381f admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:04.923422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0fd17-dbb2-45d1-a7e3-19c4d6fa381f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:37:04.925333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0fd17-dbb2-45d1-a7e3-19c4d6fa381f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:37:04.946251 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4316/8658] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:37:04 2021] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:37:04.950455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8432d-2924-4a1d-b3de-34bc3f7b5093 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:37:04.961337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8432d-2924-4a1d-b3de-34bc3f7b5093 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:37:04.966584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89648164-9c0f-4469-897a-585e603a37f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:37:04.967244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89648164-9c0f-4469-897a-585e603a37f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:04.967560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89648164-9c0f-4469-897a-585e603a37f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:04.967833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89648164-9c0f-4469-897a-585e603a37f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:04.968568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89648164-9c0f-4469-897a-585e603a37f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:37:04.970154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89648164-9c0f-4469-897a-585e603a37f7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:37:04.981672 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4343/8659] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:37:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:37:04.985813 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0fd17-dbb2-45d1-a7e3-19c4d6fa381f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:37:04.995723 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0fd17-dbb2-45d1-a7e3-19c4d6fa381f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:37:05.000362 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9725-eed9-427f-b7be-e21d18caf313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:37:05.001005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9725-eed9-427f-b7be-e21d18caf313 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:05.001284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9725-eed9-427f-b7be-e21d18caf313 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:05.001554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9725-eed9-427f-b7be-e21d18caf313 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:05.002275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d9725-eed9-427f-b7be-e21d18caf313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:37:05.004154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d9725-eed9-427f-b7be-e21d18caf313 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:37:05.013755 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4317/8660] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:37:04 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:37:05.017757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89648164-9c0f-4469-897a-585e603a37f7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:37:05.027979 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89648164-9c0f-4469-897a-585e603a37f7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:37:05.032580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316b413-ecda-445d-b483-7eef8717ead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:37:05.033472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316b413-ecda-445d-b483-7eef8717ead8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:05.033753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316b413-ecda-445d-b483-7eef8717ead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:05.034025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316b413-ecda-445d-b483-7eef8717ead8 admin admin] PATH_INFO: `/v3/projects/8ac362e2c70a4862919a7dfcd5f32167/users/df0509ba3bea4d9f893f5c966b9efd46/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:05.049141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316b413-ecda-445d-b483-7eef8717ead8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac362e2c70a4862919a7dfcd5f32167, user_id=df0509ba3bea4d9f893f5c966b9efd46, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:37:05.051783 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316b413-ecda-445d-b483-7eef8717ead8 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:37:05.064463 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4344/8661] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:37:05 2021] PUT /identity/v3/projects/8ac362e2c70a4862919a7dfcd5f32167/users/df0509ba3bea4d9f893f5c966b9efd46/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:37:05.069554 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28f585-b6be-4203-b93c-c8c532d1a9e3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:05.069848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28f585-b6be-4203-b93c-c8c532d1a9e3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:05.070138 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28f585-b6be-4203-b93c-c8c532d1a9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:05.087376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ba28f585-b6be-4203-b93c-c8c532d1a9e3 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:37:05.089058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ba28f585-b6be-4203-b93c-c8c532d1a9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:37:05.144925 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4318/8662] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:37:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:37:05.155360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316b413-ecda-445d-b483-7eef8717ead8 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:37:05.157041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6316b413-ecda-445d-b483-7eef8717ead8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:37:05.211634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316b413-ecda-445d-b483-7eef8717ead8 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:37:05.215829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cae40-abb4-4ab4-943b-a60bbc17d032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:37:05.216467 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cae40-abb4-4ab4-943b-a60bbc17d032 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:05.216752 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cae40-abb4-4ab4-943b-a60bbc17d032 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:05.217026 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cae40-abb4-4ab4-943b-a60bbc17d032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:05.225852 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cae40-abb4-4ab4-943b-a60bbc17d032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:37:05.227297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cae40-abb4-4ab4-943b-a60bbc17d032 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:37:05.237243 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4345/8663] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:37:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:37:09.254474 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0ac5-933a-4918-a828-a4d66909cf41 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:09.254990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0ac5-933a-4918-a828-a4d66909cf41 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:09.255158 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e0ac5-933a-4918-a828-a4d66909cf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:09.281093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-eb0e0ac5-933a-4918-a828-a4d66909cf41 None None] MFA Rules not processed for user `df0509ba3bea4d9f893f5c966b9efd46`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:37:09.282658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-eb0e0ac5-933a-4918-a828-a4d66909cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:37:09.347653 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4319/8664] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:37:09 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:37:09.361718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cae40-abb4-4ab4-943b-a60bbc17d032 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:37:09.363578 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-573cae40-abb4-4ab4-943b-a60bbc17d032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:37:09.447048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cae40-abb4-4ab4-943b-a60bbc17d032 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:37:09.453478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a13ba-b680-4f8f-ae4a-f1406635c89f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:37:09.454141 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a13ba-b680-4f8f-ae4a-f1406635c89f service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:09.454434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a13ba-b680-4f8f-ae4a-f1406635c89f service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:09.454716 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a13ba-b680-4f8f-ae4a-f1406635c89f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:09.463079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a13ba-b680-4f8f-ae4a-f1406635c89f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:37:09.464738 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a13ba-b680-4f8f-ae4a-f1406635c89f service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:37:09.473747 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4346/8665] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:37:09 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:37:11.059497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d7e4e-cd10-43c8-b024-13b0b115dfce None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:37:11.059993 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d7e4e-cd10-43c8-b024-13b0b115dfce None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:37:11.060219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d7e4e-cd10-43c8-b024-13b0b115dfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:37:11.078834 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f78d7e4e-cd10-43c8-b024-13b0b115dfce None None] MFA Rules not processed for user `df0509ba3bea4d9f893f5c966b9efd46`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:37:11.080134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f78d7e4e-cd10-43c8-b024-13b0b115dfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:37:11.087096 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4320/8666] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:37:11 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:39:02.438503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64043515-e751-48ee-a8b4-0baabb190a2c None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:39:02.439124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64043515-e751-48ee-a8b4-0baabb190a2c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:39:02.439124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64043515-e751-48ee-a8b4-0baabb190a2c None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:39:02.441150 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4347/8667] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 21:39:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:39:02.449622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39260ad3-0526-4e28-afe4-3cc0f83da5c5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:39:02.450153 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39260ad3-0526-4e28-afe4-3cc0f83da5c5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:39:02.450906 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39260ad3-0526-4e28-afe4-3cc0f83da5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:39:02.491131 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-39260ad3-0526-4e28-afe4-3cc0f83da5c5 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:39:02.492405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-39260ad3-0526-4e28-afe4-3cc0f83da5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:39:02.557825 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4321/8668] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:39:02 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:39:02.580484 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64043515-e751-48ee-a8b4-0baabb190a2c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:39:02.582331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-64043515-e751-48ee-a8b4-0baabb190a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:39:02.600936 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64043515-e751-48ee-a8b4-0baabb190a2c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:39:02.605877 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122618f5-70b0-4521-9876-8fce65e3f16c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:39:02.606510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122618f5-70b0-4521-9876-8fce65e3f16c service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:39:02.606788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122618f5-70b0-4521-9876-8fce65e3f16c service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:39:02.607060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122618f5-70b0-4521-9876-8fce65e3f16c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:39:02.615579 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122618f5-70b0-4521-9876-8fce65e3f16c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:39:02.617171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122618f5-70b0-4521-9876-8fce65e3f16c service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:39:02.627676 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4348/8669] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:39:02 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:39:03.368853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39260ad3-0526-4e28-afe4-3cc0f83da5c5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:39:03.382453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39260ad3-0526-4e28-afe4-3cc0f83da5c5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:39:03.387584 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053a544-0d80-45b0-9148-0db92c3db684 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:39:03.388275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a544-0d80-45b0-9148-0db92c3db684 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:39:03.388557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a544-0d80-45b0-9148-0db92c3db684 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:39:03.388845 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a544-0d80-45b0-9148-0db92c3db684 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:39:03.390738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6053a544-0d80-45b0-9148-0db92c3db684 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:39:03.407118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053a544-0d80-45b0-9148-0db92c3db684 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:39:03.408784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053a544-0d80-45b0-9148-0db92c3db684 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:39:03.422436 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4322/8670] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:39:03 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:39:16.578784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122618f5-70b0-4521-9876-8fce65e3f16c service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:39:16.588436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122618f5-70b0-4521-9876-8fce65e3f16c service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:39:16.592025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaabfd-a350-4755-b7ae-38490b11eeed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:39:16.592693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaabfd-a350-4755-b7ae-38490b11eeed service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:39:16.592976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaabfd-a350-4755-b7ae-38490b11eeed service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:39:16.593252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaabfd-a350-4755-b7ae-38490b11eeed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:39:16.595079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-42aaabfd-a350-4755-b7ae-38490b11eeed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:39:16.608978 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaabfd-a350-4755-b7ae-38490b11eeed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:39:16.610430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaabfd-a350-4755-b7ae-38490b11eeed service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:39:16.620734 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4349/8671] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:39:16 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:39:26.723909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b087bac-527f-4c19-95ce-23d3b9365a41 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:39:26.724389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b087bac-527f-4c19-95ce-23d3b9365a41 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:39:26.724389 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b087bac-527f-4c19-95ce-23d3b9365a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:39:26.741718 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1b087bac-527f-4c19-95ce-23d3b9365a41 None None] MFA Rules not processed for user `df0509ba3bea4d9f893f5c966b9efd46`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:39:26.742890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1b087bac-527f-4c19-95ce-23d3b9365a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:39:26.750173 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4323/8672] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:39:26 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:39:36.665870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaabfd-a350-4755-b7ae-38490b11eeed service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:39:36.667095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-42aaabfd-a350-4755-b7ae-38490b11eeed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:39:36.706772 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaabfd-a350-4755-b7ae-38490b11eeed service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:39:36.712465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6078a71-1d43-441a-ad9f-d8c7628207bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:39:36.713106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6078a71-1d43-441a-ad9f-d8c7628207bd service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:39:36.713390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6078a71-1d43-441a-ad9f-d8c7628207bd service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:39:36.713804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6078a71-1d43-441a-ad9f-d8c7628207bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:39:36.715625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a6078a71-1d43-441a-ad9f-d8c7628207bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:39:36.731308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6078a71-1d43-441a-ad9f-d8c7628207bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:39:36.732966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6078a71-1d43-441a-ad9f-d8c7628207bd service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:39:36.745850 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4350/8673] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:39:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:39:40.727435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b087bac-527f-4c19-95ce-23d3b9365a41 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:39:40.744053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b087bac-527f-4c19-95ce-23d3b9365a41 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:39:40.750218 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1b46e-6647-4b1e-9fce-f59c96b11f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:39:40.750864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1b46e-6647-4b1e-9fce-f59c96b11f85 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:39:40.751402 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1b46e-6647-4b1e-9fce-f59c96b11f85 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:39:40.751675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1b46e-6647-4b1e-9fce-f59c96b11f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:39:40.753827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-49c1b46e-6647-4b1e-9fce-f59c96b11f85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:39:40.773548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1b46e-6647-4b1e-9fce-f59c96b11f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:39:40.775185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1b46e-6647-4b1e-9fce-f59c96b11f85 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:39:40.790914 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4324/8674] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:39:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:40:16.533892 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6078a71-1d43-441a-ad9f-d8c7628207bd service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:40:16.535376 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a6078a71-1d43-441a-ad9f-d8c7628207bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:40:16.552034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6078a71-1d43-441a-ad9f-d8c7628207bd service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:40:16.557036 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c01b4-60c1-4b90-ae36-6c02c711f769 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:40:16.557667 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c01b4-60c1-4b90-ae36-6c02c711f769 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:40:16.557955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c01b4-60c1-4b90-ae36-6c02c711f769 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:40:16.558231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c01b4-60c1-4b90-ae36-6c02c711f769 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:40:16.560543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8f8c01b4-60c1-4b90-ae36-6c02c711f769 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:40:16.574043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c01b4-60c1-4b90-ae36-6c02c711f769 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:40:16.575689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c01b4-60c1-4b90-ae36-6c02c711f769 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:40:16.587969 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4351/8675] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:40:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:42:04.343656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c15722-165d-4bd6-8081-057ba84b4f62 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:04.344938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c15722-165d-4bd6-8081-057ba84b4f62 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:04.344938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c15722-165d-4bd6-8081-057ba84b4f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:04.363950 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-a1c15722-165d-4bd6-8081-057ba84b4f62 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:42:04.365332 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a1c15722-165d-4bd6-8081-057ba84b4f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:04.375271 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4325/8676] 10.222.0.35 () {58 vars in 1015 bytes} [Sat Nov 27 21:42:04 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:42:04.395646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea42f76-c368-4bd2-b65f-f9ddb81f1cff None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:04.396168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea42f76-c368-4bd2-b65f-f9ddb81f1cff None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:04.396296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea42f76-c368-4bd2-b65f-f9ddb81f1cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:04.415671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0ea42f76-c368-4bd2-b65f-f9ddb81f1cff None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:42:04.416876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0ea42f76-c368-4bd2-b65f-f9ddb81f1cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:04.426155 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4352/8677] 10.222.0.21 () {58 vars in 1057 bytes} [Sat Nov 27 21:42:04 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:42:04.432134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c15722-165d-4bd6-8081-057ba84b4f62 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:04.442676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c15722-165d-4bd6-8081-057ba84b4f62 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:04.448056 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4ac84-bbfd-4d67-9ac0-1a3ac2281d70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:04.448733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4ac84-bbfd-4d67-9ac0-1a3ac2281d70 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:04.449024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4ac84-bbfd-4d67-9ac0-1a3ac2281d70 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:04.449306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4ac84-bbfd-4d67-9ac0-1a3ac2281d70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:04.458559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4ac84-bbfd-4d67-9ac0-1a3ac2281d70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:04.460192 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4ac84-bbfd-4d67-9ac0-1a3ac2281d70 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:04.470423 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4326/8678] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:04 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:42:08.516421 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea42f76-c368-4bd2-b65f-f9ddb81f1cff None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:08.543557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea42f76-c368-4bd2-b65f-f9ddb81f1cff None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:08.549834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220420c9-f732-46c3-85c2-909382d46cd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:08.550479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220420c9-f732-46c3-85c2-909382d46cd7 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:08.550765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220420c9-f732-46c3-85c2-909382d46cd7 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:08.551050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220420c9-f732-46c3-85c2-909382d46cd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:08.559039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220420c9-f732-46c3-85c2-909382d46cd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:08.560660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220420c9-f732-46c3-85c2-909382d46cd7 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:08.569383 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4353/8679] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:08 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:42:09.845113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4ac84-bbfd-4d67-9ac0-1a3ac2281d70 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:09.846528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-bfd4ac84-bbfd-4d67-9ac0-1a3ac2281d70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:09.868457 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4ac84-bbfd-4d67-9ac0-1a3ac2281d70 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:09.873093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd667b5-775a-415d-9a19-6bf090999a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:09.873732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd667b5-775a-415d-9a19-6bf090999a0f service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:09.874010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd667b5-775a-415d-9a19-6bf090999a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:09.874284 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd667b5-775a-415d-9a19-6bf090999a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:09.876070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cdd667b5-775a-415d-9a19-6bf090999a0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:09.892924 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd667b5-775a-415d-9a19-6bf090999a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:09.894355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd667b5-775a-415d-9a19-6bf090999a0f service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:09.908062 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4327/8680] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:42:11.080280 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220420c9-f732-46c3-85c2-909382d46cd7 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:11.089405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220420c9-f732-46c3-85c2-909382d46cd7 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:11.092965 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfd840-a95e-46c7-9922-87656f682c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:11.093590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfd840-a95e-46c7-9922-87656f682c89 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:11.093911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfd840-a95e-46c7-9922-87656f682c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:11.094182 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfd840-a95e-46c7-9922-87656f682c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:11.095989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5cdfd840-a95e-46c7-9922-87656f682c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:11.111808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfd840-a95e-46c7-9922-87656f682c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:11.113214 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfd840-a95e-46c7-9922-87656f682c89 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:11.127183 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4354/8681] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:42:16.560854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7d48-3442-4152-83f2-3b9d81246eb5 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:16.561449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7d48-3442-4152-83f2-3b9d81246eb5 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:16.561449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7d48-3442-4152-83f2-3b9d81246eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:16.580738 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-6a7c7d48-3442-4152-83f2-3b9d81246eb5 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:42:16.581942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6a7c7d48-3442-4152-83f2-3b9d81246eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:16.590727 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4328/8682] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Nov 27 21:42:16 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:42:16.604133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49119-8ed3-43cf-97e4-ab39be5e3f7c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:16.604613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49119-8ed3-43cf-97e4-ab39be5e3f7c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:16.604750 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff49119-8ed3-43cf-97e4-ab39be5e3f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:16.622903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-dff49119-8ed3-43cf-97e4-ab39be5e3f7c None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:42:16.624124 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dff49119-8ed3-43cf-97e4-ab39be5e3f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:16.633575 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4355/8683] 10.222.0.21 () {58 vars in 1057 bytes} [Sat Nov 27 21:42:16 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:42:16.639705 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7d48-3442-4152-83f2-3b9d81246eb5 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:16.650647 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7d48-3442-4152-83f2-3b9d81246eb5 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:16.655682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6729c8-0617-44b5-91fa-306f560c67fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:16.656375 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6729c8-0617-44b5-91fa-306f560c67fb service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:16.656657 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6729c8-0617-44b5-91fa-306f560c67fb service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:16.656933 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6729c8-0617-44b5-91fa-306f560c67fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:16.665154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6729c8-0617-44b5-91fa-306f560c67fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:16.666680 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6729c8-0617-44b5-91fa-306f560c67fb service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:16.676406 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4329/8684] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:42:25.658312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff49119-8ed3-43cf-97e4-ab39be5e3f7c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:25.667533 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff49119-8ed3-43cf-97e4-ab39be5e3f7c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:25.671150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346771e-6f31-4bdd-997d-e95817cbd324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:25.671833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346771e-6f31-4bdd-997d-e95817cbd324 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:25.672120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346771e-6f31-4bdd-997d-e95817cbd324 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:25.672399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346771e-6f31-4bdd-997d-e95817cbd324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:25.674273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5346771e-6f31-4bdd-997d-e95817cbd324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:25.686531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346771e-6f31-4bdd-997d-e95817cbd324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:25.688011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346771e-6f31-4bdd-997d-e95817cbd324 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:25.699001 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4356/8685] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:25 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:42:25.804319 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1e4b-75e6-4756-a03a-34da49b6a6d9 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:25.804821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1e4b-75e6-4756-a03a-34da49b6a6d9 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:25.804949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a1e4b-75e6-4756-a03a-34da49b6a6d9 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:25.806617 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4330/8686] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 21:42:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:42:25.811690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83e97f-5dc5-40ca-a780-e64508a321ac None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:25.811976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83e97f-5dc5-40ca-a780-e64508a321ac None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:25.812251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83e97f-5dc5-40ca-a780-e64508a321ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:25.833137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ad83e97f-5dc5-40ca-a780-e64508a321ac None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:42:25.834328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ad83e97f-5dc5-40ca-a780-e64508a321ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:25.842787 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4357/8687] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:42:25 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:42:25.864011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a1e4b-75e6-4756-a03a-34da49b6a6d9 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:25.877880 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a1e4b-75e6-4756-a03a-34da49b6a6d9 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:25.883107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238334e-cdd2-4f2f-9043-7b5404cc5324 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:25.883766 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238334e-cdd2-4f2f-9043-7b5404cc5324 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:25.884046 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238334e-cdd2-4f2f-9043-7b5404cc5324 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:25.884317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238334e-cdd2-4f2f-9043-7b5404cc5324 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:25.892519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238334e-cdd2-4f2f-9043-7b5404cc5324 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:25.894096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238334e-cdd2-4f2f-9043-7b5404cc5324 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:25.903636 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4331/8688] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:42:26.059876 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83e97f-5dc5-40ca-a780-e64508a321ac None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:26.070614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83e97f-5dc5-40ca-a780-e64508a321ac None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:26.075646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841558ed-4152-4762-80d8-2e0de25f416c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:26.076276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841558ed-4152-4762-80d8-2e0de25f416c service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:26.076554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841558ed-4152-4762-80d8-2e0de25f416c service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:26.076825 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841558ed-4152-4762-80d8-2e0de25f416c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:26.078543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-841558ed-4152-4762-80d8-2e0de25f416c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:26.089283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841558ed-4152-4762-80d8-2e0de25f416c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:26.090829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841558ed-4152-4762-80d8-2e0de25f416c service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:26.100152 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4358/8689] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:26 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:42:29.480427 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238334e-cdd2-4f2f-9043-7b5404cc5324 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:29.490123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238334e-cdd2-4f2f-9043-7b5404cc5324 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:29.493704 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50ccfd-d3b9-4bc2-95cd-eddd8ceff73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:29.494323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ccfd-d3b9-4bc2-95cd-eddd8ceff73a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:29.494601 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ccfd-d3b9-4bc2-95cd-eddd8ceff73a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:29.494871 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ccfd-d3b9-4bc2-95cd-eddd8ceff73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:29.496628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2f50ccfd-d3b9-4bc2-95cd-eddd8ceff73a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:29.508645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50ccfd-d3b9-4bc2-95cd-eddd8ceff73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:29.510069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50ccfd-d3b9-4bc2-95cd-eddd8ceff73a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:29.520520 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4332/8690] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:29 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:42:40.926201 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e576b52-f26d-43c2-8266-d831df47e2bb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:40.926726 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e576b52-f26d-43c2-8266-d831df47e2bb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:40.926832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e576b52-f26d-43c2-8266-d831df47e2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:40.944632 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1e576b52-f26d-43c2-8266-d831df47e2bb None None] MFA Rules not processed for user `df0509ba3bea4d9f893f5c966b9efd46`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:42:40.945841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1e576b52-f26d-43c2-8266-d831df47e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:40.952720 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4359/8691] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:42:40 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:42:41.253291 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50ccfd-d3b9-4bc2-95cd-eddd8ceff73a service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:41.262066 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50ccfd-d3b9-4bc2-95cd-eddd8ceff73a service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:41.265710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3365fb-7e8f-4dab-9be3-dd13676aa5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:41.266369 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3365fb-7e8f-4dab-9be3-dd13676aa5ec service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:41.266651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3365fb-7e8f-4dab-9be3-dd13676aa5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:41.266925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3365fb-7e8f-4dab-9be3-dd13676aa5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:41.268694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-6d3365fb-7e8f-4dab-9be3-dd13676aa5ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:41.280485 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3365fb-7e8f-4dab-9be3-dd13676aa5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:41.282566 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3365fb-7e8f-4dab-9be3-dd13676aa5ec service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:41.292913 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4333/8692] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:42:41.615656 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e576b52-f26d-43c2-8266-d831df47e2bb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:41.627994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e576b52-f26d-43c2-8266-d831df47e2bb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:41.633692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe914d-0cf2-4424-9f07-909365ca140e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:41.634411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe914d-0cf2-4424-9f07-909365ca140e service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:41.634696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe914d-0cf2-4424-9f07-909365ca140e service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:41.634974 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe914d-0cf2-4424-9f07-909365ca140e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:41.636874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e5fe914d-0cf2-4424-9f07-909365ca140e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:41.649035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe914d-0cf2-4424-9f07-909365ca140e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:41.660455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe914d-0cf2-4424-9f07-909365ca140e service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:41.670900 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4360/8693] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:42:43.910921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3365fb-7e8f-4dab-9be3-dd13676aa5ec service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:42:43.942803 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3365fb-7e8f-4dab-9be3-dd13676aa5ec service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:42:43.950071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eff54-40c1-46b3-bf00-19dfde21c980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:42:43.950747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eff54-40c1-46b3-bf00-19dfde21c980 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:42:43.951032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eff54-40c1-46b3-bf00-19dfde21c980 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:42:43.951405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eff54-40c1-46b3-bf00-19dfde21c980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:42:43.954006 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e78eff54-40c1-46b3-bf00-19dfde21c980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:42:43.971887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78eff54-40c1-46b3-bf00-19dfde21c980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:42:43.973519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78eff54-40c1-46b3-bf00-19dfde21c980 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:42:43.989339 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4334/8694] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:42:43 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:44:20.781372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79755ec9-1da1-4451-a59d-e0dbc33cb76a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:44:20.781967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79755ec9-1da1-4451-a59d-e0dbc33cb76a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:44:20.781967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79755ec9-1da1-4451-a59d-e0dbc33cb76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:44:20.827731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-79755ec9-1da1-4451-a59d-e0dbc33cb76a None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:44:20.829015 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-79755ec9-1da1-4451-a59d-e0dbc33cb76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:44:20.836372 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4361/8695] 10.222.0.15 () {58 vars in 1015 bytes} [Sat Nov 27 21:44:20 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:44:20.850111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eff54-40c1-46b3-bf00-19dfde21c980 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:44:20.859631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eff54-40c1-46b3-bf00-19dfde21c980 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:44:20.863857 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab347d1-6ddd-4a64-a99b-5ef3fa19864a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:44:20.864489 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab347d1-6ddd-4a64-a99b-5ef3fa19864a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:44:20.864773 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab347d1-6ddd-4a64-a99b-5ef3fa19864a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:44:20.865049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab347d1-6ddd-4a64-a99b-5ef3fa19864a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:44:20.872126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab347d1-6ddd-4a64-a99b-5ef3fa19864a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:44:20.873553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab347d1-6ddd-4a64-a99b-5ef3fa19864a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:44:20.882189 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4335/8696] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:44:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:45:21.161244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec236b59-261e-4a40-be27-4fb5a166cd02 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:21.161882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec236b59-261e-4a40-be27-4fb5a166cd02 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:21.161882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec236b59-261e-4a40-be27-4fb5a166cd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:21.180737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-ec236b59-261e-4a40-be27-4fb5a166cd02 None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:21.181923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ec236b59-261e-4a40-be27-4fb5a166cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:21.188342 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4362/8697] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:45:21 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:45:21.201089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab347d1-6ddd-4a64-a99b-5ef3fa19864a service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:45:21.209568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab347d1-6ddd-4a64-a99b-5ef3fa19864a service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:45:21.213235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5789b50-19c7-42f3-bfe7-2d568bd206d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:45:21.213863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5789b50-19c7-42f3-bfe7-2d568bd206d5 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:21.214145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5789b50-19c7-42f3-bfe7-2d568bd206d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:21.214421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5789b50-19c7-42f3-bfe7-2d568bd206d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:21.222383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5789b50-19c7-42f3-bfe7-2d568bd206d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:45:21.223853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5789b50-19c7-42f3-bfe7-2d568bd206d5 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:45:21.231705 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4336/8698] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:45:21 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:45:21.362340 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d22e-f088-4ad7-b1cf-ffee1aa8d0aa None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:21.362770 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d22e-f088-4ad7-b1cf-ffee1aa8d0aa None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:21.363095 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251d22e-f088-4ad7-b1cf-ffee1aa8d0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:21.372558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfc412-2abf-4640-a76b-b3699613985c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:21.372855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfc412-2abf-4640-a76b-b3699613985c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:21.373130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfc412-2abf-4640-a76b-b3699613985c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:21.381690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a251d22e-f088-4ad7-b1cf-ffee1aa8d0aa None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:21.382920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a251d22e-f088-4ad7-b1cf-ffee1aa8d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:21.390178 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4363/8699] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:45:21 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:45:21.402339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251d22e-f088-4ad7-b1cf-ffee1aa8d0aa None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:45:21.411196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251d22e-f088-4ad7-b1cf-ffee1aa8d0aa None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:45:21.412346 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-0adfc412-2abf-4640-a76b-b3699613985c None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:21.413567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0adfc412-2abf-4640-a76b-b3699613985c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:21.415027 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2fbe8-56a6-41bc-8db9-56d13145cf8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:45:21.415711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2fbe8-56a6-41bc-8db9-56d13145cf8a service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:21.415997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2fbe8-56a6-41bc-8db9-56d13145cf8a service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:21.416276 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2fbe8-56a6-41bc-8db9-56d13145cf8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:21.422984 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4337/8700] 10.222.0.21 () {58 vars in 1058 bytes} [Sat Nov 27 21:45:21 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:45:21.423404 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2fbe8-56a6-41bc-8db9-56d13145cf8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:45:21.424843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2fbe8-56a6-41bc-8db9-56d13145cf8a service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:45:21.429029 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eec0ad-9aaa-40e5-8460-74bc518f7146 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:21.429325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eec0ad-9aaa-40e5-8460-74bc518f7146 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:21.429609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eec0ad-9aaa-40e5-8460-74bc518f7146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:21.433180 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4364/8701] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:45:21 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:45:21.448445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-69eec0ad-9aaa-40e5-8460-74bc518f7146 None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:21.449946 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-69eec0ad-9aaa-40e5-8460-74bc518f7146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:21.460090 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4338/8702] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:45:21 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:45:21.472597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2fbe8-56a6-41bc-8db9-56d13145cf8a service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:45:21.481561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2fbe8-56a6-41bc-8db9-56d13145cf8a service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:45:21.485172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcaa30-5202-44ea-96a1-97c586f3fbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:45:21.485874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcaa30-5202-44ea-96a1-97c586f3fbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:21.486228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcaa30-5202-44ea-96a1-97c586f3fbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:21.486568 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcaa30-5202-44ea-96a1-97c586f3fbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:21.497029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcaa30-5202-44ea-96a1-97c586f3fbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:45:21.498441 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcaa30-5202-44ea-96a1-97c586f3fbc4 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:45:21.510206 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4365/8703] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:45:21 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:45:21.527631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84a3ab-1142-49b2-9702-d0010f27371e None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:21.527925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84a3ab-1142-49b2-9702-d0010f27371e None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:21.528207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84a3ab-1142-49b2-9702-d0010f27371e None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:21.530013 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4339/8704] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 21:45:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:45:21.536290 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff47fe7-e640-4bca-a3c6-57fe25cc1e4c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:21.536583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff47fe7-e640-4bca-a3c6-57fe25cc1e4c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:21.536858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff47fe7-e640-4bca-a3c6-57fe25cc1e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:21.573515 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-aff47fe7-e640-4bca-a3c6-57fe25cc1e4c None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:21.574775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-aff47fe7-e640-4bca-a3c6-57fe25cc1e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:21.593515 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4366/8705] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:45:21 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:45:21.615628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84a3ab-1142-49b2-9702-d0010f27371e None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:45:21.633576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84a3ab-1142-49b2-9702-d0010f27371e None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:45:21.638652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970012f6-cba5-4d5b-b5b3-87cdd8e262d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:45:21.639335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970012f6-cba5-4d5b-b5b3-87cdd8e262d6 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:21.639677 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970012f6-cba5-4d5b-b5b3-87cdd8e262d6 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:21.639942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970012f6-cba5-4d5b-b5b3-87cdd8e262d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:21.648341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970012f6-cba5-4d5b-b5b3-87cdd8e262d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:45:21.649926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970012f6-cba5-4d5b-b5b3-87cdd8e262d6 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:45:21.660066 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4340/8706] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:45:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:45:22.685503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5503a3-2f95-4df9-a740-42d517391e77 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:22.686053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5503a3-2f95-4df9-a740-42d517391e77 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:22.686053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5503a3-2f95-4df9-a740-42d517391e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:22.704834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-aa5503a3-2f95-4df9-a740-42d517391e77 None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:22.705940 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-aa5503a3-2f95-4df9-a740-42d517391e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:22.715464 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4367/8707] 10.222.0.21 () {58 vars in 1058 bytes} [Sat Nov 27 21:45:22 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:45:22.721709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29d3cf-2a38-4a22-ba3a-9bc77e9b7876 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:22.722184 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29d3cf-2a38-4a22-ba3a-9bc77e9b7876 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:22.722298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29d3cf-2a38-4a22-ba3a-9bc77e9b7876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:22.740345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-2a29d3cf-2a38-4a22-ba3a-9bc77e9b7876 None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:22.741513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2a29d3cf-2a38-4a22-ba3a-9bc77e9b7876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:22.751217 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4341/8708] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:45:22 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:45:22.762396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5503a3-2f95-4df9-a740-42d517391e77 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:45:22.771511 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5503a3-2f95-4df9-a740-42d517391e77 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:45:22.775118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657a8f-541c-4b13-b177-d556a82c8a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:45:22.775776 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657a8f-541c-4b13-b177-d556a82c8a98 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:22.776056 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657a8f-541c-4b13-b177-d556a82c8a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:22.776328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657a8f-541c-4b13-b177-d556a82c8a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:22.786371 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91657a8f-541c-4b13-b177-d556a82c8a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:45:22.787844 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91657a8f-541c-4b13-b177-d556a82c8a98 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:45:22.799061 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4368/8709] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:45:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:45:39.348850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658471d7-66d1-4589-a715-275671655ddf None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:39.349487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658471d7-66d1-4589-a715-275671655ddf None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:39.349487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658471d7-66d1-4589-a715-275671655ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:39.367444 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-658471d7-66d1-4589-a715-275671655ddf None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:39.368626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-658471d7-66d1-4589-a715-275671655ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:39.374951 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4342/8710] 10.222.0.35 () {58 vars in 1015 bytes} [Sat Nov 27 21:45:39 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:45:39.394676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657a8f-541c-4b13-b177-d556a82c8a98 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:45:39.403264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657a8f-541c-4b13-b177-d556a82c8a98 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:45:39.407447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155899a7-2488-4e03-b658-ed70816c8f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:45:39.408070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155899a7-2488-4e03-b658-ed70816c8f47 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:39.408359 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155899a7-2488-4e03-b658-ed70816c8f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:39.408627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155899a7-2488-4e03-b658-ed70816c8f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:39.415729 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155899a7-2488-4e03-b658-ed70816c8f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:45:39.417366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155899a7-2488-4e03-b658-ed70816c8f47 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:45:39.425228 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4369/8711] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:45:39 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:45:40.119599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b66353-f004-45d5-8a06-db21b930fb69 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:40.119914 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b66353-f004-45d5-8a06-db21b930fb69 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:40.120258 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b66353-f004-45d5-8a06-db21b930fb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:40.140151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-f0b66353-f004-45d5-8a06-db21b930fb69 None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:40.141361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f0b66353-f004-45d5-8a06-db21b930fb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:40.150893 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4343/8712] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:45:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:45:40.175958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155899a7-2488-4e03-b658-ed70816c8f47 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:45:40.190754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155899a7-2488-4e03-b658-ed70816c8f47 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:45:40.196962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ddb7b-3202-4999-91b7-e545032e3762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:45:40.197307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ddb7b-3202-4999-91b7-e545032e3762 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:40.197676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ddb7b-3202-4999-91b7-e545032e3762 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:40.197883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ddb7b-3202-4999-91b7-e545032e3762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:40.208196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ddb7b-3202-4999-91b7-e545032e3762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:45:40.209862 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ddb7b-3202-4999-91b7-e545032e3762 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:45:40.223160 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4370/8713] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:45:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:45:44.993351 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5047b-4ee3-4f13-be3c-d96a5cbce72b None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:44.993921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5047b-4ee3-4f13-be3c-d96a5cbce72b None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:44.994224 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5047b-4ee3-4f13-be3c-d96a5cbce72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:45.017995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-14b5047b-4ee3-4f13-be3c-d96a5cbce72b None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:45.019354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-14b5047b-4ee3-4f13-be3c-d96a5cbce72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:45.030551 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4344/8714] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:45:44 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:45:45.048536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ddb7b-3202-4999-91b7-e545032e3762 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:45:45.077761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ddb7b-3202-4999-91b7-e545032e3762 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:45:45.083459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e785db-2f67-496f-ba55-c1b38baa2a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:45:45.084179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e785db-2f67-496f-ba55-c1b38baa2a98 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:45.084534 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e785db-2f67-496f-ba55-c1b38baa2a98 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:45.084880 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e785db-2f67-496f-ba55-c1b38baa2a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:45.094522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e785db-2f67-496f-ba55-c1b38baa2a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:45:45.096127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e785db-2f67-496f-ba55-c1b38baa2a98 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:45:45.106323 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4371/8715] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:45:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:45:47.525260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ca06-9b13-4aad-87b1-3a5574252b8c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:47.525747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ca06-9b13-4aad-87b1-3a5574252b8c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:47.525747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2ca06-9b13-4aad-87b1-3a5574252b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:47.545895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8da2ca06-9b13-4aad-87b1-3a5574252b8c None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:47.547395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8da2ca06-9b13-4aad-87b1-3a5574252b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:47.558753 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4345/8716] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:45:47 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:45:47.586227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e785db-2f67-496f-ba55-c1b38baa2a98 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:45:47.597415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e785db-2f67-496f-ba55-c1b38baa2a98 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:45:47.603415 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edb186-22ab-4026-baa0-0cbff00090d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:45:47.604836 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edb186-22ab-4026-baa0-0cbff00090d9 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:47.605150 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edb186-22ab-4026-baa0-0cbff00090d9 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:47.605418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edb186-22ab-4026-baa0-0cbff00090d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:47.615570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edb186-22ab-4026-baa0-0cbff00090d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:45:47.617455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edb186-22ab-4026-baa0-0cbff00090d9 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:45:47.629680 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4372/8717] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:45:47 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:45:55.709733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be867af-0247-414a-87ec-fbb61d813b44 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:45:55.710217 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be867af-0247-414a-87ec-fbb61d813b44 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:45:55.710328 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be867af-0247-414a-87ec-fbb61d813b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:45:55.728104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5be867af-0247-414a-87ec-fbb61d813b44 None None] MFA Rules not processed for user `df0509ba3bea4d9f893f5c966b9efd46`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:45:55.729288 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5be867af-0247-414a-87ec-fbb61d813b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:45:55.736156 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4346/8718] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:45:55 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:47:08.221411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edb186-22ab-4026-baa0-0cbff00090d9 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:47:08.262240 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edb186-22ab-4026-baa0-0cbff00090d9 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:47:08.267917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d227bdb-7075-45e4-a4e2-2829d86e5a1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:47:08.268550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d227bdb-7075-45e4-a4e2-2829d86e5a1c service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:47:08.268834 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d227bdb-7075-45e4-a4e2-2829d86e5a1c service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:47:08.269111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d227bdb-7075-45e4-a4e2-2829d86e5a1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:47:08.276765 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d227bdb-7075-45e4-a4e2-2829d86e5a1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:47:08.278347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d227bdb-7075-45e4-a4e2-2829d86e5a1c service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:47:08.287054 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4373/8719] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:47:08 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:47:08.343666 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be867af-0247-414a-87ec-fbb61d813b44 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:47:08.372122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be867af-0247-414a-87ec-fbb61d813b44 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:47:08.377634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd23485-fb4f-437c-a7a4-94e60a065533 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:47:08.378265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23485-fb4f-437c-a7a4-94e60a065533 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:47:08.378547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23485-fb4f-437c-a7a4-94e60a065533 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:47:08.378822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd23485-fb4f-437c-a7a4-94e60a065533 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:47:08.387201 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd23485-fb4f-437c-a7a4-94e60a065533 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:47:08.388801 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd23485-fb4f-437c-a7a4-94e60a065533 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:47:08.398434 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4347/8720] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:47:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:47:21.519976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d227bdb-7075-45e4-a4e2-2829d86e5a1c service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:47:21.530718 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d227bdb-7075-45e4-a4e2-2829d86e5a1c service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:47:21.536428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b678-c227-48b5-9c02-d5bb5b52e188 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:47:21.537055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b678-c227-48b5-9c02-d5bb5b52e188 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:47:21.537337 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b678-c227-48b5-9c02-d5bb5b52e188 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:47:21.537611 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b678-c227-48b5-9c02-d5bb5b52e188 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:47:21.545792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b678-c227-48b5-9c02-d5bb5b52e188 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:47:21.547425 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b678-c227-48b5-9c02-d5bb5b52e188 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:47:21.557490 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4374/8721] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:47:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:48:41.929604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36d41-5572-48af-9417-3af466d4d859 None None] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:48:41.930245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36d41-5572-48af-9417-3af466d4d859 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:48:41.930245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e36d41-5572-48af-9417-3af466d4d859 None None] PATH_INFO: `/` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:48:41.932110 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4348/8722] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 21:48:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:48:41.937446 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b741b-e746-4c5a-bab6-769aa88794ad None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:48:41.937921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b741b-e746-4c5a-bab6-769aa88794ad None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:48:41.938053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b741b-e746-4c5a-bab6-769aa88794ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:48:41.965883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-711b741b-e746-4c5a-bab6-769aa88794ad None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:48:41.967654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-711b741b-e746-4c5a-bab6-769aa88794ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:48:41.986625 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4375/8723] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:48:41 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:48:42.007668 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e36d41-5572-48af-9417-3af466d4d859 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:48:42.021322 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e36d41-5572-48af-9417-3af466d4d859 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:48:42.026057 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d3253-d1a4-47d2-8874-816df5d6d088 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:48:42.026682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d3253-d1a4-47d2-8874-816df5d6d088 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:48:42.026964 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d3253-d1a4-47d2-8874-816df5d6d088 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:48:42.027238 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d3253-d1a4-47d2-8874-816df5d6d088 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:48:42.035983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d3253-d1a4-47d2-8874-816df5d6d088 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:48:42.037545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d3253-d1a4-47d2-8874-816df5d6d088 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:48:42.046973 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4349/8724] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:48:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:48:42.201607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b741b-e746-4c5a-bab6-769aa88794ad None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:48:42.211937 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b741b-e746-4c5a-bab6-769aa88794ad None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:48:42.217651 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb88e19-b3c6-4872-8876-97cf4e53e310 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:48:42.218279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb88e19-b3c6-4872-8876-97cf4e53e310 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:48:42.218566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb88e19-b3c6-4872-8876-97cf4e53e310 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:48:42.218845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb88e19-b3c6-4872-8876-97cf4e53e310 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:48:42.227169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb88e19-b3c6-4872-8876-97cf4e53e310 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:48:42.228771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb88e19-b3c6-4872-8876-97cf4e53e310 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:48:42.238745 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4376/8725] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:48:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:49:20.184573 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d3253-d1a4-47d2-8874-816df5d6d088 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:20.186152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ae1d3253-d1a4-47d2-8874-816df5d6d088 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:20.253176 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d3253-d1a4-47d2-8874-816df5d6d088 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:20.256947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51205cc3-6f0f-47a6-9a93-7af147d204c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:20.257582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51205cc3-6f0f-47a6-9a93-7af147d204c3 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:20.257860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51205cc3-6f0f-47a6-9a93-7af147d204c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:20.258130 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51205cc3-6f0f-47a6-9a93-7af147d204c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:20.260042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-51205cc3-6f0f-47a6-9a93-7af147d204c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:20.340253 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51205cc3-6f0f-47a6-9a93-7af147d204c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:20.341679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51205cc3-6f0f-47a6-9a93-7af147d204c3 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:20.360310 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4350/8726] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:49:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:49:23.310096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb88e19-b3c6-4872-8876-97cf4e53e310 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:23.312119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9eb88e19-b3c6-4872-8876-97cf4e53e310 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:23.333380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb88e19-b3c6-4872-8876-97cf4e53e310 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:23.338299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9d9a4-5104-4f97-bc42-feaa98f5145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:23.339449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9d9a4-5104-4f97-bc42-feaa98f5145b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:23.339799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9d9a4-5104-4f97-bc42-feaa98f5145b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:23.340157 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9d9a4-5104-4f97-bc42-feaa98f5145b admin admin] PATH_INFO: `/v3/users/df0509ba3bea4d9f893f5c966b9efd46` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:23.361221 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9d9a4-5104-4f97-bc42-feaa98f5145b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0509ba3bea4d9f893f5c966b9efd46)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:23.363153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9d9a4-5104-4f97-bc42-feaa98f5145b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:23.409304 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-75b9d9a4-5104-4f97-bc42-feaa98f5145b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0509ba3bea4d9f893f5c966b9efd46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:23.416087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-75b9d9a4-5104-4f97-bc42-feaa98f5145b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0509ba3bea4d9f893f5c966b9efd46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:23.416733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-75b9d9a4-5104-4f97-bc42-feaa98f5145b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0509ba3bea4d9f893f5c966b9efd46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:23.423674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-75b9d9a4-5104-4f97-bc42-feaa98f5145b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0509ba3bea4d9f893f5c966b9efd46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:23.435522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-75b9d9a4-5104-4f97-bc42-feaa98f5145b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0509ba3bea4d9f893f5c966b9efd46'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:23.442493 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4377/8727] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:49:23 2021] DELETE /identity/v3/users/df0509ba3bea4d9f893f5c966b9efd46 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:49:23.613203 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51205cc3-6f0f-47a6-9a93-7af147d204c3 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:23.623856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51205cc3-6f0f-47a6-9a93-7af147d204c3 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:23.681606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:23.682461 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:23.682743 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:23.683047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] PATH_INFO: `/v3/projects/8ac362e2c70a4862919a7dfcd5f32167` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:23.693890 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac362e2c70a4862919a7dfcd5f32167)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:23.695852 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:23.740139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac362e2c70a4862919a7dfcd5f32167', 'request_id': 'req-542f1133-5331-4b40-8a0e-51b79e68887c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:23.746430 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac362e2c70a4862919a7dfcd5f32167', 'request_id': 'req-542f1133-5331-4b40-8a0e-51b79e68887c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:23.754397 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac362e2c70a4862919a7dfcd5f32167', 'request_id': 'req-542f1133-5331-4b40-8a0e-51b79e68887c'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:23.764374 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] The token cache is being invalidate because project 8ac362e2c70a4862919a7dfcd5f32167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:49:23.764659 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:23.765279 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-542f1133-5331-4b40-8a0e-51b79e68887c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:23.767369 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4351/8728] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:49:23 2021] DELETE /identity/v3/projects/8ac362e2c70a4862919a7dfcd5f32167 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:49:23.773170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffd712-61a0-4ef8-9b90-57185535c914 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:23.773460 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffd712-61a0-4ef8-9b90-57185535c914 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:23.773736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffd712-61a0-4ef8-9b90-57185535c914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:23.830744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-fdffd712-61a0-4ef8-9b90-57185535c914 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:49:23.832209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fdffd712-61a0-4ef8-9b90-57185535c914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:23.889967 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4378/8729] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:49:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:49:23.897840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed7a1-846a-4cec-952b-c5a44fc8dda1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:23.898484 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed7a1-846a-4cec-952b-c5a44fc8dda1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:23.898679 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed7a1-846a-4cec-952b-c5a44fc8dda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:23.916449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c70ed7a1-846a-4cec-952b-c5a44fc8dda1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:49:23.917654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c70ed7a1-846a-4cec-952b-c5a44fc8dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:23.926248 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4352/8730] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:49:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:49:23.930490 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffd712-61a0-4ef8-9b90-57185535c914 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:23.941335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffd712-61a0-4ef8-9b90-57185535c914 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:23.946067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c515a6-1b0e-40b1-b28e-010d8dc8a272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:23.946728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c515a6-1b0e-40b1-b28e-010d8dc8a272 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:23.947014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c515a6-1b0e-40b1-b28e-010d8dc8a272 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:23.947327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c515a6-1b0e-40b1-b28e-010d8dc8a272 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:23.948069 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c515a6-1b0e-40b1-b28e-010d8dc8a272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:49:23.948386 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c515a6-1b0e-40b1-b28e-010d8dc8a272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:23.949989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c515a6-1b0e-40b1-b28e-010d8dc8a272 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:23.962062 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4379/8731] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:49:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 27 21:49:23.966458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ed7a1-846a-4cec-952b-c5a44fc8dda1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:23.976032 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ed7a1-846a-4cec-952b-c5a44fc8dda1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:23.980759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e96801-0d09-4f7b-a3b4-bbdcba532fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:23.981415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e96801-0d09-4f7b-a3b4-bbdcba532fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:23.981703 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e96801-0d09-4f7b-a3b4-bbdcba532fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:23.981978 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e96801-0d09-4f7b-a3b4-bbdcba532fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:23.982682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e96801-0d09-4f7b-a3b4-bbdcba532fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:23.985122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e96801-0d09-4f7b-a3b4-bbdcba532fe1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:24.024549 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4353/8732] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:49:23 2021] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:49:24.025793 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c515a6-1b0e-40b1-b28e-010d8dc8a272 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:24.039351 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c515a6-1b0e-40b1-b28e-010d8dc8a272 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:24.097099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac3587-f978-4cc4-b3e1-c3a8308a0dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:24.097820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac3587-f978-4cc4-b3e1-c3a8308a0dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:24.098423 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac3587-f978-4cc4-b3e1-c3a8308a0dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:24.098794 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac3587-f978-4cc4-b3e1-c3a8308a0dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:24.099799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac3587-f978-4cc4-b3e1-c3a8308a0dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:24.102412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac3587-f978-4cc4-b3e1-c3a8308a0dd3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:24.121742 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4380/8733] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:49:24 2021] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:49:24.126468 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e96801-0d09-4f7b-a3b4-bbdcba532fe1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:24.137234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e96801-0d09-4f7b-a3b4-bbdcba532fe1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:24.141863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b15349-b69b-4e64-9c21-038538ed0824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:24.142514 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15349-b69b-4e64-9c21-038538ed0824 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:24.142796 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15349-b69b-4e64-9c21-038538ed0824 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:24.143071 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15349-b69b-4e64-9c21-038538ed0824 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:24.143836 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b15349-b69b-4e64-9c21-038538ed0824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:24.145429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b15349-b69b-4e64-9c21-038538ed0824 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:24.155508 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4354/8734] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:49:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:49:24.159728 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac3587-f978-4cc4-b3e1-c3a8308a0dd3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:24.169654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac3587-f978-4cc4-b3e1-c3a8308a0dd3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:24.175145 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61864ff-8705-4698-bfcc-a4c19581054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:24.175857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61864ff-8705-4698-bfcc-a4c19581054f admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:24.176138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61864ff-8705-4698-bfcc-a4c19581054f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:24.176412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61864ff-8705-4698-bfcc-a4c19581054f admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:24.177147 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61864ff-8705-4698-bfcc-a4c19581054f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:24.178760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61864ff-8705-4698-bfcc-a4c19581054f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:24.188649 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4381/8735] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:49:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:49:24.192537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b15349-b69b-4e64-9c21-038538ed0824 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:24.202433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b15349-b69b-4e64-9c21-038538ed0824 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:24.207053 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4b59c-2cd2-489c-a30a-5b3bbf993a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:24.207959 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4b59c-2cd2-489c-a30a-5b3bbf993a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:24.208243 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4b59c-2cd2-489c-a30a-5b3bbf993a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:24.208517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4b59c-2cd2-489c-a30a-5b3bbf993a42 admin admin] PATH_INFO: `/v3/projects/22da8510e20f4540924f5d45f11f0d9f/users/a9b5e9107eab489f9ad4d198b9b92313/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:24.223306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4b59c-2cd2-489c-a30a-5b3bbf993a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22da8510e20f4540924f5d45f11f0d9f, user_id=a9b5e9107eab489f9ad4d198b9b92313, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:24.225958 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4b59c-2cd2-489c-a30a-5b3bbf993a42 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:24.238985 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4355/8736] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:49:24 2021] PUT /identity/v3/projects/22da8510e20f4540924f5d45f11f0d9f/users/a9b5e9107eab489f9ad4d198b9b92313/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:49:24.244215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3155fe-0081-4286-9102-21707bd468eb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:24.244443 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3155fe-0081-4286-9102-21707bd468eb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:24.244719 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3155fe-0081-4286-9102-21707bd468eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:24.262336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1b3155fe-0081-4286-9102-21707bd468eb None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:49:24.263581 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1b3155fe-0081-4286-9102-21707bd468eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:24.320091 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4382/8737] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:49:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:49:24.330570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4b59c-2cd2-489c-a30a-5b3bbf993a42 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:24.332413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a5a4b59c-2cd2-489c-a30a-5b3bbf993a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:24.387519 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4b59c-2cd2-489c-a30a-5b3bbf993a42 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:24.391222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d4c64-7090-4652-919c-e182ce321001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:24.391885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d4c64-7090-4652-919c-e182ce321001 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:24.392171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d4c64-7090-4652-919c-e182ce321001 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:24.392447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d4c64-7090-4652-919c-e182ce321001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:24.401408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d4c64-7090-4652-919c-e182ce321001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:24.402854 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d4c64-7090-4652-919c-e182ce321001 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:24.412822 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4356/8738] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:49:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:49:25.011815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19ec31-03b5-40a1-8a3c-ebe5427a1a4b None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:25.012125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19ec31-03b5-40a1-8a3c-ebe5427a1a4b None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:25.012411 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19ec31-03b5-40a1-8a3c-ebe5427a1a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:25.039564 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0a19ec31-03b5-40a1-8a3c-ebe5427a1a4b None None] MFA Rules not processed for user `a9b5e9107eab489f9ad4d198b9b92313`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:49:25.040807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0a19ec31-03b5-40a1-8a3c-ebe5427a1a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:25.104400 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4383/8739] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:49:25 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:49:25.114832 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f77a94-63c7-4cdb-8aef-38c6744d7c8f None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:25.115401 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f77a94-63c7-4cdb-8aef-38c6744d7c8f None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:25.115513 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f77a94-63c7-4cdb-8aef-38c6744d7c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:25.133415 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-82f77a94-63c7-4cdb-8aef-38c6744d7c8f None None] MFA Rules not processed for user `a9b5e9107eab489f9ad4d198b9b92313`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:49:25.134605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-82f77a94-63c7-4cdb-8aef-38c6744d7c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:25.142278 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4357/8740] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:49:25 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:49:25.153573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19ec31-03b5-40a1-8a3c-ebe5427a1a4b None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:25.155054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0a19ec31-03b5-40a1-8a3c-ebe5427a1a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:25.226080 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19ec31-03b5-40a1-8a3c-ebe5427a1a4b None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:25.231850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e58a45-b8f6-41b3-8585-ee113e68195f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:25.232509 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58a45-b8f6-41b3-8585-ee113e68195f service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:25.232800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58a45-b8f6-41b3-8585-ee113e68195f service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:25.233075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e58a45-b8f6-41b3-8585-ee113e68195f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:25.241403 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e58a45-b8f6-41b3-8585-ee113e68195f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:25.242999 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e58a45-b8f6-41b3-8585-ee113e68195f service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:25.252523 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4384/8741] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:49:25 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:49:25.476289 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c3ec-613f-46ab-ade6-c38217193151 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:25.476611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c3ec-613f-46ab-ade6-c38217193151 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:25.476887 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c3ec-613f-46ab-ade6-c38217193151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:25.495599 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-41f6c3ec-613f-46ab-ade6-c38217193151 None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:49:25.496795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-41f6c3ec-613f-46ab-ade6-c38217193151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:25.504237 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4358/8742] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:49:25 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:49:25.515923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e58a45-b8f6-41b3-8585-ee113e68195f service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:25.525197 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e58a45-b8f6-41b3-8585-ee113e68195f service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:25.528843 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124a4a3-318e-449f-8cc5-ab07e42616ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:25.529486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124a4a3-318e-449f-8cc5-ab07e42616ea service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:25.529769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124a4a3-318e-449f-8cc5-ab07e42616ea service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:25.530048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124a4a3-318e-449f-8cc5-ab07e42616ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:25.537053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124a4a3-318e-449f-8cc5-ab07e42616ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:25.538476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124a4a3-318e-449f-8cc5-ab07e42616ea service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:25.546252 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4385/8743] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:49:25 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:49:25.864398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c3ec-613f-46ab-ade6-c38217193151 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:25.865838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-41f6c3ec-613f-46ab-ade6-c38217193151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:25.948947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c3ec-613f-46ab-ade6-c38217193151 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:25.953925 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1926a-a1cb-41b3-ad59-ae3ee6cbfd93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:25.954558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1926a-a1cb-41b3-ad59-ae3ee6cbfd93 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:25.954838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1926a-a1cb-41b3-ad59-ae3ee6cbfd93 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:25.955110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1926a-a1cb-41b3-ad59-ae3ee6cbfd93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:25.956864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-04e1926a-a1cb-41b3-ad59-ae3ee6cbfd93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:25.968896 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1926a-a1cb-41b3-ad59-ae3ee6cbfd93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:25.970986 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1926a-a1cb-41b3-ad59-ae3ee6cbfd93 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:25.980465 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4359/8744] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:49:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:49:27.830664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124a4a3-318e-449f-8cc5-ab07e42616ea service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:27.839224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124a4a3-318e-449f-8cc5-ab07e42616ea service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:27.842901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a54cd-a70d-42bf-b984-5416a36fb517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:27.843573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a54cd-a70d-42bf-b984-5416a36fb517 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:27.843842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a54cd-a70d-42bf-b984-5416a36fb517 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:27.844115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a54cd-a70d-42bf-b984-5416a36fb517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:27.846502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-650a54cd-a70d-42bf-b984-5416a36fb517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:27.856736 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a54cd-a70d-42bf-b984-5416a36fb517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:27.858171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a54cd-a70d-42bf-b984-5416a36fb517 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:27.866622 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4386/8745] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:49:27 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:49:35.523207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ac17b-4cda-4ecd-837e-508f89e532e3 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:35.523784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ac17b-4cda-4ecd-837e-508f89e532e3 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:35.523784 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ac17b-4cda-4ecd-837e-508f89e532e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:35.540822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b70ac17b-4cda-4ecd-837e-508f89e532e3 None None] MFA Rules not processed for user `a9b5e9107eab489f9ad4d198b9b92313`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:49:35.541990 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b70ac17b-4cda-4ecd-837e-508f89e532e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:35.549386 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4360/8746] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:49:35 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:49:54.677346 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a54cd-a70d-42bf-b984-5416a36fb517 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:54.688696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a54cd-a70d-42bf-b984-5416a36fb517 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:54.693819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773d5bf-551d-4423-a535-d047ab80ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:54.694708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773d5bf-551d-4423-a535-d047ab80ea6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:54.694989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773d5bf-551d-4423-a535-d047ab80ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:54.695287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773d5bf-551d-4423-a535-d047ab80ea6f admin admin] PATH_INFO: `/v3/users/a9b5e9107eab489f9ad4d198b9b92313` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:54.696510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773d5bf-551d-4423-a535-d047ab80ea6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b5e9107eab489f9ad4d198b9b92313)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:54.698518 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773d5bf-551d-4423-a535-d047ab80ea6f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:54.745447 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e773d5bf-551d-4423-a535-d047ab80ea6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b5e9107eab489f9ad4d198b9b92313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:54.753143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e773d5bf-551d-4423-a535-d047ab80ea6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b5e9107eab489f9ad4d198b9b92313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:54.754014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e773d5bf-551d-4423-a535-d047ab80ea6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b5e9107eab489f9ad4d198b9b92313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:54.760818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e773d5bf-551d-4423-a535-d047ab80ea6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b5e9107eab489f9ad4d198b9b92313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:54.772109 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e773d5bf-551d-4423-a535-d047ab80ea6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b5e9107eab489f9ad4d198b9b92313'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:54.777765 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4387/8747] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:49:54 2021] DELETE /identity/v3/users/a9b5e9107eab489f9ad4d198b9b92313 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:49:54.946919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ac17b-4cda-4ecd-837e-508f89e532e3 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:54.959939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ac17b-4cda-4ecd-837e-508f89e532e3 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:55.016345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:55.017232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:55.017515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:55.017790 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] PATH_INFO: `/v3/projects/22da8510e20f4540924f5d45f11f0d9f` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:55.019002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=22da8510e20f4540924f5d45f11f0d9f)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:55.020965 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:55.066681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22da8510e20f4540924f5d45f11f0d9f', 'request_id': 'req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:55.072575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22da8510e20f4540924f5d45f11f0d9f', 'request_id': 'req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:55.079376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22da8510e20f4540924f5d45f11f0d9f', 'request_id': 'req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:55.089239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] The token cache is being invalidate because project 22da8510e20f4540924f5d45f11f0d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:49:55.089526 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:55.090152 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-d7a73ecd-3652-4ab9-afcc-a1bec4d2b7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:49:55.091735 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4361/8748] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:49:54 2021] DELETE /identity/v3/projects/22da8510e20f4540924f5d45f11f0d9f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:49:55.098040 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa6cd5-7a82-4bed-8a68-0ba91fa1c222 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:55.098319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa6cd5-7a82-4bed-8a68-0ba91fa1c222 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:55.098595 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa6cd5-7a82-4bed-8a68-0ba91fa1c222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:55.116910 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-dbaa6cd5-7a82-4bed-8a68-0ba91fa1c222 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:49:55.118102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dbaa6cd5-7a82-4bed-8a68-0ba91fa1c222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:55.175665 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4388/8749] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:49:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:49:55.184469 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c175-f424-4b55-95ec-d41852ce51cc None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:55.184765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c175-f424-4b55-95ec-d41852ce51cc None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:55.185041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c175-f424-4b55-95ec-d41852ce51cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:55.204411 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8e42c175-f424-4b55-95ec-d41852ce51cc None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:49:55.206047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8e42c175-f424-4b55-95ec-d41852ce51cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:55.213937 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4362/8750] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:49:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:49:55.218158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa6cd5-7a82-4bed-8a68-0ba91fa1c222 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:55.228527 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa6cd5-7a82-4bed-8a68-0ba91fa1c222 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:55.233241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825eaf1-f043-43a1-bb25-7f6113152614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:55.233896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825eaf1-f043-43a1-bb25-7f6113152614 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:55.234183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825eaf1-f043-43a1-bb25-7f6113152614 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:55.234459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825eaf1-f043-43a1-bb25-7f6113152614 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:55.235358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825eaf1-f043-43a1-bb25-7f6113152614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:49:55.235669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825eaf1-f043-43a1-bb25-7f6113152614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:55.237261 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825eaf1-f043-43a1-bb25-7f6113152614 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:55.248485 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4389/8751] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:49:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:49:55.252787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c175-f424-4b55-95ec-d41852ce51cc None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:55.262222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c175-f424-4b55-95ec-d41852ce51cc None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:55.266921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ea1c5-91eb-43cb-bad0-6ab31d4ef05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:55.268083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ea1c5-91eb-43cb-bad0-6ab31d4ef05d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:55.268367 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ea1c5-91eb-43cb-bad0-6ab31d4ef05d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:55.268640 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ea1c5-91eb-43cb-bad0-6ab31d4ef05d admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:55.269361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ea1c5-91eb-43cb-bad0-6ab31d4ef05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:55.271242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ea1c5-91eb-43cb-bad0-6ab31d4ef05d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:55.295741 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4363/8752] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:49:55 2021] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:49:55.299812 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825eaf1-f043-43a1-bb25-7f6113152614 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:55.309498 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825eaf1-f043-43a1-bb25-7f6113152614 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:55.364497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889823-0886-4c0d-81f6-39c5aa9ca39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:55.365167 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889823-0886-4c0d-81f6-39c5aa9ca39a admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:55.365452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889823-0886-4c0d-81f6-39c5aa9ca39a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:55.365734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889823-0886-4c0d-81f6-39c5aa9ca39a admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:55.366872 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889823-0886-4c0d-81f6-39c5aa9ca39a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:55.368829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889823-0886-4c0d-81f6-39c5aa9ca39a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:55.388236 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4390/8753] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:49:55 2021] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:49:55.392919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ea1c5-91eb-43cb-bad0-6ab31d4ef05d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:55.403081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ea1c5-91eb-43cb-bad0-6ab31d4ef05d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:55.408302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28062ea-89fc-4d2e-8b22-e361a96b2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:55.408961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28062ea-89fc-4d2e-8b22-e361a96b2dad admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:55.409257 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28062ea-89fc-4d2e-8b22-e361a96b2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:55.409535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28062ea-89fc-4d2e-8b22-e361a96b2dad admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:55.410266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28062ea-89fc-4d2e-8b22-e361a96b2dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:55.411902 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28062ea-89fc-4d2e-8b22-e361a96b2dad admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:55.422036 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4364/8754] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:49:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:49:55.425951 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889823-0886-4c0d-81f6-39c5aa9ca39a admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:55.435669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889823-0886-4c0d-81f6-39c5aa9ca39a admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:55.440299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e131e7-5345-47cd-83a2-57249fcff234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:55.440943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e131e7-5345-47cd-83a2-57249fcff234 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:55.441224 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e131e7-5345-47cd-83a2-57249fcff234 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:55.441500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e131e7-5345-47cd-83a2-57249fcff234 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:55.442253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e131e7-5345-47cd-83a2-57249fcff234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:55.443864 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e131e7-5345-47cd-83a2-57249fcff234 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:55.453551 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4391/8755] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:49:55 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:49:55.458234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28062ea-89fc-4d2e-8b22-e361a96b2dad admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:55.468198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28062ea-89fc-4d2e-8b22-e361a96b2dad admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:55.473472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc772aa-3edb-4e3f-bfd2-e1669a89edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:55.474360 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc772aa-3edb-4e3f-bfd2-e1669a89edbe admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:55.474645 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc772aa-3edb-4e3f-bfd2-e1669a89edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:55.474923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc772aa-3edb-4e3f-bfd2-e1669a89edbe admin admin] PATH_INFO: `/v3/projects/0f1b366de851417abdd0fd53c9f3c0e1/users/ab91ee3f15c94533a7a947f9335e296e/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:55.489325 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc772aa-3edb-4e3f-bfd2-e1669a89edbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1b366de851417abdd0fd53c9f3c0e1, user_id=ab91ee3f15c94533a7a947f9335e296e, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:55.492051 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc772aa-3edb-4e3f-bfd2-e1669a89edbe admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:55.505369 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4365/8756] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:49:55 2021] PUT /identity/v3/projects/0f1b366de851417abdd0fd53c9f3c0e1/users/ab91ee3f15c94533a7a947f9335e296e/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:49:55.515448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d3d00-2b67-42f4-bf07-29742d7ff29e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:55.515758 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d3d00-2b67-42f4-bf07-29742d7ff29e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:55.516039 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d3d00-2b67-42f4-bf07-29742d7ff29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:55.542690 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f15d3d00-2b67-42f4-bf07-29742d7ff29e None None] MFA Rules not processed for user `ab91ee3f15c94533a7a947f9335e296e`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:49:55.543908 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f15d3d00-2b67-42f4-bf07-29742d7ff29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:55.606780 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4392/8757] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:49:55 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:49:55.617263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc772aa-3edb-4e3f-bfd2-e1669a89edbe admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:49:55.618922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7bc772aa-3edb-4e3f-bfd2-e1669a89edbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:49:55.674419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc772aa-3edb-4e3f-bfd2-e1669a89edbe admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:49:55.678146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dafc8-f1af-4f26-92ba-ea819bed8e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:49:55.678777 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dafc8-f1af-4f26-92ba-ea819bed8e2a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:49:55.679060 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dafc8-f1af-4f26-92ba-ea819bed8e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:49:55.679479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dafc8-f1af-4f26-92ba-ea819bed8e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:49:55.687722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dafc8-f1af-4f26-92ba-ea819bed8e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:49:55.689764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dafc8-f1af-4f26-92ba-ea819bed8e2a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:49:55.698513 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4366/8758] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:49:55 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:50:05.716516 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d3d00-2b67-42f4-bf07-29742d7ff29e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:05.781808 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d3d00-2b67-42f4-bf07-29742d7ff29e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:05.786517 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:05.787399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:05.787682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:05.787962 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] PATH_INFO: `/v3/users/ab91ee3f15c94533a7a947f9335e296e` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:05.789166 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab91ee3f15c94533a7a947f9335e296e)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:05.791075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:05.834293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab91ee3f15c94533a7a947f9335e296e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:05.841265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab91ee3f15c94533a7a947f9335e296e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:05.841913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab91ee3f15c94533a7a947f9335e296e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:05.848653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab91ee3f15c94533a7a947f9335e296e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:05.860154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab91ee3f15c94533a7a947f9335e296e'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:05.866428 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4393/8759] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:50:05 2021] DELETE /identity/v3/users/ab91ee3f15c94533a7a947f9335e296e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:50:05.870922 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625b7a-a9cc-4ee2-aee7-06ec66e07252 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:05.871443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625b7a-a9cc-4ee2-aee7-06ec66e07252 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:05.871553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625b7a-a9cc-4ee2-aee7-06ec66e07252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:05.888860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-02625b7a-a9cc-4ee2-aee7-06ec66e07252 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:05.890047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-02625b7a-a9cc-4ee2-aee7-06ec66e07252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:05.949134 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4367/8760] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:50:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:05.959118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:05.960696 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:06.024547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d021b94-30b3-42f7-95c8-2c181db06b65 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:06.028377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3083ee-8727-4dc2-97c6-bda3510c9f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:06.029018 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3083ee-8727-4dc2-97c6-bda3510c9f63 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.029300 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3083ee-8727-4dc2-97c6-bda3510c9f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.029571 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3083ee-8727-4dc2-97c6-bda3510c9f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.038883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3083ee-8727-4dc2-97c6-bda3510c9f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:06.040353 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3083ee-8727-4dc2-97c6-bda3510c9f63 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:06.050272 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4394/8761] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:50:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:50:06.212971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02625b7a-a9cc-4ee2-aee7-06ec66e07252 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:06.214407 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-02625b7a-a9cc-4ee2-aee7-06ec66e07252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:06.231646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02625b7a-a9cc-4ee2-aee7-06ec66e07252 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:06.237888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:06.238702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.238983 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.239282 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] PATH_INFO: `/v3/projects/0f1b366de851417abdd0fd53c9f3c0e1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.240702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1b366de851417abdd0fd53c9f3c0e1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:06.242597 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:06.287999 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1b366de851417abdd0fd53c9f3c0e1', 'request_id': 'req-0a8c7043-e7c6-4e73-b393-f267990216d8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:06.293920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1b366de851417abdd0fd53c9f3c0e1', 'request_id': 'req-0a8c7043-e7c6-4e73-b393-f267990216d8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:06.300741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1b366de851417abdd0fd53c9f3c0e1', 'request_id': 'req-0a8c7043-e7c6-4e73-b393-f267990216d8'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:06.310792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] The token cache is being invalidate because project 0f1b366de851417abdd0fd53c9f3c0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:50:06.311052 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:06.311735 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-0a8c7043-e7c6-4e73-b393-f267990216d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:06.313250 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4368/8762] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:50:06 2021] DELETE /identity/v3/projects/0f1b366de851417abdd0fd53c9f3c0e1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:50:06.319905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edca9f-8d0a-4b15-93de-facafa51847a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.320199 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edca9f-8d0a-4b15-93de-facafa51847a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.320480 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edca9f-8d0a-4b15-93de-facafa51847a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.338730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-18edca9f-8d0a-4b15-93de-facafa51847a None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:06.339950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-18edca9f-8d0a-4b15-93de-facafa51847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:06.397189 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4395/8763] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:50:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:06.404882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c317a-5f01-45b7-bfe7-17d488679175 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.405171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c317a-5f01-45b7-bfe7-17d488679175 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.405445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c317a-5f01-45b7-bfe7-17d488679175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.424159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-769c317a-5f01-45b7-bfe7-17d488679175 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:06.425363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-769c317a-5f01-45b7-bfe7-17d488679175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:06.433507 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4369/8764] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:50:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:06.437800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edca9f-8d0a-4b15-93de-facafa51847a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:06.448288 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edca9f-8d0a-4b15-93de-facafa51847a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:06.452905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02cef-f341-4c65-b06e-16217bb24d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:06.453562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02cef-f341-4c65-b06e-16217bb24d28 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.453850 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02cef-f341-4c65-b06e-16217bb24d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.454181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02cef-f341-4c65-b06e-16217bb24d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.454918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02cef-f341-4c65-b06e-16217bb24d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:50:06.455227 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02cef-f341-4c65-b06e-16217bb24d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:06.456847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02cef-f341-4c65-b06e-16217bb24d28 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:06.468092 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4396/8765] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:50:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:50:06.472370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c317a-5f01-45b7-bfe7-17d488679175 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:06.481486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c317a-5f01-45b7-bfe7-17d488679175 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:06.486618 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cae8d-de15-4530-a438-c95967bd0d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:06.487275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cae8d-de15-4530-a438-c95967bd0d53 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.487577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cae8d-de15-4530-a438-c95967bd0d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.487851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cae8d-de15-4530-a438-c95967bd0d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.488552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cae8d-de15-4530-a438-c95967bd0d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:06.490441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cae8d-de15-4530-a438-c95967bd0d53 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:06.516288 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4370/8766] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:50:06 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:50:06.520402 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02cef-f341-4c65-b06e-16217bb24d28 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:06.530255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02cef-f341-4c65-b06e-16217bb24d28 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:06.587552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8db2d3-c677-45d7-8cde-022e097aa86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:06.588222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db2d3-c677-45d7-8cde-022e097aa86b admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.588502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db2d3-c677-45d7-8cde-022e097aa86b admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.588775 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db2d3-c677-45d7-8cde-022e097aa86b admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.589472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8db2d3-c677-45d7-8cde-022e097aa86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:06.591397 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8db2d3-c677-45d7-8cde-022e097aa86b admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:06.609977 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4397/8767] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:50:06 2021] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:50:06.614753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cae8d-de15-4530-a438-c95967bd0d53 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:06.625000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cae8d-de15-4530-a438-c95967bd0d53 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:06.630651 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb832798-cf97-40bb-b913-14ba57c75345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:06.631323 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832798-cf97-40bb-b913-14ba57c75345 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.631605 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832798-cf97-40bb-b913-14ba57c75345 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.631877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb832798-cf97-40bb-b913-14ba57c75345 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.632600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb832798-cf97-40bb-b913-14ba57c75345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:06.634180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb832798-cf97-40bb-b913-14ba57c75345 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:06.644372 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4371/8768] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:50:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:50:06.648453 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8db2d3-c677-45d7-8cde-022e097aa86b admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:06.658118 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8db2d3-c677-45d7-8cde-022e097aa86b admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:06.662693 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ffe4d-66cd-4c91-9bfa-b8de7259c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:06.663389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ffe4d-66cd-4c91-9bfa-b8de7259c454 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.663662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ffe4d-66cd-4c91-9bfa-b8de7259c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.663926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ffe4d-66cd-4c91-9bfa-b8de7259c454 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.664810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ffe4d-66cd-4c91-9bfa-b8de7259c454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:06.666230 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ffe4d-66cd-4c91-9bfa-b8de7259c454 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:06.676265 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4398/8769] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:50:06 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:50:06.680277 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb832798-cf97-40bb-b913-14ba57c75345 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:06.690741 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb832798-cf97-40bb-b913-14ba57c75345 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:06.695414 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3a87a-1675-42a5-b363-4bde1b87b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:06.696281 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a87a-1675-42a5-b363-4bde1b87b5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.696565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a87a-1675-42a5-b363-4bde1b87b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.696846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a87a-1675-42a5-b363-4bde1b87b5f8 admin admin] PATH_INFO: `/v3/projects/5697f8f381974f1d943f67d706fc2e1b/users/4674c3d6c0df441c814890f261d7e5fa/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.710971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3a87a-1675-42a5-b363-4bde1b87b5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5697f8f381974f1d943f67d706fc2e1b, user_id=4674c3d6c0df441c814890f261d7e5fa, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:06.713652 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3a87a-1675-42a5-b363-4bde1b87b5f8 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:06.727135 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4372/8770] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:50:06 2021] PUT /identity/v3/projects/5697f8f381974f1d943f67d706fc2e1b/users/4674c3d6c0df441c814890f261d7e5fa/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:50:06.737325 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708b6fb-610a-4870-87d0-5039be5d5a9a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.737835 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708b6fb-610a-4870-87d0-5039be5d5a9a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.737988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708b6fb-610a-4870-87d0-5039be5d5a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.764585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-7708b6fb-610a-4870-87d0-5039be5d5a9a None None] MFA Rules not processed for user `4674c3d6c0df441c814890f261d7e5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:06.765889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7708b6fb-610a-4870-87d0-5039be5d5a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:06.827520 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4399/8771] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:50:06 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:06.837515 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3a87a-1675-42a5-b363-4bde1b87b5f8 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:06.839189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-37e3a87a-1675-42a5-b363-4bde1b87b5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:06.894935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3a87a-1675-42a5-b363-4bde1b87b5f8 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:06.898697 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284b59d-5149-48ee-9644-4bac087bf703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:06.899306 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284b59d-5149-48ee-9644-4bac087bf703 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:06.899596 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284b59d-5149-48ee-9644-4bac087bf703 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:06.899876 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284b59d-5149-48ee-9644-4bac087bf703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:06.908590 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284b59d-5149-48ee-9644-4bac087bf703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:06.910042 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284b59d-5149-48ee-9644-4bac087bf703 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:06.918750 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4373/8772] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:50:06 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:50:11.536506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708b6fb-610a-4870-87d0-5039be5d5a9a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:11.598372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708b6fb-610a-4870-87d0-5039be5d5a9a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:11.602899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:11.603792 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:11.604070 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:11.604343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] PATH_INFO: `/v3/users/4674c3d6c0df441c814890f261d7e5fa` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:11.605596 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4674c3d6c0df441c814890f261d7e5fa)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:11.607565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:11.654451 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4674c3d6c0df441c814890f261d7e5fa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:11.660918 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4674c3d6c0df441c814890f261d7e5fa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:11.661721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4674c3d6c0df441c814890f261d7e5fa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:11.668521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4674c3d6c0df441c814890f261d7e5fa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:11.680639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4674c3d6c0df441c814890f261d7e5fa'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:11.686567 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4400/8773] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:50:11 2021] DELETE /identity/v3/users/4674c3d6c0df441c814890f261d7e5fa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:50:11.691913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50229-417d-42ad-8126-ec3228a8ed21 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:11.692393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50229-417d-42ad-8126-ec3228a8ed21 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:11.692500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50229-417d-42ad-8126-ec3228a8ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:11.709228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b7d50229-417d-42ad-8126-ec3228a8ed21 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:11.710518 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b7d50229-417d-42ad-8126-ec3228a8ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:11.768712 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4374/8774] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:50:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:11.778735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:11.780098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:11.835570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d990d4d-8722-4afc-b7bf-9fd7b2134a14 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:11.839158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc37fc-84fe-46bb-835c-ae90c2c53139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:11.839841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc37fc-84fe-46bb-835c-ae90c2c53139 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:11.840120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc37fc-84fe-46bb-835c-ae90c2c53139 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:11.840394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc37fc-84fe-46bb-835c-ae90c2c53139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:11.849161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc37fc-84fe-46bb-835c-ae90c2c53139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:11.850551 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc37fc-84fe-46bb-835c-ae90c2c53139 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:11.859674 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4401/8775] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:50:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:50:12.039011 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d50229-417d-42ad-8126-ec3228a8ed21 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:12.040591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b7d50229-417d-42ad-8126-ec3228a8ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:12.054509 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d50229-417d-42ad-8126-ec3228a8ed21 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:12.059404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:12.060262 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:12.060542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:12.060814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] PATH_INFO: `/v3/projects/5697f8f381974f1d943f67d706fc2e1b` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:12.062010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5697f8f381974f1d943f67d706fc2e1b)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:12.064690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:12.111458 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5697f8f381974f1d943f67d706fc2e1b', 'request_id': 'req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:12.117488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5697f8f381974f1d943f67d706fc2e1b', 'request_id': 'req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:12.124779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5697f8f381974f1d943f67d706fc2e1b', 'request_id': 'req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:12.134957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] The token cache is being invalidate because project 5697f8f381974f1d943f67d706fc2e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:50:12.135242 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:12.135889 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-6c8a1b0b-d2c7-4599-8ab0-d580090842cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:50:12.137424 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4375/8776] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:50:12 2021] DELETE /identity/v3/projects/5697f8f381974f1d943f67d706fc2e1b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:50:12.144854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd373e-5186-4b3d-932a-42affd79f541 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:12.145142 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd373e-5186-4b3d-932a-42affd79f541 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:12.145452 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd373e-5186-4b3d-932a-42affd79f541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:12.163559 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-bbfd373e-5186-4b3d-932a-42affd79f541 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:12.164733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-bbfd373e-5186-4b3d-932a-42affd79f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:12.222150 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4402/8777] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:50:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:50:12.231665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1213fc-3684-44af-8ac7-49cd8f58e324 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:12.231953 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1213fc-3684-44af-8ac7-49cd8f58e324 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:12.232231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1213fc-3684-44af-8ac7-49cd8f58e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:12.251975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ed1213fc-3684-44af-8ac7-49cd8f58e324 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:12.253168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ed1213fc-3684-44af-8ac7-49cd8f58e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:12.261369 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4376/8778] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:50:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:12.265604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd373e-5186-4b3d-932a-42affd79f541 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:12.275184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd373e-5186-4b3d-932a-42affd79f541 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:12.279911 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a692d06-597e-4c08-9e29-32f8dc01a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:12.280502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a692d06-597e-4c08-9e29-32f8dc01a785 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:12.280791 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a692d06-597e-4c08-9e29-32f8dc01a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:12.281073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a692d06-597e-4c08-9e29-32f8dc01a785 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:12.281814 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a692d06-597e-4c08-9e29-32f8dc01a785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:50:12.282660 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a692d06-597e-4c08-9e29-32f8dc01a785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:12.284275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a692d06-597e-4c08-9e29-32f8dc01a785 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:12.296273 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4403/8779] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:50:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:50:12.301070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1213fc-3684-44af-8ac7-49cd8f58e324 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:12.310239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1213fc-3684-44af-8ac7-49cd8f58e324 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:12.314879 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be5dc1-c121-4adb-9e3d-81add26bc371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:12.315551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be5dc1-c121-4adb-9e3d-81add26bc371 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:12.315838 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be5dc1-c121-4adb-9e3d-81add26bc371 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:12.316114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be5dc1-c121-4adb-9e3d-81add26bc371 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:12.316808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be5dc1-c121-4adb-9e3d-81add26bc371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:12.318707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be5dc1-c121-4adb-9e3d-81add26bc371 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:12.343026 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4377/8780] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:50:12 2021] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:50:12.347669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a692d06-597e-4c08-9e29-32f8dc01a785 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:12.357426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a692d06-597e-4c08-9e29-32f8dc01a785 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:12.413395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f429b-7e7b-4cb4-a110-e19a01add69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:12.414076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f429b-7e7b-4cb4-a110-e19a01add69f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:12.414365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f429b-7e7b-4cb4-a110-e19a01add69f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:12.414647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f429b-7e7b-4cb4-a110-e19a01add69f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:12.415426 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f429b-7e7b-4cb4-a110-e19a01add69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:12.417405 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f429b-7e7b-4cb4-a110-e19a01add69f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:12.438431 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4404/8781] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:50:12 2021] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:50:12.442822 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be5dc1-c121-4adb-9e3d-81add26bc371 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:12.453480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be5dc1-c121-4adb-9e3d-81add26bc371 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:12.458758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b3f69-2653-43cf-b8a4-045a7d6c6e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:12.459510 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b3f69-2653-43cf-b8a4-045a7d6c6e81 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:12.459786 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b3f69-2653-43cf-b8a4-045a7d6c6e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:12.460068 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b3f69-2653-43cf-b8a4-045a7d6c6e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:12.460802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b3f69-2653-43cf-b8a4-045a7d6c6e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:12.462409 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b3f69-2653-43cf-b8a4-045a7d6c6e81 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:12.473261 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4378/8782] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:50:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:50:12.477319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f429b-7e7b-4cb4-a110-e19a01add69f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:12.487653 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f429b-7e7b-4cb4-a110-e19a01add69f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:12.492547 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7a09e-040a-4d0d-ad35-a0c03be546d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:12.493226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a09e-040a-4d0d-ad35-a0c03be546d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:12.493507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a09e-040a-4d0d-ad35-a0c03be546d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:12.493781 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a09e-040a-4d0d-ad35-a0c03be546d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:12.494502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7a09e-040a-4d0d-ad35-a0c03be546d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:12.496115 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7a09e-040a-4d0d-ad35-a0c03be546d4 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:12.506160 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4405/8783] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:50:12 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:50:12.510160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b3f69-2653-43cf-b8a4-045a7d6c6e81 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:12.520602 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b3f69-2653-43cf-b8a4-045a7d6c6e81 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:12.525119 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ed284-d0bf-46d8-97da-be32ff745e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:12.525976 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ed284-d0bf-46d8-97da-be32ff745e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:12.526252 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ed284-d0bf-46d8-97da-be32ff745e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:12.526524 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ed284-d0bf-46d8-97da-be32ff745e2f admin admin] PATH_INFO: `/v3/projects/741fb423d7b24833be8f3d9d7d83294e/users/a32b19324e154c7fb5e29e374753ba7f/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:12.541030 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ed284-d0bf-46d8-97da-be32ff745e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=741fb423d7b24833be8f3d9d7d83294e, user_id=a32b19324e154c7fb5e29e374753ba7f, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:12.543687 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ed284-d0bf-46d8-97da-be32ff745e2f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:12.555997 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4379/8784] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:50:12 2021] PUT /identity/v3/projects/741fb423d7b24833be8f3d9d7d83294e/users/a32b19324e154c7fb5e29e374753ba7f/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:50:12.562146 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606495-ff4a-4d69-8b3a-0dcbe2e63d89 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:12.562875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606495-ff4a-4d69-8b3a-0dcbe2e63d89 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:12.563500 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606495-ff4a-4d69-8b3a-0dcbe2e63d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:12.584625 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c0606495-ff4a-4d69-8b3a-0dcbe2e63d89 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:12.585816 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c0606495-ff4a-4d69-8b3a-0dcbe2e63d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:12.643916 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4406/8785] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:50:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:12.653884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ed284-d0bf-46d8-97da-be32ff745e2f admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:12.655635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5a1ed284-d0bf-46d8-97da-be32ff745e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:12.711486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ed284-d0bf-46d8-97da-be32ff745e2f admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:12.715286 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2506b4c-32e2-40a1-911a-19c35e92461a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:12.715942 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2506b4c-32e2-40a1-911a-19c35e92461a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:12.716229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2506b4c-32e2-40a1-911a-19c35e92461a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:12.716506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2506b4c-32e2-40a1-911a-19c35e92461a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:12.726185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2506b4c-32e2-40a1-911a-19c35e92461a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:12.727661 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2506b4c-32e2-40a1-911a-19c35e92461a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:12.737005 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4380/8786] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:50:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:50:16.880323 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9233f6f-01fc-4341-bac9-1e3f53d95e3a None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:16.880865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9233f6f-01fc-4341-bac9-1e3f53d95e3a None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:16.881434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9233f6f-01fc-4341-bac9-1e3f53d95e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:16.911075 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-c9233f6f-01fc-4341-bac9-1e3f53d95e3a None None] MFA Rules not processed for user `a32b19324e154c7fb5e29e374753ba7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:16.912252 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c9233f6f-01fc-4341-bac9-1e3f53d95e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:16.981719 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4407/8787] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:50:16 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:16.986782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2506b4c-32e2-40a1-911a-19c35e92461a service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:16.996851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2506b4c-32e2-40a1-911a-19c35e92461a service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:17.002221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec70a0b-8244-4bac-b3dd-5f44d180525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:17.002882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec70a0b-8244-4bac-b3dd-5f44d180525d admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:17.003165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec70a0b-8244-4bac-b3dd-5f44d180525d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:17.003756 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec70a0b-8244-4bac-b3dd-5f44d180525d admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:17.004591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec70a0b-8244-4bac-b3dd-5f44d180525d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:17.006549 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec70a0b-8244-4bac-b3dd-5f44d180525d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:17.036040 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4381/8788] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:50:16 2021] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:50:17.040237 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9233f6f-01fc-4341-bac9-1e3f53d95e3a None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:17.051806 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9233f6f-01fc-4341-bac9-1e3f53d95e3a None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:17.111448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b531-29a5-47a6-9142-12a9801531b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:17.112131 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b531-29a5-47a6-9142-12a9801531b3 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:17.112416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b531-29a5-47a6-9142-12a9801531b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:17.112695 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b531-29a5-47a6-9142-12a9801531b3 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:17.113409 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b531-29a5-47a6-9142-12a9801531b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:17.115375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b531-29a5-47a6-9142-12a9801531b3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:17.136759 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4408/8789] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:50:17 2021] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:50:17.141134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec70a0b-8244-4bac-b3dd-5f44d180525d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:17.152009 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec70a0b-8244-4bac-b3dd-5f44d180525d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:17.156858 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f86f-6be4-4444-a89f-04d572c7edd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:17.157626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f86f-6be4-4444-a89f-04d572c7edd1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:17.157984 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f86f-6be4-4444-a89f-04d572c7edd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:17.158333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1f86f-6be4-4444-a89f-04d572c7edd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:17.159148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1f86f-6be4-4444-a89f-04d572c7edd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:17.161547 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1f86f-6be4-4444-a89f-04d572c7edd1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:17.173679 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4382/8790] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:50:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:50:17.178179 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b531-29a5-47a6-9142-12a9801531b3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:17.189314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b531-29a5-47a6-9142-12a9801531b3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:17.194347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb8113-407c-4b43-97ab-ade177b01a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:17.195231 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb8113-407c-4b43-97ab-ade177b01a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:17.195544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb8113-407c-4b43-97ab-ade177b01a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:17.195819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb8113-407c-4b43-97ab-ade177b01a97 admin admin] PATH_INFO: `/v3/projects/2b15df8238684c62af48774c633162e7/users/af8d4617aad344dd8a31c7e63b707a5b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:17.213449 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb8113-407c-4b43-97ab-ade177b01a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b15df8238684c62af48774c633162e7, user_id=af8d4617aad344dd8a31c7e63b707a5b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:17.216190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb8113-407c-4b43-97ab-ade177b01a97 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:17.230821 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4409/8791] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:50:17 2021] PUT /identity/v3/projects/2b15df8238684c62af48774c633162e7/users/af8d4617aad344dd8a31c7e63b707a5b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:50:17.234907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f86f-6be4-4444-a89f-04d572c7edd1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:17.245690 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1f86f-6be4-4444-a89f-04d572c7edd1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:17.304557 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225ac23-f68c-4511-921c-e5519cd2e1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:17.305220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ac23-f68c-4511-921c-e5519cd2e1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:17.305502 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ac23-f68c-4511-921c-e5519cd2e1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:17.305776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225ac23-f68c-4511-921c-e5519cd2e1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:17.306506 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225ac23-f68c-4511-921c-e5519cd2e1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:17.308185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225ac23-f68c-4511-921c-e5519cd2e1c1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:17.318622 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4383/8792] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:50:17 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:50:17.322884 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb8113-407c-4b43-97ab-ade177b01a97 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:17.334045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb8113-407c-4b43-97ab-ade177b01a97 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:17.338832 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0a111-26bc-484a-a85f-65608ac6613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:17.339888 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0a111-26bc-484a-a85f-65608ac6613f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:17.340151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0a111-26bc-484a-a85f-65608ac6613f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:17.340432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0a111-26bc-484a-a85f-65608ac6613f admin admin] PATH_INFO: `/v3/projects/2b15df8238684c62af48774c633162e7/users/af8d4617aad344dd8a31c7e63b707a5b/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:17.342526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0a111-26bc-484a-a85f-65608ac6613f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b15df8238684c62af48774c633162e7, user_id=af8d4617aad344dd8a31c7e63b707a5b, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:17.345297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0a111-26bc-484a-a85f-65608ac6613f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:17.356508 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4410/8793] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:50:17 2021] PUT /identity/v3/projects/2b15df8238684c62af48774c633162e7/users/af8d4617aad344dd8a31c7e63b707a5b/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:50:22.207221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d520f0-1ccc-4e46-9c73-7a301b6b6d69 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:22.207886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d520f0-1ccc-4e46-9c73-7a301b6b6d69 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:22.207886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d520f0-1ccc-4e46-9c73-7a301b6b6d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:22.262377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-56d520f0-1ccc-4e46-9c73-7a301b6b6d69 None None] MFA Rules not processed for user `af8d4617aad344dd8a31c7e63b707a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:22.264093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-56d520f0-1ccc-4e46-9c73-7a301b6b6d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:22.377488 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4384/8794] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:50:22 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:22.404948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3ee9-4aab-4ba6-8763-4b6cb3337039 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:22.405522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3ee9-4aab-4ba6-8763-4b6cb3337039 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:22.405522 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f3ee9-4aab-4ba6-8763-4b6cb3337039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:22.470314 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-8e4f3ee9-4aab-4ba6-8763-4b6cb3337039 None None] MFA Rules not processed for user `7e4c41e7988043c0b3b8e338ccd31d37`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:22.471724 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8e4f3ee9-4aab-4ba6-8763-4b6cb3337039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:22.573459 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4411/8795] 10.222.0.21 () {58 vars in 1059 bytes} [Sat Nov 27 21:50:22 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:22.579782 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d520f0-1ccc-4e46-9c73-7a301b6b6d69 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:22.592028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d520f0-1ccc-4e46-9c73-7a301b6b6d69 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:22.597540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b1511-3407-4dd5-a421-cd19ce4fb2ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:22.598787 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b1511-3407-4dd5-a421-cd19ce4fb2ba service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:22.599636 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b1511-3407-4dd5-a421-cd19ce4fb2ba service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:22.600200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b1511-3407-4dd5-a421-cd19ce4fb2ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:22.681451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b1511-3407-4dd5-a421-cd19ce4fb2ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:22.683072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b1511-3407-4dd5-a421-cd19ce4fb2ba service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:22.693014 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4385/8796] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:50:22 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:50:22.808177 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718fe18-13b4-4d6f-bbe5-69c2593501c9 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:22.808470 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718fe18-13b4-4d6f-bbe5-69c2593501c9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:22.808754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718fe18-13b4-4d6f-bbe5-69c2593501c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:22.859183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a718fe18-13b4-4d6f-bbe5-69c2593501c9 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:22.861779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a718fe18-13b4-4d6f-bbe5-69c2593501c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:22.953246 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4412/8797] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:50:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:23.008948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513af61-ec34-45c2-b59b-e48f1302633c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:23.009293 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513af61-ec34-45c2-b59b-e48f1302633c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:23.009572 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513af61-ec34-45c2-b59b-e48f1302633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:23.057020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-3513af61-ec34-45c2-b59b-e48f1302633c None None] MFA Rules not processed for user `f39a303b702041259ebb6a66c5967528`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:23.058134 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3513af61-ec34-45c2-b59b-e48f1302633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:23.129548 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4386/8798] 10.222.0.21 () {58 vars in 1039 bytes} [Sat Nov 27 21:50:23 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:50:23.136046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718fe18-13b4-4d6f-bbe5-69c2593501c9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:23.147654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718fe18-13b4-4d6f-bbe5-69c2593501c9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:23.152676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b51ee-686a-4099-907c-cb0668812461 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:23.153305 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b51ee-686a-4099-907c-cb0668812461 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:23.153585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b51ee-686a-4099-907c-cb0668812461 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:23.153858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b51ee-686a-4099-907c-cb0668812461 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:23.161959 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b51ee-686a-4099-907c-cb0668812461 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:23.163544 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b51ee-686a-4099-907c-cb0668812461 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:23.171474 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4413/8799] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:50:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 27 21:50:32.585132 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f4ee-cee5-4dbd-9981-8f19c7bbcebf None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:32.585758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f4ee-cee5-4dbd-9981-8f19c7bbcebf None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:32.585758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f4ee-cee5-4dbd-9981-8f19c7bbcebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:32.605324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-5d53f4ee-cee5-4dbd-9981-8f19c7bbcebf None None] MFA Rules not processed for user `a32b19324e154c7fb5e29e374753ba7f`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:32.606646 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-5d53f4ee-cee5-4dbd-9981-8f19c7bbcebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:32.614205 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4387/8800] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:50:32 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:32.650845 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b51ee-686a-4099-907c-cb0668812461 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:32.660687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b51ee-686a-4099-907c-cb0668812461 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:32.664334 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfae39-c0a2-4cda-9aa4-4430f049c016 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:32.664966 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfae39-c0a2-4cda-9aa4-4430f049c016 service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:32.665246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfae39-c0a2-4cda-9aa4-4430f049c016 service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:32.665520 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfae39-c0a2-4cda-9aa4-4430f049c016 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:32.667311 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e7dfae39-c0a2-4cda-9aa4-4430f049c016 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:32.747331 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfae39-c0a2-4cda-9aa4-4430f049c016 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:32.748766 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfae39-c0a2-4cda-9aa4-4430f049c016 service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:32.759722 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4414/8801] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:50:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:50:33.307405 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53f4ee-cee5-4dbd-9981-8f19c7bbcebf None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:33.362507 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53f4ee-cee5-4dbd-9981-8f19c7bbcebf None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:33.366355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133917c-bcbe-4083-b218-dd6ca865f743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:33.367082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133917c-bcbe-4083-b218-dd6ca865f743 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:33.367412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133917c-bcbe-4083-b218-dd6ca865f743 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:33.367674 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133917c-bcbe-4083-b218-dd6ca865f743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:33.369413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d133917c-bcbe-4083-b218-dd6ca865f743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:33.384078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133917c-bcbe-4083-b218-dd6ca865f743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:33.385522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133917c-bcbe-4083-b218-dd6ca865f743 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:33.397175 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4388/8802] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:50:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:50:34.354548 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328287e7-2d88-4ab1-b739-669cef5ebb4e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:34.355079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328287e7-2d88-4ab1-b739-669cef5ebb4e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:34.355377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328287e7-2d88-4ab1-b739-669cef5ebb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:34.374315 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-328287e7-2d88-4ab1-b739-669cef5ebb4e None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:50:34.376408 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-328287e7-2d88-4ab1-b739-669cef5ebb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:34.384185 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4415/8803] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 21:50:34 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:50:34.398358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133917c-bcbe-4083-b218-dd6ca865f743 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:34.410631 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133917c-bcbe-4083-b218-dd6ca865f743 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:34.416408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d769fe-29d1-4683-9ea1-8f56de7aa04a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:34.417266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d769fe-29d1-4683-9ea1-8f56de7aa04a service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:34.417555 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d769fe-29d1-4683-9ea1-8f56de7aa04a service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:34.417837 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d769fe-29d1-4683-9ea1-8f56de7aa04a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:34.428404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d769fe-29d1-4683-9ea1-8f56de7aa04a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:34.430136 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d769fe-29d1-4683-9ea1-8f56de7aa04a service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:34.439681 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4389/8804] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:50:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:50:47.840407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328287e7-2d88-4ab1-b739-669cef5ebb4e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:47.842158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-328287e7-2d88-4ab1-b739-669cef5ebb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:47.864717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328287e7-2d88-4ab1-b739-669cef5ebb4e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:47.871004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c307936-7918-4e0a-acb0-51e4a0668e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:47.871800 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c307936-7918-4e0a-acb0-51e4a0668e15 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:47.872089 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c307936-7918-4e0a-acb0-51e4a0668e15 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:47.872372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c307936-7918-4e0a-acb0-51e4a0668e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:47.875646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7c307936-7918-4e0a-acb0-51e4a0668e15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:47.907784 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c307936-7918-4e0a-acb0-51e4a0668e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:47.909619 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c307936-7918-4e0a-acb0-51e4a0668e15 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:47.923636 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4416/8805] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:50:47 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:50:51.981426 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d769fe-29d1-4683-9ea1-8f56de7aa04a service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:50:51.994034 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d769fe-29d1-4683-9ea1-8f56de7aa04a service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:50:51.999559 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c831a-232b-4b7c-b196-917bdcb4ee8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:50:52.000722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c831a-232b-4b7c-b196-917bdcb4ee8a service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:50:52.001001 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c831a-232b-4b7c-b196-917bdcb4ee8a service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:50:52.001271 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c831a-232b-4b7c-b196-917bdcb4ee8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:50:52.003020 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-242c831a-232b-4b7c-b196-917bdcb4ee8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:50:52.015316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c831a-232b-4b7c-b196-917bdcb4ee8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:50:52.017582 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c831a-232b-4b7c-b196-917bdcb4ee8a service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:50:52.028063 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4390/8806] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:50:51 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:51:00.146282 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c307936-7918-4e0a-acb0-51e4a0668e15 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:51:00.147730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7c307936-7918-4e0a-acb0-51e4a0668e15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:51:00.158929 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c307936-7918-4e0a-acb0-51e4a0668e15 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:51:00.162585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b643e95-9189-40a1-a911-228fe62437e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:51:00.163210 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b643e95-9189-40a1-a911-228fe62437e0 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:51:00.163626 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b643e95-9189-40a1-a911-228fe62437e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:51:00.163924 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b643e95-9189-40a1-a911-228fe62437e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:51:00.172664 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b643e95-9189-40a1-a911-228fe62437e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:51:00.174096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b643e95-9189-40a1-a911-228fe62437e0 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:51:00.183288 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4417/8807] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:51:00 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:52:13.319188 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c831a-232b-4b7c-b196-917bdcb4ee8a service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:52:13.320624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-242c831a-232b-4b7c-b196-917bdcb4ee8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:52:13.386654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c831a-232b-4b7c-b196-917bdcb4ee8a service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:52:13.392113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e5fcd-024d-406a-a53f-e99d6df4a2d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:52:13.392744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e5fcd-024d-406a-a53f-e99d6df4a2d7 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:52:13.393023 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e5fcd-024d-406a-a53f-e99d6df4a2d7 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:52:13.393295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e5fcd-024d-406a-a53f-e99d6df4a2d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:52:13.395005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3b8e5fcd-024d-406a-a53f-e99d6df4a2d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:52:13.406459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e5fcd-024d-406a-a53f-e99d6df4a2d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:52:13.408073 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e5fcd-024d-406a-a53f-e99d6df4a2d7 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:52:13.417991 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4391/8808] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:52:13 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:52:23.540713 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b643e95-9189-40a1-a911-228fe62437e0 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:52:23.542099 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1b643e95-9189-40a1-a911-228fe62437e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:52:23.556188 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b643e95-9189-40a1-a911-228fe62437e0 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:52:23.561627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e48206-34d8-44cb-9481-69c3d3f965ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:52:23.562255 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e48206-34d8-44cb-9481-69c3d3f965ef service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:52:23.562536 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e48206-34d8-44cb-9481-69c3d3f965ef service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:52:23.562811 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e48206-34d8-44cb-9481-69c3d3f965ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:52:23.564507 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-32e48206-34d8-44cb-9481-69c3d3f965ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:52:23.575671 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e48206-34d8-44cb-9481-69c3d3f965ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:52:23.577943 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e48206-34d8-44cb-9481-69c3d3f965ef service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:52:23.587716 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4418/8809] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:52:23 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:53:16.777123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e5fcd-024d-406a-a53f-e99d6df4a2d7 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:16.810349 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e5fcd-024d-406a-a53f-e99d6df4a2d7 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:16.820268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e247e-dadf-4d30-b255-cc7b2c95fbf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:16.821923 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e247e-dadf-4d30-b255-cc7b2c95fbf9 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:16.822496 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e247e-dadf-4d30-b255-cc7b2c95fbf9 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:16.823207 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e247e-dadf-4d30-b255-cc7b2c95fbf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:16.825619 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-261e247e-dadf-4d30-b255-cc7b2c95fbf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:53:16.845193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e247e-dadf-4d30-b255-cc7b2c95fbf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:16.847187 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e247e-dadf-4d30-b255-cc7b2c95fbf9 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:16.862397 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4392/8810] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:53:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:53:24.079054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7e355-5ecc-4d58-8cf3-3e5696f90d50 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:24.079605 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7e355-5ecc-4d58-8cf3-3e5696f90d50 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:24.079717 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7e355-5ecc-4d58-8cf3-3e5696f90d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:24.097028 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-5fd7e355-5ecc-4d58-8cf3-3e5696f90d50 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:53:24.098215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5fd7e355-5ecc-4d58-8cf3-3e5696f90d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:53:24.105390 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4419/8811] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 21:53:24 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:53:24.147123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e247e-dadf-4d30-b255-cc7b2c95fbf9 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:24.158357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e247e-dadf-4d30-b255-cc7b2c95fbf9 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:24.163406 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccf4ae-efe9-447f-ba45-45ea471e13b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:24.164035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccf4ae-efe9-447f-ba45-45ea471e13b7 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:24.164317 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccf4ae-efe9-447f-ba45-45ea471e13b7 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:24.164592 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccf4ae-efe9-447f-ba45-45ea471e13b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:24.173135 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccf4ae-efe9-447f-ba45-45ea471e13b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:24.174706 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccf4ae-efe9-447f-ba45-45ea471e13b7 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:24.182547 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4393/8812] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 21:53:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 21:53:31.056347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7e355-5ecc-4d58-8cf3-3e5696f90d50 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:31.119769 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7e355-5ecc-4d58-8cf3-3e5696f90d50 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:31.124815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:31.125670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:31.125949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:31.126226 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] PATH_INFO: `/v3/users/a32b19324e154c7fb5e29e374753ba7f` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:31.127456 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32b19324e154c7fb5e29e374753ba7f)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:31.129604 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:31.172246 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32b19324e154c7fb5e29e374753ba7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.179104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32b19324e154c7fb5e29e374753ba7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.182016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32b19324e154c7fb5e29e374753ba7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.189583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32b19324e154c7fb5e29e374753ba7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.200917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32b19324e154c7fb5e29e374753ba7f'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.206810 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4420/8813] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:53:31 2021] DELETE /identity/v3/users/a32b19324e154c7fb5e29e374753ba7f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:53:31.381888 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccf4ae-efe9-447f-ba45-45ea471e13b7 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:31.393275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccf4ae-efe9-447f-ba45-45ea471e13b7 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:31.450598 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:31.451638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:31.451955 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:31.452231 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] PATH_INFO: `/v3/projects/741fb423d7b24833be8f3d9d7d83294e` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:31.453441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=741fb423d7b24833be8f3d9d7d83294e)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:31.455398 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:31.499664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '741fb423d7b24833be8f3d9d7d83294e', 'request_id': 'req-badc793b-2b53-4d6e-96ad-d992e3a62f22'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.505826 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '741fb423d7b24833be8f3d9d7d83294e', 'request_id': 'req-badc793b-2b53-4d6e-96ad-d992e3a62f22'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.512528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '741fb423d7b24833be8f3d9d7d83294e', 'request_id': 'req-badc793b-2b53-4d6e-96ad-d992e3a62f22'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.522707 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] The token cache is being invalidate because project 741fb423d7b24833be8f3d9d7d83294e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:53:31.522995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.523664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.525218 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4394/8814] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:53:31 2021] DELETE /identity/v3/projects/741fb423d7b24833be8f3d9d7d83294e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:53:31.529151 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:31.531021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:53:31.543733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301b647-ddb0-4b1f-b4d9-13033eb326c7 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:31.599117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71882b5-7224-451d-b61a-6ce68b6ff84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:31.599932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71882b5-7224-451d-b61a-6ce68b6ff84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:31.600213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71882b5-7224-451d-b61a-6ce68b6ff84a admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:31.600486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71882b5-7224-451d-b61a-6ce68b6ff84a admin admin] PATH_INFO: `/v3/users/af8d4617aad344dd8a31c7e63b707a5b` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:31.601679 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71882b5-7224-451d-b61a-6ce68b6ff84a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8d4617aad344dd8a31c7e63b707a5b)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:31.603615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71882b5-7224-451d-b61a-6ce68b6ff84a admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:31.646727 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e71882b5-7224-451d-b61a-6ce68b6ff84a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8d4617aad344dd8a31c7e63b707a5b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.653755 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e71882b5-7224-451d-b61a-6ce68b6ff84a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8d4617aad344dd8a31c7e63b707a5b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.654422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e71882b5-7224-451d-b61a-6ce68b6ff84a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8d4617aad344dd8a31c7e63b707a5b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.661858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e71882b5-7224-451d-b61a-6ce68b6ff84a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8d4617aad344dd8a31c7e63b707a5b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.674117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-e71882b5-7224-451d-b61a-6ce68b6ff84a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8d4617aad344dd8a31c7e63b707a5b'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.680318 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4421/8815] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 21:53:31 2021] DELETE /identity/v3/users/af8d4617aad344dd8a31c7e63b707a5b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:53:31.845182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:31.846656 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:53:31.860522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc793b-2b53-4d6e-96ad-d992e3a62f22 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:31.927350 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:31.928200 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:31.928481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:31.928753 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] PATH_INFO: `/v3/projects/2b15df8238684c62af48774c633162e7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:31.929926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b15df8238684c62af48774c633162e7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:31.931865 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:31.975440 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b15df8238684c62af48774c633162e7', 'request_id': 'req-5afbb83a-d849-4406-ac21-47f4d286fc94'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.981479 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b15df8238684c62af48774c633162e7', 'request_id': 'req-5afbb83a-d849-4406-ac21-47f4d286fc94'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.988804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b15df8238684c62af48774c633162e7', 'request_id': 'req-5afbb83a-d849-4406-ac21-47f4d286fc94'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.998624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] The token cache is being invalidate because project 2b15df8238684c62af48774c633162e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 21:53:31.998907 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:31.999553 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-5afbb83a-d849-4406-ac21-47f4d286fc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 21:53:32.001068 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4395/8816] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 21:53:31 2021] DELETE /identity/v3/projects/2b15df8238684c62af48774c633162e7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:53:32.007207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9607c-4306-48f8-aa0f-8b1b642fae3f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.007528 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9607c-4306-48f8-aa0f-8b1b642fae3f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.007804 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9607c-4306-48f8-aa0f-8b1b642fae3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.025939 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-0fc9607c-4306-48f8-aa0f-8b1b642fae3f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:53:32.027119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0fc9607c-4306-48f8-aa0f-8b1b642fae3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:53:32.085481 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4422/8817] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:53:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:53:32.093821 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781be5-02a7-4327-baf7-50ccb99da243 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.094113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781be5-02a7-4327-baf7-50ccb99da243 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.094386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781be5-02a7-4327-baf7-50ccb99da243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.112951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c5781be5-02a7-4327-baf7-50ccb99da243 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:53:32.114058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c5781be5-02a7-4327-baf7-50ccb99da243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:53:32.121975 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4396/8818] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:53:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:53:32.126307 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9607c-4306-48f8-aa0f-8b1b642fae3f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.136608 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9607c-4306-48f8-aa0f-8b1b642fae3f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.142874 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39153-4616-4bcc-b210-0fe907c429b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.143746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39153-4616-4bcc-b210-0fe907c429b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.144034 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39153-4616-4bcc-b210-0fe907c429b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.144343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39153-4616-4bcc-b210-0fe907c429b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.145058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c39153-4616-4bcc-b210-0fe907c429b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 21:53:32.145739 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c39153-4616-4bcc-b210-0fe907c429b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.147061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c39153-4616-4bcc-b210-0fe907c429b5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.159342 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4423/8819] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 21:53:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 21:53:32.163747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5781be5-02a7-4327-baf7-50ccb99da243 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.172817 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5781be5-02a7-4327-baf7-50ccb99da243 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.177550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66f5c1-1a0c-48b8-9f4c-312d0c92634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.178190 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f5c1-1a0c-48b8-9f4c-312d0c92634c admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.178471 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f5c1-1a0c-48b8-9f4c-312d0c92634c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.178746 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66f5c1-1a0c-48b8-9f4c-312d0c92634c admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.179487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66f5c1-1a0c-48b8-9f4c-312d0c92634c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.181399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66f5c1-1a0c-48b8-9f4c-312d0c92634c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.207769 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4397/8820] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:53:32 2021] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:53:32.211981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39153-4616-4bcc-b210-0fe907c429b5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.221942 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39153-4616-4bcc-b210-0fe907c429b5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.277160 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156bf4b-5d25-413c-a220-9d60cde0975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.277817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156bf4b-5d25-413c-a220-9d60cde0975f admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.278098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156bf4b-5d25-413c-a220-9d60cde0975f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.278375 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156bf4b-5d25-413c-a220-9d60cde0975f admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.279078 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156bf4b-5d25-413c-a220-9d60cde0975f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.281011 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156bf4b-5d25-413c-a220-9d60cde0975f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.299805 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4424/8821] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:53:32 2021] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:53:32.303861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66f5c1-1a0c-48b8-9f4c-312d0c92634c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.314591 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66f5c1-1a0c-48b8-9f4c-312d0c92634c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.319329 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91797f03-46b2-430a-80a5-605b5cd120cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.319982 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91797f03-46b2-430a-80a5-605b5cd120cf admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.320268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91797f03-46b2-430a-80a5-605b5cd120cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.320545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91797f03-46b2-430a-80a5-605b5cd120cf admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.321275 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91797f03-46b2-430a-80a5-605b5cd120cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.322877 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91797f03-46b2-430a-80a5-605b5cd120cf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.333888 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4398/8822] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:53:32.337439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156bf4b-5d25-413c-a220-9d60cde0975f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.346920 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156bf4b-5d25-413c-a220-9d60cde0975f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.351583 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b945cd0-c282-402b-8c75-d9821fb03e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.352220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b945cd0-c282-402b-8c75-d9821fb03e87 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.352502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b945cd0-c282-402b-8c75-d9821fb03e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.352777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b945cd0-c282-402b-8c75-d9821fb03e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.353497 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b945cd0-c282-402b-8c75-d9821fb03e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.355059 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b945cd0-c282-402b-8c75-d9821fb03e87 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.365135 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4425/8823] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:53:32.368916 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91797f03-46b2-430a-80a5-605b5cd120cf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.381671 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91797f03-46b2-430a-80a5-605b5cd120cf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.388139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3ee51-95c6-440a-8e24-357012d412d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.389028 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3ee51-95c6-440a-8e24-357012d412d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.390050 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3ee51-95c6-440a-8e24-357012d412d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.390169 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3ee51-95c6-440a-8e24-357012d412d1 admin admin] PATH_INFO: `/v3/projects/5b468a4008c24bb3a5c854460c0e26b0/users/91a121eeb37c42efb5cab8c884e74c10/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.406116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3ee51-95c6-440a-8e24-357012d412d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b468a4008c24bb3a5c854460c0e26b0, user_id=91a121eeb37c42efb5cab8c884e74c10, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.408839 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3ee51-95c6-440a-8e24-357012d412d1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.421591 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4399/8824] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:53:32 2021] PUT /identity/v3/projects/5b468a4008c24bb3a5c854460c0e26b0/users/91a121eeb37c42efb5cab8c884e74c10/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:53:32.431635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e074d-716f-41a6-96d0-668bcfd37fa0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.431923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e074d-716f-41a6-96d0-668bcfd37fa0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.432203 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e074d-716f-41a6-96d0-668bcfd37fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.459614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-058e074d-716f-41a6-96d0-668bcfd37fa0 None None] MFA Rules not processed for user `91a121eeb37c42efb5cab8c884e74c10`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:53:32.460837 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-058e074d-716f-41a6-96d0-668bcfd37fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:53:32.522344 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4426/8825] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:53:32 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:53:32.526806 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3ee51-95c6-440a-8e24-357012d412d1 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.587490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3ee51-95c6-440a-8e24-357012d412d1 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.592210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a2c00-4bcd-4344-a927-eedc6ae62570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.592868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a2c00-4bcd-4344-a927-eedc6ae62570 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.593154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a2c00-4bcd-4344-a927-eedc6ae62570 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.593434 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a2c00-4bcd-4344-a927-eedc6ae62570 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.594142 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a2c00-4bcd-4344-a927-eedc6ae62570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.596090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a2c00-4bcd-4344-a927-eedc6ae62570 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.623308 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4400/8826] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 21:53:32 2021] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 21:53:32.625067 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e074d-716f-41a6-96d0-668bcfd37fa0 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.636043 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e074d-716f-41a6-96d0-668bcfd37fa0 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.690435 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55d37-514a-45ea-8f2b-ecfd80c4b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.691101 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55d37-514a-45ea-8f2b-ecfd80c4b190 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.691428 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55d37-514a-45ea-8f2b-ecfd80c4b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.691708 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d55d37-514a-45ea-8f2b-ecfd80c4b190 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.692418 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d55d37-514a-45ea-8f2b-ecfd80c4b190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.694309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d55d37-514a-45ea-8f2b-ecfd80c4b190 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.714485 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4427/8827] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 21:53:32 2021] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 21:53:32.718472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a2c00-4bcd-4344-a927-eedc6ae62570 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.728528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a2c00-4bcd-4344-a927-eedc6ae62570 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.733980 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb8e10-8eaf-4609-8873-25b4c6d81623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.734624 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8e10-8eaf-4609-8873-25b4c6d81623 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.734904 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8e10-8eaf-4609-8873-25b4c6d81623 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.735177 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8e10-8eaf-4609-8873-25b4c6d81623 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.735957 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb8e10-8eaf-4609-8873-25b4c6d81623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.737548 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb8e10-8eaf-4609-8873-25b4c6d81623 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.751385 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4401/8828] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 21:53:32.756030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55d37-514a-45ea-8f2b-ecfd80c4b190 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.767077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d55d37-514a-45ea-8f2b-ecfd80c4b190 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.773377 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45245b0-4c4b-4ff4-9856-fb7465caad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.774225 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45245b0-4c4b-4ff4-9856-fb7465caad11 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.774502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45245b0-4c4b-4ff4-9856-fb7465caad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.774774 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45245b0-4c4b-4ff4-9856-fb7465caad11 admin admin] PATH_INFO: `/v3/projects/bd1eac163a544258a9fd45795544f180/users/7fcd321f5da643d2bf806ce457a12a14/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.789827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45245b0-4c4b-4ff4-9856-fb7465caad11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1eac163a544258a9fd45795544f180, user_id=7fcd321f5da643d2bf806ce457a12a14, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.792561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45245b0-4c4b-4ff4-9856-fb7465caad11 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.805180 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4428/8829] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:53:32 2021] PUT /identity/v3/projects/bd1eac163a544258a9fd45795544f180/users/7fcd321f5da643d2bf806ce457a12a14/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 21:53:32.809116 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb8e10-8eaf-4609-8873-25b4c6d81623 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.819808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb8e10-8eaf-4609-8873-25b4c6d81623 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.875536 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e8136-b7f9-4684-a49a-02607ef12b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.876129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e8136-b7f9-4684-a49a-02607ef12b6c admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.876412 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e8136-b7f9-4684-a49a-02607ef12b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.876689 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e8136-b7f9-4684-a49a-02607ef12b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.877442 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e8136-b7f9-4684-a49a-02607ef12b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.879326 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e8136-b7f9-4684-a49a-02607ef12b6c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.888734 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4402/8830] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 21:53:32 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 21:53:32.893033 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45245b0-4c4b-4ff4-9856-fb7465caad11 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:32.903271 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45245b0-4c4b-4ff4-9856-fb7465caad11 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:32.907923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b91802-1a24-4728-b88a-671f456d329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:32.908799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91802-1a24-4728-b88a-671f456d329f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.909084 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91802-1a24-4728-b88a-671f456d329f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.909362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b91802-1a24-4728-b88a-671f456d329f admin admin] PATH_INFO: `/v3/projects/bd1eac163a544258a9fd45795544f180/users/7fcd321f5da643d2bf806ce457a12a14/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.911412 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b91802-1a24-4728-b88a-671f456d329f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1eac163a544258a9fd45795544f180, user_id=7fcd321f5da643d2bf806ce457a12a14, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:32.914041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b91802-1a24-4728-b88a-671f456d329f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:32.924666 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4429/8831] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 21:53:32 2021] PUT /identity/v3/projects/bd1eac163a544258a9fd45795544f180/users/7fcd321f5da643d2bf806ce457a12a14/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 21:53:32.934229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e1632-a4f1-4ff4-80b7-13f5d75c8042 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:32.934517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e1632-a4f1-4ff4-80b7-13f5d75c8042 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:32.934793 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e1632-a4f1-4ff4-80b7-13f5d75c8042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:32.961263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fe6e1632-a4f1-4ff4-80b7-13f5d75c8042 None None] MFA Rules not processed for user `7fcd321f5da643d2bf806ce457a12a14`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:53:32.962455 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fe6e1632-a4f1-4ff4-80b7-13f5d75c8042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:53:33.029499 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4403/8832] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:53:32 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:53:33.041662 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b91802-1a24-4728-b88a-671f456d329f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:33.043448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f2b91802-1a24-4728-b88a-671f456d329f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:53:33.113598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b91802-1a24-4728-b88a-671f456d329f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:33.119058 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41136611-ea9a-4943-9f4d-d5b7a07f8cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:33.119746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41136611-ea9a-4943-9f4d-d5b7a07f8cbf service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:33.120035 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41136611-ea9a-4943-9f4d-d5b7a07f8cbf service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:33.120309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41136611-ea9a-4943-9f4d-d5b7a07f8cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:33.174293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41136611-ea9a-4943-9f4d-d5b7a07f8cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:33.175859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41136611-ea9a-4943-9f4d-d5b7a07f8cbf service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:33.184567 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4430/8833] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:53:33 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:53:36.320164 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e1632-a4f1-4ff4-80b7-13f5d75c8042 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:53:36.321654 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fe6e1632-a4f1-4ff4-80b7-13f5d75c8042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:53:36.389577 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e1632-a4f1-4ff4-80b7-13f5d75c8042 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:53:36.393273 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa0da6-c58d-42b1-852c-f68088f6d3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:53:36.393920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa0da6-c58d-42b1-852c-f68088f6d3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:36.394210 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa0da6-c58d-42b1-852c-f68088f6d3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:36.394487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa0da6-c58d-42b1-852c-f68088f6d3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:36.404229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa0da6-c58d-42b1-852c-f68088f6d3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:53:36.406343 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa0da6-c58d-42b1-852c-f68088f6d3f3 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:53:36.416458 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4404/8834] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:53:36 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:53:39.020670 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99f18-a420-49f5-b4bb-a63b64ef5d5c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:53:39.021232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99f18-a420-49f5-b4bb-a63b64ef5d5c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:53:39.021232 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d99f18-a420-49f5-b4bb-a63b64ef5d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:53:39.040526 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-f6d99f18-a420-49f5-b4bb-a63b64ef5d5c None None] MFA Rules not processed for user `91a121eeb37c42efb5cab8c884e74c10`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:53:39.041754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f6d99f18-a420-49f5-b4bb-a63b64ef5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:53:39.049115 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4431/8835] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:53:39 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:54:32.383995 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa0da6-c58d-42b1-852c-f68088f6d3f3 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:54:32.393265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa0da6-c58d-42b1-852c-f68088f6d3f3 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:54:32.397126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f63a0b-8434-4aa1-b65e-191332279d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:54:32.397759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63a0b-8434-4aa1-b65e-191332279d00 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:54:32.398035 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63a0b-8434-4aa1-b65e-191332279d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:54:32.398303 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63a0b-8434-4aa1-b65e-191332279d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:54:32.400092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b4f63a0b-8434-4aa1-b65e-191332279d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:54:32.409399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f63a0b-8434-4aa1-b65e-191332279d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:54:32.410808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f63a0b-8434-4aa1-b65e-191332279d00 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:54:32.418501 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4405/8836] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:54:32 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:55:16.282854 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8933b-4f98-42ea-95f4-6b5750ebc5d8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:55:16.283389 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8933b-4f98-42ea-95f4-6b5750ebc5d8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:55:16.283523 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8933b-4f98-42ea-95f4-6b5750ebc5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:55:16.308365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-01e8933b-4f98-42ea-95f4-6b5750ebc5d8 None None] MFA Rules not processed for user `91a121eeb37c42efb5cab8c884e74c10`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:55:16.309751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-01e8933b-4f98-42ea-95f4-6b5750ebc5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:55:16.321983 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4432/8837] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:55:16 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:55:16.711940 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f63a0b-8434-4aa1-b65e-191332279d00 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:55:16.713392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b4f63a0b-8434-4aa1-b65e-191332279d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:55:16.724448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f63a0b-8434-4aa1-b65e-191332279d00 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:55:16.728432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc7c32-c205-4b4f-8487-8e5e12a91995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:55:16.729081 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7c32-c205-4b4f-8487-8e5e12a91995 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:55:16.729361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7c32-c205-4b4f-8487-8e5e12a91995 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:55:16.731076 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7c32-c205-4b4f-8487-8e5e12a91995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:55:16.733482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1efc7c32-c205-4b4f-8487-8e5e12a91995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:55:16.743500 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc7c32-c205-4b4f-8487-8e5e12a91995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:55:16.744938 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc7c32-c205-4b4f-8487-8e5e12a91995 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:55:16.753044 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4406/8838] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:55:16 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:55:17.125060 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8933b-4f98-42ea-95f4-6b5750ebc5d8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:55:17.128144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-01e8933b-4f98-42ea-95f4-6b5750ebc5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:55:17.216912 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8933b-4f98-42ea-95f4-6b5750ebc5d8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:55:17.222117 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a7e8e-29dc-47ba-b824-a852676d9514 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:55:17.222764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a7e8e-29dc-47ba-b824-a852676d9514 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:55:17.223045 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a7e8e-29dc-47ba-b824-a852676d9514 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:55:17.223366 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a7e8e-29dc-47ba-b824-a852676d9514 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:55:17.225137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a13a7e8e-29dc-47ba-b824-a852676d9514 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:55:17.237144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a7e8e-29dc-47ba-b824-a852676d9514 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:55:17.238906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a7e8e-29dc-47ba-b824-a852676d9514 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:55:17.251589 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4433/8839] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:55:17 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:56:33.252752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc7c32-c205-4b4f-8487-8e5e12a91995 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:56:33.264827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc7c32-c205-4b4f-8487-8e5e12a91995 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:56:33.268594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30055b1-9f81-4ce8-a28f-d70cc70ad931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:56:33.269259 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30055b1-9f81-4ce8-a28f-d70cc70ad931 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:56:33.269537 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30055b1-9f81-4ce8-a28f-d70cc70ad931 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:56:33.269808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30055b1-9f81-4ce8-a28f-d70cc70ad931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:56:33.272278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c30055b1-9f81-4ce8-a28f-d70cc70ad931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:56:33.285748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30055b1-9f81-4ce8-a28f-d70cc70ad931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:56:33.287713 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30055b1-9f81-4ce8-a28f-d70cc70ad931 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:56:33.299231 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4407/8840] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:56:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 21:56:34.505316 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a7e8e-29dc-47ba-b824-a852676d9514 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:56:34.514673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a7e8e-29dc-47ba-b824-a852676d9514 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:56:34.518799 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcf0c6-c785-40ef-9546-8e3643c03e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:56:34.519685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcf0c6-c785-40ef-9546-8e3643c03e8b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:56:34.519798 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcf0c6-c785-40ef-9546-8e3643c03e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:56:34.520913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcf0c6-c785-40ef-9546-8e3643c03e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:56:34.522737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f1bcf0c6-c785-40ef-9546-8e3643c03e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:56:34.536866 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcf0c6-c785-40ef-9546-8e3643c03e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:56:34.538298 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bcf0c6-c785-40ef-9546-8e3643c03e8b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:56:34.549433 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4434/8841] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:56:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:57:15.280157 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30055b1-9f81-4ce8-a28f-d70cc70ad931 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:57:15.281550 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c30055b1-9f81-4ce8-a28f-d70cc70ad931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:57:15.334758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30055b1-9f81-4ce8-a28f-d70cc70ad931 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:57:15.340720 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf6dd6-e886-459f-9235-d2f31c9db2e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:57:15.341354 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6dd6-e886-459f-9235-d2f31c9db2e3 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:57:15.341635 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6dd6-e886-459f-9235-d2f31c9db2e3 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:57:15.341909 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf6dd6-e886-459f-9235-d2f31c9db2e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:57:15.343688 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e7cf6dd6-e886-459f-9235-d2f31c9db2e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:57:15.356357 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf6dd6-e886-459f-9235-d2f31c9db2e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:57:15.357926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf6dd6-e886-459f-9235-d2f31c9db2e3 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:57:15.368161 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4408/8842] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:57:15 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:57:30.574020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcf0c6-c785-40ef-9546-8e3643c03e8b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:57:30.615524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bcf0c6-c785-40ef-9546-8e3643c03e8b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:57:30.620612 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2a695-1ba1-4141-b167-535ca512564b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:57:30.621251 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2a695-1ba1-4141-b167-535ca512564b service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:57:30.621537 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2a695-1ba1-4141-b167-535ca512564b service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:57:30.621818 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2a695-1ba1-4141-b167-535ca512564b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:57:30.623598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6dd2a695-1ba1-4141-b167-535ca512564b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:57:30.635440 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2a695-1ba1-4141-b167-535ca512564b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:57:30.637007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2a695-1ba1-4141-b167-535ca512564b service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:57:30.646532 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4435/8843] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:57:30 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:57:34.801092 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf6dd6-e886-459f-9235-d2f31c9db2e3 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:57:34.802609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e7cf6dd6-e886-459f-9235-d2f31c9db2e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:57:34.817752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf6dd6-e886-459f-9235-d2f31c9db2e3 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:57:34.823523 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f821fc-d5f0-41c1-8793-e33f386aae35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:57:34.824425 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f821fc-d5f0-41c1-8793-e33f386aae35 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:57:34.824568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f821fc-d5f0-41c1-8793-e33f386aae35 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:57:34.824833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f821fc-d5f0-41c1-8793-e33f386aae35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:57:34.827860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-77f821fc-d5f0-41c1-8793-e33f386aae35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:57:34.839583 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f821fc-d5f0-41c1-8793-e33f386aae35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:57:34.841178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f821fc-d5f0-41c1-8793-e33f386aae35 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:57:34.853503 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4409/8844] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:57:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:57:47.611010 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349946e-b349-4d42-b1c9-4cd27740777e None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:57:47.613589 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349946e-b349-4d42-b1c9-4cd27740777e None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:57:47.614081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349946e-b349-4d42-b1c9-4cd27740777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:57:47.638478 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1349946e-b349-4d42-b1c9-4cd27740777e None None] MFA Rules not processed for user `91a121eeb37c42efb5cab8c884e74c10`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:57:47.639989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1349946e-b349-4d42-b1c9-4cd27740777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:57:47.648624 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4436/8845] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 21:57:47 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:57:48.334544 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f821fc-d5f0-41c1-8793-e33f386aae35 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:57:48.351039 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f821fc-d5f0-41c1-8793-e33f386aae35 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:57:48.358233 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef577cc0-9ea8-4367-8cd6-17b6ba88d0ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:57:48.359108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef577cc0-9ea8-4367-8cd6-17b6ba88d0ae service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:57:48.359650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef577cc0-9ea8-4367-8cd6-17b6ba88d0ae service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:57:48.359931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef577cc0-9ea8-4367-8cd6-17b6ba88d0ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:57:48.361844 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ef577cc0-9ea8-4367-8cd6-17b6ba88d0ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:57:48.376002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef577cc0-9ea8-4367-8cd6-17b6ba88d0ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:57:48.377884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef577cc0-9ea8-4367-8cd6-17b6ba88d0ae service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:57:48.389595 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4410/8846] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:57:48 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:57:58.127649 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349946e-b349-4d42-b1c9-4cd27740777e None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:57:58.142482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349946e-b349-4d42-b1c9-4cd27740777e None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:57:58.148692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bac6b-ef30-4a62-a594-c0192f2250b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:57:58.149347 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bac6b-ef30-4a62-a594-c0192f2250b6 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:57:58.149635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bac6b-ef30-4a62-a594-c0192f2250b6 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:57:58.149913 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bac6b-ef30-4a62-a594-c0192f2250b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:57:58.151732 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f51bac6b-ef30-4a62-a594-c0192f2250b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:57:58.164416 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bac6b-ef30-4a62-a594-c0192f2250b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:57:58.165989 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bac6b-ef30-4a62-a594-c0192f2250b6 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:57:58.176462 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4437/8847] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:57:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:58:33.790672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef577cc0-9ea8-4367-8cd6-17b6ba88d0ae service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:58:33.803395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef577cc0-9ea8-4367-8cd6-17b6ba88d0ae service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:58:33.808795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a157b-2a8a-475f-b9e2-272fcf42368d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:58:33.809422 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a157b-2a8a-475f-b9e2-272fcf42368d service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:58:33.809702 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a157b-2a8a-475f-b9e2-272fcf42368d service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:58:33.809975 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a157b-2a8a-475f-b9e2-272fcf42368d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:58:33.817504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a157b-2a8a-475f-b9e2-272fcf42368d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:58:33.819070 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a157b-2a8a-475f-b9e2-272fcf42368d service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:58:33.827853 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4411/8848] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:58:33 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:59:04.469343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99f8b5-78cd-4350-a386-60280498b040 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:59:04.469971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99f8b5-78cd-4350-a386-60280498b040 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:59:04.469971 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99f8b5-78cd-4350-a386-60280498b040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:59:04.526482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-1f99f8b5-78cd-4350-a386-60280498b040 None None] MFA Rules not processed for user `10914bd6817341eeafda6c3ded4ecfc3`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:59:04.527740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1f99f8b5-78cd-4350-a386-60280498b040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:59:04.543604 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4438/8849] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:59:04 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 21:59:04.556520 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a157b-2a8a-475f-b9e2-272fcf42368d service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:59:04.566229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a157b-2a8a-475f-b9e2-272fcf42368d service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:59:04.570570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c8f41-d0e1-4ca9-920a-25023dce78ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:59:04.571473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8f41-d0e1-4ca9-920a-25023dce78ee service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:59:04.571972 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8f41-d0e1-4ca9-920a-25023dce78ee service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:59:04.572419 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c8f41-d0e1-4ca9-920a-25023dce78ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:59:04.582385 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c8f41-d0e1-4ca9-920a-25023dce78ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:59:04.584693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c8f41-d0e1-4ca9-920a-25023dce78ee service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:59:04.593329 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4412/8850] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:59:04 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:59:04.684501 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b426b-f814-47e0-b761-7f2a950792e9 None None] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:59:04.684821 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b426b-f814-47e0-b761-7f2a950792e9 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:59:04.685098 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b426b-f814-47e0-b761-7f2a950792e9 None None] PATH_INFO: `/` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:59:04.686997 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4439/8851] 10.222.0.21 () {54 vars in 921 bytes} [Sat Nov 27 21:59:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 27 21:59:04.692268 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e64e52-5c01-4f30-81a0-81b1cc213353 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:59:04.693178 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e64e52-5c01-4f30-81a0-81b1cc213353 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:59:04.693454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e64e52-5c01-4f30-81a0-81b1cc213353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:59:04.730859 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-d2e64e52-5c01-4f30-81a0-81b1cc213353 None None] MFA Rules not processed for user `12473c7375ac477a85977655ccb3f514`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 21:59:04.732083 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-d2e64e52-5c01-4f30-81a0-81b1cc213353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:59:04.741050 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4413/8852] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 21:59:04 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 21:59:04.762062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b426b-f814-47e0-b761-7f2a950792e9 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:59:04.775381 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b426b-f814-47e0-b761-7f2a950792e9 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:59:04.780344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595fb52-0982-45da-b11f-3d04abec1e8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:59:04.780997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595fb52-0982-45da-b11f-3d04abec1e8b service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:59:04.781285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595fb52-0982-45da-b11f-3d04abec1e8b service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:59:04.781565 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595fb52-0982-45da-b11f-3d04abec1e8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:59:04.789859 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595fb52-0982-45da-b11f-3d04abec1e8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:59:04.791505 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595fb52-0982-45da-b11f-3d04abec1e8b service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:59:04.801110 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4440/8853] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:59:04 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:59:18.343058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e64e52-5c01-4f30-81a0-81b1cc213353 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:59:18.352604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e64e52-5c01-4f30-81a0-81b1cc213353 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:59:18.356265 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98dbd6-e984-4323-80d6-abf1069034fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:59:18.356929 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98dbd6-e984-4323-80d6-abf1069034fc service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:59:18.357211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98dbd6-e984-4323-80d6-abf1069034fc service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:59:18.357487 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98dbd6-e984-4323-80d6-abf1069034fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:59:18.359435 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-4c98dbd6-e984-4323-80d6-abf1069034fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:59:18.368747 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98dbd6-e984-4323-80d6-abf1069034fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:59:18.370232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98dbd6-e984-4323-80d6-abf1069034fc service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:59:18.378407 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4414/8854] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:59:18 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 21:59:18.865562 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595fb52-0982-45da-b11f-3d04abec1e8b service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 21:59:18.879074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595fb52-0982-45da-b11f-3d04abec1e8b service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 21:59:18.885438 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d784e-4519-49da-b4bd-a547e708c62b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 21:59:18.886074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d784e-4519-49da-b4bd-a547e708c62b service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 21:59:18.886360 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d784e-4519-49da-b4bd-a547e708c62b service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 21:59:18.886639 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d784e-4519-49da-b4bd-a547e708c62b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 21:59:18.888432 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fc3d784e-4519-49da-b4bd-a547e708c62b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 21:59:18.901102 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d784e-4519-49da-b4bd-a547e708c62b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 21:59:18.902687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d784e-4519-49da-b4bd-a547e708c62b service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 21:59:18.913628 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4441/8855] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 21:59:18 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 22:00:04.532637 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98dbd6-e984-4323-80d6-abf1069034fc service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:00:04.541127 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98dbd6-e984-4323-80d6-abf1069034fc service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:00:04.544776 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86ab49-a279-4aab-aac5-9ab7151f2782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:00:04.545410 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86ab49-a279-4aab-aac5-9ab7151f2782 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:00:04.545691 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86ab49-a279-4aab-aac5-9ab7151f2782 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:00:04.545969 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86ab49-a279-4aab-aac5-9ab7151f2782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:00:04.554968 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86ab49-a279-4aab-aac5-9ab7151f2782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:00:04.556451 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86ab49-a279-4aab-aac5-9ab7151f2782 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:00:04.566505 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4415/8856] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:00:04 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:00:07.560055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d3b97-23ad-4408-980e-6ecd5b340a6f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:00:07.560586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d3b97-23ad-4408-980e-6ecd5b340a6f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:00:07.560586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d3b97-23ad-4408-980e-6ecd5b340a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:00:07.579948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-cd1d3b97-23ad-4408-980e-6ecd5b340a6f None None] MFA Rules not processed for user `91a121eeb37c42efb5cab8c884e74c10`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:00:07.581218 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cd1d3b97-23ad-4408-980e-6ecd5b340a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:00:07.589003 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4442/8857] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:00:07 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:00:11.075755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86ab49-a279-4aab-aac5-9ab7151f2782 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:00:11.084714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86ab49-a279-4aab-aac5-9ab7151f2782 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:00:11.092846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b524c-d02d-46d6-8eea-c9a452072dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:00:11.092846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b524c-d02d-46d6-8eea-c9a452072dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:00:11.092846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b524c-d02d-46d6-8eea-c9a452072dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:00:11.092846 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b524c-d02d-46d6-8eea-c9a452072dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:00:11.102168 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b524c-d02d-46d6-8eea-c9a452072dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:00:11.103683 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b524c-d02d-46d6-8eea-c9a452072dc8 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:00:11.112582 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4416/8858] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:00:11 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:01:33.600399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d3b97-23ad-4408-980e-6ecd5b340a6f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:01:33.609948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d3b97-23ad-4408-980e-6ecd5b340a6f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:01:33.613504 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666291-45d4-4407-a648-dd1f986fb1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:01:33.614139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666291-45d4-4407-a648-dd1f986fb1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:01:33.614422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666291-45d4-4407-a648-dd1f986fb1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:01:33.614699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6666291-45d4-4407-a648-dd1f986fb1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:01:33.631707 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6666291-45d4-4407-a648-dd1f986fb1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:01:33.633134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6666291-45d4-4407-a648-dd1f986fb1e9 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:01:33.644281 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4443/8859] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:01:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:01:34.816603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b524c-d02d-46d6-8eea-c9a452072dc8 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:01:34.824867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b524c-d02d-46d6-8eea-c9a452072dc8 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:01:34.829113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf76d2-8f73-466f-9b7e-3e13ad71ccbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:01:34.829734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf76d2-8f73-466f-9b7e-3e13ad71ccbc service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:01:34.830013 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf76d2-8f73-466f-9b7e-3e13ad71ccbc service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:01:34.830285 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf76d2-8f73-466f-9b7e-3e13ad71ccbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:01:34.840086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf76d2-8f73-466f-9b7e-3e13ad71ccbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:01:34.841562 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf76d2-8f73-466f-9b7e-3e13ad71ccbc service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:01:34.852010 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4417/8860] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:01:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:02:16.242081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666291-45d4-4407-a648-dd1f986fb1e9 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:02:16.253016 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6666291-45d4-4407-a648-dd1f986fb1e9 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:02:16.258267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f95f32-0b72-49e2-bfc4-58fb7c0ad13f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:02:16.258902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f95f32-0b72-49e2-bfc4-58fb7c0ad13f service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:02:16.259184 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f95f32-0b72-49e2-bfc4-58fb7c0ad13f service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:02:16.259491 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f95f32-0b72-49e2-bfc4-58fb7c0ad13f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:02:16.268296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f95f32-0b72-49e2-bfc4-58fb7c0ad13f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:02:16.269867 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f95f32-0b72-49e2-bfc4-58fb7c0ad13f service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:02:16.280063 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4444/8861] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:02:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:02:39.504805 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf76d2-8f73-466f-9b7e-3e13ad71ccbc service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:02:39.517655 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf76d2-8f73-466f-9b7e-3e13ad71ccbc service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:02:39.525626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d757870-c2d6-4d1d-988a-613ad3661046 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:02:39.526732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757870-c2d6-4d1d-988a-613ad3661046 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:02:39.527090 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757870-c2d6-4d1d-988a-613ad3661046 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:02:39.527493 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d757870-c2d6-4d1d-988a-613ad3661046 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:02:39.540047 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d757870-c2d6-4d1d-988a-613ad3661046 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:02:39.541714 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d757870-c2d6-4d1d-988a-613ad3661046 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:02:39.554480 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4418/8862] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:02:39 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:02:39.962211 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b9e2f-e50b-43f8-a6d3-3bea01481678 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:02:39.962686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b9e2f-e50b-43f8-a6d3-3bea01481678 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:02:39.962921 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b9e2f-e50b-43f8-a6d3-3bea01481678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:02:39.987174 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-108b9e2f-e50b-43f8-a6d3-3bea01481678 None None] MFA Rules not processed for user `91a121eeb37c42efb5cab8c884e74c10`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:02:39.988541 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-108b9e2f-e50b-43f8-a6d3-3bea01481678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:02:39.995747 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4445/8863] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:02:39 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 22:02:40.330918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d757870-c2d6-4d1d-988a-613ad3661046 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:02:40.344473 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d757870-c2d6-4d1d-988a-613ad3661046 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:02:40.348392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafcffa-d760-453b-9741-a8c0c2c8afdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:02:40.349154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafcffa-d760-453b-9741-a8c0c2c8afdb service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:02:40.349540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafcffa-d760-453b-9741-a8c0c2c8afdb service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:02:40.350082 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafcffa-d760-453b-9741-a8c0c2c8afdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:02:40.352324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-7eafcffa-d760-453b-9741-a8c0c2c8afdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:02:40.379012 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafcffa-d760-453b-9741-a8c0c2c8afdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:02:40.380552 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafcffa-d760-453b-9741-a8c0c2c8afdb service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:02:40.390413 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4419/8864] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:02:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:02:40.762063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b9e2f-e50b-43f8-a6d3-3bea01481678 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:02:40.787734 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b9e2f-e50b-43f8-a6d3-3bea01481678 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:02:40.793175 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430be81-ea6d-41e6-a9d2-26e0924e9cf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:02:40.794557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430be81-ea6d-41e6-a9d2-26e0924e9cf1 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:02:40.794945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430be81-ea6d-41e6-a9d2-26e0924e9cf1 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:02:40.795369 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430be81-ea6d-41e6-a9d2-26e0924e9cf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:02:40.805129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430be81-ea6d-41e6-a9d2-26e0924e9cf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:02:40.806721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430be81-ea6d-41e6-a9d2-26e0924e9cf1 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:02:40.821945 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4446/8865] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:02:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:02:43.260074 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafcffa-d760-453b-9741-a8c0c2c8afdb service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:02:43.276041 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafcffa-d760-453b-9741-a8c0c2c8afdb service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:02:43.286302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d384f-b732-4981-83a7-e7fc2e798ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:02:43.287276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d384f-b732-4981-83a7-e7fc2e798ef6 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:02:43.287622 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d384f-b732-4981-83a7-e7fc2e798ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:02:43.288129 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d384f-b732-4981-83a7-e7fc2e798ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:02:43.305847 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d384f-b732-4981-83a7-e7fc2e798ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:02:43.307568 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d384f-b732-4981-83a7-e7fc2e798ef6 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:02:43.357343 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4420/8866] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:02:43 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:03:56.956155 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430be81-ea6d-41e6-a9d2-26e0924e9cf1 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:03:57.031733 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430be81-ea6d-41e6-a9d2-26e0924e9cf1 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:03:57.037120 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0be69-1cd5-4eb6-a9cf-1db2d4da8dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:03:57.037744 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0be69-1cd5-4eb6-a9cf-1db2d4da8dc3 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:03:57.038024 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0be69-1cd5-4eb6-a9cf-1db2d4da8dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:03:57.038295 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0be69-1cd5-4eb6-a9cf-1db2d4da8dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:03:57.040168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-58b0be69-1cd5-4eb6-a9cf-1db2d4da8dc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:03:57.114297 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0be69-1cd5-4eb6-a9cf-1db2d4da8dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:03:57.115905 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0be69-1cd5-4eb6-a9cf-1db2d4da8dc3 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:03:57.133808 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4447/8867] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:03:56 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:04:12.025404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d384f-b732-4981-83a7-e7fc2e798ef6 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:12.026981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cf6d384f-b732-4981-83a7-e7fc2e798ef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:12.119490 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d384f-b732-4981-83a7-e7fc2e798ef6 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:12.124569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:12.125540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:12.125819 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:12.126093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] PATH_INFO: `/v3/users/91a121eeb37c42efb5cab8c884e74c10` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:12.127316 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a121eeb37c42efb5cab8c884e74c10)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:12.129223 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:12.173570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a121eeb37c42efb5cab8c884e74c10'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.174170 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a121eeb37c42efb5cab8c884e74c10'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.181429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a121eeb37c42efb5cab8c884e74c10'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.182015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a121eeb37c42efb5cab8c884e74c10'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.189341 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a121eeb37c42efb5cab8c884e74c10'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.206622 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4421/8868] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 22:04:12 2021] DELETE /identity/v3/users/91a121eeb37c42efb5cab8c884e74c10 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:04:12.211285 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068241-f7e0-41e9-851e-10f5417c787f None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:12.211730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068241-f7e0-41e9-851e-10f5417c787f None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:12.211882 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068241-f7e0-41e9-851e-10f5417c787f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:12.236795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-84068241-f7e0-41e9-851e-10f5417c787f None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:04:12.237985 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-84068241-f7e0-41e9-851e-10f5417c787f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:12.295567 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4448/8869] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:04:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:04:12.305634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:12.307106 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:12.371884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047c095-bdc6-44ba-b770-6005119e431d admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:12.376228 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a72f7-858a-4f6d-8d4f-e5cd8770bda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:12.376873 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a72f7-858a-4f6d-8d4f-e5cd8770bda4 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:12.377160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a72f7-858a-4f6d-8d4f-e5cd8770bda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:12.377453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a72f7-858a-4f6d-8d4f-e5cd8770bda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:12.386694 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a72f7-858a-4f6d-8d4f-e5cd8770bda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:12.388202 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a72f7-858a-4f6d-8d4f-e5cd8770bda4 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:12.397883 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4422/8870] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:04:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:04:12.570801 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84068241-f7e0-41e9-851e-10f5417c787f None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:12.572373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-84068241-f7e0-41e9-851e-10f5417c787f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:12.585445 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84068241-f7e0-41e9-851e-10f5417c787f None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:12.590576 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:12.591577 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:12.591857 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:12.592129 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] PATH_INFO: `/v3/projects/5b468a4008c24bb3a5c854460c0e26b0` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:12.593319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b468a4008c24bb3a5c854460c0e26b0)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:12.595273 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:12.645552 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b468a4008c24bb3a5c854460c0e26b0', 'request_id': 'req-12022347-b30f-4f78-ab52-907692c65e83'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.652692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b468a4008c24bb3a5c854460c0e26b0', 'request_id': 'req-12022347-b30f-4f78-ab52-907692c65e83'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.659506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b468a4008c24bb3a5c854460c0e26b0', 'request_id': 'req-12022347-b30f-4f78-ab52-907692c65e83'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.670111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] The token cache is being invalidate because project 5b468a4008c24bb3a5c854460c0e26b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 22:04:12.670396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.671031 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.672685 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4449/8871] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 22:04:12 2021] DELETE /identity/v3/projects/5b468a4008c24bb3a5c854460c0e26b0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:04:12.677516 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a72f7-858a-4f6d-8d4f-e5cd8770bda4 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:12.688365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a72f7-858a-4f6d-8d4f-e5cd8770bda4 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:12.743179 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69c6b3-c8c3-49b3-870a-a5ac33792625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:12.744005 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69c6b3-c8c3-49b3-870a-a5ac33792625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:12.744290 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69c6b3-c8c3-49b3-870a-a5ac33792625 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:12.744565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69c6b3-c8c3-49b3-870a-a5ac33792625 admin admin] PATH_INFO: `/v3/users/7fcd321f5da643d2bf806ce457a12a14` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:12.759370 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69c6b3-c8c3-49b3-870a-a5ac33792625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fcd321f5da643d2bf806ce457a12a14)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:12.761308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69c6b3-c8c3-49b3-870a-a5ac33792625 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:12.805517 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad69c6b3-c8c3-49b3-870a-a5ac33792625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fcd321f5da643d2bf806ce457a12a14'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.806162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad69c6b3-c8c3-49b3-870a-a5ac33792625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fcd321f5da643d2bf806ce457a12a14'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.812921 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad69c6b3-c8c3-49b3-870a-a5ac33792625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fcd321f5da643d2bf806ce457a12a14'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.813546 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad69c6b3-c8c3-49b3-870a-a5ac33792625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fcd321f5da643d2bf806ce457a12a14'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.820206 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ad69c6b3-c8c3-49b3-870a-a5ac33792625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fcd321f5da643d2bf806ce457a12a14'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:12.836773 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4423/8872] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 22:04:12 2021] DELETE /identity/v3/users/7fcd321f5da643d2bf806ce457a12a14 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:04:13.099621 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:13.101074 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:13.113889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12022347-b30f-4f78-ab52-907692c65e83 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:13.168953 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:13.169795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:13.170081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:13.170358 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] PATH_INFO: `/v3/projects/bd1eac163a544258a9fd45795544f180` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:13.180396 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1eac163a544258a9fd45795544f180)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:13.182312 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:13.226143 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1eac163a544258a9fd45795544f180', 'request_id': 'req-f2bb5998-690d-4f3f-aefd-0adcc67dc145'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:13.232567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1eac163a544258a9fd45795544f180', 'request_id': 'req-f2bb5998-690d-4f3f-aefd-0adcc67dc145'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:13.239053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1eac163a544258a9fd45795544f180', 'request_id': 'req-f2bb5998-690d-4f3f-aefd-0adcc67dc145'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:13.248967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] The token cache is being invalidate because project bd1eac163a544258a9fd45795544f180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 22:04:13.249250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:13.249870 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-f2bb5998-690d-4f3f-aefd-0adcc67dc145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:04:13.251395 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4450/8873] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 22:04:13 2021] DELETE /identity/v3/projects/bd1eac163a544258a9fd45795544f180 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:04:13.258000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a6c0-308a-4417-8125-d78989ab35c1 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:13.258715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a6c0-308a-4417-8125-d78989ab35c1 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:13.258848 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a6c0-308a-4417-8125-d78989ab35c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:13.305438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-68d4a6c0-308a-4417-8125-d78989ab35c1 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:04:13.306542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-68d4a6c0-308a-4417-8125-d78989ab35c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:13.364696 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4424/8874] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:04:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:04:13.373000 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1a428-a2cb-4def-a783-62c9d1927bcd None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:13.373287 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1a428-a2cb-4def-a783-62c9d1927bcd None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:13.373591 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1a428-a2cb-4def-a783-62c9d1927bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:13.392134 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-e2d1a428-a2cb-4def-a783-62c9d1927bcd None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:04:13.393338 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e2d1a428-a2cb-4def-a783-62c9d1927bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:13.401204 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4451/8875] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:04:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:04:13.405894 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a6c0-308a-4417-8125-d78989ab35c1 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:13.415486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a6c0-308a-4417-8125-d78989ab35c1 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:13.420079 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5e222-363b-423a-be8a-cfc688baa819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:13.420717 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e222-363b-423a-be8a-cfc688baa819 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:13.420996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e222-363b-423a-be8a-cfc688baa819 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:13.421295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5e222-363b-423a-be8a-cfc688baa819 admin admin] PATH_INFO: `/v3/domains` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:13.422016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5e222-363b-423a-be8a-cfc688baa819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90122) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 22:04:13.422333 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5e222-363b-423a-be8a-cfc688baa819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:13.423961 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5e222-363b-423a-be8a-cfc688baa819 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:13.435821 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4425/8876] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 22:04:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 22:04:13.440125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1a428-a2cb-4def-a783-62c9d1927bcd None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:13.449380 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1a428-a2cb-4def-a783-62c9d1927bcd None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:13.454622 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fea29c-b290-4b54-b4ba-e3dda09b0a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:13.455296 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea29c-b290-4b54-b4ba-e3dda09b0a09 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:13.455586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea29c-b290-4b54-b4ba-e3dda09b0a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:13.455861 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea29c-b290-4b54-b4ba-e3dda09b0a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:13.456598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fea29c-b290-4b54-b4ba-e3dda09b0a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:13.458524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fea29c-b290-4b54-b4ba-e3dda09b0a09 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:13.493055 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4452/8877] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 22:04:13 2021] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 22:04:13.497800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5e222-363b-423a-be8a-cfc688baa819 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:13.507722 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5e222-363b-423a-be8a-cfc688baa819 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:13.562324 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dfa99-fae3-4b1b-99ce-37082908db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:13.562920 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dfa99-fae3-4b1b-99ce-37082908db13 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:13.563204 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dfa99-fae3-4b1b-99ce-37082908db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:13.563531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dfa99-fae3-4b1b-99ce-37082908db13 admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:13.564245 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dfa99-fae3-4b1b-99ce-37082908db13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:13.566171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dfa99-fae3-4b1b-99ce-37082908db13 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:13.586158 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4426/8878] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 22:04:13 2021] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 22:04:13.590266 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fea29c-b290-4b54-b4ba-e3dda09b0a09 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:13.600489 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fea29c-b290-4b54-b4ba-e3dda09b0a09 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:13.605130 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ab6d1-103e-420d-bbbb-4b1a2131f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:13.605827 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab6d1-103e-420d-bbbb-4b1a2131f8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:13.606114 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab6d1-103e-420d-bbbb-4b1a2131f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:13.606465 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ab6d1-103e-420d-bbbb-4b1a2131f8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:13.607204 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ab6d1-103e-420d-bbbb-4b1a2131f8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:13.608817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ab6d1-103e-420d-bbbb-4b1a2131f8b5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:13.618337 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4453/8879] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 22:04:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 22:04:13.622758 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dfa99-fae3-4b1b-99ce-37082908db13 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:13.632459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dfa99-fae3-4b1b-99ce-37082908db13 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:13.637296 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92089c84-c43c-4478-b83a-a7ef965970b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:13.638560 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92089c84-c43c-4478-b83a-a7ef965970b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:13.638855 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92089c84-c43c-4478-b83a-a7ef965970b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:13.639110 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92089c84-c43c-4478-b83a-a7ef965970b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:13.639867 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92089c84-c43c-4478-b83a-a7ef965970b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:13.641446 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92089c84-c43c-4478-b83a-a7ef965970b1 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:13.651221 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4427/8880] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 22:04:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 22:04:13.655283 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ab6d1-103e-420d-bbbb-4b1a2131f8b5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:13.665689 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ab6d1-103e-420d-bbbb-4b1a2131f8b5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:13.670343 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de472f-f333-40f2-9163-4e8a41036914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:13.671212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de472f-f333-40f2-9163-4e8a41036914 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:13.671525 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de472f-f333-40f2-9163-4e8a41036914 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:13.671802 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de472f-f333-40f2-9163-4e8a41036914 admin admin] PATH_INFO: `/v3/projects/2673f0e267164ddc9371d10cb58d17aa/users/1ca9642dc2294528a287553029ab7c54/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:13.686407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de472f-f333-40f2-9163-4e8a41036914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2673f0e267164ddc9371d10cb58d17aa, user_id=1ca9642dc2294528a287553029ab7c54, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:13.689081 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de472f-f333-40f2-9163-4e8a41036914 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:13.702372 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4454/8881] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 22:04:13 2021] PUT /identity/v3/projects/2673f0e267164ddc9371d10cb58d17aa/users/1ca9642dc2294528a287553029ab7c54/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 22:04:13.707533 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd535335-b389-4e32-b268-15dc854f62be None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:13.707830 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd535335-b389-4e32-b268-15dc854f62be None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:13.708114 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd535335-b389-4e32-b268-15dc854f62be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:13.725604 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-cd535335-b389-4e32-b268-15dc854f62be None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:04:13.726808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-cd535335-b389-4e32-b268-15dc854f62be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:13.784578 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4428/8882] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:04:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:04:13.795144 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de472f-f333-40f2-9163-4e8a41036914 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:13.796856 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-54de472f-f333-40f2-9163-4e8a41036914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:13.851459 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de472f-f333-40f2-9163-4e8a41036914 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:13.855068 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc470a7-aa1c-4fc4-8f1b-263a1088ee24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:13.855737 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc470a7-aa1c-4fc4-8f1b-263a1088ee24 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:13.856020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc470a7-aa1c-4fc4-8f1b-263a1088ee24 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:13.856777 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc470a7-aa1c-4fc4-8f1b-263a1088ee24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:13.866209 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc470a7-aa1c-4fc4-8f1b-263a1088ee24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:13.867699 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc470a7-aa1c-4fc4-8f1b-263a1088ee24 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:13.877929 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4455/8883] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:04:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:04:17.930781 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc13bb-0169-469f-a781-0ae4c6ac43b8 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:17.931292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc13bb-0169-469f-a781-0ae4c6ac43b8 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:17.931292 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc13bb-0169-469f-a781-0ae4c6ac43b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:17.958295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fdfc13bb-0169-469f-a781-0ae4c6ac43b8 None None] MFA Rules not processed for user `1ca9642dc2294528a287553029ab7c54`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:04:17.959529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fdfc13bb-0169-469f-a781-0ae4c6ac43b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:18.036749 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4429/8884] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:04:17 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:04:18.041086 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc470a7-aa1c-4fc4-8f1b-263a1088ee24 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:18.054257 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc470a7-aa1c-4fc4-8f1b-263a1088ee24 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:18.060439 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65898ad7-17b5-4dd2-8262-5154fd807997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:18.061302 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65898ad7-17b5-4dd2-8262-5154fd807997 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:18.061731 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65898ad7-17b5-4dd2-8262-5154fd807997 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:18.062170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65898ad7-17b5-4dd2-8262-5154fd807997 admin admin] PATH_INFO: `/v3/projects` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:18.063148 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65898ad7-17b5-4dd2-8262-5154fd807997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:18.065125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65898ad7-17b5-4dd2-8262-5154fd807997 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:18.096706 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4456/8885] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 22:04:18 2021] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 22:04:18.097531 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc13bb-0169-469f-a781-0ae4c6ac43b8 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:18.110118 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc13bb-0169-469f-a781-0ae4c6ac43b8 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:18.174670 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6353be9-ad3f-4f44-ad65-c4cb61a9a3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:18.175436 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353be9-ad3f-4f44-ad65-c4cb61a9a3cf admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:18.175724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353be9-ad3f-4f44-ad65-c4cb61a9a3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:18.176004 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6353be9-ad3f-4f44-ad65-c4cb61a9a3cf admin admin] PATH_INFO: `/v3/users` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:18.176710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6353be9-ad3f-4f44-ad65-c4cb61a9a3cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:18.178634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6353be9-ad3f-4f44-ad65-c4cb61a9a3cf admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:18.205804 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4430/8886] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 22:04:18 2021] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 27 22:04:18.209984 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65898ad7-17b5-4dd2-8262-5154fd807997 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:18.220903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65898ad7-17b5-4dd2-8262-5154fd807997 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:18.225687 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd037ea-3f3a-4a68-8a4d-3ceb508cab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:18.226352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd037ea-3f3a-4a68-8a4d-3ceb508cab41 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:18.226628 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd037ea-3f3a-4a68-8a4d-3ceb508cab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:18.226900 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd037ea-3f3a-4a68-8a4d-3ceb508cab41 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:18.227676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd037ea-3f3a-4a68-8a4d-3ceb508cab41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:18.229278 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd037ea-3f3a-4a68-8a4d-3ceb508cab41 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:18.240624 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4457/8887] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 22:04:18 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 22:04:18.244542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6353be9-ad3f-4f44-ad65-c4cb61a9a3cf admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:18.255996 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6353be9-ad3f-4f44-ad65-c4cb61a9a3cf admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:18.261314 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c668437-b2e5-4703-b741-9404cce03192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:18.262338 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c668437-b2e5-4703-b741-9404cce03192 admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:18.263246 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c668437-b2e5-4703-b741-9404cce03192 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:18.263567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c668437-b2e5-4703-b741-9404cce03192 admin admin] PATH_INFO: `/v3/projects/98408a5639d14f2e8563e2f4b8a3f3e1/users/ae1c37b95be64b40b781646e9b14fff9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:18.281156 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c668437-b2e5-4703-b741-9404cce03192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98408a5639d14f2e8563e2f4b8a3f3e1, user_id=ae1c37b95be64b40b781646e9b14fff9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:18.283949 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c668437-b2e5-4703-b741-9404cce03192 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:18.298776 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4431/8888] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 22:04:18 2021] PUT /identity/v3/projects/98408a5639d14f2e8563e2f4b8a3f3e1/users/ae1c37b95be64b40b781646e9b14fff9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:04:18.302638 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd037ea-3f3a-4a68-8a4d-3ceb508cab41 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:18.313805 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd037ea-3f3a-4a68-8a4d-3ceb508cab41 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:18.370450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09d7ef-fee0-4edc-9c0d-9c5c7e239f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:18.371121 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d7ef-fee0-4edc-9c0d-9c5c7e239f07 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:18.371436 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d7ef-fee0-4edc-9c0d-9c5c7e239f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:18.371714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d7ef-fee0-4edc-9c0d-9c5c7e239f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:18.373008 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d7ef-fee0-4edc-9c0d-9c5c7e239f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:18.374609 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d7ef-fee0-4edc-9c0d-9c5c7e239f07 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:18.385302 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4458/8889] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 22:04:18 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 22:04:18.389695 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c668437-b2e5-4703-b741-9404cce03192 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:18.400748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c668437-b2e5-4703-b741-9404cce03192 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:18.405891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55182623-ea44-4178-aa6c-59dd653edacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:18.406853 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182623-ea44-4178-aa6c-59dd653edacd admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:18.407229 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182623-ea44-4178-aa6c-59dd653edacd admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:18.407755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182623-ea44-4178-aa6c-59dd653edacd admin admin] PATH_INFO: `/v3/projects/98408a5639d14f2e8563e2f4b8a3f3e1/users/ae1c37b95be64b40b781646e9b14fff9/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:18.409861 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55182623-ea44-4178-aa6c-59dd653edacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=98408a5639d14f2e8563e2f4b8a3f3e1, user_id=ae1c37b95be64b40b781646e9b14fff9, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:18.412692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55182623-ea44-4178-aa6c-59dd653edacd admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:18.427312 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4432/8890] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 22:04:18 2021] PUT /identity/v3/projects/98408a5639d14f2e8563e2f4b8a3f3e1/users/ae1c37b95be64b40b781646e9b14fff9/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:04:22.983158 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50ceeb-4308-4a74-8fcb-0dae353aaa69 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:22.983682 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50ceeb-4308-4a74-8fcb-0dae353aaa69 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:22.983773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50ceeb-4308-4a74-8fcb-0dae353aaa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:23.012760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-6f50ceeb-4308-4a74-8fcb-0dae353aaa69 None None] MFA Rules not processed for user `ae1c37b95be64b40b781646e9b14fff9`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:04:23.013958 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-6f50ceeb-4308-4a74-8fcb-0dae353aaa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:23.082117 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4459/8891] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:04:22 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:04:23.093882 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55182623-ea44-4178-aa6c-59dd653edacd admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:23.095649 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-55182623-ea44-4178-aa6c-59dd653edacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:23.186475 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55182623-ea44-4178-aa6c-59dd653edacd admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:23.192078 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a166c4-0744-4049-8c45-45cbc7228dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:23.192748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a166c4-0744-4049-8c45-45cbc7228dcb service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:23.193024 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a166c4-0744-4049-8c45-45cbc7228dcb service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:23.193295 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a166c4-0744-4049-8c45-45cbc7228dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:23.250308 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a166c4-0744-4049-8c45-45cbc7228dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:23.251885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a166c4-0744-4049-8c45-45cbc7228dcb service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:23.262232 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4433/8892] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:04:23 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:04:24.643529 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa116052-db26-4f22-bc89-0e68ee4f0ebb None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:24.644063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa116052-db26-4f22-bc89-0e68ee4f0ebb None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:24.644475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa116052-db26-4f22-bc89-0e68ee4f0ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:24.671170 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-aa116052-db26-4f22-bc89-0e68ee4f0ebb None None] MFA Rules not processed for user `1ca9642dc2294528a287553029ab7c54`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:04:24.672494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-aa116052-db26-4f22-bc89-0e68ee4f0ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:24.679766 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4460/8893] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:04:24 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:04:26.340280 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a166c4-0744-4049-8c45-45cbc7228dcb service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:26.341792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c5a166c4-0744-4049-8c45-45cbc7228dcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:26.438535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a166c4-0744-4049-8c45-45cbc7228dcb service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:26.449595 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05882ef8-075d-491a-b38e-e56432a089d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:26.450725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05882ef8-075d-491a-b38e-e56432a089d8 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:26.451868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05882ef8-075d-491a-b38e-e56432a089d8 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:26.451868 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05882ef8-075d-491a-b38e-e56432a089d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:26.453733 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-05882ef8-075d-491a-b38e-e56432a089d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:26.467627 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05882ef8-075d-491a-b38e-e56432a089d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:26.469248 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05882ef8-075d-491a-b38e-e56432a089d8 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:26.480033 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4434/8894] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:04:26 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:04:38.234181 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa116052-db26-4f22-bc89-0e68ee4f0ebb None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:38.235714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-aa116052-db26-4f22-bc89-0e68ee4f0ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:38.252310 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa116052-db26-4f22-bc89-0e68ee4f0ebb None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:38.257795 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e422af2-0a9f-4c31-9fc5-736d03eb79b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:38.258698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e422af2-0a9f-4c31-9fc5-736d03eb79b7 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:38.258976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e422af2-0a9f-4c31-9fc5-736d03eb79b7 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:38.259267 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e422af2-0a9f-4c31-9fc5-736d03eb79b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:38.261494 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4e422af2-0a9f-4c31-9fc5-736d03eb79b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:38.273919 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e422af2-0a9f-4c31-9fc5-736d03eb79b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:38.275524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e422af2-0a9f-4c31-9fc5-736d03eb79b7 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:38.285915 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4461/8895] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:04:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:04:40.454764 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05882ef8-075d-491a-b38e-e56432a089d8 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:04:40.456198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-05882ef8-075d-491a-b38e-e56432a089d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:04:40.511239 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05882ef8-075d-491a-b38e-e56432a089d8 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:04:40.514911 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ace19d-8e7e-424e-b60d-7796c43db7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:04:40.515827 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ace19d-8e7e-424e-b60d-7796c43db7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:04:40.515926 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ace19d-8e7e-424e-b60d-7796c43db7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:04:40.516159 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ace19d-8e7e-424e-b60d-7796c43db7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:04:40.525345 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ace19d-8e7e-424e-b60d-7796c43db7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:04:40.526820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ace19d-8e7e-424e-b60d-7796c43db7e1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:04:40.536732 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4435/8896] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:04:40 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:05:46.258996 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e422af2-0a9f-4c31-9fc5-736d03eb79b7 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:05:46.268326 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e422af2-0a9f-4c31-9fc5-736d03eb79b7 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:05:46.272122 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd36858-23da-4746-9fc8-a344f6ab3a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:05:46.272748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd36858-23da-4746-9fc8-a344f6ab3a18 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:05:46.273030 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd36858-23da-4746-9fc8-a344f6ab3a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:05:46.273306 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd36858-23da-4746-9fc8-a344f6ab3a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:05:46.275048 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fcd36858-23da-4746-9fc8-a344f6ab3a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:05:46.284196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd36858-23da-4746-9fc8-a344f6ab3a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:05:46.285598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd36858-23da-4746-9fc8-a344f6ab3a18 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:05:46.293160 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4462/8897] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:05:46 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:07:08.131701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bd892-9f0a-47e9-9516-f88bf7f7d795 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:08.132172 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bd892-9f0a-47e9-9516-f88bf7f7d795 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:08.132299 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bd892-9f0a-47e9-9516-f88bf7f7d795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:08.180154 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-632bd892-9f0a-47e9-9516-f88bf7f7d795 None None] MFA Rules not processed for user `7e4c41e7988043c0b3b8e338ccd31d37`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:07:08.181352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-632bd892-9f0a-47e9-9516-f88bf7f7d795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:08.238372 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4436/8898] 10.222.0.21 () {58 vars in 1059 bytes} [Sat Nov 27 22:07:08 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:07:08.244915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd36858-23da-4746-9fc8-a344f6ab3a18 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:07:08.254631 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd36858-23da-4746-9fc8-a344f6ab3a18 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:07:08.258265 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861acf5-1897-41ea-bd7d-f71e59eec74f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:07:08.258899 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861acf5-1897-41ea-bd7d-f71e59eec74f service glance] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:08.259235 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861acf5-1897-41ea-bd7d-f71e59eec74f service glance] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:08.259499 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861acf5-1897-41ea-bd7d-f71e59eec74f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:08.261514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7861acf5-1897-41ea-bd7d-f71e59eec74f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:08.274627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861acf5-1897-41ea-bd7d-f71e59eec74f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:07:08.276108 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861acf5-1897-41ea-bd7d-f71e59eec74f service glance] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:07:08.287511 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4463/8899] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:07:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 22:07:09.548093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bd892-9f0a-47e9-9516-f88bf7f7d795 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:07:09.557347 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bd892-9f0a-47e9-9516-f88bf7f7d795 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:07:09.561561 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622534c-8f1f-4e83-8b75-aaaeead10a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:07:09.562191 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622534c-8f1f-4e83-8b75-aaaeead10a2d service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:09.562472 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622534c-8f1f-4e83-8b75-aaaeead10a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:09.562744 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622534c-8f1f-4e83-8b75-aaaeead10a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:09.564480 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-2622534c-8f1f-4e83-8b75-aaaeead10a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:09.578093 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622534c-8f1f-4e83-8b75-aaaeead10a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:07:09.579539 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622534c-8f1f-4e83-8b75-aaaeead10a2d service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:07:09.590117 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4437/8900] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:07:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:07:19.301139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861acf5-1897-41ea-bd7d-f71e59eec74f service glance] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:07:19.302502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-7861acf5-1897-41ea-bd7d-f71e59eec74f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:19.325345 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861acf5-1897-41ea-bd7d-f71e59eec74f service glance] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:07:19.330309 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f2ccc-9cb2-4cb3-a5b6-e516f5de607d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:07:19.330934 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2ccc-9cb2-4cb3-a5b6-e516f5de607d service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:19.331212 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2ccc-9cb2-4cb3-a5b6-e516f5de607d service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:19.331524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f2ccc-9cb2-4cb3-a5b6-e516f5de607d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:19.333180 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1c9f2ccc-9cb2-4cb3-a5b6-e516f5de607d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:19.344407 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f2ccc-9cb2-4cb3-a5b6-e516f5de607d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:07:19.345949 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f2ccc-9cb2-4cb3-a5b6-e516f5de607d service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:07:19.355362 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4464/8901] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:07:19 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:07:25.071101 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1cbc-4f84-41b6-a2a0-2ada5c837c35 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:25.071628 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1cbc-4f84-41b6-a2a0-2ada5c837c35 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:25.071727 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1cbc-4f84-41b6-a2a0-2ada5c837c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:25.118373 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-fe4c1cbc-4f84-41b6-a2a0-2ada5c837c35 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:07:25.119626 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-fe4c1cbc-4f84-41b6-a2a0-2ada5c837c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:25.180703 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4438/8902] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 22:07:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:07:25.232669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f2ccc-9cb2-4cb3-a5b6-e516f5de607d service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:07:25.234171 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1c9f2ccc-9cb2-4cb3-a5b6-e516f5de607d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:25.320394 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f2ccc-9cb2-4cb3-a5b6-e516f5de607d service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:07:25.325372 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8891a09-0437-430e-96b9-547491bfe12f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:07:25.326585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891a09-0437-430e-96b9-547491bfe12f service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:25.326860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891a09-0437-430e-96b9-547491bfe12f service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:25.327127 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8891a09-0437-430e-96b9-547491bfe12f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:25.334995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8891a09-0437-430e-96b9-547491bfe12f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:07:25.336599 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8891a09-0437-430e-96b9-547491bfe12f service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:07:25.344349 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4465/8903] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 22:07:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 22:07:38.090241 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1cbc-4f84-41b6-a2a0-2ada5c837c35 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:07:38.110342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1cbc-4f84-41b6-a2a0-2ada5c837c35 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:07:38.114061 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90331146-dcdd-433e-b100-3f3bfba0d718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:07:38.114701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90331146-dcdd-433e-b100-3f3bfba0d718 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:38.114987 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90331146-dcdd-433e-b100-3f3bfba0d718 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:38.115276 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90331146-dcdd-433e-b100-3f3bfba0d718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:38.117095 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-90331146-dcdd-433e-b100-3f3bfba0d718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:38.126755 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90331146-dcdd-433e-b100-3f3bfba0d718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:07:38.128175 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90331146-dcdd-433e-b100-3f3bfba0d718 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:07:38.137105 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4439/8904] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:07:38 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:07:38.227021 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c297-68fa-46d6-90aa-28d2a1537d1c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:38.227607 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c297-68fa-46d6-90aa-28d2a1537d1c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:38.227701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c297-68fa-46d6-90aa-28d2a1537d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:38.264730 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9d35c297-68fa-46d6-90aa-28d2a1537d1c None None] MFA Rules not processed for user `aa3373ab52dc4fe680372579cfcde718`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:07:38.265994 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9d35c297-68fa-46d6-90aa-28d2a1537d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:38.296797 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4466/8905] 10.222.0.21 () {58 vars in 1018 bytes} [Sat Nov 27 22:07:38 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 22:07:38.308438 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90331146-dcdd-433e-b100-3f3bfba0d718 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:07:38.317798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90331146-dcdd-433e-b100-3f3bfba0d718 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:07:38.321456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1765ea-d153-4ecc-bb79-75a103658e42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:07:38.322126 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1765ea-d153-4ecc-bb79-75a103658e42 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:38.322413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1765ea-d153-4ecc-bb79-75a103658e42 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:38.322692 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1765ea-d153-4ecc-bb79-75a103658e42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:38.333672 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1765ea-d153-4ecc-bb79-75a103658e42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:07:38.335113 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1765ea-d153-4ecc-bb79-75a103658e42 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:07:38.346511 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4440/8906] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:07:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:07:38.411481 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c297-68fa-46d6-90aa-28d2a1537d1c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:07:38.421448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c297-68fa-46d6-90aa-28d2a1537d1c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:07:38.425113 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51eb42-8fe2-450a-b05c-6301475436d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:07:38.425753 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51eb42-8fe2-450a-b05c-6301475436d5 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:38.426038 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51eb42-8fe2-450a-b05c-6301475436d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:38.426317 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51eb42-8fe2-450a-b05c-6301475436d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:38.428111 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-cd51eb42-8fe2-450a-b05c-6301475436d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:38.437675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51eb42-8fe2-450a-b05c-6301475436d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:07:38.439096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51eb42-8fe2-450a-b05c-6301475436d5 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:07:38.446987 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4467/8907] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:07:38 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:07:38.836263 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1765ea-d153-4ecc-bb79-75a103658e42 service glance] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:07:38.847522 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1765ea-d153-4ecc-bb79-75a103658e42 service glance] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:07:38.852795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26bc6d-3716-4b2b-8f14-dd4d0edbf2bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:07:38.853470 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bc6d-3716-4b2b-8f14-dd4d0edbf2bc service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:38.853772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bc6d-3716-4b2b-8f14-dd4d0edbf2bc service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:38.854048 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bc6d-3716-4b2b-8f14-dd4d0edbf2bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:38.856408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0b26bc6d-3716-4b2b-8f14-dd4d0edbf2bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:38.868109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26bc6d-3716-4b2b-8f14-dd4d0edbf2bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:07:38.869710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26bc6d-3716-4b2b-8f14-dd4d0edbf2bc service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:07:38.880096 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4441/8908] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:07:38 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:07:40.087133 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a5af4-3556-426c-8601-220091d453c0 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:40.087620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a5af4-3556-426c-8601-220091d453c0 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:40.087711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a5af4-3556-426c-8601-220091d453c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:40.106475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-be1a5af4-3556-426c-8601-220091d453c0 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:07:40.107711 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-be1a5af4-3556-426c-8601-220091d453c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:07:40.114913 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4468/8909] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 22:07:40 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:07:40.127358 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26bc6d-3716-4b2b-8f14-dd4d0edbf2bc service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:07:40.139274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26bc6d-3716-4b2b-8f14-dd4d0edbf2bc service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:07:40.144481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29770b59-d0bd-45e7-900a-55f8586d2ba7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:07:40.145148 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29770b59-d0bd-45e7-900a-55f8586d2ba7 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:07:40.145433 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29770b59-d0bd-45e7-900a-55f8586d2ba7 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:07:40.145709 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29770b59-d0bd-45e7-900a-55f8586d2ba7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:07:40.154467 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29770b59-d0bd-45e7-900a-55f8586d2ba7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:07:40.156086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29770b59-d0bd-45e7-900a-55f8586d2ba7 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:07:40.164407 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4442/8910] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 22:07:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 22:08:00.460137 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eef83-9597-40e1-bdee-85da4a3297b8 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:08:00.460618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eef83-9597-40e1-bdee-85da4a3297b8 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:08:00.460710 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eef83-9597-40e1-bdee-85da4a3297b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:08:00.478506 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-601eef83-9597-40e1-bdee-85da4a3297b8 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:08:00.479773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-601eef83-9597-40e1-bdee-85da4a3297b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:08:00.486784 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4469/8911] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 22:08:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 22:08:00.499278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29770b59-d0bd-45e7-900a-55f8586d2ba7 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:08:00.509448 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29770b59-d0bd-45e7-900a-55f8586d2ba7 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:08:00.515232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc787-0d14-48d3-9b48-950319036e81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:08:00.515884 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc787-0d14-48d3-9b48-950319036e81 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:08:00.516167 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc787-0d14-48d3-9b48-950319036e81 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:08:00.516443 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc787-0d14-48d3-9b48-950319036e81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:08:00.524352 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acc787-0d14-48d3-9b48-950319036e81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:08:00.525935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acc787-0d14-48d3-9b48-950319036e81 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:08:00.534572 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4443/8912] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 22:08:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 22:09:37.553400 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601eef83-9597-40e1-bdee-85da4a3297b8 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:09:37.562629 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601eef83-9597-40e1-bdee-85da4a3297b8 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:09:37.566697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48431c6a-9225-4e4e-b1ca-65fb12f11377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:09:37.567362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431c6a-9225-4e4e-b1ca-65fb12f11377 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:09:37.567654 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431c6a-9225-4e4e-b1ca-65fb12f11377 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:09:37.567935 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431c6a-9225-4e4e-b1ca-65fb12f11377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:09:37.576050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48431c6a-9225-4e4e-b1ca-65fb12f11377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:09:37.577476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48431c6a-9225-4e4e-b1ca-65fb12f11377 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:09:37.586932 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4470/8913] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:09:37 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:09:38.435492 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc787-0d14-48d3-9b48-950319036e81 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:09:38.451682 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc787-0d14-48d3-9b48-950319036e81 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:09:38.457335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba14466-8500-4a9a-b039-80ffdf64fc6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:09:38.457988 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba14466-8500-4a9a-b039-80ffdf64fc6d service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:09:38.458278 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba14466-8500-4a9a-b039-80ffdf64fc6d service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:09:38.458609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba14466-8500-4a9a-b039-80ffdf64fc6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:09:38.460495 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0ba14466-8500-4a9a-b039-80ffdf64fc6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:09:38.494085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba14466-8500-4a9a-b039-80ffdf64fc6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:09:38.495851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba14466-8500-4a9a-b039-80ffdf64fc6d service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:09:38.506731 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4444/8914] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:09:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:09:40.718328 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48431c6a-9225-4e4e-b1ca-65fb12f11377 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:09:40.733125 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48431c6a-9225-4e4e-b1ca-65fb12f11377 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:09:40.739580 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb521078-84f7-4c72-ae3c-2d69373ecf70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:09:40.740248 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb521078-84f7-4c72-ae3c-2d69373ecf70 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:09:40.740563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb521078-84f7-4c72-ae3c-2d69373ecf70 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:09:40.740841 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb521078-84f7-4c72-ae3c-2d69373ecf70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:09:40.742590 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-fb521078-84f7-4c72-ae3c-2d69373ecf70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:09:40.755427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb521078-84f7-4c72-ae3c-2d69373ecf70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:09:40.757007 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb521078-84f7-4c72-ae3c-2d69373ecf70 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:09:40.767684 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4471/8915] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:09:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:09:43.326918 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ce522-7f12-45b3-a4dc-0b63baf0e325 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:09:43.327391 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ce522-7f12-45b3-a4dc-0b63baf0e325 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:09:43.327586 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ce522-7f12-45b3-a4dc-0b63baf0e325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:09:43.344551 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-649ce522-7f12-45b3-a4dc-0b63baf0e325 None None] MFA Rules not processed for user `1ca9642dc2294528a287553029ab7c54`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:09:43.345748 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-649ce522-7f12-45b3-a4dc-0b63baf0e325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:09:43.352733 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4445/8916] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:09:43 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:09:46.570521 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb521078-84f7-4c72-ae3c-2d69373ecf70 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:09:46.581573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb521078-84f7-4c72-ae3c-2d69373ecf70 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:09:46.586620 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75e398-589e-41c7-99fe-b480e22c4649 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:09:46.587259 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75e398-589e-41c7-99fe-b480e22c4649 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:09:46.587558 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75e398-589e-41c7-99fe-b480e22c4649 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:09:46.587829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75e398-589e-41c7-99fe-b480e22c4649 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:09:46.595932 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75e398-589e-41c7-99fe-b480e22c4649 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:09:46.597997 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75e398-589e-41c7-99fe-b480e22c4649 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:09:46.607564 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4472/8917] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:09:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:09:59.587772 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ce522-7f12-45b3-a4dc-0b63baf0e325 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:09:59.601247 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ce522-7f12-45b3-a4dc-0b63baf0e325 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:09:59.606885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73084615-09e7-46a4-9d25-c8c96f1d783d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:09:59.607565 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73084615-09e7-46a4-9d25-c8c96f1d783d service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:09:59.607856 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73084615-09e7-46a4-9d25-c8c96f1d783d service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:09:59.608133 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73084615-09e7-46a4-9d25-c8c96f1d783d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:09:59.617960 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73084615-09e7-46a4-9d25-c8c96f1d783d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:09:59.619589 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73084615-09e7-46a4-9d25-c8c96f1d783d service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:09:59.631110 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4446/8918] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:09:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:10:01.737336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75e398-589e-41c7-99fe-b480e22c4649 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:10:01.746336 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75e398-589e-41c7-99fe-b480e22c4649 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:10:01.749969 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968eb2f-57bd-440c-a2bd-3adacf987752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:10:01.750585 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968eb2f-57bd-440c-a2bd-3adacf987752 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:10:01.750865 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968eb2f-57bd-440c-a2bd-3adacf987752 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:10:01.751138 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968eb2f-57bd-440c-a2bd-3adacf987752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:10:01.760610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968eb2f-57bd-440c-a2bd-3adacf987752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:10:01.762313 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968eb2f-57bd-440c-a2bd-3adacf987752 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:10:01.772553 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4473/8919] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:10:01 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:10:50.243545 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73084615-09e7-46a4-9d25-c8c96f1d783d service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:10:50.252612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73084615-09e7-46a4-9d25-c8c96f1d783d service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:10:50.256182 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4345c4-d26c-4f1a-917c-769e1cf89120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:10:50.256814 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4345c4-d26c-4f1a-917c-769e1cf89120 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:10:50.257098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4345c4-d26c-4f1a-917c-769e1cf89120 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:10:50.257379 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4345c4-d26c-4f1a-917c-769e1cf89120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:10:50.265211 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4345c4-d26c-4f1a-917c-769e1cf89120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:10:50.266638 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4345c4-d26c-4f1a-917c-769e1cf89120 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:10:50.274343 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4447/8920] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:10:50 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:12:10.077700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968eb2f-57bd-440c-a2bd-3adacf987752 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:12:10.086215 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968eb2f-57bd-440c-a2bd-3adacf987752 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:12:10.089858 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e2e23-4171-4fa7-acc1-91682fe39630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:12:10.090488 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e2e23-4171-4fa7-acc1-91682fe39630 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:12:10.090771 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e2e23-4171-4fa7-acc1-91682fe39630 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:12:10.091046 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e2e23-4171-4fa7-acc1-91682fe39630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:12:10.107594 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e2e23-4171-4fa7-acc1-91682fe39630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:12:10.108964 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e2e23-4171-4fa7-acc1-91682fe39630 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:12:10.119993 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4474/8921] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:12:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:12:11.289798 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4345c4-d26c-4f1a-917c-769e1cf89120 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:12:11.298195 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4345c4-d26c-4f1a-917c-769e1cf89120 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:12:11.301804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a339-4169-4adb-b514-002d084b9800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:12:11.302431 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a339-4169-4adb-b514-002d084b9800 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:12:11.302715 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a339-4169-4adb-b514-002d084b9800 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:12:11.302994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a339-4169-4adb-b514-002d084b9800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:12:11.313185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1a339-4169-4adb-b514-002d084b9800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:12:11.314615 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1a339-4169-4adb-b514-002d084b9800 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:12:11.325568 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4448/8922] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:12:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:12:22.025482 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e2e23-4171-4fa7-acc1-91682fe39630 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:12:22.033819 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e2e23-4171-4fa7-acc1-91682fe39630 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:12:22.037510 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a36ad-faed-47e9-b765-f19b3de3a3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:12:22.038139 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a36ad-faed-47e9-b765-f19b3de3a3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:12:22.038422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a36ad-faed-47e9-b765-f19b3de3a3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:12:22.038697 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a36ad-faed-47e9-b765-f19b3de3a3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:12:22.040475 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-5f9a36ad-faed-47e9-b765-f19b3de3a3b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:12:22.049550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a36ad-faed-47e9-b765-f19b3de3a3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:12:22.051471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a36ad-faed-47e9-b765-f19b3de3a3b5 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:12:22.059556 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4475/8923] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:12:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:12:22.236481 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a339-4169-4adb-b514-002d084b9800 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:12:22.248003 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a339-4169-4adb-b514-002d084b9800 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:12:22.252971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d7758-7965-41fe-9455-36d31789245d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:12:22.253606 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d7758-7965-41fe-9455-36d31789245d service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:12:22.253895 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d7758-7965-41fe-9455-36d31789245d service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:12:22.254226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d7758-7965-41fe-9455-36d31789245d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:12:22.256576 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-941d7758-7965-41fe-9455-36d31789245d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:12:22.268504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d7758-7965-41fe-9455-36d31789245d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:12:22.270145 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d7758-7965-41fe-9455-36d31789245d service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:12:22.280186 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4449/8924] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:12:22 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:12:23.641566 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a36ad-faed-47e9-b765-f19b3de3a3b5 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:12:23.653587 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a36ad-faed-47e9-b765-f19b3de3a3b5 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:12:23.658643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9470c-2aa4-41a5-bfc7-266f819134f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:12:23.659293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9470c-2aa4-41a5-bfc7-266f819134f7 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:12:23.659584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9470c-2aa4-41a5-bfc7-266f819134f7 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:12:23.659895 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9470c-2aa4-41a5-bfc7-266f819134f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:12:23.668077 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9470c-2aa4-41a5-bfc7-266f819134f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:12:23.669643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9470c-2aa4-41a5-bfc7-266f819134f7 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:12:23.679924 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4476/8925] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:12:23 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:12:24.114107 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d7758-7965-41fe-9455-36d31789245d service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:12:24.123567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d7758-7965-41fe-9455-36d31789245d service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:12:24.127096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150466c9-2481-4ca2-8353-c1bd81c29ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:12:24.127752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150466c9-2481-4ca2-8353-c1bd81c29ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:12:24.128033 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150466c9-2481-4ca2-8353-c1bd81c29ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:12:24.128304 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150466c9-2481-4ca2-8353-c1bd81c29ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:12:24.130002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-150466c9-2481-4ca2-8353-c1bd81c29ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:12:24.139499 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150466c9-2481-4ca2-8353-c1bd81c29ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:12:24.140919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150466c9-2481-4ca2-8353-c1bd81c29ee9 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:12:24.148628 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4450/8926] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:12:24 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:12:50.473673 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9470c-2aa4-41a5-bfc7-266f819134f7 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:12:50.484573 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9470c-2aa4-41a5-bfc7-266f819134f7 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:12:50.489570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343397bb-ea94-4fa9-8c32-9eed77e4bc66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:12:50.490195 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343397bb-ea94-4fa9-8c32-9eed77e4bc66 service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:12:50.490479 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343397bb-ea94-4fa9-8c32-9eed77e4bc66 service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:12:50.490754 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343397bb-ea94-4fa9-8c32-9eed77e4bc66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:12:50.499172 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343397bb-ea94-4fa9-8c32-9eed77e4bc66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:12:50.500761 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343397bb-ea94-4fa9-8c32-9eed77e4bc66 service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:12:50.510345 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4477/8927] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:12:50 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:14:03.370219 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150466c9-2481-4ca2-8353-c1bd81c29ee9 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:03.379147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150466c9-2481-4ca2-8353-c1bd81c29ee9 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:03.382860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558518b4-bf67-47db-a65b-df03d08f9f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:03.383528 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558518b4-bf67-47db-a65b-df03d08f9f0d service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:03.383863 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558518b4-bf67-47db-a65b-df03d08f9f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:03.384146 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558518b4-bf67-47db-a65b-df03d08f9f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:03.443910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558518b4-bf67-47db-a65b-df03d08f9f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:03.445365 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558518b4-bf67-47db-a65b-df03d08f9f0d service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:03.454989 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4451/8928] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:14:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:14:10.006817 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343397bb-ea94-4fa9-8c32-9eed77e4bc66 service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:10.017606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343397bb-ea94-4fa9-8c32-9eed77e4bc66 service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:10.022763 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:10.023674 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:10.024220 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:10.024502 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] PATH_INFO: `/v3/users/1ca9642dc2294528a287553029ab7c54` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:10.026004 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca9642dc2294528a287553029ab7c54)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:10.028356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:10.074807 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca9642dc2294528a287553029ab7c54'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.082054 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca9642dc2294528a287553029ab7c54'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.082748 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca9642dc2294528a287553029ab7c54'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.089543 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca9642dc2294528a287553029ab7c54'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.101029 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca9642dc2294528a287553029ab7c54'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.106759 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4478/8929] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 22:14:10 2021] DELETE /identity/v3/users/1ca9642dc2294528a287553029ab7c54 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:14:10.276910 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558518b4-bf67-47db-a65b-df03d08f9f0d service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:10.288376 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558518b4-bf67-47db-a65b-df03d08f9f0d service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:10.346833 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:10.347712 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:10.347991 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:10.348297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] PATH_INFO: `/v3/projects/2673f0e267164ddc9371d10cb58d17aa` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:10.349759 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2673f0e267164ddc9371d10cb58d17aa)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:10.351931 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:10.396124 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2673f0e267164ddc9371d10cb58d17aa', 'request_id': 'req-22caa456-b8e9-49d2-b374-1ffa92f9c129'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.401971 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2673f0e267164ddc9371d10cb58d17aa', 'request_id': 'req-22caa456-b8e9-49d2-b374-1ffa92f9c129'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.409274 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2673f0e267164ddc9371d10cb58d17aa', 'request_id': 'req-22caa456-b8e9-49d2-b374-1ffa92f9c129'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.419166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] The token cache is being invalidate because project 2673f0e267164ddc9371d10cb58d17aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 22:14:10.419504 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.420166 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.421740 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4452/8930] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 22:14:10 2021] DELETE /identity/v3/projects/2673f0e267164ddc9371d10cb58d17aa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:14:10.426399 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:10.427847 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:10.440586 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5348c8-ad2d-40f0-8307-329c90074ac3 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:10.497196 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4809e8c-9e85-4d6a-ba30-d98d6c0d4043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:10.498062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4809e8c-9e85-4d6a-ba30-d98d6c0d4043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:10.498344 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4809e8c-9e85-4d6a-ba30-d98d6c0d4043 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:10.498618 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4809e8c-9e85-4d6a-ba30-d98d6c0d4043 admin admin] PATH_INFO: `/v3/users/ae1c37b95be64b40b781646e9b14fff9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:10.499901 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4809e8c-9e85-4d6a-ba30-d98d6c0d4043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1c37b95be64b40b781646e9b14fff9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:10.501824 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4809e8c-9e85-4d6a-ba30-d98d6c0d4043 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:10.546207 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c4809e8c-9e85-4d6a-ba30-d98d6c0d4043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1c37b95be64b40b781646e9b14fff9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.554561 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c4809e8c-9e85-4d6a-ba30-d98d6c0d4043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1c37b95be64b40b781646e9b14fff9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.555348 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c4809e8c-9e85-4d6a-ba30-d98d6c0d4043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1c37b95be64b40b781646e9b14fff9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.562486 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c4809e8c-9e85-4d6a-ba30-d98d6c0d4043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1c37b95be64b40b781646e9b14fff9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.574126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c4809e8c-9e85-4d6a-ba30-d98d6c0d4043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1c37b95be64b40b781646e9b14fff9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.580133 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4479/8931] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 22:14:10 2021] DELETE /identity/v3/users/ae1c37b95be64b40b781646e9b14fff9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 22:14:10.750432 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:10.752112 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:10.765569 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22caa456-b8e9-49d2-b374-1ffa92f9c129 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:10.829155 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:10.830016 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:10.830913 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:10.831189 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] PATH_INFO: `/v3/projects/98408a5639d14f2e8563e2f4b8a3f3e1` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:10.832456 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98408a5639d14f2e8563e2f4b8a3f3e1)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:10.834377 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:10.885578 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98408a5639d14f2e8563e2f4b8a3f3e1', 'request_id': 'req-ee000542-ed6c-4522-90a1-a19626dc8421'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.892065 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98408a5639d14f2e8563e2f4b8a3f3e1', 'request_id': 'req-ee000542-ed6c-4522-90a1-a19626dc8421'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.900151 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98408a5639d14f2e8563e2f4b8a3f3e1', 'request_id': 'req-ee000542-ed6c-4522-90a1-a19626dc8421'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.910985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] The token cache is being invalidate because project 98408a5639d14f2e8563e2f4b8a3f3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90122) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 22:14:10.911298 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.911948 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ee000542-ed6c-4522-90a1-a19626dc8421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:14:10.913505 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4453/8932] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 22:14:10 2021] DELETE /identity/v3/projects/98408a5639d14f2e8563e2f4b8a3f3e1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:14:10.919602 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4302e-b5ba-427f-8aa1-07db935318f4 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:10.919967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4302e-b5ba-427f-8aa1-07db935318f4 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:10.920319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4302e-b5ba-427f-8aa1-07db935318f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:10.940020 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-37c4302e-b5ba-427f-8aa1-07db935318f4 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:14:10.941222 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-37c4302e-b5ba-427f-8aa1-07db935318f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:10.999933 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4480/8933] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:14:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 22:14:11.007937 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae65ef-05ea-4f2f-b9df-c7fc198fbaf7 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:11.008232 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae65ef-05ea-4f2f-b9df-c7fc198fbaf7 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:11.008542 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae65ef-05ea-4f2f-b9df-c7fc198fbaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:11.028185 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-b3ae65ef-05ea-4f2f-b9df-c7fc198fbaf7 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:14:11.029371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b3ae65ef-05ea-4f2f-b9df-c7fc198fbaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:11.037879 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4454/8934] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:14:11.042161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4302e-b5ba-427f-8aa1-07db935318f4 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:11.051869 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4302e-b5ba-427f-8aa1-07db935318f4 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:11.056981 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f5a1-3591-4e5f-b858-ba602264c363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:11.057643 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f5a1-3591-4e5f-b858-ba602264c363 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:11.057923 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f5a1-3591-4e5f-b858-ba602264c363 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:11.058190 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f5a1-3591-4e5f-b858-ba602264c363 admin admin] PATH_INFO: `/v3/domains` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:11.058925 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99f5a1-3591-4e5f-b858-ba602264c363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90123) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 27 22:14:11.059233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99f5a1-3591-4e5f-b858-ba602264c363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:11.060839 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99f5a1-3591-4e5f-b858-ba602264c363 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:11.072684 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4481/8935] 10.222.0.21 () {58 vars in 1152 bytes} [Sat Nov 27 22:14:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 27 22:14:11.077096 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae65ef-05ea-4f2f-b9df-c7fc198fbaf7 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:11.086851 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae65ef-05ea-4f2f-b9df-c7fc198fbaf7 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:11.091745 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797f1e5-f26e-41fe-a16d-53c5780567b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:11.092393 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797f1e5-f26e-41fe-a16d-53c5780567b4 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:11.092676 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797f1e5-f26e-41fe-a16d-53c5780567b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:11.092954 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797f1e5-f26e-41fe-a16d-53c5780567b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:11.093664 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797f1e5-f26e-41fe-a16d-53c5780567b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:11.095609 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797f1e5-f26e-41fe-a16d-53c5780567b4 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:11.120726 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4455/8936] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 22:14:11 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 22:14:11.124658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f5a1-3591-4e5f-b858-ba602264c363 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:11.134746 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f5a1-3591-4e5f-b858-ba602264c363 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:11.188757 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484197-dde5-447d-8519-8784f14920b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:11.189427 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484197-dde5-447d-8519-8784f14920b5 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:11.190356 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484197-dde5-447d-8519-8784f14920b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:11.190636 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1484197-dde5-447d-8519-8784f14920b5 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:11.191430 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1484197-dde5-447d-8519-8784f14920b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:11.193820 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1484197-dde5-447d-8519-8784f14920b5 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:11.214598 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4482/8937] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 22:14:11 2021] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 22:14:11.218728 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797f1e5-f26e-41fe-a16d-53c5780567b4 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:11.228898 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797f1e5-f26e-41fe-a16d-53c5780567b4 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:11.233477 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc67b86-a200-4bd1-b2f1-0d93ae03d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:11.234123 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67b86-a200-4bd1-b2f1-0d93ae03d3ea admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:11.234404 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67b86-a200-4bd1-b2f1-0d93ae03d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:11.234675 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67b86-a200-4bd1-b2f1-0d93ae03d3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:11.235429 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc67b86-a200-4bd1-b2f1-0d93ae03d3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:11.237021 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc67b86-a200-4bd1-b2f1-0d93ae03d3ea admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:11.247179 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4456/8938] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 22:14:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 22:14:11.251073 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484197-dde5-447d-8519-8784f14920b5 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:11.261274 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1484197-dde5-447d-8519-8784f14920b5 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:11.266097 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84addb2e-7720-461a-96db-ffc9e0e4a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:11.266735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84addb2e-7720-461a-96db-ffc9e0e4a014 admin admin] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:11.267014 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84addb2e-7720-461a-96db-ffc9e0e4a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:11.267322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84addb2e-7720-461a-96db-ffc9e0e4a014 admin admin] PATH_INFO: `/v3/roles` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:11.268751 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84addb2e-7720-461a-96db-ffc9e0e4a014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:11.270322 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84addb2e-7720-461a-96db-ffc9e0e4a014 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:11.280271 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4483/8939] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 22:14:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 27 22:14:11.284209 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc67b86-a200-4bd1-b2f1-0d93ae03d3ea admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:11.293885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc67b86-a200-4bd1-b2f1-0d93ae03d3ea admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:11.298497 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3bb5d-4d6b-496f-b145-30f335076e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:11.299386 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3bb5d-4d6b-496f-b145-30f335076e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:11.299665 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3bb5d-4d6b-496f-b145-30f335076e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:11.299934 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3bb5d-4d6b-496f-b145-30f335076e5e admin admin] PATH_INFO: `/v3/projects/43420851d76644b8bd7d25b34365dce9/users/601728112c7c4e689208826544604460/roles/e3eef42cb87d4017b957fccc4eb21e62` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:11.314395 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3bb5d-4d6b-496f-b145-30f335076e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43420851d76644b8bd7d25b34365dce9, user_id=601728112c7c4e689208826544604460, role_id=e3eef42cb87d4017b957fccc4eb21e62)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:11.317529 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3bb5d-4d6b-496f-b145-30f335076e5e admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:11.331395 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4457/8940] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 22:14:11 2021] PUT /identity/v3/projects/43420851d76644b8bd7d25b34365dce9/users/601728112c7c4e689208826544604460/roles/e3eef42cb87d4017b957fccc4eb21e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:14:11.336563 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1476-eaef-41ee-b951-5e9121fbcb31 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:11.336853 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1476-eaef-41ee-b951-5e9121fbcb31 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:11.337132 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea1476-eaef-41ee-b951-5e9121fbcb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:11.355110 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-b1ea1476-eaef-41ee-b951-5e9121fbcb31 None None] MFA Rules not processed for user `3ad02887ca234176a8ab03d817e9a1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:14:11.356349 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-b1ea1476-eaef-41ee-b951-5e9121fbcb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:11.414214 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4484/8941] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:14:11.424214 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3bb5d-4d6b-496f-b145-30f335076e5e admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:11.426087 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-43f3bb5d-4d6b-496f-b145-30f335076e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:11.495180 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3bb5d-4d6b-496f-b145-30f335076e5e admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:11.498840 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4080273-a6d1-4f68-b440-a62142dba32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:11.499525 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4080273-a6d1-4f68-b440-a62142dba32e service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:11.499807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4080273-a6d1-4f68-b440-a62142dba32e service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:11.500105 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4080273-a6d1-4f68-b440-a62142dba32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:11.509634 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4080273-a6d1-4f68-b440-a62142dba32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:11.511058 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4080273-a6d1-4f68-b440-a62142dba32e service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:11.520586 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4458/8942] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:14:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:14:15.516434 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e1eb8-c935-46a8-b183-0dd186842d1c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:15.516945 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e1eb8-c935-46a8-b183-0dd186842d1c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:15.517279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e1eb8-c935-46a8-b183-0dd186842d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:15.543468 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-4d6e1eb8-c935-46a8-b183-0dd186842d1c None None] MFA Rules not processed for user `601728112c7c4e689208826544604460`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:14:15.544606 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-4d6e1eb8-c935-46a8-b183-0dd186842d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:15.619137 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4485/8943] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:14:15 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:14:15.620488 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4080273-a6d1-4f68-b440-a62142dba32e service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:15.648216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4080273-a6d1-4f68-b440-a62142dba32e service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:15.652835 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a474a3-92ca-4242-b233-dc405d2bb544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:15.653486 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a474a3-92ca-4242-b233-dc405d2bb544 admin admin] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:15.653769 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a474a3-92ca-4242-b233-dc405d2bb544 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:15.654045 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a474a3-92ca-4242-b233-dc405d2bb544 admin admin] PATH_INFO: `/v3/projects` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:15.654737 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a474a3-92ca-4242-b233-dc405d2bb544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:15.656684 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a474a3-92ca-4242-b233-dc405d2bb544 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:15.708660 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4459/8944] 10.222.0.21 () {60 vars in 1152 bytes} [Sat Nov 27 22:14:15 2021] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 22:14:15.712950 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e1eb8-c935-46a8-b183-0dd186842d1c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:15.724633 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e1eb8-c935-46a8-b183-0dd186842d1c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:15.781574 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42327a-8001-4f68-8c80-d76bfd906302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:15.782233 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42327a-8001-4f68-8c80-d76bfd906302 admin admin] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:15.782514 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42327a-8001-4f68-8c80-d76bfd906302 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:15.782786 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42327a-8001-4f68-8c80-d76bfd906302 admin admin] PATH_INFO: `/v3/users` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:15.784104 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42327a-8001-4f68-8c80-d76bfd906302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:15.786168 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42327a-8001-4f68-8c80-d76bfd906302 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:15.808183 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4486/8945] 10.222.0.21 () {60 vars in 1143 bytes} [Sat Nov 27 22:14:15 2021] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 27 22:14:15.812162 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a474a3-92ca-4242-b233-dc405d2bb544 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:15.825681 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a474a3-92ca-4242-b233-dc405d2bb544 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:15.830734 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ee3f4-3880-43b2-9275-93fe6eabbefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:15.831441 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee3f4-3880-43b2-9275-93fe6eabbefb admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:15.831724 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee3f4-3880-43b2-9275-93fe6eabbefb admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:15.831998 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee3f4-3880-43b2-9275-93fe6eabbefb admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:15.832860 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ee3f4-3880-43b2-9275-93fe6eabbefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:15.835540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ee3f4-3880-43b2-9275-93fe6eabbefb admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:15.859916 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4460/8946] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 22:14:15 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 22:14:15.860557 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42327a-8001-4f68-8c80-d76bfd906302 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:15.873849 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42327a-8001-4f68-8c80-d76bfd906302 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:15.878829 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6f93-78a0-4165-917c-a1dfa985f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:15.879789 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6f93-78a0-4165-917c-a1dfa985f035 admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:15.880076 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6f93-78a0-4165-917c-a1dfa985f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:15.880368 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6f93-78a0-4165-917c-a1dfa985f035 admin admin] PATH_INFO: `/v3/projects/cf9d576ed99f4e5f89b93410451ee764/users/89c8a0e2bf0f46c9b561f6c6488a658d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:15.896550 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d6f93-78a0-4165-917c-a1dfa985f035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9d576ed99f4e5f89b93410451ee764, user_id=89c8a0e2bf0f46c9b561f6c6488a658d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:15.899243 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d6f93-78a0-4165-917c-a1dfa985f035 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:15.915692 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4487/8947] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 22:14:15 2021] PUT /identity/v3/projects/cf9d576ed99f4e5f89b93410451ee764/users/89c8a0e2bf0f46c9b561f6c6488a658d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 27 22:14:15.920139 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ee3f4-3880-43b2-9275-93fe6eabbefb admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:15.931337 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ee3f4-3880-43b2-9275-93fe6eabbefb admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:15.991072 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564313c-b225-49c3-95aa-c56fb923638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:15.991804 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564313c-b225-49c3-95aa-c56fb923638f admin admin] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:15.992089 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564313c-b225-49c3-95aa-c56fb923638f admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:15.992363 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564313c-b225-49c3-95aa-c56fb923638f admin admin] PATH_INFO: `/v3/roles` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:15.993111 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564313c-b225-49c3-95aa-c56fb923638f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:15.995000 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564313c-b225-49c3-95aa-c56fb923638f admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:16.005869 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4461/8948] 10.222.0.21 () {58 vars in 1121 bytes} [Sat Nov 27 22:14:15 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 27 22:14:16.010079 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6f93-78a0-4165-917c-a1dfa985f035 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:16.021615 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6f93-78a0-4165-917c-a1dfa985f035 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:16.026773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0622a7-3d06-4a07-8f9f-b859c424d61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:16.027685 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0622a7-3d06-4a07-8f9f-b859c424d61f admin admin] REQUEST_METHOD: `PUT` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:16.027967 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0622a7-3d06-4a07-8f9f-b859c424d61f admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:16.028242 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0622a7-3d06-4a07-8f9f-b859c424d61f admin admin] PATH_INFO: `/v3/projects/cf9d576ed99f4e5f89b93410451ee764/users/89c8a0e2bf0f46c9b561f6c6488a658d/roles/f0f7eb6ce00345e79b333982649f1ff7` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:16.030244 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0622a7-3d06-4a07-8f9f-b859c424d61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9d576ed99f4e5f89b93410451ee764, user_id=89c8a0e2bf0f46c9b561f6c6488a658d, role_id=f0f7eb6ce00345e79b333982649f1ff7)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:16.032995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0622a7-3d06-4a07-8f9f-b859c424d61f admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:16.044592 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4488/8949] 10.222.0.21 () {60 vars in 1482 bytes} [Sat Nov 27 22:14:16 2021] PUT /identity/v3/projects/cf9d576ed99f4e5f89b93410451ee764/users/89c8a0e2bf0f46c9b561f6c6488a658d/roles/f0f7eb6ce00345e79b333982649f1ff7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:14:20.633147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d918b-0e96-451c-8367-845dfa105e41 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:20.633685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d918b-0e96-451c-8367-845dfa105e41 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:20.633685 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d918b-0e96-451c-8367-845dfa105e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:20.660331 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-ec2d918b-0e96-451c-8367-845dfa105e41 None None] MFA Rules not processed for user `89c8a0e2bf0f46c9b561f6c6488a658d`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:14:20.661558 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ec2d918b-0e96-451c-8367-845dfa105e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:20.737428 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4462/8950] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:14:20 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:14:20.748889 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0622a7-3d06-4a07-8f9f-b859c424d61f admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:20.752327 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ca0622a7-3d06-4a07-8f9f-b859c424d61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:20.848009 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0622a7-3d06-4a07-8f9f-b859c424d61f admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:20.853740 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd371fb7-28f0-49fa-b031-41ac8aa4f277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:20.854390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd371fb7-28f0-49fa-b031-41ac8aa4f277 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:20.854675 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd371fb7-28f0-49fa-b031-41ac8aa4f277 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:20.854955 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd371fb7-28f0-49fa-b031-41ac8aa4f277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:20.921112 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd371fb7-28f0-49fa-b031-41ac8aa4f277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:20.924293 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd371fb7-28f0-49fa-b031-41ac8aa4f277 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:20.935310 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4489/8951] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:14:20 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:14:22.218816 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2765cf4-88da-4c09-b8d2-ebf5437089e2 None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:22.219445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2765cf4-88da-4c09-b8d2-ebf5437089e2 None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:22.219445 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2765cf4-88da-4c09-b8d2-ebf5437089e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:22.240015 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-e2765cf4-88da-4c09-b8d2-ebf5437089e2 None None] MFA Rules not processed for user `601728112c7c4e689208826544604460`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:14:22.241439 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-e2765cf4-88da-4c09-b8d2-ebf5437089e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:22.250815 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4463/8952] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:14:22 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:14:22.579050 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd371fb7-28f0-49fa-b031-41ac8aa4f277 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:22.580588 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-dd371fb7-28f0-49fa-b031-41ac8aa4f277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:22.654926 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd371fb7-28f0-49fa-b031-41ac8aa4f277 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:22.659390 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb145cd-9811-46bd-9e0d-d6364d3a8b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:22.660055 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb145cd-9811-46bd-9e0d-d6364d3a8b4b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:22.660339 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb145cd-9811-46bd-9e0d-d6364d3a8b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:22.660613 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb145cd-9811-46bd-9e0d-d6364d3a8b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:22.662692 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-8bb145cd-9811-46bd-9e0d-d6364d3a8b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:14:22.674948 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb145cd-9811-46bd-9e0d-d6364d3a8b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:22.676627 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb145cd-9811-46bd-9e0d-d6364d3a8b4b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:22.698477 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4490/8953] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:14:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:14:33.909792 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2765cf4-88da-4c09-b8d2-ebf5437089e2 None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:14:33.919342 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2765cf4-88da-4c09-b8d2-ebf5437089e2 None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:14:33.922951 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4389ef5-6dc4-4279-b450-499aa214651a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:14:33.923693 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4389ef5-6dc4-4279-b450-499aa214651a service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:14:33.923981 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4389ef5-6dc4-4279-b450-499aa214651a service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:14:33.924260 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4389ef5-6dc4-4279-b450-499aa214651a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:14:33.933098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4389ef5-6dc4-4279-b450-499aa214651a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:14:33.934532 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4389ef5-6dc4-4279-b450-499aa214651a service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:14:33.944576 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4464/8954] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:14:33 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:15:55.836352 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb145cd-9811-46bd-9e0d-d6364d3a8b4b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:15:55.844810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb145cd-9811-46bd-9e0d-d6364d3a8b4b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:15:55.849154 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee355365-2371-4fc9-830a-05b348aef018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:15:55.849779 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee355365-2371-4fc9-830a-05b348aef018 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:15:55.850061 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee355365-2371-4fc9-830a-05b348aef018 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:15:55.850335 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee355365-2371-4fc9-830a-05b348aef018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:15:55.852119 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-ee355365-2371-4fc9-830a-05b348aef018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:15:55.861213 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee355365-2371-4fc9-830a-05b348aef018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:15:55.862634 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee355365-2371-4fc9-830a-05b348aef018 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:15:55.870328 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4491/8955] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:15:55 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:17:09.982361 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4389ef5-6dc4-4279-b450-499aa214651a service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:17:09.983809 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b4389ef5-6dc4-4279-b450-499aa214651a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:10.012818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4389ef5-6dc4-4279-b450-499aa214651a service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:17:10.019600 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5ef5c-33b6-457a-8d4e-03ce6ca4cc90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:17:10.020368 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ef5c-33b6-457a-8d4e-03ce6ca4cc90 service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:10.020658 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ef5c-33b6-457a-8d4e-03ce6ca4cc90 service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:10.020932 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ef5c-33b6-457a-8d4e-03ce6ca4cc90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:10.022765 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f9d5ef5c-33b6-457a-8d4e-03ce6ca4cc90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:10.036611 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5ef5c-33b6-457a-8d4e-03ce6ca4cc90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:17:10.038222 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5ef5c-33b6-457a-8d4e-03ce6ca4cc90 service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:17:10.049373 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4465/8956] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:17:09 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:17:11.553422 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c708b9-fdcc-47de-b385-5fa1c9d9d9e1 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:11.553914 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c708b9-fdcc-47de-b385-5fa1c9d9d9e1 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:11.554025 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c708b9-fdcc-47de-b385-5fa1c9d9d9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:11.581531 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-d5c708b9-fdcc-47de-b385-5fa1c9d9d9e1 None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:17:11.582743 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d5c708b9-fdcc-47de-b385-5fa1c9d9d9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:11.636820 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4492/8957] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 22:17:11 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:17:11.684297 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5ef5c-33b6-457a-8d4e-03ce6ca4cc90 service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:17:11.685686 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f9d5ef5c-33b6-457a-8d4e-03ce6ca4cc90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:11.752850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5ef5c-33b6-457a-8d4e-03ce6ca4cc90 service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:17:11.758122 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeaef6-1d22-421e-bd7b-5a1570ca84e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:17:11.758800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeaef6-1d22-421e-bd7b-5a1570ca84e1 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:11.759086 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeaef6-1d22-421e-bd7b-5a1570ca84e1 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:11.759399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeaef6-1d22-421e-bd7b-5a1570ca84e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:11.768294 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeeaef6-1d22-421e-bd7b-5a1570ca84e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:17:11.769885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeeaef6-1d22-421e-bd7b-5a1570ca84e1 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:17:11.777937 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4466/8958] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 22:17:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 22:17:21.261169 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b72b-53f0-4a48-9b36-d87c84b716d6 None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:21.261635 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b72b-53f0-4a48-9b36-d87c84b716d6 None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:21.261764 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b72b-53f0-4a48-9b36-d87c84b716d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:21.279041 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-9e62b72b-53f0-4a48-9b36-d87c84b716d6 None None] MFA Rules not processed for user `601728112c7c4e689208826544604460`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:17:21.280264 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-9e62b72b-53f0-4a48-9b36-d87c84b716d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:21.287297 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4493/8959] 10.222.0.21 () {58 vars in 957 bytes} [Sat Nov 27 22:17:21 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 27 22:17:21.351381 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeaef6-1d22-421e-bd7b-5a1570ca84e1 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:17:21.352775 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ddeeaef6-1d22-421e-bd7b-5a1570ca84e1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:21.430266 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeaef6-1d22-421e-bd7b-5a1570ca84e1 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:17:21.433966 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9239-b390-4719-a4ba-8b581b56a935 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e4c41e7988043c0b3b8e338ccd31d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:17:21.434614 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9239-b390-4719-a4ba-8b581b56a935 service glance] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:21.434947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9239-b390-4719-a4ba-8b581b56a935 service glance] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:21.435220 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df9239-b390-4719-a4ba-8b581b56a935 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:21.437567 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-96df9239-b390-4719-a4ba-8b581b56a935 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:21.452173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df9239-b390-4719-a4ba-8b581b56a935 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:17:21.453650 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df9239-b390-4719-a4ba-8b581b56a935 service glance] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:17:21.464767 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4467/8960] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:17:21 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:17:21.749437 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62b72b-53f0-4a48-9b36-d87c84b716d6 None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:17:21.758714 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62b72b-53f0-4a48-9b36-d87c84b716d6 None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:17:21.762241 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636c4d3-f11f-49e1-b399-5963d31dd358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:17:21.762875 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636c4d3-f11f-49e1-b399-5963d31dd358 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:21.763161 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636c4d3-f11f-49e1-b399-5963d31dd358 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:21.763476 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636c4d3-f11f-49e1-b399-5963d31dd358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:21.765477 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-1636c4d3-f11f-49e1-b399-5963d31dd358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:21.774630 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636c4d3-f11f-49e1-b399-5963d31dd358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:17:21.776126 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636c4d3-f11f-49e1-b399-5963d31dd358 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:17:21.784263 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4494/8961] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:17:21 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 27 22:17:22.118212 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9239-b390-4719-a4ba-8b581b56a935 service glance] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:17:22.127355 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df9239-b390-4719-a4ba-8b581b56a935 service glance] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:17:22.131234 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4668fa-948c-4634-b4c8-16d655375ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:17:22.131919 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4668fa-948c-4634-b4c8-16d655375ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:22.132165 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4668fa-948c-4634-b4c8-16d655375ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:22.132447 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4668fa-948c-4634-b4c8-16d655375ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:22.134198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-0a4668fa-948c-4634-b4c8-16d655375ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:22.148579 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4668fa-948c-4634-b4c8-16d655375ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:17:22.150037 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4668fa-948c-4634-b4c8-16d655375ce1 service neutron] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:17:22.165227 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4468/8962] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:17:22 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:17:23.304828 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d3f5-3e69-41bb-be5a-7be971fd1e3c None None] REQUEST_METHOD: `POST` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:23.305373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d3f5-3e69-41bb-be5a-7be971fd1e3c None None] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:23.305513 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332d3f5-3e69-41bb-be5a-7be971fd1e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:23.324387 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.auth.core [None req-a332d3f5-3e69-41bb-be5a-7be971fd1e3c None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90123) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:17:23.325760 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-a332d3f5-3e69-41bb-be5a-7be971fd1e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:23.333415 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4495/8963] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 22:17:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:17:23.347807 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4668fa-948c-4634-b4c8-16d655375ce1 service neutron] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:17:23.359010 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4668fa-948c-4634-b4c8-16d655375ce1 service neutron] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:17:23.364698 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299daa4-a107-4b7f-aaf8-cc2d23e5b3d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:17:23.365421 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299daa4-a107-4b7f-aaf8-cc2d23e5b3d5 service swift] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:23.365752 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299daa4-a107-4b7f-aaf8-cc2d23e5b3d5 service swift] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:23.366098 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299daa4-a107-4b7f-aaf8-cc2d23e5b3d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:23.374947 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299daa4-a107-4b7f-aaf8-cc2d23e5b3d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:17:23.376779 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299daa4-a107-4b7f-aaf8-cc2d23e5b3d5 service swift] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:17:23.385254 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4469/8964] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 22:17:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 22:17:34.012450 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332d3f5-3e69-41bb-be5a-7be971fd1e3c None None] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:17:34.022890 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332d3f5-3e69-41bb-be5a-7be971fd1e3c None None] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:17:34.026431 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d83f94-c9d8-4fcc-a9b7-f5ce17a5161b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:17:34.027063 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d83f94-c9d8-4fcc-a9b7-f5ce17a5161b service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:34.027370 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d83f94-c9d8-4fcc-a9b7-f5ce17a5161b service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:34.027644 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d83f94-c9d8-4fcc-a9b7-f5ce17a5161b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:34.029406 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-f8d83f94-c9d8-4fcc-a9b7-f5ce17a5161b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:34.040049 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d83f94-c9d8-4fcc-a9b7-f5ce17a5161b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:17:34.041472 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d83f94-c9d8-4fcc-a9b7-f5ce17a5161b service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:17:34.049084 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4496/8965] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:17:34 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:17:34.367198 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299daa4-a107-4b7f-aaf8-cc2d23e5b3d5 service swift] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:17:34.368620 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-f299daa4-a107-4b7f-aaf8-cc2d23e5b3d5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:34.468905 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299daa4-a107-4b7f-aaf8-cc2d23e5b3d5 service swift] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:17:34.474221 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3ee8b-7294-4f2e-ac33-07849ade51d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:17:34.474883 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3ee8b-7294-4f2e-ac33-07849ade51d6 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:34.475173 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3ee8b-7294-4f2e-ac33-07849ade51d6 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:34.475482 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3ee8b-7294-4f2e-ac33-07849ade51d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:34.477302 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-11f3ee8b-7294-4f2e-ac33-07849ade51d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:34.491508 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3ee8b-7294-4f2e-ac33-07849ade51d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:17:34.493535 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3ee8b-7294-4f2e-ac33-07849ade51d6 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:17:34.512165 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4470/8966] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:17:34 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:17:34.691082 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d83f94-c9d8-4fcc-a9b7-f5ce17a5161b service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:17:34.710183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d83f94-c9d8-4fcc-a9b7-f5ce17a5161b service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:17:34.716567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfd7a4-ebf4-408d-ac58-9dd1583ce3f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:17:34.717454 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfd7a4-ebf4-408d-ac58-9dd1583ce3f5 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:34.717896 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfd7a4-ebf4-408d-ac58-9dd1583ce3f5 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:34.718178 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfd7a4-ebf4-408d-ac58-9dd1583ce3f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:34.720275 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-d9cfd7a4-ebf4-408d-ac58-9dd1583ce3f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:34.733810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfd7a4-ebf4-408d-ac58-9dd1583ce3f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:17:34.736319 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfd7a4-ebf4-408d-ac58-9dd1583ce3f5 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:17:34.752375 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4497/8967] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:17:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:17:58.537818 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3ee8b-7294-4f2e-ac33-07849ade51d6 service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:17:58.539174 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-11f3ee8b-7294-4f2e-ac33-07849ade51d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:58.581534 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3ee8b-7294-4f2e-ac33-07849ade51d6 service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:17:58.586594 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b2d56-f986-4712-a7b2-f6be795fd257 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:17:58.587225 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b2d56-f986-4712-a7b2-f6be795fd257 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:17:58.587540 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b2d56-f986-4712-a7b2-f6be795fd257 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:17:58.587820 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b2d56-f986-4712-a7b2-f6be795fd257 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:17:58.589575 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-a73b2d56-f986-4712-a7b2-f6be795fd257 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:17:58.608144 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b2d56-f986-4712-a7b2-f6be795fd257 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:17:58.610335 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b2d56-f986-4712-a7b2-f6be795fd257 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:17:58.620067 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4471/8968] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:17:58 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:19:26.152554 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfd7a4-ebf4-408d-ac58-9dd1583ce3f5 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:19:26.192903 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfd7a4-ebf4-408d-ac58-9dd1583ce3f5 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:19:26.198362 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25cd71-4039-4ff7-9906-ddcb080b7910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:19:26.198993 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25cd71-4039-4ff7-9906-ddcb080b7910 service nova] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:26.199289 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25cd71-4039-4ff7-9906-ddcb080b7910 service nova] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:26.199567 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25cd71-4039-4ff7-9906-ddcb080b7910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:26.208096 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25cd71-4039-4ff7-9906-ddcb080b7910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:19:26.209669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25cd71-4039-4ff7-9906-ddcb080b7910 service nova] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:19:26.219019 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4498/8969] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:19:26 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:19:30.264392 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d35d-694d-4e82-86ce-ed380b319d2a None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:30.265701 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d35d-694d-4e82-86ce-ed380b319d2a None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:30.265797 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d35d-694d-4e82-86ce-ed380b319d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:30.311408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-c0d2d35d-694d-4e82-86ce-ed380b319d2a None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:19:30.313085 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c0d2d35d-694d-4e82-86ce-ed380b319d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:19:30.331822 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4472/8970] 10.222.0.21 () {58 vars in 1009 bytes} [Sat Nov 27 22:19:30 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:19:30.372153 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25cd71-4039-4ff7-9906-ddcb080b7910 service nova] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:19:30.394216 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25cd71-4039-4ff7-9906-ddcb080b7910 service nova] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:19:30.399471 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e615a-1329-4c69-8efc-ad20d06e2a3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:19:30.400107 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e615a-1329-4c69-8efc-ad20d06e2a3d service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:30.400395 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e615a-1329-4c69-8efc-ad20d06e2a3d service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:30.400658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e615a-1329-4c69-8efc-ad20d06e2a3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:30.408700 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e615a-1329-4c69-8efc-ad20d06e2a3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:19:30.410250 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e615a-1329-4c69-8efc-ad20d06e2a3d service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:19:30.418032 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4499/8971] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 22:19:30 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 22:19:39.915269 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0695a-4d01-490c-b978-14b2168c42ec None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:39.915808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0695a-4d01-490c-b978-14b2168c42ec None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:39.915808 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0695a-4d01-490c-b978-14b2168c42ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:39.947494 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-8fa0695a-4d01-490c-b978-14b2168c42ec None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:19:39.948939 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-8fa0695a-4d01-490c-b978-14b2168c42ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:19:39.965171 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4473/8972] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 22:19:39 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:19:39.978788 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e615a-1329-4c69-8efc-ad20d06e2a3d service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:19:39.989584 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e615a-1329-4c69-8efc-ad20d06e2a3d service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:19:39.994597 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4cdb6-8000-4835-98a2-702b852fc3b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:19:39.995229 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4cdb6-8000-4835-98a2-702b852fc3b1 service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:39.995535 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4cdb6-8000-4835-98a2-702b852fc3b1 service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:39.995810 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4cdb6-8000-4835-98a2-702b852fc3b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:40.004570 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4cdb6-8000-4835-98a2-702b852fc3b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:19:40.006152 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4cdb6-8000-4835-98a2-702b852fc3b1 service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:19:40.013908 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4500/8973] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 22:19:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 22:19:44.805235 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22361c-d0d2-458a-8934-ae7f3ff7859c None None] REQUEST_METHOD: `POST` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:44.805780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22361c-d0d2-458a-8934-ae7f3ff7859c None None] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:44.805780 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22361c-d0d2-458a-8934-ae7f3ff7859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:44.823736 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.auth.core [None req-1e22361c-d0d2-458a-8934-ae7f3ff7859c None None] MFA Rules not processed for user `93ed192079af4cad8a303e6c1b4da343`. Rule list: `[]` (Enabled: `True`). {{(pid=90122) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 27 22:19:44.824935 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-1e22361c-d0d2-458a-8934-ae7f3ff7859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:19:44.832031 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4474/8974] 10.222.0.21 () {58 vars in 967 bytes} [Sat Nov 27 22:19:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 27 22:19:44.844676 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4cdb6-8000-4835-98a2-702b852fc3b1 service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:19:44.855087 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4cdb6-8000-4835-98a2-702b852fc3b1 service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:19:44.860701 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee8fb5-4e35-4aac-b5bd-442f4126c7bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f39a303b702041259ebb6a66c5967528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:19:44.861367 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8fb5-4e35-4aac-b5bd-442f4126c7bb service swift] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:44.861610 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8fb5-4e35-4aac-b5bd-442f4126c7bb service swift] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:44.861883 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee8fb5-4e35-4aac-b5bd-442f4126c7bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:44.869762 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee8fb5-4e35-4aac-b5bd-442f4126c7bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:19:44.871373 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee8fb5-4e35-4aac-b5bd-442f4126c7bb service swift] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:19:44.880083 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4501/8975] 10.222.0.21 () {60 vars in 1384 bytes} [Sat Nov 27 22:19:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 27 22:19:46.115036 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22361c-d0d2-458a-8934-ae7f3ff7859c None None] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:19:46.129408 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22361c-d0d2-458a-8934-ae7f3ff7859c None None] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:19:46.135108 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8637171-6d9b-40f0-9990-7058e60b039f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa3373ab52dc4fe680372579cfcde718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:19:46.135795 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8637171-6d9b-40f0-9990-7058e60b039f service nova] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:46.136091 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8637171-6d9b-40f0-9990-7058e60b039f service nova] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:46.136371 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8637171-6d9b-40f0-9990-7058e60b039f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:46.138226 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-b8637171-6d9b-40f0-9990-7058e60b039f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:19:46.154944 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8637171-6d9b-40f0-9990-7058e60b039f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:19:46.156875 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8637171-6d9b-40f0-9990-7058e60b039f service nova] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:19:46.168092 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4475/8976] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:19:46 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:19:48.892542 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee8fb5-4e35-4aac-b5bd-442f4126c7bb service swift] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:19:48.901698 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee8fb5-4e35-4aac-b5bd-442f4126c7bb service swift] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:19:48.905279 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f887f-c616-40ef-8093-47db47bc5252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10914bd6817341eeafda6c3ded4ecfc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:19:48.905906 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f887f-c616-40ef-8093-47db47bc5252 service neutron] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:48.906253 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f887f-c616-40ef-8093-47db47bc5252 service neutron] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:48.906530 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f887f-c616-40ef-8093-47db47bc5252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:48.964677 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f887f-c616-40ef-8093-47db47bc5252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:19:48.966053 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f887f-c616-40ef-8093-47db47bc5252 service neutron] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:19:48.975765 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4502/8977] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:19:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:19:55.297891 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8637171-6d9b-40f0-9990-7058e60b039f service nova] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:19:55.313730 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8637171-6d9b-40f0-9990-7058e60b039f service nova] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:19:55.318301 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:19:55.319160 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:55.319612 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:55.319886 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] PATH_INFO: `/v3/users/601728112c7c4e689208826544604460` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:55.321104 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] RBAC: Authorizing `identity:delete_user(user_id=601728112c7c4e689208826544604460)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:19:55.323147 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:19:55.369394 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601728112c7c4e689208826544604460'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.369974 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601728112c7c4e689208826544604460'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.387380 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601728112c7c4e689208826544604460'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.388002 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601728112c7c4e689208826544604460'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.397802 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601728112c7c4e689208826544604460'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.414640 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4476/8978] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 22:19:55 2021] DELETE /identity/v3/users/601728112c7c4e689208826544604460 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:19:55.587308 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f887f-c616-40ef-8093-47db47bc5252 service neutron] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:19:55.597988 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f887f-c616-40ef-8093-47db47bc5252 service neutron] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:19:55.653842 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:19:55.654614 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:55.654902 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:55.655183 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] PATH_INFO: `/v3/projects/43420851d76644b8bd7d25b34365dce9` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:55.656915 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43420851d76644b8bd7d25b34365dce9)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:19:55.658868 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:19:55.704065 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43420851d76644b8bd7d25b34365dce9', 'request_id': 'req-c91eea55-8293-4877-8156-7a11fc90bf34'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.712658 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43420851d76644b8bd7d25b34365dce9', 'request_id': 'req-c91eea55-8293-4877-8156-7a11fc90bf34'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.719492 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43420851d76644b8bd7d25b34365dce9', 'request_id': 'req-c91eea55-8293-4877-8156-7a11fc90bf34'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.729546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] The token cache is being invalidate because project 43420851d76644b8bd7d25b34365dce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 22:19:55.729833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.730455 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.732038 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4503/8979] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 22:19:55 2021] DELETE /identity/v3/projects/43420851d76644b8bd7d25b34365dce9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:19:55.736732 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:19:55.738125 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:19:55.751356 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47ad98-9aa9-4eeb-886d-78b3b209981c admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:19:55.806800 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:19:55.807710 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:55.807994 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:55.808254 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] PATH_INFO: `/v3/users/89c8a0e2bf0f46c9b561f6c6488a658d` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:55.809449 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c8a0e2bf0f46c9b561f6c6488a658d)` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:19:55.811399 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:19:55.857742 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c8a0e2bf0f46c9b561f6c6488a658d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.858383 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c8a0e2bf0f46c9b561f6c6488a658d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.866049 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c8a0e2bf0f46c9b561f6c6488a658d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.866726 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c8a0e2bf0f46c9b561f6c6488a658d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.873603 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.notifications [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c8a0e2bf0f46c9b561f6c6488a658d'} {{(pid=90122) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:55.890566 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4477/8980] 10.222.0.21 () {58 vars in 1223 bytes} [Sat Nov 27 22:19:55 2021] DELETE /identity/v3/users/89c8a0e2bf0f46c9b561f6c6488a658d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:19:56.067995 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:19:56.069686 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:19:56.088448 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91eea55-8293-4877-8156-7a11fc90bf34 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:19:56.147669 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ad02887ca234176a8ab03d817e9a1ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5d1bf085ae456f8f7285f5a202640b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:19:56.148560 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:19:56.148976 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:19:56.149299 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] PATH_INFO: `/v3/projects/cf9d576ed99f4e5f89b93410451ee764` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:19:56.150598 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf9d576ed99f4e5f89b93410451ee764)` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:19:56.152524 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:19:56.197778 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf9d576ed99f4e5f89b93410451ee764', 'request_id': 'req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:56.205378 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf9d576ed99f4e5f89b93410451ee764', 'request_id': 'req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:56.211860 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf9d576ed99f4e5f89b93410451ee764', 'request_id': 'req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9'} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:56.222773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] The token cache is being invalidate because project cf9d576ed99f4e5f89b93410451ee764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90123) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 27 22:19:56.223062 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:56.223721 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.notifications [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90123) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 27 22:19:56.225276 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4504/8981] 10.222.0.21 () {58 vars in 1232 bytes} [Sat Nov 27 22:19:56 2021] DELETE /identity/v3/projects/cf9d576ed99f4e5f89b93410451ee764 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 27 22:22:36.250413 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:22:36.251850 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:22:36.318725 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddb0e5-d97b-40d1-827c-1846028cb120 admin admin] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:22:36.375459 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847469c-5bc6-4eab-9722-b4fa909ce50e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:22:36.376109 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847469c-5bc6-4eab-9722-b4fa909ce50e service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:22:36.376396 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847469c-5bc6-4eab-9722-b4fa909ce50e service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:22:36.376678 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847469c-5bc6-4eab-9722-b4fa909ce50e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:22:36.378460 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9847469c-5bc6-4eab-9722-b4fa909ce50e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:22:36.390193 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847469c-5bc6-4eab-9722-b4fa909ce50e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:22:36.391767 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847469c-5bc6-4eab-9722-b4fa909ce50e service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:22:36.401907 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4478/8982] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:22:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:23:03.479822 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:23:03.481228 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:23:03.495742 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a446e8d-e7c3-46ad-9251-bf134a6ac8a9 admin admin] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:23:03.500735 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292a50f-6936-4c68-b779-9a1f514b05da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:23:03.501365 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a50f-6936-4c68-b779-9a1f514b05da service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:23:03.501646 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a50f-6936-4c68-b779-9a1f514b05da service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:23:03.501917 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a50f-6936-4c68-b779-9a1f514b05da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:23:03.503647 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.fernet_utils [None req-e292a50f-6936-4c68-b779-9a1f514b05da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90123) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:23:03.515234 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292a50f-6936-4c68-b779-9a1f514b05da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:23:03.516815 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292a50f-6936-4c68-b779-9a1f514b05da service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:23:03.526430 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4505/8983] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:23:03 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:27:43.249570 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847469c-5bc6-4eab-9722-b4fa909ce50e service placement] Authenticating user token {{(pid=90122) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:27:43.250985 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.fernet_utils [None req-9847469c-5bc6-4eab-9722-b4fa909ce50e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90122) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 27 22:27:43.286069 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847469c-5bc6-4eab-9722-b4fa909ce50e service placement] Validating token access rules against request {{(pid=90122) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:27:43.291216 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aba022-bcec-411b-b0c7-6cf4de866714 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90122) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:27:43.291885 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aba022-bcec-411b-b0c7-6cf4de866714 service placement] REQUEST_METHOD: `GET` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:27:43.292171 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aba022-bcec-411b-b0c7-6cf4de866714 service placement] SCRIPT_NAME: `/identity` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:27:43.292453 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aba022-bcec-411b-b0c7-6cf4de866714 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90122) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:27:43.300864 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aba022-bcec-411b-b0c7-6cf4de866714 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:27:43.302454 ncdv-master-1 devstack@keystone.service[90122]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aba022-bcec-411b-b0c7-6cf4de866714 service placement] RBAC: Authorization granted {{(pid=90122) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:27:43.312063 ncdv-master-1 devstack@keystone.service[90122]: [pid: 90122|app: 0|req: 4479/8984] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:27:43 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 27 22:28:11.491503 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292a50f-6936-4c68-b779-9a1f514b05da service placement] Authenticating user token {{(pid=90123) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 27 22:28:11.513294 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292a50f-6936-4c68-b779-9a1f514b05da service placement] Validating token access rules against request {{(pid=90123) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 27 22:28:11.518773 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09acc14-835e-431e-811b-25ee5b75ddfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12473c7375ac477a85977655ccb3f514', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c371d9310548a3ac5cf1cb274d0e34', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90123) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 27 22:28:11.519546 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09acc14-835e-431e-811b-25ee5b75ddfb service placement] REQUEST_METHOD: `GET` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 27 22:28:11.519833 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09acc14-835e-431e-811b-25ee5b75ddfb service placement] SCRIPT_NAME: `/identity` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 27 22:28:11.520464 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09acc14-835e-431e-811b-25ee5b75ddfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90123) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 27 22:28:11.529106 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09acc14-835e-431e-811b-25ee5b75ddfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 27 22:28:11.530782 ncdv-master-1 devstack@keystone.service[90123]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09acc14-835e-431e-811b-25ee5b75ddfb service placement] RBAC: Authorization granted {{(pid=90123) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 27 22:28:11.542682 ncdv-master-1 devstack@keystone.service[90123]: [pid: 90123|app: 0|req: 4506/8985] 10.222.0.21 () {60 vars in 1365 bytes} [Sat Nov 27 22:28:11 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)